2024-09-10T09:16:21.518 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T09:16:21.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T09:16:21.632 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975 branch: wip-rishabh-testing-20240909.165402-squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7898975' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.0 ' name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCIo+iJhC+9bzgUyemaxPHLOR8DtZcVXHXt1kY3KbACi3CdxwdfrCrvzEYieYBQkWpZEqqdnAAqAjwWsRtZVRzk= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCiYNYt0p1TRqKFkx8DVjjE9DoBLqCTtioneRndSIRETfcfXTM5wsBGpDxJhbmyaEVImebB/Vx3YARXqeKhJ5RE= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.0 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.0 roleless: true - print: '**** done end installing v18.2.0 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-10T09:16:21.632 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T09:16:21.633 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T09:16:21.633 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T09:16:21.635 INFO:teuthology.task.internal:Checking packages... 2024-09-10T09:16:21.656 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T09:16:21.656 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T09:16:21.656 INFO:teuthology.packaging:ref: None 2024-09-10T09:16:21.657 INFO:teuthology.packaging:tag: None 2024-09-10T09:16:21.657 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:16:21.657 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:16:21.657 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:16:21.799 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T09:16:21.801 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T09:16:21.808 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T09:16:21.808 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T09:16:21.816 INFO:teuthology.task.internal:Saving configuration 2024-09-10T09:16:21.836 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T09:16:21.842 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T09:16:21.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:11:20.837081', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCIo+iJhC+9bzgUyemaxPHLOR8DtZcVXHXt1kY3KbACi3CdxwdfrCrvzEYieYBQkWpZEqqdnAAqAjwWsRtZVRzk='} 2024-09-10T09:16:21.886 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 09:11:20.835757', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCiYNYt0p1TRqKFkx8DVjjE9DoBLqCTtioneRndSIRETfcfXTM5wsBGpDxJhbmyaEVImebB/Vx3YARXqeKhJ5RE='} 2024-09-10T09:16:21.886 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T09:16:21.892 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-10T09:16:21.892 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-10T09:16:21.892 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T09:16:21.952 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe28110feb0>, signals=[15]) 2024-09-10T09:16:21.952 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T09:16:21.958 INFO:teuthology.task.internal:Opening connections... 2024-09-10T09:16:21.958 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:16:21.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:16:22.036 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-10T09:16:22.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:16:22.114 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T09:16:22.120 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-10T09:16:22.138 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-10T09:16:22.139 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-09-10T09:16:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:16:22.198 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:16:22.198 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:16:22.198 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:16:22.198 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:16:22.198 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:16:22.199 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-10T09:16:22.217 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-10T09:16:22.234 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-10T09:16:22.235 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-09-10T09:16:22.292 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T09:16:22.293 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-09-10T09:16:22.293 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T09:16:22.293 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T09:16:22.293 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T09:16:22.293 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-10T09:16:22.309 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T09:16:22.318 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T09:16:22.324 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T09:16:22.324 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:16:22.326 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-10T09:16:22.347 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T09:16:22.354 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T09:16:22.354 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:16:22.384 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-10T09:16:22.484 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T09:16:22.533 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T09:16:22.635 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T09:16:22.635 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T09:16:22.636 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:16:22.636 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T09:16:22.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:16:22.654 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-10T09:16:22.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:16:22.655 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-10T09:16:22.712 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-503.el9.x86_64 2024-09-10T09:16:22.713 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.14.0-503.el9.x86_64 2024-09-10T09:16:22.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2024-09-10T09:16:22.714 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-503.el9.x86_64 2024-09-10T09:16:22.714 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-503.el9.x86_64 2024-09-10T09:16:22.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-09-10T09:16:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-10T09:16:25.959 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-09-10T09:16:27.843 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-10T09:16:28.210 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-10T09:16:33.327 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-10T09:16:33.335 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-10T09:16:34.786 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-10T09:16:34.786 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-10T09:16:35.673 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T09:16:35.943 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-10T09:16:41.170 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T09:16:41.423 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T09:16:43.193 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T09:16:43.193 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T09:16:43.290 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:16:43.302 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:16:43.302 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:16:43.302 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:16:43.302 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:16:43.302 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages 2024-09-10T09:16:43.303 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:16:43.304 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 79 M 2024-09-10T09:16:43.304 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 126 M 2024-09-10T09:16:43.304 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:16:43.496 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T09:16:43.499 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T09:16:43.588 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T09:16:43.595 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 79 M 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 126 M 2024-09-10T09:16:43.596 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:16:43.825 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 240 kB/s | 23 kB 00:00 2024-09-10T09:16:43.938 INFO:teuthology.orchestra.run.smithi079.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 39 kB/s | 23 kB 00:00 2024-09-10T09:16:44.747 INFO:teuthology.orchestra.run.smithi079.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-10T09:16:45.413 INFO:teuthology.orchestra.run.smithi079.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-10T09:16:46.180 INFO:teuthology.orchestra.run.smithi079.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-10T09:16:46.180 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:16:46.181 INFO:teuthology.orchestra.run.smithi079.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-10T09:16:46.869 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:16:46.941 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-10T09:16:47.212 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:16:47.212 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:16:47.883 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 7.0 MB/s | 29 MB 00:04 2024-09-10T09:16:48.186 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:16:48.186 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:16:50.631 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:16:51.278 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:16:51.356 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:16:53.557 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.5 MB/s | 35 MB 00:09 2024-09-10T09:16:53.558 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:16:53.558 INFO:teuthology.orchestra.run.smithi135.stdout:Total 7.9 MB/s | 79 MB 00:09 2024-09-10T09:16:54.137 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:16:54.244 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:16:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:16:54.613 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:16:54.613 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:16:55.580 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:16:55.581 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:16:58.019 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:16:58.707 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:16:58.791 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:16:59.175 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:16:59.216 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:01.630 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:17:01.775 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:17:04.086 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:06.605 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:17:06.717 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:11.576 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:42.321 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:42.360 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:42.751 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:42.751 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:17:42.751 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:17:42.751 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:17:43.587 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:43.587 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:17:43.587 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:17:43.587 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T09:17:43.587 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T09:17:43.587 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T09:17:43.588 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T09:17:43.588 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:17:43.588 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:17:43.957 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:17:44.038 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:17:44.039 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:17:44.039 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T09:17:44.039 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T09:17:44.039 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T09:17:44.039 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-10T09:17:44.039 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T09:17:44.039 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:17:44.096 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:17:44.096 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:17:44.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.06 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 82.el9 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Group : Unspecified 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 8274670 2024-09-10T09:17:44.143 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : builder@centos.org 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : CentOS 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2024-09-10T09:17:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:17:44.145 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T09:17:44.145 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T09:17:44.145 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T09:17:44.145 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2024-09-10T09:17:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:17:44.145 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T09:17:44.146 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T09:17:44.146 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 5.14.0-505.el9.x86_64 2024-09-10T09:17:44.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T09:17:44.791 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-09-10T09:17:46.118 INFO:teuthology.orchestra.run.smithi079.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T09:17:46.151 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-09-10T09:17:46.154 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-10T09:17:46.169 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.r0nASzJ9Pi 2024-09-10T09:17:46.169 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.r0nASzJ9Pi 2024-09-10T09:17:46.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.r0nASzJ9Pi 2024-09-10T09:17:46.374 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.r0nASzJ9Pi is 6KB 2024-09-10T09:17:46.422 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.r0nASzJ9Pi 2024-09-10T09:17:46.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T09:17:46.510 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T09:17:46.510 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T09:17:46.510 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T09:17:46.510 INFO:teuthology.orchestra.run.smithi079.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T09:17:46.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T09:17:46.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-09-10T09:17:50.105 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:50.155 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:50.507 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:50.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T09:17:50.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T09:17:50.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T09:17:51.358 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T09:17:51.358 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:17:51.358 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:17:51.358 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T09:17:51.359 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T09:17:51.359 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T09:17:51.359 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T09:17:51.359 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:17:51.359 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:17:51.734 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:17:51.822 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:17:51.822 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:17:51.823 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T09:17:51.823 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T09:17:51.823 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T09:17:51.823 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-10T09:17:51.824 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T09:17:51.824 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T09:17:51.884 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T09:17:51.885 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T09:17:51.885 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-09-10T09:17:51.945 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-09-10T09:17:51.945 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 82.el9 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8274670 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T09:17:51.946 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:17:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T09:17:51.948 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T09:17:51.948 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-505.el9.x86_64 2024-09-10T09:17:51.948 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T09:17:52.595 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-09-10T09:17:54.005 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T09:17:54.035 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-09-10T09:17:54.041 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-10T09:17:54.097 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.ybKflP7sHe 2024-09-10T09:17:54.097 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ybKflP7sHe 2024-09-10T09:17:54.170 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.ybKflP7sHe 2024-09-10T09:17:54.307 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.ybKflP7sHe is 6KB 2024-09-10T09:17:54.356 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.ybKflP7sHe 2024-09-10T09:17:54.372 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T09:17:54.435 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T09:17:54.435 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T09:17:54.435 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T09:17:54.435 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T09:17:54.436 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T09:17:54.591 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-09-10T09:18:16.697 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-10T09:18:16.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-10T09:18:16.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:18:24.601 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-10T09:18:24.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T09:18:24.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:18:35.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-10T09:18:43.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-10T09:18:44.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-10T09:18:44.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:18:47.136 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-10T09:18:52.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T09:18:52.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:18:59.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-10T09:18:59.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:19:17.565 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-10T09:19:32.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-10T09:19:32.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:19:33.060 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-10T09:19:33.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-10T09:19:33.443 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-10T09:19:33.444 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-10T09:19:33.501 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-505.el9.x86_64 2024-09-10T09:19:33.502 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T09:19:33.502 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T09:19:33.502 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T09:19:34.504 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-10T09:19:34.505 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T09:19:34.625 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-09-10T09:19:34.654 DEBUG:teuthology.parallel:result is None 2024-09-10T09:19:52.012 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T09:20:04.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T09:20:04.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:20:04.409 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-10T09:20:04.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T09:20:04.741 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-10T09:20:04.741 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-10T09:20:04.756 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-505.el9.x86_64 2024-09-10T09:20:04.756 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T09:20:04.756 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T09:20:04.756 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T09:20:05.757 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-10T09:20:05.758 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T09:20:06.117 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-09-10T09:20:06.139 DEBUG:teuthology.parallel:result is None 2024-09-10T09:20:06.140 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T09:20:06.146 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T09:20:06.147 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:20:06.150 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T09:20:06.168 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T09:20:06.175 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T09:20:06.183 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T09:20:06.183 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:20:06.208 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T09:20:06.263 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T09:20:06.273 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T09:20:06.274 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:20:06.278 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T09:20:06.314 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:20:06.316 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:20:06.326 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:20:06.327 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T09:20:06.329 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T09:20:06.336 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T09:20:06.337 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:20:06.371 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T09:20:06.399 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T09:20:06.408 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T09:20:06.408 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:20:06.440 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T09:20:06.457 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:20:06.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:20:06.591 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:20:06.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:20:06.720 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:20:06.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:20:06.786 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:20:06.831 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T09:20:06.900 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:20:06.945 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T09:20:06.987 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:20:06.987 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T09:20:07.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-10T09:20:07.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-10T09:20:07.103 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:20:07.138 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:20:07.499 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T09:20:07.506 INFO:teuthology.task.internal:Starting timer... 2024-09-10T09:20:07.506 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T09:20:07.517 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T09:20:07.530 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T09:20:07.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-09-10T09:20:07.576 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-09-10T09:20:07.578 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-09-10T09:20:07.650 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-09-10T09:20:07.652 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T09:20:07.652 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-09-10T09:20:07.687 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-09-10T09:20:07.687 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-09-10T09:20:07.715 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-09-10T09:20:07.715 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-09-10T09:20:07.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:20:07.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:20:07.757 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:20:07.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:20:07.784 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T09:20:07.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:20:07.846 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-09-10T09:20:07.875 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T09:20:07.885 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T09:20:07.897 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T09:20:07.898 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T09:23:50.774 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-09-10T09:23:50.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-10T09:23:50.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:23:50.861 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-10T09:23:50.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-10T09:23:50.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T09:23:50.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T09:23:51.025 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-10T09:23:51.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T09:23:51.113 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T09:23:51.123 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T09:23:51.124 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:23:51.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:23:51.127 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T09:23:51.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:23:51.156 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:23:51.172 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:23:51.183 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T09:23:51.197 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-09-10T09:23:51.198 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T09:23:51.209 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-09-10T09:23:51.223 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-09-10T09:23:51.224 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:23:51.234 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-09-10T09:23:51.239 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:23:51.248 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T09:23:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T09:23:51.294 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:23:51.298 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:23:51.298 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-09-10T09:23:51.298 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.298 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.298 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.298 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.326 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:23:51.329 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:23:51.329 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-10T09:23:51.329 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.330 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.330 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.330 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:23:51.331 INFO:teuthology.run_tasks:Running task install... 2024-09-10T09:23:51.338 DEBUG:teuthology.task.install:project ceph 2024-09-10T09:23:51.338 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T09:23:51.338 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.0', 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T09:23:51.338 INFO:teuthology.task.install:Using flavor: default 2024-09-10T09:23:51.344 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T09:23:51.344 INFO:teuthology.task.install:extra packages: [] 2024-09-10T09:23:51.344 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-10T09:23:51.344 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T09:23:51.344 INFO:teuthology.packaging:ref: None 2024-09-10T09:23:51.345 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T09:23:51.345 INFO:teuthology.packaging:branch: None 2024-09-10T09:23:51.345 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:23:51.487 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.0^{} -> 5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T09:23:51.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T09:23:51.489 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': 'v18.2.0', 'wait_for_package': False} 2024-09-10T09:23:51.490 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T09:23:51.490 INFO:teuthology.packaging:ref: None 2024-09-10T09:23:51.490 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T09:23:51.490 INFO:teuthology.packaging:branch: None 2024-09-10T09:23:51.490 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:23:51.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T09:23:51.637 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-10T09:23:51.637 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-10T09:23:51.643 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/ 2024-09-10T09:23:51.643 INFO:teuthology.task.install.rpm:Package version is 18.2.0-0 2024-09-10T09:23:51.682 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:23:51.683 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:23:51.683 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:23:51.685 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/5dd24139a1eada541a3bc16b6941c5dde975e26d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T09:23:51.685 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:23:51.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T09:23:51.711 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T09:23:51.711 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T09:23:51.711 INFO:teuthology.packaging:ref: None 2024-09-10T09:23:51.711 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T09:23:51.711 INFO:teuthology.packaging:branch: None 2024-09-10T09:23:51.711 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:23:51.712 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:23:51.713 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-10T09:23:51.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T09:23:51.713 INFO:teuthology.packaging:ref: None 2024-09-10T09:23:51.713 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T09:23:51.713 INFO:teuthology.packaging:branch: None 2024-09-10T09:23:51.713 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:23:51.713 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T09:23:51.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:23:51.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T09:23:51.853 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:23:51.856 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T09:23:51.917 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-09-10T09:23:51.918 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-09-10T09:23:51.920 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-09-10T09:23:51.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-09-10T09:23:52.150 INFO:teuthology.orchestra.run.smithi079.stdout:45 files removed 2024-09-10T09:23:52.154 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-09-10T09:23:52.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw 2024-09-10T09:23:52.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw 2024-09-10T09:23:52.551 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 919 kB/s | 76 kB 00:00 2024-09-10T09:23:52.551 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 839 kB/s | 76 kB 00:00 2024-09-10T09:23:52.676 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 116 kB/s | 9.3 kB 00:00 2024-09-10T09:23:52.677 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 117 kB/s | 9.3 kB 00:00 2024-09-10T09:23:52.793 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 26 kB/s | 2.2 kB 00:00 2024-09-10T09:23:52.794 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 27 kB/s | 2.2 kB 00:00 2024-09-10T09:23:53.252 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-10T09:23:54.495 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-10T09:23:59.154 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 20 MB 00:03 2024-09-10T09:24:02.036 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-10T09:24:03.605 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-10T09:24:05.181 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-10T09:24:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-10T09:24:07.286 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-10T09:24:08.904 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-10T09:24:10.183 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-10T09:24:11.566 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-10T09:24:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:24:14.020 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T09:24:14.021 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-10T09:24:14.022 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T09:24:14.023 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:24:14.024 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:14.024 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:24:14.024 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:14.024 INFO:teuthology.orchestra.run.smithi079.stdout:Install 28 Packages 2024-09-10T09:24:14.024 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 2 Packages 2024-09-10T09:24:14.024 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:14.024 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 53 M 2024-09-10T09:24:14.025 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:24:14.484 INFO:teuthology.orchestra.run.smithi079.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 13 MB/s | 5.2 MB 00:00 2024-09-10T09:24:14.534 INFO:teuthology.orchestra.run.smithi079.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-10T09:24:14.635 INFO:teuthology.orchestra.run.smithi079.stdout:(3/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 14 MB/s | 7.6 MB 00:00 2024-09-10T09:24:14.676 INFO:teuthology.orchestra.run.smithi079.stdout:(4/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 4.5 MB/s | 653 kB 00:00 2024-09-10T09:24:14.735 INFO:teuthology.orchestra.run.smithi079.stdout:(5/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 4.6 MB/s | 474 kB 00:00 2024-09-10T09:24:14.869 INFO:teuthology.orchestra.run.smithi079.stdout:(6/30): librgw2-18.2.0-0.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-10T09:24:14.894 INFO:teuthology.orchestra.run.smithi079.stdout:(7/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 283 kB/s | 45 kB 00:00 2024-09-10T09:24:15.070 INFO:teuthology.orchestra.run.smithi079.stdout:(8/30): ceph-common-18.2.0-0.el9.x86_64.rpm 18 MB/s | 18 MB 00:00 2024-09-10T09:24:15.095 INFO:teuthology.orchestra.run.smithi079.stdout:(9/30): python3-ceph-common-18.2.0-0.el9.x86_64 529 kB/s | 119 kB 00:00 2024-09-10T09:24:15.120 INFO:teuthology.orchestra.run.smithi079.stdout:(10/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 689 kB/s | 155 kB 00:00 2024-09-10T09:24:15.154 INFO:teuthology.orchestra.run.smithi079.stdout:(11/30): python3-rados-18.2.0-0.el9.x86_64.rpm 3.7 MB/s | 321 kB 00:00 2024-09-10T09:24:15.190 INFO:teuthology.orchestra.run.smithi079.stdout:(12/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 3.1 MB/s | 297 kB 00:00 2024-09-10T09:24:15.213 INFO:teuthology.orchestra.run.smithi079.stdout:(13/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.1 MB/s | 99 kB 00:00 2024-09-10T09:24:15.297 INFO:teuthology.orchestra.run.smithi079.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 543 kB/s | 45 kB 00:00 2024-09-10T09:24:15.322 INFO:teuthology.orchestra.run.smithi079.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 798 kB/s | 107 kB 00:00 2024-09-10T09:24:15.355 INFO:teuthology.orchestra.run.smithi079.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 957 kB/s | 160 kB 00:00 2024-09-10T09:24:15.398 INFO:teuthology.orchestra.run.smithi079.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-10T09:24:15.423 INFO:teuthology.orchestra.run.smithi079.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-10T09:24:15.457 INFO:teuthology.orchestra.run.smithi079.stdout:(19/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-10T09:24:15.515 INFO:teuthology.orchestra.run.smithi079.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 942 kB/s | 111 kB 00:00 2024-09-10T09:24:15.541 INFO:teuthology.orchestra.run.smithi079.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-10T09:24:15.566 INFO:teuthology.orchestra.run.smithi079.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.1 MB/s | 309 kB 00:00 2024-09-10T09:24:15.591 INFO:teuthology.orchestra.run.smithi079.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-10T09:24:15.617 INFO:teuthology.orchestra.run.smithi079.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T09:24:15.650 INFO:teuthology.orchestra.run.smithi079.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-10T09:24:15.680 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T09:24:15.692 INFO:teuthology.orchestra.run.smithi079.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-10T09:24:15.751 INFO:teuthology.orchestra.run.smithi079.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T09:24:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:(28/30): librados2-18.2.0-0.el9.x86_64.rpm 24 MB/s | 3.3 MB 00:00 2024-09-10T09:24:15.893 INFO:teuthology.orchestra.run.smithi079.stdout:(29/30): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-10T09:24:15.943 INFO:teuthology.orchestra.run.smithi079.stdout:(30/30): librbd1-18.2.0-0.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-09-10T09:24:15.948 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:24:15.948 INFO:teuthology.orchestra.run.smithi079.stdout:Total 27 MB/s | 53 MB 00:01 2024-09-10T09:24:16.019 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:24:16.053 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:24:16.053 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:24:16.684 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:24:16.684 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:24:18.092 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:24:18.107 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:24:18.119 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:18.119 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T09:24:18.119 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:18.119 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:18.2.0-0.el9 ceph 7.6 M 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:18.2.0-0.el9 ceph 3.3 M 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:18.2.0-0.el9 ceph 5.2 M 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:18.2.0-0.el9 ceph 24 k 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T09:24:18.120 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:18.2.0-0.el9 ceph 653 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:18.2.0-0.el9 ceph 474 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:18.2.0-0.el9 ceph 45 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:18.2.0-0.el9 ceph 119 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:18.2.0-0.el9 ceph 155 k 2024-09-10T09:24:18.121 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:18.2.0-0.el9 ceph 321 k 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:18.2.0-0.el9 ceph 297 k 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:18.2.0-0.el9 ceph 99 k 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout:Install 28 Packages 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2024-09-10T09:24:18.122 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:18.123 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 53 M 2024-09-10T09:24:18.123 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:24:18.169 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-10T09:24:18.199 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-10T09:24:18.249 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-10T09:24:18.432 INFO:teuthology.orchestra.run.smithi135.stdout:(1/30): ceph-base-18.2.0-0.el9.x86_64.rpm 40 MB/s | 5.2 MB 00:00 2024-09-10T09:24:18.457 INFO:teuthology.orchestra.run.smithi135.stdout:(2/30): ceph-selinux-18.2.0-0.el9.x86_64.rpm 976 kB/s | 24 kB 00:00 2024-09-10T09:24:18.499 INFO:teuthology.orchestra.run.smithi135.stdout:(3/30): libcephfs2-18.2.0-0.el9.x86_64.rpm 15 MB/s | 653 kB 00:00 2024-09-10T09:24:18.541 INFO:teuthology.orchestra.run.smithi135.stdout:(4/30): libradosstriper1-18.2.0-0.el9.x86_64.rp 11 MB/s | 474 kB 00:00 2024-09-10T09:24:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-10T09:24:18.658 INFO:teuthology.orchestra.run.smithi135.stdout:(5/30): ceph-radosgw-18.2.0-0.el9.x86_64.rpm 21 MB/s | 7.6 MB 00:00 2024-09-10T09:24:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T09:24:18.683 INFO:teuthology.orchestra.run.smithi135.stdout:(6/30): python3-ceph-argparse-18.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-10T09:24:18.708 INFO:teuthology.orchestra.run.smithi135.stdout:(7/30): python3-ceph-common-18.2.0-0.el9.x86_64 4.7 MB/s | 119 kB 00:00 2024-09-10T09:24:18.734 INFO:teuthology.orchestra.run.smithi135.stdout:(8/30): python3-cephfs-18.2.0-0.el9.x86_64.rpm 6.1 MB/s | 155 kB 00:00 2024-09-10T09:24:18.759 INFO:teuthology.orchestra.run.smithi135.stdout:(9/30): python3-rados-18.2.0-0.el9.x86_64.rpm 13 MB/s | 321 kB 00:00 2024-09-10T09:24:18.765 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T09:24:18.826 INFO:teuthology.orchestra.run.smithi135.stdout:(10/30): librgw2-18.2.0-0.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T09:24:18.844 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T09:24:18.851 INFO:teuthology.orchestra.run.smithi135.stdout:(11/30): python3-rbd-18.2.0-0.el9.x86_64.rpm 3.2 MB/s | 297 kB 00:00 2024-09-10T09:24:18.875 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T09:24:18.877 INFO:teuthology.orchestra.run.smithi135.stdout:(12/30): python3-rgw-18.2.0-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-09-10T09:24:18.937 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T09:24:18.966 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-10T09:24:19.010 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T09:24:19.085 INFO:teuthology.orchestra.run.smithi135.stdout:(13/30): ceph-common-18.2.0-0.el9.x86_64.rpm 23 MB/s | 18 MB 00:00 2024-09-10T09:24:19.089 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T09:24:19.119 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T09:24:19.127 INFO:teuthology.orchestra.run.smithi135.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 388 kB/s | 107 kB 00:00 2024-09-10T09:24:19.161 INFO:teuthology.orchestra.run.smithi135.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 564 kB/s | 160 kB 00:00 2024-09-10T09:24:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T09:24:19.178 INFO:teuthology.orchestra.run.smithi135.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-10T09:24:19.228 INFO:teuthology.orchestra.run.smithi135.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-10T09:24:19.253 INFO:teuthology.orchestra.run.smithi135.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 560 kB/s | 42 kB 00:00 2024-09-10T09:24:19.279 INFO:teuthology.orchestra.run.smithi135.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-10T09:24:19.283 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-10T09:24:19.319 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-10T09:24:19.329 INFO:teuthology.orchestra.run.smithi135.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-09-10T09:24:19.354 INFO:teuthology.orchestra.run.smithi135.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-10T09:24:19.360 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-10T09:24:19.379 INFO:teuthology.orchestra.run.smithi135.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T09:24:19.392 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-09-10T09:24:19.405 INFO:teuthology.orchestra.run.smithi135.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.0 MB/s | 309 kB 00:00 2024-09-10T09:24:19.419 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-10T09:24:19.430 INFO:teuthology.orchestra.run.smithi135.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T09:24:19.463 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-10T09:24:19.464 INFO:teuthology.orchestra.run.smithi135.stdout:(25/30): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-10T09:24:19.498 INFO:teuthology.orchestra.run.smithi135.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-10T09:24:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-10T09:24:19.564 INFO:teuthology.orchestra.run.smithi135.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T09:24:19.623 INFO:teuthology.orchestra.run.smithi135.stdout:(28/30): librados2-18.2.0-0.el9.x86_64.rpm 26 MB/s | 3.3 MB 00:00 2024-09-10T09:24:19.682 INFO:teuthology.orchestra.run.smithi135.stdout:(29/30): librbd1-18.2.0-0.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-09-10T09:24:19.766 INFO:teuthology.orchestra.run.smithi135.stdout:(30/30): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-10T09:24:19.771 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:24:19.771 INFO:teuthology.orchestra.run.smithi135.stdout:Total 32 MB/s | 53 MB 00:01 2024-09-10T09:24:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-10T09:24:19.839 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:24:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T09:24:19.873 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:24:19.873 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:24:19.941 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T09:24:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-10T09:24:20.009 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-10T09:24:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-10T09:24:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T09:24:20.497 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:24:20.497 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:24:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T09:24:20.583 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-10T09:24:20.615 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-10T09:24:21.860 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:24:21.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-09-10T09:24:21.970 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-09-10T09:24:22.020 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-09-10T09:24:22.383 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-09-10T09:24:22.444 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T09:24:22.527 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T09:24:22.615 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T09:24:22.645 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T09:24:22.708 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T09:24:22.714 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T09:24:22.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-09-10T09:24:22.746 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T09:24:22.796 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T09:24:22.879 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T09:24:22.906 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T09:24:22.972 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T09:24:23.078 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/32 2024-09-10T09:24:23.114 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-09-10T09:24:23.156 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-09-10T09:24:23.187 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-09-10T09:24:23.214 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-09-10T09:24:23.258 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-09-10T09:24:23.290 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-09-10T09:24:23.298 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T09:24:23.334 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T09:24:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T09:24:23.434 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:24:23.434 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:24:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T09:24:23.589 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-09-10T09:24:23.629 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T09:24:23.718 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:18.2.0-0.el9.x86_64 20/32 2024-09-10T09:24:23.750 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:18.2.0-0.el9.x86_64 21/32 2024-09-10T09:24:23.786 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-09-10T09:24:24.186 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-09-10T09:24:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T09:24:24.286 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:18.2.0-0.el9.x86_64 24/32 2024-09-10T09:24:24.361 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:18.2.0-0.el9.x86_64 25/32 2024-09-10T09:24:24.400 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:18.2.0-0.el9.x86_64 26/32 2024-09-10T09:24:26.453 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T09:24:26.497 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T09:24:27.060 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:18.2.0-0.el9.x86_64 27/32 2024-09-10T09:24:27.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T09:24:27.209 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:18.2.0-0.el9.x86_64 28/32 2024-09-10T09:24:27.209 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T09:24:27.209 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T09:24:27.210 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:27.243 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T09:24:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T09:24:33.729 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-09-10T09:24:33.729 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-09-10T09:24:33.729 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-09-10T09:24:33.730 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-09-10T09:24:33.730 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-09-10T09:24:33.730 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-09-10T09:24:33.730 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-09-10T09:24:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T09:24:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T09:24:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:24:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:24:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:24:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T09:24:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T09:24:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T09:24:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T09:24:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-10T09:24:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-10T09:24:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-10T09:24:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-10T09:24:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T09:24:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-10T09:24:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-10T09:24:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T09:24:35.706 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-10T09:24:35.706 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-10T09:24:36.666 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-10T09:24:36.667 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T09:24:36.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:36.669 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:24:37.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-test 2024-09-10T09:24:37.514 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T09:24:37.514 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-09-10T09:24:37.514 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-09-10T09:24:37.514 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-09-10T09:24:37.514 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-09-10T09:24:37.515 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-09-10T09:24:37.515 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-09-10T09:24:37.515 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-09-10T09:24:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:37.634 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:26 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:24:37.764 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:24:37.765 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:37.766 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:24:37.766 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:37.766 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages 2024-09-10T09:24:37.766 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:37.766 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 40 M 2024-09-10T09:24:37.766 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 165 M 2024-09-10T09:24:37.766 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:24:37.958 INFO:teuthology.orchestra.run.smithi079.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-10T09:24:37.991 INFO:teuthology.orchestra.run.smithi079.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-10T09:24:38.293 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T09:24:38.319 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-0.el9.x86_64 30/32 2024-09-10T09:24:38.319 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:38.319 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T09:24:38.319 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:24:38.319 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T09:24:38.320 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:38.321 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T09:24:38.412 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-09-10T09:24:38.412 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T09:24:38.800 INFO:teuthology.orchestra.run.smithi079.stdout:(3/4): ceph-test-18.2.0-0.el9.x86_64.rpm 40 MB/s | 40 MB 00:00 2024-09-10T09:24:38.825 INFO:teuthology.orchestra.run.smithi079.stdout:(4/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 159 kB/s | 161 kB 00:01 2024-09-10T09:24:38.827 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:24:38.828 INFO:teuthology.orchestra.run.smithi079.stdout:Total 38 MB/s | 40 MB 00:01 2024-09-10T09:24:38.855 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:24:38.875 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:24:38.875 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:24:39.214 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:24:39.215 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:18.2.0-0.el9.x86_64 1/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:18.2.0-0.el9.x86_64 2/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:18.2.0-0.el9.x86_64 3/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:18.2.0-0.el9.x86_64 4/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:18.2.0-0.el9.x86_64 5/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:18.2.0-0.el9.x86_64 6/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:18.2.0-0.el9.x86_64 7/32 2024-09-10T09:24:39.560 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:18.2.0-0.el9.x86_64 8/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:18.2.0-0.el9.x86_64 9/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:18.2.0-0.el9.x86_64 10/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:18.2.0-0.el9.x86_64 11/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:18.2.0-0.el9.x86_64 12/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:18.2.0-0.el9.x86_64 13/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-09-10T09:24:39.561 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-20.el9.x86_64 27/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:18.2.0-0.el9.x86_64 29/32 2024-09-10T09:24:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-09-10T09:24:39.563 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:18.2.0-0.el9.x86_64 31/32 2024-09-10T09:24:39.685 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:24:39.767 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T09:24:39.814 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T09:24:39.869 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:18.2.0-0.el9.x86_64 librbd1-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.577 INFO:teuthology.orchestra.run.smithi135.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.578 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.579 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:40.580 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T09:24:40.580 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T09:24:40.580 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:40.580 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:24:40.941 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-test 2024-09-10T09:24:41.511 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:26 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:24:41.642 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:24:41.643 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:41.643 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:24:41.643 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:41.643 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:24:41.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:18.2.0-0.el9 ceph 40 M 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:18.2.0-0.el9 ceph 161 k 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-09-10T09:24:41.644 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:41.645 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 40 M 2024-09-10T09:24:41.645 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 165 M 2024-09-10T09:24:41.645 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:24:41.751 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): libcephsqlite-18.2.0-0.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-10T09:24:41.876 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-10T09:24:41.893 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-10T09:24:42.285 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): ceph-test-18.2.0-0.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2024-09-10T09:24:42.287 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:24:42.288 INFO:teuthology.orchestra.run.smithi135.stdout:Total 62 MB/s | 40 MB 00:00 2024-09-10T09:24:42.314 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:24:42.333 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:24:42.333 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:24:42.667 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:24:42.667 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:24:43.153 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:24:43.229 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-10T09:24:43.267 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-10T09:24:43.295 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T09:24:43.620 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T09:24:43.701 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T09:24:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T09:24:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-10T09:24:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-10T09:24:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T09:24:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T09:24:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:46.100 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:24:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:46.100 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:24:46.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:46.101 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:24:46.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph 2024-09-10T09:24:46.984 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:35 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:24:47.001 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:18.2.0-0.el9.x86_64 3/4 2024-09-10T09:24:47.077 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T09:24:47.123 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T09:24:47.126 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:24:47.127 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:24:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:24:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:24:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:24:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:24:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:24:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout:Install 33 Packages 2024-09-10T09:24:47.129 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:47.130 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 30 M 2024-09-10T09:24:47.130 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 109 M 2024-09-10T09:24:47.130 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:24:47.337 INFO:teuthology.orchestra.run.smithi079.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 77 kB/s | 6.4 kB 00:00 2024-09-10T09:24:47.396 INFO:teuthology.orchestra.run.smithi079.stdout:(2/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 15 MB/s | 2.1 MB 00:00 2024-09-10T09:24:47.713 INFO:teuthology.orchestra.run.smithi079.stdout:(3/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 3.1 MB/s | 1.4 MB 00:00 2024-09-10T09:24:47.780 INFO:teuthology.orchestra.run.smithi079.stdout:(4/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-10T09:24:47.805 INFO:teuthology.orchestra.run.smithi079.stdout:(5/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 2.6 MB/s | 240 kB 00:00 2024-09-10T09:24:48.006 INFO:teuthology.orchestra.run.smithi079.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 29 MB/s | 18 MB 00:00 2024-09-10T09:24:48.147 INFO:teuthology.orchestra.run.smithi079.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 753 kB/s | 106 kB 00:00 2024-09-10T09:24:48.181 INFO:teuthology.orchestra.run.smithi079.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 632 kB/s | 253 kB 00:00 2024-09-10T09:24:48.223 INFO:teuthology.orchestra.run.smithi079.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.7 MB/s | 135 kB 00:00 2024-09-10T09:24:48.290 INFO:teuthology.orchestra.run.smithi079.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-10T09:24:48.315 INFO:teuthology.orchestra.run.smithi079.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 931 kB/s | 125 kB 00:00 2024-09-10T09:24:48.457 INFO:teuthology.orchestra.run.smithi079.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 245 kB/s | 35 kB 00:00 2024-09-10T09:24:48.491 INFO:teuthology.orchestra.run.smithi079.stdout:(13/33): python3-cryptography-36.0.1-4.el9.x86_ 1.8 MB/s | 1.2 MB 00:00 2024-09-10T09:24:48.574 INFO:teuthology.orchestra.run.smithi079.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 606 kB/s | 172 kB 00:00 2024-09-10T09:24:48.591 INFO:teuthology.orchestra.run.smithi079.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 380 kB/s | 51 kB 00:00 2024-09-10T09:24:48.625 INFO:teuthology.orchestra.run.smithi079.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 862 kB/s | 43 kB 00:00 2024-09-10T09:24:48.642 INFO:teuthology.orchestra.run.smithi079.stdout:(17/33): python3-toml-0.10.2-6.el9.noarch.rpm 275 kB/s | 42 kB 00:00 2024-09-10T09:24:48.676 INFO:teuthology.orchestra.run.smithi079.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-10T09:24:48.693 INFO:teuthology.orchestra.run.smithi079.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-09-10T09:24:48.710 INFO:teuthology.orchestra.run.smithi079.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 553 kB/s | 18 kB 00:00 2024-09-10T09:24:48.735 INFO:teuthology.orchestra.run.smithi079.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-09-10T09:24:48.769 INFO:teuthology.orchestra.run.smithi079.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 305 kB/s | 23 kB 00:00 2024-09-10T09:24:48.794 INFO:teuthology.orchestra.run.smithi079.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 230 kB/s | 19 kB 00:00 2024-09-10T09:24:48.819 INFO:teuthology.orchestra.run.smithi079.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 234 kB/s | 20 kB 00:00 2024-09-10T09:24:48.845 INFO:teuthology.orchestra.run.smithi079.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 612 kB/s | 46 kB 00:00 2024-09-10T09:24:48.870 INFO:teuthology.orchestra.run.smithi079.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-10T09:24:48.895 INFO:teuthology.orchestra.run.smithi079.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 325 kB/s | 16 kB 00:00 2024-09-10T09:24:48.921 INFO:teuthology.orchestra.run.smithi079.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-10T09:24:48.946 INFO:teuthology.orchestra.run.smithi079.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-10T09:24:48.971 INFO:teuthology.orchestra.run.smithi079.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-10T09:24:48.997 INFO:teuthology.orchestra.run.smithi079.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 801 kB/s | 20 kB 00:00 2024-09-10T09:24:49.022 INFO:teuthology.orchestra.run.smithi079.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T09:24:49.040 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-test-2:18.2.0-0.el9.x86_64 4/4 2024-09-10T09:24:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:18.2.0-0.el9.x86_64 1/4 2024-09-10T09:24:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:18.2.0-0.el9.x86_64 2/4 2024-09-10T09:24:49.041 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-10T09:24:49.056 INFO:teuthology.orchestra.run.smithi079.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-10T09:24:49.060 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:24:49.060 INFO:teuthology.orchestra.run.smithi079.stdout:Total 16 MB/s | 30 MB 00:01 2024-09-10T09:24:49.178 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:24:49.214 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:24:49.215 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:24:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-10T09:24:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:49.332 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:24:49.332 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:18.2.0-0.el9.x86_64 libcephsqlite-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T09:24:49.333 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:49.333 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:24:49.614 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph 2024-09-10T09:24:49.622 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:24:49.623 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:24:50.188 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:35 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:24:50.330 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:24:50.332 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:50.332 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T09:24:50.332 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:50.332 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:18.2.0-0.el9 ceph 6.4 k 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:18.2.0-0.el9 ceph 2.1 M 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:18.2.0-0.el9 ceph 1.4 M 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:18.2.0-0.el9 ceph-noarch 240 k 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:18.2.0-0.el9 ceph 4.4 M 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:18.2.0-0.el9 ceph 18 M 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T09:24:50.333 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T09:24:50.334 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout:Install 33 Packages 2024-09-10T09:24:50.335 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:50.336 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 30 M 2024-09-10T09:24:50.336 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 109 M 2024-09-10T09:24:50.336 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:24:50.744 INFO:teuthology.orchestra.run.smithi135.stdout:(1/33): ceph-18.2.0-0.el9.x86_64.rpm 137 kB/s | 6.4 kB 00:00 2024-09-10T09:24:50.794 INFO:teuthology.orchestra.run.smithi135.stdout:(2/33): ceph-mgr-18.2.0-0.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-10T09:24:50.844 INFO:teuthology.orchestra.run.smithi135.stdout:(3/33): ceph-mds-18.2.0-0.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2024-09-10T09:24:50.871 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:24:50.878 INFO:teuthology.orchestra.run.smithi135.stdout:(4/33): ceph-mgr-modules-core-18.2.0-0.el9.noar 7.1 MB/s | 240 kB 00:00 2024-09-10T09:24:50.934 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-10T09:24:50.953 INFO:teuthology.orchestra.run.smithi135.stdout:(5/33): ceph-mon-18.2.0-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-10T09:24:50.967 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-10T09:24:51.008 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-10T09:24:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-10T09:24:51.187 INFO:teuthology.orchestra.run.smithi135.stdout:(6/33): ceph-osd-18.2.0-0.el9.x86_64.rpm 45 MB/s | 18 MB 00:00 2024-09-10T09:24:51.188 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-10T09:24:51.237 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-10T09:24:51.280 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-10T09:24:51.310 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-10T09:24:51.320 INFO:teuthology.orchestra.run.smithi135.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 800 kB/s | 106 kB 00:00 2024-09-10T09:24:51.345 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-10T09:24:51.346 INFO:teuthology.orchestra.run.smithi135.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 542 kB/s | 253 kB 00:00 2024-09-10T09:24:51.378 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-10T09:24:51.387 INFO:teuthology.orchestra.run.smithi135.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-10T09:24:51.446 INFO:teuthology.orchestra.run.smithi135.stdout:(10/33): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-10T09:24:51.449 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-10T09:24:51.472 INFO:teuthology.orchestra.run.smithi135.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 994 kB/s | 125 kB 00:00 2024-09-10T09:24:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-10T09:24:51.530 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-10T09:24:51.568 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-10T09:24:51.613 INFO:teuthology.orchestra.run.smithi135.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 245 kB/s | 35 kB 00:00 2024-09-10T09:24:51.641 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-10T09:24:51.714 INFO:teuthology.orchestra.run.smithi135.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 643 kB/s | 172 kB 00:00 2024-09-10T09:24:51.739 INFO:teuthology.orchestra.run.smithi135.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2024-09-10T09:24:51.781 INFO:teuthology.orchestra.run.smithi135.stdout:(15/33): python3-cryptography-36.0.1-4.el9.x86_ 1.5 MB/s | 1.2 MB 00:00 2024-09-10T09:24:51.795 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-10T09:24:51.806 INFO:teuthology.orchestra.run.smithi135.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 452 kB/s | 42 kB 00:00 2024-09-10T09:24:51.857 INFO:teuthology.orchestra.run.smithi135.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 370 kB/s | 43 kB 00:00 2024-09-10T09:24:51.877 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-10T09:24:51.882 INFO:teuthology.orchestra.run.smithi135.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 461 kB/s | 11 kB 00:00 2024-09-10T09:24:51.907 INFO:teuthology.orchestra.run.smithi135.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T09:24:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-10T09:24:51.932 INFO:teuthology.orchestra.run.smithi135.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-10T09:24:51.958 INFO:teuthology.orchestra.run.smithi135.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 928 kB/s | 23 kB 00:00 2024-09-10T09:24:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-10T09:24:51.983 INFO:teuthology.orchestra.run.smithi135.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-10T09:24:52.008 INFO:teuthology.orchestra.run.smithi135.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 792 kB/s | 20 kB 00:00 2024-09-10T09:24:52.022 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-10T09:24:52.033 INFO:teuthology.orchestra.run.smithi135.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-10T09:24:52.059 INFO:teuthology.orchestra.run.smithi135.stdout:(25/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-10T09:24:52.076 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-10T09:24:52.084 INFO:teuthology.orchestra.run.smithi135.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-10T09:24:52.109 INFO:teuthology.orchestra.run.smithi135.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-10T09:24:52.135 INFO:teuthology.orchestra.run.smithi135.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-10T09:24:52.160 INFO:teuthology.orchestra.run.smithi135.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2024-09-10T09:24:52.185 INFO:teuthology.orchestra.run.smithi135.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-10T09:24:52.210 INFO:teuthology.orchestra.run.smithi135.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 809 kB/s | 20 kB 00:00 2024-09-10T09:24:52.235 INFO:teuthology.orchestra.run.smithi135.stdout:(32/33): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T09:24:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-10T09:24:52.269 INFO:teuthology.orchestra.run.smithi135.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-10T09:24:52.273 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:24:52.274 INFO:teuthology.orchestra.run.smithi135.stdout:Total 15 MB/s | 30 MB 00:01 2024-09-10T09:24:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-10T09:24:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-10T09:24:52.392 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:24:52.429 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:24:52.429 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:24:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-10T09:24:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-10T09:24:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-10T09:24:52.795 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-10T09:24:52.822 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T09:24:52.837 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:24:52.837 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:24:52.848 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T09:24:52.848 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:52.849 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:24:52.849 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:24:52.849 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:24:52.849 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:54.069 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:24:54.172 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-09-10T09:24:54.205 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-09-10T09:24:54.237 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-09-10T09:24:54.330 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-09-10T09:24:54.348 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T09:24:54.375 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T09:24:54.375 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:54.375 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:24:54.375 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:24:54.375 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:24:54.376 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:54.408 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-09-10T09:24:54.449 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/33 2024-09-10T09:24:54.492 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-09-10T09:24:54.522 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-09-10T09:24:54.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-09-10T09:24:54.589 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-09-10T09:24:54.630 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-09-10T09:24:54.681 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-09-10T09:24:54.719 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-09-10T09:24:54.757 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-09-10T09:24:54.815 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T09:24:54.831 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-09-10T09:24:54.839 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T09:24:54.839 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:54.839 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:24:54.839 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:24:54.839 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:24:54.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:54.968 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-09-10T09:24:55.057 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-09-10T09:24:55.057 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T09:24:55.081 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T09:24:55.081 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:55.081 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:24:55.081 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:24:55.081 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:24:55.081 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:55.119 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-09-10T09:24:55.145 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T09:24:55.165 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-09-10T09:24:55.217 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-09-10T09:24:55.270 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-09-10T09:24:55.455 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-09-10T09:24:55.512 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-09-10T09:24:55.597 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-09-10T09:24:55.685 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-09-10T09:24:55.735 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-09-10T09:24:55.851 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-09-10T09:24:56.023 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 28/33 2024-09-10T09:24:56.063 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T09:24:56.088 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:18.2.0-0.el9.x86_64 29/33 2024-09-10T09:24:56.088 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:56.088 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T09:24:56.088 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:24:56.088 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T09:24:56.089 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T09:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-10T09:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-10T09:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-10T09:24:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-10T09:24:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-10T09:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-10T09:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-10T09:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-10T09:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-10T09:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-10T09:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-10T09:24:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-10T09:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-10T09:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-10T09:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-10T09:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-10T09:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-10T09:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-10T09:24:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-10T09:24:57.665 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T09:24:57.693 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:18.2.0-0.el9.x86_64 30/33 2024-09-10T09:24:57.694 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:57.694 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T09:24:57.694 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:24:57.694 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T09:24:57.694 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:57.847 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-10T09:24:57.847 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:57.847 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:24:57.847 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:24:57.848 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:24:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:57.850 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:24:58.226 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-base 2024-09-10T09:24:58.305 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T09:24:58.329 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:18.2.0-0.el9.x86_64 31/33 2024-09-10T09:24:58.329 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:58.330 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T09:24:58.330 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:24:58.330 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T09:24:58.330 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:58.549 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T09:24:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:18.2.0-0.el9.x86_64 32/33 2024-09-10T09:24:58.573 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:24:58.573 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T09:24:58.573 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:24:58.573 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T09:24:58.573 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:24:58.638 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T09:24:58.791 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:47 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:24:58.880 INFO:teuthology.orchestra.run.smithi079.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:24:58.922 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:24:58.923 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:24:58.923 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:24:58.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install cephadm 2024-09-10T09:24:59.570 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:48 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:24:59.703 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 209 k 2024-09-10T09:24:59.704 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 200 k 2024-09-10T09:24:59.705 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:24:59.769 INFO:teuthology.orchestra.run.smithi079.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.2 MB/s | 209 kB 00:00 2024-09-10T09:24:59.770 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:24:59.770 INFO:teuthology.orchestra.run.smithi079.stdout:Total 3.1 MB/s | 209 kB 00:00 2024-09-10T09:24:59.770 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:24:59.775 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:24:59.776 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:24:59.778 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:24:59.778 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:24:59.847 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:00.295 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-2:18.2.0-0.el9.x86_64 33/33 2024-09-10T09:25:00.295 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:18.2.0-0.el9.x86_64 1/33 2024-09-10T09:25:00.295 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:18.2.0-0.el9.x86_64 2/33 2024-09-10T09:25:00.295 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:18.2.0-0.el9.x86_64 3/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:18.2.0-0.el9.x86_64 4/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:18.2.0-0.el9.x86_64 5/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 6/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-09-10T09:25:00.296 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-09-10T09:25:00.297 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-09-10T09:25:00.298 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-09-10T09:25:00.298 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-09-10T09:25:00.298 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 31/33 2024-09-10T09:25:00.298 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-09-10T09:25:00.299 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:00.390 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:00.742 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:00.981 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:00.982 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:00.982 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:00.982 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-10T09:25:00.982 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:00.982 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:01.158 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-09-10T09:25:01.158 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:01.158 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:01.158 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:01.158 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:01.158 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:01.158 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:18.2.0-0.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T09:25:01.159 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T09:25:01.160 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T09:25:01.161 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T09:25:01.161 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T09:25:01.161 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:01.161 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:01.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T09:25:01.536 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-base 2024-09-10T09:25:01.777 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:50 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:01.910 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:01.910 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:01.910 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repo Size 2024-09-10T09:25:01.910 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:01.910 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:01.911 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-10T09:25:01.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:01.911 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:01.911 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:01.911 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-09-10T09:25:01.911 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:01.911 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 142 k 2024-09-10T09:25:01.912 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 399 k 2024-09-10T09:25:01.912 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:01.978 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.1 MB/s | 142 kB 00:00 2024-09-10T09:25:01.978 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:01.979 INFO:teuthology.orchestra.run.smithi079.stdout:Total 2.0 MB/s | 142 kB 00:00 2024-09-10T09:25:01.979 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:01.987 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:01.987 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:02.050 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:02.050 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:02.113 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:47 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:02.202 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-base-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:02.245 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:02.246 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:02.246 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:02.271 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:02.296 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:02.296 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:25:02.296 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:25:02.296 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:02.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install cephadm 2024-09-10T09:25:02.881 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:47 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:03.013 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:03.014 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:03.014 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:03.014 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:18.2.0-0.el9 ceph-noarch 209 k 2024-09-10T09:25:03.014 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:03.014 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:03.015 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:03.015 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-09-10T09:25:03.015 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:03.015 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 209 k 2024-09-10T09:25:03.015 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 200 k 2024-09-10T09:25:03.015 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:03.073 INFO:teuthology.orchestra.run.smithi135.stdout:cephadm-18.2.0-0.el9.noarch.rpm 3.5 MB/s | 209 kB 00:00 2024-09-10T09:25:03.073 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:03.074 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.4 MB/s | 209 kB 00:00 2024-09-10T09:25:03.074 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:03.079 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:03.079 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:03.081 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:03.082 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:03.155 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:03.245 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:03.246 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:03.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr 2024-09-10T09:25:03.542 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:03.618 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:03.987 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:04.030 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:04.124 INFO:teuthology.orchestra.run.smithi079.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:04.166 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:04.167 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:04.167 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:04.223 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:18.2.0-0.el9.noarch 1/1 2024-09-10T09:25:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:04.224 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:18.2.0-0.el9.noarch 2024-09-10T09:25:04.224 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:04.224 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:04.235 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T09:25:04.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-immutable-object-cache 2024-09-10T09:25:04.795 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:04.926 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:04.926 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:04.926 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-10T09:25:04.927 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:04.927 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:04.927 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-10T09:25:04.927 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:25:04.927 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-10T09:25:04.927 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-10T09:25:04.928 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-10T09:25:04.928 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:25:04.928 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:25:04.928 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-09-10T09:25:04.928 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-10T09:25:04.929 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:04.929 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:04.929 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:04.929 INFO:teuthology.orchestra.run.smithi079.stdout:Install 7 Packages 2024-09-10T09:25:04.930 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:04.931 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 2.0 M 2024-09-10T09:25:04.931 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 8.1 M 2024-09-10T09:25:04.931 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:05.019 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:50 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:05.025 INFO:teuthology.orchestra.run.smithi079.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 349 kB/s | 23 kB 00:00 2024-09-10T09:25:05.059 INFO:teuthology.orchestra.run.smithi079.stdout:(2/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 273 kB/s | 9.0 kB 00:00 2024-09-10T09:25:05.076 INFO:teuthology.orchestra.run.smithi079.stdout:(3/7): python3-jwt-2.4.0-1.el9.noarch.rpm 2.4 MB/s | 41 kB 00:00 2024-09-10T09:25:05.093 INFO:teuthology.orchestra.run.smithi079.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.8 MB/s | 31 kB 00:00 2024-09-10T09:25:05.118 INFO:teuthology.orchestra.run.smithi079.stdout:(5/7): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-10T09:25:05.156 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:05.156 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repo Size 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-0.el9 ceph 142 k 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-09-10T09:25:05.157 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:05.158 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 142 k 2024-09-10T09:25:05.158 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 399 k 2024-09-10T09:25:05.158 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:05.160 INFO:teuthology.orchestra.run.smithi079.stdout:(6/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.4 MB/s | 1.7 MB 00:00 2024-09-10T09:25:05.177 INFO:teuthology.orchestra.run.smithi079.stdout:(7/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 67 kB/s | 15 kB 00:00 2024-09-10T09:25:05.180 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:05.180 INFO:teuthology.orchestra.run.smithi079.stdout:Total 7.9 MB/s | 2.0 MB 00:00 2024-09-10T09:25:05.180 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:05.188 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:05.188 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:05.213 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-immutable-object-cache-18.2.0-0.el9.x86_64 2.5 MB/s | 142 kB 00:00 2024-09-10T09:25:05.214 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:05.214 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.4 MB/s | 142 kB 00:00 2024-09-10T09:25:05.215 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:05.222 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:05.222 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:05.258 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:05.259 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:05.281 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:05.281 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:05.433 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:05.540 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:05.555 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T09:25:05.565 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:05.612 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-10T09:25:05.645 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-10T09:25:05.693 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-10T09:25:05.724 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-10T09:25:05.753 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-10T09:25:05.981 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-10T09:25:06.015 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T09:25:06.520 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:06.521 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:06.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:06.521 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:06.564 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T09:25:06.564 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-10T09:25:06.564 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-10T09:25:06.564 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-10T09:25:06.564 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-10T09:25:06.564 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-10T09:25:06.564 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-10T09:25:06.733 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr 2024-09-10T09:25:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-10T09:25:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:06.835 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-10T09:25:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-10T09:25:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-10T09:25:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-10T09:25:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-10T09:25:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:25:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:25:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:06.836 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:07.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T09:25:07.327 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:52 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:07.431 INFO:teuthology.orchestra.run.smithi135.stdout:Package ceph-mgr-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:07.474 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:07.475 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:07.475 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:07.544 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-dashboard 2024-09-10T09:25:07.616 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:56 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:07.748 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:25:07.749 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout:Install 12 Packages 2024-09-10T09:25:07.750 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:07.751 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 38 M 2024-09-10T09:25:07.751 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 212 M 2024-09-10T09:25:07.751 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:07.951 INFO:teuthology.orchestra.run.smithi079.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-10T09:25:07.993 INFO:teuthology.orchestra.run.smithi079.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-10T09:25:08.094 INFO:teuthology.orchestra.run.smithi079.stdout:(3/12): ceph-mgr-diskprediction-local-18.2.0-0. 26 MB/s | 7.4 MB 00:00 2024-09-10T09:25:08.119 INFO:teuthology.orchestra.run.smithi079.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 195 kB/s | 33 kB 00:00 2024-09-10T09:25:08.121 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:53 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:08.186 INFO:teuthology.orchestra.run.smithi079.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 198 kB/s | 18 kB 00:00 2024-09-10T09:25:08.211 INFO:teuthology.orchestra.run.smithi079.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-10T09:25:08.254 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:08.255 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:08.255 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T09:25:08.255 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:18.2.0-0.el9 ceph-noarch 1.7 M 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:18.2.0-0.el9 ceph-noarch 23 k 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:18.2.0-0.el9 ceph-noarch 15 k 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:08.256 INFO:teuthology.orchestra.run.smithi135.stdout:Install 7 Packages 2024-09-10T09:25:08.257 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:08.257 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 2.0 M 2024-09-10T09:25:08.257 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 8.1 M 2024-09-10T09:25:08.257 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:08.337 INFO:teuthology.orchestra.run.smithi079.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-10T09:25:08.343 INFO:teuthology.orchestra.run.smithi135.stdout:(1/7): ceph-grafana-dashboards-18.2.0-0.el9.noa 445 kB/s | 23 kB 00:00 2024-09-10T09:25:08.368 INFO:teuthology.orchestra.run.smithi135.stdout:(2/7): ceph-prometheus-alerts-18.2.0-0.el9.noar 190 kB/s | 15 kB 00:00 2024-09-10T09:25:08.404 INFO:teuthology.orchestra.run.smithi079.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.3 MB/s | 3.0 MB 00:00 2024-09-10T09:25:08.410 INFO:teuthology.orchestra.run.smithi135.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-10T09:25:08.435 INFO:teuthology.orchestra.run.smithi135.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-10T09:25:08.460 INFO:teuthology.orchestra.run.smithi135.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-10T09:25:08.471 INFO:teuthology.orchestra.run.smithi079.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2024-09-10T09:25:08.496 INFO:teuthology.orchestra.run.smithi079.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-10T09:25:08.502 INFO:teuthology.orchestra.run.smithi135.stdout:(6/7): ceph-mgr-dashboard-18.2.0-0.el9.noarch.r 8.0 MB/s | 1.7 MB 00:00 2024-09-10T09:25:08.528 INFO:teuthology.orchestra.run.smithi135.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2024-09-10T09:25:08.531 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:08.531 INFO:teuthology.orchestra.run.smithi135.stdout:Total 7.3 MB/s | 2.0 MB 00:00 2024-09-10T09:25:08.532 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:08.539 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:08.539 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:08.613 INFO:teuthology.orchestra.run.smithi079.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-10T09:25:08.633 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:08.634 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:08.872 INFO:teuthology.orchestra.run.smithi079.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-10T09:25:08.873 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:08.873 INFO:teuthology.orchestra.run.smithi079.stdout:Total 34 MB/s | 38 MB 00:01 2024-09-10T09:25:08.933 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:08.987 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-10T09:25:09.022 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-10T09:25:09.068 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-10T09:25:09.100 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-10T09:25:09.128 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 5/7 2024-09-10T09:25:09.227 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:09.253 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:09.253 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:09.359 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 6/7 2024-09-10T09:25:09.390 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T09:25:09.752 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:09.752 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:09.938 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 7/7 2024-09-10T09:25:09.938 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 1/7 2024-09-10T09:25:09.938 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2/7 2024-09-10T09:25:09.938 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 3/7 2024-09-10T09:25:09.938 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-10T09:25:09.938 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-10T09:25:09.938 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-10T09:25:10.210 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-10T09:25:10.210 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:10.210 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:10.210 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:18.2.0-0.el9.noarch 2024-09-10T09:25:10.210 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:18.2.0-0.el9.noarch 2024-09-10T09:25:10.210 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:18.2.0-0.el9.noarch 2024-09-10T09:25:10.211 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-10T09:25:10.211 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-10T09:25:10.211 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T09:25:10.211 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T09:25:10.211 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:10.211 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:10.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-10T09:25:10.505 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:10.579 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T09:25:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:25:10.726 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:25:10.763 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T09:25:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T09:25:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T09:25:11.011 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:56 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:11.060 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T09:25:11.144 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:11.146 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:11.146 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T09:25:11.146 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-0.el9 ceph-noarch 7.4 M 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T09:25:11.147 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout:Install 12 Packages 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 38 M 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 212 M 2024-09-10T09:25:11.148 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:11.610 INFO:teuthology.orchestra.run.smithi135.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.0-0. 52 MB/s | 7.4 MB 00:00 2024-09-10T09:25:11.668 INFO:teuthology.orchestra.run.smithi135.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 953 kB/s | 191 kB 00:00 2024-09-10T09:25:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T09:25:11.718 INFO:teuthology.orchestra.run.smithi135.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-10T09:25:11.817 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T09:25:11.844 INFO:teuthology.orchestra.run.smithi135.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 140 kB/s | 33 kB 00:00 2024-09-10T09:25:11.878 INFO:teuthology.orchestra.run.smithi135.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 115 kB/s | 18 kB 00:00 2024-09-10T09:25:11.961 INFO:teuthology.orchestra.run.smithi135.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-10T09:25:12.170 INFO:teuthology.orchestra.run.smithi135.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-10T09:25:12.912 INFO:teuthology.orchestra.run.smithi135.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-09-10T09:25:13.037 INFO:teuthology.orchestra.run.smithi135.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-09-10T09:25:13.072 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:25:13.712 INFO:teuthology.orchestra.run.smithi135.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 5.1 MB 00:01 2024-09-10T09:25:14.106 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T09:25:14.139 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T09:25:14.354 INFO:teuthology.orchestra.run.smithi135.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.0 MB/s | 4.9 MB 00:02 2024-09-10T09:25:16.889 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T09:25:16.889 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-10T09:25:16.889 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:25:16.889 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:25:16.890 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T09:25:17.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T09:25:17.276 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:17.276 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:17.276 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-10T09:25:17.276 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:25:17.277 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:17.278 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:17.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-rook 2024-09-10T09:25:17.954 INFO:teuthology.orchestra.run.smithi135.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-09-10T09:25:17.954 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:17.954 INFO:teuthology.orchestra.run.smithi135.stdout:Total 5.6 MB/s | 38 MB 00:06 2024-09-10T09:25:18.199 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:07 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:18.307 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:18.330 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:25:18.332 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout:Install 13 Packages 2024-09-10T09:25:18.333 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:18.334 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:18.334 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:18.334 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 2.2 M 2024-09-10T09:25:18.335 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 26 M 2024-09-10T09:25:18.335 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:18.583 INFO:teuthology.orchestra.run.smithi079.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 905 kB/s | 47 kB 00:00 2024-09-10T09:25:18.792 INFO:teuthology.orchestra.run.smithi079.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 98 kB/s | 26 kB 00:00 2024-09-10T09:25:18.809 INFO:teuthology.orchestra.run.smithi079.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 69 kB/s | 19 kB 00:00 2024-09-10T09:25:18.842 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:18.842 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:19.092 INFO:teuthology.orchestra.run.smithi079.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 436 kB/s | 222 kB 00:00 2024-09-10T09:25:19.151 INFO:teuthology.orchestra.run.smithi079.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 464 kB/s | 159 kB 00:00 2024-09-10T09:25:19.185 INFO:teuthology.orchestra.run.smithi079.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 972 kB/s | 32 kB 00:00 2024-09-10T09:25:19.202 INFO:teuthology.orchestra.run.smithi079.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 492 kB/s | 54 kB 00:00 2024-09-10T09:25:19.219 INFO:teuthology.orchestra.run.smithi079.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 420 kB/s | 14 kB 00:00 2024-09-10T09:25:19.261 INFO:teuthology.orchestra.run.smithi079.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 617 kB/s | 279 kB 00:00 2024-09-10T09:25:19.311 INFO:teuthology.orchestra.run.smithi079.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-10T09:25:19.336 INFO:teuthology.orchestra.run.smithi079.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-10T09:25:19.354 INFO:teuthology.orchestra.run.smithi079.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 651 kB/s | 59 kB 00:00 2024-09-10T09:25:19.395 INFO:teuthology.orchestra.run.smithi079.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2024-09-10T09:25:19.398 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:19.398 INFO:teuthology.orchestra.run.smithi079.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-09-10T09:25:19.469 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:19.486 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:19.486 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:19.573 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:19.574 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:19.607 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:19.701 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-10T09:25:19.743 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:25:19.841 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:25:19.877 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-10T09:25:20.063 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-10T09:25:20.084 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:20.110 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-10T09:25:20.189 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-10T09:25:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T09:25:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T09:25:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T09:25:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T09:25:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T09:25:20.575 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T09:25:20.678 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T09:25:20.734 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T09:25:20.872 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-10T09:25:20.989 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-10T09:25:21.453 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T09:25:21.506 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T09:25:21.540 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T09:25:21.585 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T09:25:21.610 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T09:25:22.235 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:25:22.420 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T09:25:22.420 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T09:25:22.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T09:25:22.761 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:25:22.762 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:25:22.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:25:22.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:25:22.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:25:22.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:25:22.763 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:25:22.763 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:22.763 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:23.007 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T09:25:23.265 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-10T09:25:23.301 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T09:25:23.571 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:12 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:23.704 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:25:23.705 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout:Install 6 Packages 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 7.0 M 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 33 M 2024-09-10T09:25:23.706 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:23.868 INFO:teuthology.orchestra.run.smithi079.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 1.6 MB/s | 127 kB 00:00 2024-09-10T09:25:23.918 INFO:teuthology.orchestra.run.smithi079.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-10T09:25:23.944 INFO:teuthology.orchestra.run.smithi079.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-10T09:25:23.969 INFO:teuthology.orchestra.run.smithi079.stdout:(4/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-10T09:25:23.994 INFO:teuthology.orchestra.run.smithi079.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-10T09:25:24.136 INFO:teuthology.orchestra.run.smithi079.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-10T09:25:24.138 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:24.138 INFO:teuthology.orchestra.run.smithi079.stdout:Total 16 MB/s | 7.0 MB 00:00 2024-09-10T09:25:24.208 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:24.219 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:24.219 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:24.317 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:24.317 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:24.820 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T09:25:24.872 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T09:25:25.404 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T09:25:25.492 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T09:25:25.559 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T09:25:25.593 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T09:25:25.992 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 12/12 2024-09-10T09:25:25.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarc 1/12 2024-09-10T09:25:25.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-10T09:25:25.992 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-10T09:25:25.993 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-10T09:25:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T09:25:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-10T09:25:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T09:25:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T09:25:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T09:25:26.374 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T09:25:26.426 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-10T09:25:26.426 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:26.426 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:26.426 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:18.2.0-0.el9.noarch 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:26.427 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:26.639 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T09:25:26.639 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:26.639 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:26.640 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:26.823 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-rook 2024-09-10T09:25:26.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-fuse 2024-09-10T09:25:27.429 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:12 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:27.781 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:27.781 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:27.781 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T09:25:27.781 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:18.2.0-0.el9 ceph-noarch 47 k 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T09:25:27.782 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout:Install 13 Packages 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 2.2 M 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 26 M 2024-09-10T09:25:27.783 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:16 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-10T09:25:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:Install 2 Packages 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 914 k 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 2.7 M 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 6.7 MB/s | 835 kB 00:00 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 465 kB/s | 80 kB 00:00 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:27.785 INFO:teuthology.orchestra.run.smithi079.stdout:Total 4.6 MB/s | 914 kB 00:00 2024-09-10T09:25:27.786 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:27.807 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:27.807 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:27.890 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:27.891 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:27.977 INFO:teuthology.orchestra.run.smithi135.stdout:(1/13): ceph-mgr-rook-18.2.0-0.el9.noarch.rpm 1.0 MB/s | 47 kB 00:00 2024-09-10T09:25:28.060 INFO:teuthology.orchestra.run.smithi135.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 147 kB/s | 19 kB 00:00 2024-09-10T09:25:28.075 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:28.086 INFO:teuthology.orchestra.run.smithi135.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 165 kB/s | 26 kB 00:00 2024-09-10T09:25:28.202 INFO:teuthology.orchestra.run.smithi135.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 985 kB/s | 222 kB 00:00 2024-09-10T09:25:28.213 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T09:25:28.228 INFO:teuthology.orchestra.run.smithi135.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 950 kB/s | 159 kB 00:00 2024-09-10T09:25:28.261 INFO:teuthology.orchestra.run.smithi135.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 913 kB/s | 54 kB 00:00 2024-09-10T09:25:28.287 INFO:teuthology.orchestra.run.smithi135.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-10T09:25:28.289 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T09:25:28.321 INFO:teuthology.orchestra.run.smithi135.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 348 kB/s | 32 kB 00:00 2024-09-10T09:25:28.354 INFO:teuthology.orchestra.run.smithi135.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 156 kB/s | 14 kB 00:00 2024-09-10T09:25:28.379 INFO:teuthology.orchestra.run.smithi135.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-10T09:25:28.405 INFO:teuthology.orchestra.run.smithi135.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-10T09:25:28.430 INFO:teuthology.orchestra.run.smithi135.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-10T09:25:28.472 INFO:teuthology.orchestra.run.smithi135.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-10T09:25:28.474 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:28.474 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-10T09:25:28.536 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:28.551 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:28.551 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:28.639 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:28.639 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T09:25:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-10T09:25:29.141 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:29.214 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T09:25:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:29.215 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T09:25:29.215 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:29.215 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:29.308 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-10T09:25:29.356 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-10T09:25:29.411 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-10T09:25:29.440 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-10T09:25:29.482 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-10T09:25:29.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install librados-devel 2024-09-10T09:25:29.591 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-10T09:25:29.693 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-10T09:25:29.750 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-10T09:25:30.104 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:19 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:30.242 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:30.243 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:30.243 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:30.243 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 126 k 2024-09-10T09:25:30.244 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 456 k 2024-09-10T09:25:30.245 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:30.315 INFO:teuthology.orchestra.run.smithi079.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 1.8 MB/s | 126 kB 00:00 2024-09-10T09:25:30.315 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:30.316 INFO:teuthology.orchestra.run.smithi079.stdout:Total 1.7 MB/s | 126 kB 00:00 2024-09-10T09:25:30.316 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:30.325 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:30.325 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:30.384 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:30.384 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:30.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-10T09:25:30.530 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:30.574 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-10T09:25:30.598 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-10T09:25:30.637 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:30.669 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-10T09:25:30.695 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T09:25:31.046 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:31.348 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:31.348 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:31.348 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:31.348 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:31.348 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:31.348 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:31.398 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-0.el9.noarch 13/13 2024-09-10T09:25:31.398 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:18.2.0-0.el9.noarch 1/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-10T09:25:31.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-10T09:25:31.400 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-10T09:25:31.400 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-10T09:25:31.400 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-10T09:25:31.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install libcephfs2 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:18.2.0-0.el9.noarch 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T09:25:31.723 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:31.724 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:31.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-cephadm 2024-09-10T09:25:32.163 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:21 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:32.254 INFO:teuthology.orchestra.run.smithi079.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:32.297 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:32.298 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:32.298 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:32.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install libcephfs-devel 2024-09-10T09:25:32.529 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:17 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:32.663 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:32.664 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:32.664 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T09:25:32.665 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:32.665 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:32.665 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:18.2.0-0.el9 ceph-noarch 127 k 2024-09-10T09:25:32.665 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:25:32.665 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T09:25:32.665 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T09:25:32.666 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T09:25:32.666 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T09:25:32.666 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T09:25:32.666 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:32.666 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:32.666 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:32.666 INFO:teuthology.orchestra.run.smithi135.stdout:Install 6 Packages 2024-09-10T09:25:32.667 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:32.667 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 7.0 M 2024-09-10T09:25:32.667 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 33 M 2024-09-10T09:25:32.667 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:32.898 INFO:teuthology.orchestra.run.smithi135.stdout:(1/6): ceph-mgr-cephadm-18.2.0-0.el9.noarch.rpm 2.0 MB/s | 127 kB 00:00 2024-09-10T09:25:32.962 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:21 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:32.965 INFO:teuthology.orchestra.run.smithi135.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-10T09:25:32.991 INFO:teuthology.orchestra.run.smithi135.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-10T09:25:33.016 INFO:teuthology.orchestra.run.smithi135.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-10T09:25:33.095 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:33.095 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:33.095 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 30 k 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 137 k 2024-09-10T09:25:33.096 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:33.108 INFO:teuthology.orchestra.run.smithi135.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 917 kB/s | 248 kB 00:00 2024-09-10T09:25:33.154 INFO:teuthology.orchestra.run.smithi079.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 526 kB/s | 30 kB 00:00 2024-09-10T09:25:33.154 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:33.155 INFO:teuthology.orchestra.run.smithi079.stdout:Total 514 kB/s | 30 kB 00:00 2024-09-10T09:25:33.155 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:33.158 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:33.158 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:33.171 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:33.172 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:33.385 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:33.962 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:33.963 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:33.963 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:33.963 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:34.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install librados2 2024-09-10T09:25:34.714 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:23 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:34.804 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:34.846 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:34.847 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:34.847 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:34.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install librbd1 2024-09-10T09:25:35.016 INFO:teuthology.orchestra.run.smithi135.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.7 MB/s | 6.0 MB 00:02 2024-09-10T09:25:35.018 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:35.018 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.0 MB/s | 7.0 MB 00:02 2024-09-10T09:25:35.089 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:35.100 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:35.100 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:35.200 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:35.200 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:35.474 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:24 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:35.564 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:35.607 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:35.608 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:35.608 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:35.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-rados 2024-09-10T09:25:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-10T09:25:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-10T09:25:36.247 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:25 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-10T09:25:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-10T09:25:36.337 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:36.379 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:36.380 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:36.381 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-10T09:25:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T09:25:36.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-rgw 2024-09-10T09:25:37.008 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:26 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:37.097 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:37.139 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:37.140 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:37.140 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:37.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-cephfs 2024-09-10T09:25:37.244 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 6/6 2024-09-10T09:25:37.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 1/6 2024-09-10T09:25:37.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-10T09:25:37.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-10T09:25:37.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-10T09:25:37.244 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:18.2.0-0.el9.noarch 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T09:25:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T09:25:37.516 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:37.516 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:37.746 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-fuse 2024-09-10T09:25:37.774 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:26 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:37.865 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:37.907 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:37.908 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:37.908 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:37.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install python3-rbd 2024-09-10T09:25:38.337 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:23 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:38.471 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:18.2.0-0.el9 ceph 835 k 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout:Install 2 Packages 2024-09-10T09:25:38.472 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:38.473 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 914 k 2024-09-10T09:25:38.473 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 2.7 M 2024-09-10T09:25:38.473 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:38.542 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:27 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:38.632 INFO:teuthology.orchestra.run.smithi079.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:38.651 INFO:teuthology.orchestra.run.smithi135.stdout:(1/2): ceph-fuse-18.2.0-0.el9.x86_64.rpm 10 MB/s | 835 kB 00:00 2024-09-10T09:25:38.674 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:38.675 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2024-09-10T09:25:38.675 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:38.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install rbd-fuse 2024-09-10T09:25:38.768 INFO:teuthology.orchestra.run.smithi135.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 408 kB/s | 80 kB 00:00 2024-09-10T09:25:38.768 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:38.769 INFO:teuthology.orchestra.run.smithi135.stdout:Total 3.0 MB/s | 914 kB 00:00 2024-09-10T09:25:38.781 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:38.803 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:38.803 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:38.887 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:38.887 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:39.077 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:39.217 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-10T09:25:39.284 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T09:25:39.309 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:28 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:39.443 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:39.444 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:39.444 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:39.444 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:39.445 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-10T09:25:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:39.445 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:39.445 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:39.445 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-09-10T09:25:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:39.446 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 86 k 2024-09-10T09:25:39.446 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 230 k 2024-09-10T09:25:39.446 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:39.508 INFO:teuthology.orchestra.run.smithi079.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-09-10T09:25:39.509 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:39.509 INFO:teuthology.orchestra.run.smithi079.stdout:Total 1.3 MB/s | 86 kB 00:00 2024-09-10T09:25:39.509 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:39.515 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:39.515 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:39.577 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:39.580 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:39.723 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:39.837 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:39.981 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-fuse-2:18.2.0-0.el9.x86_64 2/2 2024-09-10T09:25:39.981 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:18.2.0-0.el9.x86_64 1/2 2024-09-10T09:25:40.211 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:40.281 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-10T09:25:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:40.282 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:18.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-10T09:25:40.282 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:40.282 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:40.480 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:40.480 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:40.480 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:40.480 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:40.480 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:40.480 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:40.524 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados-devel 2024-09-10T09:25:40.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install rbd-mirror 2024-09-10T09:25:41.104 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:26 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:41.245 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:41.245 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:18.2.0-0.el9 ceph 126 k 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-09-10T09:25:41.246 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:41.247 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 126 k 2024-09-10T09:25:41.247 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 456 k 2024-09-10T09:25:41.247 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:41.298 INFO:teuthology.orchestra.run.smithi135.stdout:librados-devel-18.2.0-0.el9.x86_64.rpm 2.4 MB/s | 126 kB 00:00 2024-09-10T09:25:41.299 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:41.299 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.3 MB/s | 126 kB 00:00 2024-09-10T09:25:41.299 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:41.304 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:41.305 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:41.309 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:30 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:41.367 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:41.367 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:41.446 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:41.446 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:41.446 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:41.447 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:41.447 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:41.447 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T09:25:41.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:41.447 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:41.447 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:41.447 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-09-10T09:25:41.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:41.448 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 3.0 M 2024-09-10T09:25:41.448 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 12 M 2024-09-10T09:25:41.448 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:41.512 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:41.587 INFO:teuthology.orchestra.run.smithi079.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 21 MB/s | 3.0 MB 00:00 2024-09-10T09:25:41.588 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:41.588 INFO:teuthology.orchestra.run.smithi079.stdout:Total 21 MB/s | 3.0 MB 00:00 2024-09-10T09:25:41.589 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:41.597 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:41.597 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:41.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:41.676 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:41.676 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:42.049 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:42.093 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:42.155 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:42.180 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:42.180 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:25:42.180 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:25:42.180 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:25:42.180 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:25:42.180 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:42.338 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:42.338 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:42.338 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:42.338 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:42.339 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:42.339 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:42.577 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs2 2024-09-10T09:25:43.153 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:28 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:43.244 INFO:teuthology.orchestra.run.smithi135.stdout:Package libcephfs2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:43.276 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:43.276 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:43.276 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:43.276 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:43.276 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:43.276 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:43.287 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:43.289 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:43.289 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:43.356 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs-devel 2024-09-10T09:25:43.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install rbd-nbd 2024-09-10T09:25:43.927 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:28 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:44.061 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:44.061 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:44.061 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:18.2.0-0.el9 ceph 30 k 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-09-10T09:25:44.062 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:44.063 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 30 k 2024-09-10T09:25:44.063 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 137 k 2024-09-10T09:25:44.063 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:44.102 INFO:teuthology.orchestra.run.smithi135.stdout:libcephfs-devel-18.2.0-0.el9.x86_64.rpm 776 kB/s | 30 kB 00:00 2024-09-10T09:25:44.103 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:44.103 INFO:teuthology.orchestra.run.smithi135.stdout:Total 752 kB/s | 30 kB 00:00 2024-09-10T09:25:44.103 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:44.106 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:44.106 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:44.129 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:33 ago on Tue 10 Sep 2024 09:24:11 AM UTC. 2024-09-10T09:25:44.132 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:44.132 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:44.219 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:44.262 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-10T09:25:44.263 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-09-10T09:25:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2024-09-10T09:25:44.264 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 169 k 2024-09-10T09:25:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 490 k 2024-09-10T09:25:44.264 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-10T09:25:44.335 INFO:teuthology.orchestra.run.smithi079.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.3 MB/s | 169 kB 00:00 2024-09-10T09:25:44.335 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:44.336 INFO:teuthology.orchestra.run.smithi079.stdout:Total 2.3 MB/s | 169 kB 00:00 2024-09-10T09:25:44.336 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-10T09:25:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:44.344 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-10T09:25:44.344 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-10T09:25:44.408 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-10T09:25:44.408 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-10T09:25:44.557 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-10T09:25:44.666 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:44.717 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:44.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:44.971 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:44.971 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:44.971 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:44.971 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:44.971 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:45.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librados2 2024-09-10T09:25:45.353 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:45.353 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-10T09:25:45.353 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:45.353 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:25:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-10T09:25:45.653 DEBUG:teuthology.parallel:result is None 2024-09-10T09:25:45.743 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:30 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:45.833 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:45.875 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:45.877 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:45.877 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:45.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install librbd1 2024-09-10T09:25:46.522 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:31 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:46.612 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:46.655 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:46.656 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:46.656 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:46.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rados 2024-09-10T09:25:47.288 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:32 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:47.377 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rados-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:47.419 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:47.420 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:47.421 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:47.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rgw 2024-09-10T09:25:48.055 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:33 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:48.145 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rgw-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:48.187 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:48.188 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:48.188 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:48.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-cephfs 2024-09-10T09:25:48.826 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:33 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:48.919 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-cephfs-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:48.962 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:48.963 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:48.963 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:49.027 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install python3-rbd 2024-09-10T09:25:49.598 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:34 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:49.689 INFO:teuthology.orchestra.run.smithi135.stdout:Package python3-rbd-2:18.2.0-0.el9.x86_64 is already installed. 2024-09-10T09:25:49.731 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:49.732 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-09-10T09:25:49.732 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:49.805 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-fuse 2024-09-10T09:25:50.378 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:35 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:50.512 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:50.513 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:50.513 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:50.513 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:50.513 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:50.513 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:18.2.0-0.el9 ceph 86 k 2024-09-10T09:25:50.513 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:50.514 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:50.514 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:50.514 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-09-10T09:25:50.514 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:50.514 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 86 k 2024-09-10T09:25:50.514 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 230 k 2024-09-10T09:25:50.514 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:50.572 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-fuse-18.2.0-0.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-10T09:25:50.572 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:50.573 INFO:teuthology.orchestra.run.smithi135.stdout:Total 1.4 MB/s | 86 kB 00:00 2024-09-10T09:25:50.573 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:50.580 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:50.580 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:50.643 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:50.644 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:50.789 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:50.886 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:51.272 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:51.541 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:51.541 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:51.541 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:51.541 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:51.541 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:51.541 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:51.773 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-mirror 2024-09-10T09:25:52.363 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:37 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:52.505 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:52.506 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:52.506 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:52.506 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:52.506 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:52.506 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:18.2.0-0.el9 ceph 3.0 M 2024-09-10T09:25:52.506 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:52.506 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:52.507 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:52.507 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-09-10T09:25:52.507 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:52.507 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 3.0 M 2024-09-10T09:25:52.507 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 12 M 2024-09-10T09:25:52.507 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:52.592 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-mirror-18.2.0-0.el9.x86_64.rpm 35 MB/s | 3.0 MB 00:00 2024-09-10T09:25:52.593 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:52.593 INFO:teuthology.orchestra.run.smithi135.stdout:Total 34 MB/s | 3.0 MB 00:00 2024-09-10T09:25:52.593 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:52.602 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:52.603 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:52.685 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:52.685 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:53.100 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:53.169 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:53.193 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:53.193 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T09:25:53.193 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T09:25:53.193 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:25:53.193 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T09:25:53.193 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:54.336 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:54.336 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:54.336 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:54.336 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:54.336 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:54.336 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:54.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-nbd 2024-09-10T09:25:55.161 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:01:40 ago on Tue 10 Sep 2024 09:24:15 AM UTC. 2024-09-10T09:25:55.299 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:18.2.0-0.el9 ceph 169 k 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2024-09-10T09:25:55.300 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:55.301 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 169 k 2024-09-10T09:25:55.301 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 490 k 2024-09-10T09:25:55.301 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T09:25:55.364 INFO:teuthology.orchestra.run.smithi135.stdout:rbd-nbd-18.2.0-0.el9.x86_64.rpm 2.7 MB/s | 169 kB 00:00 2024-09-10T09:25:55.364 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:25:55.365 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.6 MB/s | 169 kB 00:00 2024-09-10T09:25:55.365 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T09:25:55.372 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T09:25:55.373 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T09:25:55.435 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T09:25:55.435 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T09:25:55.587 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T09:25:55.702 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:56.123 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:56.396 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:18.2.0-0.el9.x86_64 1/1 2024-09-10T09:25:56.396 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:56.396 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T09:25:56.396 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:18.2.0-0.el9.x86_64 2024-09-10T09:25:56.397 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:25:56.397 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T09:25:56.664 DEBUG:teuthology.parallel:result is None 2024-09-10T09:25:56.665 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T09:25:56.665 INFO:teuthology.packaging:ref: None 2024-09-10T09:25:56.665 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T09:25:56.665 INFO:teuthology.packaging:branch: None 2024-09-10T09:25:56.665 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:25:56.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T09:25:56.804 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:25:56.830 INFO:teuthology.orchestra.run.smithi079.stdout:18.2.0-0.el9 2024-09-10T09:25:56.830 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-10T09:25:56.830 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-10T09:25:56.832 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-09-10T09:25:56.832 INFO:teuthology.packaging:ref: None 2024-09-10T09:25:56.832 INFO:teuthology.packaging:tag: v18.2.0 2024-09-10T09:25:56.832 INFO:teuthology.packaging:branch: None 2024-09-10T09:25:56.832 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:25:56.833 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5dd24139a1eada541a3bc16b6941c5dde975e26d 2024-09-10T09:25:56.968 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T09:25:56.991 INFO:teuthology.orchestra.run.smithi135.stdout:18.2.0-0.el9 2024-09-10T09:25:56.991 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-0.el9 2024-09-10T09:25:56.991 INFO:teuthology.task.install:The correct ceph version 18.2.0-0 is installed. 2024-09-10T09:25:56.993 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T09:25:56.993 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:25:56.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:25:57.024 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:25:57.024 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T09:25:57.056 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T09:25:57.056 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:25:57.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:25:57.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:25:57.163 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:25:57.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T09:25:57.188 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T09:25:57.252 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T09:25:57.253 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:25:57.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:25:57.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:25:57.352 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:25:57.352 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T09:25:57.377 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T09:25:57.457 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T09:25:57.457 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:25:57.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:25:57.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:25:57.548 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:25:57.548 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T09:25:57.573 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T09:25:57.639 INFO:teuthology.run_tasks:Running task print... 2024-09-10T09:25:57.648 INFO:teuthology.task.print:**** done install task... 2024-09-10T09:25:57.648 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T09:25:57.758 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.io/ceph/ceph:v18.2.0', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T09:25:57.758 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.0 2024-09-10T09:25:57.758 INFO:tasks.cephadm:Cluster fsid is afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:25:57.759 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T09:25:57.759 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-10T09:25:57.759 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi079': '172.21.15.79', 'mon.smithi135': '172.21.15.135'} 2024-09-10T09:25:57.759 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T09:25:57.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2024-09-10T09:25:57.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-09-10T09:25:57.809 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-09-10T09:25:57.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:25:57.952 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82914/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:14:38.445020', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82912/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:05:03.996701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-10T09:25:58.183 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref reef, sha1 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-09-10T09:25:58.184 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/centos/9/x86_64/flavors/default/cephadm 2024-09-10T09:25:58.184 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/centos/9/x86_64/flavors/default/cephadm 2024-09-10T09:25:58.185 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T09:25:58.522 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r--. 1 ubuntu ubuntu 217036 Sep 10 09:25 /home/ubuntu/cephtest/cephadm 2024-09-10T09:25:58.522 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T09:25:58.856 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 217036 Sep 10 09:25 /home/ubuntu/cephtest/cephadm 2024-09-10T09:25:58.857 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T09:25:58.873 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T09:25:58.901 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.0 on all hosts... 2024-09-10T09:25:58.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-10T09:25:58.916 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 pull 2024-09-10T09:26:00.432 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-10T09:26:00.607 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-10T09:26:12.645 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:26:12.645 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-10T09:26:12.645 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-10T09:26:12.646 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2024-09-10T09:26:12.646 INFO:teuthology.orchestra.run.smithi079.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-10T09:26:12.646 INFO:teuthology.orchestra.run.smithi079.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-10T09:26:12.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-10T09:26:12.646 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)", 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946", 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout: "quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007", 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout: "quay.io/ceph/ceph@sha256:d58cf65589d0abf9d5261cd46fb62be3bfb29098febc78c0fcdf116a15274d27" 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-10T09:26:13.509 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-10T09:26:13.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2024-09-10T09:26:13.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-09-10T09:26:13.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2024-09-10T09:26:13.629 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-09-10T09:26:13.654 INFO:tasks.cephadm:Writing seed config... 2024-09-10T09:26:13.655 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-10T09:26:13.655 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-10T09:26:13.655 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T09:26:13.655 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T09:26:13.655 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T09:26:13.655 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T09:26:13.655 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T09:26:13.656 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T09:26:13.657 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T09:26:13.658 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T09:26:13.659 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:26:13.659 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T09:26:13.686 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = afb60aa6-6f56-11ef-bcea-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T09:26:13.687 DEBUG:teuthology.orchestra.run.smithi079:mon.smithi079> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service 2024-09-10T09:26:13.729 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T09:26:13.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 -v bootstrap --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.79 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:26:13.887 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-10T09:26:13.888 INFO:teuthology.orchestra.run.smithi079.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.0', '-v', 'bootstrap', '--fsid', 'afb60aa6-6f56-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.79', '--skip-admin-label'] 2024-09-10T09:26:13.910 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:26:13.910 INFO:teuthology.orchestra.run.smithi079.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T09:26:13.911 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying podman|docker is present... 2024-09-10T09:26:13.933 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:26:13.933 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying lvm2 is present... 2024-09-10T09:26:13.933 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying time synchronization is in place... 2024-09-10T09:26:13.940 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T09:26:13.941 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T09:26:13.948 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T09:26:13.948 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-10T09:26:13.953 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-09-10T09:26:13.960 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-09-10T09:26:13.960 INFO:teuthology.orchestra.run.smithi079.stdout:Unit chronyd.service is enabled and running 2024-09-10T09:26:13.960 INFO:teuthology.orchestra.run.smithi079.stdout:Repeating the final host check... 2024-09-10T09:26:13.982 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout 5.2.2 2024-09-10T09:26:13.982 INFO:teuthology.orchestra.run.smithi079.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T09:26:13.982 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl is present 2024-09-10T09:26:13.982 INFO:teuthology.orchestra.run.smithi079.stdout:lvcreate is present 2024-09-10T09:26:13.988 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T09:26:13.988 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T09:26:13.994 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T09:26:13.994 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-10T09:26:14.001 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout enabled 2024-09-10T09:26:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout active 2024-09-10T09:26:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Unit chronyd.service is enabled and running 2024-09-10T09:26:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Host looks OK 2024-09-10T09:26:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Cluster fsid: afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Acquiring lock 140119349601616 on /run/cephadm/afb60aa6-6f56-11ef-bcea-c7b262605968.lock 2024-09-10T09:26:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Lock 140119349601616 acquired on /run/cephadm/afb60aa6-6f56-11ef-bcea-c7b262605968.lock 2024-09-10T09:26:14.008 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 3300 ... 2024-09-10T09:26:14.009 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying IP 172.21.15.79 port 6789 ... 2024-09-10T09:26:14.009 INFO:teuthology.orchestra.run.smithi079.stdout:Base mon IP(s) is [172.21.15.79:3300, 172.21.15.79:6789], mon addrv is [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-10T09:26:14.011 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.79 metric 100 2024-09-10T09:26:14.011 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.79 metric 100 2024-09-10T09:26:14.014 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T09:26:14.014 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-10T09:26:14.014 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-10T09:26:14.016 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T09:26:14.016 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T09:26:14.016 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T09:26:14.017 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-10T09:26:14.017 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link noprefixroute 2024-09-10T09:26:14.017 INFO:teuthology.orchestra.run.smithi079.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T09:26:14.017 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-09-10T09:26:14.017 INFO:teuthology.orchestra.run.smithi079.stdout:Mon IP `172.21.15.79` is in CIDR network `172.21.0.0/20` 2024-09-10T09:26:14.017 INFO:teuthology.orchestra.run.smithi079.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T09:26:14.018 INFO:teuthology.orchestra.run.smithi079.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T09:26:14.019 INFO:teuthology.orchestra.run.smithi079.stdout:Pulling container image quay.io/ceph/ceph:v18.2.0... 2024-09-10T09:26:14.765 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stdout dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-10T09:26:14.766 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.0... 2024-09-10T09:26:14.766 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T09:26:14.766 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying blob sha256:3bd20aeff60302f668275dc2005d10679ae56492967a3a5a54fd3dde85333aec 2024-09-10T09:26:14.766 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying blob sha256:46af8f5390d4e94fc57efb422ccb97bb53dfe5b948546bfc191b46557eb2dbd9 2024-09-10T09:26:14.766 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Copying config sha256:dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 2024-09-10T09:26:14.766 INFO:teuthology.orchestra.run.smithi079.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T09:26:15.719 INFO:teuthology.orchestra.run.smithi079.stdout:ceph: stdout ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-10T09:26:15.719 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph version: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable) 2024-09-10T09:26:15.719 INFO:teuthology.orchestra.run.smithi079.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T09:26:20.080 INFO:teuthology.orchestra.run.smithi079.stdout:stat: stdout 167 167 2024-09-10T09:26:20.080 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial keys... 2024-09-10T09:26:28.273 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQC+EOBmFaoMOBAALVGbbO4/q4rKn3PFQdX0qw== 2024-09-10T09:26:29.225 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQDEEOBmdkV7IhAA5YCLTmbBQitDsLfFnJviXQ== 2024-09-10T09:26:30.195 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph-authtool: stdout AQDFEOBmOP/WIBAAMIJIUiViISCqjfrYVuwKvA== 2024-09-10T09:26:30.195 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial monmap... 2024-09-10T09:26:31.129 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T09:26:31.129 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-10T09:26:31.129 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:31.129 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T09:26:31.130 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool for smithi079 [v2:172.21.15.79:3300,v1:172.21.15.79:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T09:26:31.130 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = pacific 2024-09-10T09:26:31.130 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: set fsid to afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:31.130 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T09:26:31.130 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:26:31.130 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mon... 2024-09-10T09:26:32.051 INFO:teuthology.orchestra.run.smithi079.stdout:create mon.smithi079 on 2024-09-10T09:26:32.250 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T09:26:32.386 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T09:26:32.548 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968.target. 2024-09-10T09:26:32.548 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968.target. 2024-09-10T09:26:32.774 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079 2024-09-10T09:26:32.774 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service: Unit ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service not loaded. 2024-09-10T09:26:32.929 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968.target.wants/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service → /etc/systemd/system/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@.service. 2024-09-10T09:26:33.421 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:33 smithi079 ceph-mon[27224]: mon.smithi079 is new leader, mons smithi079 in quorum (ranks 0) 2024-09-10T09:26:33.434 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:26:33.435 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-10T09:26:33.441 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:26:33.441 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-10T09:26:33.441 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-10T09:26:33.441 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T09:26:33.442 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon to start... 2024-09-10T09:26:33.442 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mon... 2024-09-10T09:26:33.677 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:33 smithi079 bash[27206]: 71c6a66919d687dd522e6b5a1ff09448bb928be9eaf733adbd6a562d5eec218e 2024-09-10T09:26:33.677 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:33 smithi079 systemd[1]: Started Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:26:34.511 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T09:26:34.511 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout id: afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:34.511 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout services: 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi079 (age 0.544463s) 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout data: 2024-09-10T09:26:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.872+0000 7ffabe19b700 1 Processor -- start 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.872+0000 7ffabe19b700 1 -- start start 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.872+0000 7ffabe19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab8105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.872+0000 7ffabe19b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81064c0 con 0x7ffab8105b70 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab8105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab8105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38298/0 (socket says 172.21.15.79:38298) 2024-09-10T09:26:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab77fe700 1 -- 172.21.15.79:0/3011419142 learned_addr learned my addr 172.21.15.79:0/3011419142 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab77fe700 1 -- 172.21.15.79:0/3011419142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8106600 con 0x7ffab8105b70 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab77fe700 1 --2- 172.21.15.79:0/3011419142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab8105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80098a0 tx=0x7ffaa8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a1316128dd3ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab67fc700 1 -- 172.21.15.79:0/3011419142 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaa8004180 con 0x7ffab8105b70 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab67fc700 1 -- 172.21.15.79:0/3011419142 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa80042e0 con 0x7ffab8105b70 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.873+0000 7ffab67fc700 1 -- 172.21.15.79:0/3011419142 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaa80036a0 con 0x7ffab8105b70 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 -- 172.21.15.79:0/3011419142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 msgr2=0x7ffab8105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 --2- 172.21.15.79:0/3011419142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab8105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80098a0 tx=0x7ffaa8009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 -- 172.21.15.79:0/3011419142 shutdown_connections 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 --2- 172.21.15.79:0/3011419142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab8105f80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 -- 172.21.15.79:0/3011419142 >> 172.21.15.79:0/3011419142 conn(0x7ffab8101220 msgr2=0x7ffab8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 -- 172.21.15.79:0/3011419142 shutdown_connections 2024-09-10T09:26:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 -- 172.21.15.79:0/3011419142 wait complete. 2024-09-10T09:26:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.874+0000 7ffabe19b700 1 Processor -- start 2024-09-10T09:26:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffabe19b700 1 -- start start 2024-09-10T09:26:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffabe19b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab807bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffabe19b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab807c1b0 con 0x7ffab8105b70 2024-09-10T09:26:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab807bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:34.515 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab807bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38306/0 (socket says 172.21.15.79:38306) 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffab77fe700 1 -- 172.21.15.79:0/3696078536 learned_addr learned my addr 172.21.15.79:0/3696078536 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffab77fe700 1 -- 172.21.15.79:0/3696078536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8009550 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.875+0000 7ffab77fe700 1 --2- 172.21.15.79:0/3696078536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab807bc70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffab81068a0 tx=0x7ffaa8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffab4ff9700 1 -- 172.21.15.79:0/3696078536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaa8003ce0 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffab4ff9700 1 -- 172.21.15.79:0/3696078536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa8020070 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab807a2c0 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffab4ff9700 1 -- 172.21.15.79:0/3696078536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffaa8011630 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab807a6e0 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffab4ff9700 1 -- 172.21.15.79:0/3696078536 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffaa8022030 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffab4ff9700 1 -- 172.21.15.79:0/3696078536 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffaa8025d00 con 0x7ffab8105b70 2024-09-10T09:26:34.516 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.876+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8062380 con 0x7ffab8105b70 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.879+0000 7ffab4ff9700 1 -- 172.21.15.79:0/3696078536 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ffaa8025480 con 0x7ffab8105b70 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.948+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ffab81924a0 con 0x7ffab8105b70 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.948+0000 7ffab4ff9700 1 -- 172.21.15.79:0/3696078536 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7ffaa8011bd0 con 0x7ffab8105b70 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.949+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 msgr2=0x7ffab807bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.949+0000 7ffabe19b700 1 --2- 172.21.15.79:0/3696078536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab807bc70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffab81068a0 tx=0x7ffaa8004750 comp rx=0 tx=0).stop 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.949+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 shutdown_connections 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.949+0000 7ffabe19b700 1 --2- 172.21.15.79:0/3696078536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffab8105b70 0x7ffab807bc70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.949+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 >> 172.21.15.79:0/3696078536 conn(0x7ffab8101220 msgr2=0x7ffab818d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:34.518 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.949+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 shutdown_connections 2024-09-10T09:26:34.518 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:33.949+0000 7ffabe19b700 1 -- 172.21.15.79:0/3696078536 wait complete. 2024-09-10T09:26:34.518 INFO:teuthology.orchestra.run.smithi079.stdout:mon is available 2024-09-10T09:26:34.518 INFO:teuthology.orchestra.run.smithi079.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T09:26:34.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:34 smithi079 ceph-mon[27224]: mon.smithi079 is new leader, mons smithi079 in quorum (ranks 0) 2024-09-10T09:26:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:34 smithi079 ceph-mon[27224]: monmap e1: 1 mons at {smithi079=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0]} removed_ranks: {} 2024-09-10T09:26:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:34 smithi079 ceph-mon[27224]: fsmap 2024-09-10T09:26:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:34 smithi079 ceph-mon[27224]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T09:26:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:34 smithi079 ceph-mon[27224]: mgrmap e1: no daemons active 2024-09-10T09:26:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:34 smithi079 ceph-mon[27224]: from='client.? 172.21.15.79:0/3696078536' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T09:26:35.592 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:35.592 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T09:26:35.592 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.79:3300,v1:172.21.15.79:6789] 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T09:26:35.593 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe34839a700 1 Processor -- start 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe34839a700 1 -- start start 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe34839a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34010ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe34839a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe340106530 con 0x7fe340079d00 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe346136700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34010ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe346136700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34010ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38322/0 (socket says 172.21.15.79:38322) 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe346136700 1 -- 172.21.15.79:0/1572751182 learned_addr learned my addr 172.21.15.79:0/1572751182 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.936+0000 7fe346136700 1 -- 172.21.15.79:0/1572751182 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34010b080 con 0x7fe340079d00 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe346136700 1 --2- 172.21.15.79:0/1572751182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34010ab40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0098a0 tx=0x7fe33c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b80e7bd29dabc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe345134700 1 -- 172.21.15.79:0/1572751182 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe33c004180 con 0x7fe340079d00 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe345134700 1 -- 172.21.15.79:0/1572751182 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c0042e0 con 0x7fe340079d00 2024-09-10T09:26:35.594 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe345134700 1 -- 172.21.15.79:0/1572751182 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe33c0036a0 con 0x7fe340079d00 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe34839a700 1 -- 172.21.15.79:0/1572751182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 msgr2=0x7fe34010ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe34839a700 1 --2- 172.21.15.79:0/1572751182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34010ab40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0098a0 tx=0x7fe33c009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe34839a700 1 -- 172.21.15.79:0/1572751182 shutdown_connections 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe34839a700 1 --2- 172.21.15.79:0/1572751182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34010ab40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe34839a700 1 -- 172.21.15.79:0/1572751182 >> 172.21.15.79:0/1572751182 conn(0x7fe3401000f0 msgr2=0x7fe340102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe34839a700 1 -- 172.21.15.79:0/1572751182 shutdown_connections 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.937+0000 7fe34839a700 1 -- 172.21.15.79:0/1572751182 wait complete. 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.938+0000 7fe34839a700 1 Processor -- start 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.938+0000 7fe34839a700 1 -- start start 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.938+0000 7fe34839a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.938+0000 7fe34839a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34019b7e0 con 0x7fe340079d00 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.938+0000 7fe346136700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:35.595 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.938+0000 7fe346136700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34019b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38328/0 (socket says 172.21.15.79:38328) 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.938+0000 7fe346136700 1 -- 172.21.15.79:0/2258457286 learned_addr learned my addr 172.21.15.79:0/2258457286 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe346136700 1 -- 172.21.15.79:0/2258457286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c009550 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe346136700 1 --2- 172.21.15.79:0/2258457286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34019b2a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe33c004000 tx=0x7fe33c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe33c003ce0 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33c020070 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34019b9e0 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34019be00 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe33c011630 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe33c022030 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.939+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe33c025d60 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.940+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe340195070 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:34.942+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fe33c025480 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.010+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe340062380 con 0x7fe340079d00 2024-09-10T09:26:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.014+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe33c025620 con 0x7fe340079d00 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.014+0000 7fe3377fe700 1 -- 172.21.15.79:0/2258457286 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7fe33c01c450 con 0x7fe340079d00 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.015+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 msgr2=0x7fe34019b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.015+0000 7fe34839a700 1 --2- 172.21.15.79:0/2258457286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34019b2a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe33c004000 tx=0x7fe33c004750 comp rx=0 tx=0).stop 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.015+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 shutdown_connections 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.015+0000 7fe34839a700 1 --2- 172.21.15.79:0/2258457286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe340079d00 0x7fe34019b2a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.015+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 >> 172.21.15.79:0/2258457286 conn(0x7fe3401000f0 msgr2=0x7fe340101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.015+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 shutdown_connections 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:35.015+0000 7fe34839a700 1 -- 172.21.15.79:0/2258457286 wait complete. 2024-09-10T09:26:35.597 INFO:teuthology.orchestra.run.smithi079.stdout:Generating new minimal ceph.conf... 2024-09-10T09:26:35.709 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:35 smithi079 ceph-mon[27224]: from='client.? 172.21.15.79:0/2258457286' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T09:26:35.709 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:35 smithi079 ceph-mon[27224]: from='client.? 172.21.15.79:0/2258457286' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T09:26:36.690 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:36 smithi079 ceph-mon[27224]: from='client.? 172.21.15.79:0/2590796121' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:26:36.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.010+0000 7f9c8da14700 1 Processor -- start 2024-09-10T09:26:36.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.010+0000 7f9c8da14700 1 -- start start 2024-09-10T09:26:36.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.010+0000 7f9c8da14700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c88104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:36.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.010+0000 7f9c8da14700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881053d0 con 0x7f9c88104a80 2024-09-10T09:26:36.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.010+0000 7f9c86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c88104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:36.701 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.010+0000 7f9c86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c88104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38340/0 (socket says 172.21.15.79:38340) 2024-09-10T09:26:36.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.010+0000 7f9c86ffd700 1 -- 172.21.15.79:0/104327943 learned_addr learned my addr 172.21.15.79:0/104327943 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:36.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.011+0000 7f9c86ffd700 1 -- 172.21.15.79:0/104327943 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88105510 con 0x7f9c88104a80 2024-09-10T09:26:36.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.011+0000 7f9c86ffd700 1 --2- 172.21.15.79:0/104327943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c88104e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9c780098a0 tx=0x7f9c78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589bdb655e53bd54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:36.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.011+0000 7f9c85ffb700 1 -- 172.21.15.79:0/104327943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c78004180 con 0x7f9c88104a80 2024-09-10T09:26:36.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.011+0000 7f9c85ffb700 1 -- 172.21.15.79:0/104327943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9c780042e0 con 0x7f9c88104a80 2024-09-10T09:26:36.702 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.011+0000 7f9c85ffb700 1 -- 172.21.15.79:0/104327943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c78011a50 con 0x7f9c88104a80 2024-09-10T09:26:36.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 -- 172.21.15.79:0/104327943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 msgr2=0x7f9c88104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:36.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 --2- 172.21.15.79:0/104327943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c88104e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9c780098a0 tx=0x7f9c78009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:36.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 -- 172.21.15.79:0/104327943 shutdown_connections 2024-09-10T09:26:36.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 --2- 172.21.15.79:0/104327943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c88104e90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:36.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 -- 172.21.15.79:0/104327943 >> 172.21.15.79:0/104327943 conn(0x7f9c881000f0 msgr2=0x7f9c88102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:36.703 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 -- 172.21.15.79:0/104327943 shutdown_connections 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 -- 172.21.15.79:0/104327943 wait complete. 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 Processor -- start 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.012+0000 7f9c8da14700 1 -- start start 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8da14700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c881987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8da14700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88198d10 con 0x7f9c88104a80 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c881987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c881987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38342/0 (socket says 172.21.15.79:38342) 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c86ffd700 1 -- 172.21.15.79:0/2590796121 learned_addr learned my addr 172.21.15.79:0/2590796121 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c86ffd700 1 -- 172.21.15.79:0/2590796121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009550 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c86ffd700 1 --2- 172.21.15.79:0/2590796121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c881987d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c780119e0 tx=0x7f9c78011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8ca12700 1 -- 172.21.15.79:0/2590796121 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c78003b90 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c88198f10 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8ca12700 1 -- 172.21.15.79:0/2590796121 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9c7801a8a0 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8ca12700 1 -- 172.21.15.79:0/2590796121 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c78019930 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88199330 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8ca12700 1 -- 172.21.15.79:0/2590796121 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9c7802d440 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.013+0000 7f9c8ca12700 1 -- 172.21.15.79:0/2590796121 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9c780248b0 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.014+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c88108f10 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.017+0000 7f9c8ca12700 1 -- 172.21.15.79:0/2590796121 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9c7801aa10 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.084+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f9c88062380 con 0x7f9c88104a80 2024-09-10T09:26:36.705 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.084+0000 7f9c8ca12700 1 -- 172.21.15.79:0/2590796121 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f9c7801abb0 con 0x7f9c88104a80 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.085+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 msgr2=0x7f9c881987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.085+0000 7f9c8da14700 1 --2- 172.21.15.79:0/2590796121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c881987d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c780119e0 tx=0x7f9c78011ac0 comp rx=0 tx=0).stop 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.085+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 shutdown_connections 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.085+0000 7f9c8da14700 1 --2- 172.21.15.79:0/2590796121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c88104a80 0x7f9c881987d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.085+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 >> 172.21.15.79:0/2590796121 conn(0x7f9c881000f0 msgr2=0x7f9c88101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.085+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 shutdown_connections 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:36.085+0000 7f9c8da14700 1 -- 172.21.15.79:0/2590796121 wait complete. 2024-09-10T09:26:36.706 INFO:teuthology.orchestra.run.smithi079.stdout:Restarting the monitor... 2024-09-10T09:26:36.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:36 smithi079 systemd[1]: Stopping Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:26:37.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:36 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[27220]: 2024-09-10T09:26:36.959+0000 7f1005377700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi079 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:26:37.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:36 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[27220]: 2024-09-10T09:26:36.959+0000 7f1005377700 -1 mon.smithi079@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T09:26:37.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:37 smithi079 podman[27469]: 2024-09-10 09:26:37.184832025 +0000 UTC m=+0.323610084 container died 71c6a66919d687dd522e6b5a1ff09448bb928be9eaf733adbd6a562d5eec218e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20231212, GIT_CLEAN=True) 2024-09-10T09:26:37.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:37 smithi079 podman[27469]: 2024-09-10 09:26:37.534733294 +0000 UTC m=+0.673511360 container cleanup 71c6a66919d687dd522e6b5a1ff09448bb928be9eaf733adbd6a562d5eec218e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-10T09:26:37.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:37 smithi079 bash[27469]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079 2024-09-10T09:26:38.153 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:37 smithi079 podman[27480]: 2024-09-10 09:26:37.802472662 +0000 UTC m=+0.614935021 container remove 71c6a66919d687dd522e6b5a1ff09448bb928be9eaf733adbd6a562d5eec218e (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T09:26:38.153 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:37 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service: Deactivated successfully. 2024-09-10T09:26:38.153 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:37 smithi079 systemd[1]: Stopped Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:26:38.153 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:37 smithi079 systemd[1]: Starting Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:26:38.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 podman[27574]: 2024-09-10 09:26:38.05567254 +0000 UTC m=+0.015643023 image pull dc2bc1663786ad5862ef6efcff18243ab7dfeda0bcb911ddf757a0d20feca946 quay.io/ceph/ceph:v18.2.0 2024-09-10T09:26:38.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 podman[27574]: 2024-09-10 09:26:38.153099841 +0000 UTC m=+0.113070314 container create f719abe33353aedd50ef63ea381449805830dc7c4016726f20ffbed99803a16f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T09:26:38.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 podman[27574]: 2024-09-10 09:26:38.380589391 +0000 UTC m=+0.340559864 container init f719abe33353aedd50ef63ea381449805830dc7c4016726f20ffbed99803a16f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_BRANCH=HEAD) 2024-09-10T09:26:38.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 podman[27574]: 2024-09-10 09:26:38.383648485 +0000 UTC m=+0.343618975 container start f719abe33353aedd50ef63ea381449805830dc7c4016726f20ffbed99803a16f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.29.1) 2024-09-10T09:26:38.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T09:26:38.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable), process ceph-mon, pid 2 2024-09-10T09:26:38.407 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: pidfile_write: ignore empty --pid-file 2024-09-10T09:26:38.468 INFO:teuthology.orchestra.run.smithi079.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T09:26:38.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: load: jerasure load: lrc 2024-09-10T09:26:38.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: RocksDB version: 7.9.2 2024-09-10T09:26:38.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Git sha 0 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Compile date 2023-08-03 19:21:13 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: DB SUMMARY 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: DB Session ID: CZAZSYA862C9DK49IVLQ 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: CURRENT file: CURRENT 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi079/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi079/store.db: 000009.log size: 98771 ; 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.error_if_exists: 0 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.create_if_missing: 0 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.paranoid_checks: 1 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T09:26:38.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.env: 0x55863cd43720 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.info_log: 0x55863eea52c0 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.statistics: (nil) 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.use_fsync: 0 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_log_file_size: 0 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.allow_fallocate: 1 2024-09-10T09:26:38.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.use_direct_reads: 0 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.db_log_dir: 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.wal_dir: 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T09:26:38.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T09:26:38.709 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T09:26:38.709 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.write_buffer_manager: 0x55863e1345a0 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.unordered_write: 0 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T09:26:38.710 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.row_cache: None 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.wal_filter: None 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.two_write_queues: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.wal_compression: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.atomic_flush: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T09:26:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.log_readahead_size: 0 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_background_jobs: 2 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_background_compactions: -1 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_subcompactions: 1 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T09:26:38.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_open_files: -1 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_background_flushes: -1 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Compression algorithms supported: 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kZSTD supported: 0 2024-09-10T09:26:38.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kXpressCompression supported: 0 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kZlibCompression supported: 1 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kSnappyCompression supported: 1 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kLZ4Compression supported: 1 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: kBZip2Compression supported: 0 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi079/store.db/MANIFEST-000010 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.merge_operator: 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_filter: None 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T09:26:38.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55863eea53c0) 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: cache_index_and_filter_blocks: 1 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: pin_top_level_index_and_filter: 1 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_type: 0 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_block_index_type: 0 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_shortening: 1 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: checksum: 4 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: no_block_cache: 0 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache: 0x55863e1b71f0 2024-09-10T09:26:38.715 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_name: BinnedLRUCache 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_options: 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: capacity : 536870912 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: num_shard_bits : 4 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: strict_capacity_limit : 0 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: high_pri_pool_ratio: 0.000 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_compressed: (nil) 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: persistent_cache: (nil) 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_size: 4096 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_size_deviation: 10 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_restart_interval: 16 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_block_restart_interval: 1 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: metadata_block_size: 4096 2024-09-10T09:26:38.716 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: partition_filters: 0 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: use_delta_encoding: 1 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: filter_policy: bloomfilter 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: whole_key_filtering: 1 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: verify_compression: 0 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: read_amp_bytes_per_bit: 0 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: format_version: 5 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: enable_index_compression: 1 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_align: 0 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_auto_readahead_size: 262144 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: prepopulate_block_cache: 0 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: initial_auto_readahead_size: 8192 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T09:26:38.717 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression: NoCompression 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.num_levels: 7 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T09:26:38.718 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:26:38.719 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T09:26:38.720 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T09:26:38.721 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.table_properties_collectors: 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.inplace_update_support: 0 2024-09-10T09:26:38.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.bloom_locality: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.max_successive_merges: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.ttl: 2592000 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T09:26:38.723 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.enable_blob_files: false 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.min_blob_size: 0 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T09:26:38.724 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi079/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ac76676b-5f81-4abc-ac2b-f20b2488af04 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725960398412711, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725960398413703, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94017, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92023, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84531, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725960398, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ac76676b-5f81-4abc-ac2b-f20b2488af04", "db_session_id": "CZAZSYA862C9DK49IVLQ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725960398413785, "job": 1, "event": "recovery_finished"} 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi079/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55863e254000 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: DB pointer 0x55863e240000 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T09:26:38.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** DB Stats ** 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** Compaction Stats [default] ** 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: L0 2/0 93.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Sum 2/0 93.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T09:26:38.726 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 143.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** Compaction Stats [default] ** 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 143.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T09:26:38.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative compaction: 0.00 GB write, 30.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval compaction: 0.00 GB write, 30.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Block cache BinnedLRUCache@0x55863e1b71f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: starting mon.smithi079 rank 0 at public addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] at bind addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi079 fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???) e1 preinit fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???).mds e1 new map 2024-09-10T09:26:38.728 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???).mds e1 print_map 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: e1 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: legacy client fscid: -1 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: No filesystems configured 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expand map: {default=false} 2024-09-10T09:26:38.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta from 'false' to 'false' 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expanded map: {default=false} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expand map: {default=info} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta from 'info' to 'info' 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expanded map: {default=info} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expand map: {default=daemon} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta from 'daemon' to 'daemon' 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expanded map: {default=daemon} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expand map: {default=debug} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta from 'debug' to 'debug' 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: expand_channel_meta expanded map: {default=debug} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 bash[27574]: f719abe33353aedd50ef63ea381449805830dc7c4016726f20ffbed99803a16f 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 systemd[1]: Started Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mon.smithi079 is new leader, mons smithi079 in quorum (ranks 0) 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: monmap e1: 1 mons at {smithi079=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0]} removed_ranks: {} 2024-09-10T09:26:38.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: fsmap 2024-09-10T09:26:38.731 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T09:26:38.731 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:38 smithi079 ceph-mon[27592]: mgrmap e1: no daemons active 2024-09-10T09:26:39.585 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.917+0000 7f2706d62700 1 Processor -- start 2024-09-10T09:26:39.585 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.917+0000 7f2706d62700 1 -- start start 2024-09-10T09:26:39.585 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.917+0000 7f2706d62700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f2700105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.917+0000 7f2706d62700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27001064c0 con 0x7f2700105b70 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.917+0000 7f2704afe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f2700105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.917+0000 7f2704afe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f2700105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38344/0 (socket says 172.21.15.79:38344) 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.917+0000 7f2704afe700 1 -- 172.21.15.79:0/4117131717 learned_addr learned my addr 172.21.15.79:0/4117131717 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.918+0000 7f2704afe700 1 -- 172.21.15.79:0/4117131717 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700106600 con 0x7f2700105b70 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.918+0000 7f2704afe700 1 --2- 172.21.15.79:0/4117131717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f2700105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098a0 tx=0x7f26fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c787578d6ef0148f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.918+0000 7f26f77fe700 1 -- 172.21.15.79:0/4117131717 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26fc004180 con 0x7f2700105b70 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.918+0000 7f26f77fe700 1 -- 172.21.15.79:0/4117131717 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f26fc0042e0 con 0x7f2700105b70 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.918+0000 7f26f77fe700 1 -- 172.21.15.79:0/4117131717 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26fc011a50 con 0x7f2700105b70 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 -- 172.21.15.79:0/4117131717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 msgr2=0x7f2700105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 --2- 172.21.15.79:0/4117131717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f2700105f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098a0 tx=0x7f26fc009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 -- 172.21.15.79:0/4117131717 shutdown_connections 2024-09-10T09:26:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 --2- 172.21.15.79:0/4117131717 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f2700105f80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 -- 172.21.15.79:0/4117131717 >> 172.21.15.79:0/4117131717 conn(0x7f2700101220 msgr2=0x7f2700103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 -- 172.21.15.79:0/4117131717 shutdown_connections 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 -- 172.21.15.79:0/4117131717 wait complete. 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 Processor -- start 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 -- start start 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f27001998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.919+0000 7f2706d62700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700199df0 con 0x7f2700105b70 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f2704afe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f27001998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f2704afe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f27001998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38358/0 (socket says 172.21.15.79:38358) 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f2704afe700 1 -- 172.21.15.79:0/1022012160 learned_addr learned my addr 172.21.15.79:0/1022012160 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f2704afe700 1 -- 172.21.15.79:0/1022012160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009550 con 0x7f2700105b70 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f2704afe700 1 --2- 172.21.15.79:0/1022012160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f27001998b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f26fc000c00 tx=0x7f26fc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:39.587 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f26f5ffb700 1 -- 172.21.15.79:0/1022012160 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26fc003b90 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f26f5ffb700 1 -- 172.21.15.79:0/1022012160 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f26fc0248b0 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f26f5ffb700 1 -- 172.21.15.79:0/1022012160 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f26fc01a8e0 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2700199ff0 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f26f5ffb700 1 -- 172.21.15.79:0/1022012160 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f26fc0193c0 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.920+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270019a410 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.921+0000 7f26f5ffb700 1 -- 172.21.15.79:0/1022012160 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f26fc019850 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.921+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2700062380 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.924+0000 7f26f5ffb700 1 -- 172.21.15.79:0/1022012160 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f26fc024db0 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.993+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f2700107a30 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.996+0000 7f26f5ffb700 1 -- 172.21.15.79:0/1022012160 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f26fc024a20 con 0x7f2700105b70 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.997+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 msgr2=0x7f27001998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.997+0000 7f2706d62700 1 --2- 172.21.15.79:0/1022012160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f27001998b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f26fc000c00 tx=0x7f26fc011ab0 comp rx=0 tx=0).stop 2024-09-10T09:26:39.588 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.997+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 shutdown_connections 2024-09-10T09:26:39.589 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.997+0000 7f2706d62700 1 --2- 172.21.15.79:0/1022012160 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2700105b70 0x7f27001998b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:39.589 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.997+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 >> 172.21.15.79:0/1022012160 conn(0x7f2700101220 msgr2=0x7f2700101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:39.589 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.997+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 shutdown_connections 2024-09-10T09:26:39.589 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:38.997+0000 7f2706d62700 1 -- 172.21.15.79:0/1022012160 wait complete. 2024-09-10T09:26:39.589 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T09:26:39.612 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:26:39.612 INFO:teuthology.orchestra.run.smithi079.stdout:Creating mgr... 2024-09-10T09:26:39.612 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T09:26:39.613 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T09:26:39.613 INFO:teuthology.orchestra.run.smithi079.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-10T09:26:39.860 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mgr.smithi079.mhirny 2024-09-10T09:26:39.860 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Failed to reset failed state of unit ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mgr.smithi079.mhirny.service: Unit ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mgr.smithi079.mhirny.service not loaded. 2024-09-10T09:26:40.006 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968.target.wants/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mgr.smithi079.mhirny.service → /etc/systemd/system/ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@.service. 2024-09-10T09:26:40.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:39 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1022012160' entity='client.admin' 2024-09-10T09:26:40.521 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:26:40.522 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-10T09:26:40.529 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:26:40.529 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-10T09:26:40.529 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-10T09:26:40.529 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T09:26:40.537 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:26:40.537 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-10T09:26:40.545 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:26:40.545 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-10T09:26:40.545 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-10T09:26:40.545 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-10T09:26:40.545 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr to start... 2024-09-10T09:26:40.545 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr... 2024-09-10T09:26:41.329 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:41 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2663987815' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "afb60aa6-6f56-11ef-bcea-c7b262605968", 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:41.776 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "smithi079" 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T09:26:41.777 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T09:26:41.778 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T09:26:41.779 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T09:26:33.406271+0000", 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.046+0000 7f4fc66db700 1 Processor -- start 2024-09-10T09:26:41.780 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.046+0000 7f4fc66db700 1 -- start start 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.046+0000 7f4fc66db700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc0108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.046+0000 7f4fc66db700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0079d60 con 0x7f4fc0106730 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.046+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc0108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.046+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc0108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38392/0 (socket says 172.21.15.79:38392) 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.046+0000 7f4fbffff700 1 -- 172.21.15.79:0/3115610926 learned_addr learned my addr 172.21.15.79:0/3115610926 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.047+0000 7f4fbffff700 1 -- 172.21.15.79:0/3115610926 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0079ea0 con 0x7f4fc0106730 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.047+0000 7f4fbffff700 1 --2- 172.21.15.79:0/3115610926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc0108b10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00098a0 tx=0x7f4fb0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82b3855fa55a8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.047+0000 7f4fbeffd700 1 -- 172.21.15.79:0/3115610926 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fb0004180 con 0x7f4fc0106730 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.047+0000 7f4fbeffd700 1 -- 172.21.15.79:0/3115610926 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4fb00042e0 con 0x7f4fc0106730 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.047+0000 7f4fbeffd700 1 -- 172.21.15.79:0/3115610926 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fb0011a50 con 0x7f4fc0106730 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.048+0000 7f4fc66db700 1 -- 172.21.15.79:0/3115610926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 msgr2=0x7f4fc0108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.048+0000 7f4fc66db700 1 --2- 172.21.15.79:0/3115610926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc0108b10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00098a0 tx=0x7f4fb0009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.048+0000 7f4fc66db700 1 -- 172.21.15.79:0/3115610926 shutdown_connections 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.048+0000 7f4fc66db700 1 --2- 172.21.15.79:0/3115610926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc0108b10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.048+0000 7f4fc66db700 1 -- 172.21.15.79:0/3115610926 >> 172.21.15.79:0/3115610926 conn(0x7f4fc0100130 msgr2=0x7f4fc0102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.048+0000 7f4fc66db700 1 -- 172.21.15.79:0/3115610926 shutdown_connections 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.048+0000 7f4fc66db700 1 -- 172.21.15.79:0/3115610926 wait complete. 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.049+0000 7f4fc66db700 1 Processor -- start 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.049+0000 7f4fc66db700 1 -- start start 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.049+0000 7f4fc66db700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc01998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.049+0000 7f4fc66db700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0199df0 con 0x7f4fc0106730 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.049+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc01998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.049+0000 7f4fbffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc01998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38398/0 (socket says 172.21.15.79:38398) 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.049+0000 7f4fbffff700 1 -- 172.21.15.79:0/2663987815 learned_addr learned my addr 172.21.15.79:0/2663987815 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fbffff700 1 -- 172.21.15.79:0/2663987815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009550 con 0x7f4fc0106730 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fbffff700 1 --2- 172.21.15.79:0/2663987815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc01998b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0000c00 tx=0x7f4fb0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:41.782 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fbd7fa700 1 -- 172.21.15.79:0/2663987815 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fb0003b90 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fbd7fa700 1 -- 172.21.15.79:0/2663987815 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4fb00248b0 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc019a050 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fbd7fa700 1 -- 172.21.15.79:0/2663987815 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4fb001a8e0 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc019a4d0 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fbd7fa700 1 -- 172.21.15.79:0/2663987815 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4fb002d3f0 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.050+0000 7f4fbd7fa700 1 -- 172.21.15.79:0/2663987815 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4fb0019490 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.051+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0109c70 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.053+0000 7f4fbd7fa700 1 -- 172.21.15.79:0/2663987815 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4fb0024a20 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.128+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4fc0109e60 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.128+0000 7f4fbd7fa700 1 -- 172.21.15.79:0/2663987815 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f4fb0024bc0 con 0x7f4fc0106730 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.129+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 msgr2=0x7f4fc01998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.129+0000 7f4fc66db700 1 --2- 172.21.15.79:0/2663987815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc01998b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0000c00 tx=0x7f4fb0011ab0 comp rx=0 tx=0).stop 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.129+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 shutdown_connections 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.129+0000 7f4fc66db700 1 --2- 172.21.15.79:0/2663987815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4fc0106730 0x7f4fc01998b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.129+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 >> 172.21.15.79:0/2663987815 conn(0x7f4fc0100130 msgr2=0x7f4fc0100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:41.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.129+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 shutdown_connections 2024-09-10T09:26:41.784 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:41.129+0000 7f4fc66db700 1 -- 172.21.15.79:0/2663987815 wait complete. 2024-09-10T09:26:41.784 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (1/15)... 2024-09-10T09:26:44.935 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:44 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3559947301' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T09:26:45.337 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:45.337 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:26:45.337 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "afb60aa6-6f56-11ef-bcea-c7b262605968", 2024-09-10T09:26:45.337 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "smithi079" 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T09:26:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T09:26:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T09:26:45.347 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T09:26:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T09:26:45.349 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T09:26:45.350 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T09:26:45.350 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T09:26:45.350 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T09:26:45.350 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:45.350 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:45.350 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:45.351 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T09:26:45.351 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:45.352 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T09:26:33.406271+0000", 2024-09-10T09:26:45.352 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:45.352 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:45.352 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T09:26:45.352 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:26:45.352 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.643+0000 7f150fcdf700 1 Processor -- start 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150fcdf700 1 -- start start 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150fcdf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150807a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150fcdf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150807a860 con 0x7f150807be20 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150da7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150807a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150da7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150807a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34760/0 (socket says 172.21.15.79:34760) 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150da7b700 1 -- 172.21.15.79:0/4188418288 learned_addr learned my addr 172.21.15.79:0/4188418288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150da7b700 1 -- 172.21.15.79:0/4188418288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150807a9a0 con 0x7f150807be20 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150da7b700 1 --2- 172.21.15.79:0/4188418288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150807a320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15040098a0 tx=0x7f1504009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83293dd004b8e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.644+0000 7f150ca79700 1 -- 172.21.15.79:0/4188418288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1504004180 con 0x7f150807be20 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150ca79700 1 -- 172.21.15.79:0/4188418288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f15040042e0 con 0x7f150807be20 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150ca79700 1 -- 172.21.15.79:0/4188418288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1504011a50 con 0x7f150807be20 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150fcdf700 1 -- 172.21.15.79:0/4188418288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 msgr2=0x7f150807a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:45.353 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150fcdf700 1 --2- 172.21.15.79:0/4188418288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150807a320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15040098a0 tx=0x7f1504009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150fcdf700 1 -- 172.21.15.79:0/4188418288 shutdown_connections 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150fcdf700 1 --2- 172.21.15.79:0/4188418288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150807a320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150fcdf700 1 -- 172.21.15.79:0/4188418288 >> 172.21.15.79:0/4188418288 conn(0x7f1508101220 msgr2=0x7f1508103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150fcdf700 1 -- 172.21.15.79:0/4188418288 shutdown_connections 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.645+0000 7f150fcdf700 1 -- 172.21.15.79:0/4188418288 wait complete. 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150fcdf700 1 Processor -- start 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150fcdf700 1 -- start start 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150fcdf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150fcdf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150819c0b0 con 0x7f150807be20 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150da7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150da7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150819bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34766/0 (socket says 172.21.15.79:34766) 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150da7b700 1 -- 172.21.15.79:0/3559947301 learned_addr learned my addr 172.21.15.79:0/3559947301 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.646+0000 7f150da7b700 1 -- 172.21.15.79:0/3559947301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009550 con 0x7f150807be20 2024-09-10T09:26:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f150da7b700 1 --2- 172.21.15.79:0/3559947301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150819bb70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1504003de0 tx=0x7f1504011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f14feffd700 1 -- 172.21.15.79:0/3559947301 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1504003930 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f14feffd700 1 -- 172.21.15.79:0/3559947301 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1504003a90 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f14feffd700 1 -- 172.21.15.79:0/3559947301 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15040196c0 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150819c2b0 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150819c610 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f14feffd700 1 -- 172.21.15.79:0/3559947301 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1504019c30 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.647+0000 7f14feffd700 1 -- 172.21.15.79:0/3559947301 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f150402c3a0 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.648+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1508195b70 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.650+0000 7f14feffd700 1 -- 172.21.15.79:0/3559947301 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f150401abc0 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.723+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f150802ce20 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.723+0000 7f14feffd700 1 -- 172.21.15.79:0/3559947301 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f150401a430 con 0x7f150807be20 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.725+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 msgr2=0x7f150819bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.725+0000 7f150fcdf700 1 --2- 172.21.15.79:0/3559947301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150819bb70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1504003de0 tx=0x7f1504011ab0 comp rx=0 tx=0).stop 2024-09-10T09:26:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.725+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 shutdown_connections 2024-09-10T09:26:45.356 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.725+0000 7f150fcdf700 1 --2- 172.21.15.79:0/3559947301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f150807be20 0x7f150819bb70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:45.356 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.725+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 >> 172.21.15.79:0/3559947301 conn(0x7f1508101220 msgr2=0x7f1508102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:45.356 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.725+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 shutdown_connections 2024-09-10T09:26:45.356 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:44.725+0000 7f150fcdf700 1 -- 172.21.15.79:0/3559947301 wait complete. 2024-09-10T09:26:45.356 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (2/15)... 2024-09-10T09:26:47.441 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: Activating manager daemon smithi079.mhirny 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: mgrmap e2: smithi079.mhirny(active, starting, since 0.00324166s) 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:26:47.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:47 smithi079 ceph-mon[27592]: from='mgr.14100 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:26:48.421 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:48 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/851790620' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T09:26:48.421 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:48 smithi079 ceph-mon[27592]: mgrmap e3: smithi079.mhirny(active, since 1.00597s) 2024-09-10T09:26:48.425 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "afb60aa6-6f56-11ef-bcea-c7b262605968", 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "smithi079" 2024-09-10T09:26:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T09:26:48.427 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T09:26:48.434 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T09:26:48.434 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T09:26:48.434 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:48.435 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:48.436 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T09:26:33.406271+0000", 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.780+0000 7fb2f8a65700 1 Processor -- start 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.780+0000 7fb2f8a65700 1 -- start start 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.780+0000 7fb2f8a65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f4104610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.780+0000 7fb2f8a65700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4104b50 con 0x7fb2f4104200 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f4104610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:48.437 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f4104610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34842/0 (socket says 172.21.15.79:34842) 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f259c700 1 -- 172.21.15.79:0/344971329 learned_addr learned my addr 172.21.15.79:0/344971329 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f259c700 1 -- 172.21.15.79:0/344971329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4104c90 con 0x7fb2f4104200 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f259c700 1 --2- 172.21.15.79:0/344971329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f4104610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0098a0 tx=0x7fb2ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a764ee6d0c4ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f159a700 1 -- 172.21.15.79:0/344971329 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2ec004180 con 0x7fb2f4104200 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f159a700 1 -- 172.21.15.79:0/344971329 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb2ec0042e0 con 0x7fb2f4104200 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.781+0000 7fb2f159a700 1 -- 172.21.15.79:0/344971329 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2ec011a50 con 0x7fb2f4104200 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.782+0000 7fb2f8a65700 1 -- 172.21.15.79:0/344971329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 msgr2=0x7fb2f4104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.782+0000 7fb2f8a65700 1 --2- 172.21.15.79:0/344971329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f4104610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0098a0 tx=0x7fb2ec009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.782+0000 7fb2f8a65700 1 -- 172.21.15.79:0/344971329 shutdown_connections 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.782+0000 7fb2f8a65700 1 --2- 172.21.15.79:0/344971329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f4104610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.782+0000 7fb2f8a65700 1 -- 172.21.15.79:0/344971329 >> 172.21.15.79:0/344971329 conn(0x7fb2f40ff870 msgr2=0x7fb2f4101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.782+0000 7fb2f8a65700 1 -- 172.21.15.79:0/344971329 shutdown_connections 2024-09-10T09:26:48.438 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.782+0000 7fb2f8a65700 1 -- 172.21.15.79:0/344971329 wait complete. 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f8a65700 1 Processor -- start 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f8a65700 1 -- start start 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f8a65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f41998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f8a65700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f4199e10 con 0x7fb2f4104200 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f41998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f41998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34858/0 (socket says 172.21.15.79:34858) 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f259c700 1 -- 172.21.15.79:0/851790620 learned_addr learned my addr 172.21.15.79:0/851790620 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f259c700 1 -- 172.21.15.79:0/851790620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec009550 con 0x7fb2f4104200 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f259c700 1 --2- 172.21.15.79:0/851790620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f41998d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0119e0 tx=0x7fb2ec011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2eb7fe700 1 -- 172.21.15.79:0/851790620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2ec003b90 con 0x7fb2f4104200 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f419a010 con 0x7fb2f4104200 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2eb7fe700 1 -- 172.21.15.79:0/851790620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb2ec01a8a0 con 0x7fb2f4104200 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.783+0000 7fb2eb7fe700 1 -- 172.21.15.79:0/851790620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2ec019930 con 0x7fb2f4104200 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.784+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f419a430 con 0x7fb2f4104200 2024-09-10T09:26:48.439 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.784+0000 7fb2eb7fe700 1 -- 172.21.15.79:0/851790620 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 2) v1 ==== 44840+0+0 (secure 0 0 0) 0x7fb2ec019bf0 con 0x7fb2f4104200 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.784+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f4062380 con 0x7fb2f4104200 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.785+0000 7fb2eb7fe700 1 -- 172.21.15.79:0/851790620 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb2ec04c500 con 0x7fb2f4104200 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.787+0000 7fb2eb7fe700 1 -- 172.21.15.79:0/851790620 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fb2ec02d440 con 0x7fb2f4104200 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.857+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb2f4106070 con 0x7fb2f4104200 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.857+0000 7fb2eb7fe700 1 -- 172.21.15.79:0/851790620 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fb2ec02b340 con 0x7fb2f4104200 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.858+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 msgr2=0x7fb2f41998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.858+0000 7fb2f8a65700 1 --2- 172.21.15.79:0/851790620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f41998d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0119e0 tx=0x7fb2ec011ac0 comp rx=0 tx=0).stop 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.858+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 shutdown_connections 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.858+0000 7fb2f8a65700 1 --2- 172.21.15.79:0/851790620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2f4104200 0x7fb2f41998d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.858+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 >> 172.21.15.79:0/851790620 conn(0x7fb2f40ff870 msgr2=0x7fb2f4100560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.858+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 shutdown_connections 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:47.858+0000 7fb2f8a65700 1 -- 172.21.15.79:0/851790620 wait complete. 2024-09-10T09:26:48.440 INFO:teuthology.orchestra.run.smithi079.stdout:mgr not available, waiting (3/15)... 2024-09-10T09:26:50.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:50 smithi079 ceph-mon[27592]: mgrmap e4: smithi079.mhirny(active, since 2s) 2024-09-10T09:26:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:51 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3064882704' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T09:26:51.823 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:51.823 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsid": "afb60aa6-6f56-11ef-bcea-c7b262605968", 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 0 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "smithi079" 2024-09-10T09:26:51.824 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T09:26:51.825 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T09:26:51.826 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ], 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:51.827 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T09:26:33.406271+0000", 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout }, 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.922+0000 7fa9ad69f700 1 Processor -- start 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.922+0000 7fa9ad69f700 1 -- start start 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.922+0000 7fa9ad69f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8108af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.922+0000 7fa9ad69f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8079d40 con 0x7fa9a8106710 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.922+0000 7fa9a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8108af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.922+0000 7fa9a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8108af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34868/0 (socket says 172.21.15.79:34868) 2024-09-10T09:26:51.828 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.922+0000 7fa9a6ffd700 1 -- 172.21.15.79:0/675571454 learned_addr learned my addr 172.21.15.79:0/675571454 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.923+0000 7fa9a6ffd700 1 -- 172.21.15.79:0/675571454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a8079e80 con 0x7fa9a8106710 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.923+0000 7fa9a6ffd700 1 --2- 172.21.15.79:0/675571454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8108af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa998009e80 tx=0x7fa99800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aadbc979dbcb625 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.923+0000 7fa9a5ffb700 1 -- 172.21.15.79:0/675571454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99800e070 con 0x7fa9a8106710 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.923+0000 7fa9a5ffb700 1 -- 172.21.15.79:0/675571454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa998003e90 con 0x7fa9a8106710 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.923+0000 7fa9a5ffb700 1 -- 172.21.15.79:0/675571454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa998004380 con 0x7fa9a8106710 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.923+0000 7fa9ad69f700 1 -- 172.21.15.79:0/675571454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 msgr2=0x7fa9a8108af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.923+0000 7fa9ad69f700 1 --2- 172.21.15.79:0/675571454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8108af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa998009e80 tx=0x7fa99800b330 comp rx=0 tx=0).stop 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.924+0000 7fa9ad69f700 1 -- 172.21.15.79:0/675571454 shutdown_connections 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.924+0000 7fa9ad69f700 1 --2- 172.21.15.79:0/675571454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8108af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.924+0000 7fa9ad69f700 1 -- 172.21.15.79:0/675571454 >> 172.21.15.79:0/675571454 conn(0x7fa9a8100150 msgr2=0x7fa9a8102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.924+0000 7fa9ad69f700 1 -- 172.21.15.79:0/675571454 shutdown_connections 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.924+0000 7fa9ad69f700 1 -- 172.21.15.79:0/675571454 wait complete. 2024-09-10T09:26:51.829 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.924+0000 7fa9ad69f700 1 Processor -- start 2024-09-10T09:26:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.924+0000 7fa9ad69f700 1 -- start start 2024-09-10T09:26:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9ad69f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9ad69f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8199dc0 con 0x7fa9a8106710 2024-09-10T09:26:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34872/0 (socket says 172.21.15.79:34872) 2024-09-10T09:26:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9a6ffd700 1 -- 172.21.15.79:0/3064882704 learned_addr learned my addr 172.21.15.79:0/3064882704 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:51.830 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9a6ffd700 1 -- 172.21.15.79:0/3064882704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998009b30 con 0x7fa9a8106710 2024-09-10T09:26:51.833 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9a6ffd700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8199880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b7b0 tx=0x7fa998004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:51.833 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa99ffff700 1 -- 172.21.15.79:0/3064882704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99800e040 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa99ffff700 1 -- 172.21.15.79:0/3064882704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa998003c70 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a8199fc0 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa99ffff700 1 -- 172.21.15.79:0/3064882704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99801b730 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.925+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a819a440 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.926+0000 7fa99ffff700 1 -- 172.21.15.79:0/3064882704 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7fa998019040 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.926+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a80623f0 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.926+0000 7fa99ffff700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa9940383b0 0x7fa99403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.926+0000 7fa99ffff700 1 -- 172.21.15.79:0/3064882704 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa99804bbe0 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.927+0000 7fa9a67fc700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa9940383b0 0x7fa99403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.927+0000 7fa9a67fc700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa9940383b0 0x7fa99403a860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa990006fd0 tx=0x7fa990006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:50.931+0000 7fa99ffff700 1 -- 172.21.15.79:0/3064882704 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa9a80623f0 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.195+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa9a8062380 con 0x7fa9a8106710 2024-09-10T09:26:51.834 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.195+0000 7fa99ffff700 1 -- 172.21.15.79:0/3064882704 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fa99801f090 con 0x7fa9a8106710 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa9940383b0 msgr2=0x7fa99403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa9940383b0 0x7fa99403a860 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa990006fd0 tx=0x7fa990006e40 comp rx=0 tx=0).stop 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 msgr2=0x7fa9a8199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8199880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b7b0 tx=0x7fa998004430 comp rx=0 tx=0).stop 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 shutdown_connections 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa9940383b0 0x7fa99403a860 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 --2- 172.21.15.79:0/3064882704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8106710 0x7fa9a8199880 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 >> 172.21.15.79:0/3064882704 conn(0x7fa9a8100150 msgr2=0x7fa9a8100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 shutdown_connections 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:51.198+0000 7fa9ad69f700 1 -- 172.21.15.79:0/3064882704 wait complete. 2024-09-10T09:26:51.835 INFO:teuthology.orchestra.run.smithi079.stdout:mgr is available 2024-09-10T09:26:52.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:52 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3249854620' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T09:26:53.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout fsid = afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T09:26:53.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.263+0000 7f21a55b7700 1 Processor -- start 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.263+0000 7f21a55b7700 1 -- start start 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.263+0000 7f21a55b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a0104610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.263+0000 7f21a55b7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0104b50 con 0x7f21a0104200 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a0104610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a0104610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34816/0 (socket says 172.21.15.79:34816) 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219effd700 1 -- 172.21.15.79:0/3609596576 learned_addr learned my addr 172.21.15.79:0/3609596576 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219effd700 1 -- 172.21.15.79:0/3609596576 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0104c90 con 0x7f21a0104200 2024-09-10T09:26:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219effd700 1 --2- 172.21.15.79:0/3609596576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a0104610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f219000aa40 tx=0x7f219000ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5745cb27f14ea6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219e7fc700 1 -- 172.21.15.79:0/3609596576 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2190004180 con 0x7f21a0104200 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219e7fc700 1 -- 172.21.15.79:0/3609596576 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f219000cd60 con 0x7f21a0104200 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.264+0000 7f219e7fc700 1 -- 172.21.15.79:0/3609596576 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2190003ce0 con 0x7f21a0104200 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 -- 172.21.15.79:0/3609596576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 msgr2=0x7f21a0104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 --2- 172.21.15.79:0/3609596576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a0104610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f219000aa40 tx=0x7f219000ad50 comp rx=0 tx=0).stop 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 -- 172.21.15.79:0/3609596576 shutdown_connections 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 --2- 172.21.15.79:0/3609596576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a0104610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 -- 172.21.15.79:0/3609596576 >> 172.21.15.79:0/3609596576 conn(0x7f21a00ff870 msgr2=0x7f21a0101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 -- 172.21.15.79:0/3609596576 shutdown_connections 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 -- 172.21.15.79:0/3609596576 wait complete. 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 Processor -- start 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.265+0000 7f21a55b7700 1 -- start start 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f21a55b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a01998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:53.061 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f21a55b7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0199de0 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a01998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a01998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34822/0 (socket says 172.21.15.79:34822) 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219effd700 1 -- 172.21.15.79:0/3249854620 learned_addr learned my addr 172.21.15.79:0/3249854620 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219effd700 1 -- 172.21.15.79:0/3249854620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219000a6f0 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219effd700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a01998a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f2190004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219cff9700 1 -- 172.21.15.79:0/3249854620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2190010600 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a0199fe0 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219cff9700 1 -- 172.21.15.79:0/3249854620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2190010bd0 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f219cff9700 1 -- 172.21.15.79:0/3249854620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2190021980 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.266+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a019a400 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.267+0000 7f219cff9700 1 -- 172.21.15.79:0/3249854620 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f219002b440 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.267+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a0193090 con 0x7f21a0104200 2024-09-10T09:26:53.062 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.267+0000 7f219cff9700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f218c0383a0 0x7f218c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.267+0000 7f219cff9700 1 -- 172.21.15.79:0/3249854620 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f219004c560 con 0x7f21a0104200 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.267+0000 7f2197fff700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f218c0383a0 0x7f218c03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.268+0000 7f2197fff700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f218c0383a0 0x7f218c03a850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2188006fd0 tx=0x7f2188006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.272+0000 7f219cff9700 1 -- 172.21.15.79:0/3249854620 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2190029770 con 0x7f21a0104200 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.459+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f21a002c280 con 0x7f21a0104200 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.460+0000 7f219cff9700 1 -- 172.21.15.79:0/3249854620 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f2190026020 con 0x7f21a0104200 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f218c0383a0 msgr2=0x7f218c03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f218c0383a0 0x7f218c03a850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2188006fd0 tx=0x7f2188006e40 comp rx=0 tx=0).stop 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 msgr2=0x7f21a01998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a01998a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2190000c00 tx=0x7f2190004230 comp rx=0 tx=0).stop 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 shutdown_connections 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f218c0383a0 0x7f218c03a850 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 --2- 172.21.15.79:0/3249854620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21a0104200 0x7f21a01998a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 >> 172.21.15.79:0/3249854620 conn(0x7f21a00ff870 msgr2=0x7f21a018bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:53.063 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 shutdown_connections 2024-09-10T09:26:53.064 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:52.462+0000 7f21a55b7700 1 -- 172.21.15.79:0/3249854620 wait complete. 2024-09-10T09:26:53.064 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling cephadm module... 2024-09-10T09:26:54.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:54 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/4263540766' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T09:26:55.055 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9816df9700 1 Processor -- start 2024-09-10T09:26:55.055 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9816df9700 1 -- start start 2024-09-10T09:26:55.055 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9816df9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f9810105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:55.055 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9816df9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98101064c0 con 0x7f9810105b70 2024-09-10T09:26:55.055 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9814b95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f9810105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:55.055 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9814b95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f9810105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34824/0 (socket says 172.21.15.79:34824) 2024-09-10T09:26:55.055 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9814b95700 1 -- 172.21.15.79:0/2699189157 learned_addr learned my addr 172.21.15.79:0/2699189157 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9814b95700 1 -- 172.21.15.79:0/2699189157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810106600 con 0x7f9810105b70 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.479+0000 7f9814b95700 1 --2- 172.21.15.79:0/2699189157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f9810105f80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f98040098a0 tx=0x7f9804009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cea53b584c4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f980f7fe700 1 -- 172.21.15.79:0/2699189157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9804004180 con 0x7f9810105b70 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f980f7fe700 1 -- 172.21.15.79:0/2699189157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f98040042e0 con 0x7f9810105b70 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f980f7fe700 1 -- 172.21.15.79:0/2699189157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9804011a50 con 0x7f9810105b70 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f9816df9700 1 -- 172.21.15.79:0/2699189157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 msgr2=0x7f9810105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f9816df9700 1 --2- 172.21.15.79:0/2699189157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f9810105f80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f98040098a0 tx=0x7f9804009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:55.056 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f9816df9700 1 -- 172.21.15.79:0/2699189157 shutdown_connections 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f9816df9700 1 --2- 172.21.15.79:0/2699189157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f9810105f80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f9816df9700 1 -- 172.21.15.79:0/2699189157 >> 172.21.15.79:0/2699189157 conn(0x7f9810101220 msgr2=0x7f9810103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f9816df9700 1 -- 172.21.15.79:0/2699189157 shutdown_connections 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.480+0000 7f9816df9700 1 -- 172.21.15.79:0/2699189157 wait complete. 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9816df9700 1 Processor -- start 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9816df9700 1 -- start start 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9816df9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f98101998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9816df9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9810199df0 con 0x7f9810105b70 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9814b95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f98101998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9814b95700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f98101998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34828/0 (socket says 172.21.15.79:34828) 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9814b95700 1 -- 172.21.15.79:0/4263540766 learned_addr learned my addr 172.21.15.79:0/4263540766 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9814b95700 1 -- 172.21.15.79:0/4263540766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9804009550 con 0x7f9810105b70 2024-09-10T09:26:55.057 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9814b95700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f98101998b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9804000c00 tx=0x7f9804011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9804003b90 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f98040248b0 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9810199ff0 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.481+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f980401a8e0 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.482+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981019a410 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.482+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 45073+0+0 (secure 0 0 0) 0x7f9804024a20 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.483+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981010a000 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.483+0000 7f980dffb700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f98000383f0 0x7f980003a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.483+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f980404c130 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.483+0000 7f980ffff700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f98000383f0 0x7f980003a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.483+0000 7f980ffff700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f98000383f0 0x7f980003a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f97fc006fd0 tx=0x7f97fc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.487+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f9804024db0 con 0x7f9810105b70 2024-09-10T09:26:55.058 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:53.729+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f98100623d0 con 0x7f9810105b70 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.425+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f980402d910 con 0x7f9810105b70 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.426+0000 7f980dffb700 1 -- 172.21.15.79:0/4263540766 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f980401aa40 con 0x7f9810105b70 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f98000383f0 msgr2=0x7f980003a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f98000383f0 0x7f980003a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f97fc006fd0 tx=0x7f97fc006e40 comp rx=0 tx=0).stop 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 msgr2=0x7f98101998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f98101998b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9804000c00 tx=0x7f9804011ab0 comp rx=0 tx=0).stop 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 shutdown_connections 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f98000383f0 0x7f980003a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 --2- 172.21.15.79:0/4263540766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9810105b70 0x7f98101998b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 >> 172.21.15.79:0/4263540766 conn(0x7f9810101220 msgr2=0x7f9810101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 shutdown_connections 2024-09-10T09:26:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:54.429+0000 7f9816df9700 1 -- 172.21.15.79:0/4263540766 wait complete. 2024-09-10T09:26:55.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:55 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/4263540766' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T09:26:55.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:55 smithi079 ceph-mon[27592]: mgrmap e5: smithi079.mhirny(active, since 7s) 2024-09-10T09:26:56.379 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "smithi079.mhirny", 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.467+0000 7fcd35c19700 1 Processor -- start 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.467+0000 7fcd35c19700 1 -- start start 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.467+0000 7fcd35c19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd301042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.467+0000 7fcd35c19700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301047f0 con 0x7fcd30103ea0 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd301042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd301042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34848/0 (socket says 172.21.15.79:34848) 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2f7fe700 1 -- 172.21.15.79:0/3254951860 learned_addr learned my addr 172.21.15.79:0/3254951860 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:56.380 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2f7fe700 1 -- 172.21.15.79:0/3254951860 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30104930 con 0x7fcd30103ea0 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2f7fe700 1 --2- 172.21.15.79:0/3254951860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd301042b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098a0 tx=0x7fcd20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3b39ce95b56d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2e7fc700 1 -- 172.21.15.79:0/3254951860 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd20004180 con 0x7fcd30103ea0 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2e7fc700 1 -- 172.21.15.79:0/3254951860 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcd200042e0 con 0x7fcd30103ea0 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.468+0000 7fcd2e7fc700 1 -- 172.21.15.79:0/3254951860 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd20011a50 con 0x7fcd30103ea0 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.469+0000 7fcd35c19700 1 -- 172.21.15.79:0/3254951860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 msgr2=0x7fcd301042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.469+0000 7fcd35c19700 1 --2- 172.21.15.79:0/3254951860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd301042b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd200098a0 tx=0x7fcd20009bb0 comp rx=0 tx=0).stop 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.469+0000 7fcd35c19700 1 -- 172.21.15.79:0/3254951860 shutdown_connections 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.469+0000 7fcd35c19700 1 --2- 172.21.15.79:0/3254951860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd301042b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.469+0000 7fcd35c19700 1 -- 172.21.15.79:0/3254951860 >> 172.21.15.79:0/3254951860 conn(0x7fcd300ff880 msgr2=0x7fcd30101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:56.381 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.469+0000 7fcd35c19700 1 -- 172.21.15.79:0/3254951860 shutdown_connections 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.469+0000 7fcd35c19700 1 -- 172.21.15.79:0/3254951860 wait complete. 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.470+0000 7fcd35c19700 1 Processor -- start 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.470+0000 7fcd35c19700 1 -- start start 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.470+0000 7fcd35c19700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd30199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.470+0000 7fcd35c19700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30199e40 con 0x7fcd30103ea0 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.470+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd30199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.470+0000 7fcd2f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd30199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34860/0 (socket says 172.21.15.79:34860) 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.470+0000 7fcd2f7fe700 1 -- 172.21.15.79:0/3517163150 learned_addr learned my addr 172.21.15.79:0/3517163150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.471+0000 7fcd2f7fe700 1 -- 172.21.15.79:0/3517163150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009550 con 0x7fcd30103ea0 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.471+0000 7fcd2f7fe700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd30199900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd20006af0 tx=0x7fcd20011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.471+0000 7fcd2cff9700 1 -- 172.21.15.79:0/3517163150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd20003b90 con 0x7fcd30103ea0 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.471+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3019a040 con 0x7fcd30103ea0 2024-09-10T09:26:56.382 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.471+0000 7fcd2cff9700 1 -- 172.21.15.79:0/3517163150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcd2001a8a0 con 0x7fcd30103ea0 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.471+0000 7fcd2cff9700 1 -- 172.21.15.79:0/3517163150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd20019880 con 0x7fcd30103ea0 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.471+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3019a460 con 0x7fcd30103ea0 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.472+0000 7fcd2cff9700 1 -- 172.21.15.79:0/3517163150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fcd20019b40 con 0x7fcd30103ea0 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.472+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30107a60 con 0x7fcd30103ea0 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.472+0000 7fcd2cff9700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 0x7fcd1803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.472+0000 7fcd2cff9700 1 -- 172.21.15.79:0/3517163150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcd2004c700 con 0x7fcd30103ea0 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.472+0000 7fcd2effd700 1 -- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 msgr2=0x7fcd1803a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:26:56.383 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.472+0000 7fcd2effd700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 0x7fcd1803a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.477+0000 7fcd2cff9700 1 -- 172.21.15.79:0/3517163150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcd2002b750 con 0x7fcd30103ea0 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.673+0000 7fcd2effd700 1 -- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 msgr2=0x7fcd1803a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.673+0000 7fcd2effd700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 0x7fcd1803a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.730+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcd30107c50 con 0x7fcd30103ea0 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.731+0000 7fcd2cff9700 1 -- 172.21.15.79:0/3517163150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fcd20018350 con 0x7fcd30103ea0 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 msgr2=0x7fcd1803a860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 0x7fcd1803a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 msgr2=0x7fcd30199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd30199900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd20006af0 tx=0x7fcd20011a90 comp rx=0 tx=0).stop 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 shutdown_connections 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcd180383b0 0x7fcd1803a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 --2- 172.21.15.79:0/3517163150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd30103ea0 0x7fcd30199900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:26:56.384 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 >> 172.21.15.79:0/3517163150 conn(0x7fcd300ff880 msgr2=0x7fcd30100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:26:56.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 shutdown_connections 2024-09-10T09:26:56.385 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:55.733+0000 7fcd35c19700 1 -- 172.21.15.79:0/3517163150 wait complete. 2024-09-10T09:26:56.385 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-09-10T09:26:56.385 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 5... 2024-09-10T09:26:56.706 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:26:56 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3517163150' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T09:27:01.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: Active manager daemon smithi079.mhirny restarted 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: Activating manager daemon smithi079.mhirny 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: mgrmap e6: smithi079.mhirny(active, starting, since 0.0034628s) 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:27:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:01.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:01.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:27:01.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:27:01.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:27:01.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:27:01.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:01 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:27:02.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:02 smithi079 ceph-mon[27592]: Found migration_current of "None". Setting to last migration. 2024-09-10T09:27:02.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:02 smithi079 ceph-mon[27592]: mgrmap e7: smithi079.mhirny(active, since 1.00554s) 2024-09-10T09:27:02.744 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc9a8fb700 1 Processor -- start 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc9a8fb700 1 -- start start 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc9a8fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc9a8fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc941064e0 con 0x7fdc94105b90 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc93fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:03.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc93fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94105fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34862/0 (socket says 172.21.15.79:34862) 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc93fff700 1 -- 172.21.15.79:0/2877789999 learned_addr learned my addr 172.21.15.79:0/2877789999 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc93fff700 1 -- 172.21.15.79:0/2877789999 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94106620 con 0x7fdc94105b90 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.808+0000 7fdc93fff700 1 --2- 172.21.15.79:0/2877789999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94105fa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc840098a0 tx=0x7fdc84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a6d4b93514c409 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc92ffd700 1 -- 172.21.15.79:0/2877789999 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84004180 con 0x7fdc94105b90 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc92ffd700 1 -- 172.21.15.79:0/2877789999 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc840042e0 con 0x7fdc94105b90 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc92ffd700 1 -- 172.21.15.79:0/2877789999 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84011a50 con 0x7fdc94105b90 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/2877789999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 msgr2=0x7fdc94105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc9a8fb700 1 --2- 172.21.15.79:0/2877789999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94105fa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc840098a0 tx=0x7fdc84009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/2877789999 shutdown_connections 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc9a8fb700 1 --2- 172.21.15.79:0/2877789999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94105fa0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/2877789999 >> 172.21.15.79:0/2877789999 conn(0x7fdc94101220 msgr2=0x7fdc94103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/2877789999 shutdown_connections 2024-09-10T09:27:03.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.809+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/2877789999 wait complete. 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.810+0000 7fdc9a8fb700 1 Processor -- start 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.810+0000 7fdc9a8fb700 1 -- start start 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.810+0000 7fdc9a8fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.810+0000 7fdc9a8fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94199e60 con 0x7fdc94105b90 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.810+0000 7fdc93fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.810+0000 7fdc93fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34870/0 (socket says 172.21.15.79:34870) 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.810+0000 7fdc93fff700 1 -- 172.21.15.79:0/1911751285 learned_addr learned my addr 172.21.15.79:0/1911751285 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.811+0000 7fdc93fff700 1 -- 172.21.15.79:0/1911751285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009550 con 0x7fdc94105b90 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.811+0000 7fdc93fff700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94199920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc84003de0 tx=0x7fdc84011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.811+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84003930 con 0x7fdc94105b90 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.811+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9419a060 con 0x7fdc94105b90 2024-09-10T09:27:03.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.811+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc84003a90 con 0x7fdc94105b90 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.811+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdc84019730 con 0x7fdc94105b90 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.811+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9419a480 con 0x7fdc94105b90 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.812+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fdc84019960 con 0x7fdc94105b90 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.812+0000 7fdc917fa700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.812+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc7c03b000 con 0x7fdc7c038440 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.812+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdc8404c0e0 con 0x7fdc94105b90 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.812+0000 7fdc937fe700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 msgr2=0x7fdc7c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:56.812+0000 7fdc937fe700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:57.013+0000 7fdc937fe700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 msgr2=0x7fdc7c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:57.013+0000 7fdc937fe700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:57.414+0000 7fdc937fe700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 msgr2=0x7fdc7c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:57.414+0000 7fdc937fe700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T09:27:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:58.215+0000 7fdc937fe700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 msgr2=0x7fdc7c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:58.215+0000 7fdc937fe700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:59.816+0000 7fdc937fe700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 msgr2=0x7fdc7c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:26:59.816+0000 7fdc937fe700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:01.093+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mgrmap(e 6) v1 ==== 44851+0+0 (secure 0 0 0) 0x7fdc8402c960 con 0x7fdc94105b90 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:01.093+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 msgr2=0x7fdc7c03a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:01.093+0000 7fdc917fa700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.094+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fdc8404dd40 con 0x7fdc94105b90 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.094+0000 7fdc917fa700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.094+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc7c03b000 con 0x7fdc7c038440 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.095+0000 7fdc937fe700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.095+0000 7fdc937fe700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdc88003a10 tx=0x7fdc880092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.096+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fdc7c03b000 con 0x7fdc7c038440 2024-09-10T09:27:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.102+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fdc9419ac60 con 0x7fdc7c038440 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.102+0000 7fdc917fa700 1 -- 172.21.15.79:0/1911751285 <== mgr.14120 v2:172.21.15.79:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdc9419ac60 con 0x7fdc7c038440 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 msgr2=0x7fdc7c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdc88003a10 tx=0x7fdc880092b0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 msgr2=0x7fdc94199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94199920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdc84003de0 tx=0x7fdc84011ab0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 shutdown_connections 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fdc7c038440 0x7fdc7c03a8f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 --2- 172.21.15.79:0/1911751285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc94105b90 0x7fdc94199920 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 >> 172.21.15.79:0/1911751285 conn(0x7fdc94101220 msgr2=0x7fdc941028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 shutdown_connections 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:02.103+0000 7fdc9a8fb700 1 -- 172.21.15.79:0/1911751285 wait complete. 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 5 is available 2024-09-10T09:27:03.015 INFO:teuthology.orchestra.run.smithi079.stdout:Setting orchestrator backend to cephadm... 2024-09-10T09:27:03.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:03 smithi079 ceph-mon[27592]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T09:27:03.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:03 smithi079 ceph-mon[27592]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T09:27:03.391 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:03 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:03.391 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:03 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.174+0000 7fa680733700 1 Processor -- start 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.174+0000 7fa680733700 1 -- start start 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.174+0000 7fa680733700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa678104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.174+0000 7fa680733700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6781053d0 con 0x7fa678104a80 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.174+0000 7fa67e4cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa678104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.174+0000 7fa67e4cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa678104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45006/0 (socket says 172.21.15.79:45006) 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.174+0000 7fa67e4cf700 1 -- 172.21.15.79:0/3474104645 learned_addr learned my addr 172.21.15.79:0/3474104645 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.175+0000 7fa67e4cf700 1 -- 172.21.15.79:0/3474104645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678105510 con 0x7fa678104a80 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.175+0000 7fa67e4cf700 1 --2- 172.21.15.79:0/3474104645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa678104e90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa6740098a0 tx=0x7fa674009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7cc597bf31078f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.175+0000 7fa67d4cd700 1 -- 172.21.15.79:0/3474104645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa674004180 con 0x7fa678104a80 2024-09-10T09:27:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.175+0000 7fa67d4cd700 1 -- 172.21.15.79:0/3474104645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa6740042e0 con 0x7fa678104a80 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.175+0000 7fa67d4cd700 1 -- 172.21.15.79:0/3474104645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa674011a50 con 0x7fa678104a80 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 -- 172.21.15.79:0/3474104645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 msgr2=0x7fa678104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 --2- 172.21.15.79:0/3474104645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa678104e90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa6740098a0 tx=0x7fa674009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 -- 172.21.15.79:0/3474104645 shutdown_connections 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 --2- 172.21.15.79:0/3474104645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa678104e90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 -- 172.21.15.79:0/3474104645 >> 172.21.15.79:0/3474104645 conn(0x7fa678100110 msgr2=0x7fa678102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 -- 172.21.15.79:0/3474104645 shutdown_connections 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 -- 172.21.15.79:0/3474104645 wait complete. 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 Processor -- start 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 -- start start 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa6781998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.176+0000 7fa680733700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678199e10 con 0x7fa678104a80 2024-09-10T09:27:03.983 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa67e4cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa6781998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa67e4cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa6781998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45018/0 (socket says 172.21.15.79:45018) 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa67e4cf700 1 -- 172.21.15.79:0/1148477221 learned_addr learned my addr 172.21.15.79:0/1148477221 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa67e4cf700 1 -- 172.21.15.79:0/1148477221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009550 con 0x7fa678104a80 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa67e4cf700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa6781998d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6740119e0 tx=0x7fa674011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa66f7fe700 1 -- 172.21.15.79:0/1148477221 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa674003b90 con 0x7fa678104a80 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67819a010 con 0x7fa678104a80 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa66f7fe700 1 -- 172.21.15.79:0/1148477221 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa67401a8a0 con 0x7fa678104a80 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa66f7fe700 1 -- 172.21.15.79:0/1148477221 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa674019930 con 0x7fa678104a80 2024-09-10T09:27:03.984 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.177+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67819a430 con 0x7fa678104a80 2024-09-10T09:27:03.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.178+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa678062380 con 0x7fa678104a80 2024-09-10T09:27:03.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.178+0000 7fa66f7fe700 1 -- 172.21.15.79:0/1148477221 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 7) v1 ==== 44978+0+0 (secure 0 0 0) 0x7fa674019bf0 con 0x7fa678104a80 2024-09-10T09:27:03.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.178+0000 7fa66f7fe700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa664038290 0x7fa66403a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:03.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.179+0000 7fa66f7fe700 1 -- 172.21.15.79:0/1148477221 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa67404c720 con 0x7fa678104a80 2024-09-10T09:27:03.985 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.179+0000 7fa67dcce700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa664038290 0x7fa66403a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:03.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.179+0000 7fa67dcce700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa664038290 0x7fa66403a740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa668006fd0 tx=0x7fa668006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:03.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.183+0000 7fa66f7fe700 1 -- 172.21.15.79:0/1148477221 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa67402d440 con 0x7fa678104a80 2024-09-10T09:27:03.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.389+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6781022a0 con 0x7fa664038290 2024-09-10T09:27:03.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.395+0000 7fa66f7fe700 1 -- 172.21.15.79:0/1148477221 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa6781022a0 con 0x7fa664038290 2024-09-10T09:27:03.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa664038290 msgr2=0x7fa66403a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:03.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa664038290 0x7fa66403a740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa668006fd0 tx=0x7fa668006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:03.986 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 msgr2=0x7fa6781998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:03.987 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa6781998d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6740119e0 tx=0x7fa674011ac0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.987 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 shutdown_connections 2024-09-10T09:27:03.987 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa664038290 0x7fa66403a740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.987 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 --2- 172.21.15.79:0/1148477221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa678104a80 0x7fa6781998d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:03.987 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 >> 172.21.15.79:0/1148477221 conn(0x7fa678100110 msgr2=0x7fa678074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:03.987 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 shutdown_connections 2024-09-10T09:27:03.987 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:03.397+0000 7fa680733700 1 -- 172.21.15.79:0/1148477221 wait complete. 2024-09-10T09:27:04.602 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:03] ENGINE Bus STARTING 2024-09-10T09:27:04.602 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:03] ENGINE Serving on http://172.21.15.79:8765 2024-09-10T09:27:04.602 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:04.603 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:04.603 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:03] ENGINE Serving on https://172.21.15.79:7150 2024-09-10T09:27:04.603 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:03] ENGINE Bus STARTED 2024-09-10T09:27:04.603 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:27:04.603 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:04 smithi079 ceph-mon[27592]: mgrmap e8: smithi079.mhirny(active, since 2s) 2024-09-10T09:27:05.154 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T09:27:05.154 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.402+0000 7f2201b70700 1 Processor -- start 2024-09-10T09:27:05.154 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.402+0000 7f2201b70700 1 -- start start 2024-09-10T09:27:05.154 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.402+0000 7f2201b70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.402+0000 7f2201b70700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc1053d0 con 0x7f21fc104a80 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.402+0000 7f21fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.402+0000 7f21fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45022/0 (socket says 172.21.15.79:45022) 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.402+0000 7f21fb7fe700 1 -- 172.21.15.79:0/888816881 learned_addr learned my addr 172.21.15.79:0/888816881 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f21fb7fe700 1 -- 172.21.15.79:0/888816881 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc105510 con 0x7f21fc104a80 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f21fb7fe700 1 --2- 172.21.15.79:0/888816881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc104e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009e80 tx=0x7f21ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bf37bfd8cdb46f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f21fa7fc700 1 -- 172.21.15.79:0/888816881 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21ec00e070 con 0x7f21fc104a80 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f21fa7fc700 1 -- 172.21.15.79:0/888816881 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f21ec003e90 con 0x7f21fc104a80 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f21fa7fc700 1 -- 172.21.15.79:0/888816881 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21ec004380 con 0x7f21fc104a80 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f2201b70700 1 -- 172.21.15.79:0/888816881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 msgr2=0x7f21fc104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f2201b70700 1 --2- 172.21.15.79:0/888816881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc104e90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009e80 tx=0x7f21ec00b330 comp rx=0 tx=0).stop 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f2201b70700 1 -- 172.21.15.79:0/888816881 shutdown_connections 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f2201b70700 1 --2- 172.21.15.79:0/888816881 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc104e90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:05.155 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.403+0000 7f2201b70700 1 -- 172.21.15.79:0/888816881 >> 172.21.15.79:0/888816881 conn(0x7f21fc100110 msgr2=0x7f21fc102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.404+0000 7f2201b70700 1 -- 172.21.15.79:0/888816881 shutdown_connections 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.404+0000 7f2201b70700 1 -- 172.21.15.79:0/888816881 wait complete. 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.404+0000 7f2201b70700 1 Processor -- start 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.404+0000 7f2201b70700 1 -- start start 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.404+0000 7f2201b70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.404+0000 7f2201b70700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc199db0 con 0x7f21fc104a80 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21fb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45026/0 (socket says 172.21.15.79:45026) 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21fb7fe700 1 -- 172.21.15.79:0/1552423499 learned_addr learned my addr 172.21.15.79:0/1552423499 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21fb7fe700 1 -- 172.21.15.79:0/1552423499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ec009b30 con 0x7f21fc104a80 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21fb7fe700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc199870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b7b0 tx=0x7f21ec004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21f8ff9700 1 -- 172.21.15.79:0/1552423499 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21ec00e040 con 0x7f21fc104a80 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21fc199fb0 con 0x7f21fc104a80 2024-09-10T09:27:05.156 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21f8ff9700 1 -- 172.21.15.79:0/1552423499 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f21ec003c70 con 0x7f21fc104a80 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f21f8ff9700 1 -- 172.21.15.79:0/1552423499 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21ec01b760 con 0x7f21fc104a80 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.405+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21fc19a430 con 0x7f21fc104a80 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.406+0000 7f21f8ff9700 1 -- 172.21.15.79:0/1552423499 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f21ec019040 con 0x7f21fc104a80 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.406+0000 7f21f8ff9700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f21e40383b0 0x7f21e403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.406+0000 7f21f8ff9700 1 -- 172.21.15.79:0/1552423499 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f21ec0128a0 con 0x7f21fc104a80 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.406+0000 7f21faffd700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f21e40383b0 0x7f21e403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.406+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21fc062380 con 0x7f21fc104a80 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.407+0000 7f21faffd700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f21e40383b0 0x7f21e403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f21f0006fd0 tx=0x7f21f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.411+0000 7f21f8ff9700 1 -- 172.21.15.79:0/1552423499 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f21ec011980 con 0x7f21fc104a80 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.601+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f21fc102240 con 0x7f21e40383b0 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.602+0000 7f21f8ff9700 1 -- 172.21.15.79:0/1552423499 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f21fc102240 con 0x7f21e40383b0 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f21e40383b0 msgr2=0x7f21e403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:05.157 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f21e40383b0 0x7f21e403a860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f21f0006fd0 tx=0x7f21f0006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 msgr2=0x7f21fc199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc199870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00b7b0 tx=0x7f21ec004430 comp rx=0 tx=0).stop 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 shutdown_connections 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f21e40383b0 0x7f21e403a860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 --2- 172.21.15.79:0/1552423499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21fc104a80 0x7f21fc199870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 >> 172.21.15.79:0/1552423499 conn(0x7f21fc100110 msgr2=0x7f21fc074040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 shutdown_connections 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:04.604+0000 7f2201b70700 1 -- 172.21.15.79:0/1552423499 wait complete. 2024-09-10T09:27:05.158 INFO:teuthology.orchestra.run.smithi079.stdout:Generating ssh key... 2024-09-10T09:27:05.766 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:05 smithi079 ceph-mon[27592]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea62ffc700 1 Processor -- start 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea62ffc700 1 -- start start 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea62ffc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c108740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea62ffc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c108c80 con 0x7fea5c079d00 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea60d98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c108740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea60d98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c108740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45042/0 (socket says 172.21.15.79:45042) 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea60d98700 1 -- 172.21.15.79:0/3126558277 learned_addr learned my addr 172.21.15.79:0/3126558277 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.568+0000 7fea60d98700 1 -- 172.21.15.79:0/3126558277 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c108dc0 con 0x7fea5c079d00 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea60d98700 1 --2- 172.21.15.79:0/3126558277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c108740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea500098a0 tx=0x7fea50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc145e7d4a4b1c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea5b7fe700 1 -- 172.21.15.79:0/3126558277 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea50004180 con 0x7fea5c079d00 2024-09-10T09:27:06.428 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea5b7fe700 1 -- 172.21.15.79:0/3126558277 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fea500042e0 con 0x7fea5c079d00 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea5b7fe700 1 -- 172.21.15.79:0/3126558277 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea50011a50 con 0x7fea5c079d00 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea62ffc700 1 -- 172.21.15.79:0/3126558277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 msgr2=0x7fea5c108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea62ffc700 1 --2- 172.21.15.79:0/3126558277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c108740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea500098a0 tx=0x7fea50009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea62ffc700 1 -- 172.21.15.79:0/3126558277 shutdown_connections 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea62ffc700 1 --2- 172.21.15.79:0/3126558277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c108740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea62ffc700 1 -- 172.21.15.79:0/3126558277 >> 172.21.15.79:0/3126558277 conn(0x7fea5c1000f0 msgr2=0x7fea5c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea62ffc700 1 -- 172.21.15.79:0/3126558277 shutdown_connections 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.569+0000 7fea62ffc700 1 -- 172.21.15.79:0/3126558277 wait complete. 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea62ffc700 1 Processor -- start 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea62ffc700 1 -- start start 2024-09-10T09:27:06.429 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea62ffc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea62ffc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c199e70 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea60d98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea60d98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45048/0 (socket says 172.21.15.79:45048) 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea60d98700 1 -- 172.21.15.79:0/3118650678 learned_addr learned my addr 172.21.15.79:0/3118650678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea60d98700 1 -- 172.21.15.79:0/3118650678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50009550 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.570+0000 7fea60d98700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c199930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea50011a00 tx=0x7fea50011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.571+0000 7fea59ffb700 1 -- 172.21.15.79:0/3118650678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea50003970 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.571+0000 7fea59ffb700 1 -- 172.21.15.79:0/3118650678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fea50003ad0 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.571+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c19a070 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.571+0000 7fea59ffb700 1 -- 172.21.15.79:0/3118650678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea50024800 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.571+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c19a490 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.572+0000 7fea59ffb700 1 -- 172.21.15.79:0/3118650678 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fea50024ac0 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.572+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c062380 con 0x7fea5c079d00 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.572+0000 7fea59ffb700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea4c0383b0 0x7fea4c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:06.430 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.572+0000 7fea59ffb700 1 -- 172.21.15.79:0/3118650678 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fea5004c3c0 con 0x7fea5c079d00 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.572+0000 7fea5bfff700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea4c0383b0 0x7fea4c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.573+0000 7fea5bfff700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea4c0383b0 0x7fea4c03a860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea48006fd0 tx=0x7fea48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.577+0000 7fea59ffb700 1 -- 172.21.15.79:0/3118650678 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fea50018a90 con 0x7fea5c079d00 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.765+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fea5c1023e0 con 0x7fea4c0383b0 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.830+0000 7fea59ffb700 1 -- 172.21.15.79:0/3118650678 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fea5c1023e0 con 0x7fea4c0383b0 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea4c0383b0 msgr2=0x7fea4c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea4c0383b0 0x7fea4c03a860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fea48006fd0 tx=0x7fea48006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 msgr2=0x7fea5c199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c199930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea50011a00 tx=0x7fea50011ae0 comp rx=0 tx=0).stop 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 shutdown_connections 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea4c0383b0 0x7fea4c03a860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 --2- 172.21.15.79:0/3118650678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea5c079d00 0x7fea5c199930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 >> 172.21.15.79:0/3118650678 conn(0x7fea5c1000f0 msgr2=0x7fea5c101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 shutdown_connections 2024-09-10T09:27:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:05.832+0000 7fea62ffc700 1 -- 172.21.15.79:0/3118650678 wait complete. 2024-09-10T09:27:07.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:06 smithi079 ceph-mon[27592]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:07.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:06 smithi079 ceph-mon[27592]: Generating ssh key... 2024-09-10T09:27:07.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:06 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:07.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:06 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:07.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC991zda5odyL4outsYLssTPqMBgMC5SzQlJvV+LxWXSITC07RaGWK2gA/AbdZ5wpYRmEjcIU5Ht8q54C45BjuX77w5xv+ejLxG8bFy5IwXCUesPyIJucv+MRbkH3IMYb/uT7sp+ecMcsOfO1tT+Qnmy43We3n3QL+RAmFvdMMew+mCGtGS2m4XPEh9U+iJNBKGNToAq+kRNTEPR1U63/9EITAl4mKBG9unJuA8wJ20CLeQ60UwKuZaJnRgRgMq1abxdjtUgQnUFmCl+F16Mqf3Xs2C8ZZHVMjzeiXtLA78VKzm2E5MEzLQkGVYy+Zc8VVn5vNSwN+115QOpDBWEEbOD9DgsZD+5tkeSDOaWJ7r8a58Sql3RtwI7x3/421Kxaz2KxUaPlpiQDiDX8wLx+xlxMGVpwqMzBAnj424+34C9gO0DVeJz5p1Dr0Gcp5IdkGn3ZqDS2bMFxo9sZ7D1xHN6RuBj9ANTAcYZnpKA2dTJIUPhCYUusDJZ9JZEThSVLc= ceph-afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:27:07.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.915+0000 7fc206229700 1 Processor -- start 2024-09-10T09:27:07.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.915+0000 7fc206229700 1 -- start start 2024-09-10T09:27:07.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.915+0000 7fc206229700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200106490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:07.693 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.915+0000 7fc206229700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2001069d0 con 0x7fc200106080 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.915+0000 7fc1ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200106490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.915+0000 7fc1ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200106490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45062/0 (socket says 172.21.15.79:45062) 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.915+0000 7fc1ff7fe700 1 -- 172.21.15.79:0/4247382424 learned_addr learned my addr 172.21.15.79:0/4247382424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.916+0000 7fc1ff7fe700 1 -- 172.21.15.79:0/4247382424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200106b10 con 0x7fc200106080 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.916+0000 7fc1ff7fe700 1 --2- 172.21.15.79:0/4247382424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200106490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00098a0 tx=0x7fc1f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e3d7dbff5253c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.916+0000 7fc1feffd700 1 -- 172.21.15.79:0/4247382424 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f0004180 con 0x7fc200106080 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.916+0000 7fc1feffd700 1 -- 172.21.15.79:0/4247382424 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc1f00042e0 con 0x7fc200106080 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.916+0000 7fc1feffd700 1 -- 172.21.15.79:0/4247382424 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f0011a50 con 0x7fc200106080 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 -- 172.21.15.79:0/4247382424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 msgr2=0x7fc200106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 --2- 172.21.15.79:0/4247382424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200106490 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00098a0 tx=0x7fc1f0009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 -- 172.21.15.79:0/4247382424 shutdown_connections 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 --2- 172.21.15.79:0/4247382424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200106490 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:07.694 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 -- 172.21.15.79:0/4247382424 >> 172.21.15.79:0/4247382424 conn(0x7fc2000ff870 msgr2=0x7fc200101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 -- 172.21.15.79:0/4247382424 shutdown_connections 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 -- 172.21.15.79:0/4247382424 wait complete. 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 Processor -- start 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.917+0000 7fc206229700 1 -- start start 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc206229700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200104840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc206229700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20019c600 con 0x7fc200106080 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200104840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1ff7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200104840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45066/0 (socket says 172.21.15.79:45066) 2024-09-10T09:27:07.695 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1ff7fe700 1 -- 172.21.15.79:0/1437055437 learned_addr learned my addr 172.21.15.79:0/1437055437 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1ff7fe700 1 -- 172.21.15.79:0/1437055437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0009550 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1ff7fe700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200104840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00119e0 tx=0x7fc1f0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1fd7fa700 1 -- 172.21.15.79:0/1437055437 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f0003b90 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1fd7fa700 1 -- 172.21.15.79:0/1437055437 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc1f001a8a0 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20019c740 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc1fd7fa700 1 -- 172.21.15.79:0/1437055437 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1f0019930 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.918+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20019cb60 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.919+0000 7fc1fd7fa700 1 -- 172.21.15.79:0/1437055437 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fc1f0019bf0 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.919+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc200105900 con 0x7fc200106080 2024-09-10T09:27:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.919+0000 7fc1fd7fa700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc1ec0383b0 0x7fc1ec03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.919+0000 7fc1fd7fa700 1 -- 172.21.15.79:0/1437055437 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc1f004c720 con 0x7fc200106080 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.919+0000 7fc1f6ffd700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc1ec0383b0 0x7fc1ec03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.920+0000 7fc1f6ffd700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc1ec0383b0 0x7fc1ec03a860 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8006fd0 tx=0x7fc1e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:06.924+0000 7fc1fd7fa700 1 -- 172.21.15.79:0/1437055437 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc1f002b700 con 0x7fc200106080 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.114+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fc200100d60 con 0x7fc1ec0383b0 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.115+0000 7fc1fd7fa700 1 -- 172.21.15.79:0/1437055437 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fc200100d60 con 0x7fc1ec0383b0 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc1ec0383b0 msgr2=0x7fc1ec03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc1ec0383b0 0x7fc1ec03a860 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8006fd0 tx=0x7fc1e8006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 msgr2=0x7fc200104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:07.697 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200104840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00119e0 tx=0x7fc1f0011ac0 comp rx=0 tx=0).stop 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 shutdown_connections 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc1ec0383b0 0x7fc1ec03a860 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 --2- 172.21.15.79:0/1437055437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc200106080 0x7fc200104840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 >> 172.21.15.79:0/1437055437 conn(0x7fc2000ff870 msgr2=0x7fc200100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 shutdown_connections 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:07.117+0000 7fc206229700 1 -- 172.21.15.79:0/1437055437 wait complete. 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T09:27:07.698 INFO:teuthology.orchestra.run.smithi079.stdout:Adding host smithi079... 2024-09-10T09:27:07.930 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:07 smithi079 ceph-mon[27592]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:09.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:09 smithi079 ceph-mon[27592]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "addr": "172.21.15.79", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:10.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:10 smithi079 ceph-mon[27592]: Deploying cephadm binary to smithi079 2024-09-10T09:27:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Added host 'smithi079' with addr '172.21.15.79' 2024-09-10T09:27:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.141+0000 7f78ce15e700 1 Processor -- start 2024-09-10T09:27:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.141+0000 7f78ce15e700 1 -- start start 2024-09-10T09:27:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78ce15e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78ce15e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c81053d0 con 0x7f78c8104a80 2024-09-10T09:27:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:11.284 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45070/0 (socket says 172.21.15.79:45070) 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c77fe700 1 -- 172.21.15.79:0/401871925 learned_addr learned my addr 172.21.15.79:0/401871925 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c77fe700 1 -- 172.21.15.79:0/401871925 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8105510 con 0x7f78c8104a80 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c77fe700 1 --2- 172.21.15.79:0/401871925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8104e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098a0 tx=0x7f78b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4332988c515d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c67fc700 1 -- 172.21.15.79:0/401871925 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78b8004180 con 0x7f78c8104a80 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c67fc700 1 -- 172.21.15.79:0/401871925 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78b80042e0 con 0x7f78c8104a80 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.142+0000 7f78c67fc700 1 -- 172.21.15.79:0/401871925 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78b8011a50 con 0x7f78c8104a80 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.143+0000 7f78ce15e700 1 -- 172.21.15.79:0/401871925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 msgr2=0x7f78c8104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.143+0000 7f78ce15e700 1 --2- 172.21.15.79:0/401871925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8104e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098a0 tx=0x7f78b8009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.143+0000 7f78ce15e700 1 -- 172.21.15.79:0/401871925 shutdown_connections 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.143+0000 7f78ce15e700 1 --2- 172.21.15.79:0/401871925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8104e90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.143+0000 7f78ce15e700 1 -- 172.21.15.79:0/401871925 >> 172.21.15.79:0/401871925 conn(0x7f78c81000f0 msgr2=0x7f78c8102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:11.285 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.143+0000 7f78ce15e700 1 -- 172.21.15.79:0/401871925 shutdown_connections 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.143+0000 7f78ce15e700 1 -- 172.21.15.79:0/401871925 wait complete. 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78ce15e700 1 Processor -- start 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78ce15e700 1 -- start start 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78ce15e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8079b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78ce15e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c819c600 con 0x7f78c8104a80 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8079b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8079b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45086/0 (socket says 172.21.15.79:45086) 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78c77fe700 1 -- 172.21.15.79:0/1749576422 learned_addr learned my addr 172.21.15.79:0/1749576422 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.144+0000 7f78c77fe700 1 -- 172.21.15.79:0/1749576422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009550 con 0x7f78c8104a80 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.145+0000 7f78c77fe700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8079b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b80119e0 tx=0x7f78b8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.145+0000 7f78c4ff9700 1 -- 172.21.15.79:0/1749576422 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78b8003b90 con 0x7f78c8104a80 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.145+0000 7f78c4ff9700 1 -- 172.21.15.79:0/1749576422 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78b801a8a0 con 0x7f78c8104a80 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.145+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c819c740 con 0x7f78c8104a80 2024-09-10T09:27:11.286 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.145+0000 7f78c4ff9700 1 -- 172.21.15.79:0/1749576422 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78b8019930 con 0x7f78c8104a80 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.145+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c819cb60 con 0x7f78c8104a80 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.145+0000 7f78c4ff9700 1 -- 172.21.15.79:0/1749576422 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f78b8019bf0 con 0x7f78c8104a80 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.146+0000 7f78c4ff9700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f78b00383b0 0x7f78b003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.146+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c8062380 con 0x7f78c8104a80 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.146+0000 7f78c4ff9700 1 -- 172.21.15.79:0/1749576422 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f78b804c730 con 0x7f78c8104a80 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.146+0000 7f78c6ffd700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f78b00383b0 0x7f78b003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.146+0000 7f78c6ffd700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f78b00383b0 0x7f78b003a860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78bc006fd0 tx=0x7f78bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.151+0000 7f78c4ff9700 1 -- 172.21.15.79:0/1749576422 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f78b802d440 con 0x7f78c8104a80 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:08.344+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi079", "addr": "172.21.15.79", "target": ["mon-mgr", ""]}) v1 -- 0x7f78c8102390 con 0x7f78b00383b0 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.644+0000 7f78c4ff9700 1 -- 172.21.15.79:0/1749576422 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f78c8102390 con 0x7f78b00383b0 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f78b00383b0 msgr2=0x7f78b003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:11.287 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f78b00383b0 0x7f78b003a860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78bc006fd0 tx=0x7f78bc006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 msgr2=0x7f78c8079b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8079b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78b80119e0 tx=0x7f78b8011ac0 comp rx=0 tx=0).stop 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 shutdown_connections 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f78b00383b0 0x7f78b003a860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 --2- 172.21.15.79:0/1749576422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78c8104a80 0x7f78c8079b70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 >> 172.21.15.79:0/1749576422 conn(0x7f78c81000f0 msgr2=0x7f78c8101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 shutdown_connections 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:10.647+0000 7f78ce15e700 1 -- 172.21.15.79:0/1749576422 wait complete. 2024-09-10T09:27:11.288 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying mon service with default placement... 2024-09-10T09:27:11.904 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:11 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:11.904 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:11 smithi079 ceph-mon[27592]: Added host smithi079 2024-09-10T09:27:11.905 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:11 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.718+0000 7f5381694700 1 Processor -- start 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.718+0000 7f5381694700 1 -- start start 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.718+0000 7f5381694700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.718+0000 7f5381694700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c1053d0 con 0x7f537c104a80 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.718+0000 7f537affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.718+0000 7f537affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45096/0 (socket says 172.21.15.79:45096) 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.718+0000 7f537affd700 1 -- 172.21.15.79:0/3091720772 learned_addr learned my addr 172.21.15.79:0/3091720772 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.719+0000 7f537affd700 1 -- 172.21.15.79:0/3091720772 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c105510 con 0x7f537c104a80 2024-09-10T09:27:12.500 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.719+0000 7f537affd700 1 --2- 172.21.15.79:0/3091720772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f536c00bb40 tx=0x7f536c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e24e1a59a1ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.719+0000 7f5379ffb700 1 -- 172.21.15.79:0/3091720772 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f536c00dc00 con 0x7f537c104a80 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.719+0000 7f5379ffb700 1 -- 172.21.15.79:0/3091720772 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f536c0044a0 con 0x7f537c104a80 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.719+0000 7f5379ffb700 1 -- 172.21.15.79:0/3091720772 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f536c010470 con 0x7f537c104a80 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 -- 172.21.15.79:0/3091720772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 msgr2=0x7f537c104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 --2- 172.21.15.79:0/3091720772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c104e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f536c00bb40 tx=0x7f536c00be50 comp rx=0 tx=0).stop 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 -- 172.21.15.79:0/3091720772 shutdown_connections 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 --2- 172.21.15.79:0/3091720772 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c104e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 -- 172.21.15.79:0/3091720772 >> 172.21.15.79:0/3091720772 conn(0x7f537c1000f0 msgr2=0x7f537c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 -- 172.21.15.79:0/3091720772 shutdown_connections 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 -- 172.21.15.79:0/3091720772 wait complete. 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 Processor -- start 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.720+0000 7f5381694700 1 -- start start 2024-09-10T09:27:12.501 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f5381694700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f5381694700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c197be0 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f537affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f537affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c1976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45110/0 (socket says 172.21.15.79:45110) 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f537affd700 1 -- 172.21.15.79:0/3286734317 learned_addr learned my addr 172.21.15.79:0/3286734317 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f537affd700 1 -- 172.21.15.79:0/3286734317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c00b7f0 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f537affd700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c1976a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f536c0046d0 tx=0x7f536c003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f5363fff700 1 -- 172.21.15.79:0/3286734317 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f536c01e070 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c197de0 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f5363fff700 1 -- 172.21.15.79:0/3286734317 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f536c004260 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f5363fff700 1 -- 172.21.15.79:0/3286734317 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f536c0229c0 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.721+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c198200 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.722+0000 7f5363fff700 1 -- 172.21.15.79:0/3286734317 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f536c02c440 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.722+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c1913b0 con 0x7f537c104a80 2024-09-10T09:27:12.502 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.722+0000 7f5363fff700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f53640383f0 0x7f536403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.722+0000 7f5363fff700 1 -- 172.21.15.79:0/3286734317 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f536c04ea40 con 0x7f537c104a80 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.722+0000 7f537a7fc700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f53640383f0 0x7f536403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.723+0000 7f537a7fc700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f53640383f0 0x7f536403a8a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5370006fd0 tx=0x7f5370006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.727+0000 7f5363fff700 1 -- 172.21.15.79:0/3286734317 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f536c050e60 con 0x7f537c104a80 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.937+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f537c061190 con 0x7f53640383f0 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.942+0000 7f5363fff700 1 -- 172.21.15.79:0/3286734317 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f537c061190 con 0x7f53640383f0 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f53640383f0 msgr2=0x7f536403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f53640383f0 0x7f536403a8a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5370006fd0 tx=0x7f5370006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 msgr2=0x7f537c1976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c1976a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f536c0046d0 tx=0x7f536c003d70 comp rx=0 tx=0).stop 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 shutdown_connections 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f53640383f0 0x7f536403a8a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:12.503 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 --2- 172.21.15.79:0/3286734317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f537c104a80 0x7f537c1976a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:12.504 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 >> 172.21.15.79:0/3286734317 conn(0x7f537c1000f0 msgr2=0x7f537c18e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:12.504 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 shutdown_connections 2024-09-10T09:27:12.504 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:11.944+0000 7f5381694700 1 -- 172.21.15.79:0/3286734317 wait complete. 2024-09-10T09:27:12.504 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying mgr service with default placement... 2024-09-10T09:27:13.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:12 smithi079 ceph-mon[27592]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:13.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:12 smithi079 ceph-mon[27592]: Saving service mon spec with placement count:5 2024-09-10T09:27:13.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:12 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:14.386 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:14 smithi079 ceph-mon[27592]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:14.386 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:14 smithi079 ceph-mon[27592]: Saving service mgr spec with placement count:2 2024-09-10T09:27:14.387 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:14 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:14.387 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:14 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:14.399 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T09:27:14.399 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd5be60700 1 Processor -- start 2024-09-10T09:27:14.399 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd5be60700 1 -- start start 2024-09-10T09:27:14.399 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd5be60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd540791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:14.400 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd5be60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54079730 con 0x7efd5407acf0 2024-09-10T09:27:14.400 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd59bfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd540791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:14.400 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd59bfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd540791f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33248/0 (socket says 172.21.15.79:33248) 2024-09-10T09:27:14.400 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd59bfc700 1 -- 172.21.15.79:0/1999235316 learned_addr learned my addr 172.21.15.79:0/1999235316 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:14.400 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd59bfc700 1 -- 172.21.15.79:0/1999235316 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54079870 con 0x7efd5407acf0 2024-09-10T09:27:14.400 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.945+0000 7efd59bfc700 1 --2- 172.21.15.79:0/1999235316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd540791f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd50009e80 tx=0x7efd5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65c7baf4a09fb9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:14.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd58bfa700 1 -- 172.21.15.79:0/1999235316 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd5000e070 con 0x7efd5407acf0 2024-09-10T09:27:14.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd58bfa700 1 -- 172.21.15.79:0/1999235316 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efd50003e90 con 0x7efd5407acf0 2024-09-10T09:27:14.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd58bfa700 1 -- 172.21.15.79:0/1999235316 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd50004380 con 0x7efd5407acf0 2024-09-10T09:27:14.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd5be60700 1 -- 172.21.15.79:0/1999235316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 msgr2=0x7efd540791f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:14.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd5be60700 1 --2- 172.21.15.79:0/1999235316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd540791f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd50009e80 tx=0x7efd5000b330 comp rx=0 tx=0).stop 2024-09-10T09:27:14.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd5be60700 1 -- 172.21.15.79:0/1999235316 shutdown_connections 2024-09-10T09:27:14.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd5be60700 1 --2- 172.21.15.79:0/1999235316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd540791f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:14.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.946+0000 7efd5be60700 1 -- 172.21.15.79:0/1999235316 >> 172.21.15.79:0/1999235316 conn(0x7efd54101200 msgr2=0x7efd54103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:14.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd5be60700 1 -- 172.21.15.79:0/1999235316 shutdown_connections 2024-09-10T09:27:14.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd5be60700 1 -- 172.21.15.79:0/1999235316 wait complete. 2024-09-10T09:27:14.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd5be60700 1 Processor -- start 2024-09-10T09:27:14.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd5be60700 1 -- start start 2024-09-10T09:27:14.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd5be60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd5419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:14.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd5be60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5419c0c0 con 0x7efd5407acf0 2024-09-10T09:27:14.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd59bfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd5419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:14.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd59bfc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd5419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33250/0 (socket says 172.21.15.79:33250) 2024-09-10T09:27:14.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.947+0000 7efd59bfc700 1 -- 172.21.15.79:0/379311500 learned_addr learned my addr 172.21.15.79:0/379311500 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:14.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.948+0000 7efd59bfc700 1 -- 172.21.15.79:0/379311500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50009b30 con 0x7efd5407acf0 2024-09-10T09:27:14.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.948+0000 7efd59bfc700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd5419bb80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd5000d010 tx=0x7efd50003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:14.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.948+0000 7efd4affd700 1 -- 172.21.15.79:0/379311500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd5000e040 con 0x7efd5407acf0 2024-09-10T09:27:14.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.948+0000 7efd4affd700 1 -- 172.21.15.79:0/379311500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efd500048a0 con 0x7efd5407acf0 2024-09-10T09:27:14.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.948+0000 7efd4affd700 1 -- 172.21.15.79:0/379311500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd5001b5a0 con 0x7efd5407acf0 2024-09-10T09:27:14.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.948+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5419c2c0 con 0x7efd5407acf0 2024-09-10T09:27:14.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.948+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5419c740 con 0x7efd5407acf0 2024-09-10T09:27:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.949+0000 7efd4affd700 1 -- 172.21.15.79:0/379311500 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7efd50019040 con 0x7efd5407acf0 2024-09-10T09:27:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.949+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5410be80 con 0x7efd5407acf0 2024-09-10T09:27:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.949+0000 7efd4affd700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd40038390 0x7efd4003a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.949+0000 7efd4affd700 1 -- 172.21.15.79:0/379311500 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7efd5004bc00 con 0x7efd5407acf0 2024-09-10T09:27:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.949+0000 7efd593fb700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd40038390 0x7efd4003a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.950+0000 7efd593fb700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd40038390 0x7efd4003a840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efd44006fd0 tx=0x7efd44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:14.406 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:12.954+0000 7efd4affd700 1 -- 172.21.15.79:0/379311500 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd50052080 con 0x7efd5407acf0 2024-09-10T09:27:14.406 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.161+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7efd54103540 con 0x7efd40038390 2024-09-10T09:27:14.406 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.166+0000 7efd4affd700 1 -- 172.21.15.79:0/379311500 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7efd54103540 con 0x7efd40038390 2024-09-10T09:27:14.406 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd40038390 msgr2=0x7efd4003a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:14.406 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd40038390 0x7efd4003a840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efd44006fd0 tx=0x7efd44006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:14.406 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 msgr2=0x7efd5419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:14.407 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd5419bb80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd5000d010 tx=0x7efd50003d00 comp rx=0 tx=0).stop 2024-09-10T09:27:14.407 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 shutdown_connections 2024-09-10T09:27:14.407 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd40038390 0x7efd4003a840 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:14.407 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 --2- 172.21.15.79:0/379311500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5407acf0 0x7efd5419bb80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:14.407 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 >> 172.21.15.79:0/379311500 conn(0x7efd54101200 msgr2=0x7efd54102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:14.407 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 shutdown_connections 2024-09-10T09:27:14.408 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:13.168+0000 7efd5be60700 1 -- 172.21.15.79:0/379311500 wait complete. 2024-09-10T09:27:14.408 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying crash service with default placement... 2024-09-10T09:27:15.905 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:15 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:15.905 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:15 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:16.178 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-10T09:27:16.178 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.831+0000 7f2f22643700 1 Processor -- start 2024-09-10T09:27:16.178 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.831+0000 7f2f22643700 1 -- start start 2024-09-10T09:27:16.178 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.831+0000 7f2f22643700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c106440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:16.178 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.831+0000 7f2f22643700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c106980 con 0x7f2f1c106030 2024-09-10T09:27:16.178 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c106440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:16.178 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c106440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33266/0 (socket says 172.21.15.79:33266) 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1bfff700 1 -- 172.21.15.79:0/2699998936 learned_addr learned my addr 172.21.15.79:0/2699998936 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1bfff700 1 -- 172.21.15.79:0/2699998936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c106ac0 con 0x7f2f1c106030 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1bfff700 1 --2- 172.21.15.79:0/2699998936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c106440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098a0 tx=0x7f2f0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc92508aa1acd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1affd700 1 -- 172.21.15.79:0/2699998936 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c004180 con 0x7f2f1c106030 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1affd700 1 -- 172.21.15.79:0/2699998936 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c0042e0 con 0x7f2f1c106030 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.832+0000 7f2f1affd700 1 -- 172.21.15.79:0/2699998936 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c011af0 con 0x7f2f1c106030 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.833+0000 7f2f22643700 1 -- 172.21.15.79:0/2699998936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 msgr2=0x7f2f1c106440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.833+0000 7f2f22643700 1 --2- 172.21.15.79:0/2699998936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c106440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0098a0 tx=0x7f2f0c009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.833+0000 7f2f22643700 1 -- 172.21.15.79:0/2699998936 shutdown_connections 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.833+0000 7f2f22643700 1 --2- 172.21.15.79:0/2699998936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c106440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.833+0000 7f2f22643700 1 -- 172.21.15.79:0/2699998936 >> 172.21.15.79:0/2699998936 conn(0x7f2f1c0ff870 msgr2=0x7f2f1c101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.833+0000 7f2f22643700 1 -- 172.21.15.79:0/2699998936 shutdown_connections 2024-09-10T09:27:16.179 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.833+0000 7f2f22643700 1 -- 172.21.15.79:0/2699998936 wait complete. 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f22643700 1 Processor -- start 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f22643700 1 -- start start 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f22643700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f22643700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c198da0 con 0x7f2f1c106030 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f1bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f1bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33282/0 (socket says 172.21.15.79:33282) 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f1bfff700 1 -- 172.21.15.79:0/3910232547 learned_addr learned my addr 172.21.15.79:0/3910232547 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f1bfff700 1 -- 172.21.15.79:0/3910232547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c009550 con 0x7f2f1c106030 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.834+0000 7f2f1bfff700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c198860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c006ba0 tx=0x7f2f0c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.835+0000 7f2f197fa700 1 -- 172.21.15.79:0/3910232547 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c003b00 con 0x7f2f1c106030 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.835+0000 7f2f197fa700 1 -- 172.21.15.79:0/3910232547 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2f0c01a8e0 con 0x7f2f1c106030 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.835+0000 7f2f197fa700 1 -- 172.21.15.79:0/3910232547 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2f0c019990 con 0x7f2f1c106030 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.835+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c198fa0 con 0x7f2f1c106030 2024-09-10T09:27:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.835+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c1993c0 con 0x7f2f1c106030 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.835+0000 7f2f197fa700 1 -- 172.21.15.79:0/3910232547 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f2f0c019c50 con 0x7f2f1c106030 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.836+0000 7f2f197fa700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2f040383a0 0x7f2f0403a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.836+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c062380 con 0x7f2f1c106030 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.836+0000 7f2f197fa700 1 -- 172.21.15.79:0/3910232547 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2f0c04c610 con 0x7f2f1c106030 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.836+0000 7f2f1b7fe700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2f040383a0 0x7f2f0403a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.836+0000 7f2f1b7fe700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2f040383a0 0x7f2f0403a850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f10006fd0 tx=0x7f2f10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:14.841+0000 7f2f197fa700 1 -- 172.21.15.79:0/3910232547 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2f0c02b930 con 0x7f2f1c106030 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.066+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f1c101b70 con 0x7f2f040383a0 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.070+0000 7f2f197fa700 1 -- 172.21.15.79:0/3910232547 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f2f1c101b70 con 0x7f2f040383a0 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.072+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2f040383a0 msgr2=0x7f2f0403a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.072+0000 7f2f22643700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2f040383a0 0x7f2f0403a850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f10006fd0 tx=0x7f2f10006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.072+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 msgr2=0x7f2f1c198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:16.181 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.072+0000 7f2f22643700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c198860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c006ba0 tx=0x7f2f0c011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:16.182 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.073+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 shutdown_connections 2024-09-10T09:27:16.182 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.073+0000 7f2f22643700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2f040383a0 0x7f2f0403a850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:16.182 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.073+0000 7f2f22643700 1 --2- 172.21.15.79:0/3910232547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f1c106030 0x7f2f1c198860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:16.182 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.073+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 >> 172.21.15.79:0/3910232547 conn(0x7f2f1c0ff870 msgr2=0x7f2f1c100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:16.182 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.073+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 shutdown_connections 2024-09-10T09:27:16.182 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:15.073+0000 7f2f22643700 1 -- 172.21.15.79:0/3910232547 wait complete. 2024-09-10T09:27:16.182 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying ceph-exporter service with default placement... 2024-09-10T09:27:16.824 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:16 smithi079 ceph-mon[27592]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:16.824 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:16 smithi079 ceph-mon[27592]: Saving service crash spec with placement * 2024-09-10T09:27:16.824 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:16 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:17.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-10T09:27:17.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.602+0000 7ff520026700 1 Processor -- start 2024-09-10T09:27:17.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.602+0000 7ff520026700 1 -- start start 2024-09-10T09:27:17.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.603+0000 7ff520026700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:17.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.603+0000 7ff520026700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518079da0 con 0x7ff5181066f0 2024-09-10T09:27:17.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.603+0000 7ff51ddc2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:17.401 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.603+0000 7ff51ddc2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33284/0 (socket says 172.21.15.79:33284) 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.603+0000 7ff51ddc2700 1 -- 172.21.15.79:0/388363796 learned_addr learned my addr 172.21.15.79:0/388363796 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.603+0000 7ff51ddc2700 1 -- 172.21.15.79:0/388363796 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518079ee0 con 0x7ff5181066f0 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.603+0000 7ff51ddc2700 1 --2- 172.21.15.79:0/388363796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518108ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5140098a0 tx=0x7ff514009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343ed311402bb073 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff51cdc0700 1 -- 172.21.15.79:0/388363796 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff514004180 con 0x7ff5181066f0 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff51cdc0700 1 -- 172.21.15.79:0/388363796 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5140042e0 con 0x7ff5181066f0 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff51cdc0700 1 -- 172.21.15.79:0/388363796 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff514011af0 con 0x7ff5181066f0 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff520026700 1 -- 172.21.15.79:0/388363796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 msgr2=0x7ff518108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff520026700 1 --2- 172.21.15.79:0/388363796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518108ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5140098a0 tx=0x7ff514009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff520026700 1 -- 172.21.15.79:0/388363796 shutdown_connections 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff520026700 1 --2- 172.21.15.79:0/388363796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518108ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff520026700 1 -- 172.21.15.79:0/388363796 >> 172.21.15.79:0/388363796 conn(0x7ff518100130 msgr2=0x7ff518102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.604+0000 7ff520026700 1 -- 172.21.15.79:0/388363796 shutdown_connections 2024-09-10T09:27:17.402 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff520026700 1 -- 172.21.15.79:0/388363796 wait complete. 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff520026700 1 Processor -- start 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff520026700 1 -- start start 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff520026700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff520026700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518199e90 con 0x7ff5181066f0 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff51ddc2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff51ddc2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33290/0 (socket says 172.21.15.79:33290) 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.605+0000 7ff51ddc2700 1 -- 172.21.15.79:0/1442753014 learned_addr learned my addr 172.21.15.79:0/1442753014 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.606+0000 7ff51ddc2700 1 -- 172.21.15.79:0/1442753014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514009550 con 0x7ff5181066f0 2024-09-10T09:27:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.606+0000 7ff51ddc2700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518199950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff514000c00 tx=0x7ff514011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.606+0000 7ff50effd700 1 -- 172.21.15.79:0/1442753014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff514003a70 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.606+0000 7ff50effd700 1 -- 172.21.15.79:0/1442753014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff514003bd0 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.606+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51819a090 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.606+0000 7ff50effd700 1 -- 172.21.15.79:0/1442753014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5140238c0 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.606+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51819a4b0 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.607+0000 7ff50effd700 1 -- 172.21.15.79:0/1442753014 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7ff514023b80 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.607+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff518062380 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.607+0000 7ff50effd700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5040383f0 0x7ff50403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.607+0000 7ff50effd700 1 -- 172.21.15.79:0/1442753014 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff51404c510 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.607+0000 7ff51d5c1700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5040383f0 0x7ff50403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.608+0000 7ff51d5c1700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5040383f0 0x7ff50403a8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.612+0000 7ff50effd700 1 -- 172.21.15.79:0/1442753014 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff51402b300 con 0x7ff5181066f0 2024-09-10T09:27:17.404 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.823+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5181015f0 con 0x7ff5040383f0 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.828+0000 7ff50effd700 1 -- 172.21.15.79:0/1442753014 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7ff5181015f0 con 0x7ff5040383f0 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5040383f0 msgr2=0x7ff50403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5040383f0 0x7ff50403a8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 msgr2=0x7ff518199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518199950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff514000c00 tx=0x7ff514011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 shutdown_connections 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5040383f0 0x7ff50403a8a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 --2- 172.21.15.79:0/1442753014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5181066f0 0x7ff518199950 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 >> 172.21.15.79:0/1442753014 conn(0x7ff518100130 msgr2=0x7ff518100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 shutdown_connections 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:16.831+0000 7ff520026700 1 -- 172.21.15.79:0/1442753014 wait complete. 2024-09-10T09:27:17.405 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying prometheus service with default placement... 2024-09-10T09:27:17.788 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:17 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:17.788 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:17 smithi079 ceph-mon[27592]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:17.788 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:17 smithi079 ceph-mon[27592]: Saving service ceph-exporter spec with placement * 2024-09-10T09:27:17.789 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:17 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:19.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:19 smithi079 ceph-mon[27592]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:19.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:19 smithi079 ceph-mon[27592]: Saving service prometheus spec with placement count:1 2024-09-10T09:27:19.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:19 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.806+0000 7fb1bef92700 1 Processor -- start 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.806+0000 7fb1bef92700 1 -- start start 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.806+0000 7fb1bef92700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b81064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.806+0000 7fb1bef92700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b81069e0 con 0x7fb1b8106090 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1bcd2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b81064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1bcd2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b81064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33296/0 (socket says 172.21.15.79:33296) 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1bcd2e700 1 -- 172.21.15.79:0/1152883028 learned_addr learned my addr 172.21.15.79:0/1152883028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1bcd2e700 1 -- 172.21.15.79:0/1152883028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8106b20 con 0x7fb1b8106090 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1bcd2e700 1 --2- 172.21.15.79:0/1152883028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b81064a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00bb40 tx=0x7fb1ac00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40d6fc58c17b92e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:19.237 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1b77fe700 1 -- 172.21.15.79:0/1152883028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1ac00dc00 con 0x7fb1b8106090 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1b77fe700 1 -- 172.21.15.79:0/1152883028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1ac0044e0 con 0x7fb1b8106090 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.807+0000 7fb1b77fe700 1 -- 172.21.15.79:0/1152883028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1ac010470 con 0x7fb1b8106090 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.808+0000 7fb1bef92700 1 -- 172.21.15.79:0/1152883028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 msgr2=0x7fb1b81064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.808+0000 7fb1bef92700 1 --2- 172.21.15.79:0/1152883028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b81064a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00bb40 tx=0x7fb1ac00be50 comp rx=0 tx=0).stop 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.808+0000 7fb1bef92700 1 -- 172.21.15.79:0/1152883028 shutdown_connections 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.808+0000 7fb1bef92700 1 --2- 172.21.15.79:0/1152883028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b81064a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.808+0000 7fb1bef92700 1 -- 172.21.15.79:0/1152883028 >> 172.21.15.79:0/1152883028 conn(0x7fb1b80ff880 msgr2=0x7fb1b8101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.808+0000 7fb1bef92700 1 -- 172.21.15.79:0/1152883028 shutdown_connections 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.808+0000 7fb1bef92700 1 -- 172.21.15.79:0/1152883028 wait complete. 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bef92700 1 Processor -- start 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bef92700 1 -- start start 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bef92700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:19.238 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bef92700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b819c040 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bcd2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bcd2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33298/0 (socket says 172.21.15.79:33298) 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bcd2e700 1 -- 172.21.15.79:0/3346444281 learned_addr learned my addr 172.21.15.79:0/3346444281 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.809+0000 7fb1bcd2e700 1 -- 172.21.15.79:0/3346444281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac00b7f0 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.810+0000 7fb1bcd2e700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b819bb00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac003fc0 tx=0x7fb1ac0040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.810+0000 7fb1b5ffb700 1 -- 172.21.15.79:0/3346444281 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1ac00de20 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.810+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b819c240 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.810+0000 7fb1b5ffb700 1 -- 172.21.15.79:0/3346444281 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb1ac010be0 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.810+0000 7fb1b5ffb700 1 -- 172.21.15.79:0/3346444281 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb1ac021c90 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.810+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b819c600 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.811+0000 7fb1b5ffb700 1 -- 172.21.15.79:0/3346444281 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb1ac0193f0 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.811+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b80623f0 con 0x7fb1b8106090 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.811+0000 7fb1b5ffb700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb1a80383f0 0x7fb1a803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:19.239 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.811+0000 7fb1b5ffb700 1 -- 172.21.15.79:0/3346444281 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb1ac04c590 con 0x7fb1b8106090 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.811+0000 7fb1b7fff700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb1a80383f0 0x7fb1a803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.812+0000 7fb1b7fff700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb1a80383f0 0x7fb1a803a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4006fd0 tx=0x7fb1a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:17.817+0000 7fb1b5ffb700 1 -- 172.21.15.79:0/3346444281 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb1b80623f0 con 0x7fb1b8106090 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.024+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b8062380 con 0x7fb1a80383f0 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.029+0000 7fb1b5ffb700 1 -- 172.21.15.79:0/3346444281 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fb1b8062380 con 0x7fb1a80383f0 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb1a80383f0 msgr2=0x7fb1a803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb1a80383f0 0x7fb1a803a8a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4006fd0 tx=0x7fb1a4006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 msgr2=0x7fb1b819bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b819bb00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac003fc0 tx=0x7fb1ac0040a0 comp rx=0 tx=0).stop 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 shutdown_connections 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb1a80383f0 0x7fb1a803a8a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 --2- 172.21.15.79:0/3346444281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1b8106090 0x7fb1b819bb00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 >> 172.21.15.79:0/3346444281 conn(0x7fb1b80ff880 msgr2=0x7fb1b818e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:19.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 shutdown_connections 2024-09-10T09:27:19.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:18.031+0000 7fb1bef92700 1 -- 172.21.15.79:0/3346444281 wait complete. 2024-09-10T09:27:19.241 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying grafana service with default placement... 2024-09-10T09:27:20.761 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-10T09:27:20.761 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.714+0000 7fd6172d9700 1 Processor -- start 2024-09-10T09:27:20.761 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.714+0000 7fd6172d9700 1 -- start start 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd6172d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd610108a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd6172d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd610079da0 con 0x7fd6101066b0 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd615075700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd610108a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd615075700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd610108a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33314/0 (socket says 172.21.15.79:33314) 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd615075700 1 -- 172.21.15.79:0/3547753284 learned_addr learned my addr 172.21.15.79:0/3547753284 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd615075700 1 -- 172.21.15.79:0/3547753284 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610079ee0 con 0x7fd6101066b0 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd615075700 1 --2- 172.21.15.79:0/3547753284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd610108a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd600009e80 tx=0x7fd60000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85e8184879bfe4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd60ffff700 1 -- 172.21.15.79:0/3547753284 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd60000e070 con 0x7fd6101066b0 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd60ffff700 1 -- 172.21.15.79:0/3547753284 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd60000b8c0 con 0x7fd6101066b0 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.715+0000 7fd60ffff700 1 -- 172.21.15.79:0/3547753284 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6000044d0 con 0x7fd6101066b0 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.716+0000 7fd6172d9700 1 -- 172.21.15.79:0/3547753284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 msgr2=0x7fd610108a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.716+0000 7fd6172d9700 1 --2- 172.21.15.79:0/3547753284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd610108a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd600009e80 tx=0x7fd60000b330 comp rx=0 tx=0).stop 2024-09-10T09:27:20.762 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.716+0000 7fd6172d9700 1 -- 172.21.15.79:0/3547753284 shutdown_connections 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.716+0000 7fd6172d9700 1 --2- 172.21.15.79:0/3547753284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd610108a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.716+0000 7fd6172d9700 1 -- 172.21.15.79:0/3547753284 >> 172.21.15.79:0/3547753284 conn(0x7fd610100150 msgr2=0x7fd610102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.716+0000 7fd6172d9700 1 -- 172.21.15.79:0/3547753284 shutdown_connections 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.716+0000 7fd6172d9700 1 -- 172.21.15.79:0/3547753284 wait complete. 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd6172d9700 1 Processor -- start 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd6172d9700 1 -- start start 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd6172d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd6101998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd6172d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd610199e20 con 0x7fd6101066b0 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd615075700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd6101998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd615075700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd6101998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33324/0 (socket says 172.21.15.79:33324) 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd615075700 1 -- 172.21.15.79:0/2058344304 learned_addr learned my addr 172.21.15.79:0/2058344304 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.717+0000 7fd615075700 1 -- 172.21.15.79:0/2058344304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600009b30 con 0x7fd6101066b0 2024-09-10T09:27:20.763 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.718+0000 7fd615075700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd6101998e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd600004940 tx=0x7fd600004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.718+0000 7fd60e7fc700 1 -- 172.21.15.79:0/2058344304 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd60000e040 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.718+0000 7fd60e7fc700 1 -- 172.21.15.79:0/2058344304 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd60000bc40 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.718+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61019a020 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.718+0000 7fd60e7fc700 1 -- 172.21.15.79:0/2058344304 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6000126e0 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.718+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61019a4a0 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.719+0000 7fd60e7fc700 1 -- 172.21.15.79:0/2058344304 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fd600019040 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.719+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6100623f0 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.719+0000 7fd60e7fc700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd5f8038440 0x7fd5f803a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.719+0000 7fd60e7fc700 1 -- 172.21.15.79:0/2058344304 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd60004bc10 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.719+0000 7fd614874700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd5f8038440 0x7fd5f803a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.720+0000 7fd614874700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd5f8038440 0x7fd5f803a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd604006fd0 tx=0x7fd604006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.724+0000 7fd60e7fc700 1 -- 172.21.15.79:0/2058344304 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd6100623f0 con 0x7fd6101066b0 2024-09-10T09:27:20.764 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.924+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6100623f0 con 0x7fd5f8038440 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.928+0000 7fd60e7fc700 1 -- 172.21.15.79:0/2058344304 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fd6100623f0 con 0x7fd5f8038440 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd5f8038440 msgr2=0x7fd5f803a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd5f8038440 0x7fd5f803a8f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd604006fd0 tx=0x7fd604006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 msgr2=0x7fd6101998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd6101998e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd600004940 tx=0x7fd600004a20 comp rx=0 tx=0).stop 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 shutdown_connections 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd5f8038440 0x7fd5f803a8f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 --2- 172.21.15.79:0/2058344304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6101066b0 0x7fd6101998e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 >> 172.21.15.79:0/2058344304 conn(0x7fd610100150 msgr2=0x7fd610100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 shutdown_connections 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:19.931+0000 7fd6172d9700 1 -- 172.21.15.79:0/2058344304 wait complete. 2024-09-10T09:27:20.765 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying node-exporter service with default placement... 2024-09-10T09:27:21.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:20 smithi079 ceph-mon[27592]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:21.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:20 smithi079 ceph-mon[27592]: Saving service grafana spec with placement count:1 2024-09-10T09:27:21.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:20 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:21.967 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-10T09:27:21.967 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.180+0000 7fb924227700 1 Processor -- start 2024-09-10T09:27:21.967 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.180+0000 7fb924227700 1 -- start start 2024-09-10T09:27:21.967 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb924227700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c07a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:21.967 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb924227700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c07a880 con 0x7fb91c07be40 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb921fc3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c07a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb921fc3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c07a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33338/0 (socket says 172.21.15.79:33338) 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb921fc3700 1 -- 172.21.15.79:0/2639463770 learned_addr learned my addr 172.21.15.79:0/2639463770 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb921fc3700 1 -- 172.21.15.79:0/2639463770 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c07a9c0 con 0x7fb91c07be40 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb921fc3700 1 --2- 172.21.15.79:0/2639463770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c07a340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9180098a0 tx=0x7fb918009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10372ba8eb7efe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb920fc1700 1 -- 172.21.15.79:0/2639463770 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb918004180 con 0x7fb91c07be40 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb920fc1700 1 -- 172.21.15.79:0/2639463770 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb9180042e0 con 0x7fb91c07be40 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.181+0000 7fb920fc1700 1 -- 172.21.15.79:0/2639463770 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb918011af0 con 0x7fb91c07be40 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.182+0000 7fb924227700 1 -- 172.21.15.79:0/2639463770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 msgr2=0x7fb91c07a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.182+0000 7fb924227700 1 --2- 172.21.15.79:0/2639463770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c07a340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9180098a0 tx=0x7fb918009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.182+0000 7fb924227700 1 -- 172.21.15.79:0/2639463770 shutdown_connections 2024-09-10T09:27:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.182+0000 7fb924227700 1 --2- 172.21.15.79:0/2639463770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c07a340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.182+0000 7fb924227700 1 -- 172.21.15.79:0/2639463770 >> 172.21.15.79:0/2639463770 conn(0x7fb91c101220 msgr2=0x7fb91c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.182+0000 7fb924227700 1 -- 172.21.15.79:0/2639463770 shutdown_connections 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.182+0000 7fb924227700 1 -- 172.21.15.79:0/2639463770 wait complete. 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb924227700 1 Processor -- start 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb924227700 1 -- start start 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb924227700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb924227700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c19c0e0 con 0x7fb91c07be40 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb921fc3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb921fc3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c19bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33342/0 (socket says 172.21.15.79:33342) 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb921fc3700 1 -- 172.21.15.79:0/709841685 learned_addr learned my addr 172.21.15.79:0/709841685 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb921fc3700 1 -- 172.21.15.79:0/709841685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009550 con 0x7fb91c07be40 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb921fc3700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c19bba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb918006ba0 tx=0x7fb918011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:21.969 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.183+0000 7fb912ffd700 1 -- 172.21.15.79:0/709841685 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb918003b00 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.184+0000 7fb912ffd700 1 -- 172.21.15.79:0/709841685 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb91801a8e0 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.184+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c19c2e0 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.184+0000 7fb912ffd700 1 -- 172.21.15.79:0/709841685 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb918019990 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.184+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c19c700 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.184+0000 7fb912ffd700 1 -- 172.21.15.79:0/709841685 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fb918019c50 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.185+0000 7fb912ffd700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb9080383a0 0x7fb90803a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.185+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c10be80 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.185+0000 7fb912ffd700 1 -- 172.21.15.79:0/709841685 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb91804c580 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.185+0000 7fb9217c2700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb9080383a0 0x7fb90803a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.185+0000 7fb9217c2700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb9080383a0 0x7fb90803a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006fd0 tx=0x7fb90c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.189+0000 7fb912ffd700 1 -- 172.21.15.79:0/709841685 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb91801a430 con 0x7fb91c07be40 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.389+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fb91c19f560 con 0x7fb9080383a0 2024-09-10T09:27:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.394+0000 7fb912ffd700 1 -- 172.21.15.79:0/709841685 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb91c19f560 con 0x7fb9080383a0 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb9080383a0 msgr2=0x7fb90803a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb9080383a0 0x7fb90803a850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb90c006fd0 tx=0x7fb90c006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 msgr2=0x7fb91c19bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c19bba0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb918006ba0 tx=0x7fb918011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 shutdown_connections 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb9080383a0 0x7fb90803a850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 --2- 172.21.15.79:0/709841685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb91c07be40 0x7fb91c19bba0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 >> 172.21.15.79:0/709841685 conn(0x7fb91c101220 msgr2=0x7fb91c102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 shutdown_connections 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:21.396+0000 7fb924227700 1 -- 172.21.15.79:0/709841685 wait complete. 2024-09-10T09:27:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:Deploying alertmanager service with default placement... 2024-09-10T09:27:22.618 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:22 smithi079 ceph-mon[27592]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:27:22.618 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:22 smithi079 ceph-mon[27592]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:22.618 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:22 smithi079 ceph-mon[27592]: Saving service node-exporter spec with placement * 2024-09-10T09:27:22.619 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:22 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:23.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-10T09:27:23.240 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.405+0000 7f80695b8700 1 Processor -- start 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.405+0000 7f80695b8700 1 -- start start 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.405+0000 7f80695b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.405+0000 7f80695b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064105430 con 0x7f8064104ae0 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.405+0000 7f8062ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.405+0000 7f8062ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56802/0 (socket says 172.21.15.79:56802) 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.405+0000 7f8062ffd700 1 -- 172.21.15.79:0/203879879 learned_addr learned my addr 172.21.15.79:0/203879879 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.406+0000 7f8062ffd700 1 -- 172.21.15.79:0/203879879 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064105570 con 0x7f8064104ae0 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.406+0000 7f8062ffd700 1 --2- 172.21.15.79:0/203879879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064104ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80540098a0 tx=0x7f8054009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780d820b1d74fb91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.406+0000 7f8061ffb700 1 -- 172.21.15.79:0/203879879 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8054004180 con 0x7f8064104ae0 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.406+0000 7f8061ffb700 1 -- 172.21.15.79:0/203879879 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f80540042e0 con 0x7f8064104ae0 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.406+0000 7f8061ffb700 1 -- 172.21.15.79:0/203879879 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8054011af0 con 0x7f8064104ae0 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.406+0000 7f80695b8700 1 -- 172.21.15.79:0/203879879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 msgr2=0x7f8064104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.406+0000 7f80695b8700 1 --2- 172.21.15.79:0/203879879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064104ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80540098a0 tx=0x7f8054009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 -- 172.21.15.79:0/203879879 shutdown_connections 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 --2- 172.21.15.79:0/203879879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064104ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 -- 172.21.15.79:0/203879879 >> 172.21.15.79:0/203879879 conn(0x7f8064100130 msgr2=0x7f8064102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 -- 172.21.15.79:0/203879879 shutdown_connections 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 -- 172.21.15.79:0/203879879 wait complete. 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 Processor -- start 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 -- start start 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.407+0000 7f80695b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064199e80 con 0x7f8064104ae0 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f8062ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f8062ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56810/0 (socket says 172.21.15.79:56810) 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f8062ffd700 1 -- 172.21.15.79:0/2372596128 learned_addr learned my addr 172.21.15.79:0/2372596128 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f8062ffd700 1 -- 172.21.15.79:0/2372596128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054009550 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f8062ffd700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064199940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8054006ba0 tx=0x7f8054011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f804bfff700 1 -- 172.21.15.79:0/2372596128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8054003b00 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f804bfff700 1 -- 172.21.15.79:0/2372596128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f805401a8e0 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806419a080 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f804bfff700 1 -- 172.21.15.79:0/2372596128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f80540199c0 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.408+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806419a4a0 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.409+0000 7f804bfff700 1 -- 172.21.15.79:0/2372596128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f8054019c80 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.409+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8064062380 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.409+0000 7f804bfff700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f804c0383a0 0x7f804c03a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.410+0000 7f804bfff700 1 -- 172.21.15.79:0/2372596128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f805404c7e0 con 0x7f8064104ae0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.410+0000 7f80627fc700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f804c0383a0 0x7f804c03a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.410+0000 7f80627fc700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f804c0383a0 0x7f804c03a850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8058006fd0 tx=0x7f8058006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.414+0000 7f804bfff700 1 -- 172.21.15.79:0/2372596128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f805402b700 con 0x7f8064104ae0 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.617+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f80641022e0 con 0x7f804c0383a0 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.623+0000 7f804bfff700 1 -- 172.21.15.79:0/2372596128 <== mgr.14120 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f80641022e0 con 0x7f804c0383a0 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f804c0383a0 msgr2=0x7f804c03a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f804c0383a0 0x7f804c03a850 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8058006fd0 tx=0x7f8058006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 msgr2=0x7f8064199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064199940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8054006ba0 tx=0x7f8054011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 shutdown_connections 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f804c0383a0 0x7f804c03a850 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 --2- 172.21.15.79:0/2372596128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8064104ae0 0x7f8064199940 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 >> 172.21.15.79:0/2372596128 conn(0x7f8064100130 msgr2=0x7f8064079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 shutdown_connections 2024-09-10T09:27:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:22.625+0000 7f80695b8700 1 -- 172.21.15.79:0/2372596128 wait complete. 2024-09-10T09:27:23.856 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:23 smithi079 ceph-mon[27592]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:23.856 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:23 smithi079 ceph-mon[27592]: Saving service alertmanager spec with placement count:1 2024-09-10T09:27:23.856 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:23 smithi079 ceph-mon[27592]: from='mgr.14120 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:23.856 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:23 smithi079 ceph-mon[27592]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.657+0000 7f77fbd1a700 1 Processor -- start 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.657+0000 7f77fbd1a700 1 -- start start 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.657+0000 7f77fbd1a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f407a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77fbd1a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f407a840 con 0x7f77f407be00 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f9ab6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f407a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f9ab6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f407a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56814/0 (socket says 172.21.15.79:56814) 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f9ab6700 1 -- 172.21.15.79:0/3892548489 learned_addr learned my addr 172.21.15.79:0/3892548489 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f9ab6700 1 -- 172.21.15.79:0/3892548489 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f407a980 con 0x7f77f407be00 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f9ab6700 1 --2- 172.21.15.79:0/3892548489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f407a300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f77f00098a0 tx=0x7f77f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c130367703d1fa0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:24.415 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f8ab4700 1 -- 172.21.15.79:0/3892548489 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f0004180 con 0x7f77f407be00 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f8ab4700 1 -- 172.21.15.79:0/3892548489 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77f00042e0 con 0x7f77f407be00 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.658+0000 7f77f8ab4700 1 -- 172.21.15.79:0/3892548489 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f0011af0 con 0x7f77f407be00 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.659+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3892548489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 msgr2=0x7f77f407a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.659+0000 7f77fbd1a700 1 --2- 172.21.15.79:0/3892548489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f407a300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f77f00098a0 tx=0x7f77f0009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.659+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3892548489 shutdown_connections 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.659+0000 7f77fbd1a700 1 --2- 172.21.15.79:0/3892548489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f407a300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.659+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3892548489 >> 172.21.15.79:0/3892548489 conn(0x7f77f41012b0 msgr2=0x7f77f41036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.659+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3892548489 shutdown_connections 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.659+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3892548489 wait complete. 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77fbd1a700 1 Processor -- start 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77fbd1a700 1 -- start start 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77fbd1a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77fbd1a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f419c0f0 con 0x7f77f407be00 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77f9ab6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77f9ab6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f419bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56828/0 (socket says 172.21.15.79:56828) 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77f9ab6700 1 -- 172.21.15.79:0/3986921335 learned_addr learned my addr 172.21.15.79:0/3986921335 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77f9ab6700 1 -- 172.21.15.79:0/3986921335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f0009550 con 0x7f77f407be00 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77f9ab6700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f419bbb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77f0011670 tx=0x7f77f0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77eaffd700 1 -- 172.21.15.79:0/3986921335 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f00039c0 con 0x7f77f407be00 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77eaffd700 1 -- 172.21.15.79:0/3986921335 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77f0003b20 con 0x7f77f407be00 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f419c2f0 con 0x7f77f407be00 2024-09-10T09:27:24.417 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.660+0000 7f77eaffd700 1 -- 172.21.15.79:0/3986921335 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77f00247f0 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.661+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f419c710 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.662+0000 7f77eaffd700 1 -- 172.21.15.79:0/3986921335 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f77f001a430 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.662+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f410bf90 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.662+0000 7f77eaffd700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f77e0038400 0x7f77e003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.662+0000 7f77eaffd700 1 -- 172.21.15.79:0/3986921335 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f77f004c270 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.662+0000 7f77f92b5700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f77e0038400 0x7f77e003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.662+0000 7f77f92b5700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f77e0038400 0x7f77e003a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006fd0 tx=0x7f77e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.666+0000 7f77eaffd700 1 -- 172.21.15.79:0/3986921335 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f77f001a6e0 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.855+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f77f419f570 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.859+0000 7f77eaffd700 1 -- 172.21.15.79:0/3986921335 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f77f0018350 con 0x7f77f407be00 2024-09-10T09:27:24.420 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f77e0038400 msgr2=0x7f77e003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f77e0038400 0x7f77e003a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f77e4006fd0 tx=0x7f77e4006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 msgr2=0x7f77f419bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f419bbb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77f0011670 tx=0x7f77f0011aa0 comp rx=0 tx=0).stop 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 shutdown_connections 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f77e0038400 0x7f77e003a8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 --2- 172.21.15.79:0/3986921335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77f407be00 0x7f77f419bbb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 >> 172.21.15.79:0/3986921335 conn(0x7f77f41012b0 msgr2=0x7f77f4102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 shutdown_connections 2024-09-10T09:27:24.421 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:23.861+0000 7f77fbd1a700 1 -- 172.21.15.79:0/3986921335 wait complete. 2024-09-10T09:27:25.037 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:24 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3986921335' entity='client.admin' 2024-09-10T09:27:25.661 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.836+0000 7f0093800700 1 Processor -- start 2024-09-10T09:27:25.661 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f0093800700 1 -- start start 2024-09-10T09:27:25.661 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f0093800700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c1075f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:25.661 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f0093800700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c107b30 con 0x7f008c1071e0 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f009159c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c1075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f009159c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c1075f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56840/0 (socket says 172.21.15.79:56840) 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f009159c700 1 -- 172.21.15.79:0/4103274539 learned_addr learned my addr 172.21.15.79:0/4103274539 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f009159c700 1 -- 172.21.15.79:0/4103274539 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c107c70 con 0x7f008c1071e0 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.837+0000 7f009159c700 1 --2- 172.21.15.79:0/4103274539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c1075f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00880098a0 tx=0x7f0088009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5ac6efda0e1801 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0083fff700 1 -- 172.21.15.79:0/4103274539 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0088004180 con 0x7f008c1071e0 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0083fff700 1 -- 172.21.15.79:0/4103274539 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f00880042e0 con 0x7f008c1071e0 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0083fff700 1 -- 172.21.15.79:0/4103274539 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0088011af0 con 0x7f008c1071e0 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0093800700 1 -- 172.21.15.79:0/4103274539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 msgr2=0x7f008c1075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0093800700 1 --2- 172.21.15.79:0/4103274539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c1075f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00880098a0 tx=0x7f0088009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0093800700 1 -- 172.21.15.79:0/4103274539 shutdown_connections 2024-09-10T09:27:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0093800700 1 --2- 172.21.15.79:0/4103274539 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c1075f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0093800700 1 -- 172.21.15.79:0/4103274539 >> 172.21.15.79:0/4103274539 conn(0x7f008c0ff870 msgr2=0x7f008c101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0093800700 1 -- 172.21.15.79:0/4103274539 shutdown_connections 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.838+0000 7f0093800700 1 -- 172.21.15.79:0/4103274539 wait complete. 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.839+0000 7f0093800700 1 Processor -- start 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.839+0000 7f0093800700 1 -- start start 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.839+0000 7f0093800700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.839+0000 7f0093800700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c199e50 con 0x7f008c1071e0 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.839+0000 7f009159c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.839+0000 7f009159c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56844/0 (socket says 172.21.15.79:56844) 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.839+0000 7f009159c700 1 -- 172.21.15.79:0/61219536 learned_addr learned my addr 172.21.15.79:0/61219536 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.840+0000 7f009159c700 1 -- 172.21.15.79:0/61219536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088009550 con 0x7f008c1071e0 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.840+0000 7f009159c700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c199910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0088011ad0 tx=0x7f0088011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.840+0000 7f00827fc700 1 -- 172.21.15.79:0/61219536 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0088003ab0 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.840+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c19a050 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.840+0000 7f00827fc700 1 -- 172.21.15.79:0/61219536 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0088003c10 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.840+0000 7f00827fc700 1 -- 172.21.15.79:0/61219536 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00880198e0 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.840+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c19a470 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.841+0000 7f00827fc700 1 -- 172.21.15.79:0/61219536 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7f0088019ba0 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.841+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c062380 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.841+0000 7f00827fc700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f00780383f0 0x7f007803a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.841+0000 7f00827fc700 1 -- 172.21.15.79:0/61219536 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f008804c180 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.841+0000 7f0090d9b700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f00780383f0 0x7f007803a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.841+0000 7f0090d9b700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f00780383f0 0x7f007803a8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f007c006fd0 tx=0x7f007c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:24.846+0000 7f00827fc700 1 -- 172.21.15.79:0/61219536 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f008802b300 con 0x7f008c1071e0 2024-09-10T09:27:25.664 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.037+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f008c19d360 con 0x7f008c1071e0 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.040+0000 7f00827fc700 1 -- 172.21.15.79:0/61219536 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f0088010b30 con 0x7f008c1071e0 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f00780383f0 msgr2=0x7f007803a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f00780383f0 0x7f007803a8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f007c006fd0 tx=0x7f007c006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 msgr2=0x7f008c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c199910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0088011ad0 tx=0x7f0088011bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 shutdown_connections 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f00780383f0 0x7f007803a8a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 --2- 172.21.15.79:0/61219536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f008c1071e0 0x7f008c199910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 >> 172.21.15.79:0/61219536 conn(0x7f008c0ff870 msgr2=0x7f008c100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 shutdown_connections 2024-09-10T09:27:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:25.042+0000 7f0093800700 1 -- 172.21.15.79:0/61219536 wait complete. 2024-09-10T09:27:25.666 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling the dashboard module... 2024-09-10T09:27:26.361 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:26 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/61219536' entity='client.admin' 2024-09-10T09:27:26.361 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:26 smithi079 ceph-mon[27592]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:27:27.306 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:27 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2723939801' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T09:27:27.677 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.110+0000 7feae36bb700 1 Processor -- start 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.110+0000 7feae36bb700 1 -- start start 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feae36bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc108ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feae36bb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc079da0 con 0x7feadc1066e0 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feae1457700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc108ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feae1457700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc108ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56858/0 (socket says 172.21.15.79:56858) 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feae1457700 1 -- 172.21.15.79:0/1243042480 learned_addr learned my addr 172.21.15.79:0/1243042480 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feae1457700 1 -- 172.21.15.79:0/1243042480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc079ee0 con 0x7feadc1066e0 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feae1457700 1 --2- 172.21.15.79:0/1243042480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc108ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fead80098a0 tx=0x7fead8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d675e78c53b54eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:27.678 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feacffff700 1 -- 172.21.15.79:0/1243042480 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fead8004180 con 0x7feadc1066e0 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feacffff700 1 -- 172.21.15.79:0/1243042480 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fead80042e0 con 0x7feadc1066e0 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.111+0000 7feacffff700 1 -- 172.21.15.79:0/1243042480 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fead8011af0 con 0x7feadc1066e0 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.112+0000 7feae36bb700 1 -- 172.21.15.79:0/1243042480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 msgr2=0x7feadc108ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.112+0000 7feae36bb700 1 --2- 172.21.15.79:0/1243042480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc108ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fead80098a0 tx=0x7fead8009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.112+0000 7feae36bb700 1 -- 172.21.15.79:0/1243042480 shutdown_connections 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.112+0000 7feae36bb700 1 --2- 172.21.15.79:0/1243042480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc108ac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.112+0000 7feae36bb700 1 -- 172.21.15.79:0/1243042480 >> 172.21.15.79:0/1243042480 conn(0x7feadc100160 msgr2=0x7feadc102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.112+0000 7feae36bb700 1 -- 172.21.15.79:0/1243042480 shutdown_connections 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.112+0000 7feae36bb700 1 -- 172.21.15.79:0/1243042480 wait complete. 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae36bb700 1 Processor -- start 2024-09-10T09:27:27.679 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae36bb700 1 -- start start 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae36bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae36bb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc199ef0 con 0x7feadc1066e0 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae1457700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae1457700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc1999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56860/0 (socket says 172.21.15.79:56860) 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae1457700 1 -- 172.21.15.79:0/2723939801 learned_addr learned my addr 172.21.15.79:0/2723939801 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.113+0000 7feae1457700 1 -- 172.21.15.79:0/2723939801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009550 con 0x7feadc1066e0 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.114+0000 7feae1457700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc1999b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fead8011670 tx=0x7fead8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.114+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fead80039c0 con 0x7feadc1066e0 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.114+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fead8003b20 con 0x7feadc1066e0 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.114+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc19a0f0 con 0x7feadc1066e0 2024-09-10T09:27:27.680 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.114+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fead80247f0 con 0x7feadc1066e0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.114+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc19a510 con 0x7feadc1066e0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.115+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 8) v1 ==== 45084+0+0 (secure 0 0 0) 0x7fead801a430 con 0x7feadc1066e0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.115+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc109cc0 con 0x7feadc1066e0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.115+0000 7feace7fc700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7feac80383b0 0x7feac803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.115+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fead804c2c0 con 0x7feadc1066e0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.115+0000 7feae0c56700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7feac80383b0 0x7feac803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.115+0000 7feae0c56700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7feac80383b0 0x7feac803a860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fead0006fd0 tx=0x7fead0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.119+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fead8018530 con 0x7feadc1066e0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:26.360+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7feadc109e80 con 0x7feadc1066e0 2024-09-10T09:27:27.681 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.045+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fead801a6e0 con 0x7feadc1066e0 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.046+0000 7feace7fc700 1 -- 172.21.15.79:0/2723939801 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fead801ad20 con 0x7feadc1066e0 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7feac80383b0 msgr2=0x7feac803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7feac80383b0 0x7feac803a860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fead0006fd0 tx=0x7fead0006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 msgr2=0x7feadc1999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc1999b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fead8011670 tx=0x7fead8011aa0 comp rx=0 tx=0).stop 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 shutdown_connections 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7feac80383b0 0x7feac803a860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 --2- 172.21.15.79:0/2723939801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feadc1066e0 0x7feadc1999b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 >> 172.21.15.79:0/2723939801 conn(0x7feadc100160 msgr2=0x7feadc101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 shutdown_connections 2024-09-10T09:27:27.682 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:27.049+0000 7feae36bb700 1 -- 172.21.15.79:0/2723939801 wait complete. 2024-09-10T09:27:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:28 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2723939801' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T09:27:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:28 smithi079 ceph-mon[27592]: mgrmap e9: smithi079.mhirny(active, since 25s) 2024-09-10T09:27:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:27:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T09:27:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T09:27:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "active_name": "smithi079.mhirny", 2024-09-10T09:27:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T09:27:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:27:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.087+0000 7f623d14c700 1 Processor -- start 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.087+0000 7f623d14c700 1 -- start start 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f623d14c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f623d14c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238106590 con 0x7f6238105c40 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56876/0 (socket says 172.21.15.79:56876) 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f6236d9d700 1 -- 172.21.15.79:0/2059146023 learned_addr learned my addr 172.21.15.79:0/2059146023 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f6236d9d700 1 -- 172.21.15.79:0/2059146023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62381066d0 con 0x7f6238105c40 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f6236d9d700 1 --2- 172.21.15.79:0/2059146023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238106050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62280098a0 tx=0x7f6228009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130ebbc60c766d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.088+0000 7f6235d9b700 1 -- 172.21.15.79:0/2059146023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228004180 con 0x7f6238105c40 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f6235d9b700 1 -- 172.21.15.79:0/2059146023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f62280042e0 con 0x7f6238105c40 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f6235d9b700 1 -- 172.21.15.79:0/2059146023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228011af0 con 0x7f6238105c40 2024-09-10T09:27:28.950 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f623d14c700 1 -- 172.21.15.79:0/2059146023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 msgr2=0x7f6238106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f623d14c700 1 --2- 172.21.15.79:0/2059146023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238106050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f62280098a0 tx=0x7f6228009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f623d14c700 1 -- 172.21.15.79:0/2059146023 shutdown_connections 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f623d14c700 1 --2- 172.21.15.79:0/2059146023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238106050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f623d14c700 1 -- 172.21.15.79:0/2059146023 >> 172.21.15.79:0/2059146023 conn(0x7f62381012b0 msgr2=0x7f62381036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f623d14c700 1 -- 172.21.15.79:0/2059146023 shutdown_connections 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.089+0000 7f623d14c700 1 -- 172.21.15.79:0/2059146023 wait complete. 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.090+0000 7f623d14c700 1 Processor -- start 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.090+0000 7f623d14c700 1 -- start start 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.090+0000 7f623d14c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.090+0000 7f623d14c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6238199ea0 con 0x7f6238105c40 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.090+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.090+0000 7f6236d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56888/0 (socket says 172.21.15.79:56888) 2024-09-10T09:27:28.951 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.090+0000 7f6236d9d700 1 -- 172.21.15.79:0/78234093 learned_addr learned my addr 172.21.15.79:0/78234093 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.091+0000 7f6236d9d700 1 -- 172.21.15.79:0/78234093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228009550 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.091+0000 7f6236d9d700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238199960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6228011670 tx=0x7f6228011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.091+0000 7f621ffff700 1 -- 172.21.15.79:0/78234093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228003a40 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.091+0000 7f621ffff700 1 -- 172.21.15.79:0/78234093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6228003ba0 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.091+0000 7f621ffff700 1 -- 172.21.15.79:0/78234093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6228024790 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.091+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623819a0a0 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.091+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623819a4c0 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.092+0000 7f621ffff700 1 -- 172.21.15.79:0/78234093 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f622802d3f0 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.092+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6238062380 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.092+0000 7f621ffff700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 0x7f622003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.092+0000 7f621ffff700 1 -- 172.21.15.79:0/78234093 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f622804c610 con 0x7f6238105c40 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.092+0000 7f623659c700 1 -- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 msgr2=0x7f622003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.092+0000 7f623659c700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 0x7f622003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.097+0000 7f621ffff700 1 -- 172.21.15.79:0/78234093 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f62280109d0 con 0x7f6238105c40 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.293+0000 7f623659c700 1 -- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 msgr2=0x7f622003a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.293+0000 7f623659c700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 0x7f622003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.348+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f6238107af0 con 0x7f6238105c40 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.349+0000 7f621ffff700 1 -- 172.21.15.79:0/78234093 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f622804bf80 con 0x7f6238105c40 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 msgr2=0x7f622003a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 0x7f622003a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 msgr2=0x7f6238199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238199960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6228011670 tx=0x7f6228011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 shutdown_connections 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6220038440 0x7f622003a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 --2- 172.21.15.79:0/78234093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6238105c40 0x7f6238199960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:28.953 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 >> 172.21.15.79:0/78234093 conn(0x7f62381012b0 msgr2=0x7f62381029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:28.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 shutdown_connections 2024-09-10T09:27:28.954 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:28.351+0000 7f623d14c700 1 -- 172.21.15.79:0/78234093 wait complete. 2024-09-10T09:27:28.954 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for the mgr to restart... 2024-09-10T09:27:28.954 INFO:teuthology.orchestra.run.smithi079.stdout:Waiting for mgr epoch 9... 2024-09-10T09:27:29.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:29 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/78234093' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T09:27:34.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: Active manager daemon smithi079.mhirny restarted 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: Activating manager daemon smithi079.mhirny 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: mgrmap e10: smithi079.mhirny(active, starting, since 0.00393622s) 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:27:34.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:34 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout { 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout } 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.431+0000 7fe268b93700 1 Processor -- start 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.431+0000 7fe268b93700 1 -- start start 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.431+0000 7fe268b93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.431+0000 7fe268b93700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264079da0 con 0x7fe2641066f0 2024-09-10T09:27:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56896/0 (socket says 172.21.15.79:56896) 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26259c700 1 -- 172.21.15.79:0/527616828 learned_addr learned my addr 172.21.15.79:0/527616828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26259c700 1 -- 172.21.15.79:0/527616828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264079ee0 con 0x7fe2641066f0 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26259c700 1 --2- 172.21.15.79:0/527616828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264108ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098a0 tx=0x7fe254009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9466496b3d575f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26159a700 1 -- 172.21.15.79:0/527616828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe254004180 con 0x7fe2641066f0 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26159a700 1 -- 172.21.15.79:0/527616828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe2540042e0 con 0x7fe2641066f0 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.432+0000 7fe26159a700 1 -- 172.21.15.79:0/527616828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe254011af0 con 0x7fe2641066f0 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.433+0000 7fe268b93700 1 -- 172.21.15.79:0/527616828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 msgr2=0x7fe264108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.433+0000 7fe268b93700 1 --2- 172.21.15.79:0/527616828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264108ad0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098a0 tx=0x7fe254009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.433+0000 7fe268b93700 1 -- 172.21.15.79:0/527616828 shutdown_connections 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.433+0000 7fe268b93700 1 --2- 172.21.15.79:0/527616828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264108ad0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.433+0000 7fe268b93700 1 -- 172.21.15.79:0/527616828 >> 172.21.15.79:0/527616828 conn(0x7fe264100130 msgr2=0x7fe264102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.433+0000 7fe268b93700 1 -- 172.21.15.79:0/527616828 shutdown_connections 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.433+0000 7fe268b93700 1 -- 172.21.15.79:0/527616828 wait complete. 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.434+0000 7fe268b93700 1 Processor -- start 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.434+0000 7fe268b93700 1 -- start start 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.434+0000 7fe268b93700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264106050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.434+0000 7fe268b93700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264106590 con 0x7fe2641066f0 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.434+0000 7fe26259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.434+0000 7fe26259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56908/0 (socket says 172.21.15.79:56908) 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.434+0000 7fe26259c700 1 -- 172.21.15.79:0/1729262893 learned_addr learned my addr 172.21.15.79:0/1729262893 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.435+0000 7fe26259c700 1 -- 172.21.15.79:0/1729262893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254009550 con 0x7fe2641066f0 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.435+0000 7fe26259c700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264106050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe254006ba0 tx=0x7fe254011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.435+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe254003b00 con 0x7fe2641066f0 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.435+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2641046a0 con 0x7fe2641066f0 2024-09-10T09:27:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.435+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe264104ac0 con 0x7fe2641066f0 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.435+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe25401a8e0 con 0x7fe2641066f0 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.435+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe254019990 con 0x7fe2641066f0 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.436+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 9) v1 ==== 45097+0+0 (secure 0 0 0) 0x7fe254019c00 con 0x7fe2641066f0 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.437+0000 7fe2537fe700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.437+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe24c03b000 con 0x7fe24c038440 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.437+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe25404c5d0 con 0x7fe2641066f0 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.437+0000 7fe261d9b700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 msgr2=0x7fe24c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.437+0000 7fe261d9b700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.638+0000 7fe261d9b700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 msgr2=0x7fe24c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:29.638+0000 7fe261d9b700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:30.039+0000 7fe261d9b700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 msgr2=0x7fe24c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:30.039+0000 7fe261d9b700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T09:27:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:30.840+0000 7fe261d9b700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 msgr2=0x7fe24c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:30.840+0000 7fe261d9b700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:32.441+0000 7fe261d9b700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 msgr2=0x7fe24c03a8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:32.441+0000 7fe261d9b700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:33.748+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mgrmap(e 10) v1 ==== 44864+0+0 (secure 0 0 0) 0x7fe25402c3a0 con 0x7fe2641066f0 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:33.748+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 msgr2=0x7fe24c03a8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:33.748+0000 7fe2537fe700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.749+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7fe25402d960 con 0x7fe2641066f0 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.750+0000 7fe2537fe700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.750+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe24c03b000 con 0x7fe24c038440 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.750+0000 7fe261d9b700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.751+0000 7fe261d9b700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe258003a10 tx=0x7fe258009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.751+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mgr.14164 v2:172.21.15.79:6800/2 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fe24c03b000 con 0x7fe24c038440 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.757+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fe244002630 con 0x7fe24c038440 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe2537fe700 1 -- 172.21.15.79:0/1729262893 <== mgr.14164 v2:172.21.15.79:6800/2 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fe244002630 con 0x7fe24c038440 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 msgr2=0x7fe24c03a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe258003a10 tx=0x7fe258009270 comp rx=0 tx=0).stop 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 msgr2=0x7fe264106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264106050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe254006ba0 tx=0x7fe254011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 shutdown_connections 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe24c038440 0x7fe24c03a8f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 --2- 172.21.15.79:0/1729262893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2641066f0 0x7fe264106050 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 >> 172.21.15.79:0/1729262893 conn(0x7fe264100130 msgr2=0x7fe264100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 shutdown_connections 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:34.758+0000 7fe268b93700 1 -- 172.21.15.79:0/1729262893 wait complete. 2024-09-10T09:27:35.557 INFO:teuthology.orchestra.run.smithi079.stdout:mgr epoch 9 is available 2024-09-10T09:27:35.558 INFO:teuthology.orchestra.run.smithi079.stdout:Generating a dashboard self-signed certificate... 2024-09-10T09:27:35.879 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:35 smithi079 ceph-mon[27592]: mgrmap e11: smithi079.mhirny(active, since 1.00546s) 2024-09-10T09:27:35.879 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:35 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:34] ENGINE Bus STARTING 2024-09-10T09:27:35.879 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:35 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:35] ENGINE Serving on http://172.21.15.79:8765 2024-09-10T09:27:35.879 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:35 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:36.847 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T09:27:36.847 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.978+0000 7f828677b700 1 Processor -- start 2024-09-10T09:27:36.847 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.978+0000 7f828677b700 1 -- start start 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.978+0000 7f828677b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280107620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.978+0000 7f828677b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280107b60 con 0x7f8280107210 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.978+0000 7f827ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280107620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.979+0000 7f827ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280107620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45954/0 (socket says 172.21.15.79:45954) 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.979+0000 7f827ffff700 1 -- 172.21.15.79:0/1829991451 learned_addr learned my addr 172.21.15.79:0/1829991451 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.979+0000 7f827ffff700 1 -- 172.21.15.79:0/1829991451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280107ca0 con 0x7f8280107210 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.979+0000 7f827ffff700 1 --2- 172.21.15.79:0/1829991451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280107620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82700098a0 tx=0x7f8270009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660091bfc6c3e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.979+0000 7f827effd700 1 -- 172.21.15.79:0/1829991451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8270004180 con 0x7f8280107210 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.979+0000 7f827effd700 1 -- 172.21.15.79:0/1829991451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82700042e0 con 0x7f8280107210 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.979+0000 7f827effd700 1 -- 172.21.15.79:0/1829991451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8270011af0 con 0x7f8280107210 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.980+0000 7f828677b700 1 -- 172.21.15.79:0/1829991451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 msgr2=0x7f8280107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.980+0000 7f828677b700 1 --2- 172.21.15.79:0/1829991451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280107620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82700098a0 tx=0x7f8270009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:36.848 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.980+0000 7f828677b700 1 -- 172.21.15.79:0/1829991451 shutdown_connections 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.980+0000 7f828677b700 1 --2- 172.21.15.79:0/1829991451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280107620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.980+0000 7f828677b700 1 -- 172.21.15.79:0/1829991451 >> 172.21.15.79:0/1829991451 conn(0x7f82800ff880 msgr2=0x7f8280101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.980+0000 7f828677b700 1 -- 172.21.15.79:0/1829991451 shutdown_connections 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.980+0000 7f828677b700 1 -- 172.21.15.79:0/1829991451 wait complete. 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f828677b700 1 Processor -- start 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f828677b700 1 -- start start 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f828677b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f828677b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280199e80 con 0x7f8280107210 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f827ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:36.849 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f827ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45956/0 (socket says 172.21.15.79:45956) 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f827ffff700 1 -- 172.21.15.79:0/2987059859 learned_addr learned my addr 172.21.15.79:0/2987059859 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.981+0000 7f827ffff700 1 -- 172.21.15.79:0/2987059859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270009550 con 0x7f8280107210 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.982+0000 7f827ffff700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280199940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8270011ad0 tx=0x7f8270011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.982+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8270003ab0 con 0x7f8280107210 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.982+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8270003c10 con 0x7f8280107210 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.982+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828019a080 con 0x7f8280107210 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.982+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82700198e0 con 0x7f8280107210 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.982+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828019a4a0 con 0x7f8280107210 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.983+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 11) v1 ==== 44991+0+0 (secure 0 0 0) 0x7f8270019bc0 con 0x7f8280107210 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.983+0000 7f827d7fa700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8268038320 0x7f826803a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:36.850 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.983+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f827004c0d0 con 0x7f8280107210 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.983+0000 7f827f7fe700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8268038320 0x7f826803a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.983+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8280062380 con 0x7f8280107210 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.984+0000 7f827f7fe700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8268038320 0x7f826803a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8274006fd0 tx=0x7f8274006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:35.988+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f827002b300 con 0x7f8280107210 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.151+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f8270010380 con 0x7f8280107210 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.193+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f8280100d40 con 0x7f8268038320 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.274+0000 7f827d7fa700 1 -- 172.21.15.79:0/2987059859 <== mgr.14164 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f8280100d40 con 0x7f8268038320 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8268038320 msgr2=0x7f826803a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8268038320 0x7f826803a7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8274006fd0 tx=0x7f8274006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 msgr2=0x7f8280199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:36.851 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280199940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8270011ad0 tx=0x7f8270011bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 shutdown_connections 2024-09-10T09:27:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8268038320 0x7f826803a7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 --2- 172.21.15.79:0/2987059859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8280107210 0x7f8280199940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 >> 172.21.15.79:0/2987059859 conn(0x7f82800ff880 msgr2=0x7f8280100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 shutdown_connections 2024-09-10T09:27:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:36.276+0000 7f828677b700 1 -- 172.21.15.79:0/2987059859 wait complete. 2024-09-10T09:27:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:Creating initial admin user... 2024-09-10T09:27:37.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:37 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:35] ENGINE Serving on https://172.21.15.79:7150 2024-09-10T09:27:37.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:37 smithi079 ceph-mon[27592]: [10/Sep/2024:09:27:35] ENGINE Bus STARTED 2024-09-10T09:27:37.294 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:37 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:37.294 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:37 smithi079 ceph-mon[27592]: mgrmap e12: smithi079.mhirny(active, since 2s) 2024-09-10T09:27:37.294 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:37 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:37.294 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:37 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:38.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:38 smithi079 ceph-mon[27592]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:38.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:38 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$L1HachwL77LdtvuQLeyx5OWmn7pLkvyHfOGBLduU3MmKAYbKPSIt6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725960457, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.313+0000 7ff8f6a30700 1 Processor -- start 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.313+0000 7ff8f6a30700 1 -- start start 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8f6a30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8f6a30700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f01064c0 con 0x7ff8f0105b70 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45970/0 (socket says 172.21.15.79:45970) 2024-09-10T09:27:39.010 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8effff700 1 -- 172.21.15.79:0/4190194741 learned_addr learned my addr 172.21.15.79:0/4190194741 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8effff700 1 -- 172.21.15.79:0/4190194741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0106600 con 0x7ff8f0105b70 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8effff700 1 --2- 172.21.15.79:0/4190194741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0105f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00098a0 tx=0x7ff8e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dc74c27f7bb010 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8eeffd700 1 -- 172.21.15.79:0/4190194741 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8e0004180 con 0x7ff8f0105b70 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8eeffd700 1 -- 172.21.15.79:0/4190194741 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff8e00042e0 con 0x7ff8f0105b70 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.314+0000 7ff8eeffd700 1 -- 172.21.15.79:0/4190194741 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8e0011af0 con 0x7ff8f0105b70 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 -- 172.21.15.79:0/4190194741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 msgr2=0x7ff8f0105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 --2- 172.21.15.79:0/4190194741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0105f80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00098a0 tx=0x7ff8e0009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 -- 172.21.15.79:0/4190194741 shutdown_connections 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 --2- 172.21.15.79:0/4190194741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0105f80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 -- 172.21.15.79:0/4190194741 >> 172.21.15.79:0/4190194741 conn(0x7ff8f0101220 msgr2=0x7ff8f0103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 -- 172.21.15.79:0/4190194741 shutdown_connections 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 -- 172.21.15.79:0/4190194741 wait complete. 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.315+0000 7ff8f6a30700 1 Processor -- start 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8f6a30700 1 -- start start 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8f6a30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8f6a30700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0199e60 con 0x7ff8f0105b70 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45980/0 (socket says 172.21.15.79:45980) 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8effff700 1 -- 172.21.15.79:0/1841025111 learned_addr learned my addr 172.21.15.79:0/1841025111 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8effff700 1 -- 172.21.15.79:0/1841025111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0009550 con 0x7ff8f0105b70 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8effff700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0199920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0006ba0 tx=0x7ff8e0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.316+0000 7ff8ed7fa700 1 -- 172.21.15.79:0/1841025111 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8e0003b00 con 0x7ff8f0105b70 2024-09-10T09:27:39.012 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.317+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f019a060 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.317+0000 7ff8ed7fa700 1 -- 172.21.15.79:0/1841025111 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff8e001a8e0 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.317+0000 7ff8ed7fa700 1 -- 172.21.15.79:0/1841025111 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8e00199c0 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.317+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f019a480 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.317+0000 7ff8ed7fa700 1 -- 172.21.15.79:0/1841025111 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7ff8e0019c80 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.318+0000 7ff8ed7fa700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8dc0383f0 0x7ff8dc03a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.318+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f0062380 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.318+0000 7ff8ed7fa700 1 -- 172.21.15.79:0/1841025111 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ff8e004c9c0 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.318+0000 7ff8ef7fe700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8dc0383f0 0x7ff8dc03a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.318+0000 7ff8ef7fe700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8dc0383f0 0x7ff8dc03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8006fd0 tx=0x7ff8d8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.322+0000 7ff8ed7fa700 1 -- 172.21.15.79:0/1841025111 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff8e002b930 con 0x7ff8f0105b70 2024-09-10T09:27:39.013 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.534+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff8f010a040 con 0x7ff8dc0383f0 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.757+0000 7ff8ed7fa700 1 -- 172.21.15.79:0/1841025111 <== mgr.14164 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff8d8009e20 con 0x7ff8dc0383f0 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.759+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8dc0383f0 msgr2=0x7ff8dc03a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.759+0000 7ff8f6a30700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8dc0383f0 0x7ff8dc03a8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8006fd0 tx=0x7ff8d8006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.759+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 msgr2=0x7ff8f0199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.759+0000 7ff8f6a30700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0199920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0006ba0 tx=0x7ff8e0011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.760+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 shutdown_connections 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.760+0000 7ff8f6a30700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8dc0383f0 0x7ff8dc03a8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.760+0000 7ff8f6a30700 1 --2- 172.21.15.79:0/1841025111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f0105b70 0x7ff8f0199920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.760+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 >> 172.21.15.79:0/1841025111 conn(0x7ff8f0101220 msgr2=0x7ff8f01028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.760+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 shutdown_connections 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:37.760+0000 7ff8f6a30700 1 -- 172.21.15.79:0/1841025111 wait complete. 2024-09-10T09:27:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:Fetching dashboard port number... 2024-09-10T09:27:39.347 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:39 smithi079 ceph-mon[27592]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:40.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:40 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/442883669' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T09:27:40.308 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T09:27:40.308 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.445+0000 7f58c01a6700 1 Processor -- start 2024-09-10T09:27:40.308 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.445+0000 7f58c01a6700 1 -- start start 2024-09-10T09:27:40.308 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58c01a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b8106470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58c01a6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b81069b0 con 0x7f58b8106060 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bdf42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b8106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bdf42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b8106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45988/0 (socket says 172.21.15.79:45988) 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bdf42700 1 -- 172.21.15.79:0/4212309650 learned_addr learned my addr 172.21.15.79:0/4212309650 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bdf42700 1 -- 172.21.15.79:0/4212309650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8106af0 con 0x7f58b8106060 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bdf42700 1 --2- 172.21.15.79:0/4212309650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b8106470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f58a800bb40 tx=0x7f58a800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a748cff49d78f2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bcf40700 1 -- 172.21.15.79:0/4212309650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58a800dc00 con 0x7f58b8106060 2024-09-10T09:27:40.309 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bcf40700 1 -- 172.21.15.79:0/4212309650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58a80044e0 con 0x7f58b8106060 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.446+0000 7f58bcf40700 1 -- 172.21.15.79:0/4212309650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58a8010470 con 0x7f58b8106060 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.447+0000 7f58c01a6700 1 -- 172.21.15.79:0/4212309650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 msgr2=0x7f58b8106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.447+0000 7f58c01a6700 1 --2- 172.21.15.79:0/4212309650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b8106470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f58a800bb40 tx=0x7f58a800be50 comp rx=0 tx=0).stop 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.447+0000 7f58c01a6700 1 -- 172.21.15.79:0/4212309650 shutdown_connections 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.447+0000 7f58c01a6700 1 --2- 172.21.15.79:0/4212309650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b8106470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.447+0000 7f58c01a6700 1 -- 172.21.15.79:0/4212309650 >> 172.21.15.79:0/4212309650 conn(0x7f58b80ff870 msgr2=0x7f58b8101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.447+0000 7f58c01a6700 1 -- 172.21.15.79:0/4212309650 shutdown_connections 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.447+0000 7f58c01a6700 1 -- 172.21.15.79:0/4212309650 wait complete. 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58c01a6700 1 Processor -- start 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58c01a6700 1 -- start start 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58c01a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b81976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58c01a6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b8197c30 con 0x7f58b8106060 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58bdf42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b81976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:40.310 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58bdf42700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b81976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45990/0 (socket says 172.21.15.79:45990) 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58bdf42700 1 -- 172.21.15.79:0/442883669 learned_addr learned my addr 172.21.15.79:0/442883669 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58bdf42700 1 -- 172.21.15.79:0/442883669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a800b7f0 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58bdf42700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b81976f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58a8003fc0 tx=0x7f58a80040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58aeffd700 1 -- 172.21.15.79:0/442883669 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58a801e070 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58aeffd700 1 -- 172.21.15.79:0/442883669 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58a800de20 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.448+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b8197e30 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.449+0000 7f58aeffd700 1 -- 172.21.15.79:0/442883669 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58a8022b10 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.449+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b8198250 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.449+0000 7f58aeffd700 1 -- 172.21.15.79:0/442883669 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 12) v1 ==== 45097+0+0 (secure 0 0 0) 0x7f58a8022d50 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.449+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b81913b0 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.450+0000 7f58aeffd700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f58a40383f0 0x7f58a403a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.450+0000 7f58aeffd700 1 -- 172.21.15.79:0/442883669 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f58a804e700 con 0x7f58b8106060 2024-09-10T09:27:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.450+0000 7f58bd741700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f58a40383f0 0x7f58a403a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.450+0000 7f58bd741700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f58a40383f0 0x7f58a403a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f58b4006fd0 tx=0x7f58b4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.454+0000 7f58aeffd700 1 -- 172.21.15.79:0/442883669 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f58a8021590 con 0x7f58b8106060 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.643+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f58b802cf30 con 0x7f58b8106060 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.644+0000 7f58aeffd700 1 -- 172.21.15.79:0/442883669 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f58a8027030 con 0x7f58b8106060 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f58a40383f0 msgr2=0x7f58a403a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f58a40383f0 0x7f58a403a8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f58b4006fd0 tx=0x7f58b4006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 msgr2=0x7f58b81976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b81976f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58a8003fc0 tx=0x7f58a80040a0 comp rx=0 tx=0).stop 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 shutdown_connections 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f58a40383f0 0x7f58a403a8a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 --2- 172.21.15.79:0/442883669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58b8106060 0x7f58b81976f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 >> 172.21.15.79:0/442883669 conn(0x7f58b80ff870 msgr2=0x7f58b818e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 shutdown_connections 2024-09-10T09:27:40.313 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:39.646+0000 7f58c01a6700 1 -- 172.21.15.79:0/442883669 wait complete. 2024-09-10T09:27:40.315 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T09:27:40.315 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout disabled 2024-09-10T09:27:40.322 INFO:teuthology.orchestra.run.smithi079.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T09:27:40.322 INFO:teuthology.orchestra.run.smithi079.stdout:systemctl: stdout inactive 2024-09-10T09:27:40.322 INFO:teuthology.orchestra.run.smithi079.stdout:firewalld.service is not enabled 2024-09-10T09:27:40.322 INFO:teuthology.orchestra.run.smithi079.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T09:27:40.324 INFO:teuthology.orchestra.run.smithi079.stdout:Ceph Dashboard is now available at: 2024-09-10T09:27:40.324 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:40.324 INFO:teuthology.orchestra.run.smithi079.stdout: URL: https://smithi079.front.sepia.ceph.com:8443/ 2024-09-10T09:27:40.324 INFO:teuthology.orchestra.run.smithi079.stdout: User: admin 2024-09-10T09:27:40.324 INFO:teuthology.orchestra.run.smithi079.stdout: Password: dcq6383nne 2024-09-10T09:27:40.324 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:40.325 INFO:teuthology.orchestra.run.smithi079.stdout:Saving cluster configuration to /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config directory 2024-09-10T09:27:40.325 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling autotune for osd_memory_target 2024-09-10T09:27:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:41 smithi079 ceph-mon[27592]: mgrmap e13: smithi079.mhirny(active, since 6s) 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.755+0000 7f2fbe542700 1 Processor -- start 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.755+0000 7f2fbe542700 1 -- start start 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.755+0000 7f2fbe542700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb8105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.755+0000 7f2fbe542700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb81064c0 con 0x7f2fb8105b70 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.755+0000 7f2fb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb8105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.755+0000 7f2fb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb8105f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45994/0 (socket says 172.21.15.79:45994) 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.755+0000 7f2fb7fff700 1 -- 172.21.15.79:0/50809058 learned_addr learned my addr 172.21.15.79:0/50809058 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:41.490 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.756+0000 7f2fb7fff700 1 -- 172.21.15.79:0/50809058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8106600 con 0x7f2fb8105b70 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.756+0000 7f2fb7fff700 1 --2- 172.21.15.79:0/50809058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb8105f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80098a0 tx=0x7f2fa8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18645a63e743a794 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.756+0000 7f2fb6ffd700 1 -- 172.21.15.79:0/50809058 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa8004180 con 0x7f2fb8105b70 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.756+0000 7f2fb6ffd700 1 -- 172.21.15.79:0/50809058 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2fa80042e0 con 0x7f2fb8105b70 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.756+0000 7f2fb6ffd700 1 -- 172.21.15.79:0/50809058 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa8011af0 con 0x7f2fb8105b70 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.756+0000 7f2fbe542700 1 -- 172.21.15.79:0/50809058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 msgr2=0x7f2fb8105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 --2- 172.21.15.79:0/50809058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb8105f80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80098a0 tx=0x7f2fa8009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 -- 172.21.15.79:0/50809058 shutdown_connections 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 --2- 172.21.15.79:0/50809058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb8105f80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 -- 172.21.15.79:0/50809058 >> 172.21.15.79:0/50809058 conn(0x7f2fb8101220 msgr2=0x7f2fb8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 -- 172.21.15.79:0/50809058 shutdown_connections 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 -- 172.21.15.79:0/50809058 wait complete. 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 Processor -- start 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.757+0000 7f2fbe542700 1 -- start start 2024-09-10T09:27:41.491 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fbe542700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fbe542700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb8199e30 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb81998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46002/0 (socket says 172.21.15.79:46002) 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb7fff700 1 -- 172.21.15.79:0/181382728 learned_addr learned my addr 172.21.15.79:0/181382728 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb7fff700 1 -- 172.21.15.79:0/181382728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8009550 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb7fff700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb81998f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8006ba0 tx=0x7f2fa8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb57fa700 1 -- 172.21.15.79:0/181382728 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa8003b00 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb819a030 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb57fa700 1 -- 172.21.15.79:0/181382728 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2fa801a8e0 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fb57fa700 1 -- 172.21.15.79:0/181382728 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fa80199c0 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.758+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb819a450 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.759+0000 7f2fb57fa700 1 -- 172.21.15.79:0/181382728 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f2fa8019c30 con 0x7f2fb8105b70 2024-09-10T09:27:41.492 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.759+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb810a000 con 0x7f2fb8105b70 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.759+0000 7f2fb57fa700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fa00384e0 0x7f2fa003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.759+0000 7f2fb57fa700 1 -- 172.21.15.79:0/181382728 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f2fa804ca50 con 0x7f2fb8105b70 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.760+0000 7f2fb77fe700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fa00384e0 0x7f2fa003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.760+0000 7f2fb77fe700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fa00384e0 0x7f2fa003a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006fd0 tx=0x7f2fac006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.764+0000 7f2fb57fa700 1 -- 172.21.15.79:0/181382728 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2fa802b520 con 0x7f2fb8105b70 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.952+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f2fb819d2b0 con 0x7f2fb8105b70 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.952+0000 7f2fb57fa700 1 -- 172.21.15.79:0/181382728 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f2fa8023a00 con 0x7f2fb8105b70 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.954+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fa00384e0 msgr2=0x7f2fa003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.954+0000 7f2fbe542700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fa00384e0 0x7f2fa003a990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006fd0 tx=0x7f2fac006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.954+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 msgr2=0x7f2fb81998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.954+0000 7f2fbe542700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb81998f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8006ba0 tx=0x7f2fa8011b50 comp rx=0 tx=0).stop 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.955+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 shutdown_connections 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.955+0000 7f2fbe542700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fa00384e0 0x7f2fa003a990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.955+0000 7f2fbe542700 1 --2- 172.21.15.79:0/181382728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fb8105b70 0x7f2fb81998f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.955+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 >> 172.21.15.79:0/181382728 conn(0x7f2fb8101220 msgr2=0x7f2fb8101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.955+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 shutdown_connections 2024-09-10T09:27:41.494 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:40.955+0000 7f2fbe542700 1 -- 172.21.15.79:0/181382728 wait complete. 2024-09-10T09:27:42.879 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.934+0000 7f8eb2c9e700 1 Processor -- start 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.934+0000 7f8eb2c9e700 1 -- start start 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.934+0000 7f8eb2c9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac104e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.934+0000 7f8eb2c9e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac1053d0 con 0x7f8eac104a80 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.934+0000 7f8eb0a3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.934+0000 7f8eb0a3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac104e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46018/0 (socket says 172.21.15.79:46018) 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.934+0000 7f8eb0a3a700 1 -- 172.21.15.79:0/2027533895 learned_addr learned my addr 172.21.15.79:0/2027533895 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.935+0000 7f8eb0a3a700 1 -- 172.21.15.79:0/2027533895 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac105510 con 0x7f8eac104a80 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.935+0000 7f8eb0a3a700 1 --2- 172.21.15.79:0/2027533895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac104e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00098a0 tx=0x7f8ea0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cc332197323853 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.935+0000 7f8eab7fe700 1 -- 172.21.15.79:0/2027533895 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea0004180 con 0x7f8eac104a80 2024-09-10T09:27:42.880 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.935+0000 7f8eab7fe700 1 -- 172.21.15.79:0/2027533895 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ea00042e0 con 0x7f8eac104a80 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.935+0000 7f8eab7fe700 1 -- 172.21.15.79:0/2027533895 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea0011af0 con 0x7f8eac104a80 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/2027533895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 msgr2=0x7f8eac104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 --2- 172.21.15.79:0/2027533895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac104e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00098a0 tx=0x7f8ea0009bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/2027533895 shutdown_connections 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 --2- 172.21.15.79:0/2027533895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac104e90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/2027533895 >> 172.21.15.79:0/2027533895 conn(0x7f8eac1000f0 msgr2=0x7f8eac102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/2027533895 shutdown_connections 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/2027533895 wait complete. 2024-09-10T09:27:42.881 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 Processor -- start 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 -- start start 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.936+0000 7f8eb2c9e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac198d50 con 0x7f8eac104a80 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8eb0a3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8eb0a3a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46026/0 (socket says 172.21.15.79:46026) 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8eb0a3a700 1 -- 172.21.15.79:0/3706577616 learned_addr learned my addr 172.21.15.79:0/3706577616 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8eb0a3a700 1 -- 172.21.15.79:0/3706577616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0009550 con 0x7f8eac104a80 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8eb0a3a700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac198810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0011ad0 tx=0x7f8ea0011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8ea9ffb700 1 -- 172.21.15.79:0/3706577616 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea0003ab0 con 0x7f8eac104a80 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8ea9ffb700 1 -- 172.21.15.79:0/3706577616 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ea0003c10 con 0x7f8eac104a80 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac198f50 con 0x7f8eac104a80 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8ea9ffb700 1 -- 172.21.15.79:0/3706577616 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ea00198e0 con 0x7f8eac104a80 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.937+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac199370 con 0x7f8eac104a80 2024-09-10T09:27:42.882 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.938+0000 7f8ea9ffb700 1 -- 172.21.15.79:0/3706577616 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f8ea0019b50 con 0x7f8eac104a80 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.938+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac108f10 con 0x7f8eac104a80 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.938+0000 7f8ea9ffb700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8e9c038530 0x7f8e9c03a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.938+0000 7f8ea9ffb700 1 -- 172.21.15.79:0/3706577616 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f8ea004c460 con 0x7f8eac104a80 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.938+0000 7f8eabfff700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8e9c038530 0x7f8e9c03a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.939+0000 7f8eabfff700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8e9c038530 0x7f8e9c03a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006fd0 tx=0x7f8e98006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:41.943+0000 7f8ea9ffb700 1 -- 172.21.15.79:0/3706577616 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8ea000bc80 con 0x7f8eac104a80 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.237+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f8eac0623d0 con 0x7f8eac104a80 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.239+0000 7f8ea9ffb700 1 -- 172.21.15.79:0/3706577616 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8ea0010b70 con 0x7f8eac104a80 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8e9c038530 msgr2=0x7f8e9c03a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8e9c038530 0x7f8e9c03a9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006fd0 tx=0x7f8e98006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 msgr2=0x7f8eac198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac198810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0011ad0 tx=0x7f8ea0011bb0 comp rx=0 tx=0).stop 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 shutdown_connections 2024-09-10T09:27:42.883 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8e9c038530 0x7f8e9c03a9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 --2- 172.21.15.79:0/3706577616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eac104a80 0x7f8eac198810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 >> 172.21.15.79:0/3706577616 conn(0x7f8eac1000f0 msgr2=0x7f8eac101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 shutdown_connections 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr 2024-09-10T09:27:42.241+0000 7f8eb2c9e700 1 -- 172.21.15.79:0/3706577616 wait complete. 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.884 INFO:teuthology.orchestra.run.smithi079.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: ceph telemetry on 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout:For more information see: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:42.885 INFO:teuthology.orchestra.run.smithi079.stdout:Bootstrap complete. 2024-09-10T09:27:42.911 INFO:tasks.cephadm:Fetching config... 2024-09-10T09:27:42.911 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:27:42.911 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T09:27:42.927 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T09:27:42.927 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:27:42.927 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T09:27:42.983 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T09:27:42.983 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:27:42.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/keyring of=/dev/stdout 2024-09-10T09:27:43.048 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T09:27:43.048 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:27:43.048 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T09:27:43.104 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T09:27:43.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC991zda5odyL4outsYLssTPqMBgMC5SzQlJvV+LxWXSITC07RaGWK2gA/AbdZ5wpYRmEjcIU5Ht8q54C45BjuX77w5xv+ejLxG8bFy5IwXCUesPyIJucv+MRbkH3IMYb/uT7sp+ecMcsOfO1tT+Qnmy43We3n3QL+RAmFvdMMew+mCGtGS2m4XPEh9U+iJNBKGNToAq+kRNTEPR1U63/9EITAl4mKBG9unJuA8wJ20CLeQ60UwKuZaJnRgRgMq1abxdjtUgQnUFmCl+F16Mqf3Xs2C8ZZHVMjzeiXtLA78VKzm2E5MEzLQkGVYy+Zc8VVn5vNSwN+115QOpDBWEEbOD9DgsZD+5tkeSDOaWJ7r8a58Sql3RtwI7x3/421Kxaz2KxUaPlpiQDiDX8wLx+xlxMGVpwqMzBAnj424+34C9gO0DVeJz5p1Dr0Gcp5IdkGn3ZqDS2bMFxo9sZ7D1xHN6RuBj9ANTAcYZnpKA2dTJIUPhCYUusDJZ9JZEThSVLc= ceph-afb60aa6-6f56-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T09:27:43.180 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC991zda5odyL4outsYLssTPqMBgMC5SzQlJvV+LxWXSITC07RaGWK2gA/AbdZ5wpYRmEjcIU5Ht8q54C45BjuX77w5xv+ejLxG8bFy5IwXCUesPyIJucv+MRbkH3IMYb/uT7sp+ecMcsOfO1tT+Qnmy43We3n3QL+RAmFvdMMew+mCGtGS2m4XPEh9U+iJNBKGNToAq+kRNTEPR1U63/9EITAl4mKBG9unJuA8wJ20CLeQ60UwKuZaJnRgRgMq1abxdjtUgQnUFmCl+F16Mqf3Xs2C8ZZHVMjzeiXtLA78VKzm2E5MEzLQkGVYy+Zc8VVn5vNSwN+115QOpDBWEEbOD9DgsZD+5tkeSDOaWJ7r8a58Sql3RtwI7x3/421Kxaz2KxUaPlpiQDiDX8wLx+xlxMGVpwqMzBAnj424+34C9gO0DVeJz5p1Dr0Gcp5IdkGn3ZqDS2bMFxo9sZ7D1xHN6RuBj9ANTAcYZnpKA2dTJIUPhCYUusDJZ9JZEThSVLc= ceph-afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:27:43.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC991zda5odyL4outsYLssTPqMBgMC5SzQlJvV+LxWXSITC07RaGWK2gA/AbdZ5wpYRmEjcIU5Ht8q54C45BjuX77w5xv+ejLxG8bFy5IwXCUesPyIJucv+MRbkH3IMYb/uT7sp+ecMcsOfO1tT+Qnmy43We3n3QL+RAmFvdMMew+mCGtGS2m4XPEh9U+iJNBKGNToAq+kRNTEPR1U63/9EITAl4mKBG9unJuA8wJ20CLeQ60UwKuZaJnRgRgMq1abxdjtUgQnUFmCl+F16Mqf3Xs2C8ZZHVMjzeiXtLA78VKzm2E5MEzLQkGVYy+Zc8VVn5vNSwN+115QOpDBWEEbOD9DgsZD+5tkeSDOaWJ7r8a58Sql3RtwI7x3/421Kxaz2KxUaPlpiQDiDX8wLx+xlxMGVpwqMzBAnj424+34C9gO0DVeJz5p1Dr0Gcp5IdkGn3ZqDS2bMFxo9sZ7D1xHN6RuBj9ANTAcYZnpKA2dTJIUPhCYUusDJZ9JZEThSVLc= ceph-afb60aa6-6f56-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T09:27:43.327 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC991zda5odyL4outsYLssTPqMBgMC5SzQlJvV+LxWXSITC07RaGWK2gA/AbdZ5wpYRmEjcIU5Ht8q54C45BjuX77w5xv+ejLxG8bFy5IwXCUesPyIJucv+MRbkH3IMYb/uT7sp+ecMcsOfO1tT+Qnmy43We3n3QL+RAmFvdMMew+mCGtGS2m4XPEh9U+iJNBKGNToAq+kRNTEPR1U63/9EITAl4mKBG9unJuA8wJ20CLeQ60UwKuZaJnRgRgMq1abxdjtUgQnUFmCl+F16Mqf3Xs2C8ZZHVMjzeiXtLA78VKzm2E5MEzLQkGVYy+Zc8VVn5vNSwN+115QOpDBWEEbOD9DgsZD+5tkeSDOaWJ7r8a58Sql3RtwI7x3/421Kxaz2KxUaPlpiQDiDX8wLx+xlxMGVpwqMzBAnj424+34C9gO0DVeJz5p1Dr0Gcp5IdkGn3ZqDS2bMFxo9sZ7D1xHN6RuBj9ANTAcYZnpKA2dTJIUPhCYUusDJZ9JZEThSVLc= ceph-afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:27:43.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T09:27:43.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:43 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3706577616' entity='client.admin' 2024-09-10T09:27:43.542 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.642+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/2715746217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 msgr2=0x7f2ff00ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.642+0000 7f2ff5d5a700 1 --2- 172.21.15.79:0/2715746217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff00ff130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b0a0 tx=0x7f2fe000b3b0 comp rx=0 tx=0).stop 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.642+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/2715746217 shutdown_connections 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.642+0000 7f2ff5d5a700 1 --2- 172.21.15.79:0/2715746217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff00ff130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.642+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/2715746217 >> 172.21.15.79:0/2715746217 conn(0x7f2ff00fa2b0 msgr2=0x7f2ff00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.642+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/2715746217 shutdown_connections 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.642+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/2715746217 wait complete. 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.643+0000 7f2ff5d5a700 1 Processor -- start 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.643+0000 7f2ff5d5a700 1 -- start start 2024-09-10T09:27:45.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.643+0000 7f2ff5d5a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.643+0000 7f2ff5d5a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff01976e0 con 0x7f2ff00fed20 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.643+0000 7f2fef7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.643+0000 7f2fef7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff01971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44058/0 (socket says 172.21.15.79:44058) 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.643+0000 7f2fef7fe700 1 -- 172.21.15.79:0/3785145424 learned_addr learned my addr 172.21.15.79:0/3785145424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.644+0000 7f2fef7fe700 1 -- 172.21.15.79:0/3785145424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0009d00 con 0x7f2ff00fed20 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.644+0000 7f2fef7fe700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff01971a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b830 tx=0x7f2fe000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.644+0000 7f2fecff9700 1 -- 172.21.15.79:0/3785145424 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fe000e040 con 0x7f2ff00fed20 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.644+0000 7f2fecff9700 1 -- 172.21.15.79:0/3785145424 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2fe0012af0 con 0x7f2ff00fed20 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.644+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff01978e0 con 0x7f2ff00fed20 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.644+0000 7f2fecff9700 1 -- 172.21.15.79:0/3785145424 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2fe001d9f0 con 0x7f2ff00fed20 2024-09-10T09:27:45.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.644+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff0197d00 con 0x7f2ff00fed20 2024-09-10T09:27:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.645+0000 7f2fecff9700 1 -- 172.21.15.79:0/3785145424 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f2fe001dcb0 con 0x7f2ff00fed20 2024-09-10T09:27:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.645+0000 7f2fecff9700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fd8038490 0x7f2fd803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.645+0000 7f2fecff9700 1 -- 172.21.15.79:0/3785145424 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f2fe004d820 con 0x7f2ff00fed20 2024-09-10T09:27:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.645+0000 7f2feeffd700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fd8038490 0x7f2fd803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:45.647 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.645+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff0190e10 con 0x7f2ff00fed20 2024-09-10T09:27:45.648 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.645+0000 7f2feeffd700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fd8038490 0x7f2fd803a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006fd0 tx=0x7f2fe4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:45.651 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.650+0000 7f2fecff9700 1 -- 172.21.15.79:0/3785145424 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2fe001c3e0 con 0x7f2ff00fed20 2024-09-10T09:27:45.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.845+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2ff002cee0 con 0x7f2ff00fed20 2024-09-10T09:27:45.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.849+0000 7f2fecff9700 1 -- 172.21.15.79:0/3785145424 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2fe0025360 con 0x7f2ff00fed20 2024-09-10T09:27:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fd8038490 msgr2=0x7f2fd803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fd8038490 0x7f2fd803a940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4006fd0 tx=0x7f2fe4006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 msgr2=0x7f2ff01971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:45.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff01971a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000b830 tx=0x7f2fe000bd40 comp rx=0 tx=0).stop 2024-09-10T09:27:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 shutdown_connections 2024-09-10T09:27:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2fd8038490 0x7f2fd803a940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 --2- 172.21.15.79:0/3785145424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2ff00fed20 0x7f2ff01971a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 >> 172.21.15.79:0/3785145424 conn(0x7f2ff00fa2b0 msgr2=0x7f2ff00690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 shutdown_connections 2024-09-10T09:27:45.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:45.851+0000 7f2ff5d5a700 1 -- 172.21.15.79:0/3785145424 wait complete. 2024-09-10T09:27:45.872 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:45.873 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:45.873 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:27:45.873 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:45.873 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:27:45.873 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T09:27:45.873 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:27:45.873 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:45 smithi079 ceph-mon[27592]: Deploying daemon ceph-exporter.smithi079 on smithi079 2024-09-10T09:27:46.480 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T09:27:46.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T09:27:46.785 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:27:47.011 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:46 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3785145424' entity='client.admin' 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.921+0000 7f4dac5f6700 1 -- 172.21.15.79:0/586766921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 msgr2=0x7f4da40ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.921+0000 7f4dac5f6700 1 --2- 172.21.15.79:0/586766921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da40ff130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009910 tx=0x7f4da0009c20 comp rx=0 tx=0).stop 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 -- 172.21.15.79:0/586766921 shutdown_connections 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 --2- 172.21.15.79:0/586766921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da40ff130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 -- 172.21.15.79:0/586766921 >> 172.21.15.79:0/586766921 conn(0x7f4da40fa2b0 msgr2=0x7f4da40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 -- 172.21.15.79:0/586766921 shutdown_connections 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 -- 172.21.15.79:0/586766921 wait complete. 2024-09-10T09:27:48.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 Processor -- start 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 -- start start 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da4193ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.922+0000 7f4dac5f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da41943e0 con 0x7f4da40fed20 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4daa392700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da4193ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4daa392700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da4193ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44076/0 (socket says 172.21.15.79:44076) 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4daa392700 1 -- 172.21.15.79:0/2249002119 learned_addr learned my addr 172.21.15.79:0/2249002119 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4daa392700 1 -- 172.21.15.79:0/2249002119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da00095f0 con 0x7f4da40fed20 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4daa392700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da4193ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4da0005b40 tx=0x7f4da0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4d9b7fe700 1 -- 172.21.15.79:0/2249002119 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4da001d070 con 0x7f4da40fed20 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da41945e0 con 0x7f4da40fed20 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4d9b7fe700 1 -- 172.21.15.79:0/2249002119 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4da000be10 con 0x7f4da40fed20 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4d9b7fe700 1 -- 172.21.15.79:0/2249002119 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4da000f460 con 0x7f4da40fed20 2024-09-10T09:27:48.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.923+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da4194a80 con 0x7f4da40fed20 2024-09-10T09:27:48.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.924+0000 7f4d9b7fe700 1 -- 172.21.15.79:0/2249002119 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f4da00227e0 con 0x7f4da40fed20 2024-09-10T09:27:48.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.924+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da418da00 con 0x7f4da40fed20 2024-09-10T09:27:48.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.924+0000 7f4d9b7fe700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d90038490 0x7f4d9003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:48.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.924+0000 7f4d9b7fe700 1 -- 172.21.15.79:0/2249002119 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f4da004c390 con 0x7f4da40fed20 2024-09-10T09:27:48.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.924+0000 7f4da9b91700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d90038490 0x7f4d9003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:48.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.925+0000 7f4da9b91700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d90038490 0x7f4d9003a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d94006fd0 tx=0x7f4d94006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:48.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:48.929+0000 7f4d9b7fe700 1 -- 172.21.15.79:0/2249002119 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4da002bba0 con 0x7f4da40fed20 2024-09-10T09:27:49.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.128+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f4da4061220 con 0x7f4d90038490 2024-09-10T09:27:49.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.132+0000 7f4d9b7fe700 1 -- 172.21.15.79:0/2249002119 <== mgr.14164 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4da4061220 con 0x7f4d90038490 2024-09-10T09:27:49.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.133+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d90038490 msgr2=0x7f4d9003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.133+0000 7f4dac5f6700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d90038490 0x7f4d9003a940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d94006fd0 tx=0x7f4d94006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 msgr2=0x7f4da4193ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da4193ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4da0005b40 tx=0x7f4da0004740 comp rx=0 tx=0).stop 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 shutdown_connections 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d90038490 0x7f4d9003a940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 --2- 172.21.15.79:0/2249002119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4da40fed20 0x7f4da4193ea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 >> 172.21.15.79:0/2249002119 conn(0x7f4da40fa2b0 msgr2=0x7f4da40faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 shutdown_connections 2024-09-10T09:27:49.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:49.134+0000 7f4dac5f6700 1 -- 172.21.15.79:0/2249002119 wait complete. 2024-09-10T09:27:50.328 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:50 smithi079 ceph-mon[27592]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:50.328 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:50 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:50.745 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2024-09-10T09:27:50.745 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:27:50.746 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2024-09-10T09:27:50.764 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:27:50.764 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:27:50.823 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2024-09-10T09:27:50.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch host add smithi135 2024-09-10T09:27:51.277 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:27:52.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:52.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:52.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:52.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:52.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:27:52.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T09:27:52.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:27:52.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:52 smithi079 ceph-mon[27592]: Deploying daemon crash.smithi079 on smithi079 2024-09-10T09:27:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.873+0000 7ffbd448f700 1 -- 172.21.15.79:0/2216286101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 msgr2=0x7ffbcc0ff120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.873+0000 7ffbd448f700 1 --2- 172.21.15.79:0/2216286101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0ff120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009910 tx=0x7ffbc0009c20 comp rx=0 tx=0).stop 2024-09-10T09:27:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.873+0000 7ffbd448f700 1 -- 172.21.15.79:0/2216286101 shutdown_connections 2024-09-10T09:27:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.873+0000 7ffbd448f700 1 --2- 172.21.15.79:0/2216286101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0ff120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.873+0000 7ffbd448f700 1 -- 172.21.15.79:0/2216286101 >> 172.21.15.79:0/2216286101 conn(0x7ffbcc0fa360 msgr2=0x7ffbcc0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.873+0000 7ffbd448f700 1 -- 172.21.15.79:0/2216286101 shutdown_connections 2024-09-10T09:27:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.873+0000 7ffbd448f700 1 -- 172.21.15.79:0/2216286101 wait complete. 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd448f700 1 Processor -- start 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd448f700 1 -- start start 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd448f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd448f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc197cb0 con 0x7ffbcc0fed10 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd222b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd222b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42684/0 (socket says 172.21.15.79:42684) 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd222b700 1 -- 172.21.15.79:0/36690794 learned_addr learned my addr 172.21.15.79:0/36690794 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.874+0000 7ffbd222b700 1 -- 172.21.15.79:0/36690794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc00095f0 con 0x7ffbcc0fed10 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.875+0000 7ffbd222b700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0693a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005b40 tx=0x7ffbc0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.875+0000 7ffbbf7fe700 1 -- 172.21.15.79:0/36690794 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc001d070 con 0x7ffbcc0fed10 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.875+0000 7ffbbf7fe700 1 -- 172.21.15.79:0/36690794 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffbc000be10 con 0x7ffbcc0fed10 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.875+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc197df0 con 0x7ffbcc0fed10 2024-09-10T09:27:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.875+0000 7ffbbf7fe700 1 -- 172.21.15.79:0/36690794 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbc000f460 con 0x7ffbcc0fed10 2024-09-10T09:27:52.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.875+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc198290 con 0x7ffbcc0fed10 2024-09-10T09:27:52.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.876+0000 7ffbbf7fe700 1 -- 172.21.15.79:0/36690794 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ffbc000f6d0 con 0x7ffbcc0fed10 2024-09-10T09:27:52.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.876+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc18d970 con 0x7ffbcc0fed10 2024-09-10T09:27:52.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.876+0000 7ffbbf7fe700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:52.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.876+0000 7ffbbf7fe700 1 -- 172.21.15.79:0/36690794 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ffbc004c5b0 con 0x7ffbcc0fed10 2024-09-10T09:27:52.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.876+0000 7ffbd1a2a700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:52.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.876+0000 7ffbd1a2a700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ffbb8038490 0x7ffbb803a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8006fd0 tx=0x7ffbc8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:52.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:52.881+0000 7ffbbf7fe700 1 -- 172.21.15.79:0/36690794 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ffbc002a360 con 0x7ffbcc0fed10 2024-09-10T09:27:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:53.084+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbcc061190 con 0x7ffbb8038490 2024-09-10T09:27:53.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:53 smithi079 ceph-mon[27592]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:27:55.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:54 smithi079 ceph-mon[27592]: Deploying cephadm binary to smithi135 2024-09-10T09:27:55.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:54 smithi079 ceph-mon[27592]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:27:55.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:54 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:55.462 INFO:teuthology.orchestra.run.smithi079.stdout:Added host 'smithi135' with addr '172.21.15.135' 2024-09-10T09:27:55.463 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.460+0000 7ffbbf7fe700 1 -- 172.21.15.79:0/36690794 <== mgr.14164 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ffbcc061190 con 0x7ffbb8038490 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ffbb8038490 msgr2=0x7ffbb803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ffbb8038490 0x7ffbb803a940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8006fd0 tx=0x7ffbc8006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 msgr2=0x7ffbcc0693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0693a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005b40 tx=0x7ffbc0004740 comp rx=0 tx=0).stop 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 shutdown_connections 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ffbb8038490 0x7ffbb803a940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 --2- 172.21.15.79:0/36690794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffbcc0fed10 0x7ffbcc0693a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 >> 172.21.15.79:0/36690794 conn(0x7ffbcc0fa360 msgr2=0x7ffbcc0fb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 shutdown_connections 2024-09-10T09:27:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:55.463+0000 7ffbd448f700 1 -- 172.21.15.79:0/36690794 wait complete. 2024-09-10T09:27:55.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:55 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:55.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:55 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:55.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:55 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:55.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:55 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:55.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:55 smithi079 ceph-mon[27592]: Deploying daemon node-exporter.smithi079 on smithi079 2024-09-10T09:27:55.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:55 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:27:56.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T09:27:56.279 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:27:56.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:56 smithi079 ceph-mon[27592]: Added host smithi135 2024-09-10T09:27:56.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:56 smithi079 ceph-mon[27592]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.956+0000 7f2c4c179700 1 -- 172.21.15.79:0/1627569843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 msgr2=0x7f2c440fe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.956+0000 7f2c4c179700 1 --2- 172.21.15.79:0/1627569843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c440fe8b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009910 tx=0x7f2c40009c20 comp rx=0 tx=0).stop 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.956+0000 7f2c4c179700 1 -- 172.21.15.79:0/1627569843 shutdown_connections 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.956+0000 7f2c4c179700 1 --2- 172.21.15.79:0/1627569843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c440fe8b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.956+0000 7f2c4c179700 1 -- 172.21.15.79:0/1627569843 >> 172.21.15.79:0/1627569843 conn(0x7f2c440f9a50 msgr2=0x7f2c440fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.957+0000 7f2c4c179700 1 -- 172.21.15.79:0/1627569843 shutdown_connections 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.957+0000 7f2c4c179700 1 -- 172.21.15.79:0/1627569843 wait complete. 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.957+0000 7f2c4c179700 1 Processor -- start 2024-09-10T09:27:59.019 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.957+0000 7f2c4c179700 1 -- start start 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c4c179700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c44193eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c4c179700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c441943f0 con 0x7f2c440fe4a0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c49f15700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c44193eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c49f15700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c44193eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42722/0 (socket says 172.21.15.79:42722) 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c49f15700 1 -- 172.21.15.79:0/2895062830 learned_addr learned my addr 172.21.15.79:0/2895062830 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c49f15700 1 -- 172.21.15.79:0/2895062830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400095f0 con 0x7f2c440fe4a0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c49f15700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c44193eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c40005950 tx=0x7f2c40009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c3affd700 1 -- 172.21.15.79:0/2895062830 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c4001d070 con 0x7f2c440fe4a0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c3affd700 1 -- 172.21.15.79:0/2895062830 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c4000be10 con 0x7f2c440fe4a0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c441945f0 con 0x7f2c440fe4a0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c3affd700 1 -- 172.21.15.79:0/2895062830 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c4000f460 con 0x7f2c440fe4a0 2024-09-10T09:27:59.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.958+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c44194a90 con 0x7f2c440fe4a0 2024-09-10T09:27:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.959+0000 7f2c3affd700 1 -- 172.21.15.79:0/2895062830 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f2c4000f5c0 con 0x7f2c440fe4a0 2024-09-10T09:27:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.959+0000 7f2c3affd700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2c300384e0 0x7f2c3003a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:27:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.959+0000 7f2c3affd700 1 -- 172.21.15.79:0/2895062830 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f2c4004c3f0 con 0x7f2c440fe4a0 2024-09-10T09:27:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.960+0000 7f2c49714700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2c300384e0 0x7f2c3003a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:27:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.960+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4418e290 con 0x7f2c440fe4a0 2024-09-10T09:27:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.960+0000 7f2c49714700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2c300384e0 0x7f2c3003a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2c34006fd0 tx=0x7f2c34006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:27:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:58.964+0000 7f2c3affd700 1 -- 172.21.15.79:0/2895062830 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2c40027070 con 0x7f2c440fe4a0 2024-09-10T09:27:59.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.174+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c44061190 con 0x7f2c300384e0 2024-09-10T09:27:59.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.176+0000 7f2c3affd700 1 -- 172.21.15.79:0/2895062830 <== mgr.14164 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f2c44061190 con 0x7f2c300384e0 2024-09-10T09:27:59.177 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:27:59.177 INFO:teuthology.orchestra.run.smithi079.stdout:[{"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2024-09-10T09:27:59.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2c300384e0 msgr2=0x7f2c3003a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:59.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2c300384e0 0x7f2c3003a990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2c34006fd0 tx=0x7f2c34006e40 comp rx=0 tx=0).stop 2024-09-10T09:27:59.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 msgr2=0x7f2c44193eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:27:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c44193eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c40005950 tx=0x7f2c40009e60 comp rx=0 tx=0).stop 2024-09-10T09:27:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 shutdown_connections 2024-09-10T09:27:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2c300384e0 0x7f2c3003a990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 --2- 172.21.15.79:0/2895062830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c440fe4a0 0x7f2c44193eb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:27:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.178+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 >> 172.21.15.79:0/2895062830 conn(0x7f2c440f9a50 msgr2=0x7f2c440fa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:27:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.179+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 shutdown_connections 2024-09-10T09:27:59.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:27:59.179+0000 7f2c4c179700 1 -- 172.21.15.79:0/2895062830 wait complete. 2024-09-10T09:27:59.194 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:58 smithi079 ceph-mon[27592]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:27:59.194 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:27:58 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:00.308 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T09:28:00.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T09:28:00.517 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:28:00.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:00 smithi079 ceph-mon[27592]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T09:28:00.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:00 smithi079 ceph-mon[27592]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:00.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:00 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:00.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:00 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:00.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:00 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:00.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:00 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:00.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:00 smithi079 ceph-mon[27592]: Deploying daemon alertmanager.smithi079 on smithi079 2024-09-10T09:28:02.947 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:02 smithi079 ceph-mon[27592]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 -- 172.21.15.79:0/939750866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 msgr2=0x7f23ac100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 --2- 172.21.15.79:0/939750866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac100740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f239c009910 tx=0x7f239c009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 -- 172.21.15.79:0/939750866 shutdown_connections 2024-09-10T09:28:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 --2- 172.21.15.79:0/939750866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac100740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 -- 172.21.15.79:0/939750866 >> 172.21.15.79:0/939750866 conn(0x7f23ac0f9a50 msgr2=0x7f23ac0fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:03.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 -- 172.21.15.79:0/939750866 shutdown_connections 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 -- 172.21.15.79:0/939750866 wait complete. 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.215+0000 7f23b28d0700 1 Processor -- start 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23b28d0700 1 -- start start 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23b28d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23b28d0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac1954e0 con 0x7f23ac100330 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23abfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23abfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52184/0 (socket says 172.21.15.79:52184) 2024-09-10T09:28:03.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23abfff700 1 -- 172.21.15.79:0/2429633310 learned_addr learned my addr 172.21.15.79:0/2429633310 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23abfff700 1 -- 172.21.15.79:0/2429633310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0095f0 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23abfff700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac194fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f239c005950 tx=0x7f239c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23a9ffb700 1 -- 172.21.15.79:0/2429633310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f239c01d070 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23a9ffb700 1 -- 172.21.15.79:0/2429633310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f239c00be10 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac1956e0 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23a9ffb700 1 -- 172.21.15.79:0/2429633310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f239c00f460 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.216+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac195b80 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.217+0000 7f23a9ffb700 1 -- 172.21.15.79:0/2429633310 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f239c0227c0 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.217+0000 7f23a9ffb700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2398038490 0x7f239803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.217+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac18ea20 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.217+0000 7f23a9ffb700 1 -- 172.21.15.79:0/2429633310 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f239c04c3f0 con 0x7f23ac100330 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.217+0000 7f23a3fff700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2398038490 0x7f239803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:03.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.218+0000 7f23a3fff700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2398038490 0x7f239803a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2394006fd0 tx=0x7f2394006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:03.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.222+0000 7f23a9ffb700 1 -- 172.21.15.79:0/2429633310 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f239c00e5d0 con 0x7f23ac100330 2024-09-10T09:28:03.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.420+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f23ac02cc30 con 0x7f23ac100330 2024-09-10T09:28:03.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.851+0000 7f23a9ffb700 1 -- 172.21.15.79:0/2429633310 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f239c017440 con 0x7f23ac100330 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2398038490 msgr2=0x7f239803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2398038490 0x7f239803a940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2394006fd0 tx=0x7f2394006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 msgr2=0x7f23ac194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac194fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f239c005950 tx=0x7f239c009e60 comp rx=0 tx=0).stop 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 shutdown_connections 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2398038490 0x7f239803a940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 --2- 172.21.15.79:0/2429633310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ac100330 0x7f23ac194fa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 >> 172.21.15.79:0/2429633310 conn(0x7f23ac0f9a50 msgr2=0x7f23ac0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:03.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 shutdown_connections 2024-09-10T09:28:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:28:03.853+0000 7f23b28d0700 1 -- 172.21.15.79:0/2429633310 wait complete. 2024-09-10T09:28:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-09-10T09:28:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:03 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2429633310' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T09:28:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:03 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:05.012 INFO:tasks.cephadm:Adding mon.smithi079 on smithi079 2024-09-10T09:28:05.012 INFO:tasks.cephadm:Adding mon.smithi135 on smithi135 2024-09-10T09:28:05.013 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch apply mon '2;smithi079:172.21.15.79=smithi079;smithi135:172.21.15.135=smithi135' 2024-09-10T09:28:05.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:04 smithi079 ceph-mon[27592]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:05.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:04 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2429633310' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T09:28:05.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:04 smithi079 ceph-mon[27592]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T09:28:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:05.311 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:06.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 -- 172.21.15.135:0/1667691388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 msgr2=0x7fcb580ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 --2- 172.21.15.135:0/1667691388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb580ff130 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009910 tx=0x7fcb4c009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 -- 172.21.15.135:0/1667691388 shutdown_connections 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 --2- 172.21.15.135:0/1667691388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb580ff130 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 -- 172.21.15.135:0/1667691388 >> 172.21.15.135:0/1667691388 conn(0x7fcb580fa2b0 msgr2=0x7fcb580fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 -- 172.21.15.135:0/1667691388 shutdown_connections 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 -- 172.21.15.135:0/1667691388 wait complete. 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 Processor -- start 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.763+0000 7fcb60499700 1 -- start start 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.764+0000 7fcb60499700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb58194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.764+0000 7fcb60499700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb581954f0 con 0x7fcb580fed20 2024-09-10T09:28:06.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.764+0000 7fcb5e235700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb58194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.764+0000 7fcb5e235700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb58194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:50768/0 (socket says 172.21.15.135:50768) 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.764+0000 7fcb5e235700 1 -- 172.21.15.135:0/2186117391 learned_addr learned my addr 172.21.15.135:0/2186117391 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.764+0000 7fcb5e235700 1 -- 172.21.15.135:0/2186117391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c0095f0 con 0x7fcb580fed20 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.764+0000 7fcb5e235700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb58194fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c005b40 tx=0x7fcb4c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.765+0000 7fcb4b7fe700 1 -- 172.21.15.135:0/2186117391 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb4c01d070 con 0x7fcb580fed20 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.765+0000 7fcb4b7fe700 1 -- 172.21.15.135:0/2186117391 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb4c00be10 con 0x7fcb580fed20 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.765+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb581956f0 con 0x7fcb580fed20 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.765+0000 7fcb4b7fe700 1 -- 172.21.15.135:0/2186117391 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb4c00f460 con 0x7fcb580fed20 2024-09-10T09:28:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.765+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb58195b90 con 0x7fcb580fed20 2024-09-10T09:28:06.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.765+0000 7fcb4b7fe700 1 -- 172.21.15.135:0/2186117391 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fcb4c0227e0 con 0x7fcb580fed20 2024-09-10T09:28:06.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.765+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5818ea10 con 0x7fcb580fed20 2024-09-10T09:28:06.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.766+0000 7fcb4b7fe700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcb44038490 0x7fcb4403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:06.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.766+0000 7fcb4b7fe700 1 -- 172.21.15.135:0/2186117391 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fcb4c04c450 con 0x7fcb580fed20 2024-09-10T09:28:06.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.766+0000 7fcb5da34700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcb44038490 0x7fcb4403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:06.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.766+0000 7fcb5da34700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcb44038490 0x7fcb4403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcb54006fd0 tx=0x7fcb54006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:06.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.771+0000 7fcb4b7fe700 1 -- 172.21.15.135:0/2186117391 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fcb4c02bba0 con 0x7fcb580fed20 2024-09-10T09:28:06.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.970+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi079:172.21.15.79=smithi079;smithi135:172.21.15.135=smithi135", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb58061300 con 0x7fcb44038490 2024-09-10T09:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.976+0000 7fcb4b7fe700 1 -- 172.21.15.135:0/2186117391 <== mgr.14164 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcb58061300 con 0x7fcb44038490 2024-09-10T09:28:06.978 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mon update... 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcb44038490 msgr2=0x7fcb4403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcb44038490 0x7fcb4403a940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcb54006fd0 tx=0x7fcb54006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 msgr2=0x7fcb58194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb58194fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c005b40 tx=0x7fcb4c004740 comp rx=0 tx=0).stop 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 shutdown_connections 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fcb44038490 0x7fcb4403a940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 --2- 172.21.15.135:0/2186117391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb580fed20 0x7fcb58194fb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 >> 172.21.15.135:0/2186117391 conn(0x7fcb580fa2b0 msgr2=0x7fcb580690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:06.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 shutdown_connections 2024-09-10T09:28:06.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:06.979+0000 7fcb60499700 1 -- 172.21.15.135:0/2186117391 wait complete. 2024-09-10T09:28:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:06 smithi079 ceph-mon[27592]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:07.562 DEBUG:teuthology.orchestra.run.smithi135:mon.smithi135> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi135.service 2024-09-10T09:28:07.565 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:07.565 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:07.784 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:07.828 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:08.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:07 smithi079 ceph-mon[27592]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi079:172.21.15.79=smithi079;smithi135:172.21.15.135=smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:28:08.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:07 smithi079 ceph-mon[27592]: Saving service mon spec with placement smithi079:172.21.15.79=smithi079;smithi135:172.21.15.135=smithi135;count:2 2024-09-10T09:28:08.180 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:07 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:08 smithi079 ceph-mon[27592]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:08 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:08 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:08 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:08 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:09.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.352+0000 7f57f6d22700 1 -- 172.21.15.135:0/2464181147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 msgr2=0x7f57f0100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:09.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.352+0000 7f57f6d22700 1 --2- 172.21.15.135:0/2464181147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0100230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009910 tx=0x7f57e0009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:09.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.352+0000 7f57f6d22700 1 -- 172.21.15.135:0/2464181147 shutdown_connections 2024-09-10T09:28:09.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.352+0000 7f57f6d22700 1 --2- 172.21.15.135:0/2464181147 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0100230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:09.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.352+0000 7f57f6d22700 1 -- 172.21.15.135:0/2464181147 >> 172.21.15.135:0/2464181147 conn(0x7f57f00fb3d0 msgr2=0x7f57f00fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:09.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.352+0000 7f57f6d22700 1 -- 172.21.15.135:0/2464181147 shutdown_connections 2024-09-10T09:28:09.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.352+0000 7f57f6d22700 1 -- 172.21.15.135:0/2464181147 wait complete. 2024-09-10T09:28:09.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.353+0000 7f57f6d22700 1 Processor -- start 2024-09-10T09:28:09.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.353+0000 7f57f6d22700 1 -- start start 2024-09-10T09:28:09.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.353+0000 7f57f6d22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0194f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:09.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.353+0000 7f57f6d22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01954b0 con 0x7f57f00ffe20 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.353+0000 7f57f4abe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0194f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.353+0000 7f57f4abe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0194f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:50792/0 (socket says 172.21.15.135:50792) 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.353+0000 7f57f4abe700 1 -- 172.21.15.135:0/2559331723 learned_addr learned my addr 172.21.15.135:0/2559331723 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.354+0000 7f57f4abe700 1 -- 172.21.15.135:0/2559331723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00095f0 con 0x7f57f00ffe20 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.354+0000 7f57f4abe700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0194f70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57e00092e0 tx=0x7f57e0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.354+0000 7f57e5ffb700 1 -- 172.21.15.135:0/2559331723 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e001d070 con 0x7f57f00ffe20 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.354+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f01956b0 con 0x7f57f00ffe20 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.354+0000 7f57e5ffb700 1 -- 172.21.15.135:0/2559331723 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57e000be10 con 0x7f57f00ffe20 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.354+0000 7f57e5ffb700 1 -- 172.21.15.135:0/2559331723 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e000f460 con 0x7f57f00ffe20 2024-09-10T09:28:09.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.354+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f0195b50 con 0x7f57f00ffe20 2024-09-10T09:28:09.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.355+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f018ea80 con 0x7f57f00ffe20 2024-09-10T09:28:09.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.355+0000 7f57e5ffb700 1 -- 172.21.15.135:0/2559331723 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f57e0022470 con 0x7f57f00ffe20 2024-09-10T09:28:09.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.355+0000 7f57e5ffb700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f57d8038490 0x7f57d803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:09.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.355+0000 7f57e5ffb700 1 -- 172.21.15.135:0/2559331723 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f57e004c350 con 0x7f57f00ffe20 2024-09-10T09:28:09.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.356+0000 7f57e7fff700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f57d8038490 0x7f57d803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:09.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.356+0000 7f57e7fff700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f57d8038490 0x7f57d803a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f57ec006fd0 tx=0x7f57ec006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:09.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.362+0000 7f57e5ffb700 1 -- 172.21.15.135:0/2559331723 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f57e000b960 con 0x7f57f00ffe20 2024-09-10T09:28:09.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.629+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f57f002cc30 con 0x7f57f00ffe20 2024-09-10T09:28:09.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.630+0000 7f57e5ffb700 1 -- 172.21.15.135:0/2559331723 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f57e0027070 con 0x7f57f00ffe20 2024-09-10T09:28:09.631 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:09.631 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:09.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f57d8038490 msgr2=0x7f57d803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:09.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f57d8038490 0x7f57d803a940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f57ec006fd0 tx=0x7f57ec006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:09.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 msgr2=0x7f57f0194f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:09.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0194f70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57e00092e0 tx=0x7f57e0009e60 comp rx=0 tx=0).stop 2024-09-10T09:28:09.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 shutdown_connections 2024-09-10T09:28:09.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f57d8038490 0x7f57d803a940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:09.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 --2- 172.21.15.135:0/2559331723 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57f00ffe20 0x7f57f0194f70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:09.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 >> 172.21.15.135:0/2559331723 conn(0x7f57f00fb3d0 msgr2=0x7f57f00fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:09.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 shutdown_connections 2024-09-10T09:28:09.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:09.633+0000 7f57f6d22700 1 -- 172.21.15.135:0/2559331723 wait complete. 2024-09-10T09:28:09.635 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:10.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:09 smithi079 ceph-mon[27592]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-10T09:28:10.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:09 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:10.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:09 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:10.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:09 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T09:28:10.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:09 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:10.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:09 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/2559331723' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:11.199 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:11.200 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:10 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-10T09:28:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:10 smithi079 ceph-mon[27592]: Deploying daemon grafana.smithi079 on smithi079 2024-09-10T09:28:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:10 smithi079 ceph-mon[27592]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:11.397 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:11.441 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:12.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 -- 172.21.15.135:0/1916005130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 msgr2=0x7ff8740731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:12.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 --2- 172.21.15.135:0/1916005130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff8740731e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff864009910 tx=0x7ff864009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:12.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 -- 172.21.15.135:0/1916005130 shutdown_connections 2024-09-10T09:28:12.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 --2- 172.21.15.135:0/1916005130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff8740731e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:12.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 -- 172.21.15.135:0/1916005130 >> 172.21.15.135:0/1916005130 conn(0x7ff8740fb3d0 msgr2=0x7ff8740fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:12.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 -- 172.21.15.135:0/1916005130 shutdown_connections 2024-09-10T09:28:12.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 -- 172.21.15.135:0/1916005130 wait complete. 2024-09-10T09:28:12.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.886+0000 7ff878956700 1 Processor -- start 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff878956700 1 -- start start 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff878956700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff87419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff878956700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87419ba90 con 0x7ff874074d80 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff87259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff87419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff87259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff87419b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:50814/0 (socket says 172.21.15.135:50814) 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff87259c700 1 -- 172.21.15.135:0/2822159787 learned_addr learned my addr 172.21.15.135:0/2822159787 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff87259c700 1 -- 172.21.15.135:0/2822159787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8640095f0 con 0x7ff874074d80 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff87259c700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff87419b550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff864005b40 tx=0x7ff864004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.887+0000 7ff8637fe700 1 -- 172.21.15.135:0/2822159787 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff86401d070 con 0x7ff874074d80 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.888+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87419bc90 con 0x7ff874074d80 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.888+0000 7ff8637fe700 1 -- 172.21.15.135:0/2822159787 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff86400be10 con 0x7ff874074d80 2024-09-10T09:28:12.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.888+0000 7ff8637fe700 1 -- 172.21.15.135:0/2822159787 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff86400f460 con 0x7ff874074d80 2024-09-10T09:28:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.888+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87419c130 con 0x7ff874074d80 2024-09-10T09:28:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.888+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff874195100 con 0x7ff874074d80 2024-09-10T09:28:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.888+0000 7ff8637fe700 1 -- 172.21.15.135:0/2822159787 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff8640227e0 con 0x7ff874074d80 2024-09-10T09:28:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.889+0000 7ff8637fe700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff85c038490 0x7ff85c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.889+0000 7ff8637fe700 1 -- 172.21.15.135:0/2822159787 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ff86404c490 con 0x7ff874074d80 2024-09-10T09:28:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.889+0000 7ff871d9b700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff85c038490 0x7ff85c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:12.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.889+0000 7ff871d9b700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff85c038490 0x7ff85c03a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff868006fd0 tx=0x7ff868006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:12.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:12.897+0000 7ff8637fe700 1 -- 172.21.15.135:0/2822159787 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff86402bba0 con 0x7ff874074d80 2024-09-10T09:28:13.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.163+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff87402d050 con 0x7ff874074d80 2024-09-10T09:28:13.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.164+0000 7ff8637fe700 1 -- 172.21.15.135:0/2822159787 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff864027070 con 0x7ff874074d80 2024-09-10T09:28:13.165 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:13.165 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:13.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff85c038490 msgr2=0x7ff85c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:13.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff85c038490 0x7ff85c03a940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff868006fd0 tx=0x7ff868006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:13.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 msgr2=0x7ff87419b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff87419b550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff864005b40 tx=0x7ff864004740 comp rx=0 tx=0).stop 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 shutdown_connections 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff85c038490 0x7ff85c03a940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 --2- 172.21.15.135:0/2822159787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff874074d80 0x7ff87419b550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 >> 172.21.15.135:0/2822159787 conn(0x7ff8740fb3d0 msgr2=0x7ff8740fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 shutdown_connections 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:13.166+0000 7ff878956700 1 -- 172.21.15.135:0/2822159787 wait complete. 2024-09-10T09:28:13.168 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:13.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:12 smithi079 ceph-mon[27592]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:14.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:13 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/2822159787' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:14.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:13 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:14.772 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:14.773 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:14.968 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:15.018 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:15.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:14 smithi079 ceph-mon[27592]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:16.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.558+0000 7f0164181700 1 -- 172.21.15.135:0/1474554809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 msgr2=0x7f015c102d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:16.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.558+0000 7f0164181700 1 --2- 172.21.15.135:0/1474554809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c102d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f015800b0a0 tx=0x7f015800b3b0 comp rx=0 tx=0).stop 2024-09-10T09:28:16.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.558+0000 7f0164181700 1 -- 172.21.15.135:0/1474554809 shutdown_connections 2024-09-10T09:28:16.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.558+0000 7f0164181700 1 --2- 172.21.15.135:0/1474554809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c102d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:16.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.558+0000 7f0164181700 1 -- 172.21.15.135:0/1474554809 >> 172.21.15.135:0/1474554809 conn(0x7f015c0fa2b0 msgr2=0x7f015c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:16.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.558+0000 7f0164181700 1 -- 172.21.15.135:0/1474554809 shutdown_connections 2024-09-10T09:28:16.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.558+0000 7f0164181700 1 -- 172.21.15.135:0/1474554809 wait complete. 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0164181700 1 Processor -- start 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0164181700 1 -- start start 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0164181700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0164181700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c1954e0 con 0x7f015c100930 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0161f1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0161f1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c194fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:38788/0 (socket says 172.21.15.135:38788) 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0161f1d700 1 -- 172.21.15.135:0/460851825 learned_addr learned my addr 172.21.15.135:0/460851825 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.559+0000 7f0161f1d700 1 -- 172.21.15.135:0/460851825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009d00 con 0x7f015c100930 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.560+0000 7f0161f1d700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c194fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0158015040 tx=0x7f015800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.560+0000 7f0152ffd700 1 -- 172.21.15.135:0/460851825 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f015800e040 con 0x7f015c100930 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.560+0000 7f0152ffd700 1 -- 172.21.15.135:0/460851825 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f015801d930 con 0x7f015c100930 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.560+0000 7f0152ffd700 1 -- 172.21.15.135:0/460851825 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01580129d0 con 0x7f015c100930 2024-09-10T09:28:16.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.560+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c1956e0 con 0x7f015c100930 2024-09-10T09:28:16.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.560+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c195b00 con 0x7f015c100930 2024-09-10T09:28:16.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.561+0000 7f0152ffd700 1 -- 172.21.15.135:0/460851825 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f0158012c90 con 0x7f015c100930 2024-09-10T09:28:16.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.561+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c18eb00 con 0x7f015c100930 2024-09-10T09:28:16.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.561+0000 7f0152ffd700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0148038490 0x7f014803a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:16.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.561+0000 7f0152ffd700 1 -- 172.21.15.135:0/460851825 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f015804ca70 con 0x7f015c100930 2024-09-10T09:28:16.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.561+0000 7f016171c700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0148038490 0x7f014803a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:16.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.562+0000 7f016171c700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0148038490 0x7f014803a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f014c006fd0 tx=0x7f014c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:16.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.566+0000 7f0152ffd700 1 -- 172.21.15.135:0/460851825 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f015801aba0 con 0x7f015c100930 2024-09-10T09:28:16.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.830+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f015c062380 con 0x7f015c100930 2024-09-10T09:28:16.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.830+0000 7f0152ffd700 1 -- 172.21.15.135:0/460851825 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f015801aba0 con 0x7f015c100930 2024-09-10T09:28:16.831 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:16.832 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0148038490 msgr2=0x7f014803a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0148038490 0x7f014803a940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f014c006fd0 tx=0x7f014c006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 msgr2=0x7f015c194fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c194fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0158015040 tx=0x7f015800bb10 comp rx=0 tx=0).stop 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 shutdown_connections 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0148038490 0x7f014803a940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 --2- 172.21.15.135:0/460851825 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f015c100930 0x7f015c194fa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 >> 172.21.15.135:0/460851825 conn(0x7f015c0fa2b0 msgr2=0x7f015c0faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 shutdown_connections 2024-09-10T09:28:16.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:16.833+0000 7f0164181700 1 -- 172.21.15.135:0/460851825 wait complete. 2024-09-10T09:28:16.835 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:16 smithi079 ceph-mon[27592]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:16 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/460851825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:18.455 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:18.456 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:18.650 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:18.693 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:19.290 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:18 smithi079 ceph-mon[27592]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.161+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/2288663698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 msgr2=0x7f4bac0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.161+0000 7f4bb2fd8700 1 --2- 172.21.15.135:0/2288663698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac0ff130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009910 tx=0x7f4ba0009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.161+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/2288663698 shutdown_connections 2024-09-10T09:28:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.161+0000 7f4bb2fd8700 1 --2- 172.21.15.135:0/2288663698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac0ff130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.161+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/2288663698 >> 172.21.15.135:0/2288663698 conn(0x7f4bac0fa2b0 msgr2=0x7f4bac0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:20.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.161+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/2288663698 shutdown_connections 2024-09-10T09:28:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/2288663698 wait complete. 2024-09-10T09:28:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb2fd8700 1 Processor -- start 2024-09-10T09:28:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb2fd8700 1 -- start start 2024-09-10T09:28:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb2fd8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:20.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb2fd8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1954f0 con 0x7f4bac0fed20 2024-09-10T09:28:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb0d74700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:20.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb0d74700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac194fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:38808/0 (socket says 172.21.15.135:38808) 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.162+0000 7f4bb0d74700 1 -- 172.21.15.135:0/1790316462 learned_addr learned my addr 172.21.15.135:0/1790316462 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.163+0000 7f4bb0d74700 1 -- 172.21.15.135:0/1790316462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00095f0 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.163+0000 7f4bb0d74700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac194fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0005950 tx=0x7f4ba0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.163+0000 7f4ba9ffb700 1 -- 172.21.15.135:0/1790316462 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ba001d070 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.163+0000 7f4ba9ffb700 1 -- 172.21.15.135:0/1790316462 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ba000be10 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.163+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac1956f0 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.163+0000 7f4ba9ffb700 1 -- 172.21.15.135:0/1790316462 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ba000f460 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.164+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac195b90 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.164+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac18ea10 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.164+0000 7f4ba9ffb700 1 -- 172.21.15.135:0/1790316462 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f4ba00227c0 con 0x7f4bac0fed20 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.165+0000 7f4ba9ffb700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4b9c038490 0x7f4b9c03a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:20.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.165+0000 7f4ba9ffb700 1 -- 172.21.15.135:0/1790316462 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f4ba004c3f0 con 0x7f4bac0fed20 2024-09-10T09:28:20.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.165+0000 7f4babfff700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4b9c038490 0x7f4b9c03a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:20.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.165+0000 7f4babfff700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4b9c038490 0x7f4b9c03a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4b98006fd0 tx=0x7f4b98006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:20.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.170+0000 7f4ba9ffb700 1 -- 172.21.15.135:0/1790316462 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4ba002bba0 con 0x7f4bac0fed20 2024-09-10T09:28:20.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.433+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4bac02cc30 con 0x7f4bac0fed20 2024-09-10T09:28:20.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.434+0000 7f4ba9ffb700 1 -- 172.21.15.135:0/1790316462 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4ba0027030 con 0x7f4bac0fed20 2024-09-10T09:28:20.436 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:20.436 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.436+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4b9c038490 msgr2=0x7f4b9c03a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.436+0000 7f4bb2fd8700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4b9c038490 0x7f4b9c03a940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4b98006fd0 tx=0x7f4b98006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.436+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 msgr2=0x7f4bac194fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.436+0000 7f4bb2fd8700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac194fb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0005950 tx=0x7f4ba0009e60 comp rx=0 tx=0).stop 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.437+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 shutdown_connections 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.437+0000 7f4bb2fd8700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4b9c038490 0x7f4b9c03a940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.437+0000 7f4bb2fd8700 1 --2- 172.21.15.135:0/1790316462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4bac0fed20 0x7f4bac194fb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.437+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 >> 172.21.15.135:0/1790316462 conn(0x7f4bac0fa2b0 msgr2=0x7f4bac0690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.437+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 shutdown_connections 2024-09-10T09:28:20.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:20.437+0000 7f4bb2fd8700 1 -- 172.21.15.135:0/1790316462 wait complete. 2024-09-10T09:28:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:21.237 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:20 smithi079 ceph-mon[27592]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:21.238 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:20 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/1790316462' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:22.018 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:22.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:22.214 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:22.258 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:22.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:22.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:22.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: Deploying daemon prometheus.smithi079 on smithi079 2024-09-10T09:28:22.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:22 smithi079 ceph-mon[27592]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:23.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.720+0000 7fd33cd3b700 1 -- 172.21.15.135:0/2960058359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 msgr2=0x7fd3380ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.720+0000 7fd33cd3b700 1 --2- 172.21.15.135:0/2960058359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380ff130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd330009910 tx=0x7fd330009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.720+0000 7fd33cd3b700 1 -- 172.21.15.135:0/2960058359 shutdown_connections 2024-09-10T09:28:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.720+0000 7fd33cd3b700 1 --2- 172.21.15.135:0/2960058359 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380ff130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.720+0000 7fd33cd3b700 1 -- 172.21.15.135:0/2960058359 >> 172.21.15.135:0/2960058359 conn(0x7fd3380fa2b0 msgr2=0x7fd3380fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.720+0000 7fd33cd3b700 1 -- 172.21.15.135:0/2960058359 shutdown_connections 2024-09-10T09:28:23.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.720+0000 7fd33cd3b700 1 -- 172.21.15.135:0/2960058359 wait complete. 2024-09-10T09:28:23.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.721+0000 7fd33cd3b700 1 Processor -- start 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.721+0000 7fd33cd3b700 1 -- start start 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.721+0000 7fd33cd3b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.721+0000 7fd33cd3b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3380fc7a0 con 0x7fd3380fed20 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.721+0000 7fd33659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.721+0000 7fd33659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:38828/0 (socket says 172.21.15.135:38828) 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.721+0000 7fd33659c700 1 -- 172.21.15.135:0/3772350939 learned_addr learned my addr 172.21.15.135:0/3772350939 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.722+0000 7fd33659c700 1 -- 172.21.15.135:0/3772350939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300095f0 con 0x7fd3380fed20 2024-09-10T09:28:23.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.722+0000 7fd33659c700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380fc260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd330005b40 tx=0x7fd330004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.722+0000 7fd32f7fe700 1 -- 172.21.15.135:0/3772350939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd33001d070 con 0x7fd3380fed20 2024-09-10T09:28:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.722+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3380fa8b0 con 0x7fd3380fed20 2024-09-10T09:28:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.722+0000 7fd32f7fe700 1 -- 172.21.15.135:0/3772350939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd33000be10 con 0x7fd3380fed20 2024-09-10T09:28:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.722+0000 7fd32f7fe700 1 -- 172.21.15.135:0/3772350939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd33000f460 con 0x7fd3380fed20 2024-09-10T09:28:23.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.722+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3380fad50 con 0x7fd3380fed20 2024-09-10T09:28:23.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.723+0000 7fd32f7fe700 1 -- 172.21.15.135:0/3772350939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7fd33000f6d0 con 0x7fd3380fed20 2024-09-10T09:28:23.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.723+0000 7fd32f7fe700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd324038490 0x7fd32403a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:23.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.723+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd338062380 con 0x7fd3380fed20 2024-09-10T09:28:23.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.723+0000 7fd32f7fe700 1 -- 172.21.15.135:0/3772350939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7fd33004c4b0 con 0x7fd3380fed20 2024-09-10T09:28:23.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.723+0000 7fd335d9b700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd324038490 0x7fd32403a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:23.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.724+0000 7fd335d9b700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd324038490 0x7fd32403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd320006fd0 tx=0x7fd320006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:23.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.730+0000 7fd32f7fe700 1 -- 172.21.15.135:0/3772350939 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd33002c440 con 0x7fd3380fed20 2024-09-10T09:28:24.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.997+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd33818e3f0 con 0x7fd3380fed20 2024-09-10T09:28:24.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.997+0000 7fd32f7fe700 1 -- 172.21.15.135:0/3772350939 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd330027020 con 0x7fd3380fed20 2024-09-10T09:28:24.001 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:24.001 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:24.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd324038490 msgr2=0x7fd32403a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:24.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd324038490 0x7fd32403a940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd320006fd0 tx=0x7fd320006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:24.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 msgr2=0x7fd3380fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:24.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380fc260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd330005b40 tx=0x7fd330004740 comp rx=0 tx=0).stop 2024-09-10T09:28:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 shutdown_connections 2024-09-10T09:28:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd324038490 0x7fd32403a940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 --2- 172.21.15.135:0/3772350939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3380fed20 0x7fd3380fc260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 >> 172.21.15.135:0/3772350939 conn(0x7fd3380fa2b0 msgr2=0x7fd3380687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 shutdown_connections 2024-09-10T09:28:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:23.999+0000 7fd33cd3b700 1 -- 172.21.15.135:0/3772350939 wait complete. 2024-09-10T09:28:24.003 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:25.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:24 smithi079 ceph-mon[27592]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:25.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:24 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:25.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:24 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/3772350939' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:25.570 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:25.570 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:25.761 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:25.806 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:27.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:26 smithi079 ceph-mon[27592]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:27.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.316+0000 7ff8ead45700 1 -- 172.21.15.135:0/3635076232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 msgr2=0x7ff8e40ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:27.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.316+0000 7ff8ead45700 1 --2- 172.21.15.135:0/3635076232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e40ff130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009910 tx=0x7ff8d8009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:27.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.316+0000 7ff8ead45700 1 -- 172.21.15.135:0/3635076232 shutdown_connections 2024-09-10T09:28:27.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.316+0000 7ff8ead45700 1 --2- 172.21.15.135:0/3635076232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e40ff130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.316+0000 7ff8ead45700 1 -- 172.21.15.135:0/3635076232 >> 172.21.15.135:0/3635076232 conn(0x7ff8e40fa2b0 msgr2=0x7ff8e40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.316+0000 7ff8ead45700 1 -- 172.21.15.135:0/3635076232 shutdown_connections 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.316+0000 7ff8ead45700 1 -- 172.21.15.135:0/3635076232 wait complete. 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.317+0000 7ff8ead45700 1 Processor -- start 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.317+0000 7ff8ead45700 1 -- start start 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.317+0000 7ff8ead45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e4068ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.317+0000 7ff8ead45700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e4197d30 con 0x7ff8e40fed20 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.317+0000 7ff8e8ae1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e4068ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8e8ae1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e4068ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:39888/0 (socket says 172.21.15.135:39888) 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8e8ae1700 1 -- 172.21.15.135:0/990947877 learned_addr learned my addr 172.21.15.135:0/990947877 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8e8ae1700 1 -- 172.21.15.135:0/990947877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80095f0 con 0x7ff8e40fed20 2024-09-10T09:28:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8e8ae1700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e4068ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005b40 tx=0x7ff8d8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8e1ffb700 1 -- 172.21.15.135:0/990947877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8d801d070 con 0x7ff8e40fed20 2024-09-10T09:28:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8e1ffb700 1 -- 172.21.15.135:0/990947877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff8d800be10 con 0x7ff8e40fed20 2024-09-10T09:28:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e4197e70 con 0x7ff8e40fed20 2024-09-10T09:28:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.318+0000 7ff8e1ffb700 1 -- 172.21.15.135:0/990947877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8d800f460 con 0x7ff8e40fed20 2024-09-10T09:28:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.319+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e41982b0 con 0x7ff8e40fed20 2024-09-10T09:28:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.320+0000 7ff8e1ffb700 1 -- 172.21.15.135:0/990947877 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7ff8d80227e0 con 0x7ff8e40fed20 2024-09-10T09:28:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.320+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e418da00 con 0x7ff8e40fed20 2024-09-10T09:28:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.320+0000 7ff8e1ffb700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8d40384e0 0x7ff8d403a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.320+0000 7ff8e1ffb700 1 -- 172.21.15.135:0/990947877 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7ff8d804c3c0 con 0x7ff8e40fed20 2024-09-10T09:28:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.320+0000 7ff8e3fff700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8d40384e0 0x7ff8d403a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.320+0000 7ff8e3fff700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8d40384e0 0x7ff8d403a990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0006fd0 tx=0x7ff8d0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:27.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.327+0000 7ff8e1ffb700 1 -- 172.21.15.135:0/990947877 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff8d802ba00 con 0x7ff8e40fed20 2024-09-10T09:28:27.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.590+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff8e402cc30 con 0x7ff8e40fed20 2024-09-10T09:28:27.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.590+0000 7ff8e1ffb700 1 -- 172.21.15.135:0/990947877 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff8d8027030 con 0x7ff8e40fed20 2024-09-10T09:28:27.592 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:27.592 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:27.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8d40384e0 msgr2=0x7ff8d403a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8d40384e0 0x7ff8d403a990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0006fd0 tx=0x7ff8d0006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 msgr2=0x7ff8e4068ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e4068ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8005b40 tx=0x7ff8d8004740 comp rx=0 tx=0).stop 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 shutdown_connections 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff8d40384e0 0x7ff8d403a990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 --2- 172.21.15.135:0/990947877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40fed20 0x7ff8e4068ab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.592+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 >> 172.21.15.135:0/990947877 conn(0x7ff8e40fa2b0 msgr2=0x7ff8e40faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.593+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 shutdown_connections 2024-09-10T09:28:27.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:27.593+0000 7ff8ead45700 1 -- 172.21.15.135:0/990947877 wait complete. 2024-09-10T09:28:27.595 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:28.112 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:27 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/990947877' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:29.164 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:29.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:29.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:28 smithi079 ceph-mon[27592]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:29.357 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:29.401 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:30.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.886+0000 7f123cc11700 1 -- 172.21.15.135:0/1585167590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 msgr2=0x7f12380ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:30.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.886+0000 7f123cc11700 1 --2- 172.21.15.135:0/1585167590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f12380ff130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1228009910 tx=0x7f1228009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.886+0000 7f123cc11700 1 -- 172.21.15.135:0/1585167590 shutdown_connections 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.886+0000 7f123cc11700 1 --2- 172.21.15.135:0/1585167590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f12380ff130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.886+0000 7f123cc11700 1 -- 172.21.15.135:0/1585167590 >> 172.21.15.135:0/1585167590 conn(0x7f12380fa2b0 msgr2=0x7f12380fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.886+0000 7f123cc11700 1 -- 172.21.15.135:0/1585167590 shutdown_connections 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.886+0000 7f123cc11700 1 -- 172.21.15.135:0/1585167590 wait complete. 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123cc11700 1 Processor -- start 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123cc11700 1 -- start start 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123cc11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f1238194fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:30.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123cc11700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1238195500 con 0x7f12380fed20 2024-09-10T09:28:30.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f1238194fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f1238194fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:39920/0 (socket says 172.21.15.135:39920) 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123659c700 1 -- 172.21.15.135:0/2140181827 learned_addr learned my addr 172.21.15.135:0/2140181827 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123659c700 1 -- 172.21.15.135:0/2140181827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280095f0 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.887+0000 7f123659c700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f1238194fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1228005950 tx=0x7f1228009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.888+0000 7f12277fe700 1 -- 172.21.15.135:0/2140181827 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f122801d070 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.888+0000 7f12277fe700 1 -- 172.21.15.135:0/2140181827 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f122800be10 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.888+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1238195700 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.888+0000 7f12277fe700 1 -- 172.21.15.135:0/2140181827 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f122800f460 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.888+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1238195ba0 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.889+0000 7f12277fe700 1 -- 172.21.15.135:0/2140181827 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 13) v1 ==== 45140+0+0 (secure 0 0 0) 0x7f12280227c0 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.889+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1238104b50 con 0x7f12380fed20 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.889+0000 7f12277fe700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1220038490 0x7f122003a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:30.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.889+0000 7f12277fe700 1 -- 172.21.15.135:0/2140181827 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f122804c4f0 con 0x7f12380fed20 2024-09-10T09:28:30.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.889+0000 7f1235d9b700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1220038490 0x7f122003a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:30.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.889+0000 7f1235d9b700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1220038490 0x7f122003a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f122c006fd0 tx=0x7f122c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:30.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:30.894+0000 7f12277fe700 1 -- 172.21.15.135:0/2140181827 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f122802bba0 con 0x7f12380fed20 2024-09-10T09:28:30.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:30 smithi079 ceph-mon[27592]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:31.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.158+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1238198980 con 0x7f12380fed20 2024-09-10T09:28:31.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.159+0000 7f12277fe700 1 -- 172.21.15.135:0/2140181827 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1228027030 con 0x7f12380fed20 2024-09-10T09:28:31.160 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:31.160 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:31.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1220038490 msgr2=0x7f122003a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:31.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1220038490 0x7f122003a940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f122c006fd0 tx=0x7f122c006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:31.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 msgr2=0x7f1238194fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:31.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f1238194fc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1228005950 tx=0x7f1228009e60 comp rx=0 tx=0).stop 2024-09-10T09:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 shutdown_connections 2024-09-10T09:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1220038490 0x7f122003a940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 --2- 172.21.15.135:0/2140181827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12380fed20 0x7f1238194fc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 >> 172.21.15.135:0/2140181827 conn(0x7f12380fa2b0 msgr2=0x7f12380faf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 shutdown_connections 2024-09-10T09:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:31.161+0000 7f123cc11700 1 -- 172.21.15.135:0/2140181827 wait complete. 2024-09-10T09:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:31.935 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:31 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/2140181827' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:32.754 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:32.754 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:32.875 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:32 smithi079 ceph-mon[27592]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:28:32.951 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:32.995 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:34.262 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:33 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:34.262 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:33 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:34.262 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:33 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:34.262 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:33 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-10T09:28:34.262 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:33 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:34.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 -- 172.21.15.135:0/3364673311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 msgr2=0x7f6e1c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:34.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 --2- 172.21.15.135:0/3364673311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c100230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009910 tx=0x7f6e10009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:34.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 -- 172.21.15.135:0/3364673311 shutdown_connections 2024-09-10T09:28:34.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 --2- 172.21.15.135:0/3364673311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c100230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:34.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 -- 172.21.15.135:0/3364673311 >> 172.21.15.135:0/3364673311 conn(0x7f6e1c0fb3d0 msgr2=0x7f6e1c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:34.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 -- 172.21.15.135:0/3364673311 shutdown_connections 2024-09-10T09:28:34.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 -- 172.21.15.135:0/3364673311 wait complete. 2024-09-10T09:28:34.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 Processor -- start 2024-09-10T09:28:34.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.474+0000 7f6e22f1a700 1 -- start start 2024-09-10T09:28:34.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e22f1a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:34.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e22f1a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c075030 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e20cb6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:34.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e20cb6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:33314/0 (socket says 172.21.15.135:33314) 2024-09-10T09:28:34.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e20cb6700 1 -- 172.21.15.135:0/2612978538 learned_addr learned my addr 172.21.15.135:0/2612978538 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:34.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e20cb6700 1 -- 172.21.15.135:0/2612978538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100095f0 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e20cb6700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c074af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e10005b40 tx=0x7f6e10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:34.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e19ffb700 1 -- 172.21.15.135:0/2612978538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e1001d070 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e19ffb700 1 -- 172.21.15.135:0/2612978538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e1000be10 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c073140 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.475+0000 7f6e19ffb700 1 -- 172.21.15.135:0/2612978538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e1000f460 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.476+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c0735e0 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.476+0000 7f6e19ffb700 1 -- 172.21.15.135:0/2612978538 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f6e1000b960 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.476+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c062380 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.477+0000 7f6e19ffb700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 0x7f6e0c03a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.477+0000 7f6e19ffb700 1 -- 172.21.15.135:0/2612978538 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f6e1004c340 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.477+0000 7f6e1bfff700 1 -- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 msgr2=0x7f6e0c03a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:28:34.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.477+0000 7f6e1bfff700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 0x7f6e0c03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:28:34.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.482+0000 7f6e19ffb700 1 -- 172.21.15.135:0/2612978538 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6e1002bba0 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.678+0000 7f6e1bfff700 1 -- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 msgr2=0x7f6e0c03a990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:28:34.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.678+0000 7f6e1bfff700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 0x7f6e0c03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:28:34.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.746+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6e1c18e460 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.746+0000 7f6e19ffb700 1 -- 172.21.15.135:0/2612978538 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f6e10027070 con 0x7f6e1c0ffe20 2024-09-10T09:28:34.747 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:34.747 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 msgr2=0x7f6e0c03a990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 0x7f6e0c03a990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 msgr2=0x7f6e1c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c074af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e10005b40 tx=0x7f6e10004740 comp rx=0 tx=0).stop 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 shutdown_connections 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e0c0384e0 0x7f6e0c03a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 --2- 172.21.15.135:0/2612978538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e1c0ffe20 0x7f6e1c074af0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.748+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 >> 172.21.15.135:0/2612978538 conn(0x7f6e1c0fb3d0 msgr2=0x7f6e1c0fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.749+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 shutdown_connections 2024-09-10T09:28:34.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:34.749+0000 7f6e22f1a700 1 -- 172.21.15.135:0/2612978538 wait complete. 2024-09-10T09:28:34.751 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:35.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:35 smithi079 ceph-mon[27592]: from='mgr.14164 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-10T09:28:35.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:35 smithi079 ceph-mon[27592]: mgrmap e14: smithi079.mhirny(active, since 60s) 2024-09-10T09:28:35.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:35 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/2612978538' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:36.322 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:36.322 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:36.517 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:36.562 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.984+0000 7f39d28f2700 1 -- 172.21.15.135:0/1869796016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 msgr2=0x7f39cc0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.984+0000 7f39d28f2700 1 --2- 172.21.15.135:0/1869796016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0ff140 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009910 tx=0x7f39bc009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.984+0000 7f39d28f2700 1 -- 172.21.15.135:0/1869796016 shutdown_connections 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.984+0000 7f39d28f2700 1 --2- 172.21.15.135:0/1869796016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0ff140 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.984+0000 7f39d28f2700 1 -- 172.21.15.135:0/1869796016 >> 172.21.15.135:0/1869796016 conn(0x7f39cc0fa2c0 msgr2=0x7f39cc0fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.984+0000 7f39d28f2700 1 -- 172.21.15.135:0/1869796016 shutdown_connections 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.984+0000 7f39d28f2700 1 -- 172.21.15.135:0/1869796016 wait complete. 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39d28f2700 1 Processor -- start 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39d28f2700 1 -- start start 2024-09-10T09:28:37.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39d28f2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39d28f2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc197cc0 con 0x7f39cc0fed30 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39cbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:33328/0 (socket says 172.21.15.135:33328) 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39cbfff700 1 -- 172.21.15.135:0/1138585085 learned_addr learned my addr 172.21.15.135:0/1138585085 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.985+0000 7f39cbfff700 1 -- 172.21.15.135:0/1138585085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0095f0 con 0x7f39cc0fed30 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.986+0000 7f39cbfff700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0693a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005b40 tx=0x7f39bc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.986+0000 7f39c97fa700 1 -- 172.21.15.135:0/1138585085 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39bc01d070 con 0x7f39cc0fed30 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.986+0000 7f39c97fa700 1 -- 172.21.15.135:0/1138585085 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f39bc00be10 con 0x7f39cc0fed30 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.986+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc197e00 con 0x7f39cc0fed30 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.986+0000 7f39c97fa700 1 -- 172.21.15.135:0/1138585085 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39bc00f460 con 0x7f39cc0fed30 2024-09-10T09:28:37.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.986+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc1982a0 con 0x7f39cc0fed30 2024-09-10T09:28:37.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.987+0000 7f39c97fa700 1 -- 172.21.15.135:0/1138585085 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 14) v1 ==== 45154+0+0 (secure 0 0 0) 0x7f39bc00f5c0 con 0x7f39cc0fed30 2024-09-10T09:28:37.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.987+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc18da10 con 0x7f39cc0fed30 2024-09-10T09:28:37.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.987+0000 7f39c97fa700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 0x7f39b803a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:37.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.987+0000 7f39c97fa700 1 -- 172.21.15.135:0/1138585085 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (secure 0 0 0) 0x7f39bc04c560 con 0x7f39cc0fed30 2024-09-10T09:28:37.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.987+0000 7f39cb7fe700 1 -- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 msgr2=0x7f39b803a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:28:37.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.987+0000 7f39cb7fe700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 0x7f39b803a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:28:37.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:37.992+0000 7f39c97fa700 1 -- 172.21.15.135:0/1138585085 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f39bc0207e0 con 0x7f39cc0fed30 2024-09-10T09:28:38.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.188+0000 7f39cb7fe700 1 -- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 msgr2=0x7f39b803a9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.79:6800/2 2024-09-10T09:28:38.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.188+0000 7f39cb7fe700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 0x7f39b803a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T09:28:38.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.257+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f39cc02cc30 con 0x7f39cc0fed30 2024-09-10T09:28:38.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.257+0000 7f39c97fa700 1 -- 172.21.15.135:0/1138585085 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f39bc027070 con 0x7f39cc0fed30 2024-09-10T09:28:38.259 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:38.259 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:38.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 msgr2=0x7f39b803a9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:28:38.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 0x7f39b803a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:38.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 msgr2=0x7f39cc0693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:38.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0693a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005b40 tx=0x7f39bc004740 comp rx=0 tx=0).stop 2024-09-10T09:28:38.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 shutdown_connections 2024-09-10T09:28:38.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f39b8038530 0x7f39b803a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:38.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 --2- 172.21.15.135:0/1138585085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39cc0fed30 0x7f39cc0693a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:38.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 >> 172.21.15.135:0/1138585085 conn(0x7f39cc0fa2c0 msgr2=0x7f39cc0faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:38.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 shutdown_connections 2024-09-10T09:28:38.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:38.260+0000 7f39d28f2700 1 -- 172.21.15.135:0/1138585085 wait complete. 2024-09-10T09:28:38.262 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:38 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/1138585085' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:39.849 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:39.850 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:40.045 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:40.088 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:40.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: Active manager daemon smithi079.mhirny restarted 2024-09-10T09:28:40.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: Activating manager daemon smithi079.mhirny 2024-09-10T09:28:40.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: mgrmap e15: smithi079.mhirny(active, starting, since 0.00305385s) 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:40.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.589+0000 7f66abc5d700 1 -- 172.21.15.135:0/938377324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 msgr2=0x7f66a4100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.589+0000 7f66abc5d700 1 --2- 172.21.15.135:0/938377324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4100230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009910 tx=0x7f66a0009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 -- 172.21.15.135:0/938377324 shutdown_connections 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 --2- 172.21.15.135:0/938377324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4100230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 -- 172.21.15.135:0/938377324 >> 172.21.15.135:0/938377324 conn(0x7f66a40fb3d0 msgr2=0x7f66a40fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 -- 172.21.15.135:0/938377324 shutdown_connections 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 -- 172.21.15.135:0/938377324 wait complete. 2024-09-10T09:28:41.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 Processor -- start 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 -- start start 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66abc5d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a4075030 con 0x7f66a40ffe20 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.590+0000 7f66a99f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f66a99f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:33348/0 (socket says 172.21.15.135:33348) 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f66a99f9700 1 -- 172.21.15.135:0/1520206163 learned_addr learned my addr 172.21.15.135:0/1520206163 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f66a99f9700 1 -- 172.21.15.135:0/1520206163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a00095f0 con 0x7f66a40ffe20 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f66a99f9700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4074af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f66a00092e0 tx=0x7f66a0009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66a001d070 con 0x7f66a40ffe20 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f66a000be10 con 0x7f66a40ffe20 2024-09-10T09:28:41.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f66a000f460 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a4073140 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.591+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a40735e0 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.592+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a4062380 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.592+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 15) v1 ==== 44878+0+0 (secure 0 0 0) 0x7f66a0022470 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.593+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f66a004bf60 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.599+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f66a000b960 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.602+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 16) v1 ==== 45005+0+0 (secure 0 0 0) 0x7f66a0017d20 con 0x7f66a40ffe20 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.602+0000 7f669affd700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6690039440 0x7f669003b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.602+0000 7f66a91f8700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6690039440 0x7f669003b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:41.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.602+0000 7f66a91f8700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6690039440 0x7f669003b820 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6694006fd0 tx=0x7f6694006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.885+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f66a41008b0 con 0x7f66a40ffe20 2024-09-10T09:28:41.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.886+0000 7f669affd700 1 -- 172.21.15.135:0/1520206163 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f66a41008b0 con 0x7f66a40ffe20 2024-09-10T09:28:41.887 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:41.887 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6690039440 msgr2=0x7f669003b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6690039440 0x7f669003b820 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6694006fd0 tx=0x7f6694006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:41.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 msgr2=0x7f66a4074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4074af0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f66a00092e0 tx=0x7f66a0009e60 comp rx=0 tx=0).stop 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 shutdown_connections 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6690039440 0x7f669003b820 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 --2- 172.21.15.135:0/1520206163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66a40ffe20 0x7f66a4074af0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.888+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 >> 172.21.15.135:0/1520206163 conn(0x7f66a40fb3d0 msgr2=0x7f66a40fc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.889+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 shutdown_connections 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:41.889+0000 7f66abc5d700 1 -- 172.21.15.135:0/1520206163 wait complete. 2024-09-10T09:28:41.890 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:28:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:28:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:41 smithi079 ceph-mon[27592]: mgrmap e16: smithi079.mhirny(active, since 1.00892s) 2024-09-10T09:28:43.007 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:42 smithi079 ceph-mon[27592]: [10/Sep/2024:09:28:41] ENGINE Bus STARTING 2024-09-10T09:28:43.008 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:42 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:43.008 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:42 smithi079 ceph-mon[27592]: [10/Sep/2024:09:28:41] ENGINE Serving on https://172.21.15.79:7150 2024-09-10T09:28:43.008 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:42 smithi079 ceph-mon[27592]: [10/Sep/2024:09:28:41] ENGINE Serving on http://172.21.15.79:8765 2024-09-10T09:28:43.008 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:42 smithi079 ceph-mon[27592]: [10/Sep/2024:09:28:41] ENGINE Bus STARTED 2024-09-10T09:28:43.008 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:42 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/1520206163' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:43.008 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:42 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:43.498 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:43.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:44.422 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:44.474 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T09:28:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:44 smithi079 ceph-mon[27592]: mgrmap e17: smithi079.mhirny(active, since 2s) 2024-09-10T09:28:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:28:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:28:46.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.754+0000 7fb8dd459700 1 -- 172.21.15.135:0/4114228208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 msgr2=0x7fb8d8100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:46.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.754+0000 7fb8dd459700 1 --2- 172.21.15.135:0/4114228208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8100450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009910 tx=0x7fb8cc009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:46.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.754+0000 7fb8dd459700 1 -- 172.21.15.135:0/4114228208 shutdown_connections 2024-09-10T09:28:46.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.754+0000 7fb8dd459700 1 --2- 172.21.15.135:0/4114228208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8100450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:46.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.754+0000 7fb8dd459700 1 -- 172.21.15.135:0/4114228208 >> 172.21.15.135:0/4114228208 conn(0x7fb8d80fb940 msgr2=0x7fb8d80fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:46.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.754+0000 7fb8dd459700 1 -- 172.21.15.135:0/4114228208 shutdown_connections 2024-09-10T09:28:46.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.754+0000 7fb8dd459700 1 -- 172.21.15.135:0/4114228208 wait complete. 2024-09-10T09:28:46.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.755+0000 7fb8dd459700 1 Processor -- start 2024-09-10T09:28:46.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.755+0000 7fb8dd459700 1 -- start start 2024-09-10T09:28:46.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.755+0000 7fb8dd459700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:46.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.755+0000 7fb8dd459700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8195850 con 0x7fb8d8100080 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8d6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8d6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:59552/0 (socket says 172.21.15.135:59552) 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8d6ffd700 1 -- 172.21.15.135:0/1173991128 learned_addr learned my addr 172.21.15.135:0/1173991128 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8d6ffd700 1 -- 172.21.15.135:0/1173991128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0095f0 con 0x7fb8d8100080 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8d6ffd700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8195310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0092e0 tx=0x7fb8cc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8bffff700 1 -- 172.21.15.135:0/1173991128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8cc01d070 con 0x7fb8d8100080 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8bffff700 1 -- 172.21.15.135:0/1173991128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb8cc00be10 con 0x7fb8d8100080 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d8195a50 con 0x7fb8d8100080 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8bffff700 1 -- 172.21.15.135:0/1173991128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8cc022e10 con 0x7fb8d8100080 2024-09-10T09:28:46.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.756+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d8195e70 con 0x7fb8d8100080 2024-09-10T09:28:46.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.757+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d8062380 con 0x7fb8d8100080 2024-09-10T09:28:46.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.757+0000 7fb8bffff700 1 -- 172.21.15.135:0/1173991128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fb8cc00f460 con 0x7fb8d8100080 2024-09-10T09:28:46.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.758+0000 7fb8bffff700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb8c0038530 0x7fb8c003a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:46.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.758+0000 7fb8bffff700 1 -- 172.21.15.135:0/1173991128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fb8cc04c410 con 0x7fb8d8100080 2024-09-10T09:28:46.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.758+0000 7fb8d67fc700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb8c0038530 0x7fb8c003a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:46.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.758+0000 7fb8d67fc700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb8c0038530 0x7fb8c003a9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8006fd0 tx=0x7fb8c8006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:46.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:46.762+0000 7fb8bffff700 1 -- 172.21.15.135:0/1173991128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb8cc02a950 con 0x7fb8d8100080 2024-09-10T09:28:47.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.063+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb8d8107e20 con 0x7fb8d8100080 2024-09-10T09:28:47.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.064+0000 7fb8bffff700 1 -- 172.21.15.135:0/1173991128 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb8cc027030 con 0x7fb8d8100080 2024-09-10T09:28:47.065 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:47.065 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:47.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb8c0038530 msgr2=0x7fb8c003a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:47.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb8c0038530 0x7fb8c003a9e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8006fd0 tx=0x7fb8c8006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:47.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 msgr2=0x7fb8d8195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:47.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8195310 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0092e0 tx=0x7fb8cc004c80 comp rx=0 tx=0).stop 2024-09-10T09:28:47.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 shutdown_connections 2024-09-10T09:28:47.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb8c0038530 0x7fb8c003a9e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:47.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 --2- 172.21.15.135:0/1173991128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8d8100080 0x7fb8d8195310 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:47.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 >> 172.21.15.135:0/1173991128 conn(0x7fb8d80fb940 msgr2=0x7fb8d8104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:47.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 shutdown_connections 2024-09-10T09:28:47.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:47.066+0000 7fb8dd459700 1 -- 172.21.15.135:0/1173991128 wait complete. 2024-09-10T09:28:47.068 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:47.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:28:47.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T09:28:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:46 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:28:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:47 smithi079 ceph-mon[27592]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:28:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:47 smithi079 ceph-mon[27592]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:28:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:47 smithi079 ceph-mon[27592]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:28:48.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:47 smithi079 ceph-mon[27592]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:28:48.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:47 smithi079 ceph-mon[27592]: Deploying daemon ceph-exporter.smithi135 on smithi135 2024-09-10T09:28:48.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:47 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/1173991128' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:49.681 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:49.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:50.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:50.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:50.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:50.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:50.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:28:50.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-10T09:28:50.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:28:50.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:50 smithi079 ceph-mon[27592]: Deploying daemon crash.smithi135 on smithi135 2024-09-10T09:28:50.713 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:28:51.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:52.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.293+0000 7f898b0a9700 1 -- 172.21.15.135:0/1256844214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 msgr2=0x7f8984101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:52.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.293+0000 7f898b0a9700 1 --2- 172.21.15.135:0/1256844214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984101440 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8980009910 tx=0x7f8980009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:52.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.293+0000 7f898b0a9700 1 -- 172.21.15.135:0/1256844214 shutdown_connections 2024-09-10T09:28:52.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.293+0000 7f898b0a9700 1 --2- 172.21.15.135:0/1256844214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984101440 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.293+0000 7f898b0a9700 1 -- 172.21.15.135:0/1256844214 >> 172.21.15.135:0/1256844214 conn(0x7f89840fa850 msgr2=0x7f89840fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.293+0000 7f898b0a9700 1 -- 172.21.15.135:0/1256844214 shutdown_connections 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.293+0000 7f898b0a9700 1 -- 172.21.15.135:0/1256844214 wait complete. 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.294+0000 7f898b0a9700 1 Processor -- start 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.294+0000 7f898b0a9700 1 -- start start 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.294+0000 7f898b0a9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984195370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.294+0000 7f898b0a9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89841958b0 con 0x7f8984101070 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.294+0000 7f8988e45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984195370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.294+0000 7f8988e45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984195370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:59582/0 (socket says 172.21.15.135:59582) 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.294+0000 7f8988e45700 1 -- 172.21.15.135:0/3054960524 learned_addr learned my addr 172.21.15.135:0/3054960524 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.295+0000 7f8988e45700 1 -- 172.21.15.135:0/3054960524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800095f0 con 0x7f8984101070 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.295+0000 7f8988e45700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984195370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8980005b40 tx=0x7f8980004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:52.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.295+0000 7f8979ffb700 1 -- 172.21.15.135:0/3054960524 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f898001d070 con 0x7f8984101070 2024-09-10T09:28:52.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.295+0000 7f8979ffb700 1 -- 172.21.15.135:0/3054960524 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f89800044d0 con 0x7f8984101070 2024-09-10T09:28:52.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.295+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8984195ab0 con 0x7f8984101070 2024-09-10T09:28:52.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.295+0000 7f8979ffb700 1 -- 172.21.15.135:0/3054960524 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8980003930 con 0x7f8984101070 2024-09-10T09:28:52.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.295+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8984195e70 con 0x7f8984101070 2024-09-10T09:28:52.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.296+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984062380 con 0x7f8984101070 2024-09-10T09:28:52.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.296+0000 7f8979ffb700 1 -- 172.21.15.135:0/3054960524 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f8980003bf0 con 0x7f8984101070 2024-09-10T09:28:52.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.296+0000 7f8979ffb700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f896c038580 0x7f896c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:52.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.297+0000 7f8979ffb700 1 -- 172.21.15.135:0/3054960524 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f898004c410 con 0x7f8984101070 2024-09-10T09:28:52.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.297+0000 7f897bfff700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f896c038580 0x7f896c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:52.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.297+0000 7f897bfff700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f896c038580 0x7f896c03aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8974006fd0 tx=0x7f8974006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:52.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.302+0000 7f8979ffb700 1 -- 172.21.15.135:0/3054960524 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f898002a540 con 0x7f8984101070 2024-09-10T09:28:52.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.579+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8984107060 con 0x7f8984101070 2024-09-10T09:28:52.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.580+0000 7f8979ffb700 1 -- 172.21.15.135:0/3054960524 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f898002a360 con 0x7f8984101070 2024-09-10T09:28:52.581 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:52.581 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f896c038580 msgr2=0x7f896c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f896c038580 0x7f896c03aa30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8974006fd0 tx=0x7f8974006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 msgr2=0x7f8984195370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984195370 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8980005b40 tx=0x7f8980004c80 comp rx=0 tx=0).stop 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 shutdown_connections 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f896c038580 0x7f896c03aa30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 --2- 172.21.15.135:0/3054960524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101070 0x7f8984195370 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 >> 172.21.15.135:0/3054960524 conn(0x7f89840fa850 msgr2=0x7f89841046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 shutdown_connections 2024-09-10T09:28:52.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:52.582+0000 7f898b0a9700 1 -- 172.21.15.135:0/3054960524 wait complete. 2024-09-10T09:28:52.584 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:52.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:52 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/3054960524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:54.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:53 smithi079 ceph-mon[27592]: Deploying daemon node-exporter.smithi135 on smithi135 2024-09-10T09:28:54.414 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:54.414 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:54.612 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:28:55.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:28:55.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:57.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.221+0000 7f1d73e87700 1 -- 172.21.15.135:0/3831231722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 msgr2=0x7f1d6c100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:57.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.221+0000 7f1d73e87700 1 --2- 172.21.15.135:0/3831231722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c100460 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d68009910 tx=0x7f1d68009c20 comp rx=0 tx=0).stop 2024-09-10T09:28:57.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.221+0000 7f1d73e87700 1 -- 172.21.15.135:0/3831231722 shutdown_connections 2024-09-10T09:28:57.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.221+0000 7f1d73e87700 1 --2- 172.21.15.135:0/3831231722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c100460 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:57.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.221+0000 7f1d73e87700 1 -- 172.21.15.135:0/3831231722 >> 172.21.15.135:0/3831231722 conn(0x7f1d6c0fb930 msgr2=0x7f1d6c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:57.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.221+0000 7f1d73e87700 1 -- 172.21.15.135:0/3831231722 shutdown_connections 2024-09-10T09:28:57.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.221+0000 7f1d73e87700 1 -- 172.21.15.135:0/3831231722 wait complete. 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d73e87700 1 Processor -- start 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d73e87700 1 -- start start 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d73e87700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c195300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d73e87700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c195840 con 0x7f1d6c100090 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d71c23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c195300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d71c23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c195300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:38030/0 (socket says 172.21.15.135:38030) 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d71c23700 1 -- 172.21.15.135:0/3614688904 learned_addr learned my addr 172.21.15.135:0/3614688904 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.222+0000 7f1d71c23700 1 -- 172.21.15.135:0/3614688904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680095f0 con 0x7f1d6c100090 2024-09-10T09:28:57.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.223+0000 7f1d71c23700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c195300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005b40 tx=0x7f1d68004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:57.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.223+0000 7f1d62ffd700 1 -- 172.21.15.135:0/3614688904 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6801d070 con 0x7f1d6c100090 2024-09-10T09:28:57.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.223+0000 7f1d62ffd700 1 -- 172.21.15.135:0/3614688904 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d680044d0 con 0x7f1d6c100090 2024-09-10T09:28:57.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.223+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c195a40 con 0x7f1d6c100090 2024-09-10T09:28:57.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.223+0000 7f1d62ffd700 1 -- 172.21.15.135:0/3614688904 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d68003930 con 0x7f1d6c100090 2024-09-10T09:28:57.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.223+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c195e00 con 0x7f1d6c100090 2024-09-10T09:28:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.224+0000 7f1d62ffd700 1 -- 172.21.15.135:0/3614688904 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7f1d68003bf0 con 0x7f1d6c100090 2024-09-10T09:28:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.224+0000 7f1d62ffd700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1d58038580 0x7f1d5803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:28:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.224+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c062380 con 0x7f1d6c100090 2024-09-10T09:28:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.224+0000 7f1d62ffd700 1 -- 172.21.15.135:0/3614688904 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f1d6804d400 con 0x7f1d6c100090 2024-09-10T09:28:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.224+0000 7f1d71422700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1d58038580 0x7f1d5803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:28:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.225+0000 7f1d71422700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1d58038580 0x7f1d5803aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c006fd0 tx=0x7f1d5c006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:28:57.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.229+0000 7f1d62ffd700 1 -- 172.21.15.135:0/3614688904 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1d6802a950 con 0x7f1d6c100090 2024-09-10T09:28:57.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.514+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1d6c107df0 con 0x7f1d6c100090 2024-09-10T09:28:57.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.515+0000 7f1d62ffd700 1 -- 172.21.15.135:0/3614688904 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f1d6800ea50 con 0x7f1d6c100090 2024-09-10T09:28:57.516 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:28:57.516 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:28:57.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1d58038580 msgr2=0x7f1d5803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:57.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1d58038580 0x7f1d5803aa30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c006fd0 tx=0x7f1d5c006e40 comp rx=0 tx=0).stop 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 msgr2=0x7f1d6c195300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c195300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005b40 tx=0x7f1d68004c80 comp rx=0 tx=0).stop 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 shutdown_connections 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f1d58038580 0x7f1d5803aa30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 --2- 172.21.15.135:0/3614688904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d6c100090 0x7f1d6c195300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 >> 172.21.15.135:0/3614688904 conn(0x7f1d6c0fb930 msgr2=0x7f1d6c104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 shutdown_connections 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:28:57.517+0000 7f1d73e87700 1 -- 172.21.15.135:0/3614688904 wait complete. 2024-09-10T09:28:57.519 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:28:58.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:58.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:58.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:58.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:28:58.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:28:58.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T09:28:58.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:28:58.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:28:58.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:58 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/3614688904' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:28:59.269 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:28:59.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:28:59.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:28:59 smithi079 ceph-mon[27592]: Deploying daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:28:59.953 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:29:01.295 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:01.295 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:01.295 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:01.295 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:01.295 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:29:01.295 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:01.296 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:01.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.772+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/1575006987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 msgr2=0x7fa9a0101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.772+0000 7fa9a7fe4700 1 --2- 172.21.15.135:0/1575006987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0101440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b0a0 tx=0x7fa99800b3b0 comp rx=0 tx=0).stop 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.772+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/1575006987 shutdown_connections 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.772+0000 7fa9a7fe4700 1 --2- 172.21.15.135:0/1575006987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0101440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.772+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/1575006987 >> 172.21.15.135:0/1575006987 conn(0x7fa9a00fa850 msgr2=0x7fa9a00fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.772+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/1575006987 shutdown_connections 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.772+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/1575006987 wait complete. 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.773+0000 7fa9a7fe4700 1 Processor -- start 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.773+0000 7fa9a7fe4700 1 -- start start 2024-09-10T09:29:01.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.773+0000 7fa9a7fe4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.773+0000 7fa9a7fe4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a0197ab0 con 0x7fa9a0101070 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.773+0000 7fa9a5d80700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.773+0000 7fa9a5d80700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:38066/0 (socket says 172.21.15.135:38066) 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.773+0000 7fa9a5d80700 1 -- 172.21.15.135:0/2798858060 learned_addr learned my addr 172.21.15.135:0/2798858060 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.774+0000 7fa9a5d80700 1 -- 172.21.15.135:0/2798858060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998009d00 con 0x7fa9a0101070 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.774+0000 7fa9a5d80700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0197570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa9980062a0 tx=0x7fa9980097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.774+0000 7fa99effd700 1 -- 172.21.15.135:0/2798858060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99800e040 con 0x7fa9a0101070 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.774+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a0197cb0 con 0x7fa9a0101070 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.774+0000 7fa99effd700 1 -- 172.21.15.135:0/2798858060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa998007c70 con 0x7fa9a0101070 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.774+0000 7fa99effd700 1 -- 172.21.15.135:0/2798858060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99801d440 con 0x7fa9a0101070 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.774+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a0198130 con 0x7fa9a0101070 2024-09-10T09:29:01.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.775+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a0062380 con 0x7fa9a0101070 2024-09-10T09:29:01.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.775+0000 7fa99effd700 1 -- 172.21.15.135:0/2798858060 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fa998004040 con 0x7fa9a0101070 2024-09-10T09:29:01.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.775+0000 7fa99effd700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa988038580 0x7fa98803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:01.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.775+0000 7fa99effd700 1 -- 172.21.15.135:0/2798858060 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fa99804bf10 con 0x7fa9a0101070 2024-09-10T09:29:01.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.775+0000 7fa9a557f700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa988038580 0x7fa98803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:01.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.776+0000 7fa9a557f700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa988038580 0x7fa98803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa994006fd0 tx=0x7fa994006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:01.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:01.780+0000 7fa99effd700 1 -- 172.21.15.135:0/2798858060 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa998011800 con 0x7fa9a0101070 2024-09-10T09:29:02.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.098+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa9a019c0d0 con 0x7fa9a0101070 2024-09-10T09:29:02.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.099+0000 7fa99effd700 1 -- 172.21.15.135:0/2798858060 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa99802b200 con 0x7fa9a0101070 2024-09-10T09:29:02.100 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:29:02.101 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.101+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa988038580 msgr2=0x7fa98803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.101+0000 7fa9a7fe4700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa988038580 0x7fa98803aa30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa994006fd0 tx=0x7fa994006e40 comp rx=0 tx=0).stop 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.101+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 msgr2=0x7fa9a0197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.101+0000 7fa9a7fe4700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0197570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa9980062a0 tx=0x7fa9980097f0 comp rx=0 tx=0).stop 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.101+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 shutdown_connections 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.101+0000 7fa9a7fe4700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa988038580 0x7fa98803aa30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.101+0000 7fa9a7fe4700 1 --2- 172.21.15.135:0/2798858060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a0101070 0x7fa9a0197570 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.102+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 >> 172.21.15.135:0/2798858060 conn(0x7fa9a00fa850 msgr2=0x7fa9a0106ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.102+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 shutdown_connections 2024-09-10T09:29:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:02.102+0000 7fa9a7fe4700 1 -- 172.21.15.135:0/2798858060 wait complete. 2024-09-10T09:29:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:29:02.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:02 smithi079 ceph-mon[27592]: Deploying daemon mon.smithi135 on smithi135 2024-09-10T09:29:02.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:02 smithi079 ceph-mon[27592]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:03.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:03 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/2798858060' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:29:03.701 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:29:03.701 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:29:04.237 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:29:04.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:04 smithi079 ceph-mon[27592]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:05.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.864+0000 7fe125653700 1 -- 172.21.15.135:0/2321492582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 msgr2=0x7fe120101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.864+0000 7fe125653700 1 --2- 172.21.15.135:0/2321492582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe120101590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe110009910 tx=0x7fe110009c20 comp rx=0 tx=0).stop 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.864+0000 7fe125653700 1 -- 172.21.15.135:0/2321492582 shutdown_connections 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.864+0000 7fe125653700 1 --2- 172.21.15.135:0/2321492582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe120101590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.864+0000 7fe125653700 1 -- 172.21.15.135:0/2321492582 >> 172.21.15.135:0/2321492582 conn(0x7fe1200fa9a0 msgr2=0x7fe1200fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.864+0000 7fe125653700 1 -- 172.21.15.135:0/2321492582 shutdown_connections 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.864+0000 7fe125653700 1 -- 172.21.15.135:0/2321492582 wait complete. 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.865+0000 7fe125653700 1 Processor -- start 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.865+0000 7fe125653700 1 -- start start 2024-09-10T09:29:05.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.865+0000 7fe125653700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe1200fee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.865+0000 7fe125653700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120100df0 con 0x7fe1201011c0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.865+0000 7fe11effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe1200fee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.865+0000 7fe11effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe1200fee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.135:48442/0 (socket says 172.21.15.135:48442) 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.865+0000 7fe11effd700 1 -- 172.21.15.135:0/131876463 learned_addr learned my addr 172.21.15.135:0/131876463 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.866+0000 7fe11effd700 1 -- 172.21.15.135:0/131876463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100095f0 con 0x7fe1201011c0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.866+0000 7fe11effd700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe1200fee20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe110005b40 tx=0x7fe110004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.866+0000 7fe107fff700 1 -- 172.21.15.135:0/131876463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe11001d070 con 0x7fe1201011c0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.866+0000 7fe107fff700 1 -- 172.21.15.135:0/131876463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe1100044d0 con 0x7fe1201011c0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.866+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1200ff3c0 con 0x7fe1201011c0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.866+0000 7fe107fff700 1 -- 172.21.15.135:0/131876463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe110003930 con 0x7fe1201011c0 2024-09-10T09:29:05.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.866+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1200ff7e0 con 0x7fe1201011c0 2024-09-10T09:29:05.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.867+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1201076d0 con 0x7fe1201011c0 2024-09-10T09:29:05.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.867+0000 7fe107fff700 1 -- 172.21.15.135:0/131876463 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 17) v1 ==== 45197+0+0 (secure 0 0 0) 0x7fe110003bf0 con 0x7fe1201011c0 2024-09-10T09:29:05.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.867+0000 7fe107fff700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe108038580 0x7fe10803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:05.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.868+0000 7fe107fff700 1 -- 172.21.15.135:0/131876463 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fe11004c440 con 0x7fe1201011c0 2024-09-10T09:29:05.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.868+0000 7fe11e7fc700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe108038580 0x7fe10803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:05.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.868+0000 7fe11e7fc700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe108038580 0x7fe10803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe114006fd0 tx=0x7fe114006e40 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:05.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:05.872+0000 7fe107fff700 1 -- 172.21.15.135:0/131876463 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe11002a540 con 0x7fe1201011c0 2024-09-10T09:29:06.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.168+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe120062380 con 0x7fe1201011c0 2024-09-10T09:29:06.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.169+0000 7fe107fff700 1 -- 172.21.15.135:0/131876463 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe11002a360 con 0x7fe1201011c0 2024-09-10T09:29:06.170 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:29:06.170 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:26:30.512309Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T09:29:06.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe108038580 msgr2=0x7fe10803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe108038580 0x7fe10803aa30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe114006fd0 tx=0x7fe114006e40 comp rx=0 tx=0).stop 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 msgr2=0x7fe1200fee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe1200fee20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe110005b40 tx=0x7fe110004c80 comp rx=0 tx=0).stop 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 shutdown_connections 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe108038580 0x7fe10803aa30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 --2- 172.21.15.135:0/131876463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1201011c0 0x7fe1200fee20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 >> 172.21.15.135:0/131876463 conn(0x7fe1200fa9a0 msgr2=0x7fe120104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 shutdown_connections 2024-09-10T09:29:06.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:06.171+0000 7fe125653700 1 -- 172.21.15.135:0/131876463 wait complete. 2024-09-10T09:29:06.174 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-09-10T09:29:06.301 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:06 smithi079 ceph-mon[27592]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:07.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:06 smithi135 systemd[1]: Started Ceph mon.smithi135 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:29:07.755 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-10T09:29:07.755 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T09:29:07.952 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:29:12.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 -- 172.21.15.135:0/1101701861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1001b0 msgr2=0x7fea68005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:12.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 --2- 172.21.15.135:0/1101701861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1001b0 0x7fea68005610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fea74009bf0 tx=0x7fea74009f00 comp rx=0 tx=0).stop 2024-09-10T09:29:12.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 -- 172.21.15.135:0/1101701861 shutdown_connections 2024-09-10T09:29:12.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 --2- 172.21.15.135:0/1101701861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1001b0 0x7fea68005610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:12.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 -- 172.21.15.135:0/1101701861 >> 172.21.15.135:0/1101701861 conn(0x7fea7c0fba50 msgr2=0x7fea7c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:12.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 -- 172.21.15.135:0/1101701861 shutdown_connections 2024-09-10T09:29:12.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 -- 172.21.15.135:0/1101701861 wait complete. 2024-09-10T09:29:12.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.422+0000 7fea817ce700 1 Processor -- start 2024-09-10T09:29:12.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea817ce700 1 -- start start 2024-09-10T09:29:12.425 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:12.425 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:29:12.425 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: mon.smithi079 calling monitor election 2024-09-10T09:29:12.425 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.425 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.425 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: mon.smithi135 calling monitor election 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: mon.smithi079 is new leader, mons smithi079,smithi135 in quorum (ranks 0,1) 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: monmap e2: 2 mons at {smithi079=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: fsmap 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T09:29:12.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: mgrmap e17: smithi079.mhirny(active, since 31s) 2024-09-10T09:29:12.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:29:12.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: overall HEALTH_OK 2024-09-10T09:29:12.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:12.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:12.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea817ce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 0x7fea7c195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea817ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1959d0 0x7fea7c199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea817ce700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c195fe0 con 0x7fea7c1959d0 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea817ce700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c196150 con 0x7fea7c1001b0 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 0x7fea7c195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 0x7fea7c195490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42150/0 (socket says 172.21.15.135:42150) 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7affd700 1 -- 172.21.15.135:0/809508451 learned_addr learned my addr 172.21.15.135:0/809508451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7affd700 1 -- 172.21.15.135:0/809508451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 msgr2=0x7fea7c195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7affd700 1 -- 172.21.15.135:0/809508451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 msgr2=0x7fea7c195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7affd700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 0x7fea7c195490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7affd700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 0x7fea7c195490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.423+0000 7fea7a7fc700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1959d0 0x7fea7c199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:12.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea7a7fc700 1 -- 172.21.15.135:0/809508451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 msgr2=0x7fea7c195490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea7a7fc700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 0x7fea7c195490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea7a7fc700 1 -- 172.21.15.135:0/809508451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740098d0 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea7a7fc700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1959d0 0x7fea7c199e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b500 tx=0x7fea6400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea73fff700 1 -- 172.21.15.135:0/809508451 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea64011800 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c19a440 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c19a990 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea73fff700 1 -- 172.21.15.135:0/809508451 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea64011e10 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.424+0000 7fea73fff700 1 -- 172.21.15.135:0/809508451 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea64010380 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.426+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c19acc0 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.426+0000 7fea73fff700 1 -- 172.21.15.135:0/809508451 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fea64019740 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.426+0000 7fea73fff700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea5c06c750 0x7fea5c06ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.426+0000 7fea73fff700 1 -- 172.21.15.135:0/809508451 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7fea64089a70 con 0x7fea7c1959d0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.427+0000 7fea7affd700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea5c06c750 0x7fea5c06ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:12.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.427+0000 7fea7affd700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea5c06c750 0x7fea5c06ec00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fea74007950 tx=0x7fea7400b040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:12.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.431+0000 7fea73fff700 1 -- 172.21.15.135:0/809508451 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fea640552c0 con 0x7fea7c1959d0 2024-09-10T09:29:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:29:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: mon.smithi079 calling monitor election 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: mon.smithi135 calling monitor election 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: mon.smithi079 is new leader, mons smithi079,smithi135 in quorum (ranks 0,1) 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: monmap e2: 2 mons at {smithi079=[v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0],smithi135=[v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0]} removed_ranks: {} 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: fsmap 2024-09-10T09:29:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: osdmap e5: 0 total, 0 up, 0 in 2024-09-10T09:29:12.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: mgrmap e17: smithi079.mhirny(active, since 31s) 2024-09-10T09:29:12.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:29:12.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: overall HEALTH_OK 2024-09-10T09:29:12.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:12.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:12.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.712+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fea7c1a00e0 con 0x7fea7c1959d0 2024-09-10T09:29:12.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.713+0000 7fea73fff700 1 -- 172.21.15.135:0/809508451 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7fea64015410 con 0x7fea7c1959d0 2024-09-10T09:29:12.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:29:12.714 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","modified":"2024-09-10T09:29:06.901918Z","created":"2024-09-10T09:26:30.512309Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi079","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi135","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T09:29:12.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea5c06c750 msgr2=0x7fea5c06ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:12.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea5c06c750 0x7fea5c06ec00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fea74007950 tx=0x7fea7400b040 comp rx=0 tx=0).stop 2024-09-10T09:29:12.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1959d0 msgr2=0x7fea7c199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1959d0 0x7fea7c199e40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fea6400b500 tx=0x7fea6400b8c0 comp rx=0 tx=0).stop 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 shutdown_connections 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea5c06c750 0x7fea5c06ec00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea7c1001b0 0x7fea7c195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 --2- 172.21.15.135:0/809508451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea7c1959d0 0x7fea7c199e40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.715+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 >> 172.21.15.135:0/809508451 conn(0x7fea7c0fba50 msgr2=0x7fea7c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.716+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 shutdown_connections 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:29:12.716+0000 7fea817ce700 1 -- 172.21.15.135:0/809508451 wait complete. 2024-09-10T09:29:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: mgrmap e18: smithi079.mhirny(active, since 31s), standbys: smithi135.lbhjof 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/809508451' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:29:13.352 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:13.375 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T09:29:13.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: mgrmap e18: smithi079.mhirny(active, since 31s), standbys: smithi135.lbhjof 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/809508451' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T09:29:13.403 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:29:13.587 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:29:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:13 smithi135 ceph-mon[33411]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:14.363 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:13 smithi079 ceph-mon[27592]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:15.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 -- 172.21.15.79:0/1043955450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1140fef90 msgr2=0x7ff1140ff360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:15.285 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 --2- 172.21.15.79:0/1043955450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1140fef90 0x7ff1140ff360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff110009910 tx=0x7ff110009c20 comp rx=0 tx=0).stop 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 -- 172.21.15.79:0/1043955450 shutdown_connections 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 --2- 172.21.15.79:0/1043955450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1140fef90 0x7ff1140ff360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 -- 172.21.15.79:0/1043955450 >> 172.21.15.79:0/1043955450 conn(0x7ff1140fa850 msgr2=0x7ff1140fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 -- 172.21.15.79:0/1043955450 shutdown_connections 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 -- 172.21.15.79:0/1043955450 wait complete. 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 Processor -- start 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 -- start start 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.256+0000 7ff11c244700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1140fef90 0x7ff1141954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff11c244700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff114195a30 0x7ff114199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff11c244700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114196040 con 0x7ff114195a30 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff11c244700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1141961b0 con 0x7ff1140fef90 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff1197df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff114195a30 0x7ff114199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:15.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff1197df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff114195a30 0x7ff114199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39148/0 (socket says 172.21.15.79:39148) 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff1197df700 1 -- 172.21.15.79:0/856643212 learned_addr learned my addr 172.21.15.79:0/856643212 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff119fe0700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1140fef90 0x7ff1141954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff1197df700 1 -- 172.21.15.79:0/856643212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1140fef90 msgr2=0x7ff1141954f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff1197df700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1140fef90 0x7ff1141954f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff1197df700 1 -- 172.21.15.79:0/856643212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100095f0 con 0x7ff114195a30 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff119fe0700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1140fef90 0x7ff1141954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff1197df700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff114195a30 0x7ff114199ea0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff10400b730 tx=0x7ff10400baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff10affd700 1 -- 172.21.15.79:0/856643212 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff104004200 con 0x7ff114195a30 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11419a4a0 con 0x7ff114195a30 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff10affd700 1 -- 172.21.15.79:0/856643212 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff104004360 con 0x7ff114195a30 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11419a9f0 con 0x7ff114195a30 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.257+0000 7ff10affd700 1 -- 172.21.15.79:0/856643212 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff104011be0 con 0x7ff114195a30 2024-09-10T09:29:15.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.258+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11419ad20 con 0x7ff114195a30 2024-09-10T09:29:15.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.259+0000 7ff10affd700 1 -- 172.21.15.79:0/856643212 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7ff1040036a0 con 0x7ff114195a30 2024-09-10T09:29:15.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.260+0000 7ff10affd700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff10006c760 0x7ff10006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:15.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.260+0000 7ff10affd700 1 -- 172.21.15.79:0/856643212 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7ff10408a1f0 con 0x7ff114195a30 2024-09-10T09:29:15.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.260+0000 7ff119fe0700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff10006c760 0x7ff10006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:15.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.260+0000 7ff119fe0700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff10006c760 0x7ff10006ec10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff110006010 tx=0x7ff11000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:15.288 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.264+0000 7ff10affd700 1 -- 172.21.15.79:0/856643212 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff104055ae0 con 0x7ff114195a30 2024-09-10T09:29:15.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.460+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ff1141a0140 con 0x7ff114195a30 2024-09-10T09:29:15.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.461+0000 7ff10affd700 1 -- 172.21.15.79:0/856643212 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7ff104089a60 con 0x7ff114195a30 2024-09-10T09:29:15.462 INFO:teuthology.orchestra.run.smithi079.stdout:# minimal ceph.conf for afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:29:15.462 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-09-10T09:29:15.462 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:29:15.462 INFO:teuthology.orchestra.run.smithi079.stdout: mon_host = [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-10T09:29:15.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff10006c760 msgr2=0x7ff10006ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:15.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff10006c760 0x7ff10006ec10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff110006010 tx=0x7ff11000b540 comp rx=0 tx=0).stop 2024-09-10T09:29:15.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff114195a30 msgr2=0x7ff114199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:15.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff114195a30 0x7ff114199ea0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff10400b730 tx=0x7ff10400baf0 comp rx=0 tx=0).stop 2024-09-10T09:29:15.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 shutdown_connections 2024-09-10T09:29:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff10006c760 0x7ff10006ec10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1140fef90 0x7ff1141954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 --2- 172.21.15.79:0/856643212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff114195a30 0x7ff114199ea0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 >> 172.21.15.79:0/856643212 conn(0x7ff1140fa850 msgr2=0x7ff114104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 shutdown_connections 2024-09-10T09:29:15.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:15.463+0000 7ff11c244700 1 -- 172.21.15.79:0/856643212 wait complete. 2024-09-10T09:29:15.558 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.558 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.558 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:15.558 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:29:15.558 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:15.559 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:15 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/856643212' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:29:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:15.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:15 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/856643212' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:16.732 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T09:29:16.732 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:29:16.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T09:29:16.801 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:29:16.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:29:16.866 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:29:16.867 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T09:29:16.900 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:29:16.900 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:29:16.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:16 smithi079 ceph-mon[27592]: Reconfiguring mon.smithi079 (unknown last config time)... 2024-09-10T09:29:16.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:16 smithi079 ceph-mon[27592]: Reconfiguring daemon mon.smithi079 on smithi079 2024-09-10T09:29:16.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:16 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:16.964 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:16 smithi135 ceph-mon[33411]: Reconfiguring mon.smithi079 (unknown last config time)... 2024-09-10T09:29:16.964 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:16 smithi135 ceph-mon[33411]: Reconfiguring daemon mon.smithi079 on smithi079 2024-09-10T09:29:16.964 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:16 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:16.968 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T09:29:16.968 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:29:16.968 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T09:29:16.984 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T09:29:16.985 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-10 09:28:32.336439829 +0000 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-10 09:23:28.459858948 +0000 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-10 09:23:28.459858948 +0000 2024-09-10T09:29:17.040 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-10 09:23:28.459858948 +0000 2024-09-10T09:29:17.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T09:29:17.104 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-10T09:29:17.104 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-10T09:29:17.104 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000188376 s, 2.7 MB/s 2024-09-10T09:29:17.105 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T09:29:17.162 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-10 09:28:32.336439829 +0000 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-10 09:23:28.790850614 +0000 2024-09-10T09:29:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-10 09:23:28.790850614 +0000 2024-09-10T09:29:17.220 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-10 09:23:28.790850614 +0000 2024-09-10T09:29:17.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T09:29:17.284 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-10T09:29:17.284 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-10T09:29:17.284 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000255177 s, 2.0 MB/s 2024-09-10T09:29:17.285 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T09:29:17.342 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-10 09:28:32.337439805 +0000 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-10 09:23:29.125842179 +0000 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-10 09:23:29.125842179 +0000 2024-09-10T09:29:17.399 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-10 09:23:29.125842179 +0000 2024-09-10T09:29:17.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T09:29:17.464 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-10T09:29:17.464 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-10T09:29:17.464 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000189394 s, 2.7 MB/s 2024-09-10T09:29:17.465 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T09:29:17.522 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-10T09:29:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T09:29:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:17.577 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T09:29:17.577 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:17.577 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:17.577 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-10 09:28:32.337439805 +0000 2024-09-10T09:29:17.577 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-10 09:23:29.451833971 +0000 2024-09-10T09:29:17.578 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-10 09:23:29.451833971 +0000 2024-09-10T09:29:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-10 09:23:29.451833971 +0000 2024-09-10T09:29:17.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T09:29:17.641 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-10T09:29:17.641 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-10T09:29:17.641 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000175856 s, 2.9 MB/s 2024-09-10T09:29:17.643 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T09:29:17.699 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:29:17.699 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T09:29:17.719 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T09:29:17.719 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 09:29:04.484402752 +0000 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 09:23:31.223897815 +0000 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 09:23:31.223897815 +0000 2024-09-10T09:29:17.777 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 09:23:31.223897815 +0000 2024-09-10T09:29:17.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T09:29:17.843 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T09:29:17.844 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T09:29:17.844 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000271215 s, 1.9 MB/s 2024-09-10T09:29:17.845 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T09:29:17.904 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 09:29:04.484402752 +0000 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 09:23:31.561890785 +0000 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 09:23:31.561890785 +0000 2024-09-10T09:29:17.961 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 09:23:31.561890785 +0000 2024-09-10T09:29:17.962 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T09:29:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T09:29:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T09:29:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000204817 s, 2.5 MB/s 2024-09-10T09:29:18.027 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T09:29:18.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:17 smithi079 ceph-mon[27592]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:18.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:17 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:18.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:17 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:18.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:17 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:29:18.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:17 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:29:18.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:17 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:18.085 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 09:29:04.485402732 +0000 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 09:23:31.892883902 +0000 2024-09-10T09:29:18.144 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 09:23:31.892883902 +0000 2024-09-10T09:29:18.145 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 09:23:31.892883902 +0000 2024-09-10T09:29:18.145 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T09:29:18.204 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:17 smithi135 ceph-mon[33411]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:18.204 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:17 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:18.204 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:17 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:18.204 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:17 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:29:18.204 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:17 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:29:18.204 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:17 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:18.206 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T09:29:18.206 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T09:29:18.206 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000207953 s, 2.5 MB/s 2024-09-10T09:29:18.207 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T09:29:18.264 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-10T09:29:18.320 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T09:29:18.320 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T09:29:18.321 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T09:29:18.321 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:29:18.321 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T09:29:18.321 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 09:29:04.485402732 +0000 2024-09-10T09:29:18.321 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 09:23:32.224876997 +0000 2024-09-10T09:29:18.321 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 09:23:32.224876997 +0000 2024-09-10T09:29:18.321 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 09:23:32.224876997 +0000 2024-09-10T09:29:18.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T09:29:18.385 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T09:29:18.385 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T09:29:18.386 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000213528 s, 2.4 MB/s 2024-09-10T09:29:18.387 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T09:29:18.443 INFO:tasks.cephadm:Deploying osd.0 on smithi079 with /dev/vg_nvme/lv_4... 2024-09-10T09:29:18.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T09:29:18.779 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:29:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:18 smithi079 ceph-mon[27592]: Reconfiguring mgr.smithi079.mhirny (unknown last config time)... 2024-09-10T09:29:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:18 smithi079 ceph-mon[27592]: Reconfiguring daemon mgr.smithi079.mhirny on smithi079 2024-09-10T09:29:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:18 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:18 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:18 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:29:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:18 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:19.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:18 smithi135 ceph-mon[33411]: Reconfiguring mgr.smithi079.mhirny (unknown last config time)... 2024-09-10T09:29:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:18 smithi135 ceph-mon[33411]: Reconfiguring daemon mgr.smithi079.mhirny on smithi079 2024-09-10T09:29:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:18 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:18 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:18 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:29:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:18 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:20.060 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:19 smithi079 ceph-mon[27592]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:20.060 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:19 smithi079 ceph-mon[27592]: Reconfiguring ceph-exporter.smithi079 (monmap changed)... 2024-09-10T09:29:20.060 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:19 smithi079 ceph-mon[27592]: Reconfiguring daemon ceph-exporter.smithi079 on smithi079 2024-09-10T09:29:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:19 smithi135 ceph-mon[33411]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:19 smithi135 ceph-mon[33411]: Reconfiguring ceph-exporter.smithi079 (monmap changed)... 2024-09-10T09:29:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:19 smithi135 ceph-mon[33411]: Reconfiguring daemon ceph-exporter.smithi079 on smithi079 2024-09-10T09:29:22.148 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:21 smithi079 ceph-mon[27592]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:22.148 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:21 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:22.149 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:21 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:22.149 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:21 smithi079 ceph-mon[27592]: Reconfiguring crash.smithi079 (monmap changed)... 2024-09-10T09:29:22.149 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:21 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:29:22.149 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:21 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:22.149 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:21 smithi079 ceph-mon[27592]: Reconfiguring daemon crash.smithi079 on smithi079 2024-09-10T09:29:22.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:21 smithi135 ceph-mon[33411]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:22.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:21 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:21 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:21 smithi135 ceph-mon[33411]: Reconfiguring crash.smithi079 (monmap changed)... 2024-09-10T09:29:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:21 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:29:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:21 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:21 smithi135 ceph-mon[33411]: Reconfiguring daemon crash.smithi079 on smithi079 2024-09-10T09:29:22.426 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:29:22.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_4 2024-09-10T09:29:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:29:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:23 smithi079 ceph-mon[27592]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:23 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:23 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:23 smithi135 ceph-mon[33411]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:23 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:23 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:25.004 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:24 smithi079 ceph-mon[27592]: Reconfiguring alertmanager.smithi079 (dependencies changed)... 2024-09-10T09:29:25.004 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:24 smithi079 ceph-mon[27592]: Reconfiguring daemon alertmanager.smithi079 on smithi079 2024-09-10T09:29:25.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:24 smithi135 ceph-mon[33411]: Reconfiguring alertmanager.smithi079 (dependencies changed)... 2024-09-10T09:29:25.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:24 smithi135 ceph-mon[33411]: Reconfiguring daemon alertmanager.smithi079 on smithi079 2024-09-10T09:29:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:25 smithi135 ceph-mon[33411]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:26.179 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:25 smithi079 ceph-mon[27592]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:26.179 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:26.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 -- 172.21.15.79:0/3495686449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 msgr2=0x7f22480fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:26.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 --2- 172.21.15.79:0/3495686449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f22480fffd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f223c009910 tx=0x7f223c009c20 comp rx=0 tx=0).stop 2024-09-10T09:29:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 -- 172.21.15.79:0/3495686449 shutdown_connections 2024-09-10T09:29:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 --2- 172.21.15.79:0/3495686449 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f22480fffd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 --2- 172.21.15.79:0/3495686449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22480fe8c0 0x7f22480fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 -- 172.21.15.79:0/3495686449 >> 172.21.15.79:0/3495686449 conn(0x7f22480f9f10 msgr2=0x7f22480fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 -- 172.21.15.79:0/3495686449 shutdown_connections 2024-09-10T09:29:26.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 -- 172.21.15.79:0/3495686449 wait complete. 2024-09-10T09:29:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.545+0000 7f224e397700 1 Processor -- start 2024-09-10T09:29:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f224e397700 1 -- start start 2024-09-10T09:29:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f224e397700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22480fe8c0 0x7f2248195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f224e397700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f2248195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f224e397700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22481965e0 con 0x7f22480ffb60 2024-09-10T09:29:26.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f224e397700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2248196720 con 0x7f22480fe8c0 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22477fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f2248195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22477fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f2248195fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50756/0 (socket says 172.21.15.79:50756) 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22477fe700 1 -- 172.21.15.79:0/2840349107 learned_addr learned my addr 172.21.15.79:0/2840349107 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f2247fff700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22480fe8c0 0x7f2248195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22477fe700 1 -- 172.21.15.79:0/2840349107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22480fe8c0 msgr2=0x7f2248195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22477fe700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22480fe8c0 0x7f2248195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22477fe700 1 -- 172.21.15.79:0/2840349107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0095f0 con 0x7f22480ffb60 2024-09-10T09:29:26.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22477fe700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f2248195fc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f223c006010 tx=0x7f223c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.546+0000 7f22457fa700 1 -- 172.21.15.79:0/2840349107 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223c01d070 con 0x7f22480ffb60 2024-09-10T09:29:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.547+0000 7f22457fa700 1 -- 172.21.15.79:0/2840349107 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f223c00f460 con 0x7f22480ffb60 2024-09-10T09:29:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.547+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224819b170 con 0x7f22480ffb60 2024-09-10T09:29:26.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.547+0000 7f22457fa700 1 -- 172.21.15.79:0/2840349107 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223c021640 con 0x7f22480ffb60 2024-09-10T09:29:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.547+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224819b660 con 0x7f22480ffb60 2024-09-10T09:29:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.548+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22481073b0 con 0x7f22480ffb60 2024-09-10T09:29:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.548+0000 7f22457fa700 1 -- 172.21.15.79:0/2840349107 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f223c00fab0 con 0x7f22480ffb60 2024-09-10T09:29:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.548+0000 7f22457fa700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f223006c600 0x7f223006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:29:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.549+0000 7f22457fa700 1 -- 172.21.15.79:0/2840349107 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1198+0+0 (secure 0 0 0) 0x7f223c08bb00 con 0x7f22480ffb60 2024-09-10T09:29:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.549+0000 7f2247fff700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f223006c600 0x7f223006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:29:26.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.549+0000 7f2247fff700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f223006c600 0x7f223006eab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2238005fd0 tx=0x7f223800a560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:29:26.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.553+0000 7f22457fa700 1 -- 172.21.15.79:0/2840349107 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f223c05ae00 con 0x7f22480ffb60 2024-09-10T09:29:26.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:26.765+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2248061190 con 0x7f223006c600 2024-09-10T09:29:26.995 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:26 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:29:26.995 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:26 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:29:26.995 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:26 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:27.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:26 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:29:27.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:26 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:29:27.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:26 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:28.192 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:27 smithi079 ceph-mon[27592]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:28.192 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:27 smithi079 ceph-mon[27592]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:29:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:27 smithi135 ceph-mon[33411]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:27 smithi135 ceph-mon[33411]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:29:29.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:29 smithi079 ceph-mon[27592]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:29.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:29 smithi135 ceph-mon[33411]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:32.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:31 smithi079 ceph-mon[27592]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:32.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:31 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:32.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:31 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:32.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:31 smithi079 ceph-mon[27592]: Reconfiguring grafana.smithi079 (dependencies changed)... 2024-09-10T09:29:32.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:31 smithi079 ceph-mon[27592]: Reconfiguring daemon grafana.smithi079 on smithi079 2024-09-10T09:29:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:31 smithi135 ceph-mon[33411]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:31 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:31 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:31 smithi135 ceph-mon[33411]: Reconfiguring grafana.smithi079 (dependencies changed)... 2024-09-10T09:29:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:31 smithi135 ceph-mon[33411]: Reconfiguring daemon grafana.smithi079 on smithi079 2024-09-10T09:29:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:32 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/352216600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb8d86f-bc7e-4148-bf65-fcfd28de756d"}]: dispatch 2024-09-10T09:29:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:32 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/352216600' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eb8d86f-bc7e-4148-bf65-fcfd28de756d"}]': finished 2024-09-10T09:29:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:32 smithi079 ceph-mon[27592]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T09:29:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:29:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:32 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/26601778' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:29:33.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:32 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/352216600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb8d86f-bc7e-4148-bf65-fcfd28de756d"}]: dispatch 2024-09-10T09:29:33.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:32 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/352216600' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eb8d86f-bc7e-4148-bf65-fcfd28de756d"}]': finished 2024-09-10T09:29:33.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:32 smithi135 ceph-mon[33411]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T09:29:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:29:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:32 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/26601778' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:29:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:33 smithi079 ceph-mon[27592]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:33 smithi135 ceph-mon[33411]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:36.137 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:35 smithi079 ceph-mon[27592]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:36.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:35 smithi135 ceph-mon[33411]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:38.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:37 smithi079 ceph-mon[27592]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:38.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:37 smithi135 ceph-mon[33411]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:39.673 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:39 smithi079 ceph-mon[27592]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:39 smithi135 ceph-mon[33411]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:40.921 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:40.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:41.738 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:41 smithi079 ceph-mon[27592]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:41.738 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:41.738 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:41 smithi135 ceph-mon[33411]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:41.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:42.833 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:42 smithi079 ceph-mon[27592]: Reconfiguring prometheus.smithi079 (dependencies changed)... 2024-09-10T09:29:42.833 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:42 smithi079 ceph-mon[27592]: Reconfiguring daemon prometheus.smithi079 on smithi079 2024-09-10T09:29:42.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:42 smithi135 ceph-mon[33411]: Reconfiguring prometheus.smithi079 (dependencies changed)... 2024-09-10T09:29:42.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:42 smithi135 ceph-mon[33411]: Reconfiguring daemon prometheus.smithi079 on smithi079 2024-09-10T09:29:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:43 smithi079 ceph-mon[27592]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:29:43.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:43.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:43 smithi079 ceph-mon[27592]: Deploying daemon osd.0 on smithi079 2024-09-10T09:29:43.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:43 smithi135 ceph-mon[33411]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:43.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:29:43.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:43.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:43 smithi135 ceph-mon[33411]: Deploying daemon osd.0 on smithi079 2024-09-10T09:29:45.879 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:45 smithi079 ceph-mon[27592]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:45.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:45 smithi135 ceph-mon[33411]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:47.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:47 smithi079 ceph-mon[27592]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:47.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:47.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:47.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:29:47.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:47.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:47 smithi135 ceph-mon[33411]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:47.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:47.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:47.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:29:47.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:48.859 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:48 smithi079 ceph-mon[27592]: Reconfiguring ceph-exporter.smithi135 (monmap changed)... 2024-09-10T09:29:48.859 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:48 smithi079 ceph-mon[27592]: Reconfiguring daemon ceph-exporter.smithi135 on smithi135 2024-09-10T09:29:48.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:48 smithi135 ceph-mon[33411]: Reconfiguring ceph-exporter.smithi135 (monmap changed)... 2024-09-10T09:29:48.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:48 smithi135 ceph-mon[33411]: Reconfiguring daemon ceph-exporter.smithi135 on smithi135 2024-09-10T09:29:50.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:49 smithi079 ceph-mon[27592]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:50.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:50.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:50.102 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:49 smithi079 ceph-mon[27592]: Reconfiguring crash.smithi135 (monmap changed)... 2024-09-10T09:29:50.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:29:50.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:50.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:49 smithi079 ceph-mon[27592]: Reconfiguring daemon crash.smithi135 on smithi135 2024-09-10T09:29:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:49 smithi135 ceph-mon[33411]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:49 smithi135 ceph-mon[33411]: Reconfiguring crash.smithi135 (monmap changed)... 2024-09-10T09:29:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:29:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:49 smithi135 ceph-mon[33411]: Reconfiguring daemon crash.smithi135 on smithi135 2024-09-10T09:29:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: Reconfiguring mgr.smithi135.lbhjof (monmap changed)... 2024-09-10T09:29:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:29:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:29:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: Reconfiguring daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:29:51.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:51 smithi079 ceph-mon[27592]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:51.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:51.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:51.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: Reconfiguring mgr.smithi135.lbhjof (monmap changed)... 2024-09-10T09:29:51.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:29:51.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:29:51.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:51.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: Reconfiguring daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:29:51.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:51 smithi135 ceph-mon[33411]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:52.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:52.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:52.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: Reconfiguring mon.smithi135 (monmap changed)... 2024-09-10T09:29:52.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:29:52.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:29:52.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:52.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: Reconfiguring daemon mon.smithi135 on smithi135 2024-09-10T09:29:52.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:52.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:52 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:52.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:52.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:52.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: Reconfiguring mon.smithi135 (monmap changed)... 2024-09-10T09:29:52.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:29:52.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:29:52.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:29:52.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: Reconfiguring daemon mon.smithi135 on smithi135 2024-09-10T09:29:52.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:52.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:52 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.175 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:54.175 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.175 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.175 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi079.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi079.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi079.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi079.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:29:54.176 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi079.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:29:54.177 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi079.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:29:54.177 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.177 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi079.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi079.front.sepia.ceph.com:9093"}]: dispatch 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.300 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi079.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi079.front.sepia.ceph.com:3000"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi079.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi079.front.sepia.ceph.com:9095"}]: dispatch 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:54.301 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:29:55.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.697+0000 7f22457fa700 1 -- 172.21.15.79:0/2840349107 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2248061190 con 0x7f223006c600 2024-09-10T09:29:55.698 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 0 on host 'smithi079' 2024-09-10T09:29:55.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.699+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f223006c600 msgr2=0x7f223006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:55.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.699+0000 7f224e397700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f223006c600 0x7f223006eab0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2238005fd0 tx=0x7f223800a560 comp rx=0 tx=0).stop 2024-09-10T09:29:55.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.699+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 msgr2=0x7f2248195fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:29:55.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.699+0000 7f224e397700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f2248195fc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f223c006010 tx=0x7f223c00be20 comp rx=0 tx=0).stop 2024-09-10T09:29:55.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.700+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 shutdown_connections 2024-09-10T09:29:55.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.700+0000 7f224e397700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f223006c600 0x7f223006eab0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:55.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.700+0000 7f224e397700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22480fe8c0 0x7f2248195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:55.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.700+0000 7f224e397700 1 --2- 172.21.15.79:0/2840349107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22480ffb60 0x7f2248195fc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:29:55.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.700+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 >> 172.21.15.79:0/2840349107 conn(0x7f22480f9f10 msgr2=0x7f22480fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:29:55.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.700+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 shutdown_connections 2024-09-10T09:29:55.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:29:55.700+0000 7f224e397700 1 -- 172.21.15.79:0/2840349107 wait complete. 2024-09-10T09:29:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:55 smithi079 ceph-mon[27592]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:56.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:55 smithi135 ceph-mon[33411]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:29:56.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:29:56.367 DEBUG:teuthology.orchestra.run.smithi079:osd.0> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T09:29:56.369 INFO:tasks.cephadm:Deploying osd.1 on smithi079 with /dev/vg_nvme/lv_3... 2024-09-10T09:29:56.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T09:29:57.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:56 smithi079 ceph-mon[27592]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T09:29:57.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:56 smithi135 ceph-mon[33411]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T09:29:57.274 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:29:57.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:57 smithi079 ceph-mon[27592]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:57.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:57 smithi079 ceph-mon[27592]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T09:29:57.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:57 smithi079 ceph-mon[27592]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T09:29:57.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:57 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:29:57.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:57 smithi079 ceph-mon[27592]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:29:57.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:29:57 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[42665]: 2024-09-10T09:29:57.925+0000 7fabca4af700 -1 osd.0 0 waiting for initial osdmap 2024-09-10T09:29:57.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:29:57 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[42665]: 2024-09-10T09:29:57.929+0000 7fabc62a4700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:29:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:57 smithi135 ceph-mon[33411]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:29:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:57 smithi135 ceph-mon[33411]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T09:29:58.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:57 smithi135 ceph-mon[33411]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T09:29:58.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:57 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:29:58.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:57 smithi135 ceph-mon[33411]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:29:59.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:58 smithi079 ceph-mon[27592]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-10T09:29:59.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:58 smithi079 ceph-mon[27592]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T09:29:59.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:29:59.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:29:59.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:58 smithi135 ceph-mon[33411]: from='osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-10T09:29:59.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:58 smithi135 ceph-mon[33411]: osdmap e8: 1 total, 0 up, 1 in 2024-09-10T09:29:59.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:29:59.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:30:00.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:59 smithi079 ceph-mon[27592]: purged_snaps scrub starts 2024-09-10T09:30:00.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:59 smithi079 ceph-mon[27592]: purged_snaps scrub ok 2024-09-10T09:30:00.077 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:59 smithi079 ceph-mon[27592]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:30:00.077 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:59 smithi079 ceph-mon[27592]: osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] boot 2024-09-10T09:30:00.077 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:59 smithi079 ceph-mon[27592]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T09:30:00.077 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:29:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:30:00.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:30:00.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_3 2024-09-10T09:30:00.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:59 smithi135 ceph-mon[33411]: purged_snaps scrub starts 2024-09-10T09:30:00.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:59 smithi135 ceph-mon[33411]: purged_snaps scrub ok 2024-09-10T09:30:00.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:59 smithi135 ceph-mon[33411]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T09:30:00.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:59 smithi135 ceph-mon[33411]: osd.0 [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] boot 2024-09-10T09:30:00.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:59 smithi135 ceph-mon[33411]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T09:30:00.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:29:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:30:00.616 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:30:01.075 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:00 smithi079 ceph-mon[27592]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T09:30:01.075 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:00 smithi079 ceph-mon[27592]: overall HEALTH_OK 2024-09-10T09:30:01.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:00 smithi135 ceph-mon[33411]: osdmap e10: 1 total, 1 up, 1 in 2024-09-10T09:30:01.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:00 smithi135 ceph-mon[33411]: overall HEALTH_OK 2024-09-10T09:30:02.065 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:01 smithi079 ceph-mon[27592]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:01 smithi135 ceph-mon[33411]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:03.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 -- 172.21.15.79:0/396393375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b40ff150 msgr2=0x7fe6b40ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/396393375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b40ff150 0x7fe6b40ff560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b0a0 tx=0x7fe6a400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 -- 172.21.15.79:0/396393375 shutdown_connections 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/396393375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b4100350 0x7fe6b41007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/396393375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b40ff150 0x7fe6b40ff560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 -- 172.21.15.79:0/396393375 >> 172.21.15.79:0/396393375 conn(0x7fe6b40fa700 msgr2=0x7fe6b40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 -- 172.21.15.79:0/396393375 shutdown_connections 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 -- 172.21.15.79:0/396393375 wait complete. 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.251+0000 7fe6b91c0700 1 Processor -- start 2024-09-10T09:30:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b91c0700 1 -- start start 2024-09-10T09:30:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b91c0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b40ff150 0x7fe6b419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:03.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b91c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b4100350 0x7fe6b419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b91c0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b419cd50 con 0x7fe6b4100350 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b91c0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b419ce90 con 0x7fe6b40ff150 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b4100350 0x7fe6b419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b4100350 0x7fe6b419c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60892/0 (socket says 172.21.15.79:60892) 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b259c700 1 -- 172.21.15.79:0/2693754356 learned_addr learned my addr 172.21.15.79:0/2693754356 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b2d9d700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b40ff150 0x7fe6b419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b259c700 1 -- 172.21.15.79:0/2693754356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b40ff150 msgr2=0x7fe6b419c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.252+0000 7fe6b259c700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b40ff150 0x7fe6b419c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.253+0000 7fe6b259c700 1 -- 172.21.15.79:0/2693754356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a4009d00 con 0x7fe6b4100350 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.253+0000 7fe6b259c700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b4100350 0x7fe6b419c730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b4b0 tx=0x7fe69c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.253+0000 7fe6abfff700 1 -- 172.21.15.79:0/2693754356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69c011800 con 0x7fe6b4100350 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.253+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b41a1940 con 0x7fe6b4100350 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.253+0000 7fe6abfff700 1 -- 172.21.15.79:0/2693754356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe69c011e10 con 0x7fe6b4100350 2024-09-10T09:30:03.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.253+0000 7fe6abfff700 1 -- 172.21.15.79:0/2693754356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69c00f2e0 con 0x7fe6b4100350 2024-09-10T09:30:03.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.253+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b41a1e90 con 0x7fe6b4100350 2024-09-10T09:30:03.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.254+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b4107d20 con 0x7fe6b4100350 2024-09-10T09:30:03.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.255+0000 7fe6abfff700 1 -- 172.21.15.79:0/2693754356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7fe69c00f510 con 0x7fe6b4100350 2024-09-10T09:30:03.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.255+0000 7fe6abfff700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe6a006c600 0x7fe6a006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:03.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.255+0000 7fe6abfff700 1 -- 172.21.15.79:0/2693754356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1810+0+0 (secure 0 0 0) 0x7fe69c08a4d0 con 0x7fe6b4100350 2024-09-10T09:30:03.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.255+0000 7fe6b2d9d700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe6a006c600 0x7fe6a006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:03.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.256+0000 7fe6b2d9d700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe6a006c600 0x7fe6a006eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009fd0 tx=0x7fe6a40060c0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:30:03.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.259+0000 7fe6abfff700 1 -- 172.21.15.79:0/2693754356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe69c0596b0 con 0x7fe6b4100350 2024-09-10T09:30:03.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:03.467+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6b41a2560 con 0x7fe6a006c600 2024-09-10T09:30:04.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:03 smithi079 ceph-mon[27592]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:04.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:04.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:04.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:30:04.043 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:30:04.043 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:03 smithi135 ceph-mon[33411]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:04.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:04.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:30:04.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:30:04.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:05.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:04 smithi079 ceph-mon[27592]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:30:05.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:04 smithi135 ceph-mon[33411]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:30:06.046 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:05 smithi079 ceph-mon[27592]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:05 smithi135 ceph-mon[33411]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:07.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:07.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:07.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:07.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:07.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:07.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:07.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:07.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:07.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:07.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:07.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:08.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:08 smithi135 ceph-mon[33411]: Detected new or changed devices on smithi079 2024-09-10T09:30:08.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:08 smithi135 ceph-mon[33411]: Adjusting osd_memory_target on smithi079 to 11840M 2024-09-10T09:30:08.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:08 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2309379023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcaebb19-e24f-4243-baa7-1d678a9d0a9d"}]: dispatch 2024-09-10T09:30:08.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:08 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2309379023' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcaebb19-e24f-4243-baa7-1d678a9d0a9d"}]': finished 2024-09-10T09:30:08.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:08 smithi135 ceph-mon[33411]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T09:30:08.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:08 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:09.058 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:08 smithi079 ceph-mon[27592]: Detected new or changed devices on smithi079 2024-09-10T09:30:09.058 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:08 smithi079 ceph-mon[27592]: Adjusting osd_memory_target on smithi079 to 11840M 2024-09-10T09:30:09.058 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:08 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2309379023' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bcaebb19-e24f-4243-baa7-1d678a9d0a9d"}]: dispatch 2024-09-10T09:30:09.059 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:08 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2309379023' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bcaebb19-e24f-4243-baa7-1d678a9d0a9d"}]': finished 2024-09-10T09:30:09.059 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:08 smithi079 ceph-mon[27592]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T09:30:09.059 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:08 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:09.942 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:09 smithi079 ceph-mon[27592]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:09.942 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:09 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2722661610' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:30:09.942 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:09.942 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:10.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:09 smithi135 ceph-mon[33411]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:10.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:09 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2722661610' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:30:10.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:10.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:10 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:11.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:10 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:12.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:11 smithi079 ceph-mon[27592]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:11 smithi135 ceph-mon[33411]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:12.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:12.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:12.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:12.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:12.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:13.118 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:13.118 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:13.118 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:13.118 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:13.118 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:14.166 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:13 smithi079 ceph-mon[27592]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:13 smithi135 ceph-mon[33411]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:15 smithi079 ceph-mon[27592]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:30:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:15 smithi135 ceph-mon[33411]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:30:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:17.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:16 smithi079 ceph-mon[27592]: Deploying daemon osd.1 on smithi079 2024-09-10T09:30:17.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:16 smithi135 ceph-mon[33411]: Deploying daemon osd.1 on smithi079 2024-09-10T09:30:18.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:17 smithi079 ceph-mon[27592]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:17 smithi135 ceph-mon[33411]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:19.503 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:19 smithi079 ceph-mon[27592]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:19.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:19 smithi135 ceph-mon[33411]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:22.279 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:22 smithi135 ceph-mon[33411]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:22.279 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:22.279 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:22.279 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:22.319 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:22 smithi079 ceph-mon[27592]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:22.319 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:22.319 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:22.319 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:24.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:23 smithi079 ceph-mon[27592]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:24.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:23 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:24.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:23 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:23 smithi135 ceph-mon[33411]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:23 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:23 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:24.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.884+0000 7fe6abfff700 1 -- 172.21.15.79:0/2693754356 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe6b41a2560 con 0x7fe6a006c600 2024-09-10T09:30:24.886 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 1 on host 'smithi079' 2024-09-10T09:30:24.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.887+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe6a006c600 msgr2=0x7fe6a006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:24.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.887+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe6a006c600 0x7fe6a006eab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009fd0 tx=0x7fe6a40060c0 comp rx=0 tx=0).stop 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.887+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b4100350 msgr2=0x7fe6b419c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.887+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b4100350 0x7fe6b419c730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b4b0 tx=0x7fe69c00b7c0 comp rx=0 tx=0).stop 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.888+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 shutdown_connections 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.888+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe6a006c600 0x7fe6a006eab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.888+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6b40ff150 0x7fe6b419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.888+0000 7fe6b91c0700 1 --2- 172.21.15.79:0/2693754356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6b4100350 0x7fe6b419c730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.888+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 >> 172.21.15.79:0/2693754356 conn(0x7fe6b40fa700 msgr2=0x7fe6b4068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.888+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 shutdown_connections 2024-09-10T09:30:24.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:24.888+0000 7fe6b91c0700 1 -- 172.21.15.79:0/2693754356 wait complete. 2024-09-10T09:30:25.852 DEBUG:teuthology.orchestra.run.smithi079:osd.1> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T09:30:25.854 INFO:tasks.cephadm:Deploying osd.2 on smithi079 with /dev/vg_nvme/lv_2... 2024-09-10T09:30:25.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T09:30:26.133 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:25 smithi079 ceph-mon[27592]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:26.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:26.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:26.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:25 smithi079 ceph-mon[27592]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T09:30:26.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:25 smithi135 ceph-mon[33411]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:25 smithi135 ceph-mon[33411]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T09:30:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:26.587 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:30:27.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:26 smithi079 ceph-mon[27592]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T09:30:27.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:26 smithi079 ceph-mon[27592]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T09:30:27.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:26 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:27.050 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:26 smithi079 ceph-mon[27592]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:30:27.050 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:30:26 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[48176]: 2024-09-10T09:30:26.887+0000 7f87407a1700 -1 osd.1 0 waiting for initial osdmap 2024-09-10T09:30:27.050 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:30:26 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[48176]: 2024-09-10T09:30:26.892+0000 7f8739590700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:30:27.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:26 smithi135 ceph-mon[33411]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T09:30:27.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:26 smithi135 ceph-mon[33411]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T09:30:27.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:26 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:27.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:26 smithi135 ceph-mon[33411]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:30:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:27 smithi079 ceph-mon[27592]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:27 smithi079 ceph-mon[27592]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-10T09:30:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:27 smithi079 ceph-mon[27592]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T09:30:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:27 smithi135 ceph-mon[33411]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:27 smithi135 ceph-mon[33411]: from='osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-10T09:30:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:27 smithi135 ceph-mon[33411]: osdmap e13: 2 total, 1 up, 2 in 2024-09-10T09:30:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:28.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:29.071 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:28 smithi079 ceph-mon[27592]: purged_snaps scrub starts 2024-09-10T09:30:29.071 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:28 smithi079 ceph-mon[27592]: purged_snaps scrub ok 2024-09-10T09:30:29.071 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:28 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:29.071 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:28 smithi079 ceph-mon[27592]: osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] boot 2024-09-10T09:30:29.071 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:28 smithi079 ceph-mon[27592]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T09:30:29.071 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:28 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:29.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:28 smithi135 ceph-mon[33411]: purged_snaps scrub starts 2024-09-10T09:30:29.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:28 smithi135 ceph-mon[33411]: purged_snaps scrub ok 2024-09-10T09:30:29.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:28 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:29.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:28 smithi135 ceph-mon[33411]: osd.1 [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] boot 2024-09-10T09:30:29.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:28 smithi135 ceph-mon[33411]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T09:30:29.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:28 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:30:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:30:29.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi079:vg_nvme/lv_2 2024-09-10T09:30:30.077 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:29 smithi079 ceph-mon[27592]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:30.077 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:29 smithi079 ceph-mon[27592]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T09:30:30.168 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:30:30.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:29 smithi135 ceph-mon[33411]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T09:30:30.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:29 smithi135 ceph-mon[33411]: osdmap e15: 2 total, 2 up, 2 in 2024-09-10T09:30:31.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:31 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:31.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:31 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:31.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:31 smithi079 ceph-mon[27592]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:31.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:31 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:31.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:31 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:31.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:31 smithi135 ceph-mon[33411]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- 172.21.15.79:0/3933110161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 msgr2=0x7f3338100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3933110161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338100860 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3324009910 tx=0x7f3324009c20 comp rx=0 tx=0).stop 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- 172.21.15.79:0/3933110161 shutdown_connections 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3933110161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338100860 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3933110161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33380ff150 0x7f33380ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- 172.21.15.79:0/3933110161 >> 172.21.15.79:0/3933110161 conn(0x7f33380fa7a0 msgr2=0x7f33380fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- 172.21.15.79:0/3933110161 shutdown_connections 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- 172.21.15.79:0/3933110161 wait complete. 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 Processor -- start 2024-09-10T09:30:31.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- start start 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33380ff150 0x7f3338195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33381969a0 con 0x7f33381003f0 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.792+0000 7f333eaf1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3338196ae0 con 0x7f33380ff150 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3337fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3337fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338196380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46484/0 (socket says 172.21.15.79:46484) 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3337fff700 1 -- 172.21.15.79:0/3405972917 learned_addr learned my addr 172.21.15.79:0/3405972917 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:30:31.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3337fff700 1 -- 172.21.15.79:0/3405972917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33380ff150 msgr2=0x7f3338195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3337fff700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33380ff150 0x7f3338195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3337fff700 1 -- 172.21.15.79:0/3405972917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240095f0 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3337fff700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338196380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3324006010 tx=0x7f332400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3335ffb700 1 -- 172.21.15.79:0/3405972917 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f332401d070 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3335ffb700 1 -- 172.21.15.79:0/3405972917 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f332400f460 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333819b530 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f3335ffb700 1 -- 172.21.15.79:0/3405972917 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3324021640 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.793+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333819ba20 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.794+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3338068ab0 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.795+0000 7f3335ffb700 1 -- 172.21.15.79:0/3405972917 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7f332400fab0 con 0x7f33381003f0 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.795+0000 7f3335ffb700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f332806c600 0x7f332806eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.795+0000 7f3335ffb700 1 -- 172.21.15.79:0/3405972917 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2242+0+0 (secure 0 0 0) 0x7f332408bf40 con 0x7f33381003f0 2024-09-10T09:30:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.795+0000 7f333c88d700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f332806c600 0x7f332806eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.796+0000 7f333c88d700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f332806c600 0x7f332806eab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f332c0097b0 tx=0x7f332c006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:30:31.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:31.800+0000 7f3335ffb700 1 -- 172.21.15.79:0/3405972917 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f332405aea0 con 0x7f33381003f0 2024-09-10T09:30:32.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:32.003+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f33380694e0 con 0x7f332806c600 2024-09-10T09:30:32.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:32 smithi079 ceph-mon[27592]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:30:32.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:30:32.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:30:32.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:32.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:32 smithi135 ceph-mon[33411]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:30:32.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:30:32.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:30:32.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:33.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:33 smithi079 ceph-mon[27592]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:33.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:33 smithi135 ceph-mon[33411]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:35.932 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:35.932 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.932 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.932 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:35.932 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:35.932 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.933 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:35.933 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:35.933 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.933 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:35.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:36.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:36 smithi079 ceph-mon[27592]: Detected new or changed devices on smithi079 2024-09-10T09:30:36.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:36 smithi079 ceph-mon[27592]: Adjusting osd_memory_target on smithi079 to 5920M 2024-09-10T09:30:36.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:36 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1276029460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52ffae68-ccfd-45fb-b1b3-d26feca92970"}]: dispatch 2024-09-10T09:30:36.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:36 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1276029460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52ffae68-ccfd-45fb-b1b3-d26feca92970"}]': finished 2024-09-10T09:30:36.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:36 smithi079 ceph-mon[27592]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T09:30:36.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:36 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:36.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:36 smithi135 ceph-mon[33411]: Detected new or changed devices on smithi079 2024-09-10T09:30:36.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:36 smithi135 ceph-mon[33411]: Adjusting osd_memory_target on smithi079 to 5920M 2024-09-10T09:30:36.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:36 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1276029460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52ffae68-ccfd-45fb-b1b3-d26feca92970"}]: dispatch 2024-09-10T09:30:36.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:36 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1276029460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52ffae68-ccfd-45fb-b1b3-d26feca92970"}]': finished 2024-09-10T09:30:36.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:36 smithi135 ceph-mon[33411]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T09:30:36.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:36 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:37.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:37 smithi079 ceph-mon[27592]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:37.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:37 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1601653827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:30:37.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:37 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:37.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:37 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:37 smithi135 ceph-mon[33411]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:37 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1601653827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:30:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:37 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:37 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:39 smithi135 ceph-mon[33411]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:39 smithi079 ceph-mon[27592]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:40.951 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:40.951 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:40.951 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:40.951 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:40.951 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:40.952 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:42.019 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:41 smithi079 ceph-mon[27592]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:41 smithi135 ceph-mon[33411]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:43 smithi079 ceph-mon[27592]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:30:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:43 smithi135 ceph-mon[33411]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:30:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:45.040 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:44 smithi079 ceph-mon[27592]: Deploying daemon osd.2 on smithi079 2024-09-10T09:30:45.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:44 smithi135 ceph-mon[33411]: Deploying daemon osd.2 on smithi079 2024-09-10T09:30:45.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:45 smithi079 ceph-mon[27592]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:46.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:45 smithi135 ceph-mon[33411]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:48.119 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:47 smithi079 ceph-mon[27592]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:48.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:47 smithi135 ceph-mon[33411]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:49.533 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:49 smithi079 ceph-mon[27592]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:49.534 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:49.534 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:49.534 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:49 smithi135 ceph-mon[33411]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:51.928 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:51 smithi079 ceph-mon[27592]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:51.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:51 smithi135 ceph-mon[33411]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:52.558 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.557+0000 7f3335ffb700 1 -- 172.21.15.79:0/3405972917 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f33380694e0 con 0x7f332806c600 2024-09-10T09:30:52.558 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 2 on host 'smithi079' 2024-09-10T09:30:52.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f332806c600 msgr2=0x7f332806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:52.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f332806c600 0x7f332806eab0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f332c0097b0 tx=0x7f332c006d20 comp rx=0 tx=0).stop 2024-09-10T09:30:52.560 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 msgr2=0x7f3338196380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338196380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3324006010 tx=0x7f332400be20 comp rx=0 tx=0).stop 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 shutdown_connections 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f332806c600 0x7f332806eab0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33380ff150 0x7f3338195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 --2- 172.21.15.79:0/3405972917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33381003f0 0x7f3338196380 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 >> 172.21.15.79:0/3405972917 conn(0x7f33380fa7a0 msgr2=0x7f3338068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 shutdown_connections 2024-09-10T09:30:52.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:30:52.559+0000 7f333eaf1700 1 -- 172.21.15.79:0/3405972917 wait complete. 2024-09-10T09:30:53.486 DEBUG:teuthology.orchestra.run.smithi079:osd.2> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T09:30:53.488 INFO:tasks.cephadm:Deploying osd.3 on smithi135 with /dev/vg_nvme/lv_4... 2024-09-10T09:30:53.489 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T09:30:53.690 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:30:53.734 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:53.734 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:53.734 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:53 smithi079 ceph-mon[27592]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:53.735 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:53 smithi079 ceph-mon[27592]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T09:30:53.810 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:53 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:53.810 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:53 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:53.810 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:53 smithi135 ceph-mon[33411]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:53.810 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:53 smithi135 ceph-mon[33411]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T09:30:54.636 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:54 smithi135 ceph-mon[33411]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T09:30:54.636 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:54 smithi135 ceph-mon[33411]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T09:30:54.636 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:54 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:54.636 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:54 smithi135 ceph-mon[33411]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:30:54.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:54 smithi079 ceph-mon[27592]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T09:30:54.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:54 smithi079 ceph-mon[27592]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T09:30:54.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:54 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:54.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:54 smithi079 ceph-mon[27592]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:30:54.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:30:54 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[53574]: 2024-09-10T09:30:54.538+0000 7f582fbfe700 -1 osd.2 0 waiting for initial osdmap 2024-09-10T09:30:54.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:30:54 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[53574]: 2024-09-10T09:30:54.543+0000 7f58299ef700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:30:55.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:55 smithi079 ceph-mon[27592]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-10T09:30:55.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:55 smithi079 ceph-mon[27592]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T09:30:55.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:55.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:55.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:55 smithi079 ceph-mon[27592]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:55.825 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:55 smithi135 ceph-mon[33411]: from='osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-10T09:30:55.825 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:55 smithi135 ceph-mon[33411]: osdmap e18: 3 total, 2 up, 3 in 2024-09-10T09:30:55.825 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:55.825 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:55.825 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:55 smithi135 ceph-mon[33411]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T09:30:56.031 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:30:56.050 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-09-10T09:30:56.249 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: purged_snaps scrub starts 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: purged_snaps scrub ok 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] boot 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:56.657 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:56 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:56.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: purged_snaps scrub starts 2024-09-10T09:30:56.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: purged_snaps scrub ok 2024-09-10T09:30:56.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: osd.2 [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] boot 2024-09-10T09:30:56.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T09:30:56.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:30:56.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:30:56.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:56.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:56 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:57.631 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:57 smithi135 ceph-mon[33411]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T09:30:57.631 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:57 smithi135 ceph-mon[33411]: pgmap v76: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:30:57.631 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:57 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.643+0000 7ff5ddca6700 1 -- 172.21.15.135:0/905973733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 msgr2=0x7ff5d80ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.643+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/905973733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80ff8a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009910 tx=0x7ff5cc009c20 comp rx=0 tx=0).stop 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.643+0000 7ff5ddca6700 1 -- 172.21.15.135:0/905973733 shutdown_connections 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.643+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/905973733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80ff8a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.643+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/905973733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5d8100730 0x7ff5d8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.643+0000 7ff5ddca6700 1 -- 172.21.15.135:0/905973733 >> 172.21.15.135:0/905973733 conn(0x7ff5d80f9f10 msgr2=0x7ff5d80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.643+0000 7ff5ddca6700 1 -- 172.21.15.135:0/905973733 shutdown_connections 2024-09-10T09:30:57.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.644+0000 7ff5ddca6700 1 -- 172.21.15.135:0/905973733 wait complete. 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.644+0000 7ff5ddca6700 1 Processor -- start 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.644+0000 7ff5ddca6700 1 -- start start 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.644+0000 7ff5ddca6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80fee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.644+0000 7ff5ddca6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5d8100730 0x7ff5d819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5ddca6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d819adc0 con 0x7ff5d8100730 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5ddca6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d819af00 con 0x7ff5d80ff430 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80fee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33146/0 (socket says 172.21.15.135:33146) 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d77fe700 1 -- 172.21.15.135:0/1863261582 learned_addr learned my addr 172.21.15.135:0/1863261582 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d6ffd700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5d8100730 0x7ff5d819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:57.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d77fe700 1 -- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5d8100730 msgr2=0x7ff5d819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d77fe700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5d8100730 0x7ff5d819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d77fe700 1 -- 172.21.15.135:0/1863261582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0095f0 con 0x7ff5d80ff430 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d77fe700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80fee80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800e950 tx=0x7ff5c800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c800cba0 con 0x7ff5d80ff430 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d819b1e0 con 0x7ff5d80ff430 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5c800eea0 con 0x7ff5d80ff430 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c8018650 con 0x7ff5d80ff430 2024-09-10T09:30:57.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.645+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d819b700 con 0x7ff5d80ff430 2024-09-10T09:30:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.646+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d8107bf0 con 0x7ff5d80ff430 2024-09-10T09:30:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.647+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) v1 ==== 89858+0+0 (secure 0 0 0) 0x7ff5c800cd00 con 0x7ff5d80ff430 2024-09-10T09:30:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.647+0000 7ff5d4ff9700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5c006c600 0x7ff5c006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:30:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.647+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3049+0+0 (secure 0 0 0) 0x7ff5c8014070 con 0x7ff5d80ff430 2024-09-10T09:30:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.648+0000 7ff5d6ffd700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5c006c600 0x7ff5c006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:30:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.648+0000 7ff5d6ffd700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5c006c600 0x7ff5c006eab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009fd0 tx=0x7ff5cc005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:30:57.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.652+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7ff5c8051720 con 0x7ff5d80ff430 2024-09-10T09:30:57.680 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:57 smithi079 ceph-mon[27592]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T09:30:57.680 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:57 smithi079 ceph-mon[27592]: pgmap v76: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:30:57.680 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:57 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T09:30:57.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:30:57.847+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5d8104d90 con 0x7ff5c006c600 2024-09-10T09:30:58.908 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T09:30:58.908 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:58 smithi079 ceph-mon[27592]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T09:30:58.908 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T09:30:58.908 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:58 smithi079 ceph-mon[27592]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:30:58.909 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:30:58.909 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:30:58.909 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:58.940 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T09:30:58.940 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:58 smithi135 ceph-mon[33411]: osdmap e21: 3 total, 3 up, 3 in 2024-09-10T09:30:58.940 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T09:30:58.941 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:58 smithi135 ceph-mon[33411]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:30:58.941 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:30:58.941 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:30:58.941 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:59.681 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55907]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:30:59.681 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55907]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:30:59.681 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55907]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:30:59.681 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55907]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:30:59.681 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: Detected new or changed devices on smithi079 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: Adjusting osd_memory_target on smithi079 to 3946M 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:59.682 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.683 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:30:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:30:59.958 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55968]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:30:59.958 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:30:59.958 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55968]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:30:59.958 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55968]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:30:59.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T09:30:59.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: osdmap e22: 3 total, 3 up, 3 in 2024-09-10T09:30:59.970 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:30:59.970 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: Detected new or changed devices on smithi079 2024-09-10T09:30:59.970 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.970 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.970 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:59.971 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:59.971 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:30:59.971 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: Adjusting osd_memory_target on smithi079 to 3946M 2024-09-10T09:30:59.971 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.971 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:30:59.971 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:30:59.971 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:30:59.972 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:30:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:00.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55988]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:31:00.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55988]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:00.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55988]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:00.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:30:59 smithi079 sudo[55988]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:00.489 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56001]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:31:00.489 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56001]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:00.489 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56001]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:00.489 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56001]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:00.759 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56094]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:31:00.759 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:00.759 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56094]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:00.759 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56094]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:00.759 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:00 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:00.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:00 smithi079 ceph-mon[27592]: osdmap e23: 3 total, 3 up, 3 in 2024-09-10T09:31:00.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:00 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/3105246317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32be0838-5190-4679-80ae-7837d3efeec2"}]: dispatch 2024-09-10T09:31:00.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:00 smithi079 ceph-mon[27592]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32be0838-5190-4679-80ae-7837d3efeec2"}]: dispatch 2024-09-10T09:31:00.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:00 smithi079 ceph-mon[27592]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32be0838-5190-4679-80ae-7837d3efeec2"}]': finished 2024-09-10T09:31:00.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:00 smithi079 ceph-mon[27592]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T09:31:00.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:00 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:00.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:00 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:00.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:00 smithi135 ceph-mon[33411]: osdmap e23: 3 total, 3 up, 3 in 2024-09-10T09:31:00.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:00 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/3105246317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32be0838-5190-4679-80ae-7837d3efeec2"}]: dispatch 2024-09-10T09:31:00.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:00 smithi135 ceph-mon[33411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32be0838-5190-4679-80ae-7837d3efeec2"}]: dispatch 2024-09-10T09:31:00.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:00 smithi135 ceph-mon[33411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32be0838-5190-4679-80ae-7837d3efeec2"}]': finished 2024-09-10T09:31:00.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:00 smithi135 ceph-mon[33411]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T09:31:00.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:00 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:01.013 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56126]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:31:01.013 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:01.013 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56126]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:01.013 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:31:00 smithi079 sudo[56126]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:01.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56131]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:31:01.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56131]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:01.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56131]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:01.284 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56131]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:01.537 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56178]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:31:01.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56178]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:01.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56178]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:01.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 sudo[56178]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37404]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T09:31:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37404]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37404]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37404]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:01.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:01.826+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7ff5c80109e0 con 0x7ff5d80ff430 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/4194484292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:31:02.140 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:31:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37595]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37595]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37595]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 sudo[37595]: pam_unix(sudo:session): session closed for user root 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/4194484292' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:31:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:01 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:31:03.115 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:02 smithi079 ceph-mon[27592]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:31:03.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:02 smithi079 ceph-mon[27592]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:31:03.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:02 smithi079 ceph-mon[27592]: mgrmap e19: smithi079.mhirny(active, since 2m), standbys: smithi135.lbhjof 2024-09-10T09:31:03.116 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:02 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:02 smithi135 ceph-mon[33411]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T09:31:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:02 smithi135 ceph-mon[33411]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T09:31:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:02 smithi135 ceph-mon[33411]: mgrmap e19: smithi079.mhirny(active, since 2m), standbys: smithi135.lbhjof 2024-09-10T09:31:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:02 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:04.167 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:03 smithi135 ceph-mon[33411]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:04.168 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:04.168 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:03 smithi079 ceph-mon[27592]: pgmap v83: 1 pgs: 1 creating+activating; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:04.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:04 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:04.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:04 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:04.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:04 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:05.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:04 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:05.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:04 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:05.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:04 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:06.315 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:05 smithi135 ceph-mon[33411]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:06.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:05 smithi079 ceph-mon[27592]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:08.318 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:07 smithi135 ceph-mon[33411]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:08.319 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:31:08.319 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:08.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:07 smithi079 ceph-mon[27592]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:08.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:31:08.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:09.325 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:08 smithi135 ceph-mon[33411]: Deploying daemon osd.3 on smithi135 2024-09-10T09:31:09.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:08 smithi079 ceph-mon[27592]: Deploying daemon osd.3 on smithi135 2024-09-10T09:31:10.247 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:09 smithi135 ceph-mon[33411]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:10.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:09 smithi079 ceph-mon[27592]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:11.169 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:10 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:10 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:12.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:11 smithi079 ceph-mon[27592]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:11 smithi135 ceph-mon[33411]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:13.283 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:13.283 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:13.283 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:13.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:13.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:13.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:14.298 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:14 smithi135 ceph-mon[33411]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:14.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:14 smithi079 ceph-mon[27592]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:15.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.765+0000 7ff5d4ff9700 1 -- 172.21.15.135:0/1863261582 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff5d8104d90 con 0x7ff5c006c600 2024-09-10T09:31:15.767 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 3 on host 'smithi135' 2024-09-10T09:31:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5c006c600 msgr2=0x7ff5c006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5c006c600 0x7ff5c006eab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009fd0 tx=0x7ff5cc005940 comp rx=0 tx=0).stop 2024-09-10T09:31:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 msgr2=0x7ff5d80fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80fee80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800e950 tx=0x7ff5c800ec60 comp rx=0 tx=0).stop 2024-09-10T09:31:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 shutdown_connections 2024-09-10T09:31:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7ff5c006c600 0x7ff5c006eab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:15.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d80ff430 0x7ff5d80fee80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 --2- 172.21.15.135:0/1863261582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5d8100730 0x7ff5d819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 >> 172.21.15.135:0/1863261582 conn(0x7ff5d80f9f10 msgr2=0x7ff5d8103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:31:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 shutdown_connections 2024-09-10T09:31:15.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:15.772+0000 7ff5ddca6700 1 -- 172.21.15.135:0/1863261582 wait complete. 2024-09-10T09:31:16.371 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:16 smithi135 ceph-mon[33411]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:16.372 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:16 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:16.372 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:16 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:16.393 DEBUG:teuthology.orchestra.run.smithi135:osd.3> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T09:31:16.396 INFO:tasks.cephadm:Deploying osd.4 on smithi135 with /dev/vg_nvme/lv_3... 2024-09-10T09:31:16.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T09:31:16.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:16 smithi079 ceph-mon[27592]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:16.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:16 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:16.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:16 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:16.627 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:31:16 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[39395]: 2024-09-10T09:31:16.505+0000 7f5475aab640 -1 osd.3 0 log_to_monitors true 2024-09-10T09:31:17.024 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:31:17.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:17 smithi079 ceph-mon[27592]: from='osd.3 [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:31:17.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:17 smithi079 ceph-mon[27592]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:31:17.261 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:17 smithi135 ceph-mon[33411]: from='osd.3 [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:31:17.261 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:17 smithi135 ceph-mon[33411]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:31:18.366 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[39395]: 2024-09-10T09:31:18.031+0000 7f546a921700 -1 osd.3 0 waiting for initial osdmap 2024-09-10T09:31:18.367 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[39395]: 2024-09-10T09:31:18.037+0000 7f5462f0f700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:31:18.367 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:18.367 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T09:31:18.367 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T09:31:18.367 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:18.367 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: from='osd.3 [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:18.367 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:18.367 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:18.368 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:18 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:18.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:18.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T09:31:18.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: osdmap e25: 4 total, 3 up, 4 in 2024-09-10T09:31:18.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:18.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: from='osd.3 [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:18.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:18.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:18.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:18 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:19.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:19 smithi135 ceph-mon[33411]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T09:31:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:19 smithi135 ceph-mon[33411]: osdmap e26: 4 total, 3 up, 4 in 2024-09-10T09:31:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:19 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:19 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:19 smithi135 ceph-mon[33411]: osd.3 [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] boot 2024-09-10T09:31:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:19 smithi135 ceph-mon[33411]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T09:31:19.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:19 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:19.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:19 smithi079 ceph-mon[27592]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T09:31:19.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:19 smithi079 ceph-mon[27592]: osdmap e26: 4 total, 3 up, 4 in 2024-09-10T09:31:19.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:19 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:19.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:19 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:19.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:19 smithi079 ceph-mon[27592]: osd.3 [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] boot 2024-09-10T09:31:19.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:19 smithi079 ceph-mon[27592]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T09:31:19.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:19 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:31:19.801 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:31:19.824 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-09-10T09:31:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:20 smithi135 ceph-mon[33411]: purged_snaps scrub starts 2024-09-10T09:31:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:20 smithi135 ceph-mon[33411]: purged_snaps scrub ok 2024-09-10T09:31:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:20 smithi135 ceph-mon[33411]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:20.151 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:20 smithi135 ceph-mon[33411]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T09:31:20.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:20 smithi079 ceph-mon[27592]: purged_snaps scrub starts 2024-09-10T09:31:20.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:20 smithi079 ceph-mon[27592]: purged_snaps scrub ok 2024-09-10T09:31:20.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:20 smithi079 ceph-mon[27592]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-10T09:31:20.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:20 smithi079 ceph-mon[27592]: osdmap e28: 4 total, 4 up, 4 in 2024-09-10T09:31:20.644 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:31:21.632 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:21 smithi135 ceph-mon[33411]: osdmap e29: 4 total, 4 up, 4 in 2024-09-10T09:31:21.632 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:21 smithi135 ceph-mon[33411]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:21.840 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:21 smithi079 ceph-mon[27592]: osdmap e29: 4 total, 4 up, 4 in 2024-09-10T09:31:21.840 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:21 smithi079 ceph-mon[27592]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:22.529 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: osdmap e30: 4 total, 4 up, 4 in 2024-09-10T09:31:22.529 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: Detected new or changed devices on smithi135 2024-09-10T09:31:22.529 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.529 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.529 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: Adjusting osd_memory_target on smithi135 to 3639M 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:22.530 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:22 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 -- 172.21.15.135:0/2050464907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 msgr2=0x7f42d00ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:22.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2050464907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d00ff560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009910 tx=0x7f42c8009c20 comp rx=0 tx=0).stop 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 -- 172.21.15.135:0/2050464907 shutdown_connections 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2050464907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42d01003f0 0x7f42d0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2050464907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d00ff560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 -- 172.21.15.135:0/2050464907 >> 172.21.15.135:0/2050464907 conn(0x7f42d00fa7a0 msgr2=0x7f42d00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 -- 172.21.15.135:0/2050464907 shutdown_connections 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.741+0000 7f42d5b75700 1 -- 172.21.15.135:0/2050464907 wait complete. 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42d5b75700 1 Processor -- start 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42d5b75700 1 -- start start 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42d5b75700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d0195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:31:22.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42d5b75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42d01003f0 0x7f42d01963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42d5b75700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d01969e0 con 0x7f42d01003f0 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42d5b75700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d0196b20 con 0x7f42d00ff150 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42cf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d0195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42cf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d0195e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55450/0 (socket says 172.21.15.135:55450) 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.742+0000 7f42cf7fe700 1 -- 172.21.15.135:0/2463787860 learned_addr learned my addr 172.21.15.135:0/2463787860 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42ceffd700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42d01003f0 0x7f42d01963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42cf7fe700 1 -- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42d01003f0 msgr2=0x7f42d01963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42cf7fe700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42d01003f0 0x7f42d01963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42cf7fe700 1 -- 172.21.15.135:0/2463787860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c80095f0 con 0x7f42d00ff150 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42cf7fe700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d0195e80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42c800b5c0 tx=0x7f42c800be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42ccff9700 1 -- 172.21.15.135:0/2463787860 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c801d070 con 0x7f42d00ff150 2024-09-10T09:31:22.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d019b570 con 0x7f42d00ff150 2024-09-10T09:31:22.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42ccff9700 1 -- 172.21.15.135:0/2463787860 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f42c8022470 con 0x7f42d00ff150 2024-09-10T09:31:22.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42ccff9700 1 -- 172.21.15.135:0/2463787860 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c800f690 con 0x7f42d00ff150 2024-09-10T09:31:22.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.743+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d019ba60 con 0x7f42d00ff150 2024-09-10T09:31:22.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.744+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d0068ab0 con 0x7f42d00ff150 2024-09-10T09:31:22.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.745+0000 7f42ccff9700 1 -- 172.21.15.135:0/2463787860 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f42c8004b70 con 0x7f42d00ff150 2024-09-10T09:31:22.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.745+0000 7f42ccff9700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f42bc06c680 0x7f42bc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:31:22.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.745+0000 7f42ccff9700 1 -- 172.21.15.135:0/2463787860 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3602+0+0 (secure 0 0 0) 0x7f42c808c8a0 con 0x7f42d00ff150 2024-09-10T09:31:22.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.745+0000 7f42ceffd700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f42bc06c680 0x7f42bc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:31:22.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.746+0000 7f42ceffd700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f42bc06c680 0x7f42bc06eb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42b8006fd0 tx=0x7f42b8008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:31:22.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.750+0000 7f42ccff9700 1 -- 172.21.15.135:0/2463787860 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f42c805b200 con 0x7f42d00ff150 2024-09-10T09:31:22.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:22.946+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f42d019bd90 con 0x7f42bc06c680 2024-09-10T09:31:22.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: osdmap e30: 4 total, 4 up, 4 in 2024-09-10T09:31:22.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: Detected new or changed devices on smithi135 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: Adjusting osd_memory_target on smithi135 to 3639M 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:22 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:23.701 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:23 smithi135 ceph-mon[33411]: osdmap e31: 4 total, 4 up, 4 in 2024-09-10T09:31:23.701 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:23 smithi135 ceph-mon[33411]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:23.701 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:23 smithi135 ceph-mon[33411]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:31:23.701 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:23 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:31:23.701 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:23 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:31:23.701 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:23 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:23.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:23 smithi079 ceph-mon[27592]: osdmap e31: 4 total, 4 up, 4 in 2024-09-10T09:31:23.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:23 smithi079 ceph-mon[27592]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:23.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:23 smithi079 ceph-mon[27592]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:31:23.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:23 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:31:23.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:23 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:31:23.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:23 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:25 smithi079 ceph-mon[27592]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-10T09:31:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:25 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/2587356484' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dca8c952-8389-4ed9-bb93-38361592b330"}]: dispatch 2024-09-10T09:31:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:25 smithi079 ceph-mon[27592]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dca8c952-8389-4ed9-bb93-38361592b330"}]: dispatch 2024-09-10T09:31:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:25 smithi079 ceph-mon[27592]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dca8c952-8389-4ed9-bb93-38361592b330"}]': finished 2024-09-10T09:31:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:25 smithi079 ceph-mon[27592]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T09:31:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:25 smithi135 ceph-mon[33411]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-10T09:31:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:25 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/2587356484' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dca8c952-8389-4ed9-bb93-38361592b330"}]: dispatch 2024-09-10T09:31:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:25 smithi135 ceph-mon[33411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dca8c952-8389-4ed9-bb93-38361592b330"}]: dispatch 2024-09-10T09:31:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:25 smithi135 ceph-mon[33411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dca8c952-8389-4ed9-bb93-38361592b330"}]': finished 2024-09-10T09:31:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:25 smithi135 ceph-mon[33411]: osdmap e32: 5 total, 4 up, 5 in 2024-09-10T09:31:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:26.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:26 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/575932506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:31:26.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:26 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/575932506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:31:27.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:27 smithi079 ceph-mon[27592]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T09:31:27.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:27 smithi135 ceph-mon[33411]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T09:31:29.624 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:29 smithi135 ceph-mon[33411]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T09:31:29.763 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:29 smithi079 ceph-mon[27592]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-10T09:31:31.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:31 smithi079 ceph-mon[27592]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T09:31:31.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:31 smithi135 ceph-mon[33411]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-10T09:31:32.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:31:32.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:32.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:31:32.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:33.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:33 smithi135 ceph-mon[33411]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T09:31:33.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:33 smithi135 ceph-mon[33411]: Deploying daemon osd.4 on smithi135 2024-09-10T09:31:33.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:33 smithi079 ceph-mon[27592]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T09:31:33.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:33 smithi079 ceph-mon[27592]: Deploying daemon osd.4 on smithi135 2024-09-10T09:31:35.945 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:35 smithi135 ceph-mon[33411]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:35.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:35 smithi079 ceph-mon[27592]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:37.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:37 smithi079 ceph-mon[27592]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:37.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:37 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:37.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:37 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:37.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:37 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:37 smithi135 ceph-mon[33411]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:37 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:37 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:37 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:39 smithi135 ceph-mon[33411]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:39 smithi079 ceph-mon[27592]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:40.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:40.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:41.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.415+0000 7f42ccff9700 1 -- 172.21.15.135:0/2463787860 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f42d019bd90 con 0x7f42bc06c680 2024-09-10T09:31:41.416 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 4 on host 'smithi135' 2024-09-10T09:31:41.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f42bc06c680 msgr2=0x7f42bc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:41.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f42bc06c680 0x7f42bc06eb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42b8006fd0 tx=0x7f42b8008040 comp rx=0 tx=0).stop 2024-09-10T09:31:41.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 msgr2=0x7f42d0195e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:41.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d0195e80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42c800b5c0 tx=0x7f42c800be20 comp rx=0 tx=0).stop 2024-09-10T09:31:41.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 shutdown_connections 2024-09-10T09:31:41.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f42bc06c680 0x7f42bc06eb30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:41.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42d00ff150 0x7f42d0195e80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:41.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 --2- 172.21.15.135:0/2463787860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42d01003f0 0x7f42d01963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:41.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.418+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 >> 172.21.15.135:0/2463787860 conn(0x7f42d00fa7a0 msgr2=0x7f42d0068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:31:41.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.419+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 shutdown_connections 2024-09-10T09:31:41.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:41.419+0000 7f42d5b75700 1 -- 172.21.15.135:0/2463787860 wait complete. 2024-09-10T09:31:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:41 smithi079 ceph-mon[27592]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:41.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:41 smithi079 ceph-mon[27592]: from='osd.4 [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:31:41.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:41 smithi079 ceph-mon[27592]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:31:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:41 smithi135 ceph-mon[33411]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:41 smithi135 ceph-mon[33411]: from='osd.4 [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:31:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:41 smithi135 ceph-mon[33411]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:31:42.030 DEBUG:teuthology.orchestra.run.smithi135:osd.4> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T09:31:42.032 INFO:tasks.cephadm:Deploying osd.5 on smithi135 with /dev/vg_nvme/lv_2... 2024-09-10T09:31:42.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T09:31:42.277 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: osdmap e33: 5 total, 4 up, 5 in 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: from='osd.4 [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:43.378 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-mon[33411]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:43.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:43.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:43.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T09:31:43.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: osdmap e33: 5 total, 4 up, 5 in 2024-09-10T09:31:43.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:43.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: from='osd.4 [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:43.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:31:43.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:43 smithi079 ceph-mon[27592]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-10T09:31:43.693 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[44074]: 2024-09-10T09:31:43.376+0000 7fd021b8f700 -1 osd.4 0 waiting for initial osdmap 2024-09-10T09:31:43.693 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:31:43 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[44074]: 2024-09-10T09:31:43.383+0000 7fd01b980700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:31:44.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:44 smithi135 ceph-mon[33411]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T09:31:44.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:44 smithi135 ceph-mon[33411]: osdmap e34: 5 total, 4 up, 5 in 2024-09-10T09:31:44.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:44 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:44.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:44 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:44 smithi079 ceph-mon[27592]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T09:31:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:44 smithi079 ceph-mon[27592]: osdmap e34: 5 total, 4 up, 5 in 2024-09-10T09:31:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:44 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:44 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:45.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:45 smithi135 ceph-mon[33411]: purged_snaps scrub starts 2024-09-10T09:31:45.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:45 smithi135 ceph-mon[33411]: purged_snaps scrub ok 2024-09-10T09:31:45.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:45 smithi135 ceph-mon[33411]: osd.4 [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] boot 2024-09-10T09:31:45.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:45 smithi135 ceph-mon[33411]: osdmap e35: 5 total, 5 up, 5 in 2024-09-10T09:31:45.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:45 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:45.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:45 smithi135 ceph-mon[33411]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:45.502 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T09:31:45.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-09-10T09:31:45.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:45 smithi079 ceph-mon[27592]: purged_snaps scrub starts 2024-09-10T09:31:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:45 smithi079 ceph-mon[27592]: purged_snaps scrub ok 2024-09-10T09:31:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:45 smithi079 ceph-mon[27592]: osd.4 [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] boot 2024-09-10T09:31:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:45 smithi079 ceph-mon[27592]: osdmap e35: 5 total, 5 up, 5 in 2024-09-10T09:31:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:31:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:45 smithi079 ceph-mon[27592]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:46.053 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:31:46.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:46 smithi135 ceph-mon[33411]: osdmap e36: 5 total, 5 up, 5 in 2024-09-10T09:31:46.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:46 smithi079 ceph-mon[27592]: osdmap e36: 5 total, 5 up, 5 in 2024-09-10T09:31:47.640 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:47 smithi135 ceph-mon[33411]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:47.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:47 smithi079 ceph-mon[27592]: pgmap v117: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:48.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 -- 172.21.15.135:0/1674496027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 msgr2=0x7fc698101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:48.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 --2- 172.21.15.135:0/1674496027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc698101580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc680009910 tx=0x7fc680009c20 comp rx=0 tx=0).stop 2024-09-10T09:31:48.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 -- 172.21.15.135:0/1674496027 shutdown_connections 2024-09-10T09:31:48.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 --2- 172.21.15.135:0/1674496027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc698101580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:48.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 --2- 172.21.15.135:0/1674496027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6980fe500 0x7fc6980fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:48.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 -- 172.21.15.135:0/1674496027 >> 172.21.15.135:0/1674496027 conn(0x7fc6980f9f10 msgr2=0x7fc6980fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:31:48.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 -- 172.21.15.135:0/1674496027 shutdown_connections 2024-09-10T09:31:48.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 -- 172.21.15.135:0/1674496027 wait complete. 2024-09-10T09:31:48.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.300+0000 7fc69d826700 1 Processor -- start 2024-09-10T09:31:48.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc69d826700 1 -- start start 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc69d826700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6980fe500 0x7fc698100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc69d826700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc6980ff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc69d826700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980ffa70 con 0x7fc6980fe500 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc69d826700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980ffbb0 con 0x7fc6980fee50 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc68e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc6980ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc68e7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc6980ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42866/0 (socket says 172.21.15.135:42866) 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc68e7fc700 1 -- 172.21.15.135:0/3187783607 learned_addr learned my addr 172.21.15.135:0/3187783607 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc696ffd700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6980fe500 0x7fc698100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc68e7fc700 1 -- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6980fe500 msgr2=0x7fc698100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc68e7fc700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6980fe500 0x7fc698100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:31:48.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc68e7fc700 1 -- 172.21.15.135:0/3187783607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800095f0 con 0x7fc6980fee50 2024-09-10T09:31:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.301+0000 7fc68e7fc700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc6980ff530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc68000bd70 tx=0x7fc68000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:31:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.302+0000 7fc69c824700 1 -- 172.21.15.135:0/3187783607 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc68001d070 con 0x7fc6980fee50 2024-09-10T09:31:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.302+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6980ffe30 con 0x7fc6980fee50 2024-09-10T09:31:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.302+0000 7fc69c824700 1 -- 172.21.15.135:0/3187783607 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc68000f460 con 0x7fc6980fee50 2024-09-10T09:31:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.302+0000 7fc69c824700 1 -- 172.21.15.135:0/3187783607 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc680021640 con 0x7fc6980fee50 2024-09-10T09:31:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.302+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc698100320 con 0x7fc6980fee50 2024-09-10T09:31:48.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.303+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc698108d10 con 0x7fc6980fee50 2024-09-10T09:31:48.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.303+0000 7fc69c824700 1 -- 172.21.15.135:0/3187783607 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc68000fa40 con 0x7fc6980fee50 2024-09-10T09:31:48.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.304+0000 7fc69c824700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:31:48.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.304+0000 7fc69c824700 1 -- 172.21.15.135:0/3187783607 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4034+0+0 (secure 0 0 0) 0x7fc68008c5d0 con 0x7fc6980fee50 2024-09-10T09:31:48.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.304+0000 7fc696ffd700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:31:48.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.304+0000 7fc696ffd700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc688005950 tx=0x7fc6880058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:31:48.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.308+0000 7fc69c824700 1 -- 172.21.15.135:0/3187783607 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc68005acd0 con 0x7fc6980fee50 2024-09-10T09:31:48.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:31:48.512+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc69819dfb0 con 0x7fc68406c680 2024-09-10T09:31:49.275 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: Detected new or changed devices on smithi135 2024-09-10T09:31:49.275 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: Adjusting osd_memory_target on smithi135 to 1819M 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:49.276 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.277 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:31:49.277 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:31:49.277 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: Detected new or changed devices on smithi135 2024-09-10T09:31:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: Adjusting osd_memory_target on smithi135 to 1819M 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T09:31:49.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:50.191 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:50 smithi135 ceph-mon[33411]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:31:50.191 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:50 smithi135 ceph-mon[33411]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:50.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:50 smithi079 ceph-mon[27592]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:31:50.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:50 smithi079 ceph-mon[27592]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:51.347 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:51 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/1042865145' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fe6d03f-9515-4ba0-a858-a2529c870692"}]: dispatch 2024-09-10T09:31:51.347 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:51 smithi135 ceph-mon[33411]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fe6d03f-9515-4ba0-a858-a2529c870692"}]: dispatch 2024-09-10T09:31:51.347 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:51 smithi135 ceph-mon[33411]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fe6d03f-9515-4ba0-a858-a2529c870692"}]': finished 2024-09-10T09:31:51.347 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:51 smithi135 ceph-mon[33411]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T09:31:51.347 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:31:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:51 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/1042865145' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fe6d03f-9515-4ba0-a858-a2529c870692"}]: dispatch 2024-09-10T09:31:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:51 smithi079 ceph-mon[27592]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fe6d03f-9515-4ba0-a858-a2529c870692"}]: dispatch 2024-09-10T09:31:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:51 smithi079 ceph-mon[27592]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fe6d03f-9515-4ba0-a858-a2529c870692"}]': finished 2024-09-10T09:31:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:51 smithi079 ceph-mon[27592]: osdmap e37: 6 total, 5 up, 6 in 2024-09-10T09:31:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:31:52.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:52 smithi079 ceph-mon[27592]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:52.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:52 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/2971536019' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:31:52.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:52 smithi135 ceph-mon[33411]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:52.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:52 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/2971536019' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T09:31:54.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:54 smithi079 ceph-mon[27592]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:54.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:54 smithi135 ceph-mon[33411]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:55.172 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:55 smithi135 ceph-mon[33411]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:55 smithi079 ceph-mon[27592]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:56 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:56.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:56 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:31:57.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:57 smithi079 ceph-mon[27592]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:57.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:57 smithi135 ceph-mon[33411]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:58.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T09:31:58.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:58 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:58.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T09:31:58.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:58 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:31:59.813 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:59 smithi135 ceph-mon[33411]: Deploying daemon osd.5 on smithi135 2024-09-10T09:31:59.813 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:31:59 smithi135 ceph-mon[33411]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:31:59.871 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:59 smithi079 ceph-mon[27592]: Deploying daemon osd.5 on smithi135 2024-09-10T09:31:59.871 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:31:59 smithi079 ceph-mon[27592]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:01.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:01 smithi079 ceph-mon[27592]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:01.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:01 smithi135 ceph-mon[33411]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:03.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:03 smithi079 ceph-mon[27592]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:03.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:03.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:03.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:32:03.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:03 smithi135 ceph-mon[33411]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:03.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:03.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:03.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:32:05.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:05 smithi135 ceph-mon[33411]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:05.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:05 smithi079 ceph-mon[27592]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:07.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.425+0000 7fc69c824700 1 -- 172.21.15.135:0/3187783607 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc69819dfb0 con 0x7fc68406c680 2024-09-10T09:32:07.427 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 5 on host 'smithi135' 2024-09-10T09:32:07.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc68406c680 msgr2=0x7fc68406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:07.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc688005950 tx=0x7fc6880058e0 comp rx=0 tx=0).stop 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 msgr2=0x7fc6980ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc6980ff530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc68000bd70 tx=0x7fc68000be50 comp rx=0 tx=0).stop 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 shutdown_connections 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc68406c680 0x7fc68406eb30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6980fe500 0x7fc698100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 --2- 172.21.15.135:0/3187783607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6980fee50 0x7fc6980ff530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.427+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 >> 172.21.15.135:0/3187783607 conn(0x7fc6980f9f10 msgr2=0x7fc6981047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.428+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 shutdown_connections 2024-09-10T09:32:07.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:07.428+0000 7fc69d826700 1 -- 172.21.15.135:0/3187783607 wait complete. 2024-09-10T09:32:07.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:07 smithi079 ceph-mon[27592]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:07.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:07 smithi079 ceph-mon[27592]: from='osd.5 [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:32:07.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:07 smithi079 ceph-mon[27592]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:32:07.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:07.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:07 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:07.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:07 smithi135 ceph-mon[33411]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:07.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:07 smithi135 ceph-mon[33411]: from='osd.5 [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:32:07.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:07 smithi135 ceph-mon[33411]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:32:07.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:07.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:07 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:08.044 DEBUG:teuthology.orchestra.run.smithi135:osd.5> sudo journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T09:32:08.046 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-10T09:32:08.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T09:32:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:08.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:08 smithi079 ceph-mon[27592]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T09:32:08.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:08 smithi079 ceph-mon[27592]: osdmap e38: 6 total, 5 up, 6 in 2024-09-10T09:32:08.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:08 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:08.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:08 smithi079 ceph-mon[27592]: from='osd.5 [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:32:08.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:08 smithi079 ceph-mon[27592]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:32:08.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:08 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:08.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:08 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:08.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-mon[33411]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T09:32:08.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-mon[33411]: osdmap e38: 6 total, 5 up, 6 in 2024-09-10T09:32:08.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:08.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-mon[33411]: from='osd.5 [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:32:08.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-mon[33411]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:32:08.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:08.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:08.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[48730]: 2024-09-10T09:32:08.709+0000 7fe002582700 -1 osd.5 0 waiting for initial osdmap 2024-09-10T09:32:08.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:32:08 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[48730]: 2024-09-10T09:32:08.718+0000 7fdff936d700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:32:09.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 -- 172.21.15.79:0/662885523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fe500 msgr2=0x7fe9940fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 --2- 172.21.15.79:0/662885523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fe500 0x7fe9940fe910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe990009910 tx=0x7fe990009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 -- 172.21.15.79:0/662885523 shutdown_connections 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 --2- 172.21.15.79:0/662885523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9940fee50 0x7fe9940ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 --2- 172.21.15.79:0/662885523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fe500 0x7fe9940fe910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 -- 172.21.15.79:0/662885523 >> 172.21.15.79:0/662885523 conn(0x7fe9940f9f10 msgr2=0x7fe9940fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 -- 172.21.15.79:0/662885523 shutdown_connections 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 -- 172.21.15.79:0/662885523 wait complete. 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 Processor -- start 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 -- start start 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9940fe500 0x7fe99419c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.950+0000 7fe99b956700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fee50 0x7fe99419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:09.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe99b956700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99419cc80 con 0x7fe9940fee50 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe99b956700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99419cdc0 con 0x7fe9940fe500 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe998ef1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fee50 0x7fe99419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe998ef1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fee50 0x7fe99419c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52594/0 (socket says 172.21.15.79:52594) 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe998ef1700 1 -- 172.21.15.79:0/1446603966 learned_addr learned my addr 172.21.15.79:0/1446603966 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe9996f2700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9940fe500 0x7fe99419c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe998ef1700 1 -- 172.21.15.79:0/1446603966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9940fe500 msgr2=0x7fe99419c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe998ef1700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9940fe500 0x7fe99419c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe998ef1700 1 -- 172.21.15.79:0/1446603966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900095f0 con 0x7fe9940fee50 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe998ef1700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fee50 0x7fe99419c660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe98400d8d0 tx=0x7fe98400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe98a7fc700 1 -- 172.21.15.79:0/1446603966 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe98400f860 con 0x7fe9940fee50 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe98a7fc700 1 -- 172.21.15.79:0/1446603966 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe98400fe70 con 0x7fe9940fee50 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9941a1870 con 0x7fe9940fee50 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe98a7fc700 1 -- 172.21.15.79:0/1446603966 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe98400e5e0 con 0x7fe9940fee50 2024-09-10T09:32:09.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.951+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9941a1dc0 con 0x7fe9940fee50 2024-09-10T09:32:09.958 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:09 smithi135 ceph-mon[33411]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:09.958 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:09 smithi135 ceph-mon[33411]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T09:32:09.958 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:09 smithi135 ceph-mon[33411]: osdmap e39: 6 total, 5 up, 6 in 2024-09-10T09:32:09.958 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:09.958 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.952+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99410f340 con 0x7fe9940fee50 2024-09-10T09:32:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.953+0000 7fe98a7fc700 1 -- 172.21.15.79:0/1446603966 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe984010460 con 0x7fe9940fee50 2024-09-10T09:32:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.953+0000 7fe98a7fc700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe98006c680 0x7fe98006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:09.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.953+0000 7fe98a7fc700 1 -- 172.21.15.79:0/1446603966 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe98408af70 con 0x7fe9940fee50 2024-09-10T09:32:09.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.953+0000 7fe9996f2700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe98006c680 0x7fe98006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:09.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.954+0000 7fe9996f2700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe98006c680 0x7fe98006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe990006010 tx=0x7fe99000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:09.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:09.958+0000 7fe98a7fc700 1 -- 172.21.15.79:0/1446603966 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe984059540 con 0x7fe9940fee50 2024-09-10T09:32:10.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:09 smithi079 ceph-mon[27592]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:10.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:09 smithi079 ceph-mon[27592]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T09:32:10.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:09 smithi079 ceph-mon[27592]: osdmap e39: 6 total, 5 up, 6 in 2024-09-10T09:32:10.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:10.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:10.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.151+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fe99410f500 con 0x7fe9940fee50 2024-09-10T09:32:10.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.151+0000 7fe98a7fc700 1 -- 172.21.15.79:0/1446603966 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7fe9840590d0 con 0x7fe9940fee50 2024-09-10T09:32:10.152 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:32:10.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe98006c680 msgr2=0x7fe98006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe98006c680 0x7fe98006eb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe990006010 tx=0x7fe99000b540 comp rx=0 tx=0).stop 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fee50 msgr2=0x7fe99419c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fee50 0x7fe99419c660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe98400d8d0 tx=0x7fe98400dbe0 comp rx=0 tx=0).stop 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 shutdown_connections 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe98006c680 0x7fe98006eb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9940fe500 0x7fe99419c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 --2- 172.21.15.79:0/1446603966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe9940fee50 0x7fe99419c660 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 >> 172.21.15.79:0/1446603966 conn(0x7fe9940f9f10 msgr2=0x7fe994102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 shutdown_connections 2024-09-10T09:32:10.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:10.153+0000 7fe99b956700 1 -- 172.21.15.79:0/1446603966 wait complete. 2024-09-10T09:32:10.857 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1725960729,"num_in_osds":6,"osd_in_since":1725960710,"num_remapped_pgs":0} 2024-09-10T09:32:10.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T09:32:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:10 smithi135 ceph-mon[33411]: purged_snaps scrub starts 2024-09-10T09:32:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:10 smithi135 ceph-mon[33411]: purged_snaps scrub ok 2024-09-10T09:32:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:10 smithi135 ceph-mon[33411]: osd.5 [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] boot 2024-09-10T09:32:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:10 smithi135 ceph-mon[33411]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T09:32:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:10 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:10 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1446603966' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T09:32:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:10 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:11.057 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:11.178 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:10 smithi079 ceph-mon[27592]: purged_snaps scrub starts 2024-09-10T09:32:11.178 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:10 smithi079 ceph-mon[27592]: purged_snaps scrub ok 2024-09-10T09:32:11.178 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:10 smithi079 ceph-mon[27592]: osd.5 [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] boot 2024-09-10T09:32:11.178 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:10 smithi079 ceph-mon[27592]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T09:32:11.178 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:10 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:32:11.178 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:10 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1446603966' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T09:32:11.178 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:10 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:11.885 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:11.886 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:32:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: osdmap e41: 6 total, 6 up, 6 in 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:12.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:32:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 -- 172.21.15.79:0/2167400127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101d30 msgr2=0x7fb67410a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 --2- 172.21.15.79:0/2167400127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101d30 0x7fb67410a230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb668009940 tx=0x7fb668009c50 comp rx=0 tx=0).stop 2024-09-10T09:32:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 -- 172.21.15.79:0/2167400127 shutdown_connections 2024-09-10T09:32:12.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 --2- 172.21.15.79:0/2167400127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101d30 0x7fb67410a230 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 --2- 172.21.15.79:0/2167400127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb674101420 0x7fb6741017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 -- 172.21.15.79:0/2167400127 >> 172.21.15.79:0/2167400127 conn(0x7fb6740fac60 msgr2=0x7fb6740fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 -- 172.21.15.79:0/2167400127 shutdown_connections 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 -- 172.21.15.79:0/2167400127 wait complete. 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 Processor -- start 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.701+0000 7fb679b6d700 1 -- start start 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb679b6d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101420 0x7fb674195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb679b6d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb674101d30 0x7fb6741964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb679b6d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb674196bb0 con 0x7fb674101420 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb679b6d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67419a8f0 con 0x7fb674101d30 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb6737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101420 0x7fb674195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb6737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101420 0x7fb674195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42046/0 (socket says 172.21.15.79:42046) 2024-09-10T09:32:12.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb6737fe700 1 -- 172.21.15.79:0/3669870088 learned_addr learned my addr 172.21.15.79:0/3669870088 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb672ffd700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb674101d30 0x7fb6741964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb6737fe700 1 -- 172.21.15.79:0/3669870088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb674101d30 msgr2=0x7fb6741964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb6737fe700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb674101d30 0x7fb6741964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb6737fe700 1 -- 172.21.15.79:0/3669870088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6680095f0 con 0x7fb674101420 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb6737fe700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101420 0x7fb674195f90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb66400ba50 tx=0x7fb66400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb670ff9700 1 -- 172.21.15.79:0/3669870088 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb66400c900 con 0x7fb674101420 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67419abd0 con 0x7fb674101420 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb670ff9700 1 -- 172.21.15.79:0/3669870088 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb664014440 con 0x7fb674101420 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb670ff9700 1 -- 172.21.15.79:0/3669870088 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6640075a0 con 0x7fb674101420 2024-09-10T09:32:12.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.702+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67419b0f0 con 0x7fb674101420 2024-09-10T09:32:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.704+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6741078a0 con 0x7fb674101420 2024-09-10T09:32:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.704+0000 7fb670ff9700 1 -- 172.21.15.79:0/3669870088 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb66400ca60 con 0x7fb674101420 2024-09-10T09:32:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.704+0000 7fb670ff9700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb65c06c680 0x7fb65c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.704+0000 7fb670ff9700 1 -- 172.21.15.79:0/3669870088 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fb664006e40 con 0x7fb674101420 2024-09-10T09:32:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.704+0000 7fb672ffd700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb65c06c680 0x7fb65c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:12.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.705+0000 7fb672ffd700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb65c06c680 0x7fb65c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb668005f50 tx=0x7fb668005dc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:12.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.709+0000 7fb670ff9700 1 -- 172.21.15.79:0/3669870088 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb66404e720 con 0x7fb674101420 2024-09-10T09:32:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.901+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb67404f2a0 con 0x7fb674101420 2024-09-10T09:32:12.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.902+0000 7fb670ff9700 1 -- 172.21.15.79:0/3669870088 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7fb664055760 con 0x7fb674101420 2024-09-10T09:32:12.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:32:12.903 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","created":"2024-09-10T09:26:33.405835+0000","modified":"2024-09-10T09:32:10.713102+0000","last_up_change":"2024-09-10T09:32:09.706990+0000","last_in_change":"2024-09-10T09:31:50.963561+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:30:56.906015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1eb8d86f-bc7e-4148-bf65-fcfd28de756d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6803","nonce":3768365969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6805","nonce":3768365969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6809","nonce":3768365969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6807","nonce":3768365969}]},"public_addr":"172.21.15.79:6803/3768365969","cluster_addr":"172.21.15.79:6805/3768365969","heartbeat_back_addr":"172.21.15.79:6809/3768365969","heartbeat_front_addr":"172.21.15.79:6807/3768365969","state":["exists","up"]},{"osd":1,"uuid":"bcaebb19-e24f-4243-baa7-1d678a9d0a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6811","nonce":1923230193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6813","nonce":1923230193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6817","nonce":1923230193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6815","nonce":1923230193}]},"public_addr":"172.21.15.79:6811/1923230193","cluster_addr":"172.21.15.79:6813/1923230193","heartbeat_back_addr":"172.21.15.79:6817/1923230193","heartbeat_front_addr":"172.21.15.79:6815/1923230193","state":["exists","up"]},{"osd":2,"uuid":"52ffae68-ccfd-45fb-b1b3-d26feca92970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6819","nonce":151150189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6821","nonce":151150189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6825","nonce":151150189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6823","nonce":151150189}]},"public_addr":"172.21.15.79:6819/151150189","cluster_addr":"172.21.15.79:6821/151150189","heartbeat_back_addr":"172.21.15.79:6825/151150189","heartbeat_front_addr":"172.21.15.79:6823/151150189","state":["exists","up"]},{"osd":3,"uuid":"32be0838-5190-4679-80ae-7837d3efeec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6801","nonce":3565821318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6803","nonce":3565821318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6807","nonce":3565821318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6805","nonce":3565821318}]},"public_addr":"172.21.15.135:6801/3565821318","cluster_addr":"172.21.15.135:6803/3565821318","heartbeat_back_addr":"172.21.15.135:6807/3565821318","heartbeat_front_addr":"172.21.15.135:6805/3565821318","state":["exists","up"]},{"osd":4,"uuid":"dca8c952-8389-4ed9-bb93-38361592b330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6809","nonce":4092128240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6811","nonce":4092128240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6815","nonce":4092128240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6813","nonce":4092128240}]},"public_addr":"172.21.15.135:6809/4092128240","cluster_addr":"172.21.15.135:6811/4092128240","heartbeat_back_addr":"172.21.15.135:6815/4092128240","heartbeat_front_addr":"172.21.15.135:6813/4092128240","state":["exists","up"]},{"osd":5,"uuid":"8fe6d03f-9515-4ba0-a858-a2529c870692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6817","nonce":3520058192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6819","nonce":3520058192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6823","nonce":3520058192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6821","nonce":3520058192}]},"public_addr":"172.21.15.135:6817/3520058192","cluster_addr":"172.21.15.135:6819/3520058192","heartbeat_back_addr":"172.21.15.135:6823/3520058192","heartbeat_front_addr":"172.21.15.135:6821/3520058192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:29:57.236478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:30:25.904088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:30:53.933647+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:31:17.544219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:31:42.505333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:32:08.360656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1985948133":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/1268167286":"2024-09-11T09:27:33.747139+0000","172.21.15.79:6801/2":"2024-09-11T09:27:01.091778+0000","172.21.15.79:6800/2":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/3646919951":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/1657459337":"2024-09-11T09:27:33.747139+0000","172.21.15.79:0/897136131":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/4287758029":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/3342987250":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/2095060336":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/250070562":"2024-09-11T09:27:33.747139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb65c06c680 msgr2=0x7fb65c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb65c06c680 0x7fb65c06eb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb668005f50 tx=0x7fb668005dc0 comp rx=0 tx=0).stop 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101420 msgr2=0x7fb674195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101420 0x7fb674195f90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb66400ba50 tx=0x7fb66400bd60 comp rx=0 tx=0).stop 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 shutdown_connections 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb65c06c680 0x7fb65c06eb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb674101420 0x7fb674195f90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 --2- 172.21.15.79:0/3669870088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb674101d30 0x7fb6741964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 >> 172.21.15.79:0/3669870088 conn(0x7fb6740fac60 msgr2=0x7fb6741049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 shutdown_connections 2024-09-10T09:32:12.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:12.904+0000 7fb679b6d700 1 -- 172.21.15.79:0/3669870088 wait complete. 2024-09-10T09:32:13.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:12 smithi079 ceph-mon[27592]: Detected new or changed devices on smithi135 2024-09-10T09:32:13.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:12 smithi079 ceph-mon[27592]: Adjusting osd_memory_target on smithi135 to 1213M 2024-09-10T09:32:13.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:32:13.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:32:13.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:12 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:13.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:12 smithi135 ceph-mon[33411]: Detected new or changed devices on smithi135 2024-09-10T09:32:13.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:12 smithi135 ceph-mon[33411]: Adjusting osd_memory_target on smithi135 to 1213M 2024-09-10T09:32:13.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:32:13.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:32:13.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:12 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:32:13.590 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T09:30:56.906015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T09:32:13.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T09:32:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:13.909 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:13 smithi079 ceph-mon[27592]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:13.909 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:13 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3669870088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T09:32:14.119 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:13 smithi135 ceph-mon[33411]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:14.119 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:13 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/3669870088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T09:32:15.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 -- 172.21.15.79:0/2342008426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 msgr2=0x7f6e7c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:15.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 --2- 172.21.15.79:0/2342008426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c0ff720 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00b0a0 tx=0x7f6e6c00b3b0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 -- 172.21.15.79:0/2342008426 shutdown_connections 2024-09-10T09:32:15.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 --2- 172.21.15.79:0/2342008426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7c0ffc60 0x7f6e7c10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 --2- 172.21.15.79:0/2342008426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c0ff720 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 -- 172.21.15.79:0/2342008426 >> 172.21.15.79:0/2342008426 conn(0x7f6e7c0748b0 msgr2=0x7f6e7c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:15.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 -- 172.21.15.79:0/2342008426 shutdown_connections 2024-09-10T09:32:15.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.392+0000 7f6e809e2700 1 -- 172.21.15.79:0/2342008426 wait complete. 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e809e2700 1 Processor -- start 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e809e2700 1 -- start start 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e809e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e809e2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7c0ffc60 0x7f6e7c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e809e2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c196a30 con 0x7f6e7c0ff350 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e809e2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c196b70 con 0x7f6e7c0ffc60 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:15.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42070/0 (socket says 172.21.15.79:42070) 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.393+0000 7f6e7a59c700 1 -- 172.21.15.79:0/1573543151 learned_addr learned my addr 172.21.15.79:0/1573543151 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e7a59c700 1 -- 172.21.15.79:0/1573543151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7c0ffc60 msgr2=0x7f6e7c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e79d9b700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7c0ffc60 0x7f6e7c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e7a59c700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7c0ffc60 0x7f6e7c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e7a59c700 1 -- 172.21.15.79:0/1573543151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c009d00 con 0x7f6e7c0ff350 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e79d9b700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7c0ffc60 0x7f6e7c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e7a59c700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c195ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006130 tx=0x7f6e6c00cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e6b7fe700 1 -- 172.21.15.79:0/1573543151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e6c00e040 con 0x7f6e7c0ff350 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e6b7fe700 1 -- 172.21.15.79:0/1573543151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6e6c003e60 con 0x7f6e7c0ff350 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c19a960 con 0x7f6e7c0ff350 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e6b7fe700 1 -- 172.21.15.79:0/1573543151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e6c01d930 con 0x7f6e7c0ff350 2024-09-10T09:32:15.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.394+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c19ae50 con 0x7f6e7c0ff350 2024-09-10T09:32:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.395+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7c04f2a0 con 0x7f6e7c0ff350 2024-09-10T09:32:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.396+0000 7f6e6b7fe700 1 -- 172.21.15.79:0/1573543151 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6e6c004880 con 0x7f6e7c0ff350 2024-09-10T09:32:15.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.396+0000 7f6e6b7fe700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e6406c680 0x7f6e6406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.396+0000 7f6e6b7fe700 1 -- 172.21.15.79:0/1573543151 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f6e6c08cfd0 con 0x7f6e7c0ff350 2024-09-10T09:32:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.396+0000 7f6e79d9b700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e6406c680 0x7f6e6406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:15.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.396+0000 7f6e79d9b700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e6406c680 0x7f6e6406eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e70005fd0 tx=0x7f6e70005e20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:15.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.401+0000 7f6e6b7fe700 1 -- 172.21.15.79:0/1573543151 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6e6c057a90 con 0x7f6e7c0ff350 2024-09-10T09:32:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.591+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e7c107850 con 0x7f6e7c0ff350 2024-09-10T09:32:15.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.591+0000 7f6e6b7fe700 1 -- 172.21.15.79:0/1573543151 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e6c05b0b0 con 0x7f6e7c0ff350 2024-09-10T09:32:15.593 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e6406c680 msgr2=0x7f6e6406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e6406c680 0x7f6e6406eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e70005fd0 tx=0x7f6e70005e20 comp rx=0 tx=0).stop 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 msgr2=0x7f6e7c195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c195ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006130 tx=0x7f6e6c00cdd0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 shutdown_connections 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f6e6406c680 0x7f6e6406eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e7c0ff350 0x7f6e7c195ea0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 --2- 172.21.15.79:0/1573543151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e7c0ffc60 0x7f6e7c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 >> 172.21.15.79:0/1573543151 conn(0x7f6e7c0748b0 msgr2=0x7f6e7c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:15.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 shutdown_connections 2024-09-10T09:32:15.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:15.594+0000 7f6e809e2700 1 -- 172.21.15.79:0/1573543151 wait complete. 2024-09-10T09:32:15.951 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:15 smithi079 ceph-mon[27592]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:15.951 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:15 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1573543151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T09:32:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:15 smithi135 ceph-mon[33411]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:15 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1573543151' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T09:32:16.369 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T09:32:16.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T09:32:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:17.904 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:17 smithi079 ceph-mon[27592]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 -- 172.21.15.79:0/1939746261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 msgr2=0x7fa970100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 --2- 172.21.15.79:0/1939746261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa970100860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa964009910 tx=0x7fa964009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 -- 172.21.15.79:0/1939746261 shutdown_connections 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 --2- 172.21.15.79:0/1939746261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa970100860 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 --2- 172.21.15.79:0/1939746261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9700ff150 0x7fa9700ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 -- 172.21.15.79:0/1939746261 >> 172.21.15.79:0/1939746261 conn(0x7fa9700fa7a0 msgr2=0x7fa9700fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 -- 172.21.15.79:0/1939746261 shutdown_connections 2024-09-10T09:32:18.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 -- 172.21.15.79:0/1939746261 wait complete. 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 Processor -- start 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.156+0000 7fa976301700 1 -- start start 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa976301700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9700ff150 0x7fa970103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa976301700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa9701017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa976301700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970101d10 con 0x7fa9701003f0 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa976301700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970101e50 con 0x7fa9700ff150 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa9701017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa9701017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42084/0 (socket says 172.21.15.79:42084) 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96f7fe700 1 -- 172.21.15.79:0/542669228 learned_addr learned my addr 172.21.15.79:0/542669228 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96ffff700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9700ff150 0x7fa970103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96f7fe700 1 -- 172.21.15.79:0/542669228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9700ff150 msgr2=0x7fa970103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:18.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96f7fe700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9700ff150 0x7fa970103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:18.160 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96f7fe700 1 -- 172.21.15.79:0/542669228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9640095f0 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.157+0000 7fa96f7fe700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa9701017d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa964006010 tx=0x7fa96400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.158+0000 7fa96d7fa700 1 -- 172.21.15.79:0/542669228 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96401d070 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.158+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9701020d0 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.158+0000 7fa96d7fa700 1 -- 172.21.15.79:0/542669228 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa96400f460 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.158+0000 7fa96d7fa700 1 -- 172.21.15.79:0/542669228 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa964021640 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.158+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9701025c0 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.159+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa970068ab0 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.159+0000 7fa96d7fa700 1 -- 172.21.15.79:0/542669228 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa96400fab0 con 0x7fa9701003f0 2024-09-10T09:32:18.161 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.160+0000 7fa96d7fa700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa95806c680 0x7fa95806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.160+0000 7fa96ffff700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa95806c680 0x7fa95806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.160+0000 7fa96d7fa700 1 -- 172.21.15.79:0/542669228 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fa96408c6f0 con 0x7fa9701003f0 2024-09-10T09:32:18.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.160+0000 7fa96ffff700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa95806c680 0x7fa95806eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa960005950 tx=0x7fa96000b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:18.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.164+0000 7fa96d7fa700 1 -- 172.21.15.79:0/542669228 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa96405ac40 con 0x7fa9701003f0 2024-09-10T09:32:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:17 smithi135 ceph-mon[33411]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:18.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.440+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fa97019dee0 con 0x7fa9701003f0 2024-09-10T09:32:18.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.444+0000 7fa96d7fa700 1 -- 172.21.15.79:0/542669228 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fa96405a7d0 con 0x7fa9701003f0 2024-09-10T09:32:18.445 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-09-10T09:32:18.445 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAiEuBm9yZUGhAALSnV/LDPLe6HjYm+1PPcDA== 2024-09-10T09:32:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa95806c680 msgr2=0x7fa95806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa95806c680 0x7fa95806eb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa960005950 tx=0x7fa96000b410 comp rx=0 tx=0).stop 2024-09-10T09:32:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 msgr2=0x7fa9701017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:18.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa9701017d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa964006010 tx=0x7fa96400bd70 comp rx=0 tx=0).stop 2024-09-10T09:32:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 shutdown_connections 2024-09-10T09:32:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa95806c680 0x7fa95806eb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9700ff150 0x7fa970103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 --2- 172.21.15.79:0/542669228 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9701003f0 0x7fa9701017d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 >> 172.21.15.79:0/542669228 conn(0x7fa9700fa7a0 msgr2=0x7fa970068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 shutdown_connections 2024-09-10T09:32:18.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:18.446+0000 7fa976301700 1 -- 172.21.15.79:0/542669228 wait complete. 2024-09-10T09:32:19.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:18 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/542669228' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T09:32:19.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:18 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/542669228' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T09:32:19.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:18 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/542669228' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T09:32:19.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:18 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/542669228' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T09:32:19.282 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:32:19.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T09:32:19.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T09:32:19.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T09:32:19.533 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi135/config 2024-09-10T09:32:19.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:19 smithi135 ceph-mon[33411]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:20.076 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:19 smithi079 ceph-mon[27592]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:21.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 -- 172.21.15.135:0/1219319395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374101440 msgr2=0x7fc374101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 --2- 172.21.15.135:0/1219319395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374101440 0x7fc374101890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc368009910 tx=0x7fc368009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 -- 172.21.15.135:0/1219319395 shutdown_connections 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 --2- 172.21.15.135:0/1219319395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374101440 0x7fc374101890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 --2- 172.21.15.135:0/1219319395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374100240 0x7fc374100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 -- 172.21.15.135:0/1219319395 >> 172.21.15.135:0/1219319395 conn(0x7fc3740fb7f0 msgr2=0x7fc3740fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 -- 172.21.15.135:0/1219319395 shutdown_connections 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 -- 172.21.15.135:0/1219319395 wait complete. 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.141+0000 7fc37c713700 1 Processor -- start 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37c713700 1 -- start start 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37c713700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374100240 0x7fc374195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37c713700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374101440 0x7fc374195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:21.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37c713700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc374196610 con 0x7fc374101440 2024-09-10T09:32:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37c713700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc374196750 con 0x7fc374100240 2024-09-10T09:32:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37a4af700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374100240 0x7fc374195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37a4af700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374100240 0x7fc374195ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39614/0 (socket says 172.21.15.135:39614) 2024-09-10T09:32:21.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37a4af700 1 -- 172.21.15.135:0/3831102355 learned_addr learned my addr 172.21.15.135:0/3831102355 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37a4af700 1 -- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374101440 msgr2=0x7fc374195ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37a4af700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374101440 0x7fc374195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37a4af700 1 -- 172.21.15.135:0/3831102355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680095f0 con 0x7fc374100240 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37a4af700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374100240 0x7fc374195ab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc37000c8f0 tx=0x7fc37000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc3677fe700 1 -- 172.21.15.135:0/3831102355 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc370007a70 con 0x7fc374100240 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc3677fe700 1 -- 172.21.15.135:0/3831102355 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc370007bd0 con 0x7fc374100240 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37419b200 con 0x7fc374100240 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc3677fe700 1 -- 172.21.15.135:0/3831102355 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc370018630 con 0x7fc374100240 2024-09-10T09:32:21.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.142+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37419b750 con 0x7fc374100240 2024-09-10T09:32:21.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.143+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc374108d90 con 0x7fc374100240 2024-09-10T09:32:21.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.144+0000 7fc3677fe700 1 -- 172.21.15.135:0/3831102355 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc37000f450 con 0x7fc374100240 2024-09-10T09:32:21.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.144+0000 7fc3677fe700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc36006c680 0x7fc36006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:21.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.145+0000 7fc3677fe700 1 -- 172.21.15.135:0/3831102355 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fc37008b3e0 con 0x7fc374100240 2024-09-10T09:32:21.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.145+0000 7fc379cae700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc36006c680 0x7fc36006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:21.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.145+0000 7fc379cae700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc36006c680 0x7fc36006eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc36800b5c0 tx=0x7fc368005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:21.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.149+0000 7fc3677fe700 1 -- 172.21.15.135:0/3831102355 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc370059a60 con 0x7fc374100240 2024-09-10T09:32:21.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.414+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc37419bdf0 con 0x7fc374100240 2024-09-10T09:32:21.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.421+0000 7fc3677fe700 1 -- 172.21.15.135:0/3831102355 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fc3700595f0 con 0x7fc374100240 2024-09-10T09:32:21.422 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2024-09-10T09:32:21.422 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQAlEuBmWZfJGBAAL/0ITIrcMjCu32KsXOy76Q== 2024-09-10T09:32:21.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc36006c680 msgr2=0x7fc36006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:21.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc36006c680 0x7fc36006eb30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc36800b5c0 tx=0x7fc368005fd0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374100240 msgr2=0x7fc374195ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:21.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374100240 0x7fc374195ab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc37000c8f0 tx=0x7fc37000ccb0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 shutdown_connections 2024-09-10T09:32:21.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc36006c680 0x7fc36006eb30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc374100240 0x7fc374195ab0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 --2- 172.21.15.135:0/3831102355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc374101440 0x7fc374195ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:21.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 >> 172.21.15.135:0/3831102355 conn(0x7fc3740fb7f0 msgr2=0x7fc374104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:21.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 shutdown_connections 2024-09-10T09:32:21.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:32:21.423+0000 7fc37c713700 1 -- 172.21.15.135:0/3831102355 wait complete. 2024-09-10T09:32:22.132 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:21 smithi135 ceph-mon[33411]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:22.132 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:21 smithi135 ceph-mon[33411]: from='client.? 172.21.15.135:0/3831102355' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T09:32:22.133 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:21 smithi135 ceph-mon[33411]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T09:32:22.133 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:21 smithi135 ceph-mon[33411]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T09:32:22.155 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:32:22.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-10T09:32:22.155 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T09:32:22.194 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T09:32:22.194 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T09:32:22.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T09:32:22.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:21 smithi079 ceph-mon[27592]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:22.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:21 smithi079 ceph-mon[27592]: from='client.? 172.21.15.135:0/3831102355' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T09:32:22.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:21 smithi079 ceph-mon[27592]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T09:32:22.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:21 smithi079 ceph-mon[27592]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T09:32:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:23.842 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:23 smithi079 ceph-mon[27592]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:24.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 -- 172.21.15.79:0/1831588946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 msgr2=0x7f17840ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 --2- 172.21.15.79:0/1831588946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f17840ff7c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1778009910 tx=0x7f1778009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 -- 172.21.15.79:0/1831588946 shutdown_connections 2024-09-10T09:32:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 --2- 172.21.15.79:0/1831588946 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f17840ff7c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 --2- 172.21.15.79:0/1831588946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17841038b0 0x7f1784103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 -- 172.21.15.79:0/1831588946 >> 172.21.15.79:0/1831588946 conn(0x7f17840748b0 msgr2=0x7f1784074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 -- 172.21.15.79:0/1831588946 shutdown_connections 2024-09-10T09:32:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.084+0000 7f178a2c1700 1 -- 172.21.15.79:0/1831588946 wait complete. 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.085+0000 7f178a2c1700 1 Processor -- start 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.085+0000 7f178a2c1700 1 -- start start 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f178a2c1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f1784194dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f178a2c1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17841038b0 0x7f1784195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f178a2c1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1784195960 con 0x7f17840ff350 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f178a2c1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1784195aa0 con 0x7f17841038b0 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f1783fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f1784194dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f1783fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f1784194dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41570/0 (socket says 172.21.15.79:41570) 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f1783fff700 1 -- 172.21.15.79:0/343555880 learned_addr learned my addr 172.21.15.79:0/343555880 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f17837fe700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17841038b0 0x7f1784195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:24.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f1783fff700 1 -- 172.21.15.79:0/343555880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17841038b0 msgr2=0x7f1784195310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f1783fff700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17841038b0 0x7f1784195310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f1783fff700 1 -- 172.21.15.79:0/343555880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780095f0 con 0x7f17840ff350 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f1783fff700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f1784194dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f177400c930 tx=0x7f177400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f17817fa700 1 -- 172.21.15.79:0/343555880 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1774007ad0 con 0x7f17840ff350 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f17817fa700 1 -- 172.21.15.79:0/343555880 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1774007c30 con 0x7f17840ff350 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17841998a0 con 0x7f17840ff350 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.086+0000 7f17817fa700 1 -- 172.21.15.79:0/343555880 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1774018630 con 0x7f17840ff350 2024-09-10T09:32:24.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.087+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784199df0 con 0x7f17840ff350 2024-09-10T09:32:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.088+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1784107530 con 0x7f17840ff350 2024-09-10T09:32:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.088+0000 7f17817fa700 1 -- 172.21.15.79:0/343555880 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f177400f450 con 0x7f17840ff350 2024-09-10T09:32:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.088+0000 7f17817fa700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f176c06c680 0x7f176c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.089+0000 7f17817fa700 1 -- 172.21.15.79:0/343555880 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f177408b6a0 con 0x7f17840ff350 2024-09-10T09:32:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.089+0000 7f17837fe700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f176c06c680 0x7f176c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.089+0000 7f17837fe700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f176c06c680 0x7f176c06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f177800b5c0 tx=0x7f177801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:24.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.093+0000 7f17817fa700 1 -- 172.21.15.79:0/343555880 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1774056160 con 0x7f17840ff350 2024-09-10T09:32:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:23 smithi135 ceph-mon[33411]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:24.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.336+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f17841961b0 con 0x7f17840ff350 2024-09-10T09:32:24.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.339+0000 7f17817fa700 1 -- 172.21.15.79:0/343555880 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+172827 (secure 0 0 0) 0x7f1774059780 con 0x7f17840ff350 2024-09-10T09:32:24.343 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.341+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f176c06c680 msgr2=0x7f176c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.341+0000 7f178a2c1700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f176c06c680 0x7f176c06eb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f177800b5c0 tx=0x7f177801a040 comp rx=0 tx=0).stop 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 msgr2=0x7f1784194dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f1784194dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f177400c930 tx=0x7f177400ccf0 comp rx=0 tx=0).stop 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 shutdown_connections 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f176c06c680 0x7f176c06eb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17840ff350 0x7f1784194dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 --2- 172.21.15.79:0/343555880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17841038b0 0x7f1784195310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 >> 172.21.15.79:0/343555880 conn(0x7f17840748b0 msgr2=0x7f1784104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 shutdown_connections 2024-09-10T09:32:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:24.342+0000 7f178a2c1700 1 -- 172.21.15.79:0/343555880 wait complete. 2024-09-10T09:32:25.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:24 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/343555880' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T09:32:25.096 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":19,"active_gid":14213,"active_name":"smithi079.mhirny","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2},{"type":"v1","addr":"172.21.15.79:6801","nonce":2}]},"active_addr":"172.21.15.79:6801/2","active_change":"2024-09-10T09:28:40.595786+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14234,"name":"smithi135.lbhjof","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.79:8443/","prometheus":"http://172.21.15.79:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2331707006}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":4092786036}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2967164301}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":136481957}]}]} 2024-09-10T09:32:25.100 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T09:32:25.100 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T09:32:25.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T09:32:25.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:24 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/343555880' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T09:32:25.333 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:26.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:25 smithi079 ceph-mon[27592]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:26.105 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:25 smithi135 ceph-mon[33411]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 -- 172.21.15.79:0/2980562865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101420 msgr2=0x7f625c1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 --2- 172.21.15.79:0/2980562865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101420 0x7f625c1017f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f624c009910 tx=0x7f624c009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 -- 172.21.15.79:0/2980562865 shutdown_connections 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 --2- 172.21.15.79:0/2980562865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625c101d30 0x7f625c10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 --2- 172.21.15.79:0/2980562865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101420 0x7f625c1017f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 -- 172.21.15.79:0/2980562865 >> 172.21.15.79:0/2980562865 conn(0x7f625c0fac80 msgr2=0x7f625c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 -- 172.21.15.79:0/2980562865 shutdown_connections 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.059+0000 7f626119c700 1 -- 172.21.15.79:0/2980562865 wait complete. 2024-09-10T09:32:27.062 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.060+0000 7f626119c700 1 Processor -- start 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.060+0000 7f626119c700 1 -- start start 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f626119c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625c101420 0x7f625c0ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f626119c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101d30 0x7f625c0ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f626119c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0ffb00 con 0x7f625c101d30 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f626119c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0ffc40 con 0x7f625c101420 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101d30 0x7f625c0ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101d30 0x7f625c0ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41590/0 (socket says 172.21.15.79:41590) 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625a59c700 1 -- 172.21.15.79:0/4125420395 learned_addr learned my addr 172.21.15.79:0/4125420395 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625ad9d700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625c101420 0x7f625c0ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:27.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625a59c700 1 -- 172.21.15.79:0/4125420395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625c101420 msgr2=0x7f625c0ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625a59c700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625c101420 0x7f625c0ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625a59c700 1 -- 172.21.15.79:0/4125420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0095f0 con 0x7f625c101d30 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f625a59c700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101d30 0x7f625c0ff5c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f625000d8d0 tx=0x7f625000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f6243fff700 1 -- 172.21.15.79:0/4125420395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62500098a0 con 0x7f625c101d30 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f6243fff700 1 -- 172.21.15.79:0/4125420395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6250010460 con 0x7f625c101d30 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c1a2040 con 0x7f625c101d30 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.061+0000 7f6243fff700 1 -- 172.21.15.79:0/4125420395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625000f5f0 con 0x7f625c101d30 2024-09-10T09:32:27.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.062+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c1a2450 con 0x7f625c101d30 2024-09-10T09:32:27.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.063+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c107900 con 0x7f625c101d30 2024-09-10T09:32:27.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.063+0000 7f6243fff700 1 -- 172.21.15.79:0/4125420395 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f6250009a00 con 0x7f625c101d30 2024-09-10T09:32:27.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.064+0000 7f6243fff700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f624406c680 0x7f624406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:27.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.064+0000 7f6243fff700 1 -- 172.21.15.79:0/4125420395 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f625008b370 con 0x7f625c101d30 2024-09-10T09:32:27.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.064+0000 7f625ad9d700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f624406c680 0x7f624406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:27.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.064+0000 7f625ad9d700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f624406c680 0x7f624406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f624c006010 tx=0x7f624c01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:27.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.068+0000 7f6243fff700 1 -- 172.21.15.79:0/4125420395 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f6250055e30 con 0x7f625c101d30 2024-09-10T09:32:27.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.259+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f625c0ffe00 con 0x7f625c101d30 2024-09-10T09:32:27.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.260+0000 7f6243fff700 1 -- 172.21.15.79:0/4125420395 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7f625c0ffe00 con 0x7f625c101d30 2024-09-10T09:32:27.262 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:32:27.262 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","created":"2024-09-10T09:26:33.405835+0000","modified":"2024-09-10T09:32:10.713102+0000","last_up_change":"2024-09-10T09:32:09.706990+0000","last_in_change":"2024-09-10T09:31:50.963561+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:30:56.906015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1eb8d86f-bc7e-4148-bf65-fcfd28de756d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6803","nonce":3768365969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6805","nonce":3768365969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6809","nonce":3768365969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6807","nonce":3768365969}]},"public_addr":"172.21.15.79:6803/3768365969","cluster_addr":"172.21.15.79:6805/3768365969","heartbeat_back_addr":"172.21.15.79:6809/3768365969","heartbeat_front_addr":"172.21.15.79:6807/3768365969","state":["exists","up"]},{"osd":1,"uuid":"bcaebb19-e24f-4243-baa7-1d678a9d0a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6811","nonce":1923230193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6813","nonce":1923230193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6817","nonce":1923230193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6815","nonce":1923230193}]},"public_addr":"172.21.15.79:6811/1923230193","cluster_addr":"172.21.15.79:6813/1923230193","heartbeat_back_addr":"172.21.15.79:6817/1923230193","heartbeat_front_addr":"172.21.15.79:6815/1923230193","state":["exists","up"]},{"osd":2,"uuid":"52ffae68-ccfd-45fb-b1b3-d26feca92970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6819","nonce":151150189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6821","nonce":151150189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6825","nonce":151150189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6823","nonce":151150189}]},"public_addr":"172.21.15.79:6819/151150189","cluster_addr":"172.21.15.79:6821/151150189","heartbeat_back_addr":"172.21.15.79:6825/151150189","heartbeat_front_addr":"172.21.15.79:6823/151150189","state":["exists","up"]},{"osd":3,"uuid":"32be0838-5190-4679-80ae-7837d3efeec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6801","nonce":3565821318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6803","nonce":3565821318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6807","nonce":3565821318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6805","nonce":3565821318}]},"public_addr":"172.21.15.135:6801/3565821318","cluster_addr":"172.21.15.135:6803/3565821318","heartbeat_back_addr":"172.21.15.135:6807/3565821318","heartbeat_front_addr":"172.21.15.135:6805/3565821318","state":["exists","up"]},{"osd":4,"uuid":"dca8c952-8389-4ed9-bb93-38361592b330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6809","nonce":4092128240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6811","nonce":4092128240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6815","nonce":4092128240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6813","nonce":4092128240}]},"public_addr":"172.21.15.135:6809/4092128240","cluster_addr":"172.21.15.135:6811/4092128240","heartbeat_back_addr":"172.21.15.135:6815/4092128240","heartbeat_front_addr":"172.21.15.135:6813/4092128240","state":["exists","up"]},{"osd":5,"uuid":"8fe6d03f-9515-4ba0-a858-a2529c870692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6817","nonce":3520058192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6819","nonce":3520058192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6823","nonce":3520058192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6821","nonce":3520058192}]},"public_addr":"172.21.15.135:6817/3520058192","cluster_addr":"172.21.15.135:6819/3520058192","heartbeat_back_addr":"172.21.15.135:6823/3520058192","heartbeat_front_addr":"172.21.15.135:6821/3520058192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:29:57.236478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:30:25.904088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:30:53.933647+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:31:17.544219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:31:42.505333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:32:08.360656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1985948133":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/1268167286":"2024-09-11T09:27:33.747139+0000","172.21.15.79:6801/2":"2024-09-11T09:27:01.091778+0000","172.21.15.79:6800/2":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/3646919951":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/1657459337":"2024-09-11T09:27:33.747139+0000","172.21.15.79:0/897136131":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/4287758029":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/3342987250":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/2095060336":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/250070562":"2024-09-11T09:27:33.747139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f624406c680 msgr2=0x7f624406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f624406c680 0x7f624406eb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f624c006010 tx=0x7f624c01a040 comp rx=0 tx=0).stop 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101d30 msgr2=0x7f625c0ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101d30 0x7f625c0ff5c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f625000d8d0 tx=0x7f625000dbe0 comp rx=0 tx=0).stop 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 shutdown_connections 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f624406c680 0x7f624406eb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625c101420 0x7f625c0ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 --2- 172.21.15.79:0/4125420395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f625c101d30 0x7f625c0ff5c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 >> 172.21.15.79:0/4125420395 conn(0x7f625c0fac80 msgr2=0x7f625c104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 shutdown_connections 2024-09-10T09:32:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:27.262+0000 7f626119c700 1 -- 172.21.15.79:0/4125420395 wait complete. 2024-09-10T09:32:27.961 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T09:32:27.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T09:32:27.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:27 smithi079 ceph-mon[27592]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:27.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:27 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/4125420395' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T09:32:28.159 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:27 smithi135 ceph-mon[33411]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:28.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:27 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/4125420395' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T09:32:29.799 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:29 smithi135 ceph-mon[33411]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:29.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:29 smithi079 ceph-mon[27592]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:29.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 -- 172.21.15.79:0/3791129998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e40730f0 msgr2=0x7f35e40734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/3791129998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e40730f0 0x7f35e40734c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009910 tx=0x7f35d8009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 -- 172.21.15.79:0/3791129998 shutdown_connections 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/3791129998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e4073a00 0x7f35e4110d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/3791129998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e40730f0 0x7f35e40734c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 -- 172.21.15.79:0/3791129998 >> 172.21.15.79:0/3791129998 conn(0x7f35e40fbda0 msgr2=0x7f35e40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 -- 172.21.15.79:0/3791129998 shutdown_connections 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.835+0000 7f35e9ef2700 1 -- 172.21.15.79:0/3791129998 wait complete. 2024-09-10T09:32:29.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.836+0000 7f35e9ef2700 1 Processor -- start 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.836+0000 7f35e9ef2700 1 -- start start 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.836+0000 7f35e9ef2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e40730f0 0x7f35e419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.836+0000 7f35e9ef2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e4073a00 0x7f35e419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.836+0000 7f35e9ef2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e419d000 con 0x7f35e4073a00 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.836+0000 7f35e9ef2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e41a0d90 con 0x7f35e40730f0 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e4073a00 0x7f35e419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e4073a00 0x7f35e419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41612/0 (socket says 172.21.15.79:41612) 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e2ffd700 1 -- 172.21.15.79:0/2765885592 learned_addr learned my addr 172.21.15.79:0/2765885592 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e37fe700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e40730f0 0x7f35e419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e2ffd700 1 -- 172.21.15.79:0/2765885592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e40730f0 msgr2=0x7f35e419c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e2ffd700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e40730f0 0x7f35e419c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e2ffd700 1 -- 172.21.15.79:0/2765885592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d80095f0 con 0x7f35e4073a00 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e2ffd700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e4073a00 0x7f35e419c920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f35d400d8d0 tx=0x7f35d400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:29.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e0ff9700 1 -- 172.21.15.79:0/2765885592 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d40098a0 con 0x7f35e4073a00 2024-09-10T09:32:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e0ff9700 1 -- 172.21.15.79:0/2765885592 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35d4010460 con 0x7f35e4073a00 2024-09-10T09:32:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e41a1070 con 0x7f35e4073a00 2024-09-10T09:32:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e0ff9700 1 -- 172.21.15.79:0/2765885592 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d400f5f0 con 0x7f35e4073a00 2024-09-10T09:32:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.837+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e41a15c0 con 0x7f35e4073a00 2024-09-10T09:32:29.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.838+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e410e4d0 con 0x7f35e4073a00 2024-09-10T09:32:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.839+0000 7f35e0ff9700 1 -- 172.21.15.79:0/2765885592 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f35d4009a00 con 0x7f35e4073a00 2024-09-10T09:32:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.839+0000 7f35e0ff9700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.839+0000 7f35e0ff9700 1 -- 172.21.15.79:0/2765885592 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f35d408b3a0 con 0x7f35e4073a00 2024-09-10T09:32:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.839+0000 7f35e37fe700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:29.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.839+0000 7f35e37fe700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35d8006010 tx=0x7f35d801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:29.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:29.843+0000 7f35e0ff9700 1 -- 172.21.15.79:0/2765885592 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f35d4055e60 con 0x7f35e4073a00 2024-09-10T09:32:30.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.035+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35e41a17e0 con 0x7f35e4073a00 2024-09-10T09:32:30.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.036+0000 7f35e0ff9700 1 -- 172.21.15.79:0/2765885592 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11059 (secure 0 0 0) 0x7f35d4059480 con 0x7f35e4073a00 2024-09-10T09:32:30.037 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:32:30.037 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":41,"fsid":"afb60aa6-6f56-11ef-bcea-c7b262605968","created":"2024-09-10T09:26:33.405835+0000","modified":"2024-09-10T09:32:10.713102+0000","last_up_change":"2024-09-10T09:32:09.706990+0000","last_in_change":"2024-09-10T09:31:50.963561+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T09:30:56.906015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1eb8d86f-bc7e-4148-bf65-fcfd28de756d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6803","nonce":3768365969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6805","nonce":3768365969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6809","nonce":3768365969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3768365969},{"type":"v1","addr":"172.21.15.79:6807","nonce":3768365969}]},"public_addr":"172.21.15.79:6803/3768365969","cluster_addr":"172.21.15.79:6805/3768365969","heartbeat_back_addr":"172.21.15.79:6809/3768365969","heartbeat_front_addr":"172.21.15.79:6807/3768365969","state":["exists","up"]},{"osd":1,"uuid":"bcaebb19-e24f-4243-baa7-1d678a9d0a9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6811","nonce":1923230193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6813","nonce":1923230193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6817","nonce":1923230193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1923230193},{"type":"v1","addr":"172.21.15.79:6815","nonce":1923230193}]},"public_addr":"172.21.15.79:6811/1923230193","cluster_addr":"172.21.15.79:6813/1923230193","heartbeat_back_addr":"172.21.15.79:6817/1923230193","heartbeat_front_addr":"172.21.15.79:6815/1923230193","state":["exists","up"]},{"osd":2,"uuid":"52ffae68-ccfd-45fb-b1b3-d26feca92970","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6819","nonce":151150189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6821","nonce":151150189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6825","nonce":151150189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":151150189},{"type":"v1","addr":"172.21.15.79:6823","nonce":151150189}]},"public_addr":"172.21.15.79:6819/151150189","cluster_addr":"172.21.15.79:6821/151150189","heartbeat_back_addr":"172.21.15.79:6825/151150189","heartbeat_front_addr":"172.21.15.79:6823/151150189","state":["exists","up"]},{"osd":3,"uuid":"32be0838-5190-4679-80ae-7837d3efeec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6801","nonce":3565821318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6803","nonce":3565821318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6807","nonce":3565821318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":3565821318},{"type":"v1","addr":"172.21.15.135:6805","nonce":3565821318}]},"public_addr":"172.21.15.135:6801/3565821318","cluster_addr":"172.21.15.135:6803/3565821318","heartbeat_back_addr":"172.21.15.135:6807/3565821318","heartbeat_front_addr":"172.21.15.135:6805/3565821318","state":["exists","up"]},{"osd":4,"uuid":"dca8c952-8389-4ed9-bb93-38361592b330","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6809","nonce":4092128240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6811","nonce":4092128240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6815","nonce":4092128240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":4092128240},{"type":"v1","addr":"172.21.15.135:6813","nonce":4092128240}]},"public_addr":"172.21.15.135:6809/4092128240","cluster_addr":"172.21.15.135:6811/4092128240","heartbeat_back_addr":"172.21.15.135:6815/4092128240","heartbeat_front_addr":"172.21.15.135:6813/4092128240","state":["exists","up"]},{"osd":5,"uuid":"8fe6d03f-9515-4ba0-a858-a2529c870692","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6817","nonce":3520058192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6819","nonce":3520058192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6823","nonce":3520058192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3520058192},{"type":"v1","addr":"172.21.15.135:6821","nonce":3520058192}]},"public_addr":"172.21.15.135:6817/3520058192","cluster_addr":"172.21.15.135:6819/3520058192","heartbeat_back_addr":"172.21.15.135:6823/3520058192","heartbeat_front_addr":"172.21.15.135:6821/3520058192","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:29:57.236478+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:30:25.904088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:30:53.933647+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:31:17.544219+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:31:42.505333+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T09:32:08.360656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.79:0/1985948133":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/1268167286":"2024-09-11T09:27:33.747139+0000","172.21.15.79:6801/2":"2024-09-11T09:27:01.091778+0000","172.21.15.79:6800/2":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/3646919951":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/1657459337":"2024-09-11T09:27:33.747139+0000","172.21.15.79:0/897136131":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/4287758029":"2024-09-11T09:27:01.091778+0000","172.21.15.79:0/3342987250":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/2095060336":"2024-09-11T09:28:40.595640+0000","172.21.15.79:0/250070562":"2024-09-11T09:27:33.747139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T09:32:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f35cc06c680 msgr2=0x7f35cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f35d8006010 tx=0x7f35d801a040 comp rx=0 tx=0).stop 2024-09-10T09:32:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e4073a00 msgr2=0x7f35e419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e4073a00 0x7f35e419c920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f35d400d8d0 tx=0x7f35d400dbe0 comp rx=0 tx=0).stop 2024-09-10T09:32:30.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 shutdown_connections 2024-09-10T09:32:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f35cc06c680 0x7f35cc06eb30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e40730f0 0x7f35e419c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 --2- 172.21.15.79:0/2765885592 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35e4073a00 0x7f35e419c920 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 >> 172.21.15.79:0/2765885592 conn(0x7f35e40fbda0 msgr2=0x7f35e4102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.038+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 shutdown_connections 2024-09-10T09:32:30.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:30.039+0000 7f35e9ef2700 1 -- 172.21.15.79:0/2765885592 wait complete. 2024-09-10T09:32:30.660 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:30 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2765885592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T09:32:30.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T09:32:30.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T09:32:30.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T09:32:30.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T09:32:30.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T09:32:30.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T09:32:30.966 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:30.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:30 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2765885592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T09:32:31.643 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:31.644 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:31.645 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:31.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:31 smithi079 ceph-mon[27592]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:31.767 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:31.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:31 smithi135 ceph-mon[33411]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:32.093 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:33.909 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:33 smithi079 ceph-mon[27592]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:33.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:33 smithi135 ceph-mon[33411]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:35.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:35 smithi079 ceph-mon[27592]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:35.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:35 smithi135 ceph-mon[33411]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:36.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 -- 172.21.15.79:0/1487903868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4240104130 msgr2=0x7f4240104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 --2- 172.21.15.79:0/1487903868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4240104130 0x7f4240104500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4234009910 tx=0x7f4234009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:36.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 -- 172.21.15.79:0/1487903868 shutdown_connections 2024-09-10T09:32:36.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 --2- 172.21.15.79:0/1487903868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42400ffbd0 0x7f4240100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 --2- 172.21.15.79:0/1487903868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4240104130 0x7f4240104500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 -- 172.21.15.79:0/1487903868 >> 172.21.15.79:0/1487903868 conn(0x7f4240075130 msgr2=0x7f4240075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 -- 172.21.15.79:0/1487903868 shutdown_connections 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.520+0000 7f4244cab700 1 -- 172.21.15.79:0/1487903868 wait complete. 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f4244cab700 1 Processor -- start 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f4244cab700 1 -- start start 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f4244cab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42400ffbd0 0x7f4240195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f4244cab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4240104130 0x7f4240196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f4244cab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4240196a70 con 0x7f42400ffbd0 2024-09-10T09:32:36.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f4244cab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019a800 con 0x7f4240104130 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f423e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42400ffbd0 0x7f4240195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f423e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42400ffbd0 0x7f4240195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34096/0 (socket says 172.21.15.79:34096) 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.521+0000 7f423e59c700 1 -- 172.21.15.79:0/2285278111 learned_addr learned my addr 172.21.15.79:0/2285278111 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f423dd9b700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4240104130 0x7f4240196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f423e59c700 1 -- 172.21.15.79:0/2285278111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4240104130 msgr2=0x7f4240196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f423e59c700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4240104130 0x7f4240196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f423e59c700 1 -- 172.21.15.79:0/2285278111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340095f0 con 0x7f42400ffbd0 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f423e59c700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42400ffbd0 0x7f4240195e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4234000c00 tx=0x7f423400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f423401d070 con 0x7f42400ffbd0 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4234004fa0 con 0x7f42400ffbd0 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424019aa80 con 0x7f42400ffbd0 2024-09-10T09:32:36.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f423400f460 con 0x7f42400ffbd0 2024-09-10T09:32:36.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.522+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424019af70 con 0x7f42400ffbd0 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.523+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f424010c5c0 con 0x7f42400ffbd0 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.523+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4234022870 con 0x7f42400ffbd0 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f422f7fe700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f422806c680 0x7f422806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f423408c9d0 con 0x7f42400ffbd0 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f423dd9b700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f422806c680 0x7f422806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f422f7fe700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] conn(0x7f4228072210 0x7f4228074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 --> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4228074cd0 con 0x7f4228072210 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42340912a0 con 0x7f42400ffbd0 2024-09-10T09:32:36.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f423ed9d700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] conn(0x7f4228072210 0x7f4228074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.524+0000 7f423dd9b700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f422806c680 0x7f422806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4230005950 tx=0x7f42300058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:36.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.525+0000 7f423ed9d700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] conn(0x7f4228072210 0x7f4228074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:36.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.525+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== osd.2 v2:172.21.15.79:6818/151150189 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4228074cd0 con 0x7f4228072210 2024-09-10T09:32:36.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 --> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f424004f2a0 con 0x7f4228072210 2024-09-10T09:32:36.542 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f422f7fe700 1 -- 172.21.15.79:0/2285278111 <== osd.2 v2:172.21.15.79:6818/151150189 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f424004f2a0 con 0x7f4228072210 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] conn(0x7f4228072210 msgr2=0x7f4228074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] conn(0x7f4228072210 0x7f4228074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f422806c680 msgr2=0x7f422806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f422806c680 0x7f422806eb30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4230005950 tx=0x7f42300058e0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42400ffbd0 msgr2=0x7f4240195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42400ffbd0 0x7f4240195e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4234000c00 tx=0x7f423400be20 comp rx=0 tx=0).stop 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 shutdown_connections 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6818/151150189,v1:172.21.15.79:6819/151150189] conn(0x7f4228072210 0x7f4228074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f422806c680 0x7f422806eb30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42400ffbd0 0x7f4240195e50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 --2- 172.21.15.79:0/2285278111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4240104130 0x7f4240196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 >> 172.21.15.79:0/2285278111 conn(0x7f4240075130 msgr2=0x7f42400fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:36.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 shutdown_connections 2024-09-10T09:32:36.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.541+0000 7f4244cab700 1 -- 172.21.15.79:0/2285278111 wait complete. 2024-09-10T09:32:36.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 -- 172.21.15.79:0/3564267189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0ffbd0 msgr2=0x7fbc7c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3564267189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0ffbd0 0x7fbc7c100040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009910 tx=0x7fbc6c009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 -- 172.21.15.79:0/3564267189 shutdown_connections 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3564267189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c0ffbd0 0x7fbc7c100040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3564267189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7c104130 0x7fbc7c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 -- 172.21.15.79:0/3564267189 >> 172.21.15.79:0/3564267189 conn(0x7fbc7c075130 msgr2=0x7fbc7c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 -- 172.21.15.79:0/3564267189 shutdown_connections 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 -- 172.21.15.79:0/3564267189 wait complete. 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 Processor -- start 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 -- start start 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.762+0000 7fbc840a7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7c0ffbd0 0x7fbc7c194d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc840a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c104130 0x7fbc7c195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc840a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c195950 con 0x7fbc7c104130 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc840a7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1996e0 con 0x7fbc7c0ffbd0 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81642700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c104130 0x7fbc7c195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81642700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c104130 0x7fbc7c195270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34116/0 (socket says 172.21.15.79:34116) 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81642700 1 -- 172.21.15.79:0/3626429471 learned_addr learned my addr 172.21.15.79:0/3626429471 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81e43700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7c0ffbd0 0x7fbc7c194d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81642700 1 -- 172.21.15.79:0/3626429471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7c0ffbd0 msgr2=0x7fbc7c194d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81642700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7c0ffbd0 0x7fbc7c194d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81642700 1 -- 172.21.15.79:0/3626429471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0095f0 con 0x7fbc7c104130 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81e43700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7c0ffbd0 0x7fbc7c194d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc81642700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c104130 0x7fbc7c195270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00bd70 tx=0x7fbc6c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c01d070 con 0x7fbc7c104130 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c00f460 con 0x7fbc7c104130 2024-09-10T09:32:36.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c017630 con 0x7fbc7c104130 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c199960 con 0x7fbc7c104130 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.763+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c199e50 con 0x7fbc7c104130 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.764+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc7c10c5c0 con 0x7fbc7c104130 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbc6c003a60 con 0x7fbc7c104130 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc72ffd700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbc6806c680 0x7fbc6806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fbc6c08c9a0 con 0x7fbc7c104130 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc81e43700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbc6806c680 0x7fbc6806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc72ffd700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] conn(0x7fbc68072210 0x7fbc68074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 --> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc68074cd0 con 0x7fbc68072210 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc6c0912a0 con 0x7fbc7c104130 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc82644700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] conn(0x7fbc68072210 0x7fbc68074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.765+0000 7fbc81e43700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbc6806c680 0x7fbc6806eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc78005950 tx=0x7fbc780058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:36.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.766+0000 7fbc82644700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] conn(0x7fbc68072210 0x7fbc68074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:36.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.766+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== osd.1 v2:172.21.15.79:6810/1923230193 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbc68074cd0 con 0x7fbc68072210 2024-09-10T09:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.782+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 --> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc7c04f2a0 con 0x7fbc68072210 2024-09-10T09:32:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.782+0000 7fbc72ffd700 1 -- 172.21.15.79:0/3626429471 <== osd.1 v2:172.21.15.79:6810/1923230193 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc7c04f2a0 con 0x7fbc68072210 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.782+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] conn(0x7fbc68072210 msgr2=0x7fbc68074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.782+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] conn(0x7fbc68072210 0x7fbc68074620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbc6806c680 msgr2=0x7fbc6806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbc6806c680 0x7fbc6806eb30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbc78005950 tx=0x7fbc780058e0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c104130 msgr2=0x7fbc7c195270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c104130 0x7fbc7c195270 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00bd70 tx=0x7fbc6c00be50 comp rx=0 tx=0).stop 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 shutdown_connections 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6810/1923230193,v1:172.21.15.79:6811/1923230193] conn(0x7fbc68072210 0x7fbc68074620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbc6806c680 0x7fbc6806eb30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc7c0ffbd0 0x7fbc7c194d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 --2- 172.21.15.79:0/3626429471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc7c104130 0x7fbc7c195270 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:36.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 >> 172.21.15.79:0/3626429471 conn(0x7fbc7c075130 msgr2=0x7fbc7c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:36.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 shutdown_connections 2024-09-10T09:32:36.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:36.783+0000 7fbc840a7700 1 -- 172.21.15.79:0/3626429471 wait complete. 2024-09-10T09:32:37.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:37 smithi079 ceph-mon[27592]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:37 smithi135 ceph-mon[33411]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:39.079 INFO:teuthology.orchestra.run.smithi079.stdout:81604378646 2024-09-10T09:32:39.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T09:32:39.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.281+0000 7f25d24a7700 1 -- 172.21.15.79:0/3769230839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc0730f0 msgr2=0x7f25cc0734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:39.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.281+0000 7f25d24a7700 1 --2- 172.21.15.79:0/3769230839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc0730f0 0x7f25cc0734c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009910 tx=0x7f25bc009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:39.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.281+0000 7f25d24a7700 1 -- 172.21.15.79:0/3769230839 shutdown_connections 2024-09-10T09:32:39.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.281+0000 7f25d24a7700 1 --2- 172.21.15.79:0/3769230839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc073a00 0x7f25cc110d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.281+0000 7f25d24a7700 1 --2- 172.21.15.79:0/3769230839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc0730f0 0x7f25cc0734c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.281+0000 7f25d24a7700 1 -- 172.21.15.79:0/3769230839 >> 172.21.15.79:0/3769230839 conn(0x7f25cc0fbda0 msgr2=0x7f25cc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.282+0000 7f25d24a7700 1 -- 172.21.15.79:0/3769230839 shutdown_connections 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.282+0000 7f25d24a7700 1 -- 172.21.15.79:0/3769230839 wait complete. 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.282+0000 7f25d24a7700 1 Processor -- start 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.282+0000 7f25d24a7700 1 -- start start 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25d24a7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc0730f0 0x7f25cc19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25d24a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc073a00 0x7f25cc19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25d24a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc19d0f0 con 0x7f25cc073a00 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25d24a7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1a0e80 con 0x7f25cc0730f0 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc073a00 0x7f25cc19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc073a00 0x7f25cc19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34140/0 (socket says 172.21.15.79:34140) 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cb7fe700 1 -- 172.21.15.79:0/420843628 learned_addr learned my addr 172.21.15.79:0/420843628 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cbfff700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc0730f0 0x7f25cc19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cb7fe700 1 -- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc0730f0 msgr2=0x7f25cc19c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cb7fe700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc0730f0 0x7f25cc19c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cb7fe700 1 -- 172.21.15.79:0/420843628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc0095f0 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25cb7fe700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc073a00 0x7f25cc19ca10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b4b0 tx=0x7f25c000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c0011800 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f25c0011e10 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc1a1160 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25c000f2e0 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.283+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1a16b0 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.284+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25cc113c70 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.285+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f25c0010380 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.285+0000 7f25c97fa700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f25b406c680 0x7f25b406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.285+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f25c008b110 con 0x7f25cc073a00 2024-09-10T09:32:39.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.285+0000 7f25cbfff700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f25b406c680 0x7f25b406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.285+0000 7f25c97fa700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] conn(0x7f25b4072210 0x7f25b4074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.285+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 --> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25b4074cd0 con 0x7f25b4072210 2024-09-10T09:32:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.285+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c008d7e0 con 0x7f25cc073a00 2024-09-10T09:32:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.286+0000 7f25cbfff700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f25b406c680 0x7f25b406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00b5c0 tx=0x7f25bc01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.286+0000 7f25d0a44700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] conn(0x7f25b4072210 0x7f25b4074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.286+0000 7f25d0a44700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] conn(0x7f25b4072210 0x7f25b4074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:39.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.287+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== osd.3 v2:172.21.15.135:6800/3565821318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f25b4074cd0 con 0x7f25b4072210 2024-09-10T09:32:39.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.303+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 --> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25cc04f2a0 con 0x7f25b4072210 2024-09-10T09:32:39.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25c97fa700 1 -- 172.21.15.79:0/420843628 <== osd.3 v2:172.21.15.135:6800/3565821318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f25cc04f2a0 con 0x7f25b4072210 2024-09-10T09:32:39.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] conn(0x7f25b4072210 msgr2=0x7f25b4074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:39.305 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25d24a7700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] conn(0x7f25b4072210 0x7f25b4074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f25b406c680 msgr2=0x7f25b406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25d24a7700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f25b406c680 0x7f25b406eb30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00b5c0 tx=0x7f25bc01a040 comp rx=0 tx=0).stop 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc073a00 msgr2=0x7f25cc19ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25d24a7700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc073a00 0x7f25cc19ca10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b4b0 tx=0x7f25c000b870 comp rx=0 tx=0).stop 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.304+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 shutdown_connections 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.305+0000 7f25d24a7700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f25b406c680 0x7f25b406eb30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.305+0000 7f25d24a7700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25cc0730f0 0x7f25cc19c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.305+0000 7f25d24a7700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.135:6800/3565821318,v1:172.21.15.135:6801/3565821318] conn(0x7f25b4072210 0x7f25b4074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.305+0000 7f25d24a7700 1 --2- 172.21.15.79:0/420843628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25cc073a00 0x7f25cc19ca10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.305+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 >> 172.21.15.79:0/420843628 conn(0x7f25cc0fbda0 msgr2=0x7f25cc102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.305+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 shutdown_connections 2024-09-10T09:32:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:39.305+0000 7f25d24a7700 1 -- 172.21.15.79:0/420843628 wait complete. 2024-09-10T09:32:39.571 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:39 smithi079 ceph-mon[27592]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:39.876 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:39 smithi135 ceph-mon[33411]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:40.625 INFO:teuthology.orchestra.run.smithi079.stdout:115964117011 2024-09-10T09:32:40.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T09:32:40.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:40.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 -- 172.21.15.79:0/689801063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 msgr2=0x7f15601008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 --2- 172.21.15.79:0/689801063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f15601008b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1550009910 tx=0x7f1550009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 -- 172.21.15.79:0/689801063 shutdown_connections 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 --2- 172.21.15.79:0/689801063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1560100e80 0x7f1560104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 --2- 172.21.15.79:0/689801063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f15601008b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 -- 172.21.15.79:0/689801063 >> 172.21.15.79:0/689801063 conn(0x7f15600fbda0 msgr2=0x7f15600fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 -- 172.21.15.79:0/689801063 shutdown_connections 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.309+0000 7f1566887700 1 -- 172.21.15.79:0/689801063 wait complete. 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.310+0000 7f1566887700 1 Processor -- start 2024-09-10T09:32:41.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.310+0000 7f1566887700 1 -- start start 2024-09-10T09:32:41.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.310+0000 7f1566887700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f1560195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.310+0000 7f1566887700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1560100e80 0x7f15601964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.310+0000 7f1566887700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1560196b90 con 0x7f15601004e0 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.310+0000 7f1566887700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156019a920 con 0x7f1560100e80 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f1560195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f1560195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34152/0 (socket says 172.21.15.79:34152) 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155ffff700 1 -- 172.21.15.79:0/1890036670 learned_addr learned my addr 172.21.15.79:0/1890036670 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155f7fe700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1560100e80 0x7f15601964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155ffff700 1 -- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1560100e80 msgr2=0x7f15601964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155ffff700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1560100e80 0x7f15601964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155ffff700 1 -- 172.21.15.79:0/1890036670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15500095f0 con 0x7f15601004e0 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155f7fe700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1560100e80 0x7f15601964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:32:41.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155ffff700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f1560195f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1550006010 tx=0x7f155000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:41.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f155001d070 con 0x7f15601004e0 2024-09-10T09:32:41.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156019aba0 con 0x7f15601004e0 2024-09-10T09:32:41.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f155000f460 con 0x7f15601004e0 2024-09-10T09:32:41.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156019b090 con 0x7f15601004e0 2024-09-10T09:32:41.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.311+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1550021640 con 0x7f15601004e0 2024-09-10T09:32:41.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.312+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1540000ff0 con 0x7f15601004e0 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.313+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f155000faf0 con 0x7f15601004e0 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f155d7fa700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f154c06c680 0x7f154c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f155008d0d0 con 0x7f15601004e0 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f155f7fe700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f154c06c680 0x7f154c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f155d7fa700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] conn(0x7f154c072210 0x7f154c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 --> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f154c074cd0 con 0x7f154c072210 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f155008d530 con 0x7f15601004e0 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f1564e24700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] conn(0x7f154c072210 0x7f154c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:41.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.314+0000 7f155f7fe700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f154c06c680 0x7f154c06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1560197590 tx=0x7f1548008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:41.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.315+0000 7f1564e24700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] conn(0x7f154c072210 0x7f154c074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:41.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.315+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== osd.4 v2:172.21.15.135:6808/4092128240 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f154c074cd0 con 0x7f154c072210 2024-09-10T09:32:41.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.332+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 --> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1540002ce0 con 0x7f154c072210 2024-09-10T09:32:41.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f155d7fa700 1 -- 172.21.15.79:0/1890036670 <== osd.4 v2:172.21.15.135:6808/4092128240 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1540002ce0 con 0x7f154c072210 2024-09-10T09:32:41.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] conn(0x7f154c072210 msgr2=0x7f154c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:41.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] conn(0x7f154c072210 0x7f154c074620 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f154c06c680 msgr2=0x7f154c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:41.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f154c06c680 0x7f154c06eb30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1560197590 tx=0x7f1548008040 comp rx=0 tx=0).stop 2024-09-10T09:32:41.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 msgr2=0x7f1560195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:41.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f1560195f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1550006010 tx=0x7f155000be20 comp rx=0 tx=0).stop 2024-09-10T09:32:41.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 shutdown_connections 2024-09-10T09:32:41.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:6808/4092128240,v1:172.21.15.135:6809/4092128240] conn(0x7f154c072210 0x7f154c074620 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f154c06c680 0x7f154c06eb30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15601004e0 0x7f1560195f70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 --2- 172.21.15.79:0/1890036670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1560100e80 0x7f15601964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:41.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 >> 172.21.15.79:0/1890036670 conn(0x7f15600fbda0 msgr2=0x7f15600fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:41.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 shutdown_connections 2024-09-10T09:32:41.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:41.333+0000 7f1566887700 1 -- 172.21.15.79:0/1890036670 wait complete. 2024-09-10T09:32:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:41 smithi079 ceph-mon[27592]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:41 smithi135 ceph-mon[33411]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:42.040 INFO:teuthology.orchestra.run.smithi079.stdout:60129542173 2024-09-10T09:32:42.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T09:32:42.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 -- 172.21.15.79:0/801936197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc100e80 msgr2=0x7f87cc104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/801936197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc100e80 0x7f87cc104e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009910 tx=0x7f87bc009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 -- 172.21.15.79:0/801936197 shutdown_connections 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/801936197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc100e80 0x7f87cc104e50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/801936197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87cc1004e0 0x7f87cc1008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 -- 172.21.15.79:0/801936197 >> 172.21.15.79:0/801936197 conn(0x7f87cc0fbda0 msgr2=0x7f87cc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 -- 172.21.15.79:0/801936197 shutdown_connections 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.239+0000 7f87d3a5b700 1 -- 172.21.15.79:0/801936197 wait complete. 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d3a5b700 1 Processor -- start 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d3a5b700 1 -- start start 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d3a5b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc1004e0 0x7f87cc195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d3a5b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87cc100e80 0x7f87cc196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d3a5b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc196b30 con 0x7f87cc1004e0 2024-09-10T09:32:42.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d3a5b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87cc19a8c0 con 0x7f87cc100e80 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d17f7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc1004e0 0x7f87cc195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d17f7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc1004e0 0x7f87cc195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53370/0 (socket says 172.21.15.79:53370) 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d17f7700 1 -- 172.21.15.79:0/3728070332 learned_addr learned my addr 172.21.15.79:0/3728070332 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d0ff6700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87cc100e80 0x7f87cc196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d17f7700 1 -- 172.21.15.79:0/3728070332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87cc100e80 msgr2=0x7f87cc196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d17f7700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87cc100e80 0x7f87cc196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d17f7700 1 -- 172.21.15.79:0/3728070332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc0095f0 con 0x7f87cc1004e0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.240+0000 7f87d17f7700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc1004e0 0x7f87cc195f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87c800d8d0 tx=0x7f87c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.241+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87c8009940 con 0x7f87cc1004e0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.241+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87c8010460 con 0x7f87cc1004e0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.241+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87cc19aba0 con 0x7f87cc1004e0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.241+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87c800f5f0 con 0x7f87cc1004e0 2024-09-10T09:32:42.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.241+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87cc19b0f0 con 0x7f87cc1004e0 2024-09-10T09:32:42.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.242+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f87cc10d650 con 0x7f87cc1004e0 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.242+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f87c80105d0 con 0x7f87cc1004e0 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87c27fc700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f87b806c680 0x7f87b806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f87c808b3b0 con 0x7f87cc1004e0 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87d0ff6700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f87b806c680 0x7f87b806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87c27fc700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] conn(0x7f87b8072210 0x7f87b8074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 --> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87b8074cd0 con 0x7f87b8072210 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87c808da80 con 0x7f87cc1004e0 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87d1ff8700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] conn(0x7f87b8072210 0x7f87b8074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87d0ff6700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f87b806c680 0x7f87b806eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f87cc197530 tx=0x7f87bc01a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.243+0000 7f87d1ff8700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] conn(0x7f87b8072210 0x7f87b8074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:42.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.244+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== osd.0 v2:172.21.15.79:6802/3768365969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f87b8074cd0 con 0x7f87b8072210 2024-09-10T09:32:42.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 --> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f87cc04f2a0 con 0x7f87b8072210 2024-09-10T09:32:42.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87c27fc700 1 -- 172.21.15.79:0/3728070332 <== osd.0 v2:172.21.15.79:6802/3768365969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f87cc04f2a0 con 0x7f87b8072210 2024-09-10T09:32:42.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] conn(0x7f87b8072210 msgr2=0x7f87b8074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:42.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] conn(0x7f87b8072210 0x7f87b8074620 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f87b806c680 msgr2=0x7f87b806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:42.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f87b806c680 0x7f87b806eb30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f87cc197530 tx=0x7f87bc01a040 comp rx=0 tx=0).stop 2024-09-10T09:32:42.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc1004e0 msgr2=0x7f87cc195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:42.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc1004e0 0x7f87cc195f10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87c800d8d0 tx=0x7f87c800dc90 comp rx=0 tx=0).stop 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 shutdown_connections 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6802/3768365969,v1:172.21.15.79:6803/3768365969] conn(0x7f87b8072210 0x7f87b8074620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f87b806c680 0x7f87b806eb30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f87cc1004e0 0x7f87cc195f10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 --2- 172.21.15.79:0/3728070332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87cc100e80 0x7f87cc196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 >> 172.21.15.79:0/3728070332 conn(0x7f87cc0fbda0 msgr2=0x7f87cc0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 shutdown_connections 2024-09-10T09:32:42.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.260+0000 7f87d3a5b700 1 -- 172.21.15.79:0/3728070332 wait complete. 2024-09-10T09:32:43.039 INFO:teuthology.orchestra.run.smithi079.stdout:38654705699 2024-09-10T09:32:43.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T09:32:43.735 INFO:teuthology.orchestra.run.smithi079.stdout:150323855374 2024-09-10T09:32:43.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T09:32:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:43 smithi079 ceph-mon[27592]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:43.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:43 smithi135 ceph-mon[33411]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:43.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 -- 172.21.15.79:0/2083108068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 msgr2=0x7f5264104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 --2- 172.21.15.79:0/2083108068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264104500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b0a0 tx=0x7f525c00b3b0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 -- 172.21.15.79:0/2083108068 shutdown_connections 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 --2- 172.21.15.79:0/2083108068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52640ffbd0 0x7f5264100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 --2- 172.21.15.79:0/2083108068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264104500 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 -- 172.21.15.79:0/2083108068 >> 172.21.15.79:0/2083108068 conn(0x7f5264075130 msgr2=0x7f5264075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 -- 172.21.15.79:0/2083108068 shutdown_connections 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.450+0000 7f526c668700 1 -- 172.21.15.79:0/2083108068 wait complete. 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f526c668700 1 Processor -- start 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f526c668700 1 -- start start 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f526c668700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52640ffbd0 0x7f5264195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f526c668700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:43.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f526c668700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5264196a70 con 0x7f5264104130 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f526c668700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526419a800 con 0x7f52640ffbd0 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f5269c03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f5269c03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53384/0 (socket says 172.21.15.79:53384) 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f5269c03700 1 -- 172.21.15.79:0/761457454 learned_addr learned my addr 172.21.15.79:0/761457454 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.451+0000 7f526a404700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52640ffbd0 0x7f5264195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f5269c03700 1 -- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52640ffbd0 msgr2=0x7f5264195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f5269c03700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52640ffbd0 0x7f5264195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f5269c03700 1 -- 172.21.15.79:0/761457454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c009d00 con 0x7f5264104130 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f5269c03700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264196390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f525800d8d0 tx=0x7f525800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52580098a0 con 0x7f5264104130 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5258010460 con 0x7f5264104130 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526419aae0 con 0x7f5264104130 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525800f5f0 con 0x7f5264104130 2024-09-10T09:32:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.452+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526419b030 con 0x7f5264104130 2024-09-10T09:32:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.453+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f526410c5c0 con 0x7f5264104130 2024-09-10T09:32:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.453+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f5258009a00 con 0x7f5264104130 2024-09-10T09:32:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f52637fe700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f524c06c680 0x7f524c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f525808b440 con 0x7f5264104130 2024-09-10T09:32:43.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f526a404700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f524c06c680 0x7f524c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f52637fe700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] conn(0x7f524c072210 0x7f524c074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 --> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f524c074cd0 con 0x7f524c072210 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f525808da70 con 0x7f5264104130 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f526a404700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f524c06c680 0x7f524c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f525c009480 tx=0x7f525c00b7b0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.454+0000 7f526ac05700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] conn(0x7f524c072210 0x7f524c074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.455+0000 7f526ac05700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] conn(0x7f524c072210 0x7f524c074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.456+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== osd.5 v2:172.21.15.135:6816/3520058192 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f524c074cd0 con 0x7f524c072210 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.471+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 --> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f526404f2a0 con 0x7f524c072210 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f52637fe700 1 -- 172.21.15.79:0/761457454 <== osd.5 v2:172.21.15.135:6816/3520058192 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f526404f2a0 con 0x7f524c072210 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] conn(0x7f524c072210 msgr2=0x7f524c074620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] conn(0x7f524c072210 0x7f524c074620 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f524c06c680 msgr2=0x7f524c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:43.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f524c06c680 0x7f524c06eb30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f525c009480 tx=0x7f525c00b7b0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 msgr2=0x7f5264196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264196390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f525800d8d0 tx=0x7f525800dbe0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 shutdown_connections 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:6816/3520058192,v1:172.21.15.135:6817/3520058192] conn(0x7f524c072210 0x7f524c074620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f524c06c680 0x7f524c06eb30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52640ffbd0 0x7f5264195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 --2- 172.21.15.79:0/761457454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5264104130 0x7f5264196390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 >> 172.21.15.79:0/761457454 conn(0x7f5264075130 msgr2=0x7f52640fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 shutdown_connections 2024-09-10T09:32:43.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:42.472+0000 7f526c668700 1 -- 172.21.15.79:0/761457454 wait complete. 2024-09-10T09:32:44.640 INFO:teuthology.orchestra.run.smithi079.stdout:171798691849 2024-09-10T09:32:44.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T09:32:44.786 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:44.788 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:44.789 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:44.790 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:44.799 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:45.901 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:45 smithi079 ceph-mon[27592]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:45.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:45 smithi135 ceph-mon[33411]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.626+0000 7f36d16ab700 1 -- 172.21.15.79:0/1108869085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ffd60 msgr2=0x7f36cc103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.626+0000 7f36d16ab700 1 --2- 172.21.15.79:0/1108869085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ffd60 0x7f36cc103d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009910 tx=0x7f36c0009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.626+0000 7f36d16ab700 1 -- 172.21.15.79:0/1108869085 shutdown_connections 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.626+0000 7f36d16ab700 1 --2- 172.21.15.79:0/1108869085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ffd60 0x7f36cc103d30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.626+0000 7f36d16ab700 1 --2- 172.21.15.79:0/1108869085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36cc0ff3c0 0x7f36cc0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.626+0000 7f36d16ab700 1 -- 172.21.15.79:0/1108869085 >> 172.21.15.79:0/1108869085 conn(0x7f36cc0fac80 msgr2=0x7f36cc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.627+0000 7f36d16ab700 1 -- 172.21.15.79:0/1108869085 shutdown_connections 2024-09-10T09:32:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.627+0000 7f36d16ab700 1 -- 172.21.15.79:0/1108869085 wait complete. 2024-09-10T09:32:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.627+0000 7f36d16ab700 1 Processor -- start 2024-09-10T09:32:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36d16ab700 1 -- start start 2024-09-10T09:32:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36d16ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ff3c0 0x7f36cc10efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36d16ab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36cc0ffd60 0x7f36cc10f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36d16ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc10fb70 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36d16ab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc10fcb0 con 0x7f36cc0ffd60 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36caffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ff3c0 0x7f36cc10efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36caffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ff3c0 0x7f36cc10efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53408/0 (socket says 172.21.15.79:53408) 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36caffd700 1 -- 172.21.15.79:0/4148676721 learned_addr learned my addr 172.21.15.79:0/4148676721 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36ca7fc700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36cc0ffd60 0x7f36cc10f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36caffd700 1 -- 172.21.15.79:0/4148676721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36cc0ffd60 msgr2=0x7f36cc10f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36caffd700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36cc0ffd60 0x7f36cc10f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:47.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.628+0000 7f36caffd700 1 -- 172.21.15.79:0/4148676721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c00095f0 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.629+0000 7f36caffd700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ff3c0 0x7f36cc10efe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00d8d0 tx=0x7f36bc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:47.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.629+0000 7f36b3fff700 1 -- 172.21.15.79:0/4148676721 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36bc0098a0 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.629+0000 7f36b3fff700 1 -- 172.21.15.79:0/4148676721 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f36bc010460 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.629+0000 7f36b3fff700 1 -- 172.21.15.79:0/4148676721 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36bc00f5f0 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.629+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc1a6340 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.629+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc1a67a0 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.631+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc107730 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.631+0000 7f36b3fff700 1 -- 172.21.15.79:0/4148676721 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f36bc009a00 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.631+0000 7f36b3fff700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f36b406c680 0x7f36b406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:47.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.632+0000 7f36b3fff700 1 -- 172.21.15.79:0/4148676721 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f36bc08b2d0 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.632+0000 7f36ca7fc700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f36b406c680 0x7f36b406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:47.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.632+0000 7f36ca7fc700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f36b406c680 0x7f36b406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f36c0006010 tx=0x7f36c001a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:47.637 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.636+0000 7f36b3fff700 1 -- 172.21.15.79:0/4148676721 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f36bc055e10 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.829+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36cc04f2a0 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.830 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:47 smithi079 ceph-mon[27592]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:47.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.829+0000 7f36b3fff700 1 -- 172.21.15.79:0/4148676721 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36bc059430 con 0x7f36cc0ff3c0 2024-09-10T09:32:47.831 INFO:teuthology.orchestra.run.smithi079.stdout:60129542175 2024-09-10T09:32:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f36b406c680 msgr2=0x7f36b406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f36b406c680 0x7f36b406eb30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f36c0006010 tx=0x7f36c001a040 comp rx=0 tx=0).stop 2024-09-10T09:32:47.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ff3c0 msgr2=0x7f36cc10efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ff3c0 0x7f36cc10efe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f36bc00d8d0 tx=0x7f36bc00dbe0 comp rx=0 tx=0).stop 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 shutdown_connections 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f36b406c680 0x7f36b406eb30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36cc0ff3c0 0x7f36cc10efe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 --2- 172.21.15.79:0/4148676721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f36cc0ffd60 0x7f36cc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.831+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 >> 172.21.15.79:0/4148676721 conn(0x7f36cc0fac80 msgr2=0x7f36cc0fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.832+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 shutdown_connections 2024-09-10T09:32:47.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:47.832+0000 7f36d16ab700 1 -- 172.21.15.79:0/4148676721 wait complete. 2024-09-10T09:32:47.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:47 smithi135 ceph-mon[33411]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:48.954 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:48 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/4148676721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T09:32:48.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:48 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/4148676721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T09:32:48.974 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542175 for osd.1 2024-09-10T09:32:48.975 DEBUG:teuthology.parallel:result is None 2024-09-10T09:32:49.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 -- 172.21.15.79:0/2680982866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980687a0 msgr2=0x7fbb98068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 --2- 172.21.15.79:0/2680982866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980687a0 0x7fbb98068b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009910 tx=0x7fbb94009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 -- 172.21.15.79:0/2680982866 shutdown_connections 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 --2- 172.21.15.79:0/2680982866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb98069140 0x7fbb98104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 --2- 172.21.15.79:0/2680982866 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb980687a0 0x7fbb98068b70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 -- 172.21.15.79:0/2680982866 >> 172.21.15.79:0/2680982866 conn(0x7fbb98075130 msgr2=0x7fbb98075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 -- 172.21.15.79:0/2680982866 shutdown_connections 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.625+0000 7fbba00a2700 1 -- 172.21.15.79:0/2680982866 wait complete. 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbba00a2700 1 Processor -- start 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbba00a2700 1 -- start start 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbba00a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb980687a0 0x7fbb98195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:49.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbba00a2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb98069140 0x7fbb98196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbba00a2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98196b00 con 0x7fbb98069140 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbba00a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9819a890 con 0x7fbb980687a0 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9d63d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb98069140 0x7fbb98196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9d63d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb98069140 0x7fbb98196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53424/0 (socket says 172.21.15.79:53424) 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9d63d700 1 -- 172.21.15.79:0/3762569487 learned_addr learned my addr 172.21.15.79:0/3762569487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9de3e700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb980687a0 0x7fbb98195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9d63d700 1 -- 172.21.15.79:0/3762569487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb980687a0 msgr2=0x7fbb98195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9d63d700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb980687a0 0x7fbb98195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9d63d700 1 -- 172.21.15.79:0/3762569487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940095f0 con 0x7fbb98069140 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.626+0000 7fbb9d63d700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb98069140 0x7fbb98196420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d900 tx=0x7fbb8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.627+0000 7fbb8effd700 1 -- 172.21.15.79:0/3762569487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb88009900 con 0x7fbb98069140 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.627+0000 7fbb8effd700 1 -- 172.21.15.79:0/3762569487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb88010460 con 0x7fbb98069140 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.627+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9819ab70 con 0x7fbb98069140 2024-09-10T09:32:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.627+0000 7fbb8effd700 1 -- 172.21.15.79:0/3762569487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8800f5f0 con 0x7fbb98069140 2024-09-10T09:32:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.627+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9819b0c0 con 0x7fbb98069140 2024-09-10T09:32:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.628+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98108770 con 0x7fbb98069140 2024-09-10T09:32:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.628+0000 7fbb8effd700 1 -- 172.21.15.79:0/3762569487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbb880105d0 con 0x7fbb98069140 2024-09-10T09:32:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.628+0000 7fbb8effd700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb8406c680 0x7fbb8406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:49.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.629+0000 7fbb8effd700 1 -- 172.21.15.79:0/3762569487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fbb8808b2d0 con 0x7fbb98069140 2024-09-10T09:32:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.629+0000 7fbb9de3e700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb8406c680 0x7fbb8406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:49.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.629+0000 7fbb9de3e700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb8406c680 0x7fbb8406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400b5c0 tx=0x7fbb9401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:49.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.633+0000 7fbb8effd700 1 -- 172.21.15.79:0/3762569487 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb88055d90 con 0x7fbb98069140 2024-09-10T09:32:49.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:49 smithi079 ceph-mon[27592]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.829+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb9819b2e0 con 0x7fbb98069140 2024-09-10T09:32:49.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.830+0000 7fbb8effd700 1 -- 172.21.15.79:0/3762569487 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb880593b0 con 0x7fbb98069140 2024-09-10T09:32:49.831 INFO:teuthology.orchestra.run.smithi079.stdout:81604378649 2024-09-10T09:32:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb8406c680 msgr2=0x7fbb8406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb8406c680 0x7fbb8406eb30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400b5c0 tx=0x7fbb9401a040 comp rx=0 tx=0).stop 2024-09-10T09:32:49.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb98069140 msgr2=0x7fbb98196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb98069140 0x7fbb98196420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800d900 tx=0x7fbb8800dcc0 comp rx=0 tx=0).stop 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 shutdown_connections 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb8406c680 0x7fbb8406eb30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb980687a0 0x7fbb98195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 --2- 172.21.15.79:0/3762569487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb98069140 0x7fbb98196420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 >> 172.21.15.79:0/3762569487 conn(0x7fbb98075130 msgr2=0x7fbb980fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 shutdown_connections 2024-09-10T09:32:49.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:49.832+0000 7fbba00a2700 1 -- 172.21.15.79:0/3762569487 wait complete. 2024-09-10T09:32:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:49 smithi135 ceph-mon[33411]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:50.452 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378649 for osd.2 2024-09-10T09:32:50.452 DEBUG:teuthology.parallel:result is None 2024-09-10T09:32:50.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:50 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/3762569487' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T09:32:51.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:50 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3762569487' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T09:32:52.093 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:51 smithi079 ceph-mon[27592]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:52.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:51 smithi135 ceph-mon[33411]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.305+0000 7f7c068fe700 1 -- 172.21.15.79:0/112250476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 msgr2=0x7f7c0010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.305+0000 7f7c068fe700 1 --2- 172.21.15.79:0/112250476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c0010a6d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009910 tx=0x7f7be8009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 -- 172.21.15.79:0/112250476 shutdown_connections 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 --2- 172.21.15.79:0/112250476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c0010a6d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 --2- 172.21.15.79:0/112250476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000ff350 0x7f7c000ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 -- 172.21.15.79:0/112250476 >> 172.21.15.79:0/112250476 conn(0x7f7c000748b0 msgr2=0x7f7c00074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 -- 172.21.15.79:0/112250476 shutdown_connections 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 -- 172.21.15.79:0/112250476 wait complete. 2024-09-10T09:32:52.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 Processor -- start 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 -- start start 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000ff350 0x7f7c00197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c001984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00198bb0 con 0x7f7c000ffc60 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7c068fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0019c940 con 0x7f7c000ff350 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.306+0000 7f7bf7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c001984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bf7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c001984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39810/0 (socket says 172.21.15.79:39810) 2024-09-10T09:32:52.671 INFO:teuthology.orchestra.run.smithi079.stdout:38654705701 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bf7fff700 1 -- 172.21.15.79:0/996333132 learned_addr learned my addr 172.21.15.79:0/996333132 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bf7fff700 1 -- 172.21.15.79:0/996333132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000ff350 msgr2=0x7f7c00197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bf7fff700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000ff350 0x7f7c00197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bf7fff700 1 -- 172.21.15.79:0/996333132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80095f0 con 0x7f7c000ffc60 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bf7fff700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c001984d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7be8006010 tx=0x7f7be800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bfdffb700 1 -- 172.21.15.79:0/996333132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be801d070 con 0x7f7c000ffc60 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bfdffb700 1 -- 172.21.15.79:0/996333132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7be800f460 con 0x7f7c000ffc60 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0019cbc0 con 0x7f7c000ffc60 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7bfdffb700 1 -- 172.21.15.79:0/996333132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7be8021640 con 0x7f7c000ffc60 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.307+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0019d110 con 0x7f7c000ffc60 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.308+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0010a230 con 0x7f7c000ffc60 2024-09-10T09:32:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.309+0000 7f7bfdffb700 1 -- 172.21.15.79:0/996333132 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7be800faf0 con 0x7f7c000ffc60 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.309+0000 7f7bfdffb700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7bec06c680 0x7f7bec06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.309+0000 7f7bfdffb700 1 -- 172.21.15.79:0/996333132 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f7be808c740 con 0x7f7c000ffc60 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.309+0000 7f7bfffff700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7bec06c680 0x7f7bec06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.309+0000 7f7bfffff700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7bec06c680 0x7f7bec06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000a990 tx=0x7f7bf0005c80 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.313+0000 7f7bfdffb700 1 -- 172.21.15.79:0/996333132 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7be8057280 con 0x7f7c000ffc60 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.509+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c0004f2a0 con 0x7f7c000ffc60 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.509+0000 7f7bfdffb700 1 -- 172.21.15.79:0/996333132 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7be805a8a0 con 0x7f7c000ffc60 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7bec06c680 msgr2=0x7f7bec06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7bec06c680 0x7f7bec06eb30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7bf000a990 tx=0x7f7bf0005c80 comp rx=0 tx=0).stop 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 msgr2=0x7f7c001984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c001984d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7be8006010 tx=0x7f7be800be20 comp rx=0 tx=0).stop 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 shutdown_connections 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7bec06c680 0x7f7bec06eb30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:52.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c000ff350 0x7f7c00197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 --2- 172.21.15.79:0/996333132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c000ffc60 0x7f7c001984d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 >> 172.21.15.79:0/996333132 conn(0x7f7c000748b0 msgr2=0x7f7c00100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 shutdown_connections 2024-09-10T09:32:52.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:52.511+0000 7f7c068fe700 1 -- 172.21.15.79:0/996333132 wait complete. 2024-09-10T09:32:52.876 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:52.957 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:52 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/996333132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T09:32:53.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:52 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/996333132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T09:32:53.365 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-09-10T09:32:53.365 DEBUG:teuthology.parallel:result is None 2024-09-10T09:32:53.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:53 smithi079 ceph-mon[27592]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:53 smithi135 ceph-mon[33411]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:54.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 -- 172.21.15.79:0/4088475075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ffc60 msgr2=0x7efc4810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 --2- 172.21.15.79:0/4088475075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ffc60 0x7efc4810a6d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efc38009910 tx=0x7efc38009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:54.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 -- 172.21.15.79:0/4088475075 shutdown_connections 2024-09-10T09:32:54.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 --2- 172.21.15.79:0/4088475075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ffc60 0x7efc4810a6d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 --2- 172.21.15.79:0/4088475075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc480ff350 0x7efc480ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 -- 172.21.15.79:0/4088475075 >> 172.21.15.79:0/4088475075 conn(0x7efc480748b0 msgr2=0x7efc48074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 -- 172.21.15.79:0/4088475075 shutdown_connections 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 -- 172.21.15.79:0/4088475075 wait complete. 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 Processor -- start 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.395+0000 7efc4fd20700 1 -- start start 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4fd20700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ff350 0x7efc48195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4fd20700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc480ffc60 0x7efc481963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4fd20700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481969f0 con 0x7efc480ff350 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4fd20700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48196b30 con 0x7efc480ffc60 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4dabc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ff350 0x7efc48195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4dabc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ff350 0x7efc48195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39838/0 (socket says 172.21.15.79:39838) 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4dabc700 1 -- 172.21.15.79:0/2238752534 learned_addr learned my addr 172.21.15.79:0/2238752534 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:54.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4d2bb700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc480ffc60 0x7efc481963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4dabc700 1 -- 172.21.15.79:0/2238752534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc480ffc60 msgr2=0x7efc481963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4dabc700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc480ffc60 0x7efc481963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4dabc700 1 -- 172.21.15.79:0/2238752534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380095f0 con 0x7efc480ff350 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4dabc700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ff350 0x7efc48195e60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c930 tx=0x7efc4400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc3effd700 1 -- 172.21.15.79:0/2238752534 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc44007ad0 con 0x7efc480ff350 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc3effd700 1 -- 172.21.15.79:0/2238752534 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc44007c30 con 0x7efc480ff350 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4819a980 con 0x7efc480ff350 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc3effd700 1 -- 172.21.15.79:0/2238752534 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc44018630 con 0x7efc480ff350 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.396+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4819aed0 con 0x7efc480ff350 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.397+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc48107dd0 con 0x7efc480ff350 2024-09-10T09:32:54.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.398+0000 7efc3effd700 1 -- 172.21.15.79:0/2238752534 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efc4400f450 con 0x7efc480ff350 2024-09-10T09:32:54.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.398+0000 7efc3effd700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efc3406c680 0x7efc3406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:54.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.398+0000 7efc3effd700 1 -- 172.21.15.79:0/2238752534 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7efc4408b6a0 con 0x7efc480ff350 2024-09-10T09:32:54.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.398+0000 7efc4d2bb700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efc3406c680 0x7efc3406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:54.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.399+0000 7efc4d2bb700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efc3406c680 0x7efc3406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc38005f50 tx=0x7efc3801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:54.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.404+0000 7efc3effd700 1 -- 172.21.15.79:0/2238752534 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efc44056160 con 0x7efc480ff350 2024-09-10T09:32:54.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.603+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efc481077b0 con 0x7efc480ff350 2024-09-10T09:32:54.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.603+0000 7efc3effd700 1 -- 172.21.15.79:0/2238752534 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc44059780 con 0x7efc480ff350 2024-09-10T09:32:54.604 INFO:teuthology.orchestra.run.smithi079.stdout:115964117013 2024-09-10T09:32:54.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efc3406c680 msgr2=0x7efc3406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efc3406c680 0x7efc3406eb30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc38005f50 tx=0x7efc3801a040 comp rx=0 tx=0).stop 2024-09-10T09:32:54.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ff350 msgr2=0x7efc48195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ff350 0x7efc48195e60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c930 tx=0x7efc4400ccf0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 shutdown_connections 2024-09-10T09:32:54.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efc3406c680 0x7efc3406eb30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480ff350 0x7efc48195e60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 --2- 172.21.15.79:0/2238752534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc480ffc60 0x7efc481963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.605+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 >> 172.21.15.79:0/2238752534 conn(0x7efc480748b0 msgr2=0x7efc48104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:54.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.606+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 shutdown_connections 2024-09-10T09:32:54.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.606+0000 7efc4fd20700 1 -- 172.21.15.79:0/2238752534 wait complete. 2024-09-10T09:32:54.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 -- 172.21.15.79:0/449211583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e4069140 msgr2=0x7f52e4104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 --2- 172.21.15.79:0/449211583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e4069140 0x7f52e4104eb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009910 tx=0x7f52d8009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 -- 172.21.15.79:0/449211583 shutdown_connections 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 --2- 172.21.15.79:0/449211583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e4069140 0x7f52e4104eb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 --2- 172.21.15.79:0/449211583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e40687a0 0x7f52e4068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 -- 172.21.15.79:0/449211583 >> 172.21.15.79:0/449211583 conn(0x7f52e4075130 msgr2=0x7f52e4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 -- 172.21.15.79:0/449211583 shutdown_connections 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 -- 172.21.15.79:0/449211583 wait complete. 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 Processor -- start 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.675+0000 7f52ec788700 1 -- start start 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ec788700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e40687a0 0x7f52e4195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:54.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ec788700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e4069140 0x7f52e41963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ec788700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4196a80 con 0x7f52e40687a0 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ec788700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e419a810 con 0x7f52e4069140 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ea524700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e40687a0 0x7f52e4195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ea524700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e40687a0 0x7f52e4195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39866/0 (socket says 172.21.15.79:39866) 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ea524700 1 -- 172.21.15.79:0/3472950619 learned_addr learned my addr 172.21.15.79:0/3472950619 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52e9d23700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e4069140 0x7f52e41963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ea524700 1 -- 172.21.15.79:0/3472950619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e4069140 msgr2=0x7f52e41963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ea524700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e4069140 0x7f52e41963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ea524700 1 -- 172.21.15.79:0/3472950619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80095f0 con 0x7f52e40687a0 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52e9d23700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e4069140 0x7f52e41963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ea524700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e40687a0 0x7f52e4195e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52d40060b0 tx=0x7f52d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52e37fe700 1 -- 172.21.15.79:0/3472950619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d400dda0 con 0x7f52e40687a0 2024-09-10T09:32:54.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52e37fe700 1 -- 172.21.15.79:0/3472950619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f52d400f040 con 0x7f52e40687a0 2024-09-10T09:32:54.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e419aaf0 con 0x7f52e40687a0 2024-09-10T09:32:54.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52e37fe700 1 -- 172.21.15.79:0/3472950619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d4014790 con 0x7f52e40687a0 2024-09-10T09:32:54.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.676+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e419b040 con 0x7f52e40687a0 2024-09-10T09:32:54.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.678+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e4108750 con 0x7f52e40687a0 2024-09-10T09:32:54.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.678+0000 7f52e37fe700 1 -- 172.21.15.79:0/3472950619 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f52d40148f0 con 0x7f52e40687a0 2024-09-10T09:32:54.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.678+0000 7f52e37fe700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f52cc06c680 0x7f52cc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:54.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.678+0000 7f52e37fe700 1 -- 172.21.15.79:0/3472950619 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f52d408af50 con 0x7f52e40687a0 2024-09-10T09:32:54.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.678+0000 7f52e9d23700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f52cc06c680 0x7f52cc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:54.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.679+0000 7f52e9d23700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f52cc06c680 0x7f52cc06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52e4197480 tx=0x7f52d801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:54.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.683+0000 7f52e37fe700 1 -- 172.21.15.79:0/3472950619 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f52d404f720 con 0x7f52e40687a0 2024-09-10T09:32:54.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.877+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f52e404f2a0 con 0x7f52e40687a0 2024-09-10T09:32:54.878 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:54 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2238752534' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T09:32:54.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.877+0000 7f52e37fe700 1 -- 172.21.15.79:0/3472950619 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52d4055ac0 con 0x7f52e40687a0 2024-09-10T09:32:54.879 INFO:teuthology.orchestra.run.smithi079.stdout:150323855377 2024-09-10T09:32:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f52cc06c680 msgr2=0x7f52cc06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f52cc06c680 0x7f52cc06eb30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52e4197480 tx=0x7f52d801a040 comp rx=0 tx=0).stop 2024-09-10T09:32:54.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e40687a0 msgr2=0x7f52e4195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e40687a0 0x7f52e4195e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f52d40060b0 tx=0x7f52d400d3b0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 shutdown_connections 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f52cc06c680 0x7f52cc06eb30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52e40687a0 0x7f52e4195e60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 --2- 172.21.15.79:0/3472950619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52e4069140 0x7f52e41963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 >> 172.21.15.79:0/3472950619 conn(0x7f52e4075130 msgr2=0x7f52e4104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 shutdown_connections 2024-09-10T09:32:54.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:54.879+0000 7f52ec788700 1 -- 172.21.15.79:0/3472950619 wait complete. 2024-09-10T09:32:54.989 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:54 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2238752534' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T09:32:55.354 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2024-09-10T09:32:55.354 DEBUG:teuthology.parallel:result is None 2024-09-10T09:32:55.985 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:55 smithi079 ceph-mon[27592]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:55.986 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:55 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3472950619' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T09:32:55.986 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:56.010 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855374 got 150323855377 for osd.4 2024-09-10T09:32:56.010 DEBUG:teuthology.parallel:result is None 2024-09-10T09:32:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:55 smithi135 ceph-mon[33411]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:55 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/3472950619' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T09:32:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 -- 172.21.15.79:0/2255013945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c100e40 msgr2=0x7fea3c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 --2- 172.21.15.79:0/2255013945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c100e40 0x7fea3c104e10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fea28009910 tx=0x7fea28009c20 comp rx=0 tx=0).stop 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 -- 172.21.15.79:0/2255013945 shutdown_connections 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 --2- 172.21.15.79:0/2255013945 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c100e40 0x7fea3c104e10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 --2- 172.21.15.79:0/2255013945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3c1004a0 0x7fea3c100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 -- 172.21.15.79:0/2255013945 >> 172.21.15.79:0/2255013945 conn(0x7fea3c0fbd40 msgr2=0x7fea3c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 -- 172.21.15.79:0/2255013945 shutdown_connections 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 -- 172.21.15.79:0/2255013945 wait complete. 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 Processor -- start 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.641+0000 7fea42f16700 1 -- start start 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea42f16700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c1004a0 0x7fea3c195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:57.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea42f16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3c100e40 0x7fea3c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea42f16700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c196ad0 con 0x7fea3c1004a0 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea42f16700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c19a860 con 0x7fea3c100e40 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea40cb2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c1004a0 0x7fea3c195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea40cb2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c1004a0 0x7fea3c195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39892/0 (socket says 172.21.15.79:39892) 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea40cb2700 1 -- 172.21.15.79:0/808168509 learned_addr learned my addr 172.21.15.79:0/808168509 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea3bfff700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3c100e40 0x7fea3c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea40cb2700 1 -- 172.21.15.79:0/808168509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3c100e40 msgr2=0x7fea3c1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea40cb2700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3c100e40 0x7fea3c1963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea40cb2700 1 -- 172.21.15.79:0/808168509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280095f0 con 0x7fea3c1004a0 2024-09-10T09:32:57.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea40cb2700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c1004a0 0x7fea3c195eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea3000d8d0 tx=0x7fea3000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea39ffb700 1 -- 172.21.15.79:0/808168509 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea300098a0 con 0x7fea3c1004a0 2024-09-10T09:32:57.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c19ab40 con 0x7fea3c1004a0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea39ffb700 1 -- 172.21.15.79:0/808168509 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fea30010460 con 0x7fea3c1004a0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.642+0000 7fea39ffb700 1 -- 172.21.15.79:0/808168509 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea3000f5f0 con 0x7fea3c1004a0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.643+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c19b090 con 0x7fea3c1004a0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.643+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c108810 con 0x7fea3c1004a0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.644+0000 7fea39ffb700 1 -- 172.21.15.79:0/808168509 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fea30009a00 con 0x7fea3c1004a0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.644+0000 7fea39ffb700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea2c06c680 0x7fea2c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.644+0000 7fea39ffb700 1 -- 172.21.15.79:0/808168509 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fea3008b380 con 0x7fea3c1004a0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.644+0000 7fea3bfff700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea2c06c680 0x7fea2c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:32:57.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.645+0000 7fea3bfff700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea2c06c680 0x7fea2c06eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea3c1974d0 tx=0x7fea2801a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:32:57.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.648+0000 7fea39ffb700 1 -- 172.21.15.79:0/808168509 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fea30055e40 con 0x7fea3c1004a0 2024-09-10T09:32:57.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.842+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fea3c04f2a0 con 0x7fea3c1004a0 2024-09-10T09:32:57.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.842+0000 7fea39ffb700 1 -- 172.21.15.79:0/808168509 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea30059460 con 0x7fea3c1004a0 2024-09-10T09:32:57.843 INFO:teuthology.orchestra.run.smithi079.stdout:171798691852 2024-09-10T09:32:57.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.844+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea2c06c680 msgr2=0x7fea2c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:57.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.844+0000 7fea42f16700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea2c06c680 0x7fea2c06eb30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea3c1974d0 tx=0x7fea2801a040 comp rx=0 tx=0).stop 2024-09-10T09:32:57.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.844+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c1004a0 msgr2=0x7fea3c195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.844+0000 7fea42f16700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c1004a0 0x7fea3c195eb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fea3000d8d0 tx=0x7fea3000dbe0 comp rx=0 tx=0).stop 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.845+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 shutdown_connections 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.845+0000 7fea42f16700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fea2c06c680 0x7fea2c06eb30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.845+0000 7fea42f16700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea3c1004a0 0x7fea3c195eb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.845+0000 7fea42f16700 1 --2- 172.21.15.79:0/808168509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea3c100e40 0x7fea3c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.845+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 >> 172.21.15.79:0/808168509 conn(0x7fea3c0fbd40 msgr2=0x7fea3c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.845+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 shutdown_connections 2024-09-10T09:32:57.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:32:57.845+0000 7fea42f16700 1 -- 172.21.15.79:0/808168509 wait complete. 2024-09-10T09:32:58.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:57 smithi079 ceph-mon[27592]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:57 smithi135 ceph-mon[33411]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:32:58.521 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691849 got 171798691852 for osd.5 2024-09-10T09:32:58.522 DEBUG:teuthology.parallel:result is None 2024-09-10T09:32:58.522 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T09:32:58.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T09:32:58.720 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:32:59.063 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:58 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/808168509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T09:32:59.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:58 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/808168509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T09:32:59.988 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:32:59 smithi079 ceph-mon[27592]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:00.027 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:32:59 smithi135 ceph-mon[33411]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:00.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 -- 172.21.15.79:0/133407446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 msgr2=0x7f2b640ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 --2- 172.21.15.79:0/133407446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b640ff790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009910 tx=0x7f2b54009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 -- 172.21.15.79:0/133407446 shutdown_connections 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 --2- 172.21.15.79:0/133407446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b640ffd60 0x7f2b64103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 --2- 172.21.15.79:0/133407446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b640ff790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 -- 172.21.15.79:0/133407446 >> 172.21.15.79:0/133407446 conn(0x7f2b640fac80 msgr2=0x7f2b640fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 -- 172.21.15.79:0/133407446 shutdown_connections 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 -- 172.21.15.79:0/133407446 wait complete. 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 Processor -- start 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.328+0000 7f2b6a762700 1 -- start start 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b6a762700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b64195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b6a762700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b640ffd60 0x7f2b641963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b6a762700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64196a30 con 0x7f2b640ff3c0 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b6a762700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64196b70 con 0x7f2b640ffd60 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b64195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b63fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b64195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39904/0 (socket says 172.21.15.79:39904) 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b63fff700 1 -- 172.21.15.79:0/896786167 learned_addr learned my addr 172.21.15.79:0/896786167 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b5bfff700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b640ffd60 0x7f2b641963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b63fff700 1 -- 172.21.15.79:0/896786167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b640ffd60 msgr2=0x7f2b641963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b63fff700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b640ffd60 0x7f2b641963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b63fff700 1 -- 172.21.15.79:0/896786167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540095f0 con 0x7f2b640ff3c0 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b63fff700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b64195ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b54006010 tx=0x7f2b5400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b61ffb700 1 -- 172.21.15.79:0/896786167 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5401d070 con 0x7f2b640ff3c0 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6419a960 con 0x7f2b640ff3c0 2024-09-10T09:33:00.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b61ffb700 1 -- 172.21.15.79:0/896786167 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b54004fa0 con 0x7f2b640ff3c0 2024-09-10T09:33:00.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.329+0000 7f2b61ffb700 1 -- 172.21.15.79:0/896786167 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b5400f690 con 0x7f2b640ff3c0 2024-09-10T09:33:00.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.330+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6419ae50 con 0x7f2b640ff3c0 2024-09-10T09:33:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.331+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6404f2a0 con 0x7f2b640ff3c0 2024-09-10T09:33:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.331+0000 7f2b61ffb700 1 -- 172.21.15.79:0/896786167 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2b54022470 con 0x7f2b640ff3c0 2024-09-10T09:33:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.331+0000 7f2b61ffb700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b5006c680 0x7f2b5006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.331+0000 7f2b61ffb700 1 -- 172.21.15.79:0/896786167 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f2b5408cb90 con 0x7f2b640ff3c0 2024-09-10T09:33:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.331+0000 7f2b5bfff700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b5006c680 0x7f2b5006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:00.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.332+0000 7f2b5bfff700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b5006c680 0x7f2b5006eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b641974c0 tx=0x7f2b4c00a380 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:00.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.336+0000 7f2b61ffb700 1 -- 172.21.15.79:0/896786167 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2b54057650 con 0x7f2b640ff3c0 2024-09-10T09:33:00.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.521+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b6419b1a0 con 0x7f2b5006c680 2024-09-10T09:33:00.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.522+0000 7f2b61ffb700 1 -- 172.21.15.79:0/896786167 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28097 (secure 0 0 0) 0x7f2b6419b1a0 con 0x7f2b5006c680 2024-09-10T09:33:00.524 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:00.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.524+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b5006c680 msgr2=0x7f2b5006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.524+0000 7f2b6a762700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b5006c680 0x7f2b5006eb30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b641974c0 tx=0x7f2b4c00a380 comp rx=0 tx=0).stop 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.524+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 msgr2=0x7f2b64195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.524+0000 7f2b6a762700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b64195ea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b54006010 tx=0x7f2b5400bd70 comp rx=0 tx=0).stop 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.525+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 shutdown_connections 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.525+0000 7f2b6a762700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b5006c680 0x7f2b5006eb30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.525+0000 7f2b6a762700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b640ff3c0 0x7f2b64195ea0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.525+0000 7f2b6a762700 1 --2- 172.21.15.79:0/896786167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b640ffd60 0x7f2b641963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.525+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 >> 172.21.15.79:0/896786167 conn(0x7f2b640fac80 msgr2=0x7f2b64103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.525+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 shutdown_connections 2024-09-10T09:33:00.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:00.525+0000 7f2b6a762700 1 -- 172.21.15.79:0/896786167 wait complete. 2024-09-10T09:33:00.527 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-10T09:33:01.242 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-10T09:32:58.642324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002352"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":184,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T09:32:09.710326+0000","last_change":"2024-09-10T09:31:44.375869+0000","last_active":"2024-09-10T09:32:09.710326+0000","last_peered":"2024-09-10T09:32:09.710326+0000","last_clean":"2024-09-10T09:32:09.710326+0000","last_became_active":"2024-09-10T09:31:44.375551+0000","last_became_peered":"2024-09-10T09:31:44.375551+0000","last_unstale":"2024-09-10T09:32:09.710326+0000","last_undegraded":"2024-09-10T09:32:09.710326+0000","last_fullsized":"2024-09-10T09:32:09.710326+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:30:57.550245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:30:57.550245+0000","last_clean_scrub_stamp":"2024-09-10T09:30:57.550245+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:15.494318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855377,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.44400000000000001}]},{"osd":1,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":16.251999999999999,"5min":16.251999999999999,"15min":16.251999999999999},"last":0.48999999999999999}]},{"osd":4,"last update":"Tue Sep 10 09:32:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.245},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.27200000000000002}]},{"osd":1,"last update":"Tue Sep 10 09:31:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.28599999999999998}]},{"osd":3,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63200000000000001}]},{"osd":4,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 09:32:34 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.314,"15min":0.311},"min":{"1min":0.22500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.25700000000000001}]},{"osd":2,"last update":"Tue Sep 10 09:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.32500000000000001}]},{"osd":3,"last update":"Tue Sep 10 09:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Sep 10 09:32:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.505},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:32:35 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.32800000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.311},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.27900000000000003}]},{"osd":2,"last update":"Tue Sep 10 09:31:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.247},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.29099999999999998}]},{"osd":3,"last update":"Tue Sep 10 09:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68999999999999995}]},{"osd":4,"last update":"Tue Sep 10 09:32:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:33:01.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T09:33:01.441 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:01.891 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:01 smithi079 ceph-mon[27592]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T09:33:01.891 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:01 smithi079 ceph-mon[27592]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:01 smithi135 ceph-mon[33411]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T09:33:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:01 smithi135 ceph-mon[33411]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 -- 172.21.15.79:0/3380716074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c0ffbd0 msgr2=0x7f415c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 --2- 172.21.15.79:0/3380716074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c0ffbd0 0x7f415c100040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f414c009910 tx=0x7f414c009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 -- 172.21.15.79:0/3380716074 shutdown_connections 2024-09-10T09:33:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 --2- 172.21.15.79:0/3380716074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c0ffbd0 0x7f415c100040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 --2- 172.21.15.79:0/3380716074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415c104130 0x7f415c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:03.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 -- 172.21.15.79:0/3380716074 >> 172.21.15.79:0/3380716074 conn(0x7f415c075130 msgr2=0x7f415c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 -- 172.21.15.79:0/3380716074 shutdown_connections 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.048+0000 7f4161673700 1 -- 172.21.15.79:0/3380716074 wait complete. 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f4161673700 1 Processor -- start 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f4161673700 1 -- start start 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f4161673700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415c0ffbd0 0x7f415c195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f4161673700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c104130 0x7f415c196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f4161673700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c1969e0 con 0x7f415c104130 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f4161673700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c196b20 con 0x7f415c0ffbd0 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c104130 0x7f415c196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c104130 0x7f415c196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52350/0 (socket says 172.21.15.79:52350) 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415a7fc700 1 -- 172.21.15.79:0/2218434898 learned_addr learned my addr 172.21.15.79:0/2218434898 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415affd700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415c0ffbd0 0x7f415c195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415a7fc700 1 -- 172.21.15.79:0/2218434898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415c0ffbd0 msgr2=0x7f415c195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415a7fc700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415c0ffbd0 0x7f415c195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415a7fc700 1 -- 172.21.15.79:0/2218434898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0095f0 con 0x7f415c104130 2024-09-10T09:33:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.049+0000 7f415affd700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415c0ffbd0 0x7f415c195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:33:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.050+0000 7f415a7fc700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c104130 0x7f415c196390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f414c00bd70 tx=0x7f414c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.050+0000 7f4143fff700 1 -- 172.21.15.79:0/2218434898 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f414c01d070 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.050+0000 7f4143fff700 1 -- 172.21.15.79:0/2218434898 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f414c022470 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.050+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c19a910 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.050+0000 7f4143fff700 1 -- 172.21.15.79:0/2218434898 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f414c00f690 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.050+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c19ae00 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.051+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c04f2a0 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.051+0000 7f4143fff700 1 -- 172.21.15.79:0/2218434898 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f414c0225e0 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.052+0000 7f4143fff700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f414406c680 0x7f414406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.052+0000 7f4143fff700 1 -- 172.21.15.79:0/2218434898 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f414c08ca70 con 0x7f415c104130 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.052+0000 7f415affd700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f414406c680 0x7f414406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:03.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.052+0000 7f415affd700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f414406c680 0x7f414406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4150005fd0 tx=0x7f4150005e30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.056+0000 7f4143fff700 1 -- 172.21.15.79:0/2218434898 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f414c0575e0 con 0x7f415c104130 2024-09-10T09:33:03.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.242+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f415c108190 con 0x7f414406c680 2024-09-10T09:33:03.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.244+0000 7f4143fff700 1 -- 172.21.15.79:0/2218434898 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27981 (secure 0 0 0) 0x7f415c108190 con 0x7f414406c680 2024-09-10T09:33:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f414406c680 msgr2=0x7f414406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f414406c680 0x7f414406eb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4150005fd0 tx=0x7f4150005e30 comp rx=0 tx=0).stop 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c104130 msgr2=0x7f415c196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c104130 0x7f415c196390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f414c00bd70 tx=0x7f414c00be50 comp rx=0 tx=0).stop 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 shutdown_connections 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f414406c680 0x7f414406eb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f415c0ffbd0 0x7f415c195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 --2- 172.21.15.79:0/2218434898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f415c104130 0x7f415c196390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 >> 172.21.15.79:0/2218434898 conn(0x7f415c075130 msgr2=0x7f415c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:03.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 shutdown_connections 2024-09-10T09:33:03.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:03.246+0000 7f4161673700 1 -- 172.21.15.79:0/2218434898 wait complete. 2024-09-10T09:33:03.249 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-10T09:33:03.942 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-10T09:33:02.642897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2588226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002251"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":184,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T09:32:09.710326+0000","last_change":"2024-09-10T09:31:44.375869+0000","last_active":"2024-09-10T09:32:09.710326+0000","last_peered":"2024-09-10T09:32:09.710326+0000","last_clean":"2024-09-10T09:32:09.710326+0000","last_became_active":"2024-09-10T09:31:44.375551+0000","last_became_peered":"2024-09-10T09:31:44.375551+0000","last_unstale":"2024-09-10T09:32:09.710326+0000","last_undegraded":"2024-09-10T09:32:09.710326+0000","last_fullsized":"2024-09-10T09:32:09.710326+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T09:30:57.550245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T09:30:57.550245+0000","last_clean_scrub_stamp":"2024-09-10T09:30:57.550245+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:53:15.494318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.498}]},{"osd":2,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.375}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.45300000000000001}]},{"osd":1,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.42699999999999999}]},{"osd":2,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":16.251999999999999,"5min":16.251999999999999,"15min":16.251999999999999},"last":0.44}]},{"osd":4,"last update":"Tue Sep 10 09:32:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":136187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.313,"5min":0.35099999999999998,"15min":0.35699999999999998},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.497,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.26500000000000001}]},{"osd":1,"last update":"Tue Sep 10 09:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34699999999999998,"15min":0.35299999999999998},"min":{"1min":0.22800000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.46000000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36799999999999999,"15min":0.374},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52700000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.23200000000000001}]},{"osd":3,"last update":"Tue Sep 10 09:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55500000000000005}]},{"osd":4,"last update":"Tue Sep 10 09:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 10 09:32:34 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.314,"15min":0.311},"min":{"1min":0.22500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.314},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32300000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.38900000000000001}]},{"osd":2,"last update":"Tue Sep 10 09:31:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.35499999999999998}]},{"osd":3,"last update":"Tue Sep 10 09:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Tue Sep 10 09:32:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":726555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 10 09:32:35 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33100000000000002,"15min":0.32800000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.437},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52400000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Sep 10 09:32:58 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.37,"15min":0.377},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.47499999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.371,"15min":0.379},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.497,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.45400000000000001}]},{"osd":3,"last update":"Tue Sep 10 09:32:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.62},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65300000000000002}]},{"osd":4,"last update":"Tue Sep 10 09:32:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T09:33:03.943 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T09:33:03.943 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T09:33:03.943 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T09:33:03.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T09:33:04.139 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:03 smithi079 ceph-mon[27592]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:03 smithi135 ceph-mon[33411]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:04.911 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:04 smithi079 ceph-mon[27592]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T09:33:05.065 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:04 smithi135 ceph-mon[33411]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T09:33:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 -- 172.21.15.79:0/1198606290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 msgr2=0x7f186c1066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 --2- 172.21.15.79:0/1198606290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1066f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1854009910 tx=0x7f1854009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 -- 172.21.15.79:0/1198606290 shutdown_connections 2024-09-10T09:33:05.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 --2- 172.21.15.79:0/1198606290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f186c068540 0x7f186c0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 --2- 172.21.15.79:0/1198606290 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1066f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 -- 172.21.15.79:0/1198606290 >> 172.21.15.79:0/1198606290 conn(0x7f186c075130 msgr2=0x7f186c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 -- 172.21.15.79:0/1198606290 shutdown_connections 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 -- 172.21.15.79:0/1198606290 wait complete. 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.829+0000 7f18719f5700 1 Processor -- start 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f18719f5700 1 -- start start 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f18719f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f186c068540 0x7f186c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f18719f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f18719f5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c196a90 con 0x7f186c106320 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f18719f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c19a820 con 0x7f186c068540 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:05.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1963b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52374/0 (socket says 172.21.15.79:52374) 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186a7fc700 1 -- 172.21.15.79:0/3069254043 learned_addr learned my addr 172.21.15.79:0/3069254043 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186affd700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f186c068540 0x7f186c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186a7fc700 1 -- 172.21.15.79:0/3069254043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f186c068540 msgr2=0x7f186c195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186a7fc700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f186c068540 0x7f186c195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186a7fc700 1 -- 172.21.15.79:0/3069254043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540095f0 con 0x7f186c106320 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f186a7fc700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1963b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f185c00d8d0 tx=0x7f185c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.830+0000 7f18709f3700 1 -- 172.21.15.79:0/3069254043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c0098a0 con 0x7f186c106320 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.831+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c19ab00 con 0x7f186c106320 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.831+0000 7f18709f3700 1 -- 172.21.15.79:0/3069254043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f185c010460 con 0x7f186c106320 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.831+0000 7f18709f3700 1 -- 172.21.15.79:0/3069254043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c00f5f0 con 0x7f186c106320 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.831+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c19b050 con 0x7f186c106320 2024-09-10T09:33:05.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.831+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c108770 con 0x7f186c106320 2024-09-10T09:33:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.832+0000 7f18709f3700 1 -- 172.21.15.79:0/3069254043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f185c009a00 con 0x7f186c106320 2024-09-10T09:33:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.832+0000 7f18709f3700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f185806c680 0x7f185806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.832+0000 7f18709f3700 1 -- 172.21.15.79:0/3069254043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f185c08b380 con 0x7f186c106320 2024-09-10T09:33:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.832+0000 7f186affd700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f185806c680 0x7f185806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.833+0000 7f186affd700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f185806c680 0x7f185806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1854006010 tx=0x7f185401a040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:05.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:05.837+0000 7f18709f3700 1 -- 172.21.15.79:0/3069254043 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f185c055e40 con 0x7f186c106320 2024-09-10T09:33:05.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:05 smithi079 ceph-mon[27592]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:06.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.074+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f186c04f2a0 con 0x7f186c106320 2024-09-10T09:33:06.076 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.075+0000 7f18709f3700 1 -- 172.21.15.79:0/3069254043 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f185c059460 con 0x7f186c106320 2024-09-10T09:33:06.077 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:06.077 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.076+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f185806c680 msgr2=0x7f185806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.076+0000 7f18719f5700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f185806c680 0x7f185806eb30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1854006010 tx=0x7f185401a040 comp rx=0 tx=0).stop 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.076+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 msgr2=0x7f186c1963b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.076+0000 7f18719f5700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1963b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f185c00d8d0 tx=0x7f185c00dbe0 comp rx=0 tx=0).stop 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.077+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 shutdown_connections 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.077+0000 7f18719f5700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f185806c680 0x7f185806eb30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.077+0000 7f18719f5700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f186c068540 0x7f186c195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.077+0000 7f18719f5700 1 --2- 172.21.15.79:0/3069254043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f186c106320 0x7f186c1963b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.077+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 >> 172.21.15.79:0/3069254043 conn(0x7f186c075130 msgr2=0x7f186c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.077+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 shutdown_connections 2024-09-10T09:33:06.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:06.077+0000 7f18719f5700 1 -- 172.21.15.79:0/3069254043 wait complete. 2024-09-10T09:33:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:05 smithi135 ceph-mon[33411]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:06.720 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T09:33:06.720 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T09:33:06.720 INFO:teuthology.run_tasks:Running task print... 2024-09-10T09:33:06.729 INFO:teuthology.task.print:**** done end installing v18.2.0 cephadm ... 2024-09-10T09:33:06.729 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:33:06.742 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:33:06.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-10T09:33:06.944 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:06.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:06 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3069254043' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T09:33:07.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:06 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/3069254043' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T09:33:07.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:07 smithi079 ceph-mon[27592]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:07 smithi135 ceph-mon[33411]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:08.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 -- 172.21.15.79:0/3288063893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 msgr2=0x7fda400ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:08.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 --2- 172.21.15.79:0/3288063893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda400ff4b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fda34009910 tx=0x7fda34009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:08.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 -- 172.21.15.79:0/3288063893 shutdown_connections 2024-09-10T09:33:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 --2- 172.21.15.79:0/3288063893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda400ff4b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 --2- 172.21.15.79:0/3288063893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda40100750 0x7fda40100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 -- 172.21.15.79:0/3288063893 >> 172.21.15.79:0/3288063893 conn(0x7fda400f9f10 msgr2=0x7fda400fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 -- 172.21.15.79:0/3288063893 shutdown_connections 2024-09-10T09:33:08.655 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.652+0000 7fda45878700 1 -- 172.21.15.79:0/3288063893 wait complete. 2024-09-10T09:33:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.653+0000 7fda45878700 1 Processor -- start 2024-09-10T09:33:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.653+0000 7fda45878700 1 -- start start 2024-09-10T09:33:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.653+0000 7fda45878700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda40100750 0x7fda400feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:08.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.653+0000 7fda45878700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda4019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.653+0000 7fda45878700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4019ae80 con 0x7fda401010a0 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.653+0000 7fda45878700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4019aff0 con 0x7fda40100750 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda4019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda4019a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52400/0 (socket says 172.21.15.79:52400) 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3e7fc700 1 -- 172.21.15.79:0/2053985892 learned_addr learned my addr 172.21.15.79:0/2053985892 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3effd700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda40100750 0x7fda400feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3e7fc700 1 -- 172.21.15.79:0/2053985892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda40100750 msgr2=0x7fda400feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3e7fc700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda40100750 0x7fda400feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3e7fc700 1 -- 172.21.15.79:0/2053985892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340095f0 con 0x7fda401010a0 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda3e7fc700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda4019a8b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda34006010 tx=0x7fda3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda44876700 1 -- 172.21.15.79:0/2053985892 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda3401d070 con 0x7fda401010a0 2024-09-10T09:33:08.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda44876700 1 -- 172.21.15.79:0/2053985892 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda3400f460 con 0x7fda401010a0 2024-09-10T09:33:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda44876700 1 -- 172.21.15.79:0/2053985892 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda34021640 con 0x7fda401010a0 2024-09-10T09:33:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4019b270 con 0x7fda401010a0 2024-09-10T09:33:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.654+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4019b710 con 0x7fda401010a0 2024-09-10T09:33:08.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.655+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda40107ca0 con 0x7fda401010a0 2024-09-10T09:33:08.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.656+0000 7fda44876700 1 -- 172.21.15.79:0/2053985892 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fda3400fab0 con 0x7fda401010a0 2024-09-10T09:33:08.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.656+0000 7fda44876700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda2806c680 0x7fda2806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:08.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.656+0000 7fda44876700 1 -- 172.21.15.79:0/2053985892 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fda3408c980 con 0x7fda401010a0 2024-09-10T09:33:08.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.656+0000 7fda3effd700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda2806c680 0x7fda2806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:08.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.657+0000 7fda3effd700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda2806c680 0x7fda2806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:08.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.661+0000 7fda44876700 1 -- 172.21.15.79:0/2053985892 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fda3405aed0 con 0x7fda401010a0 2024-09-10T09:33:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.851+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fda40107e90 con 0x7fda401010a0 2024-09-10T09:33:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.856+0000 7fda44876700 1 -- 172.21.15.79:0/2053985892 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fda340260d0 con 0x7fda401010a0 2024-09-10T09:33:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda2806c680 msgr2=0x7fda2806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda2806c680 0x7fda2806eb30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).stop 2024-09-10T09:33:08.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 msgr2=0x7fda4019a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda4019a8b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda34006010 tx=0x7fda3400be20 comp rx=0 tx=0).stop 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 shutdown_connections 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda2806c680 0x7fda2806eb30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda40100750 0x7fda400feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 --2- 172.21.15.79:0/2053985892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda401010a0 0x7fda4019a8b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 >> 172.21.15.79:0/2053985892 conn(0x7fda400f9f10 msgr2=0x7fda40103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 shutdown_connections 2024-09-10T09:33:08.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:08.858+0000 7fda45878700 1 -- 172.21.15.79:0/2053985892 wait complete. 2024-09-10T09:33:09.543 INFO:teuthology.run_tasks:Running task print... 2024-09-10T09:33:09.554 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-10T09:33:09.554 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:33:09.570 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:33:09.571 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T09:33:09.766 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:10.070 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:09 smithi079 ceph-mon[27592]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:10.070 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:09 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2053985892' entity='client.admin' 2024-09-10T09:33:10.070 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:10.070 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:10.070 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:10.071 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:09 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:10.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:09 smithi135 ceph-mon[33411]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:10.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:09 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2053985892' entity='client.admin' 2024-09-10T09:33:10.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:10.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:10.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:10.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:09 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:10 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:11.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:10 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 -- 172.21.15.79:0/3032794927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 msgr2=0x7f720c0ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 --2- 172.21.15.79:0/3032794927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c0ffb20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f720400b0a0 tx=0x7f720400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 -- 172.21.15.79:0/3032794927 shutdown_connections 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 --2- 172.21.15.79:0/3032794927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f720c100060 0x7f720c1004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 --2- 172.21.15.79:0/3032794927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c0ffb20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 -- 172.21.15.79:0/3032794927 >> 172.21.15.79:0/3032794927 conn(0x7f720c0f9f10 msgr2=0x7f720c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 -- 172.21.15.79:0/3032794927 shutdown_connections 2024-09-10T09:33:11.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.455+0000 7f7213557700 1 -- 172.21.15.79:0/3032794927 wait complete. 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f7213557700 1 Processor -- start 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f7213557700 1 -- start start 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f7213557700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c194ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f7213557700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f720c100060 0x7f720c194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f7213557700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c195610 con 0x7f720c0ff710 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f7213557700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720c195750 con 0x7f720c100060 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f72112f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c194ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f72112f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c194ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52430/0 (socket says 172.21.15.79:52430) 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.456+0000 7f72112f3700 1 -- 172.21.15.79:0/3555457105 learned_addr learned my addr 172.21.15.79:0/3555457105 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f72112f3700 1 -- 172.21.15.79:0/3555457105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f720c100060 msgr2=0x7f720c194ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f7210af2700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f720c100060 0x7f720c194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:11.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f72112f3700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f720c100060 0x7f720c194ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f72112f3700 1 -- 172.21.15.79:0/3555457105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204009d00 con 0x7f720c0ff710 2024-09-10T09:33:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f72112f3700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c194ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f72040077b0 tx=0x7f7204003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f720a7fc700 1 -- 172.21.15.79:0/3555457105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f720400e040 con 0x7f720c0ff710 2024-09-10T09:33:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f720a7fc700 1 -- 172.21.15.79:0/3555457105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f720400ce60 con 0x7f720c0ff710 2024-09-10T09:33:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f720a7fc700 1 -- 172.21.15.79:0/3555457105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f720401daf0 con 0x7f720c0ff710 2024-09-10T09:33:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720c19a1a0 con 0x7f720c0ff710 2024-09-10T09:33:11.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.457+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720c19a690 con 0x7f720c0ff710 2024-09-10T09:33:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.458+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f720c107c90 con 0x7f720c0ff710 2024-09-10T09:33:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.458+0000 7f720a7fc700 1 -- 172.21.15.79:0/3555457105 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7204004250 con 0x7f720c0ff710 2024-09-10T09:33:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.459+0000 7f720a7fc700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f71f406c680 0x7f71f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.459+0000 7f720a7fc700 1 -- 172.21.15.79:0/3555457105 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f720408cfa0 con 0x7f720c0ff710 2024-09-10T09:33:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.459+0000 7f7210af2700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f71f406c680 0x7f71f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:11.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.459+0000 7f7210af2700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f71f406c680 0x7f71f406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7200006fd0 tx=0x7f7200008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:11.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.463+0000 7f720a7fc700 1 -- 172.21.15.79:0/3555457105 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f720405b4f0 con 0x7f720c0ff710 2024-09-10T09:33:11.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.667+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f720c19acd0 con 0x7f71f406c680 2024-09-10T09:33:11.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.668+0000 7f720a7fc700 1 -- 172.21.15.79:0/3555457105 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f720c19acd0 con 0x7f71f406c680 2024-09-10T09:33:11.669 INFO:teuthology.orchestra.run.smithi079.stdout:Backend: cephadm 2024-09-10T09:33:11.669 INFO:teuthology.orchestra.run.smithi079.stdout:Available: Yes 2024-09-10T09:33:11.669 INFO:teuthology.orchestra.run.smithi079.stdout:Paused: No 2024-09-10T09:33:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f71f406c680 msgr2=0x7f71f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f71f406c680 0x7f71f406eb30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7200006fd0 tx=0x7f7200008040 comp rx=0 tx=0).stop 2024-09-10T09:33:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 msgr2=0x7f720c194ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c194ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f72040077b0 tx=0x7f7204003ce0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 shutdown_connections 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f71f406c680 0x7f71f406eb30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f720c0ff710 0x7f720c194ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 --2- 172.21.15.79:0/3555457105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f720c100060 0x7f720c194ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 >> 172.21.15.79:0/3555457105 conn(0x7f720c0f9f10 msgr2=0x7f720c1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 shutdown_connections 2024-09-10T09:33:11.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:11.670+0000 7f7213557700 1 -- 172.21.15.79:0/3555457105 wait complete. 2024-09-10T09:33:12.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:11 smithi079 ceph-mon[27592]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:11 smithi135 ceph-mon[33411]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:12.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T09:33:12.557 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:12.944 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:12 smithi079 ceph-mon[27592]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:13.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:12 smithi135 ceph-mon[33411]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:14.151 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:13 smithi079 ceph-mon[27592]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:14.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.171+0000 7f53420eb700 1 -- 172.21.15.79:0/1558363566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c101440 msgr2=0x7f533c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:14.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.171+0000 7f53420eb700 1 --2- 172.21.15.79:0/1558363566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c101440 0x7f533c101890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5330009910 tx=0x7f5330009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:14.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.171+0000 7f53420eb700 1 -- 172.21.15.79:0/1558363566 shutdown_connections 2024-09-10T09:33:14.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.171+0000 7f53420eb700 1 --2- 172.21.15.79:0/1558363566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c101440 0x7f533c101890 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:14.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.171+0000 7f53420eb700 1 --2- 172.21.15.79:0/1558363566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f533c100240 0x7f533c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:14.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.171+0000 7f53420eb700 1 -- 172.21.15.79:0/1558363566 >> 172.21.15.79:0/1558363566 conn(0x7f533c0fb7f0 msgr2=0x7f533c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:14.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 -- 172.21.15.79:0/1558363566 shutdown_connections 2024-09-10T09:33:14.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 -- 172.21.15.79:0/1558363566 wait complete. 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 Processor -- start 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 -- start start 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c100240 0x7f533c195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f533c101440 0x7f533c195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1965f0 con 0x7f533c100240 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.172+0000 7f53420eb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c196730 con 0x7f533c101440 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c100240 0x7f533c195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c100240 0x7f533c195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52892/0 (socket says 172.21.15.79:52892) 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533b7fe700 1 -- 172.21.15.79:0/252576212 learned_addr learned my addr 172.21.15.79:0/252576212 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533affd700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f533c101440 0x7f533c195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533b7fe700 1 -- 172.21.15.79:0/252576212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f533c101440 msgr2=0x7f533c195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533b7fe700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f533c101440 0x7f533c195fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:14.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533b7fe700 1 -- 172.21.15.79:0/252576212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300095f0 con 0x7f533c100240 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533affd700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f533c101440 0x7f533c195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f533b7fe700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c100240 0x7f533c195a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f532c00d900 tx=0x7f532c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f5338ff9700 1 -- 172.21.15.79:0/252576212 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f532c0041f0 con 0x7f533c100240 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f5338ff9700 1 -- 172.21.15.79:0/252576212 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f532c004350 con 0x7f533c100240 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c19b1e0 con 0x7f533c100240 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f5338ff9700 1 -- 172.21.15.79:0/252576212 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f532c003da0 con 0x7f533c100240 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.173+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c19b730 con 0x7f533c100240 2024-09-10T09:33:14.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.174+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c108d90 con 0x7f533c100240 2024-09-10T09:33:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.175+0000 7f5338ff9700 1 -- 172.21.15.79:0/252576212 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f532c009940 con 0x7f533c100240 2024-09-10T09:33:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.175+0000 7f5338ff9700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f532406c680 0x7f532406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.176+0000 7f5338ff9700 1 -- 172.21.15.79:0/252576212 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f532c08b910 con 0x7f533c100240 2024-09-10T09:33:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.176+0000 7f533affd700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f532406c680 0x7f532406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.176+0000 7f533affd700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f532406c680 0x7f532406eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5330005b40 tx=0x7f5330005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.179+0000 7f5338ff9700 1 -- 172.21.15.79:0/252576212 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f532c059f80 con 0x7f533c100240 2024-09-10T09:33:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:13 smithi135 ceph-mon[33411]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:14.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.379+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f533c105d90 con 0x7f532406c680 2024-09-10T09:33:14.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.388+0000 7f5338ff9700 1 -- 172.21.15.79:0/252576212 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7f533c105d90 con 0x7f532406c680 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (3m) 2m ago 5m 26.5M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (5m) 2m ago 5m 7004k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (4m) 66s ago 4m 6937k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (5m) 2m ago 5m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (4m) 66s ago 4m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (3m) 2m ago 4m 79.2M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:9283,8765,8443 running (6m) 2m ago 6m 478M - 18.2.0 dc2bc1663786 3bc55a447267 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (4m) 66s ago 4m 437M - 18.2.0 dc2bc1663786 b593ff93654b 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (6m) 2m ago 6m 42.9M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (4m) 66s ago 4m 39.7M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:33:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (5m) 2m ago 5m 14.6M - 1.5.0 0da6a335fe13 2d43514669a8 2024-09-10T09:33:14.390 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (4m) 66s ago 4m 15.3M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:33:14.390 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (3m) 2m ago 3m 42.5M 3946M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:33:14.392 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (2m) 2m ago 2m 40.7M 3946M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:33:14.392 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (2m) 2m ago 2m 40.1M 3946M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:33:14.392 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (2m) 66s ago 2m 40.3M 1213M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:33:14.392 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (97s) 66s ago 96s 39.4M 1213M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:33:14.392 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (71s) 66s ago 71s 13.6M 1213M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:33:14.392 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (3m) 2m ago 4m 40.1M - 2.43.0 a07b618ecd1d 960dc8481947 2024-09-10T09:33:14.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f532406c680 msgr2=0x7f532406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:14.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f532406c680 0x7f532406eb30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5330005b40 tx=0x7f5330005a90 comp rx=0 tx=0).stop 2024-09-10T09:33:14.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c100240 msgr2=0x7f533c195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:14.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c100240 0x7f533c195a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f532c00d900 tx=0x7f532c00dcc0 comp rx=0 tx=0).stop 2024-09-10T09:33:14.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 shutdown_connections 2024-09-10T09:33:14.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f532406c680 0x7f532406eb30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:14.393 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f533c100240 0x7f533c195a90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:14.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 --2- 172.21.15.79:0/252576212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f533c101440 0x7f533c195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:14.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 >> 172.21.15.79:0/252576212 conn(0x7f533c0fb7f0 msgr2=0x7f533c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:14.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 shutdown_connections 2024-09-10T09:33:14.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:14.390+0000 7f53420eb700 1 -- 172.21.15.79:0/252576212 wait complete. 2024-09-10T09:33:15.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T09:33:15.223 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:15 smithi079 ceph-mon[27592]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:15 smithi079 ceph-mon[27592]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:15 smithi135 ceph-mon[33411]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:15 smithi135 ceph-mon[33411]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 -- 172.21.15.79:0/3566881372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db41003d0 msgr2=0x7f8db4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:16.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 --2- 172.21.15.79:0/3566881372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db41003d0 0x7f8db4100840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009910 tx=0x7f8d9c009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 -- 172.21.15.79:0/3566881372 shutdown_connections 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 --2- 172.21.15.79:0/3566881372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db41003d0 0x7f8db4100840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 --2- 172.21.15.79:0/3566881372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8db40ff130 0x7f8db40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 -- 172.21.15.79:0/3566881372 >> 172.21.15.79:0/3566881372 conn(0x7f8db40fa780 msgr2=0x7f8db40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 -- 172.21.15.79:0/3566881372 shutdown_connections 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.824+0000 7f8dba8de700 1 -- 172.21.15.79:0/3566881372 wait complete. 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8dba8de700 1 Processor -- start 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8dba8de700 1 -- start start 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8dba8de700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db40ff130 0x7f8db4195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8dba8de700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8db41003d0 0x7f8db4195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:16.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8dba8de700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db41965d0 con 0x7f8db40ff130 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8dba8de700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db4196710 con 0x7f8db41003d0 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8db3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db40ff130 0x7f8db4195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8db3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db40ff130 0x7f8db4195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52910/0 (socket says 172.21.15.79:52910) 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8db3fff700 1 -- 172.21.15.79:0/2645349845 learned_addr learned my addr 172.21.15.79:0/2645349845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8db37fe700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8db41003d0 0x7f8db4195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8db3fff700 1 -- 172.21.15.79:0/2645349845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8db41003d0 msgr2=0x7f8db4195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8db3fff700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8db41003d0 0x7f8db4195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.825+0000 7f8db3fff700 1 -- 172.21.15.79:0/2645349845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0095f0 con 0x7f8db40ff130 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.826+0000 7f8db3fff700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db40ff130 0x7f8db4195a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8da400d8d0 tx=0x7f8da400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.826+0000 7f8db17fa700 1 -- 172.21.15.79:0/2645349845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da40098a0 con 0x7f8db40ff130 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.826+0000 7f8db17fa700 1 -- 172.21.15.79:0/2645349845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8da4010460 con 0x7f8db40ff130 2024-09-10T09:33:16.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.826+0000 7f8db17fa700 1 -- 172.21.15.79:0/2645349845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8da400f5f0 con 0x7f8db40ff130 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.826+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db419b1c0 con 0x7f8db40ff130 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.826+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db419b710 con 0x7f8db40ff130 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.827+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db4107c10 con 0x7f8db40ff130 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.827+0000 7f8db17fa700 1 -- 172.21.15.79:0/2645349845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f8da4009a00 con 0x7f8db40ff130 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.828+0000 7f8db17fa700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8da006c680 0x7f8da006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.828+0000 7f8db37fe700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8da006c680 0x7f8da006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.828+0000 7f8db17fa700 1 -- 172.21.15.79:0/2645349845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f8da408b330 con 0x7f8db40ff130 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.828+0000 7f8db37fe700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8da006c680 0x7f8da006eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c006010 tx=0x7f8d9c00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:16.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:16.832+0000 7f8db17fa700 1 -- 172.21.15.79:0/2645349845 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f8da40598a0 con 0x7f8db40ff130 2024-09-10T09:33:17.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.034+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8db4068c50 con 0x7f8da006c680 2024-09-10T09:33:17.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.038+0000 7f8db17fa700 1 -- 172.21.15.79:0/2645349845 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f8db4068c50 con 0x7f8da006c680 2024-09-10T09:33:17.039 INFO:teuthology.orchestra.run.smithi079.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T09:33:17.039 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter 2/2 2m ago 6m * 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:crash 2/2 2m ago 6m * 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:mgr 2/2 2m ago 6m count:2 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:mon 2/2 2m ago 5m smithi079:172.21.15.79=smithi079;smithi135:172.21.15.135=smithi135;count:2 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:osd 6 2m ago - 2024-09-10T09:33:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-10T09:33:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.040+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8da006c680 msgr2=0x7f8da006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.040+0000 7f8dba8de700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8da006c680 0x7f8da006eb30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c006010 tx=0x7f8d9c00b540 comp rx=0 tx=0).stop 2024-09-10T09:33:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.040+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db40ff130 msgr2=0x7f8db4195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.040+0000 7f8dba8de700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db40ff130 0x7f8db4195a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8da400d8d0 tx=0x7f8da400dbe0 comp rx=0 tx=0).stop 2024-09-10T09:33:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.040+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 shutdown_connections 2024-09-10T09:33:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.040+0000 7f8dba8de700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f8da006c680 0x7f8da006eb30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.040+0000 7f8dba8de700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8db40ff130 0x7f8db4195a70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.041+0000 7f8dba8de700 1 --2- 172.21.15.79:0/2645349845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8db41003d0 0x7f8db4195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.041+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 >> 172.21.15.79:0/2645349845 conn(0x7f8db40fa780 msgr2=0x7f8db4068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.041+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 shutdown_connections 2024-09-10T09:33:17.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:17.041+0000 7f8dba8de700 1 -- 172.21.15.79:0/2645349845 wait complete. 2024-09-10T09:33:17.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T09:33:17.897 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:17.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:17 smithi079 ceph-mon[27592]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:17.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:17 smithi079 ceph-mon[27592]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:17 smithi135 ceph-mon[33411]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:17 smithi135 ceph-mon[33411]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.532+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/3712713902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 msgr2=0x7f2b44101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.532+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/3712713902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44101c90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009910 tx=0x7f2b40009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/3712713902 shutdown_connections 2024-09-10T09:33:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/3712713902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b441021d0 0x7f2b440fe300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/3712713902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44101c90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/3712713902 >> 172.21.15.79:0/3712713902 conn(0x7f2b440f9f10 msgr2=0x7f2b440fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/3712713902 shutdown_connections 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/3712713902 wait complete. 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 Processor -- start 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 -- start start 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b441021d0 0x7f2b440ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ffb10 con 0x7f2b44101880 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.533+0000 7f2b4c4b6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ffc50 con 0x7f2b441021d0 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4a252700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4a252700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52920/0 (socket says 172.21.15.79:52920) 2024-09-10T09:33:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4a252700 1 -- 172.21.15.79:0/249683049 learned_addr learned my addr 172.21.15.79:0/249683049 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b49a51700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b441021d0 0x7f2b440ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4a252700 1 -- 172.21.15.79:0/249683049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b441021d0 msgr2=0x7f2b440ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4a252700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b441021d0 0x7f2b440ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4a252700 1 -- 172.21.15.79:0/249683049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400095f0 con 0x7f2b44101880 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b49a51700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b441021d0 0x7f2b440ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4a252700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44100f80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b400092e0 tx=0x7f2b4000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b3b7fe700 1 -- 172.21.15.79:0/249683049 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b4001d070 con 0x7f2b44101880 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b440ffed0 con 0x7f2b44101880 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b3b7fe700 1 -- 172.21.15.79:0/249683049 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2b4000f460 con 0x7f2b44101880 2024-09-10T09:33:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b3b7fe700 1 -- 172.21.15.79:0/249683049 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b40021620 con 0x7f2b44101880 2024-09-10T09:33:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.534+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b441003c0 con 0x7f2b44101880 2024-09-10T09:33:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.535+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44108d40 con 0x7f2b44101880 2024-09-10T09:33:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.536+0000 7f2b3b7fe700 1 -- 172.21.15.79:0/249683049 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f2b4000f5d0 con 0x7f2b44101880 2024-09-10T09:33:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.536+0000 7f2b3b7fe700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b3006c680 0x7f2b3006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:19.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.536+0000 7f2b3b7fe700 1 -- 172.21.15.79:0/249683049 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7f2b4008c840 con 0x7f2b44101880 2024-09-10T09:33:19.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.536+0000 7f2b49a51700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b3006c680 0x7f2b3006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:19.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.537+0000 7f2b49a51700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b3006c680 0x7f2b3006eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b34005950 tx=0x7f2b340058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:19.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.541+0000 7f2b3b7fe700 1 -- 172.21.15.79:0/249683049 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f2b4005ad90 con 0x7f2b44101880 2024-09-10T09:33:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:19 smithi079 ceph-mon[27592]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:19.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.737+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b44105f70 con 0x7f2b3006c680 2024-09-10T09:33:19.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.738+0000 7f2b3b7fe700 1 -- 172.21.15.79:0/249683049 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f2b44105f70 con 0x7f2b3006c680 2024-09-10T09:33:19.739 INFO:teuthology.orchestra.run.smithi079.stdout:HOST ADDR LABELS STATUS 2024-09-10T09:33:19.739 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 172.21.15.79 2024-09-10T09:33:19.739 INFO:teuthology.orchestra.run.smithi079.stdout:smithi135 172.21.15.135 2024-09-10T09:33:19.739 INFO:teuthology.orchestra.run.smithi079.stdout:2 hosts in cluster 2024-09-10T09:33:19.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b3006c680 msgr2=0x7f2b3006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:19.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b3006c680 0x7f2b3006eb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b34005950 tx=0x7f2b340058e0 comp rx=0 tx=0).stop 2024-09-10T09:33:19.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 msgr2=0x7f2b44100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:19.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44100f80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b400092e0 tx=0x7f2b4000be20 comp rx=0 tx=0).stop 2024-09-10T09:33:19.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 shutdown_connections 2024-09-10T09:33:19.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f2b3006c680 0x7f2b3006eb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:19.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2b44101880 0x7f2b44100f80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:19.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 --2- 172.21.15.79:0/249683049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b441021d0 0x7f2b440ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:19.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 >> 172.21.15.79:0/249683049 conn(0x7f2b440f9f10 msgr2=0x7f2b44104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:19.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 shutdown_connections 2024-09-10T09:33:19.742 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:19.740+0000 7f2b4c4b6700 1 -- 172.21.15.79:0/249683049 wait complete. 2024-09-10T09:33:19.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:19 smithi135 ceph-mon[33411]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:20.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T09:33:20.632 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:20.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:20 smithi079 ceph-mon[27592]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:20.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:20 smithi135 ceph-mon[33411]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:21.738 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:21 smithi079 ceph-mon[27592]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:21.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:21 smithi135 ceph-mon[33411]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:22.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 -- 172.21.15.79:0/3917369942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990102250 msgr2=0x7fe9900fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:22.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 --2- 172.21.15.79:0/3917369942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990102250 0x7fe9900fe380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe980009910 tx=0x7fe980009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:22.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 -- 172.21.15.79:0/3917369942 shutdown_connections 2024-09-10T09:33:22.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 --2- 172.21.15.79:0/3917369942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990102250 0x7fe9900fe380 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:22.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 --2- 172.21.15.79:0/3917369942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe990101900 0x7fe990101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:22.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 -- 172.21.15.79:0/3917369942 >> 172.21.15.79:0/3917369942 conn(0x7fe9900f9f10 msgr2=0x7fe9900fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:22.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 -- 172.21.15.79:0/3917369942 shutdown_connections 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.252+0000 7fe99649c700 1 -- 172.21.15.79:0/3917369942 wait complete. 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe99649c700 1 Processor -- start 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe99649c700 1 -- start start 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe99649c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990101900 0x7fe990195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe99649c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe990102250 0x7fe990196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe99649c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9901965d0 con 0x7fe990101900 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe99649c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe990196710 con 0x7fe990102250 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe98ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990101900 0x7fe990195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe98ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990101900 0x7fe990195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44936/0 (socket says 172.21.15.79:44936) 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe98ffff700 1 -- 172.21.15.79:0/1869148481 learned_addr learned my addr 172.21.15.79:0/1869148481 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe98f7fe700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe990102250 0x7fe990196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe98ffff700 1 -- 172.21.15.79:0/1869148481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe990102250 msgr2=0x7fe990196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:22.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe98ffff700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe990102250 0x7fe990196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:22.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.253+0000 7fe98ffff700 1 -- 172.21.15.79:0/1869148481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9800095f0 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.254+0000 7fe98ffff700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990101900 0x7fe990195b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c930 tx=0x7fe97800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.254+0000 7fe98d7fa700 1 -- 172.21.15.79:0/1869148481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe978007ad0 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.254+0000 7fe98d7fa700 1 -- 172.21.15.79:0/1869148481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe978007c30 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.254+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99019b1d0 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.254+0000 7fe98d7fa700 1 -- 172.21.15.79:0/1869148481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe978018630 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.254+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99019b6f0 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.255+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe990108d30 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.255+0000 7fe98d7fa700 1 -- 172.21.15.79:0/1869148481 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fe97800f450 con 0x7fe990101900 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.256+0000 7fe98d7fa700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe97c06c680 0x7fe97c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:22.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.256+0000 7fe98f7fe700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe97c06c680 0x7fe97c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:22.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.256+0000 7fe98d7fa700 1 -- 172.21.15.79:0/1869148481 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7fe97808b690 con 0x7fe990101900 2024-09-10T09:33:22.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.256+0000 7fe98f7fe700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe97c06c680 0x7fe97c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe980006010 tx=0x7fe980005960 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:22.261 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.260+0000 7fe98d7fa700 1 -- 172.21.15.79:0/1869148481 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fe978059be0 con 0x7fe990101900 2024-09-10T09:33:22.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.454+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe990105ff0 con 0x7fe97c06c680 2024-09-10T09:33:22.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.456+0000 7fe98d7fa700 1 -- 172.21.15.79:0/1869148481 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe990105ff0 con 0x7fe97c06c680 2024-09-10T09:33:22.457 INFO:teuthology.orchestra.run.smithi079.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T09:33:22.457 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013G400BGN 372G No 2m ago LVM detected, locked 2024-09-10T09:33:22.457 INFO:teuthology.orchestra.run.smithi079.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 71s ago LVM detected, locked 2024-09-10T09:33:22.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe97c06c680 msgr2=0x7fe97c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:22.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe97c06c680 0x7fe97c06eb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe980006010 tx=0x7fe980005960 comp rx=0 tx=0).stop 2024-09-10T09:33:22.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990101900 msgr2=0x7fe990195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:22.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990101900 0x7fe990195b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe97800c930 tx=0x7fe97800ccf0 comp rx=0 tx=0).stop 2024-09-10T09:33:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 shutdown_connections 2024-09-10T09:33:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fe97c06c680 0x7fe97c06eb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe990101900 0x7fe990195b00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 --2- 172.21.15.79:0/1869148481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe990102250 0x7fe990196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 >> 172.21.15.79:0/1869148481 conn(0x7fe9900f9f10 msgr2=0x7fe9901048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 shutdown_connections 2024-09-10T09:33:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:22.458+0000 7fe99649c700 1 -- 172.21.15.79:0/1869148481 wait complete. 2024-09-10T09:33:23.082 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:33:23.091 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:33:23.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-10T09:33:23.289 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:23.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:23 smithi079 ceph-mon[27592]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:23.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:23 smithi079 ceph-mon[27592]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:23.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:23 smithi135 ceph-mon[33411]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:23.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:23 smithi135 ceph-mon[33411]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:24.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 -- 172.21.15.79:0/3521560403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 msgr2=0x7efd380ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:24.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 --2- 172.21.15.79:0/3521560403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380ff540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efd28009910 tx=0x7efd28009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 -- 172.21.15.79:0/3521560403 shutdown_connections 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 --2- 172.21.15.79:0/3521560403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd381003d0 0x7efd38100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 --2- 172.21.15.79:0/3521560403 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380ff540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 -- 172.21.15.79:0/3521560403 >> 172.21.15.79:0/3521560403 conn(0x7efd380fa780 msgr2=0x7efd380fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 -- 172.21.15.79:0/3521560403 shutdown_connections 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 -- 172.21.15.79:0/3521560403 wait complete. 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.852+0000 7efd3d862700 1 Processor -- start 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd3d862700 1 -- start start 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd3d862700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd3d862700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd381003d0 0x7efd3819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd3d862700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3819adc0 con 0x7efd380ff130 2024-09-10T09:33:24.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd3d862700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3819af30 con 0x7efd381003d0 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44958/0 (socket says 172.21.15.79:44958) 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd36ffd700 1 -- 172.21.15.79:0/3444577145 learned_addr learned my addr 172.21.15.79:0/3444577145 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd2e7fc700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd381003d0 0x7efd3819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd36ffd700 1 -- 172.21.15.79:0/3444577145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd381003d0 msgr2=0x7efd3819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd36ffd700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd381003d0 0x7efd3819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd36ffd700 1 -- 172.21.15.79:0/3444577145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280095f0 con 0x7efd380ff130 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.853+0000 7efd36ffd700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380690c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efd28006010 tx=0x7efd2800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.854+0000 7efd3c860700 1 -- 172.21.15.79:0/3444577145 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd2801d070 con 0x7efd380ff130 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.854+0000 7efd3c860700 1 -- 172.21.15.79:0/3444577145 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efd2800f460 con 0x7efd380ff130 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.854+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3819b1b0 con 0x7efd380ff130 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.854+0000 7efd3c860700 1 -- 172.21.15.79:0/3444577145 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd28021640 con 0x7efd380ff130 2024-09-10T09:33:24.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.854+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3819b6a0 con 0x7efd380ff130 2024-09-10T09:33:24.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.855+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd38107c10 con 0x7efd380ff130 2024-09-10T09:33:24.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.855+0000 7efd3c860700 1 -- 172.21.15.79:0/3444577145 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7efd2800fab0 con 0x7efd380ff130 2024-09-10T09:33:24.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.856+0000 7efd3c860700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd2406c680 0x7efd2406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.856+0000 7efd3c860700 1 -- 172.21.15.79:0/3444577145 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4466+0+0 (secure 0 0 0) 0x7efd2808c780 con 0x7efd380ff130 2024-09-10T09:33:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.856+0000 7efd2e7fc700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd2406c680 0x7efd2406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:24.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.856+0000 7efd2e7fc700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd2406c680 0x7efd2406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd38069620 tx=0x7efd2000a300 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:24.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:24.860+0000 7efd3c860700 1 -- 172.21.15.79:0/3444577145 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7efd2805ad50 con 0x7efd380ff130 2024-09-10T09:33:25.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:25.079+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efd3819bda0 con 0x7efd2406c680 2024-09-10T09:33:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:25 smithi079 ceph-mon[27592]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:25 smithi079 ceph-mon[27592]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-10T09:33:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:25 smithi135 ceph-mon[33411]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:25 smithi135 ceph-mon[33411]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:33:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-10T09:33:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:26.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.742+0000 7efd3c860700 1 -- 172.21.15.79:0/3444577145 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7efd3819bda0 con 0x7efd2406c680 2024-09-10T09:33:26.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd2406c680 msgr2=0x7efd2406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:26.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd2406c680 0x7efd2406eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efd38069620 tx=0x7efd2000a300 comp rx=0 tx=0).stop 2024-09-10T09:33:26.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 msgr2=0x7efd380690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380690c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efd28006010 tx=0x7efd2800bd70 comp rx=0 tx=0).stop 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 shutdown_connections 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7efd2406c680 0x7efd2406eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd380ff130 0x7efd380690c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 --2- 172.21.15.79:0/3444577145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd381003d0 0x7efd3819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.746+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 >> 172.21.15.79:0/3444577145 conn(0x7efd380fa780 msgr2=0x7efd38103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.747+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 shutdown_connections 2024-09-10T09:33:26.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:26.747+0000 7efd3d862700 1 -- 172.21.15.79:0/3444577145 wait complete. 2024-09-10T09:33:26.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:26 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-10T09:33:26.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:26 smithi135 ceph-mon[33411]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T09:33:26.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:26 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-10T09:33:27.191 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:26 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-10T09:33:27.191 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:26 smithi079 ceph-mon[27592]: osdmap e42: 6 total, 6 up, 6 in 2024-09-10T09:33:27.191 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:26 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-10T09:33:27.192 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:26 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[27588]: 2024-09-10T09:33:26.720+0000 7fe2bf0d3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:33:27.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T09:33:27.719 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: pgmap v173: 33 pgs: 10 creating+peering, 1 active+clean, 22 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: osdmap e43: 6 total, 6 up, 6 in 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: osdmap e44: 6 total, 6 up, 6 in 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-10T09:33:27.831 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: fsmap cephfs:0 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: Saving service mds.cephfs spec with placement count:4 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:27.832 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:27 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:27.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: pgmap v173: 33 pgs: 10 creating+peering, 1 active+clean, 22 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:27.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: osdmap e43: 6 total, 6 up, 6 in 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: osdmap e44: 6 total, 6 up, 6 in 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: fsmap cephfs:0 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: Saving service mds.cephfs spec with placement count:4 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:27.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:27.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:27.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:27.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:27 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:29.058 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:28 smithi079 ceph-mon[27592]: Deploying daemon mds.cephfs.smithi079.pqgxjw on smithi079 2024-09-10T09:33:29.058 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:28 smithi079 ceph-mon[27592]: osdmap e45: 6 total, 6 up, 6 in 2024-09-10T09:33:29.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:28 smithi135 ceph-mon[33411]: Deploying daemon mds.cephfs.smithi079.pqgxjw on smithi079 2024-09-10T09:33:29.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:28 smithi135 ceph-mon[33411]: osdmap e45: 6 total, 6 up, 6 in 2024-09-10T09:33:29.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:29 smithi079 ceph-mon[27592]: pgmap v177: 65 pgs: 10 creating+peering, 1 active+clean, 54 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:29.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:29 smithi079 ceph-mon[27592]: osdmap e46: 6 total, 6 up, 6 in 2024-09-10T09:33:30.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:29 smithi135 ceph-mon[33411]: pgmap v177: 65 pgs: 10 creating+peering, 1 active+clean, 54 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:30.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:29 smithi135 ceph-mon[33411]: osdmap e46: 6 total, 6 up, 6 in 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 -- 172.21.15.79:0/3942848582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9401003f0 msgr2=0x7fb940100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 --2- 172.21.15.79:0/3942848582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9401003f0 0x7fb940100860 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb934009910 tx=0x7fb934009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 -- 172.21.15.79:0/3942848582 shutdown_connections 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 --2- 172.21.15.79:0/3942848582 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9401003f0 0x7fb940100860 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 --2- 172.21.15.79:0/3942848582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9400ff150 0x7fb9400ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 -- 172.21.15.79:0/3942848582 >> 172.21.15.79:0/3942848582 conn(0x7fb9400fa7a0 msgr2=0x7fb9400fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 -- 172.21.15.79:0/3942848582 shutdown_connections 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.523+0000 7fb9448db700 1 -- 172.21.15.79:0/3942848582 wait complete. 2024-09-10T09:33:30.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb9448db700 1 Processor -- start 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb9448db700 1 -- start start 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb9448db700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9400ff150 0x7fb940069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb9448db700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9401003f0 0x7fb94019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb9448db700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb940196980 con 0x7fb9400ff150 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb9448db700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94019d450 con 0x7fb9401003f0 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb93e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9400ff150 0x7fb940069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb93e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9400ff150 0x7fb940069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44964/0 (socket says 172.21.15.79:44964) 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb93e59c700 1 -- 172.21.15.79:0/3987192829 learned_addr learned my addr 172.21.15.79:0/3987192829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.524+0000 7fb93dd9b700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9401003f0 0x7fb94019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb93e59c700 1 -- 172.21.15.79:0/3987192829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9401003f0 msgr2=0x7fb94019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb93e59c700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9401003f0 0x7fb94019cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb93e59c700 1 -- 172.21.15.79:0/3987192829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340095f0 con 0x7fb9400ff150 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb93e59c700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9400ff150 0x7fb940069930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb93000e950 tx=0x7fb93000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:30.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb92f7fe700 1 -- 172.21.15.79:0/3987192829 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93000cba0 con 0x7fb9400ff150 2024-09-10T09:33:30.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb92f7fe700 1 -- 172.21.15.79:0/3987192829 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb93000eea0 con 0x7fb9400ff150 2024-09-10T09:33:30.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94019d700 con 0x7fb9400ff150 2024-09-10T09:33:30.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb92f7fe700 1 -- 172.21.15.79:0/3987192829 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb930018650 con 0x7fb9400ff150 2024-09-10T09:33:30.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.525+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94019dc20 con 0x7fb9400ff150 2024-09-10T09:33:30.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.526+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb940068ab0 con 0x7fb9400ff150 2024-09-10T09:33:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.527+0000 7fb92f7fe700 1 -- 172.21.15.79:0/3987192829 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb93000cd00 con 0x7fb9400ff150 2024-09-10T09:33:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.527+0000 7fb92f7fe700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb92806c680 0x7fb92806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.527+0000 7fb93dd9b700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb92806c680 0x7fb92806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.527+0000 7fb92f7fe700 1 -- 172.21.15.79:0/3987192829 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb930014070 con 0x7fb9400ff150 2024-09-10T09:33:30.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.527+0000 7fb93dd9b700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb92806c680 0x7fb92806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb934009fd0 tx=0x7fb934005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:30.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.532+0000 7fb92f7fe700 1 -- 172.21.15.79:0/3987192829 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb930051720 con 0x7fb9400ff150 2024-09-10T09:33:30.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.796+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb94019df30 con 0x7fb9400ff150 2024-09-10T09:33:30.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.797+0000 7fb92f7fe700 1 -- 172.21.15.79:0/3987192829 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7fb930059b90 con 0x7fb9400ff150 2024-09-10T09:33:30.798 INFO:teuthology.orchestra.run.smithi079.stdout:e2 2024-09-10T09:33:30.798 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:33:30.798 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:33:30.798 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:33:30.798 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 2 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:26.721574+0000 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:33:30.799 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 0 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:in 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:up {} 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data disabled 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:33:30.800 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:33:30.801 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 0 2024-09-10T09:33:30.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:30.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:30.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb92806c680 msgr2=0x7fb92806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb92806c680 0x7fb92806eb30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb934009fd0 tx=0x7fb934005940 comp rx=0 tx=0).stop 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9400ff150 msgr2=0x7fb940069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9400ff150 0x7fb940069930 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb93000e950 tx=0x7fb93000ec60 comp rx=0 tx=0).stop 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 shutdown_connections 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb92806c680 0x7fb92806eb30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9400ff150 0x7fb940069930 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 --2- 172.21.15.79:0/3987192829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb9401003f0 0x7fb94019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 >> 172.21.15.79:0/3987192829 conn(0x7fb9400fa7a0 msgr2=0x7fb940103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 shutdown_connections 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:30.799+0000 7fb9448db700 1 -- 172.21.15.79:0/3987192829 wait complete. 2024-09-10T09:33:30.802 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 2 2024-09-10T09:33:31.644 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:33:31.654 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:33:31.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-10T09:33:31.939 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:31.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:31 smithi079 ceph-mon[27592]: pgmap v179: 65 pgs: 43 active+clean, 10 creating+peering, 12 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:31.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:31 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3987192829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:33:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:31 smithi135 ceph-mon[33411]: pgmap v179: 65 pgs: 43 active+clean, 10 creating+peering, 12 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:31 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/3987192829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:33:33.072 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:33.072 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: Deploying daemon mds.cephfs.smithi135.lvmrsq on smithi135 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.79:6826/2813902761,v1:172.21.15.79:6827/2813902761] up:boot 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: daemon mds.cephfs.smithi079.pqgxjw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: Cluster is now healthy 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: fsmap cephfs:0 1 up:standby 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:33:33.073 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:creating} 2024-09-10T09:33:33.074 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:32 smithi079 ceph-mon[27592]: daemon mds.cephfs.smithi079.pqgxjw is now active in filesystem cephfs as rank 0 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: Deploying daemon mds.cephfs.smithi135.lvmrsq on smithi135 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.79:6826/2813902761,v1:172.21.15.79:6827/2813902761] up:boot 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: daemon mds.cephfs.smithi079.pqgxjw assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: Cluster is now healthy 2024-09-10T09:33:33.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: fsmap cephfs:0 1 up:standby 2024-09-10T09:33:33.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:33:33.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:creating} 2024-09-10T09:33:33.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:32 smithi135 ceph-mon[33411]: daemon mds.cephfs.smithi079.pqgxjw is now active in filesystem cephfs as rank 0 2024-09-10T09:33:33.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 -- 172.21.15.79:0/96836860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190100240 msgr2=0x7f0190100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 --2- 172.21.15.79:0/96836860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190100240 0x7f0190100650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0180009910 tx=0x7f0180009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 -- 172.21.15.79:0/96836860 shutdown_connections 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 --2- 172.21.15.79:0/96836860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0190101440 0x7f0190101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 --2- 172.21.15.79:0/96836860 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190100240 0x7f0190100650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 -- 172.21.15.79:0/96836860 >> 172.21.15.79:0/96836860 conn(0x7f01900fb7f0 msgr2=0x7f01900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 -- 172.21.15.79:0/96836860 shutdown_connections 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 -- 172.21.15.79:0/96836860 wait complete. 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.581+0000 7f0195c51700 1 Processor -- start 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f0195c51700 1 -- start start 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f0195c51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0190100240 0x7f0190195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f0195c51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190101440 0x7f0190196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:33.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f0195c51700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901965a0 con 0x7f0190101440 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f0195c51700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901966e0 con 0x7f0190100240 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190101440 0x7f0190196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0190100240 0x7f0190195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0190100240 0x7f0190195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:38326/0 (socket says 172.21.15.79:38326) 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190101440 0x7f0190196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47880/0 (socket says 172.21.15.79:47880) 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018f7fe700 1 -- 172.21.15.79:0/445456 learned_addr learned my addr 172.21.15.79:0/445456 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018effd700 1 -- 172.21.15.79:0/445456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0190100240 msgr2=0x7f0190195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018effd700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0190100240 0x7f0190195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018effd700 1 -- 172.21.15.79:0/445456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800095f0 con 0x7f0190101440 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018effd700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190101440 0x7f0190196010 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f018400c8f0 tx=0x7f018400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018cff9700 1 -- 172.21.15.79:0/445456 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0184004410 con 0x7f0190101440 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019019b1a0 con 0x7f0190101440 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.582+0000 7f018cff9700 1 -- 172.21.15.79:0/445456 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0184004570 con 0x7f0190101440 2024-09-10T09:33:33.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.583+0000 7f018cff9700 1 -- 172.21.15.79:0/445456 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01840038b0 con 0x7f0190101440 2024-09-10T09:33:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.583+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019019b6c0 con 0x7f0190101440 2024-09-10T09:33:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.584+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190108d90 con 0x7f0190101440 2024-09-10T09:33:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.584+0000 7f018cff9700 1 -- 172.21.15.79:0/445456 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0184003b20 con 0x7f0190101440 2024-09-10T09:33:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.585+0000 7f018cff9700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f017806c680 0x7f017806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:33.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.585+0000 7f018cff9700 1 -- 172.21.15.79:0/445456 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f018408b160 con 0x7f0190101440 2024-09-10T09:33:33.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.585+0000 7f018f7fe700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f017806c680 0x7f017806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:33.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.585+0000 7f018f7fe700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f017806c680 0x7f017806eb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0180006010 tx=0x7f018000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:33.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.589+0000 7f018cff9700 1 -- 172.21.15.79:0/445456 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0184059380 con 0x7f0190101440 2024-09-10T09:33:33.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:33.832+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f019019bd60 con 0x7f0190101440 2024-09-10T09:33:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:33 smithi079 ceph-mon[27592]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:33 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.79:6826/2813902761,v1:172.21.15.79:6827/2813902761] up:active 2024-09-10T09:33:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:33 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 2024-09-10T09:33:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:33 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/445456' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-10T09:33:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:33 smithi135 ceph-mon[33411]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:33:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:33 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.79:6826/2813902761,v1:172.21.15.79:6827/2813902761] up:active 2024-09-10T09:33:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:33 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 2024-09-10T09:33:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:33 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/445456' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-10T09:33:34.745 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.744+0000 7f018cff9700 1 -- 172.21.15.79:0/445456 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0184058f10 con 0x7f0190101440 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f017806c680 msgr2=0x7f017806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f017806c680 0x7f017806eb30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0180006010 tx=0x7f018000b540 comp rx=0 tx=0).stop 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190101440 msgr2=0x7f0190196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190101440 0x7f0190196010 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f018400c8f0 tx=0x7f018400cc00 comp rx=0 tx=0).stop 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 shutdown_connections 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f017806c680 0x7f017806eb30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0190100240 0x7f0190195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 --2- 172.21.15.79:0/445456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0190101440 0x7f0190196010 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 >> 172.21.15.79:0/445456 conn(0x7f01900fb7f0 msgr2=0x7f0190104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 shutdown_connections 2024-09-10T09:33:34.748 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:34.747+0000 7f0195c51700 1 -- 172.21.15.79:0/445456 wait complete. 2024-09-10T09:33:35.402 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:33:35.411 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:33:35.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-10T09:33:35.704 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:35.704 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:35.704 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:35.704 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:35.704 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:35.704 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:35.704 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: Deploying daemon mds.cephfs.smithi079.wpfdzn on smithi079 2024-09-10T09:33:35.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: pgmap v181: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 775 B/s wr, 2 op/s 2024-09-10T09:33:35.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/445456' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-10T09:33:35.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:boot 2024-09-10T09:33:35.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby 2024-09-10T09:33:35.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:33:35.705 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:35 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby 2024-09-10T09:33:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: Deploying daemon mds.cephfs.smithi079.wpfdzn on smithi079 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: pgmap v181: 65 pgs: 65 active+clean; 578 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 775 B/s wr, 2 op/s 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/445456' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:boot 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:33:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:35 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby 2024-09-10T09:33:36.210 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:37.912 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:37 smithi079 ceph-mon[27592]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-10T09:33:37.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:37 smithi135 ceph-mon[33411]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 4 op/s 2024-09-10T09:33:38.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 -- 172.21.15.79:0/1063316907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44880ff130 msgr2=0x7f44880ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:38.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 --2- 172.21.15.79:0/1063316907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44880ff130 0x7f44880ff540 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4478009910 tx=0x7f4478009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:38.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 -- 172.21.15.79:0/1063316907 shutdown_connections 2024-09-10T09:33:38.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 --2- 172.21.15.79:0/1063316907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44881003d0 0x7f4488100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:38.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 --2- 172.21.15.79:0/1063316907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44880ff130 0x7f44880ff540 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:38.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 -- 172.21.15.79:0/1063316907 >> 172.21.15.79:0/1063316907 conn(0x7f44880fa780 msgr2=0x7f44880fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:38.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 -- 172.21.15.79:0/1063316907 shutdown_connections 2024-09-10T09:33:38.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.948+0000 7f448c8c2700 1 -- 172.21.15.79:0/1063316907 wait complete. 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f448c8c2700 1 Processor -- start 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f448c8c2700 1 -- start start 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f448c8c2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44880ff130 0x7f44881949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f448c8c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44881003d0 0x7f4488194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f448c8c2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4488195510 con 0x7f44881003d0 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f448c8c2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4488195650 con 0x7f44880ff130 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f4485d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44881003d0 0x7f4488194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f4485d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44881003d0 0x7f4488194ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47916/0 (socket says 172.21.15.79:47916) 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f4485d9b700 1 -- 172.21.15.79:0/2810440379 learned_addr learned my addr 172.21.15.79:0/2810440379 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f448659c700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44880ff130 0x7f44881949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:38.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f4485d9b700 1 -- 172.21.15.79:0/2810440379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44880ff130 msgr2=0x7f44881949b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f4485d9b700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44880ff130 0x7f44881949b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.949+0000 7f4485d9b700 1 -- 172.21.15.79:0/2810440379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780095f0 con 0x7f44881003d0 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.950+0000 7f4485d9b700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44881003d0 0x7f4488194ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c8a0 tx=0x7f447c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.950+0000 7f44777fe700 1 -- 172.21.15.79:0/2810440379 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f447c0078e0 con 0x7f44881003d0 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.950+0000 7f44777fe700 1 -- 172.21.15.79:0/2810440379 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f447c00f450 con 0x7f44881003d0 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.950+0000 7f44777fe700 1 -- 172.21.15.79:0/2810440379 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f447c00e5e0 con 0x7f44881003d0 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.950+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448819a100 con 0x7f44881003d0 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.950+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448819a650 con 0x7f44881003d0 2024-09-10T09:33:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.951+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4488107c10 con 0x7f44881003d0 2024-09-10T09:33:38.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.951+0000 7f44777fe700 1 -- 172.21.15.79:0/2810440379 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f447c00f5c0 con 0x7f44881003d0 2024-09-10T09:33:38.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.952+0000 7f44777fe700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f447006c680 0x7f447006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:38.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.952+0000 7f44777fe700 1 -- 172.21.15.79:0/2810440379 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f447c08b650 con 0x7f44881003d0 2024-09-10T09:33:38.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.952+0000 7f448659c700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f447006c680 0x7f447006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:38.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.952+0000 7f448659c700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f447006c680 0x7f447006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4478006010 tx=0x7f447800b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:38.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:38.956+0000 7f44777fe700 1 -- 172.21.15.79:0/2810440379 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f447c0598f0 con 0x7f44881003d0 2024-09-10T09:33:39.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.189+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f4488107e00 con 0x7f44881003d0 2024-09-10T09:33:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.505+0000 7f44777fe700 1 -- 172.21.15.79:0/2810440379 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) v1 ==== 121+0+0 (secure 0 0 0) 0x7f447c059480 con 0x7f44881003d0 2024-09-10T09:33:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f447006c680 msgr2=0x7f447006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f447006c680 0x7f447006eb30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4478006010 tx=0x7f447800b540 comp rx=0 tx=0).stop 2024-09-10T09:33:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44881003d0 msgr2=0x7f4488194ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44881003d0 0x7f4488194ef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c8a0 tx=0x7f447c00cbb0 comp rx=0 tx=0).stop 2024-09-10T09:33:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 shutdown_connections 2024-09-10T09:33:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f447006c680 0x7f447006eb30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44880ff130 0x7f44881949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 --2- 172.21.15.79:0/2810440379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44881003d0 0x7f4488194ef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 >> 172.21.15.79:0/2810440379 conn(0x7f44880fa780 msgr2=0x7f4488103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 shutdown_connections 2024-09-10T09:33:39.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:39.508+0000 7f448c8c2700 1 -- 172.21.15.79:0/2810440379 wait complete. 2024-09-10T09:33:39.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T09:33:39.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: Deploying daemon mds.cephfs.smithi135.oqqtlp on smithi135 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2810440379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] up:boot 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2810440379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 2 up:standby 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:33:39.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:39 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T09:33:39.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-10T09:33:39.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: Deploying daemon mds.cephfs.smithi135.oqqtlp on smithi135 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2810440379' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] up:boot 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2810440379' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 2 up:standby 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:33:39.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:39 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 1 up:standby 2024-09-10T09:33:40.144 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:33:40.154 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:33:40.154 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-10T09:33:40.358 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:41.063 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:41.063 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:41.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:41 smithi079 ceph-mon[27592]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 171 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-10T09:33:41.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:41.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:41.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:41.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:41.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:41.922 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:41 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 -- 172.21.15.79:0/3109096818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 msgr2=0x7fafb00ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 --2- 172.21.15.79:0/3109096818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb00ff540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009910 tx=0x7fafa0009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 -- 172.21.15.79:0/3109096818 shutdown_connections 2024-09-10T09:33:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 --2- 172.21.15.79:0/3109096818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb01003d0 0x7fafb0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 --2- 172.21.15.79:0/3109096818 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb00ff540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:42.031 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 -- 172.21.15.79:0/3109096818 >> 172.21.15.79:0/3109096818 conn(0x7fafb00fa780 msgr2=0x7fafb00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 -- 172.21.15.79:0/3109096818 shutdown_connections 2024-09-10T09:33:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 -- 172.21.15.79:0/3109096818 wait complete. 2024-09-10T09:33:42.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.030+0000 7fafb54cf700 1 Processor -- start 2024-09-10T09:33:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafb54cf700 1 -- start start 2024-09-10T09:33:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafb54cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb0103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafb54cf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb01003d0 0x7fafb01017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafb54cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0101cf0 con 0x7fafb00ff130 2024-09-10T09:33:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafb54cf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0101e30 con 0x7fafb01003d0 2024-09-10T09:33:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafaeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb0103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:42.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafaeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb0103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57636/0 (socket says 172.21.15.79:57636) 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafaeffd700 1 -- 172.21.15.79:0/2887054173 learned_addr learned my addr 172.21.15.79:0/2887054173 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafae7fc700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb01003d0 0x7fafb01017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafaeffd700 1 -- 172.21.15.79:0/2887054173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb01003d0 msgr2=0x7fafb01017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafaeffd700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb01003d0 0x7fafb01017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.031+0000 7fafaeffd700 1 -- 172.21.15.79:0/2887054173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00095f0 con 0x7fafb00ff130 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.032+0000 7fafaeffd700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb0103160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafa0006010 tx=0x7fafa000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.032+0000 7faf97fff700 1 -- 172.21.15.79:0/2887054173 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa001d070 con 0x7fafb00ff130 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.032+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb01020b0 con 0x7fafb00ff130 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.032+0000 7faf97fff700 1 -- 172.21.15.79:0/2887054173 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fafa000f460 con 0x7fafb00ff130 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.032+0000 7faf97fff700 1 -- 172.21.15.79:0/2887054173 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafa0005720 con 0x7fafb00ff130 2024-09-10T09:33:42.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.032+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb01025a0 con 0x7fafb00ff130 2024-09-10T09:33:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.033+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0107c10 con 0x7fafb00ff130 2024-09-10T09:33:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.033+0000 7faf97fff700 1 -- 172.21.15.79:0/2887054173 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fafa0003a60 con 0x7fafb00ff130 2024-09-10T09:33:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.034+0000 7faf97fff700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7faf9806c680 0x7faf9806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.034+0000 7faf97fff700 1 -- 172.21.15.79:0/2887054173 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fafa008cb10 con 0x7fafb00ff130 2024-09-10T09:33:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.034+0000 7fafae7fc700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7faf9806c680 0x7faf9806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:42.035 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.034+0000 7fafae7fc700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7faf9806c680 0x7faf9806eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005950 tx=0x7fafa40058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:42.039 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.038+0000 7faf97fff700 1 -- 172.21.15.79:0/2887054173 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fafa005ad30 con 0x7fafb00ff130 2024-09-10T09:33:42.086 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:41 smithi135 ceph-mon[33411]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 171 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-10T09:33:42.086 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:42.086 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:42.087 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:42.087 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:42.087 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:42.087 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:41 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:42.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.295+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafb0107dd0 con 0x7fafb00ff130 2024-09-10T09:33:42.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.765+0000 7faf97fff700 1 -- 172.21.15.79:0/2887054173 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v11) v1 ==== 168+0+0 (secure 0 0 0) 0x7fafa005a8c0 con 0x7fafb00ff130 2024-09-10T09:33:42.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7faf9806c680 msgr2=0x7faf9806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:42.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7faf9806c680 0x7faf9806eb30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005950 tx=0x7fafa40058e0 comp rx=0 tx=0).stop 2024-09-10T09:33:42.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 msgr2=0x7fafb0103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:42.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb0103160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fafa0006010 tx=0x7fafa000be20 comp rx=0 tx=0).stop 2024-09-10T09:33:42.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 shutdown_connections 2024-09-10T09:33:42.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7faf9806c680 0x7faf9806eb30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb00ff130 0x7fafb0103160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 --2- 172.21.15.79:0/2887054173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafb01003d0 0x7fafb01017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 >> 172.21.15.79:0/2887054173 conn(0x7fafb00fa780 msgr2=0x7fafb0068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 shutdown_connections 2024-09-10T09:33:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:42.768+0000 7fafb54cf700 1 -- 172.21.15.79:0/2887054173 wait complete. 2024-09-10T09:33:42.770 INFO:teuthology.orchestra.run.smithi079.stderr:inline data enabled 2024-09-10T09:33:42.955 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:42 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:boot 2024-09-10T09:33:42.955 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:42 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:33:42.955 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:42 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:33:42.955 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:42 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2887054173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T09:33:43.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:42 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:boot 2024-09-10T09:33:43.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:42 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:33:43.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:42 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:33:43.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:42 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2887054173' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T09:33:43.468 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:33:43.478 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:33:43.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T09:33:44.041 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-10T09:33:44.041 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-10T09:33:44.041 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2887054173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T09:33:44.041 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:standby-replay 2024-09-10T09:33:44.041 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] up:standby 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: Dropping low affinity active daemon mds.cephfs.smithi079.pqgxjw in favor of higher affinity standby. 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: Replacing daemon mds.cephfs.smithi079.pqgxjw as rank 0 with standby daemon mds.cephfs.smithi135.lvmrsq 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: osdmap e47: 6 total, 6 up, 6 in 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: fsmap cephfs:1/1 {0=cephfs.smithi135.lvmrsq=up:replay} 2 up:standby 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:44.042 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:43 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-10T09:33:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2887054173' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:standby-replay 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] up:standby 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: Dropping low affinity active daemon mds.cephfs.smithi079.pqgxjw in favor of higher affinity standby. 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: Replacing daemon mds.cephfs.smithi079.pqgxjw as rank 0 with standby daemon mds.cephfs.smithi135.lvmrsq 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: osdmap e47: 6 total, 6 up, 6 in 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: fsmap cephfs:1/1 {0=cephfs.smithi135.lvmrsq=up:replay} 2 up:standby 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:44.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:43 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:44.356 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:45.119 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:44 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] up:boot 2024-09-10T09:33:45.119 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:44 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:reconnect 2024-09-10T09:33:45.119 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:44 smithi135 ceph-mon[33411]: fsmap cephfs:1/1 {0=cephfs.smithi135.lvmrsq=up:reconnect} 3 up:standby 2024-09-10T09:33:45.119 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:44 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:33:45.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:44 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] up:boot 2024-09-10T09:33:45.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:44 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:reconnect 2024-09-10T09:33:45.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:44 smithi079 ceph-mon[27592]: fsmap cephfs:1/1 {0=cephfs.smithi135.lvmrsq=up:reconnect} 3 up:standby 2024-09-10T09:33:45.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:44 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:33:45.827 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:45 smithi079 ceph-mon[27592]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 818 B/s wr, 4 op/s 2024-09-10T09:33:45.827 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:45 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:rejoin 2024-09-10T09:33:45.827 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:45 smithi079 ceph-mon[27592]: fsmap cephfs:1/1 {0=cephfs.smithi135.lvmrsq=up:rejoin} 3 up:standby 2024-09-10T09:33:45.827 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:45 smithi079 ceph-mon[27592]: daemon mds.cephfs.smithi135.lvmrsq is now active in filesystem cephfs as rank 0 2024-09-10T09:33:45.827 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:45 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:46.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:45 smithi135 ceph-mon[33411]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 818 B/s wr, 4 op/s 2024-09-10T09:33:46.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:45 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:rejoin 2024-09-10T09:33:46.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:45 smithi135 ceph-mon[33411]: fsmap cephfs:1/1 {0=cephfs.smithi135.lvmrsq=up:rejoin} 3 up:standby 2024-09-10T09:33:46.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:45 smithi135 ceph-mon[33411]: daemon mds.cephfs.smithi135.lvmrsq is now active in filesystem cephfs as rank 0 2024-09-10T09:33:46.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:45 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:46.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 -- 172.21.15.79:0/1437256822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c1018c0 msgr2=0x7fd77c101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:46.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 --2- 172.21.15.79:0/1437256822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c1018c0 0x7fd77c101cd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009910 tx=0x7fd76c009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:46.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 -- 172.21.15.79:0/1437256822 shutdown_connections 2024-09-10T09:33:46.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 --2- 172.21.15.79:0/1437256822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd77c102210 0x7fd77c0fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:46.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 --2- 172.21.15.79:0/1437256822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c1018c0 0x7fd77c101cd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:46.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 -- 172.21.15.79:0/1437256822 >> 172.21.15.79:0/1437256822 conn(0x7fd77c0f9f10 msgr2=0x7fd77c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:46.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 -- 172.21.15.79:0/1437256822 shutdown_connections 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.706+0000 7fd78426b700 1 -- 172.21.15.79:0/1437256822 wait complete. 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd78426b700 1 Processor -- start 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd78426b700 1 -- start start 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd78426b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd77c1018c0 0x7fd77c100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd78426b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c102210 0x7fd77c0ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd78426b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0ffb50 con 0x7fd77c102210 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd78426b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0ffc90 con 0x7fd77c1018c0 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd781806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c102210 0x7fd77c0ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd781806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c102210 0x7fd77c0ff610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57670/0 (socket says 172.21.15.79:57670) 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.707+0000 7fd781806700 1 -- 172.21.15.79:0/1043344216 learned_addr learned my addr 172.21.15.79:0/1043344216 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd782007700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd77c1018c0 0x7fd77c100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:46.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd781806700 1 -- 172.21.15.79:0/1043344216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd77c1018c0 msgr2=0x7fd77c100fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd781806700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd77c1018c0 0x7fd77c100fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd781806700 1 -- 172.21.15.79:0/1043344216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0095f0 con 0x7fd77c102210 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd781806700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c102210 0x7fd77c0ff610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd77800b480 tx=0x7fd77800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd7737fe700 1 -- 172.21.15.79:0/1043344216 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7780118c0 con 0x7fd77c102210 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd7737fe700 1 -- 172.21.15.79:0/1043344216 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd778010380 con 0x7fd77c102210 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c0fff70 con 0x7fd77c102210 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd7737fe700 1 -- 172.21.15.79:0/1043344216 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd77800f4f0 con 0x7fd77c102210 2024-09-10T09:33:46.712 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.708+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c19dbf0 con 0x7fd77c102210 2024-09-10T09:33:46.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.709+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c108dd0 con 0x7fd77c102210 2024-09-10T09:33:46.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.710+0000 7fd7737fe700 1 -- 172.21.15.79:0/1043344216 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fd7780104f0 con 0x7fd77c102210 2024-09-10T09:33:46.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.710+0000 7fd7737fe700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd76806c680 0x7fd76806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:46.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.710+0000 7fd782007700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd76806c680 0x7fd76806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:46.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.710+0000 7fd7737fe700 1 -- 172.21.15.79:0/1043344216 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd77808b470 con 0x7fd77c102210 2024-09-10T09:33:46.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.710+0000 7fd782007700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd76806c680 0x7fd76806eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0059d0 tx=0x7fd76c005920 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:46.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.714+0000 7fd7737fe700 1 -- 172.21.15.79:0/1043344216 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fd778059630 con 0x7fd77c102210 2024-09-10T09:33:46.940 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:46 smithi079 ceph-mon[27592]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T09:33:46.940 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:46 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:active 2024-09-10T09:33:46.940 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:46 smithi079 ceph-mon[27592]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:standby 2024-09-10T09:33:46.940 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:46 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:33:46.941 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:46 smithi079 ceph-mon[27592]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:33:46.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.957+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd77c108fc0 con 0x7fd77c102210 2024-09-10T09:33:46.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.957+0000 7fd7737fe700 1 -- 172.21.15.79:0/1043344216 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7fd7780591c0 con 0x7fd77c102210 2024-09-10T09:33:46.959 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:33:46.959 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:33:46.959 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:33:46.959 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:33:46.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:33:46.960 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:33:46.961 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:33:46.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd76806c680 msgr2=0x7fd76806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd76806c680 0x7fd76806eb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0059d0 tx=0x7fd76c005920 comp rx=0 tx=0).stop 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c102210 msgr2=0x7fd77c0ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c102210 0x7fd77c0ff610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd77800b480 tx=0x7fd77800b840 comp rx=0 tx=0).stop 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 shutdown_connections 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fd76806c680 0x7fd76806eb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd77c1018c0 0x7fd77c100fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 --2- 172.21.15.79:0/1043344216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd77c102210 0x7fd77c0ff610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 >> 172.21.15.79:0/1043344216 conn(0x7fd77c0f9f10 msgr2=0x7fd77c104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.959+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 shutdown_connections 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:46.960+0000 7fd78426b700 1 -- 172.21.15.79:0/1043344216 wait complete. 2024-09-10T09:33:46.963 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:33:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:46 smithi135 ceph-mon[33411]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T09:33:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:46 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] up:active 2024-09-10T09:33:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:46 smithi135 ceph-mon[33411]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:standby 2024-09-10T09:33:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:46 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:33:47.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:46 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:33:47.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-10T09:33:47.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:47 smithi079 ceph-mon[27592]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T09:33:47.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:47 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1043344216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:33:48.072 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:48.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:47 smithi135 ceph-mon[33411]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T09:33:48.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:47 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1043344216' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:33:49.790 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:49 smithi079 ceph-mon[27592]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T09:33:49.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:49 smithi135 ceph-mon[33411]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T09:33:50.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 -- 172.21.15.79:0/996201608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda400ff710 msgr2=0x7fda400ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:50.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 --2- 172.21.15.79:0/996201608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda400ff710 0x7fda400ffb20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fda34009910 tx=0x7fda34009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:50.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 -- 172.21.15.79:0/996201608 shutdown_connections 2024-09-10T09:33:50.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 --2- 172.21.15.79:0/996201608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda40100060 0x7fda401004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:50.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 --2- 172.21.15.79:0/996201608 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda400ff710 0x7fda400ffb20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:50.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 -- 172.21.15.79:0/996201608 >> 172.21.15.79:0/996201608 conn(0x7fda400f9f10 msgr2=0x7fda400fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:50.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 -- 172.21.15.79:0/996201608 shutdown_connections 2024-09-10T09:33:50.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.328+0000 7fda46b2e700 1 -- 172.21.15.79:0/996201608 wait complete. 2024-09-10T09:33:50.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.329+0000 7fda46b2e700 1 Processor -- start 2024-09-10T09:33:50.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.329+0000 7fda46b2e700 1 -- start start 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.329+0000 7fda46b2e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda400ff710 0x7fda400fef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.329+0000 7fda46b2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda40100060 0x7fda4019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.329+0000 7fda46b2e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4019adb0 con 0x7fda40100060 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.329+0000 7fda46b2e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4019aef0 con 0x7fda400ff710 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda40100060 0x7fda4019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda40100060 0x7fda4019a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57688/0 (socket says 172.21.15.79:57688) 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3ffff700 1 -- 172.21.15.79:0/3687732425 learned_addr learned my addr 172.21.15.79:0/3687732425 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda448ca700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda400ff710 0x7fda400fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3ffff700 1 -- 172.21.15.79:0/3687732425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda400ff710 msgr2=0x7fda400fef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3ffff700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda400ff710 0x7fda400fef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3ffff700 1 -- 172.21.15.79:0/3687732425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340095f0 con 0x7fda40100060 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda448ca700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda400ff710 0x7fda400fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:33:50.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3ffff700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda40100060 0x7fda4019a7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00d8d0 tx=0x7fda2c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:50.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3dffb700 1 -- 172.21.15.79:0/3687732425 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c0098a0 con 0x7fda40100060 2024-09-10T09:33:50.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4019b1d0 con 0x7fda40100060 2024-09-10T09:33:50.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3dffb700 1 -- 172.21.15.79:0/3687732425 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda2c010460 con 0x7fda40100060 2024-09-10T09:33:50.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.330+0000 7fda3dffb700 1 -- 172.21.15.79:0/3687732425 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda2c00f5f0 con 0x7fda40100060 2024-09-10T09:33:50.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.331+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4019b720 con 0x7fda40100060 2024-09-10T09:33:50.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.332+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda40107c10 con 0x7fda40100060 2024-09-10T09:33:50.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.332+0000 7fda3dffb700 1 -- 172.21.15.79:0/3687732425 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fda2c009a00 con 0x7fda40100060 2024-09-10T09:33:50.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.332+0000 7fda3dffb700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda3006c680 0x7fda3006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:50.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.333+0000 7fda3dffb700 1 -- 172.21.15.79:0/3687732425 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fda2c08b710 con 0x7fda40100060 2024-09-10T09:33:50.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.333+0000 7fda448ca700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda3006c680 0x7fda3006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:50.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.333+0000 7fda448ca700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda3006c680 0x7fda3006eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda34006010 tx=0x7fda3400b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:50.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.337+0000 7fda3dffb700 1 -- 172.21.15.79:0/3687732425 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fda2c0598d0 con 0x7fda40100060 2024-09-10T09:33:50.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.582+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda40107e30 con 0x7fda40100060 2024-09-10T09:33:50.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.582+0000 7fda3dffb700 1 -- 172.21.15.79:0/3687732425 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4750 (secure 0 0 0) 0x7fda2c059460 con 0x7fda40100060 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda3006c680 msgr2=0x7fda3006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda3006c680 0x7fda3006eb30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda34006010 tx=0x7fda3400b540 comp rx=0 tx=0).stop 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda40100060 msgr2=0x7fda4019a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda40100060 0x7fda4019a7e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00d8d0 tx=0x7fda2c00dbe0 comp rx=0 tx=0).stop 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 shutdown_connections 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fda3006c680 0x7fda3006eb30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda400ff710 0x7fda400fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 --2- 172.21.15.79:0/3687732425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda40100060 0x7fda4019a7e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 >> 172.21.15.79:0/3687732425 conn(0x7fda400f9f10 msgr2=0x7fda401036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 shutdown_connections 2024-09-10T09:33:50.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:50.585+0000 7fda46b2e700 1 -- 172.21.15.79:0/3687732425 wait complete. 2024-09-10T09:33:50.588 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:33:50.598 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:33:51.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:51.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:51.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:51.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:51.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:51.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:51.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3687732425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T09:33:51.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:51 smithi079 ceph-mon[27592]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 10 op/s 2024-09-10T09:33:51.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:51.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:51.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:51.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:51.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:51.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:33:51.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/3687732425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T09:33:51.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:51 smithi135 ceph-mon[33411]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 10 op/s 2024-09-10T09:33:51.251 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-10T09:33:52.110 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:53.865 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:53.865 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:53 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:53.865 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:53 smithi079 ceph-mon[27592]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 10 op/s 2024-09-10T09:33:53.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:53 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:53.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:53 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:53.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:53 smithi135 ceph-mon[33411]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 10 op/s 2024-09-10T09:33:54.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 -- 172.21.15.79:0/3587200023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 msgr2=0x7f17b81018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:54.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 --2- 172.21.15.79:0/3587200023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b81018a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009910 tx=0x7f17a8009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:54.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 -- 172.21.15.79:0/3587200023 shutdown_connections 2024-09-10T09:33:54.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 --2- 172.21.15.79:0/3587200023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b81018a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:54.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 --2- 172.21.15.79:0/3587200023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100250 0x7f17b8100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:54.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 -- 172.21.15.79:0/3587200023 >> 172.21.15.79:0/3587200023 conn(0x7f17b80fb7e0 msgr2=0x7f17b80fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:54.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 -- 172.21.15.79:0/3587200023 shutdown_connections 2024-09-10T09:33:54.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.393+0000 7f17bf821700 1 -- 172.21.15.79:0/3587200023 wait complete. 2024-09-10T09:33:54.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bf821700 1 Processor -- start 2024-09-10T09:33:54.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bf821700 1 -- start start 2024-09-10T09:33:54.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bf821700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100250 0x7f17b8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bf821700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b8196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bf821700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8196790 con 0x7f17b8101450 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bf821700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b819b1a0 con 0x7f17b8100250 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bcdbc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b8196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bcdbc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b8196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52014/0 (socket says 172.21.15.79:52014) 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bcdbc700 1 -- 172.21.15.79:0/1863389490 learned_addr learned my addr 172.21.15.79:0/1863389490 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.394+0000 7f17bd5bd700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100250 0x7f17b8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17bcdbc700 1 -- 172.21.15.79:0/1863389490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100250 msgr2=0x7f17b8195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17bcdbc700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100250 0x7f17b8195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17bcdbc700 1 -- 172.21.15.79:0/1863389490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a80095f0 con 0x7f17b8101450 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17bd5bd700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100250 0x7f17b8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:33:54.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17bcdbc700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b8196170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17a80092e0 tx=0x7f17a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:54.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17ae7fc700 1 -- 172.21.15.79:0/1863389490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a801d070 con 0x7f17b8101450 2024-09-10T09:33:54.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17ae7fc700 1 -- 172.21.15.79:0/1863389490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17a800f460 con 0x7f17b8101450 2024-09-10T09:33:54.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b819b340 con 0x7f17b8101450 2024-09-10T09:33:54.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17ae7fc700 1 -- 172.21.15.79:0/1863389490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a8021640 con 0x7f17b8101450 2024-09-10T09:33:54.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.395+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b819b800 con 0x7f17b8101450 2024-09-10T09:33:54.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.396+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b8108e40 con 0x7f17b8101450 2024-09-10T09:33:54.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.397+0000 7f17ae7fc700 1 -- 172.21.15.79:0/1863389490 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f17a800fa90 con 0x7f17b8101450 2024-09-10T09:33:54.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.397+0000 7f17ae7fc700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f17a406c680 0x7f17a406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:54.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.397+0000 7f17ae7fc700 1 -- 172.21.15.79:0/1863389490 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f17a808cbf0 con 0x7f17b8101450 2024-09-10T09:33:54.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.397+0000 7f17bd5bd700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f17a406c680 0x7f17a406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:54.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.398+0000 7f17bd5bd700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f17a406c680 0x7f17a406eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f17b8197110 tx=0x7f17b4008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:54.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.402+0000 7f17ae7fc700 1 -- 172.21.15.79:0/1863389490 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f17a8057320 con 0x7f17b8101450 2024-09-10T09:33:54.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.690+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f17b8109000 con 0x7f17b8101450 2024-09-10T09:33:54.691 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.691+0000 7f17ae7fc700 1 -- 172.21.15.79:0/1863389490 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+83 (secure 0 0 0) 0x7f17a8026070 con 0x7f17b8101450 2024-09-10T09:33:54.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f17a406c680 msgr2=0x7f17a406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:54.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f17a406c680 0x7f17a406eb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f17b8197110 tx=0x7f17b4008040 comp rx=0 tx=0).stop 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 msgr2=0x7f17b8196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b8196170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17a80092e0 tx=0x7f17a800be20 comp rx=0 tx=0).stop 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 shutdown_connections 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f17a406c680 0x7f17a406eb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f17b8100250 0x7f17b8195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 --2- 172.21.15.79:0/1863389490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17b8101450 0x7f17b8196170 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 >> 172.21.15.79:0/1863389490 conn(0x7f17b80fb7e0 msgr2=0x7f17b8104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 shutdown_connections 2024-09-10T09:33:54.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:54.693+0000 7f17bf821700 1 -- 172.21.15.79:0/1863389490 wait complete. 2024-09-10T09:33:54.704 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:33:54.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:54 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1863389490' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-10T09:33:55.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:54 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1863389490' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-10T09:33:55.342 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-10T09:33:55.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T09:33:55.749 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:56.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:55 smithi079 ceph-mon[27592]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T09:33:56.096 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:56.097 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:56.172 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:55 smithi135 ceph-mon[33411]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T09:33:56.172 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:56.172 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:33:58.101 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:57 smithi079 ceph-mon[27592]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T09:33:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:57 smithi135 ceph-mon[33411]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-10T09:33:58.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 -- 172.21.15.79:0/1005703462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 msgr2=0x7fb484104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1005703462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484104e50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb480009910 tx=0x7fb480009c20 comp rx=0 tx=0).stop 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 -- 172.21.15.79:0/1005703462 shutdown_connections 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1005703462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484104e50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1005703462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4841004e0 0x7fb4841008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 -- 172.21.15.79:0/1005703462 >> 172.21.15.79:0/1005703462 conn(0x7fb4840fbda0 msgr2=0x7fb4840fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 -- 172.21.15.79:0/1005703462 shutdown_connections 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.580+0000 7fb48c05b700 1 -- 172.21.15.79:0/1005703462 wait complete. 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb48c05b700 1 Processor -- start 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb48c05b700 1 -- start start 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb48c05b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4841004e0 0x7fb484195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:58.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb48c05b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb48c05b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb484196b30 con 0x7fb484100e80 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb48c05b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48419a8c0 con 0x7fb4841004e0 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb4895f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb4895f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52040/0 (socket says 172.21.15.79:52040) 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb4895f6700 1 -- 172.21.15.79:0/1940333989 learned_addr learned my addr 172.21.15.79:0/1940333989 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb4895f6700 1 -- 172.21.15.79:0/1940333989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4841004e0 msgr2=0x7fb484195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb4895f6700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4841004e0 0x7fb484195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.581+0000 7fb4895f6700 1 -- 172.21.15.79:0/1940333989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800095f0 con 0x7fb484100e80 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.582+0000 7fb4895f6700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484196450 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb4800092e0 tx=0x7fb48000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.582+0000 7fb47affd700 1 -- 172.21.15.79:0/1940333989 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48001d070 con 0x7fb484100e80 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.582+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48419ab40 con 0x7fb484100e80 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.582+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48419b030 con 0x7fb484100e80 2024-09-10T09:33:58.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.582+0000 7fb47affd700 1 -- 172.21.15.79:0/1940333989 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb480022470 con 0x7fb484100e80 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.582+0000 7fb47affd700 1 -- 172.21.15.79:0/1940333989 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48000f690 con 0x7fb484100e80 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.583+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb468005320 con 0x7fb484100e80 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.583+0000 7fb47affd700 1 -- 172.21.15.79:0/1940333989 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb480004b70 con 0x7fb484100e80 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.584+0000 7fb47affd700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb47006c680 0x7fb47006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.584+0000 7fb47affd700 1 -- 172.21.15.79:0/1940333989 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb48008cc20 con 0x7fb484100e80 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.584+0000 7fb489df7700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb47006c680 0x7fb47006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.584+0000 7fb489df7700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb47006c680 0x7fb47006eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb47400a990 tx=0x7fb474005c80 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:33:58.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.588+0000 7fb47affd700 1 -- 172.21.15.79:0/1940333989 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb480057400 con 0x7fb484100e80 2024-09-10T09:33:58.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.837+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb468005f70 con 0x7fb484100e80 2024-09-10T09:33:58.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.838+0000 7fb47affd700 1 -- 172.21.15.79:0/1940333989 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4750 (secure 0 0 0) 0x7fb480027090 con 0x7fb484100e80 2024-09-10T09:33:58.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:33:58.839 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1635861920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1635861920},{"type":"v1","addr":"172.21.15.79:6827","nonce":1635861920}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:33:45.783866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14474":{"gid":14474,"name":"cephfs.smithi079.wpfdzn","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.79:6829/397850123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":397850123},{"type":"v1","addr":"172.21.15.79:6829","nonce":397850123}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24281":{"gid":24281,"name":"cephfs.smithi135.lvmrsq","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6825/3101337164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3101337164},{"type":"v1","addr":"172.21.15.135:6825","nonce":3101337164}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-10T09:33:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb47006c680 msgr2=0x7fb47006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb47006c680 0x7fb47006eb30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb47400a990 tx=0x7fb474005c80 comp rx=0 tx=0).stop 2024-09-10T09:33:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 msgr2=0x7fb484196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:33:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484196450 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb4800092e0 tx=0x7fb48000be20 comp rx=0 tx=0).stop 2024-09-10T09:33:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 shutdown_connections 2024-09-10T09:33:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb47006c680 0x7fb47006eb30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:58.841 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4841004e0 0x7fb484195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 --2- 172.21.15.79:0/1940333989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb484100e80 0x7fb484196450 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:33:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 >> 172.21.15.79:0/1940333989 conn(0x7fb4840fbda0 msgr2=0x7fb4840fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:33:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 shutdown_connections 2024-09-10T09:33:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:33:58.840+0000 7fb48c05b700 1 -- 172.21.15.79:0/1940333989 wait complete. 2024-09-10T09:33:58.842 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:33:59.529 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-10T09:33:59.530 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T09:33:59.556 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T09:33:59.556 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-10T09:33:59.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:33:59.556 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-09-10T09:33:59.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:33:59.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-09-10T09:33:59.641 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-09-10T09:33:59.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:33:59.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:33:59.643 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-10T09:33:59.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:33:59.663 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-10T09:33:59.736 INFO:teuthology.orchestra.run.smithi135.stderr:Cannot find device "ceph-brx" 2024-09-10T09:33:59.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:33:59.738 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-10T09:33:59.738 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T09:33:59.738 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T09:33:59.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T09:33:59.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:59 smithi079 ceph-mon[27592]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T09:33:59.760 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:59.761 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:59.761 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:59.761 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:59.761 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:59 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:59.761 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:33:59 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1940333989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T09:33:59.935 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:33:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:59 smithi135 ceph-mon[33411]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T09:33:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:59.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:59.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:33:59.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:33:59.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:59 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:33:59.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:33:59 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1940333989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T09:34:01.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 -- 172.21.15.79:0/1733494813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 msgr2=0x7f1090103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:01.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 --2- 172.21.15.79:0/1733494813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f1090103d30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1084009910 tx=0x7f1084009c20 comp rx=0 tx=0).stop 2024-09-10T09:34:01.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 -- 172.21.15.79:0/1733494813 shutdown_connections 2024-09-10T09:34:01.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 --2- 172.21.15.79:0/1733494813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f1090103d30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:01.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 --2- 172.21.15.79:0/1733494813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10900ff3c0 0x7f10900ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:01.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 -- 172.21.15.79:0/1733494813 >> 172.21.15.79:0/1733494813 conn(0x7f10900fac80 msgr2=0x7f10900fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:01.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 -- 172.21.15.79:0/1733494813 shutdown_connections 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.600+0000 7f109859a700 1 -- 172.21.15.79:0/1733494813 wait complete. 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f109859a700 1 Processor -- start 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f109859a700 1 -- start start 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f109859a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10900ff3c0 0x7f1090195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f109859a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f10901963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f109859a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090196ab0 con 0x7f10900ffd60 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f109859a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109019a840 con 0x7f10900ff3c0 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f1095b35700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f10901963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f1095b35700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f10901963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52066/0 (socket says 172.21.15.79:52066) 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f1095b35700 1 -- 172.21.15.79:0/786417202 learned_addr learned my addr 172.21.15.79:0/786417202 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.601+0000 7f1096336700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10900ff3c0 0x7f1090195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:01.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f1095b35700 1 -- 172.21.15.79:0/786417202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10900ff3c0 msgr2=0x7f1090195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f1095b35700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10900ff3c0 0x7f1090195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f1095b35700 1 -- 172.21.15.79:0/786417202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840095f0 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f1095b35700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f10901963d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f10840092e0 tx=0x7f108400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f108f7fe700 1 -- 172.21.15.79:0/786417202 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f108401d070 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f108f7fe700 1 -- 172.21.15.79:0/786417202 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1084004fa0 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109019aac0 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f108f7fe700 1 -- 172.21.15.79:0/786417202 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f108400f690 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.602+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109019afb0 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.603+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109004f2a0 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.603+0000 7f108f7fe700 1 -- 172.21.15.79:0/786417202 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f1084022470 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.604+0000 7f108f7fe700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f107806c680 0x7f107806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.604+0000 7f108f7fe700 1 -- 172.21.15.79:0/786417202 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f108408ce90 con 0x7f10900ffd60 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.604+0000 7f1096336700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f107806c680 0x7f107806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:01.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.604+0000 7f1096336700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f107806c680 0x7f107806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10880060b0 tx=0x7f108800c040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:01.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.608+0000 7f108f7fe700 1 -- 172.21.15.79:0/786417202 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1084057640 con 0x7f10900ffd60 2024-09-10T09:34:01.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.844+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f109019b220 con 0x7f10900ffd60 2024-09-10T09:34:01.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.844+0000 7f108f7fe700 1 -- 172.21.15.79:0/786417202 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f1084027070 con 0x7f10900ffd60 2024-09-10T09:34:01.845 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-10T09:34:01.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.846+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f107806c680 msgr2=0x7f107806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:01.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.846+0000 7f109859a700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f107806c680 0x7f107806eb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10880060b0 tx=0x7f108800c040 comp rx=0 tx=0).stop 2024-09-10T09:34:01.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.846+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 msgr2=0x7f10901963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.846+0000 7f109859a700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f10901963d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f10840092e0 tx=0x7f108400bd70 comp rx=0 tx=0).stop 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.847+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 shutdown_connections 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.847+0000 7f109859a700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f107806c680 0x7f107806eb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.847+0000 7f109859a700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10900ff3c0 0x7f1090195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.847+0000 7f109859a700 1 --2- 172.21.15.79:0/786417202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10900ffd60 0x7f10901963d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.847+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 >> 172.21.15.79:0/786417202 conn(0x7f10900fac80 msgr2=0x7f1090068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.847+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 shutdown_connections 2024-09-10T09:34:01.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:01.847+0000 7f109859a700 1 -- 172.21.15.79:0/786417202 wait complete. 2024-09-10T09:34:01.858 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:01 smithi079 ceph-mon[27592]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T09:34:01.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:01 smithi135 ceph-mon[33411]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:34:02.498 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T09:34:02.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:02.499 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-09-10T09:34:02.554 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:34:02.554 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:34:02.554 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:34:02.554 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42324sec preferred_lft 42324sec 2024-09-10T09:34:02.555 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link noprefixroute 2024-09-10T09:34:02.556 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:34:02.556 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T09:34:02.556 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:02.556 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-10T09:34:02.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-09-10T09:34:02.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-09-10T09:34:02.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-09-10T09:34:02.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T09:34:02.557 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-10T09:34:02.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:02.727 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:02 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/786417202' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T09:34:02.752 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:02.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:02.758 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:34:02.782 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-09-10T09:34:02.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:02.784 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-09-10T09:34:02.861 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-09-10T09:34:02.862 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:34:02.862 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T09:34:02.862 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T09:34:02.862 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:34:02.862 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:02.862 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-10T09:34:02.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T09:34:02.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T09:34:02.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T09:34:02.863 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-10T09:34:02.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:03.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:03.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:03.182 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-09-10T09:34:03.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:03.199 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-09-10T09:34:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:02 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/786417202' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T09:34:03.254 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:03.254 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-10T09:34:03.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T09:34:03.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T09:34:03.254 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-10T09:34:03.342 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:03.365 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:03.371 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T09:34:03.371 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:03.371 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-10T09:34:03.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T09:34:03.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T09:34:03.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T09:34:03.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T09:34:03.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T09:34:03.372 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-10T09:34:03.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:03.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:03.495 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:03.495 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-09-10T09:34:03.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-09-10T09:34:03.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T09:34:03.496 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-09-10T09:34:03.543 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:03.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:03.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:34:03.572 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T09:34:03.587 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T09:34:03.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:34:03.587 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T09:34:03.643 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:34:03.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:03.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:34:03.738 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:34:03.738 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:34:03.739 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-09-10T09:34:03.863 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:34:03.863 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:34:03.863 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-09-10T09:34:03.863 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.135:3300" 2024-09-10T09:34:03.863 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:34:03.869 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-10T09:34:03.869 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-10T09:34:03.869 INFO:teuthology.orchestra.run.smithi079.stdout:invalid new device string format 2024-09-10T09:34:03.869 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.135:3300" 2024-09-10T09:34:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:34:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.135:6789" 2024-09-10T09:34:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.135:6789:/ 2024-09-10T09:34:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=afb60aa6-6f56-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T09:34:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T09:34:03.871 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:34:03.871 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:34:03.871 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:34:03.871 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:34:03.872 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:34:03.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:03.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T09:34:03.898 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:34:03.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:03 smithi079 ceph-mon[27592]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-10T09:34:03.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:34:03.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:04.000 INFO:teuthology.orchestra.run.smithi079.stdout:client14510 2024-09-10T09:34:04.001 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:34:04.001 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:34:04.058 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:34:04.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:34:04.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:04.161 INFO:teuthology.orchestra.run.smithi079.stdout:client14510 2024-09-10T09:34:04.161 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:34:04.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:34:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:03 smithi135 ceph-mon[33411]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-10T09:34:04.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:04.224 INFO:teuthology.orchestra.run.smithi079.stdout:client14510 2024-09-10T09:34:04.225 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968.client14510/status') 2024-09-10T09:34:04.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:04.288 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.14510 (3)192.168.0.1:0/871001870 2024-09-10T09:34:04.288 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2024-09-10T09:34:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2024-09-10T09:34:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2024-09-10T09:34:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:69 bytes copied, 2.179e-05 s, 3.2 MB/s 2024-09-10T09:34:04.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:04.295 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-10T09:34:04.296 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T09:34:04.296 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:04.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T09:34:04.495 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:34:05.917 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:05 smithi079 ceph-mon[27592]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:34:05.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:05 smithi135 ceph-mon[33411]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:34:06.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 -- 172.21.15.79:0/3852152659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 msgr2=0x7f12a80ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:06.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 --2- 172.21.15.79:0/3852152659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a80ff790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1290009910 tx=0x7f1290009c20 comp rx=0 tx=0).stop 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 -- 172.21.15.79:0/3852152659 shutdown_connections 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 --2- 172.21.15.79:0/3852152659 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12a80ffd60 0x7f12a8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 --2- 172.21.15.79:0/3852152659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a80ff790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 -- 172.21.15.79:0/3852152659 >> 172.21.15.79:0/3852152659 conn(0x7f12a80fac60 msgr2=0x7f12a80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 -- 172.21.15.79:0/3852152659 shutdown_connections 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.150+0000 7f12aef33700 1 -- 172.21.15.79:0/3852152659 wait complete. 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12aef33700 1 Processor -- start 2024-09-10T09:34:06.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12aef33700 1 -- start start 2024-09-10T09:34:06.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12aef33700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a81981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12aef33700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12a80ffd60 0x7f12a81986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12aef33700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8198dc0 con 0x7f12a80ff3c0 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12aef33700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a819cb50 con 0x7f12a80ffd60 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12acccf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a81981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12acccf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a81981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43464/0 (socket says 172.21.15.79:43464) 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12acccf700 1 -- 172.21.15.79:0/1581601144 learned_addr learned my addr 172.21.15.79:0/1581601144 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12a7fff700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12a80ffd60 0x7f12a81986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12acccf700 1 -- 172.21.15.79:0/1581601144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12a80ffd60 msgr2=0x7f12a81986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12acccf700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12a80ffd60 0x7f12a81986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.151+0000 7f12acccf700 1 -- 172.21.15.79:0/1581601144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12900095f0 con 0x7f12a80ff3c0 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.152+0000 7f12acccf700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a81981a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1290006010 tx=0x7f129000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.152+0000 7f12a5ffb700 1 -- 172.21.15.79:0/1581601144 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129001d070 con 0x7f12a80ff3c0 2024-09-10T09:34:06.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.152+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a819cdd0 con 0x7f12a80ff3c0 2024-09-10T09:34:06.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.152+0000 7f12a5ffb700 1 -- 172.21.15.79:0/1581601144 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f129000f460 con 0x7f12a80ff3c0 2024-09-10T09:34:06.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.152+0000 7f12a5ffb700 1 -- 172.21.15.79:0/1581601144 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1290021640 con 0x7f12a80ff3c0 2024-09-10T09:34:06.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.152+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a819d2c0 con 0x7f12a80ff3c0 2024-09-10T09:34:06.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.153+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a804f2a0 con 0x7f12a80ff3c0 2024-09-10T09:34:06.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.153+0000 7f12a5ffb700 1 -- 172.21.15.79:0/1581601144 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f129000faf0 con 0x7f12a80ff3c0 2024-09-10T09:34:06.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.154+0000 7f12a5ffb700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f129406c680 0x7f129406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:06.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.154+0000 7f12a5ffb700 1 -- 172.21.15.79:0/1581601144 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f129008cc80 con 0x7f12a80ff3c0 2024-09-10T09:34:06.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.154+0000 7f12a7fff700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f129406c680 0x7f129406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:06.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.154+0000 7f12a7fff700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f129406c680 0x7f129406eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12a81997c0 tx=0x7f12980094f0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:06.159 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.158+0000 7f12a5ffb700 1 -- 172.21.15.79:0/1581601144 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f1290057310 con 0x7f12a80ff3c0 2024-09-10T09:34:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.390+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12a819d5a0 con 0x7f12a80ff3c0 2024-09-10T09:34:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.391+0000 7f12a5ffb700 1 -- 172.21.15.79:0/1581601144 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f1290026070 con 0x7f12a80ff3c0 2024-09-10T09:34:06.392 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f129406c680 msgr2=0x7f129406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f129406c680 0x7f129406eb30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f12a81997c0 tx=0x7f12980094f0 comp rx=0 tx=0).stop 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 msgr2=0x7f12a81981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a81981a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1290006010 tx=0x7f129000be20 comp rx=0 tx=0).stop 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 shutdown_connections 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f129406c680 0x7f129406eb30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12a80ff3c0 0x7f12a81981a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:06.394 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 --2- 172.21.15.79:0/1581601144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12a80ffd60 0x7f12a81986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 >> 172.21.15.79:0/1581601144 conn(0x7f12a80fac60 msgr2=0x7f12a8102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 shutdown_connections 2024-09-10T09:34:06.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:06.393+0000 7f12aef33700 1 -- 172.21.15.79:0/1581601144 wait complete. 2024-09-10T09:34:07.037 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:06 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1581601144' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T09:34:07.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T09:34:07.058 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T09:34:07.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:07.058 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-09-10T09:34:07.078 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-09-10T09:34:07.079 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T09:34:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:07.080 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T09:34:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-09-10T09:34:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T09:34:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42322sec preferred_lft 42322sec 2024-09-10T09:34:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::ec4:7aff:fe88:8083/64 scope link noprefixroute 2024-09-10T09:34:07.080 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-09-10T09:34:07.080 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T09:34:07.081 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:07.081 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-10T09:34:07.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-09-10T09:34:07.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-09-10T09:34:07.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-09-10T09:34:07.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T09:34:07.081 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-10T09:34:07.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:07.182 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:06 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1581601144' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T09:34:07.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:07.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:07.297 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T09:34:07.322 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-10T09:34:07.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:07.324 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-09-10T09:34:07.395 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-09-10T09:34:07.395 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T09:34:07.395 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T09:34:07.395 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T09:34:07.395 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T09:34:07.396 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:07.396 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-10T09:34:07.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T09:34:07.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T09:34:07.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T09:34:07.396 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-10T09:34:07.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:07.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:07.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:07.688 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-10T09:34:07.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:07.703 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-09-10T09:34:07.758 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:07.758 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-10T09:34:07.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T09:34:07.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T09:34:07.758 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-10T09:34:07.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:07.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:07.878 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T09:34:07.878 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:07.878 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-10T09:34:07.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T09:34:07.878 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T09:34:07.879 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T09:34:07.879 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T09:34:07.879 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T09:34:07.879 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-10T09:34:07.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:07.981 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:07 smithi135 ceph-mon[33411]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-10T09:34:08.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:08.015 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T09:34:08.016 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-09-10T09:34:08.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-09-10T09:34:08.016 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T09:34:08.016 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-09-10T09:34:08.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:08.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:08.093 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:34:08.093 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:08.108 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T09:34:08.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T09:34:08.109 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:08.163 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-10T09:34:08.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:08.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:34:08.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:07 smithi079 ceph-mon[27592]: pgmap v198: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-10T09:34:08.267 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:34:08.267 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:34:08.267 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-10T09:34:08.393 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:34:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:34:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-10T09:34:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.135:3300" 2024-09-10T09:34:08.394 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:34:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-10T09:34:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-10T09:34:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:invalid new device string format 2024-09-10T09:34:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.79:3300,172.21.15.135:3300" 2024-09-10T09:34:08.398 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-10T09:34:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.79:6789,172.21.15.135:6789" 2024-09-10T09:34:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.79:6789,172.21.15.135:6789:/ 2024-09-10T09:34:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=afb60aa6-6f56-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T09:34:08.399 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T09:34:08.399 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-09-10T09:34:08.400 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T09:34:08.400 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T09:34:08.400 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T09:34:08.401 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T09:34:08.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:34:08.402 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:08.427 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:34:08.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:34:08.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:08.522 INFO:teuthology.orchestra.run.smithi135.stdout:client24309 2024-09-10T09:34:08.523 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:34:08.523 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:34:08.540 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:34:08.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:34:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:08.634 INFO:teuthology.orchestra.run.smithi135.stdout:client24309 2024-09-10T09:34:08.635 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T09:34:08.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T09:34:08.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:08.691 INFO:teuthology.orchestra.run.smithi135.stdout:client24309 2024-09-10T09:34:08.691 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968.client24309/status') 2024-09-10T09:34:08.740 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T09:34:08.750 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.24309 (3)192.168.0.1:0/3633561501 2024-09-10T09:34:08.750 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-09-10T09:34:08.750 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-09-10T09:34:08.750 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-09-10T09:34:08.750 INFO:teuthology.orchestra.run.smithi135.stderr:70 bytes copied, 2.26e-05 s, 3.1 MB/s 2024-09-10T09:34:08.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T09:34:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T09:34:08.757 INFO:teuthology.run_tasks:Running task print... 2024-09-10T09:34:08.770 INFO:teuthology.task.print:**** done client 2024-09-10T09:34:08.770 INFO:teuthology.run_tasks:Running task parallel... 2024-09-10T09:34:08.779 INFO:teuthology.task.parallel:starting parallel... 2024-09-10T09:34:08.779 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-10T09:34:08.780 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T09:34:08.780 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:34:08.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-10T09:34:08.781 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-10T09:34:08.781 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-10T09:34:08.786 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:08.786 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T09:34:08.786 INFO:tasks.workunit:timeout=3h 2024-09-10T09:34:08.786 INFO:tasks.workunit:cleanup=True 2024-09-10T09:34:08.787 DEBUG:teuthology.orchestra.run.smithi079:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 86h/134d Inode: 1 Links: 2 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-10 09:33:32.743967243 +0000 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-10 09:34:03.895533927 +0000 2024-09-10T09:34:08.808 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-10 09:33:32.743967243 +0000 2024-09-10T09:34:08.808 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T09:34:08.809 DEBUG:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T09:34:08.878 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:08.894 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 09:34:08.873415160 +0000 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 09:34:08.873415160 +0000 2024-09-10T09:34:08.895 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 09:33:32.743967243 +0000 2024-09-10T09:34:08.895 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-10T09:34:08.895 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-10T09:34:08.963 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:08.964 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:08.980 INFO:tasks.workunit.client.0.smithi079.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T09:34:09.008 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:34:09.019 INFO:tasks.workunit.client.1.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-10T09:34:09.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:09 smithi079 ceph-mon[27592]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-10T09:34:09.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:09 smithi135 ceph-mon[33411]: pgmap v199: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 -- 172.21.15.79:0/565124021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 msgr2=0x7f07f80ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 --2- 172.21.15.79:0/565124021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f80ff8a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009910 tx=0x7f07e8009c20 comp rx=0 tx=0).stop 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 -- 172.21.15.79:0/565124021 shutdown_connections 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 --2- 172.21.15.79:0/565124021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f80ff8a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 --2- 172.21.15.79:0/565124021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f8100730 0x7f07f8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 -- 172.21.15.79:0/565124021 >> 172.21.15.79:0/565124021 conn(0x7f07f80f9f10 msgr2=0x7f07f80fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 -- 172.21.15.79:0/565124021 shutdown_connections 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.673+0000 7f0800744700 1 -- 172.21.15.79:0/565124021 wait complete. 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f0800744700 1 Processor -- start 2024-09-10T09:34:10.675 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f0800744700 1 -- start start 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f0800744700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f81949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f0800744700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f8100730 0x7f07f8194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f0800744700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8195520 con 0x7f07f80ff430 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f0800744700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f8195660 con 0x7f07f8100730 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f07fe4e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f81949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f07fe4e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f81949c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43476/0 (socket says 172.21.15.79:43476) 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.674+0000 7f07fe4e0700 1 -- 172.21.15.79:0/3301654366 learned_addr learned my addr 172.21.15.79:0/3301654366 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07fdcdf700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f8100730 0x7f07f8194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:10.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07fe4e0700 1 -- 172.21.15.79:0/3301654366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f8100730 msgr2=0x7f07f8194f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07fe4e0700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f8100730 0x7f07f8194f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07fe4e0700 1 -- 172.21.15.79:0/3301654366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80095f0 con 0x7f07f80ff430 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07fe4e0700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f81949c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07f400d8d0 tx=0x7f07f400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07ef7fe700 1 -- 172.21.15.79:0/3301654366 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f40098a0 con 0x7f07f80ff430 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07ef7fe700 1 -- 172.21.15.79:0/3301654366 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f07f4010460 con 0x7f07f80ff430 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f80fe4c0 con 0x7f07f80ff430 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f07ef7fe700 1 -- 172.21.15.79:0/3301654366 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07f400f5f0 con 0x7f07f80ff430 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.675+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f80fea10 con 0x7f07f80ff430 2024-09-10T09:34:10.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.676+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f8107bf0 con 0x7f07f80ff430 2024-09-10T09:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.677+0000 7f07ef7fe700 1 -- 172.21.15.79:0/3301654366 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f07f4009a00 con 0x7f07f80ff430 2024-09-10T09:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.677+0000 7f07ef7fe700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f07e406c680 0x7f07e406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.677+0000 7f07ef7fe700 1 -- 172.21.15.79:0/3301654366 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f07f408b730 con 0x7f07f80ff430 2024-09-10T09:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.677+0000 7f07fdcdf700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f07e406c680 0x7f07e406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:10.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.678+0000 7f07fdcdf700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f07e406c680 0x7f07e406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07e8006010 tx=0x7f07e800b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:10.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.682+0000 7f07ef7fe700 1 -- 172.21.15.79:0/3301654366 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f07f40598f0 con 0x7f07f80ff430 2024-09-10T09:34:10.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.875+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f07f8107de0 con 0x7f07f80ff430 2024-09-10T09:34:10.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.876+0000 7f07ef7fe700 1 -- 172.21.15.79:0/3301654366 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f07f4059480 con 0x7f07f80ff430 2024-09-10T09:34:10.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f07e406c680 msgr2=0x7f07e406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f07e406c680 0x7f07e406eb30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f07e8006010 tx=0x7f07e800b540 comp rx=0 tx=0).stop 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 msgr2=0x7f07f81949c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f81949c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07f400d8d0 tx=0x7f07f400dbe0 comp rx=0 tx=0).stop 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 shutdown_connections 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f07e406c680 0x7f07e406eb30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f80ff430 0x7f07f81949c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 --2- 172.21.15.79:0/3301654366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f8100730 0x7f07f8194f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 >> 172.21.15.79:0/3301654366 conn(0x7f07f80f9f10 msgr2=0x7f07f8103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 shutdown_connections 2024-09-10T09:34:10.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:10.878+0000 7f0800744700 1 -- 172.21.15.79:0/3301654366 wait complete. 2024-09-10T09:34:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:10 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:10 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:11.608 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-10T09:34:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:34:11.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:11 smithi079 ceph-mon[27592]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-10T09:34:11.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:11 smithi135 ceph-mon[33411]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 -- 172.21.15.79:0/2471751055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 msgr2=0x7fb0140fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 --2- 172.21.15.79:0/2471751055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb0140fecd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb008009910 tx=0x7fb008009c20 comp rx=0 tx=0).stop 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 -- 172.21.15.79:0/2471751055 shutdown_connections 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 --2- 172.21.15.79:0/2471751055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0140ffb60 0x7fb0140fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 --2- 172.21.15.79:0/2471751055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb0140fecd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 -- 172.21.15.79:0/2471751055 >> 172.21.15.79:0/2471751055 conn(0x7fb0140f9f10 msgr2=0x7fb0140fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 -- 172.21.15.79:0/2471751055 shutdown_connections 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.476+0000 7fb01b562700 1 -- 172.21.15.79:0/2471751055 wait complete. 2024-09-10T09:34:13.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb01b562700 1 Processor -- start 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb01b562700 1 -- start start 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb01b562700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb014195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb01b562700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0140ffb60 0x7fb014196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb01b562700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb014196670 con 0x7fb0140fe8c0 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb01b562700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0141967b0 con 0x7fb0140ffb60 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb0192fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb014195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb0192fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb014195b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53044/0 (socket says 172.21.15.79:53044) 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.477+0000 7fb0192fe700 1 -- 172.21.15.79:0/3743354072 learned_addr learned my addr 172.21.15.79:0/3743354072 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb018afd700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0140ffb60 0x7fb014196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb0192fe700 1 -- 172.21.15.79:0/3743354072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0140ffb60 msgr2=0x7fb014196050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb0192fe700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0140ffb60 0x7fb014196050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb0192fe700 1 -- 172.21.15.79:0/3743354072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080095f0 con 0x7fb0140fe8c0 2024-09-10T09:34:13.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb018afd700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0140ffb60 0x7fb014196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:34:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb0192fe700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb014195b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb008006010 tx=0x7fb00800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb0067fc700 1 -- 172.21.15.79:0/3743354072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00801d070 con 0x7fb0140fe8c0 2024-09-10T09:34:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01419b200 con 0x7fb0140fe8c0 2024-09-10T09:34:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb0067fc700 1 -- 172.21.15.79:0/3743354072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb00800f460 con 0x7fb0140fe8c0 2024-09-10T09:34:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb0067fc700 1 -- 172.21.15.79:0/3743354072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb008021640 con 0x7fb0140fe8c0 2024-09-10T09:34:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.478+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01419b6f0 con 0x7fb0140fe8c0 2024-09-10T09:34:13.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.479+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb014107420 con 0x7fb0140fe8c0 2024-09-10T09:34:13.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.480+0000 7fb0067fc700 1 -- 172.21.15.79:0/3743354072 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb00800fab0 con 0x7fb0140fe8c0 2024-09-10T09:34:13.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.480+0000 7fb0067fc700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb00006c680 0x7fb00006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:13.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.480+0000 7fb018afd700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb00006c680 0x7fb00006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:13.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.480+0000 7fb0067fc700 1 -- 172.21.15.79:0/3743354072 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb00808cd10 con 0x7fb0140fe8c0 2024-09-10T09:34:13.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.481+0000 7fb018afd700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb00006c680 0x7fb00006eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb010007900 tx=0x7fb010008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:13.485 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.485+0000 7fb0067fc700 1 -- 172.21.15.79:0/3743354072 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb00805aed0 con 0x7fb0140fe8c0 2024-09-10T09:34:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.676+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fb01419bd30 con 0x7fb0140fe8c0 2024-09-10T09:34:13.678 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.676+0000 7fb0067fc700 1 -- 172.21.15.79:0/3743354072 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb0080260e0 con 0x7fb0140fe8c0 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb00006c680 msgr2=0x7fb00006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb00006c680 0x7fb00006eb30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb010007900 tx=0x7fb010008040 comp rx=0 tx=0).stop 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 msgr2=0x7fb014195b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb014195b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb008006010 tx=0x7fb00800be20 comp rx=0 tx=0).stop 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 shutdown_connections 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb00006c680 0x7fb00006eb30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0140fe8c0 0x7fb014195b10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 --2- 172.21.15.79:0/3743354072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0140ffb60 0x7fb014196050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 >> 172.21.15.79:0/3743354072 conn(0x7fb0140f9f10 msgr2=0x7fb0140fc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 shutdown_connections 2024-09-10T09:34:13.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:13.679+0000 7fb01b562700 1 -- 172.21.15.79:0/3743354072 wait complete. 2024-09-10T09:34:13.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:13 smithi079 ceph-mon[27592]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-10T09:34:13.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:13 smithi135 ceph-mon[33411]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-10T09:34:14.533 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-10T09:34:14.743 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:34:15.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:15 smithi135 ceph-mon[33411]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-10T09:34:15.992 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:15 smithi079 ceph-mon[27592]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-10T09:34:16.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 -- 172.21.15.79:0/2144656450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 msgr2=0x7fb46c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:16.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 --2- 172.21.15.79:0/2144656450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c101890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009910 tx=0x7fb45c009c20 comp rx=0 tx=0).stop 2024-09-10T09:34:16.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 -- 172.21.15.79:0/2144656450 shutdown_connections 2024-09-10T09:34:16.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 --2- 172.21.15.79:0/2144656450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c101890 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 --2- 172.21.15.79:0/2144656450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb46c100240 0x7fb46c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 -- 172.21.15.79:0/2144656450 >> 172.21.15.79:0/2144656450 conn(0x7fb46c0fb7f0 msgr2=0x7fb46c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:16.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 -- 172.21.15.79:0/2144656450 shutdown_connections 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 -- 172.21.15.79:0/2144656450 wait complete. 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 Processor -- start 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.527+0000 7fb473c74700 1 -- start start 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb473c74700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb46c100240 0x7fb46c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb473c74700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb473c74700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c1996e0 con 0x7fb46c101440 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb473c74700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c199820 con 0x7fb46c100240 2024-09-10T09:34:16.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb47120f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:16.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb47120f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c073140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53056/0 (socket says 172.21.15.79:53056) 2024-09-10T09:34:16.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb47120f700 1 -- 172.21.15.79:0/3362586457 learned_addr learned my addr 172.21.15.79:0/3362586457 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:34:16.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb471a10700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb46c100240 0x7fb46c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:16.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb47120f700 1 -- 172.21.15.79:0/3362586457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb46c100240 msgr2=0x7fb46c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:16.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb47120f700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb46c100240 0x7fb46c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb47120f700 1 -- 172.21.15.79:0/3362586457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0095f0 con 0x7fb46c101440 2024-09-10T09:34:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb47120f700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c073140 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00bd70 tx=0x7fb45c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.528+0000 7fb462ffd700 1 -- 172.21.15.79:0/3362586457 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c01d070 con 0x7fb46c101440 2024-09-10T09:34:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.529+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c073680 con 0x7fb46c101440 2024-09-10T09:34:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.529+0000 7fb462ffd700 1 -- 172.21.15.79:0/3362586457 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb45c005940 con 0x7fb46c101440 2024-09-10T09:34:16.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.529+0000 7fb462ffd700 1 -- 172.21.15.79:0/3362586457 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c021430 con 0x7fb46c101440 2024-09-10T09:34:16.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.529+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c073b40 con 0x7fb46c101440 2024-09-10T09:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.530+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c04f2a0 con 0x7fb46c101440 2024-09-10T09:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.530+0000 7fb462ffd700 1 -- 172.21.15.79:0/3362586457 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fb45c00f860 con 0x7fb46c101440 2024-09-10T09:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.530+0000 7fb462ffd700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb45806c680 0x7fb45806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.531+0000 7fb462ffd700 1 -- 172.21.15.79:0/3362586457 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fb45c08cbe0 con 0x7fb46c101440 2024-09-10T09:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.531+0000 7fb471a10700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb45806c680 0x7fb45806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:16.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.531+0000 7fb471a10700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb45806c680 0x7fb45806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb46c1012a0 tx=0x7fb46800a3b0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:16.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.535+0000 7fb462ffd700 1 -- 172.21.15.79:0/3362586457 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fb45c05ada0 con 0x7fb46c101440 2024-09-10T09:34:16.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.724+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fb46c073e20 con 0x7fb46c101440 2024-09-10T09:34:16.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.724+0000 7fb462ffd700 1 -- 172.21.15.79:0/3362586457 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb45c05a930 con 0x7fb46c101440 2024-09-10T09:34:16.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb45806c680 msgr2=0x7fb45806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:16.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb45806c680 0x7fb45806eb30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb46c1012a0 tx=0x7fb46800a3b0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 msgr2=0x7fb46c073140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c073140 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00bd70 tx=0x7fb45c00bda0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 shutdown_connections 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fb45806c680 0x7fb45806eb30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb46c100240 0x7fb46c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 --2- 172.21.15.79:0/3362586457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb46c101440 0x7fb46c073140 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.726+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 >> 172.21.15.79:0/3362586457 conn(0x7fb46c0fb7f0 msgr2=0x7fb46c104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.727+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 shutdown_connections 2024-09-10T09:34:16.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:16.727+0000 7fb473c74700 1 -- 172.21.15.79:0/3362586457 wait complete. 2024-09-10T09:34:17.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-10T09:34:17.665 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:34:18.061 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:17 smithi079 ceph-mon[27592]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-10T09:34:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:17 smithi135 ceph-mon[33411]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-10T09:34:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 -- 172.21.15.79:0/1300600662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e500ff130 msgr2=0x7f7e500ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:19.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 --2- 172.21.15.79:0/1300600662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e500ff130 0x7f7e500ff540 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009910 tx=0x7f7e40009c20 comp rx=0 tx=0).stop 2024-09-10T09:34:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 -- 172.21.15.79:0/1300600662 shutdown_connections 2024-09-10T09:34:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 --2- 172.21.15.79:0/1300600662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e501003d0 0x7f7e50100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 --2- 172.21.15.79:0/1300600662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e500ff130 0x7f7e500ff540 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 -- 172.21.15.79:0/1300600662 >> 172.21.15.79:0/1300600662 conn(0x7f7e500fa780 msgr2=0x7f7e500fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 -- 172.21.15.79:0/1300600662 shutdown_connections 2024-09-10T09:34:19.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.501+0000 7f7e568e7700 1 -- 172.21.15.79:0/1300600662 wait complete. 2024-09-10T09:34:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e568e7700 1 Processor -- start 2024-09-10T09:34:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e568e7700 1 -- start start 2024-09-10T09:34:19.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e568e7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e500ff130 0x7f7e500690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e568e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e501003d0 0x7f7e5019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e568e7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5019ae10 con 0x7f7e501003d0 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e568e7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5019af80 con 0x7f7e500ff130 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e501003d0 0x7f7e5019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e47fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e501003d0 0x7f7e5019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53072/0 (socket says 172.21.15.79:53072) 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e47fff700 1 -- 172.21.15.79:0/4027118788 learned_addr learned my addr 172.21.15.79:0/4027118788 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e47fff700 1 -- 172.21.15.79:0/4027118788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e500ff130 msgr2=0x7f7e500690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e47fff700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e500ff130 0x7f7e500690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.502+0000 7f7e47fff700 1 -- 172.21.15.79:0/4027118788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400095f0 con 0x7f7e501003d0 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.503+0000 7f7e47fff700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e501003d0 0x7f7e5019a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b4b0 tx=0x7f7e3800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.503+0000 7f7e4dffb700 1 -- 172.21.15.79:0/4027118788 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e38011800 con 0x7f7e501003d0 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.503+0000 7f7e4dffb700 1 -- 172.21.15.79:0/4027118788 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7e38011e10 con 0x7f7e501003d0 2024-09-10T09:34:19.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.503+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5019b260 con 0x7f7e501003d0 2024-09-10T09:34:19.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.503+0000 7f7e4dffb700 1 -- 172.21.15.79:0/4027118788 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e3800f2e0 con 0x7f7e501003d0 2024-09-10T09:34:19.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.503+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5019b7b0 con 0x7f7e501003d0 2024-09-10T09:34:19.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.504+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50107c90 con 0x7f7e501003d0 2024-09-10T09:34:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.505+0000 7f7e4dffb700 1 -- 172.21.15.79:0/4027118788 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f7e38010380 con 0x7f7e501003d0 2024-09-10T09:34:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.505+0000 7f7e4dffb700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7e3c06c680 0x7f7e3c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:34:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.505+0000 7f7e4ffff700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7e3c06c680 0x7f7e3c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:34:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.505+0000 7f7e4dffb700 1 -- 172.21.15.79:0/4027118788 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f7e3808b380 con 0x7f7e501003d0 2024-09-10T09:34:19.507 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.506+0000 7f7e4ffff700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7e3c06c680 0x7f7e3c06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000b5c0 tx=0x7f7e40005fd0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:34:19.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.510+0000 7f7e4dffb700 1 -- 172.21.15.79:0/4027118788 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f7e38059670 con 0x7f7e501003d0 2024-09-10T09:34:19.716 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:19.716+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e50104d20 con 0x7f7e3c06c680 2024-09-10T09:34:19.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:19 smithi079 ceph-mon[27592]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-10T09:34:19.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:19 smithi135 ceph-mon[33411]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-10T09:34:20.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:20 smithi079 ceph-mon[27592]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:34:20.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:20 smithi135 ceph-mon[33411]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:34:21.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:21 smithi079 ceph-mon[27592]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-10T09:34:21.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:21 smithi135 ceph-mon[33411]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-10T09:34:23.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:23 smithi135 ceph-mon[33411]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-10T09:34:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:23 smithi079 ceph-mon[27592]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-10T09:34:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:25 smithi135 ceph-mon[33411]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T09:34:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:25 smithi079 ceph-mon[27592]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T09:34:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:27 smithi079 ceph-mon[27592]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:27 smithi135 ceph-mon[33411]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:29.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:29 smithi079 ceph-mon[27592]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:29.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:29 smithi135 ceph-mon[33411]: pgmap v209: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:31.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:31 smithi135 ceph-mon[33411]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:34:32.057 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:31 smithi079 ceph-mon[27592]: pgmap v210: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:34:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:33 smithi079 ceph-mon[27592]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:33 smithi135 ceph-mon[33411]: pgmap v211: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:36.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:35 smithi079 ceph-mon[27592]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:34:36.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:35 smithi135 ceph-mon[33411]: pgmap v212: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:34:38.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:37 smithi079 ceph-mon[27592]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:38.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:37 smithi135 ceph-mon[33411]: pgmap v213: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:39 smithi079 ceph-mon[27592]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:39.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:39 smithi135 ceph-mon[33411]: pgmap v214: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:40.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:40.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:41.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:41 smithi079 ceph-mon[27592]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:34:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:41 smithi135 ceph-mon[33411]: pgmap v215: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:34:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:43 smithi079 ceph-mon[27592]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:43 smithi135 ceph-mon[33411]: pgmap v216: 65 pgs: 65 active+clean; 584 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:34:45.999 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:45 smithi135 ceph-mon[33411]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-10T09:34:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:45 smithi079 ceph-mon[27592]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-09-10T09:34:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:47 smithi079 ceph-mon[27592]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-10T09:34:48.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:47 smithi135 ceph-mon[33411]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-10T09:34:48.325 INFO:teuthology.orchestra.run.smithi079.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:48.326 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.324+0000 7f7e4dffb700 1 -- 172.21.15.79:0/4027118788 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f7e50104d20 con 0x7f7e3c06c680 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7e3c06c680 msgr2=0x7f7e3c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7e3c06c680 0x7f7e3c06eb30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000b5c0 tx=0x7f7e40005fd0 comp rx=0 tx=0).stop 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e501003d0 msgr2=0x7f7e5019a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e501003d0 0x7f7e5019a840 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b4b0 tx=0x7f7e3800b870 comp rx=0 tx=0).stop 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 shutdown_connections 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f7e3c06c680 0x7f7e3c06eb30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e500ff130 0x7f7e500690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:48.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 --2- 172.21.15.79:0/4027118788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e501003d0 0x7f7e5019a840 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:34:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 >> 172.21.15.79:0/4027118788 conn(0x7f7e500fa780 msgr2=0x7f7e50103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:34:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 shutdown_connections 2024-09-10T09:34:48.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:34:48.327+0000 7f7e568e7700 1 -- 172.21.15.79:0/4027118788 wait complete. 2024-09-10T09:34:48.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-10T09:34:49.270 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:34:49.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:49 smithi079 ceph-mon[27592]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:49.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:34:49.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:34:49.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:49 smithi079 ceph-mon[27592]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-10T09:34:49.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:34:49.672 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:34:49.672 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:49 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:34:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:49 smithi135 ceph-mon[33411]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:34:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:34:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:49 smithi135 ceph-mon[33411]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-09-10T09:34:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:34:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:34:49.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:49 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:34:50.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:50 smithi079 ceph-mon[27592]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:50.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:50 smithi135 ceph-mon[33411]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:34:51.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:51 smithi079 ceph-mon[27592]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-10T09:34:51.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:51 smithi135 ceph-mon[33411]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-10T09:34:54.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:53 smithi079 ceph-mon[27592]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-10T09:34:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:53 smithi135 ceph-mon[33411]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-10T09:34:56.159 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:55 smithi135 ceph-mon[33411]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-10T09:34:56.160 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:55 smithi079 ceph-mon[27592]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 597 B/s wr, 3 op/s 2024-09-10T09:34:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:34:58.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:57 smithi079 ceph-mon[27592]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:34:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:57 smithi135 ceph-mon[33411]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:34:59.921 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:34:59 smithi079 ceph-mon[27592]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:34:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:34:59 smithi135 ceph-mon[33411]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:35:00.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 -- 172.21.15.79:0/2800801201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d80ff150 msgr2=0x7f55d80ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 --2- 172.21.15.79:0/2800801201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d80ff150 0x7f55d80ff560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009910 tx=0x7f55c8009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 -- 172.21.15.79:0/2800801201 shutdown_connections 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 --2- 172.21.15.79:0/2800801201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d81003f0 0x7f55d8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 --2- 172.21.15.79:0/2800801201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d80ff150 0x7f55d80ff560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 -- 172.21.15.79:0/2800801201 >> 172.21.15.79:0/2800801201 conn(0x7f55d80fa7a0 msgr2=0x7f55d80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 -- 172.21.15.79:0/2800801201 shutdown_connections 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.237+0000 7f55de422700 1 -- 172.21.15.79:0/2800801201 wait complete. 2024-09-10T09:35:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.238+0000 7f55de422700 1 Processor -- start 2024-09-10T09:35:00.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.238+0000 7f55de422700 1 -- start start 2024-09-10T09:35:00.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55de422700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d80ff150 0x7f55d8197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:00.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55de422700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d81003f0 0x7f55d81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:00.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d80ff150 0x7f55d8197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:00.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55d7fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d80ff150 0x7f55d8197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:37630/0 (socket says 172.21.15.79:37630) 2024-09-10T09:35:00.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55d7fff700 1 -- 172.21.15.79:0/3428680481 learned_addr learned my addr 172.21.15.79:0/3428680481 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:00.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8198b00 con 0x7f55d81003f0 2024-09-10T09:35:00.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8198c40 con 0x7f55d80ff150 2024-09-10T09:35:00.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.239+0000 7f55d77fe700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d81003f0 0x7f55d81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.240+0000 7f55d77fe700 1 -- 172.21.15.79:0/3428680481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d80ff150 msgr2=0x7f55d8197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.240+0000 7f55d77fe700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d80ff150 0x7f55d8197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.240+0000 7f55d77fe700 1 -- 172.21.15.79:0/3428680481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc009520 con 0x7f55d81003f0 2024-09-10T09:35:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.240+0000 7f55d77fe700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d81003f0 0x7f55d81984e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00e970 tx=0x7f55cc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.240+0000 7f55d57fa700 1 -- 172.21.15.79:0/3428680481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55cc00cb40 con 0x7f55d81003f0 2024-09-10T09:35:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.240+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c80095f0 con 0x7f55d81003f0 2024-09-10T09:35:00.242 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.241+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d819dab0 con 0x7f55d81003f0 2024-09-10T09:35:00.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.241+0000 7f55d57fa700 1 -- 172.21.15.79:0/3428680481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f55cc00eec0 con 0x7f55d81003f0 2024-09-10T09:35:00.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.241+0000 7f55d57fa700 1 -- 172.21.15.79:0/3428680481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55cc0055f0 con 0x7f55d81003f0 2024-09-10T09:35:00.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.243+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c4005320 con 0x7f55d81003f0 2024-09-10T09:35:00.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.244+0000 7f55d57fa700 1 -- 172.21.15.79:0/3428680481 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f55cc00cca0 con 0x7f55d81003f0 2024-09-10T09:35:00.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.245+0000 7f55d57fa700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f55c006c680 0x7f55c006eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:00.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.245+0000 7f55d57fa700 1 -- 172.21.15.79:0/3428680481 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f55cc014070 con 0x7f55d81003f0 2024-09-10T09:35:00.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.247+0000 7f55d7fff700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f55c006c680 0x7f55c006eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:00.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.248+0000 7f55d7fff700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f55c006c680 0x7f55c006eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55c8006010 tx=0x7f55c8005a90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:00.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.255+0000 7f55d57fa700 1 -- 172.21.15.79:0/3428680481 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f55cc056500 con 0x7f55d81003f0 2024-09-10T09:35:00.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.499+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55c4000bf0 con 0x7f55c006c680 2024-09-10T09:35:00.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.501+0000 7f55d57fa700 1 -- 172.21.15.79:0/3428680481 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f55c4000bf0 con 0x7f55c006c680 2024-09-10T09:35:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f55c006c680 msgr2=0x7f55c006eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f55c006c680 0x7f55c006eb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55c8006010 tx=0x7f55c8005a90 comp rx=0 tx=0).stop 2024-09-10T09:35:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d81003f0 msgr2=0x7f55d81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d81003f0 0x7f55d81984e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00e970 tx=0x7f55cc00ec80 comp rx=0 tx=0).stop 2024-09-10T09:35:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 shutdown_connections 2024-09-10T09:35:00.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f55c006c680 0x7f55c006eb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55d80ff150 0x7f55d8197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 --2- 172.21.15.79:0/3428680481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55d81003f0 0x7f55d81984e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 >> 172.21.15.79:0/3428680481 conn(0x7f55d80fa7a0 msgr2=0x7f55d8068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 shutdown_connections 2024-09-10T09:35:00.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.504+0000 7f55de422700 1 -- 172.21.15.79:0/3428680481 wait complete. 2024-09-10T09:35:00.525 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:35:00.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.638+0000 7f05ccc05700 1 -- 172.21.15.79:0/1743845505 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b80054b0 con 0x7f05c8100350 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 -- 172.21.15.79:0/1743845505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 msgr2=0x7f05c81007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/1743845505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 0x7f05c81007a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009910 tx=0x7f05b8009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 -- 172.21.15.79:0/1743845505 shutdown_connections 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/1743845505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 0x7f05c81007a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/1743845505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 0x7f05c80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 -- 172.21.15.79:0/1743845505 >> 172.21.15.79:0/1743845505 conn(0x7f05c80fa700 msgr2=0x7f05c80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 -- 172.21.15.79:0/1743845505 shutdown_connections 2024-09-10T09:35:00.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.639+0000 7f05cfe6b700 1 -- 172.21.15.79:0/1743845505 wait complete. 2024-09-10T09:35:00.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cfe6b700 1 Processor -- start 2024-09-10T09:35:00.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cfe6b700 1 -- start start 2024-09-10T09:35:00.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cfe6b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 0x7f05c81949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:00.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cfe6b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 0x7f05c8194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:00.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cfe6b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c8195500 con 0x7f05c8100350 2024-09-10T09:35:00.641 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cfe6b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c8195640 con 0x7f05c80ff150 2024-09-10T09:35:00.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cdc07700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 0x7f05c81949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:00.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.640+0000 7f05cdc07700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 0x7f05c81949a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:37640/0 (socket says 172.21.15.79:37640) 2024-09-10T09:35:00.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.641+0000 7f05cdc07700 1 -- 172.21.15.79:0/756401471 learned_addr learned my addr 172.21.15.79:0/756401471 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:00.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.641+0000 7f05cd406700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 0x7f05c8194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:00.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.641+0000 7f05cdc07700 1 -- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 msgr2=0x7f05c8194ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.641+0000 7f05cdc07700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 0x7f05c8194ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.642 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.641+0000 7f05cdc07700 1 -- 172.21.15.79:0/756401471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80095f0 con 0x7f05c80ff150 2024-09-10T09:35:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.641+0000 7f05cdc07700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 0x7f05c81949a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f05c400d900 tx=0x7f05c400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.641+0000 7f05beffd700 1 -- 172.21.15.79:0/756401471 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c40041f0 con 0x7f05c80ff150 2024-09-10T09:35:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.642+0000 7f05beffd700 1 -- 172.21.15.79:0/756401471 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f05c4004350 con 0x7f05c80ff150 2024-09-10T09:35:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.642+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c819a0f0 con 0x7f05c80ff150 2024-09-10T09:35:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.642+0000 7f05beffd700 1 -- 172.21.15.79:0/756401471 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05c4003d20 con 0x7f05c80ff150 2024-09-10T09:35:00.643 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.642+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c8069060 con 0x7f05c80ff150 2024-09-10T09:35:00.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.643+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c8107ca0 con 0x7f05c80ff150 2024-09-10T09:35:00.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.644+0000 7f05beffd700 1 -- 172.21.15.79:0/756401471 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f05c4009730 con 0x7f05c80ff150 2024-09-10T09:35:00.645 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.644+0000 7f05beffd700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f05b406c6d0 0x7f05b406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:00.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.645+0000 7f05beffd700 1 -- 172.21.15.79:0/756401471 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f05c408b7f0 con 0x7f05c80ff150 2024-09-10T09:35:00.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.645+0000 7f05cd406700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f05b406c6d0 0x7f05b406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:00.646 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.645+0000 7f05cd406700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f05b406c6d0 0x7f05b406eb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05b800b5c0 tx=0x7f05b8005ee0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:00.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.653+0000 7f05beffd700 1 -- 172.21.15.79:0/756401471 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f05c4059910 con 0x7f05c80ff150 2024-09-10T09:35:00.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.920+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05c8069d20 con 0x7f05b406c6d0 2024-09-10T09:35:00.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.921+0000 7f05beffd700 1 -- 172.21.15.79:0/756401471 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f05c8069d20 con 0x7f05b406c6d0 2024-09-10T09:35:00.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.924+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f05b406c6d0 msgr2=0x7f05b406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.924+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f05b406c6d0 0x7f05b406eb80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f05b800b5c0 tx=0x7f05b8005ee0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.924+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 msgr2=0x7f05c81949a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 0x7f05c81949a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f05c400d900 tx=0x7f05c400dc10 comp rx=0 tx=0).stop 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 shutdown_connections 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f05b406c6d0 0x7f05b406eb80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c80ff150 0x7f05c81949a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 --2- 172.21.15.79:0/756401471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c8100350 0x7f05c8194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 >> 172.21.15.79:0/756401471 conn(0x7f05c80fa700 msgr2=0x7f05c8103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 shutdown_connections 2024-09-10T09:35:00.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:00.925+0000 7f05cfe6b700 1 -- 172.21.15.79:0/756401471 wait complete. 2024-09-10T09:35:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 -- 172.21.15.79:0/1890818484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 msgr2=0x7f4ea8103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 --2- 172.21.15.79:0/1890818484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 0x7f4ea8103140 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009910 tx=0x7f4e98009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 -- 172.21.15.79:0/1890818484 shutdown_connections 2024-09-10T09:35:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 --2- 172.21.15.79:0/1890818484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 0x7f4ea8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 --2- 172.21.15.79:0/1890818484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 0x7f4ea8103140 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 -- 172.21.15.79:0/1890818484 >> 172.21.15.79:0/1890818484 conn(0x7f4ea80fa780 msgr2=0x7f4ea80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 -- 172.21.15.79:0/1890818484 shutdown_connections 2024-09-10T09:35:01.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.089+0000 7f4ead433700 1 -- 172.21.15.79:0/1890818484 wait complete. 2024-09-10T09:35:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.090+0000 7f4ead433700 1 Processor -- start 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.090+0000 7f4ead433700 1 -- start start 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.090+0000 7f4ead433700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 0x7f4ea8195ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.090+0000 7f4ead433700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 0x7f4ea8195ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ead433700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8196610 con 0x7f4ea8100d60 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ead433700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8196750 con 0x7f4ea8103680 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 0x7f4ea8195ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea67fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 0x7f4ea8195ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:37652/0 (socket says 172.21.15.79:37652) 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea67fc700 1 -- 172.21.15.79:0/1081227393 learned_addr learned my addr 172.21.15.79:0/1081227393 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea6ffd700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 0x7f4ea8195ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea67fc700 1 -- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 msgr2=0x7f4ea8195ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea67fc700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 0x7f4ea8195ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea67fc700 1 -- 172.21.15.79:0/1081227393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980095f0 con 0x7f4ea8103680 2024-09-10T09:35:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.091+0000 7f4ea6ffd700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 0x7f4ea8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:35:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.092+0000 7f4ea67fc700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 0x7f4ea8195ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d900 tx=0x7f4e9c00dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.092+0000 7f4e8ffff700 1 -- 172.21.15.79:0/1081227393 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e9c0041f0 con 0x7f4ea8103680 2024-09-10T09:35:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.092+0000 7f4e8ffff700 1 -- 172.21.15.79:0/1081227393 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4e9c004ce0 con 0x7f4ea8103680 2024-09-10T09:35:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.092+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea80febb0 con 0x7f4ea8103680 2024-09-10T09:35:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.092+0000 7f4e8ffff700 1 -- 172.21.15.79:0/1081227393 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e9c00b750 con 0x7f4ea8103680 2024-09-10T09:35:01.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.092+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea80ff100 con 0x7f4ea8103680 2024-09-10T09:35:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.094+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea818fbc0 con 0x7f4ea8103680 2024-09-10T09:35:01.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.095+0000 7f4e8ffff700 1 -- 172.21.15.79:0/1081227393 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4e9c004e50 con 0x7f4ea8103680 2024-09-10T09:35:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.095+0000 7f4e8ffff700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4e9006c6d0 0x7f4e9006eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.095+0000 7f4e8ffff700 1 -- 172.21.15.79:0/1081227393 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4e9c08b6d0 con 0x7f4ea8103680 2024-09-10T09:35:01.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.096+0000 7f4ea6ffd700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4e9006c6d0 0x7f4e9006eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.096+0000 7f4ea6ffd700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4e9006c6d0 0x7f4e9006eb80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e98006010 tx=0x7f4e9800b560 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:01.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.103+0000 7f4e8ffff700 1 -- 172.21.15.79:0/1081227393 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4e9c059870 con 0x7f4ea8103680 2024-09-10T09:35:01.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.504+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ea8100560 con 0x7f4e9006c6d0 2024-09-10T09:35:01.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.523+0000 7f4e8ffff700 1 -- 172.21.15.79:0/1081227393 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f4ea8100560 con 0x7f4e9006c6d0 2024-09-10T09:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (5m) 62s ago 6m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:35:01.524 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (7m) 62s ago 7m 7398k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (6m) 69s ago 6m 7348k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (7m) 62s ago 7m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (6m) 69s ago 6m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (5m) 62s ago 6m 83.2M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (90s) 62s ago 89s 11.5M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (83s) 62s ago 82s 14.4M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (87s) 69s ago 87s 19.5M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (80s) 69s ago 80s 15.4M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:35:01.525 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:9283,8765,8443 running (8m) 62s ago 8m 487M - 18.2.0 dc2bc1663786 3bc55a447267 2024-09-10T09:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (6m) 69s ago 6m 438M - 18.2.0 dc2bc1663786 b593ff93654b 2024-09-10T09:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (8m) 62s ago 8m 45.0M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (5m) 69s ago 5m 35.3M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 62s ago 7m 14.5M - 1.5.0 0da6a335fe13 2d43514669a8 2024-09-10T09:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (6m) 69s ago 6m 15.3M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:35:01.526 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (5m) 62s ago 5m 49.1M 3946M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (4m) 62s ago 4m 48.2M 3946M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (4m) 62s ago 4m 46.4M 3946M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (3m) 69s ago 3m 46.0M 1213M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (3m) 69s ago 3m 44.7M 1213M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (2m) 69s ago 2m 46.3M 1213M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:35:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (5m) 62s ago 6m 61.5M - 2.43.0 a07b618ecd1d 960dc8481947 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4e9006c6d0 msgr2=0x7f4e9006eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4e9006c6d0 0x7f4e9006eb80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4e98006010 tx=0x7f4e9800b560 comp rx=0 tx=0).stop 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 msgr2=0x7f4ea8195ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 0x7f4ea8195ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00d900 tx=0x7f4e9c00dc10 comp rx=0 tx=0).stop 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 shutdown_connections 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4e9006c6d0 0x7f4e9006eb80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ea8100d60 0x7f4ea8195ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 --2- 172.21.15.79:0/1081227393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ea8103680 0x7f4ea8195ff0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.526+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 >> 172.21.15.79:0/1081227393 conn(0x7f4ea80fa780 msgr2=0x7f4ea80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.527+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 shutdown_connections 2024-09-10T09:35:01.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.527+0000 7f4ead433700 1 -- 172.21.15.79:0/1081227393 wait complete. 2024-09-10T09:35:01.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 -- 172.21.15.79:0/3941397780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0ff480 msgr2=0x7f373c0ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 --2- 172.21.15.79:0/3941397780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0ff480 0x7f373c0ff8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3730009910 tx=0x7f3730009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:01.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 -- 172.21.15.79:0/3941397780 shutdown_connections 2024-09-10T09:35:01.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 --2- 172.21.15.79:0/3941397780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0ff480 0x7f373c0ff8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 --2- 172.21.15.79:0/3941397780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373c0feb30 0x7f373c0fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 -- 172.21.15.79:0/3941397780 >> 172.21.15.79:0/3941397780 conn(0x7f373c0fa700 msgr2=0x7f373c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:01.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 -- 172.21.15.79:0/3941397780 shutdown_connections 2024-09-10T09:35:01.636 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.634+0000 7f3740c4b700 1 -- 172.21.15.79:0/3941397780 wait complete. 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.635+0000 7f3740c4b700 1 Processor -- start 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.635+0000 7f3740c4b700 1 -- start start 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.635+0000 7f3740c4b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0feb30 0x7f373c1046b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.635+0000 7f3740c4b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373c0ff480 0x7f373c104bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.635+0000 7f3740c4b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1011a0 con 0x7f373c0feb30 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.635+0000 7f3740c4b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c101310 con 0x7f373c0ff480 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f373a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0feb30 0x7f373c1046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f373a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0feb30 0x7f373c1046b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42676/0 (socket says 172.21.15.79:42676) 2024-09-10T09:35:01.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f373a59c700 1 -- 172.21.15.79:0/2408636679 learned_addr learned my addr 172.21.15.79:0/2408636679 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f3739d9b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373c0ff480 0x7f373c104bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f373a59c700 1 -- 172.21.15.79:0/2408636679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373c0ff480 msgr2=0x7f373c104bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f373a59c700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373c0ff480 0x7f373c104bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f373a59c700 1 -- 172.21.15.79:0/2408636679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300095f0 con 0x7f373c0feb30 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f373a59c700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0feb30 0x7f373c1046b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f372c00d8d0 tx=0x7f372c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f372b7fe700 1 -- 172.21.15.79:0/2408636679 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372c009940 con 0x7f373c0feb30 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c1015f0 con 0x7f373c0feb30 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f372b7fe700 1 -- 172.21.15.79:0/2408636679 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f372c010460 con 0x7f373c0feb30 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.636+0000 7f372b7fe700 1 -- 172.21.15.79:0/2408636679 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372c00f5f0 con 0x7f373c0feb30 2024-09-10T09:35:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.637+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c101b40 con 0x7f373c0feb30 2024-09-10T09:35:01.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.638+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c10af80 con 0x7f373c0feb30 2024-09-10T09:35:01.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.638+0000 7f372b7fe700 1 -- 172.21.15.79:0/2408636679 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f372c0105d0 con 0x7f373c0feb30 2024-09-10T09:35:01.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.639+0000 7f372b7fe700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f372406c680 0x7f372406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:01.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.639+0000 7f372b7fe700 1 -- 172.21.15.79:0/2408636679 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f372c08b7b0 con 0x7f373c0feb30 2024-09-10T09:35:01.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.639+0000 7f3739d9b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f372406c680 0x7f372406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:01.640 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.640+0000 7f3739d9b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f372406c680 0x7f372406eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3730006010 tx=0x7f373000b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:01.644 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.643+0000 7f372b7fe700 1 -- 172.21.15.79:0/2408636679 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f372c0599f0 con 0x7f373c0feb30 2024-09-10T09:35:01.869 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:01.869 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:35:01.869 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:35:01.869 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: Upgrade: Target is version 19.1.1-305-g1cf819b7 (unknown) 2024-09-10T09:35:01.869 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559'] 2024-09-10T09:35:01.870 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:35:01.870 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:35:01.870 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: Upgrade: Need to upgrade myself (mgr.smithi079.mhirny) 2024-09-10T09:35:01.870 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:01 smithi079 ceph-mon[27592]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:01.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.929+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f373c1a2700 con 0x7f373c0feb30 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.930+0000 7f372b7fe700 1 -- 172.21.15.79:0/2408636679 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f372c059580 con 0x7f373c0feb30 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:35:01.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:01.932 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:35:01.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:35:01.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:01.932 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:35:01.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-10T09:35:01.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:35:01.932 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:35:01.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f372406c680 msgr2=0x7f372406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f372406c680 0x7f372406eb30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3730006010 tx=0x7f373000b540 comp rx=0 tx=0).stop 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0feb30 msgr2=0x7f373c1046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0feb30 0x7f373c1046b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f372c00d8d0 tx=0x7f372c00dc90 comp rx=0 tx=0).stop 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 shutdown_connections 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f372406c680 0x7f372406eb30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f373c0feb30 0x7f373c1046b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 --2- 172.21.15.79:0/2408636679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373c0ff480 0x7f373c104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.932+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 >> 172.21.15.79:0/2408636679 conn(0x7f373c0fa700 msgr2=0x7f373c107160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.933+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 shutdown_connections 2024-09-10T09:35:01.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:01.933+0000 7f3740c4b700 1 -- 172.21.15.79:0/2408636679 wait complete. 2024-09-10T09:35:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 -- 172.21.15.79:0/1006663114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 msgr2=0x7fa1e0107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:02.044 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 --2- 172.21.15.79:0/1006663114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0107b30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009910 tx=0x7fa1d4009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 -- 172.21.15.79:0/1006663114 shutdown_connections 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 --2- 172.21.15.79:0/1006663114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0107b30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 --2- 172.21.15.79:0/1006663114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1e0069ae0 0x7fa1e0105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 -- 172.21.15.79:0/1006663114 >> 172.21.15.79:0/1006663114 conn(0x7fa1e00fa7a0 msgr2=0x7fa1e00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 -- 172.21.15.79:0/1006663114 shutdown_connections 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.043+0000 7fa1e55d6700 1 -- 172.21.15.79:0/1006663114 wait complete. 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.044+0000 7fa1e55d6700 1 Processor -- start 2024-09-10T09:35:02.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.044+0000 7fa1e55d6700 1 -- start start 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1e55d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1e0069ae0 0x7fa1e0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1e55d6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1e55d6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e0198ba0 con 0x7fa1e0105750 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1e55d6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e0198ce0 con 0x7fa1e0069ae0 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1de7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1deffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1e0069ae0 0x7fa1e0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1deffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1e0069ae0 0x7fa1e0198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:54602/0 (socket says 172.21.15.79:54602) 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1de7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51956/0 (socket says 172.21.15.79:51956) 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1deffd700 1 -- 172.21.15.79:0/2281043248 learned_addr learned my addr 172.21.15.79:0/2281043248 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1de7fc700 1 -- 172.21.15.79:0/2281043248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1e0069ae0 msgr2=0x7fa1e0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1de7fc700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1e0069ae0 0x7fa1e0198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:02.047 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.045+0000 7fa1de7fc700 1 -- 172.21.15.79:0/2281043248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40095f0 con 0x7fa1e0105750 2024-09-10T09:35:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.046+0000 7fa1de7fc700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0198580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4000c00 tx=0x7fa1d400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.046+0000 7fa1c7fff700 1 -- 172.21.15.79:0/2281043248 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d401d070 con 0x7fa1e0105750 2024-09-10T09:35:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.046+0000 7fa1c7fff700 1 -- 172.21.15.79:0/2281043248 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa1d4005dc0 con 0x7fa1e0105750 2024-09-10T09:35:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.046+0000 7fa1e55d6700 1 -- 172.21.15.79:0/2281043248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e019d730 con 0x7fa1e0105750 2024-09-10T09:35:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.046+0000 7fa1c7fff700 1 -- 172.21.15.79:0/2281043248 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d4017400 con 0x7fa1e0105750 2024-09-10T09:35:02.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.047+0000 7fa1e55d6700 1 -- 172.21.15.79:0/2281043248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e019db60 con 0x7fa1e0105750 2024-09-10T09:35:02.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.048+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c00052f0 con 0x7fa1e0105750 2024-09-10T09:35:02.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.049+0000 7fa1c7fff700 1 -- 172.21.15.79:0/2281043248 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fa1d4003810 con 0x7fa1e0105750 2024-09-10T09:35:02.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.050+0000 7fa1c7fff700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa1c806c6d0 0x7fa1c806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.050+0000 7fa1c7fff700 1 -- 172.21.15.79:0/2281043248 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa1d408cb40 con 0x7fa1e0105750 2024-09-10T09:35:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.050+0000 7fa1deffd700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa1c806c6d0 0x7fa1c806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:02.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.051+0000 7fa1deffd700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa1c806c6d0 0x7fa1c806eb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009cc0 tx=0x7fa1d0009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:02.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.054+0000 7fa1c7fff700 1 -- 172.21.15.79:0/2281043248 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fa1d405ad60 con 0x7fa1e0105750 2024-09-10T09:35:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-10T09:35:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:35:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: Upgrade: Target is version 19.1.1-305-g1cf819b7 (unknown) 2024-09-10T09:35:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559'] 2024-09-10T09:35:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:35:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:35:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: Upgrade: Need to upgrade myself (mgr.smithi079.mhirny) 2024-09-10T09:35:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:01 smithi135 ceph-mon[33411]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:02.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.470+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1c0000bc0 con 0x7fa1c806c6d0 2024-09-10T09:35:02.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.472+0000 7fa1c7fff700 1 -- 172.21.15.79:0/2281043248 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa1c0000bc0 con 0x7fa1c806c6d0 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [], 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "0/2 daemons upgraded", 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 image on host smithi135", 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:35:02.473 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:35:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa1c806c6d0 msgr2=0x7fa1c806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa1c806c6d0 0x7fa1c806eb80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009cc0 tx=0x7fa1d0009260 comp rx=0 tx=0).stop 2024-09-10T09:35:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 msgr2=0x7fa1e0198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0198580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4000c00 tx=0x7fa1d400f690 comp rx=0 tx=0).stop 2024-09-10T09:35:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 shutdown_connections 2024-09-10T09:35:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fa1c806c6d0 0x7fa1c806eb80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1e0069ae0 0x7fa1e0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 --2- 172.21.15.79:0/2281043248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa1e0105750 0x7fa1e0198580 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.474+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 >> 172.21.15.79:0/2281043248 conn(0x7fa1e00fa7a0 msgr2=0x7fa1e00fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.475+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 shutdown_connections 2024-09-10T09:35:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:02.475+0000 7fa1c5ffb700 1 -- 172.21.15.79:0/2281043248 wait complete. 2024-09-10T09:35:02.871 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:02 smithi079 ceph-mon[27592]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 on smithi135 2024-09-10T09:35:02.871 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:02 smithi079 ceph-mon[27592]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:02.871 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:02 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2408636679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:35:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:02 smithi135 ceph-mon[33411]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 on smithi135 2024-09-10T09:35:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:02 smithi135 ceph-mon[33411]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:02 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2408636679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:35:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:03 smithi079 ceph-mon[27592]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:03 smithi079 ceph-mon[27592]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-10T09:35:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:03 smithi135 ceph-mon[33411]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:03 smithi135 ceph-mon[33411]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2024-09-10T09:35:06.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:05 smithi079 ceph-mon[27592]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T09:35:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:05 smithi135 ceph-mon[33411]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T09:35:08.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:07 smithi079 ceph-mon[27592]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:35:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:07 smithi135 ceph-mon[33411]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:35:09.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:09 smithi079 ceph-mon[27592]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:35:09.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:09 smithi135 ceph-mon[33411]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:35:10.166 INFO:tasks.workunit.client.1.smithi135.stderr:Updating files: 87% (11159/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T09:35:10.666 INFO:tasks.workunit.client.1.smithi135.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T09:35:10.666 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr: git switch -c 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr:Or undo this operation with: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr: git switch - 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-09-10T09:35:10.667 INFO:tasks.workunit.client.1.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T09:35:10.668 INFO:tasks.workunit.client.1.smithi135.stderr: 2024-09-10T09:35:10.668 INFO:tasks.workunit.client.1.smithi135.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:35:10.672 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-10T09:35:10.924 INFO:tasks.workunit.client.1.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T09:35:10.927 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T09:35:10.927 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T09:35:10.955 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:10 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:10 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:11.597 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T09:35:11.670 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T09:35:11.712 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-10T09:35:11.714 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T09:35:11.714 INFO:tasks.workunit.client.1.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T09:35:11.757 INFO:tasks.workunit.client.1.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-10T09:35:11.761 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:35:11.761 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-10T09:35:11.777 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-10T09:35:11.779 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-10T09:35:11.779 DEBUG:teuthology.orchestra.run.smithi135:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-10T09:35:11.840 INFO:tasks.workunit.client.1.smithi135.stderr:+ mkdir -p fsstress 2024-09-10T09:35:11.841 INFO:tasks.workunit.client.1.smithi135.stderr:+ pushd fsstress 2024-09-10T09:35:11.842 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-10T09:35:11.842 INFO:tasks.workunit.client.1.smithi135.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-10T09:35:11.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:11 smithi079 ceph-mon[27592]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:35:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:11 smithi135 ceph-mon[33411]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:35:12.352 INFO:tasks.workunit.client.1.smithi135.stderr:+ tar xzf ltp-full.tgz 2024-09-10T09:35:12.913 INFO:tasks.workunit.client.0.smithi079.stderr:Updating files: 98% (12533/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T09:35:13.790 INFO:tasks.workunit.client.0.smithi079.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr: git switch -c 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr:Or undo this operation with: 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-09-10T09:35:13.791 INFO:tasks.workunit.client.0.smithi079.stderr: git switch - 2024-09-10T09:35:13.792 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-09-10T09:35:13.792 INFO:tasks.workunit.client.0.smithi079.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T09:35:13.792 INFO:tasks.workunit.client.0.smithi079.stderr: 2024-09-10T09:35:13.792 INFO:tasks.workunit.client.0.smithi079.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T09:35:13.796 DEBUG:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T09:35:13.823 INFO:tasks.workunit.client.0.smithi079.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T09:35:13.825 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T09:35:13.825 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T09:35:14.031 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:13 smithi079 ceph-mon[27592]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:35:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:13 smithi135 ceph-mon[33411]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:35:14.547 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T09:35:14.626 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T09:35:14.666 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T09:35:14.668 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T09:35:14.668 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T09:35:14.707 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T09:35:14.710 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:35:14.711 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T09:35:14.767 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-10T09:35:14.768 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-10T09:35:14.768 DEBUG:teuthology.orchestra.run.smithi079:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-10T09:35:14.830 INFO:tasks.workunit.client.0.smithi079.stderr:+ mkdir -p fsstress 2024-09-10T09:35:14.832 INFO:tasks.workunit.client.0.smithi079.stderr:+ pushd fsstress 2024-09-10T09:35:14.832 INFO:tasks.workunit.client.0.smithi079.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-10T09:35:14.833 INFO:tasks.workunit.client.0.smithi079.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-10T09:35:15.637 INFO:tasks.workunit.client.0.smithi079.stderr:+ tar xzf ltp-full.tgz 2024-09-10T09:35:16.018 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:15 smithi135 ceph-mon[33411]: pgmap v232: 65 pgs: 65 active+clean; 4.6 MiB data, 169 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 341 KiB/s wr, 3 op/s 2024-09-10T09:35:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:15 smithi079 ceph-mon[27592]: pgmap v232: 65 pgs: 65 active+clean; 4.6 MiB data, 169 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 341 KiB/s wr, 3 op/s 2024-09-10T09:35:18.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:17 smithi079 ceph-mon[27592]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 177 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s rd, 341 KiB/s wr, 2 op/s 2024-09-10T09:35:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:17 smithi135 ceph-mon[33411]: pgmap v233: 65 pgs: 65 active+clean; 4.6 MiB data, 177 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s rd, 341 KiB/s wr, 2 op/s 2024-09-10T09:35:19.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:19 smithi079 ceph-mon[27592]: pgmap v234: 65 pgs: 65 active+clean; 4.6 MiB data, 177 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s rd, 341 KiB/s wr, 2 op/s 2024-09-10T09:35:19.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:19 smithi135 ceph-mon[33411]: pgmap v234: 65 pgs: 65 active+clean; 4.6 MiB data, 177 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s rd, 341 KiB/s wr, 2 op/s 2024-09-10T09:35:22.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:21 smithi079 ceph-mon[27592]: pgmap v235: 65 pgs: 65 active+clean; 30 MiB data, 266 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 150 op/s 2024-09-10T09:35:22.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:21 smithi135 ceph-mon[33411]: pgmap v235: 65 pgs: 65 active+clean; 30 MiB data, 266 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 150 op/s 2024-09-10T09:35:24.135 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:23 smithi079 ceph-mon[27592]: pgmap v236: 65 pgs: 65 active+clean; 44 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 272 op/s 2024-09-10T09:35:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:23 smithi135 ceph-mon[33411]: pgmap v236: 65 pgs: 65 active+clean; 44 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 272 op/s 2024-09-10T09:35:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:25 smithi079 ceph-mon[27592]: pgmap v237: 65 pgs: 65 active+clean; 56 MiB data, 354 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 329 op/s 2024-09-10T09:35:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:25 smithi135 ceph-mon[33411]: pgmap v237: 65 pgs: 65 active+clean; 56 MiB data, 354 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 329 op/s 2024-09-10T09:35:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:27 smithi079 ceph-mon[27592]: pgmap v238: 65 pgs: 65 active+clean; 63 MiB data, 397 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 352 op/s 2024-09-10T09:35:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:27 smithi135 ceph-mon[33411]: pgmap v238: 65 pgs: 65 active+clean; 63 MiB data, 397 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 352 op/s 2024-09-10T09:35:29.722 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:29 smithi079 ceph-mon[27592]: pgmap v239: 65 pgs: 65 active+clean; 63 MiB data, 397 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 352 op/s 2024-09-10T09:35:29.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:29 smithi135 ceph-mon[33411]: pgmap v239: 65 pgs: 65 active+clean; 63 MiB data, 397 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 352 op/s 2024-09-10T09:35:31.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:31 smithi135 ceph-mon[33411]: pgmap v240: 65 pgs: 65 active+clean; 85 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 524 op/s 2024-09-10T09:35:32.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:31 smithi079 ceph-mon[27592]: pgmap v240: 65 pgs: 65 active+clean; 85 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 524 op/s 2024-09-10T09:35:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 -- 172.21.15.79:0/4090814804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 msgr2=0x7fc1400ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 --2- 172.21.15.79:0/4090814804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc1400ff540 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc130009910 tx=0x7fc130009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 -- 172.21.15.79:0/4090814804 shutdown_connections 2024-09-10T09:35:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 --2- 172.21.15.79:0/4090814804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1401003d0 0x7fc140100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 --2- 172.21.15.79:0/4090814804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc1400ff540 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 -- 172.21.15.79:0/4090814804 >> 172.21.15.79:0/4090814804 conn(0x7fc1400fa780 msgr2=0x7fc1400fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 -- 172.21.15.79:0/4090814804 shutdown_connections 2024-09-10T09:35:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.591+0000 7fc144b97700 1 -- 172.21.15.79:0/4090814804 wait complete. 2024-09-10T09:35:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc144b97700 1 Processor -- start 2024-09-10T09:35:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc144b97700 1 -- start start 2024-09-10T09:35:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc144b97700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc140107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:32.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc144b97700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1401003d0 0x7fc1401057d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc144b97700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140105d10 con 0x7fc1400ff130 2024-09-10T09:35:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc144b97700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc140105e50 con 0x7fc1401003d0 2024-09-10T09:35:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc140107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc13e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc140107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41346/0 (socket says 172.21.15.79:41346) 2024-09-10T09:35:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc13e59c700 1 -- 172.21.15.79:0/4282534260 learned_addr learned my addr 172.21.15.79:0/4282534260 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:32.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc13dd9b700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1401003d0 0x7fc1401057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc13e59c700 1 -- 172.21.15.79:0/4282534260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1401003d0 msgr2=0x7fc1401057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.592+0000 7fc13e59c700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1401003d0 0x7fc1401057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.593+0000 7fc13e59c700 1 -- 172.21.15.79:0/4282534260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300095f0 con 0x7fc1400ff130 2024-09-10T09:35:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.593+0000 7fc13e59c700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc140107180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc13000bd70 tx=0x7fc13000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:32.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.593+0000 7fc12f7fe700 1 -- 172.21.15.79:0/4282534260 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc13001d070 con 0x7fc1400ff130 2024-09-10T09:35:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.593+0000 7fc12f7fe700 1 -- 172.21.15.79:0/4282534260 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc130005dc0 con 0x7fc1400ff130 2024-09-10T09:35:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.593+0000 7fc12f7fe700 1 -- 172.21.15.79:0/4282534260 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc130021410 con 0x7fc1400ff130 2024-09-10T09:35:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.593+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1401060d0 con 0x7fc1400ff130 2024-09-10T09:35:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.593+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1401065c0 con 0x7fc1400ff130 2024-09-10T09:35:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.594+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc140108d10 con 0x7fc1400ff130 2024-09-10T09:35:32.601 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.594+0000 7fc12f7fe700 1 -- 172.21.15.79:0/4282534260 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc13000f7d0 con 0x7fc1400ff130 2024-09-10T09:35:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.595+0000 7fc12f7fe700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc12806c680 0x7fc12806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.595+0000 7fc12f7fe700 1 -- 172.21.15.79:0/4282534260 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc13008cb20 con 0x7fc1400ff130 2024-09-10T09:35:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.595+0000 7fc13dd9b700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc12806c680 0x7fc12806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.595+0000 7fc13dd9b700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc12806c680 0x7fc12806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc134007bc0 tx=0x7fc1340073d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:32.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.599+0000 7fc12f7fe700 1 -- 172.21.15.79:0/4282534260 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc13005ace0 con 0x7fc1400ff130 2024-09-10T09:35:32.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.809+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc14019df30 con 0x7fc12806c680 2024-09-10T09:35:32.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.810+0000 7fc12f7fe700 1 -- 172.21.15.79:0/4282534260 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fc14019df30 con 0x7fc12806c680 2024-09-10T09:35:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc12806c680 msgr2=0x7fc12806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc12806c680 0x7fc12806eb30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc134007bc0 tx=0x7fc1340073d0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 msgr2=0x7fc140107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc140107180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc13000bd70 tx=0x7fc13000bda0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 shutdown_connections 2024-09-10T09:35:32.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc12806c680 0x7fc12806eb30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1400ff130 0x7fc140107180 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 --2- 172.21.15.79:0/4282534260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1401003d0 0x7fc1401057d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 >> 172.21.15.79:0/4282534260 conn(0x7fc1400fa780 msgr2=0x7fc140103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 shutdown_connections 2024-09-10T09:35:32.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.812+0000 7fc144b97700 1 -- 172.21.15.79:0/4282534260 wait complete. 2024-09-10T09:35:32.823 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:35:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 -- 172.21.15.79:0/1101046854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 msgr2=0x7f4d48100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1101046854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48100b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009910 tx=0x7f4d38009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 -- 172.21.15.79:0/1101046854 shutdown_connections 2024-09-10T09:35:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1101046854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d48101040 0x7f4d480ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1101046854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48100b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 -- 172.21.15.79:0/1101046854 >> 172.21.15.79:0/1101046854 conn(0x7f4d480f9f10 msgr2=0x7f4d480fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 -- 172.21.15.79:0/1101046854 shutdown_connections 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.922+0000 7f4d4d487700 1 -- 172.21.15.79:0/1101046854 wait complete. 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d4d487700 1 Processor -- start 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d4d487700 1 -- start start 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d4d487700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d4d487700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d48101040 0x7f4d48196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d4d487700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d48196630 con 0x7f4d481006f0 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d4d487700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d48196770 con 0x7f4d48101040 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d46ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:32.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d46ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41358/0 (socket says 172.21.15.79:41358) 2024-09-10T09:35:32.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d46ffd700 1 -- 172.21.15.79:0/1731946445 learned_addr learned my addr 172.21.15.79:0/1731946445 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:32.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d3ffff700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d48101040 0x7f4d48196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:32.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d46ffd700 1 -- 172.21.15.79:0/1731946445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d48101040 msgr2=0x7f4d48196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:32.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d46ffd700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d48101040 0x7f4d48196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:32.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.923+0000 7f4d46ffd700 1 -- 172.21.15.79:0/1731946445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380095f0 con 0x7f4d481006f0 2024-09-10T09:35:32.930 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.924+0000 7f4d46ffd700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48195ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800bda0 tx=0x7f4d3800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:32.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.924+0000 7f4d44ff9700 1 -- 172.21.15.79:0/1731946445 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d3801d070 con 0x7f4d481006f0 2024-09-10T09:35:32.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.924+0000 7f4d44ff9700 1 -- 172.21.15.79:0/1731946445 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d3800f460 con 0x7f4d481006f0 2024-09-10T09:35:32.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.924+0000 7f4d44ff9700 1 -- 172.21.15.79:0/1731946445 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d38021640 con 0x7f4d481006f0 2024-09-10T09:35:32.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.924+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4819b1c0 con 0x7f4d481006f0 2024-09-10T09:35:32.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.924+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4819b6b0 con 0x7f4d481006f0 2024-09-10T09:35:32.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.925+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d48107bf0 con 0x7f4d481006f0 2024-09-10T09:35:32.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.926+0000 7f4d44ff9700 1 -- 172.21.15.79:0/1731946445 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f4d3800f5d0 con 0x7f4d481006f0 2024-09-10T09:35:32.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.926+0000 7f4d44ff9700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d3406c680 0x7f4d3406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:32.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.926+0000 7f4d44ff9700 1 -- 172.21.15.79:0/1731946445 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4d3808cab0 con 0x7f4d481006f0 2024-09-10T09:35:32.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.926+0000 7f4d3ffff700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d3406c680 0x7f4d3406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:32.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.927+0000 7f4d3ffff700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d3406c680 0x7f4d3406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d30007be0 tx=0x7f4d300073d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:32.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:32.931+0000 7f4d44ff9700 1 -- 172.21.15.79:0/1731946445 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f4d3805ac70 con 0x7f4d481006f0 2024-09-10T09:35:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.145+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d4819bcf0 con 0x7f4d3406c680 2024-09-10T09:35:33.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.146+0000 7f4d44ff9700 1 -- 172.21.15.79:0/1731946445 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4d4819bcf0 con 0x7f4d3406c680 2024-09-10T09:35:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d3406c680 msgr2=0x7f4d3406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d3406c680 0x7f4d3406eb30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d30007be0 tx=0x7f4d300073d0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 msgr2=0x7f4d48195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48195ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800bda0 tx=0x7f4d3800bdd0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 shutdown_connections 2024-09-10T09:35:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f4d3406c680 0x7f4d3406eb30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d481006f0 0x7f4d48195ad0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 --2- 172.21.15.79:0/1731946445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d48101040 0x7f4d48196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 >> 172.21.15.79:0/1731946445 conn(0x7f4d480f9f10 msgr2=0x7f4d480fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 shutdown_connections 2024-09-10T09:35:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.148+0000 7f4d4d487700 1 -- 172.21.15.79:0/1731946445 wait complete. 2024-09-10T09:35:33.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1246394363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 msgr2=0x7fc8041018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.258 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1246394363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc8041018a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009910 tx=0x7fc7f0009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1246394363 shutdown_connections 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1246394363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc8041018a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1246394363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804100250 0x7fc804100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1246394363 >> 172.21.15.79:0/1246394363 conn(0x7fc8040fb7e0 msgr2=0x7fc8040fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1246394363 shutdown_connections 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.256+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1246394363 wait complete. 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc80b0a8700 1 Processor -- start 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc80b0a8700 1 -- start start 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc80b0a8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804100250 0x7fc804195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc80b0a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc804195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc80b0a8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc804196600 con 0x7fc804101450 2024-09-10T09:35:33.259 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc80b0a8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc804196740 con 0x7fc804100250 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc803fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc804195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc803fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc804195fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41390/0 (socket says 172.21.15.79:41390) 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc803fff700 1 -- 172.21.15.79:0/1461652494 learned_addr learned my addr 172.21.15.79:0/1461652494 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.257+0000 7fc808e44700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804100250 0x7fc804195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc803fff700 1 -- 172.21.15.79:0/1461652494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804100250 msgr2=0x7fc804195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc803fff700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804100250 0x7fc804195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc803fff700 1 -- 172.21.15.79:0/1461652494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f00095f0 con 0x7fc804101450 2024-09-10T09:35:33.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc803fff700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc804195fe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0000c00 tx=0x7fc7f000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:33.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc801ffb700 1 -- 172.21.15.79:0/1461652494 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f001d070 con 0x7fc804101450 2024-09-10T09:35:33.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80419b190 con 0x7fc804101450 2024-09-10T09:35:33.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc801ffb700 1 -- 172.21.15.79:0/1461652494 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc7f0005dc0 con 0x7fc804101450 2024-09-10T09:35:33.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc801ffb700 1 -- 172.21.15.79:0/1461652494 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7f00226a0 con 0x7fc804101450 2024-09-10T09:35:33.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.258+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80419b680 con 0x7fc804101450 2024-09-10T09:35:33.262 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.259+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc804108da0 con 0x7fc804101450 2024-09-10T09:35:33.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.260+0000 7fc801ffb700 1 -- 172.21.15.79:0/1461652494 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc7f00038f0 con 0x7fc804101450 2024-09-10T09:35:33.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.260+0000 7fc801ffb700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc7f406c680 0x7fc7f406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:33.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.260+0000 7fc801ffb700 1 -- 172.21.15.79:0/1461652494 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc7f008cc00 con 0x7fc804101450 2024-09-10T09:35:33.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.260+0000 7fc808e44700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc7f406c680 0x7fc7f406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:33.263 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.261+0000 7fc808e44700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc7f406c680 0x7fc7f406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8041012b0 tx=0x7fc7f8009260 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:33.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.265+0000 7fc801ffb700 1 -- 172.21.15.79:0/1461652494 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc7f0092020 con 0x7fc804101450 2024-09-10T09:35:33.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.492+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc804105da0 con 0x7fc7f406c680 2024-09-10T09:35:33.506 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.505+0000 7fc801ffb700 1 -- 172.21.15.79:0/1461652494 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7fc804105da0 con 0x7fc7f406c680 2024-09-10T09:35:33.506 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:35:33.506 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (6m) 94s ago 7m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:35:33.507 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (7m) 94s ago 7m 7398k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:35:33.507 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (6m) 101s ago 6m 7348k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:35:33.507 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (7m) 94s ago 7m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:35:33.507 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (6m) 101s ago 6m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:35:33.507 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (5m) 94s ago 7m 83.2M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:35:33.507 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (2m) 94s ago 2m 11.5M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (115s) 94s ago 114s 14.4M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (119s) 101s ago 119s 19.5M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (112s) 101s ago 112s 15.4M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:9283,8765,8443 running (8m) 94s ago 8m 487M - 18.2.0 dc2bc1663786 3bc55a447267 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (6m) 101s ago 6m 438M - 18.2.0 dc2bc1663786 b593ff93654b 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (8m) 94s ago 9m 45.0M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (6m) 101s ago 6m 35.3M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 94s ago 7m 14.5M - 1.5.0 0da6a335fe13 2d43514669a8 2024-09-10T09:35:33.508 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (6m) 101s ago 6m 15.3M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:35:33.509 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (5m) 94s ago 5m 49.1M 3946M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:35:33.509 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (5m) 94s ago 5m 48.2M 3946M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:35:33.509 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (4m) 94s ago 4m 46.4M 3946M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:35:33.509 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (4m) 101s ago 4m 46.0M 1213M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:35:33.509 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (3m) 101s ago 3m 44.7M 1213M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:35:33.509 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (3m) 101s ago 3m 46.3M 1213M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:35:33.509 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (5m) 94s ago 7m 61.5M - 2.43.0 a07b618ecd1d 960dc8481947 2024-09-10T09:35:33.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc7f406c680 msgr2=0x7fc7f406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc7f406c680 0x7fc7f406eb30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc8041012b0 tx=0x7fc7f8009260 comp rx=0 tx=0).stop 2024-09-10T09:35:33.510 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 msgr2=0x7fc804195fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc804195fe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0000c00 tx=0x7fc7f000f690 comp rx=0 tx=0).stop 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 shutdown_connections 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc7f406c680 0x7fc7f406eb30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc804100250 0x7fc804195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 --2- 172.21.15.79:0/1461652494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc804101450 0x7fc804195fe0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.507+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 >> 172.21.15.79:0/1461652494 conn(0x7fc8040fb7e0 msgr2=0x7fc804104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.508+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 shutdown_connections 2024-09-10T09:35:33.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.508+0000 7fc80b0a8700 1 -- 172.21.15.79:0/1461652494 wait complete. 2024-09-10T09:35:33.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.621+0000 7f0f2fa81700 1 -- 172.21.15.79:0/1258122382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 msgr2=0x7f0f280fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.621+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/1258122382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f280fe910 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009910 tx=0x7f0f24009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:33.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.621+0000 7f0f2fa81700 1 -- 172.21.15.79:0/1258122382 shutdown_connections 2024-09-10T09:35:33.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.621+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/1258122382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f280fee50 0x7f0f28101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.621+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/1258122382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f280fe910 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 -- 172.21.15.79:0/1258122382 >> 172.21.15.79:0/1258122382 conn(0x7f0f280f9f10 msgr2=0x7f0f280fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 -- 172.21.15.79:0/1258122382 shutdown_connections 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 -- 172.21.15.79:0/1258122382 wait complete. 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 Processor -- start 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 -- start start 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f28195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f280fee50 0x7f0f28196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28196660 con 0x7f0f280fe500 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2fa81700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f281967a0 con 0x7f0f280fee50 2024-09-10T09:35:33.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.622+0000 7f0f2d81d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f28195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2d81d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f28195b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41396/0 (socket says 172.21.15.79:41396) 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2d81d700 1 -- 172.21.15.79:0/2847169336 learned_addr learned my addr 172.21.15.79:0/2847169336 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2d01c700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f280fee50 0x7f0f28196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2d81d700 1 -- 172.21.15.79:0/2847169336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f280fee50 msgr2=0x7f0f28196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2d81d700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f280fee50 0x7f0f28196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2d81d700 1 -- 172.21.15.79:0/2847169336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240095f0 con 0x7f0f280fe500 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2d81d700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f28195b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400bd70 tx=0x7f0f2400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f1effd700 1 -- 172.21.15.79:0/2847169336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f2401d070 con 0x7f0f280fe500 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f1effd700 1 -- 172.21.15.79:0/2847169336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0f24005dc0 con 0x7f0f280fe500 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f1effd700 1 -- 172.21.15.79:0/2847169336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f24021410 con 0x7f0f280fe500 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2819b1f0 con 0x7f0f280fe500 2024-09-10T09:35:33.626 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.623+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2819b6e0 con 0x7f0f280fe500 2024-09-10T09:35:33.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.624+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f28108d50 con 0x7f0f280fe500 2024-09-10T09:35:33.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.625+0000 7f0f1effd700 1 -- 172.21.15.79:0/2847169336 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0f2400f7d0 con 0x7f0f280fe500 2024-09-10T09:35:33.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.625+0000 7f0f1effd700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0f1406c680 0x7f0f1406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:33.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.625+0000 7f0f1effd700 1 -- 172.21.15.79:0/2847169336 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0f2408ca30 con 0x7f0f280fe500 2024-09-10T09:35:33.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.625+0000 7f0f2d01c700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0f1406c680 0x7f0f1406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:33.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.626+0000 7f0f2d01c700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0f1406c680 0x7f0f1406eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005950 tx=0x7f0f1800b410 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:33.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.630+0000 7f0f1effd700 1 -- 172.21.15.79:0/2847169336 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f0f2405abf0 con 0x7f0f280fe500 2024-09-10T09:35:33.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.923+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f2819be30 con 0x7f0f280fe500 2024-09-10T09:35:33.925 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:33 smithi079 ceph-mon[27592]: pgmap v241: 65 pgs: 65 active+clean; 95 MiB data, 487 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 479 op/s 2024-09-10T09:35:33.925 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:33 smithi079 ceph-mon[27592]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:33.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.924+0000 7f0f1effd700 1 -- 172.21.15.79:0/2847169336 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f0f2819be30 con 0x7f0f280fe500 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:35:33.926 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:35:33.927 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0f1406c680 msgr2=0x7f0f1406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0f1406c680 0x7f0f1406eb30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005950 tx=0x7f0f1800b410 comp rx=0 tx=0).stop 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 msgr2=0x7f0f28195b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f28195b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400bd70 tx=0x7f0f2400bda0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 shutdown_connections 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f0f1406c680 0x7f0f1406eb30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f280fe500 0x7f0f28195b00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 --2- 172.21.15.79:0/2847169336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f280fee50 0x7f0f28196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 >> 172.21.15.79:0/2847169336 conn(0x7f0f280f9f10 msgr2=0x7f0f281047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 shutdown_connections 2024-09-10T09:35:33.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:33.926+0000 7f0f2fa81700 1 -- 172.21.15.79:0/2847169336 wait complete. 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 -- 172.21.15.79:0/1638607546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a81003d0 msgr2=0x7f77a8100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 --2- 172.21.15.79:0/1638607546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a81003d0 0x7f77a8100840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7798009910 tx=0x7f7798009c20 comp rx=0 tx=0).stop 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 -- 172.21.15.79:0/1638607546 shutdown_connections 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 --2- 172.21.15.79:0/1638607546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a81003d0 0x7f77a8100840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 --2- 172.21.15.79:0/1638607546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77a80ff130 0x7f77a80ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 -- 172.21.15.79:0/1638607546 >> 172.21.15.79:0/1638607546 conn(0x7f77a80fa780 msgr2=0x7f77a80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 -- 172.21.15.79:0/1638607546 shutdown_connections 2024-09-10T09:35:34.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 -- 172.21.15.79:0/1638607546 wait complete. 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 Processor -- start 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.037+0000 7f77afcad700 1 -- start start 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77afcad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a80ff130 0x7f77a8195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77afcad700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77a81003d0 0x7f77a8195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77afcad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a81965c0 con 0x7f77a80ff130 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77afcad700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a8196700 con 0x7f77a81003d0 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ada49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a80ff130 0x7f77a8195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:34.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ada49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a80ff130 0x7f77a8195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:41410/0 (socket says 172.21.15.79:41410) 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ada49700 1 -- 172.21.15.79:0/505371811 learned_addr learned my addr 172.21.15.79:0/505371811 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ad248700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77a81003d0 0x7f77a8195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ada49700 1 -- 172.21.15.79:0/505371811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77a81003d0 msgr2=0x7f77a8195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ada49700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77a81003d0 0x7f77a8195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ada49700 1 -- 172.21.15.79:0/505371811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980095f0 con 0x7f77a80ff130 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77ada49700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a80ff130 0x7f77a8195a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77a400e920 tx=0x7f77a400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f779effd700 1 -- 172.21.15.79:0/505371811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77a400c9d0 con 0x7f77a80ff130 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f779effd700 1 -- 172.21.15.79:0/505371811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f77a4010430 con 0x7f77a80ff130 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a819b1b0 con 0x7f77a80ff130 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f779effd700 1 -- 172.21.15.79:0/505371811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77a4018650 con 0x7f77a80ff130 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.038+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a819b700 con 0x7f77a80ff130 2024-09-10T09:35:34.041 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.039+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a8107c10 con 0x7f77a80ff130 2024-09-10T09:35:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.040+0000 7f779effd700 1 -- 172.21.15.79:0/505371811 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f77a40105a0 con 0x7f77a80ff130 2024-09-10T09:35:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.040+0000 7f779effd700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f779406c680 0x7f779406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:35:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.040+0000 7f779effd700 1 -- 172.21.15.79:0/505371811 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f77a4014070 con 0x7f77a80ff130 2024-09-10T09:35:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.041+0000 7f77ad248700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f779406c680 0x7f779406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:35:34.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.041+0000 7f77ad248700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f779406c680 0x7f779406eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7798009fd0 tx=0x7f7798005940 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:35:34.045 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.045+0000 7f779effd700 1 -- 172.21.15.79:0/505371811 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f77a4051720 con 0x7f77a80ff130 2024-09-10T09:35:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:33 smithi135 ceph-mon[33411]: pgmap v241: 65 pgs: 65 active+clean; 95 MiB data, 487 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 5.7 MiB/s wr, 479 op/s 2024-09-10T09:35:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:33 smithi135 ceph-mon[33411]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:34.297 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.297+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77a8068c50 con 0x7f779406c680 2024-09-10T09:35:34.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.298+0000 7f779effd700 1 -- 172.21.15.79:0/505371811 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f77a8068c50 con 0x7f779406c680 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [], 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "0/2 daemons upgraded", 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 image on host smithi135", 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:35:34.299 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f779406c680 msgr2=0x7f779406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f779406c680 0x7f779406eb30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7798009fd0 tx=0x7f7798005940 comp rx=0 tx=0).stop 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a80ff130 msgr2=0x7f77a8195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a80ff130 0x7f77a8195a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77a400e920 tx=0x7f77a400ec30 comp rx=0 tx=0).stop 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 shutdown_connections 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f779406c680 0x7f779406eb30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f77a80ff130 0x7f77a8195a60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 --2- 172.21.15.79:0/505371811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f77a81003d0 0x7f77a8195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 >> 172.21.15.79:0/505371811 conn(0x7f77a80fa780 msgr2=0x7f77a8068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:35:34.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 shutdown_connections 2024-09-10T09:35:34.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:35:34.300+0000 7f77afcad700 1 -- 172.21.15.79:0/505371811 wait complete. 2024-09-10T09:35:35.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:34 smithi079 ceph-mon[27592]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:35.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:34 smithi079 ceph-mon[27592]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:35.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:34 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2847169336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:35:35.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:34 smithi135 ceph-mon[33411]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:35.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:34 smithi135 ceph-mon[33411]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:35.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:34 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2847169336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:35:36.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:35 smithi079 ceph-mon[27592]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:36.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:35 smithi079 ceph-mon[27592]: pgmap v242: 65 pgs: 65 active+clean; 100 MiB data, 537 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 403 op/s 2024-09-10T09:35:36.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:35 smithi135 ceph-mon[33411]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:35:36.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:35 smithi135 ceph-mon[33411]: pgmap v242: 65 pgs: 65 active+clean; 100 MiB data, 537 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 403 op/s 2024-09-10T09:35:38.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:37 smithi079 ceph-mon[27592]: pgmap v243: 65 pgs: 65 active+clean; 117 MiB data, 577 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 463 op/s 2024-09-10T09:35:38.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:37 smithi135 ceph-mon[33411]: pgmap v243: 65 pgs: 65 active+clean; 117 MiB data, 577 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 463 op/s 2024-09-10T09:35:39.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:39 smithi079 ceph-mon[27592]: pgmap v244: 65 pgs: 65 active+clean; 117 MiB data, 577 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 439 op/s 2024-09-10T09:35:39.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:39 smithi135 ceph-mon[33411]: pgmap v244: 65 pgs: 65 active+clean; 117 MiB data, 577 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 MiB/s wr, 439 op/s 2024-09-10T09:35:40.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:40 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:40.970 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:40 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:42.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:41 smithi079 ceph-mon[27592]: pgmap v245: 65 pgs: 65 active+clean; 140 MiB data, 693 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 694 op/s 2024-09-10T09:35:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:41 smithi135 ceph-mon[33411]: pgmap v245: 65 pgs: 65 active+clean; 140 MiB data, 693 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 6.7 MiB/s wr, 694 op/s 2024-09-10T09:35:44.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:43 smithi079 ceph-mon[27592]: pgmap v246: 65 pgs: 65 active+clean; 151 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 623 op/s 2024-09-10T09:35:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:43 smithi135 ceph-mon[33411]: pgmap v246: 65 pgs: 65 active+clean; 151 MiB data, 735 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 623 op/s 2024-09-10T09:35:46.016 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:45 smithi135 ceph-mon[33411]: pgmap v247: 65 pgs: 65 active+clean; 154 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T09:35:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:45 smithi079 ceph-mon[27592]: pgmap v247: 65 pgs: 65 active+clean; 154 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T09:35:47.213 INFO:tasks.workunit.client.1.smithi135.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-10T09:35:47.224 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-10T09:35:47.224 INFO:tasks.workunit.client.1.smithi135.stderr:+ make 2024-09-10T09:35:47.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:47 smithi079 ceph-mon[27592]: Upgrade: Updating mgr.smithi135.lbhjof 2024-09-10T09:35:47.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:35:47.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:35:47.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:35:47.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:47 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:35:47.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:47 smithi079 ceph-mon[27592]: Deploying daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:35:47.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:47 smithi135 ceph-mon[33411]: Upgrade: Updating mgr.smithi135.lbhjof 2024-09-10T09:35:47.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:35:47.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:35:47.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:35:47.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:47 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:35:47.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:47 smithi135 ceph-mon[33411]: Deploying daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:35:48.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:48 smithi079 ceph-mon[27592]: pgmap v248: 65 pgs: 65 active+clean; 161 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 478 op/s 2024-09-10T09:35:48.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:48 smithi135 ceph-mon[33411]: pgmap v248: 65 pgs: 65 active+clean; 161 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 5.3 MiB/s wr, 478 op/s 2024-09-10T09:35:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:49 smithi079 ceph-mon[27592]: pgmap v249: 65 pgs: 65 active+clean; 161 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 361 op/s 2024-09-10T09:35:49.865 INFO:tasks.workunit.client.1.smithi135.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-10T09:35:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:49 smithi135 ceph-mon[33411]: pgmap v249: 65 pgs: 65 active+clean; 161 MiB data, 781 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 361 op/s 2024-09-10T09:35:52.142 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:51 smithi135 ceph-mon[33411]: pgmap v250: 65 pgs: 65 active+clean; 184 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 527 op/s 2024-09-10T09:35:52.199 INFO:tasks.workunit.client.1.smithi135.stderr:++ readlink -f fsstress 2024-09-10T09:35:52.199 INFO:tasks.workunit.client.1.smithi135.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-10T09:35:52.200 INFO:tasks.workunit.client.1.smithi135.stderr:+ popd 2024-09-10T09:35:52.200 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-10T09:35:52.200 INFO:tasks.workunit.client.1.smithi135.stderr:+ popd 2024-09-10T09:35:52.200 INFO:tasks.workunit.client.1.smithi135.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-10T09:35:52.201 INFO:tasks.workunit.client.1.smithi135.stderr:++ mktemp -d -p . 2024-09-10T09:35:52.202 INFO:tasks.workunit.client.1.smithi135.stderr:+ T=./tmp.YrXYl0gCxK 2024-09-10T09:35:52.202 INFO:tasks.workunit.client.1.smithi135.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.YrXYl0gCxK -l 1 -n 1000 -p 10 -v 2024-09-10T09:35:52.203 INFO:tasks.workunit.client.1.smithi135.stdout:seed = 1726155261 2024-09-10T09:35:52.205 INFO:tasks.workunit.client.1.smithi135.stdout:0/0: dwrite - no filename 2024-09-10T09:35:52.205 INFO:tasks.workunit.client.1.smithi135.stdout:0/1: link - no file 2024-09-10T09:35:52.205 INFO:tasks.workunit.client.1.smithi135.stdout:0/2: read - no filename 2024-09-10T09:35:52.205 INFO:tasks.workunit.client.1.smithi135.stdout:0/3: unlink - no file 2024-09-10T09:35:52.205 INFO:tasks.workunit.client.1.smithi135.stdout:0/4: unlink - no file 2024-09-10T09:35:52.205 INFO:tasks.workunit.client.1.smithi135.stdout:1/0: dwrite - no filename 2024-09-10T09:35:52.206 INFO:tasks.workunit.client.1.smithi135.stdout:1/1: write - no filename 2024-09-10T09:35:52.206 INFO:tasks.workunit.client.1.smithi135.stdout:1/2: fdatasync - no filename 2024-09-10T09:35:52.206 INFO:tasks.workunit.client.1.smithi135.stdout:1/3: fsync - no filename 2024-09-10T09:35:52.206 INFO:tasks.workunit.client.1.smithi135.stdout:1/4: write - no filename 2024-09-10T09:35:52.206 INFO:tasks.workunit.client.1.smithi135.stdout:1/5: write - no filename 2024-09-10T09:35:52.206 INFO:tasks.workunit.client.1.smithi135.stdout:0/5: creat f0 x:0 0 0 2024-09-10T09:35:52.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/6: creat f1 x:0 0 0 2024-09-10T09:35:52.207 INFO:tasks.workunit.client.1.smithi135.stdout:2/0: rmdir - no directory 2024-09-10T09:35:52.208 INFO:tasks.workunit.client.1.smithi135.stdout:1/6: mknod c0 0 2024-09-10T09:35:52.208 INFO:tasks.workunit.client.1.smithi135.stdout:1/7: dread - no filename 2024-09-10T09:35:52.208 INFO:tasks.workunit.client.1.smithi135.stdout:1/8: dwrite - no filename 2024-09-10T09:35:52.209 INFO:tasks.workunit.client.1.smithi135.stdout:0/7: mknod c2 0 2024-09-10T09:35:52.210 INFO:tasks.workunit.client.1.smithi135.stdout:3/0: rename - no filename 2024-09-10T09:35:52.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:51 smithi079 ceph-mon[27592]: pgmap v250: 65 pgs: 65 active+clean; 184 MiB data, 867 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 527 op/s 2024-09-10T09:35:52.211 INFO:tasks.workunit.client.1.smithi135.stdout:2/1: creat f0 x:0 0 0 2024-09-10T09:35:52.211 INFO:tasks.workunit.client.1.smithi135.stdout:2/2: write f0 [149081,7639] 0 2024-09-10T09:35:52.213 INFO:tasks.workunit.client.1.smithi135.stdout:0/8: rename f0 to f3 0 2024-09-10T09:35:52.213 INFO:tasks.workunit.client.1.smithi135.stdout:0/9: creat f4 x:0 0 0 2024-09-10T09:35:52.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/0: read - no filename 2024-09-10T09:35:52.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/1: fdatasync - no filename 2024-09-10T09:35:52.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/2: write - no filename 2024-09-10T09:35:52.214 INFO:tasks.workunit.client.1.smithi135.stdout:4/3: dread - no filename 2024-09-10T09:35:52.215 INFO:tasks.workunit.client.1.smithi135.stdout:3/1: creat f0 x:0 0 0 2024-09-10T09:35:52.217 INFO:tasks.workunit.client.1.smithi135.stdout:2/3: rename f0 to f1 0 2024-09-10T09:35:52.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/10: symlink l5 0 2024-09-10T09:35:52.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/11: write f1 [584604,3692] 0 2024-09-10T09:35:52.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/12: truncate f4 898056 0 2024-09-10T09:35:52.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/13: creat f6 x:0 0 0 2024-09-10T09:35:52.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/0: stat - no entries 2024-09-10T09:35:52.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/1: unlink - no file 2024-09-10T09:35:52.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/2: rename - no filename 2024-09-10T09:35:52.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/3: dread - no filename 2024-09-10T09:35:52.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/4: readlink - no filename 2024-09-10T09:35:52.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/5: rmdir - no directory 2024-09-10T09:35:52.222 INFO:tasks.workunit.client.1.smithi135.stdout:2/4: dread f1 [0,4194304] 0 2024-09-10T09:35:52.222 INFO:tasks.workunit.client.1.smithi135.stdout:4/4: symlink l0 0 2024-09-10T09:35:52.222 INFO:tasks.workunit.client.1.smithi135.stdout:4/5: dwrite - no filename 2024-09-10T09:35:52.222 INFO:tasks.workunit.client.1.smithi135.stdout:4/6: dread - no filename 2024-09-10T09:35:52.224 INFO:tasks.workunit.client.1.smithi135.stdout:0/14: fdatasync f1 0 2024-09-10T09:35:52.224 INFO:tasks.workunit.client.1.smithi135.stdout:0/15: creat f7 x:0 0 0 2024-09-10T09:35:52.225 INFO:tasks.workunit.client.1.smithi135.stdout:6/0: link - no file 2024-09-10T09:35:52.225 INFO:tasks.workunit.client.1.smithi135.stdout:6/1: write - no filename 2024-09-10T09:35:52.225 INFO:tasks.workunit.client.1.smithi135.stdout:6/2: write - no filename 2024-09-10T09:35:52.225 INFO:tasks.workunit.client.1.smithi135.stdout:6/3: dwrite - no filename 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/7: mkdir d1 0 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/8: chown l0 136 1 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/9: dwrite - no filename 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/10: read - no filename 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/11: fdatasync - no filename 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/12: truncate - no filename 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/13: dread - no filename 2024-09-10T09:35:52.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/14: getdents d1 0 2024-09-10T09:35:52.232 INFO:tasks.workunit.client.1.smithi135.stdout:0/16: unlink l5 0 2024-09-10T09:35:52.233 INFO:tasks.workunit.client.1.smithi135.stdout:0/17: dread f4 [0,4194304] 0 2024-09-10T09:35:52.235 INFO:tasks.workunit.client.1.smithi135.stdout:7/0: unlink - no file 2024-09-10T09:35:52.235 INFO:tasks.workunit.client.1.smithi135.stdout:7/1: truncate - no filename 2024-09-10T09:35:52.235 INFO:tasks.workunit.client.1.smithi135.stdout:7/2: chown . 0 1 2024-09-10T09:35:52.235 INFO:tasks.workunit.client.1.smithi135.stdout:7/3: getdents . 0 2024-09-10T09:35:52.235 INFO:tasks.workunit.client.1.smithi135.stdout:7/4: dwrite - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/5: write - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/6: rename - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/7: rename - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/8: rename - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/9: link - no file 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/10: rename - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/11: truncate - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/12: rename - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/13: chown . 282 1 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/14: rmdir - no directory 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/15: dread - no filename 2024-09-10T09:35:52.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/16: rmdir - no directory 2024-09-10T09:35:52.237 INFO:tasks.workunit.client.1.smithi135.stdout:6/4: symlink l0 0 2024-09-10T09:35:52.237 INFO:tasks.workunit.client.1.smithi135.stdout:6/5: write - no filename 2024-09-10T09:35:52.237 INFO:tasks.workunit.client.1.smithi135.stdout:6/6: write - no filename 2024-09-10T09:35:52.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/15: mkdir d1/d2 0 2024-09-10T09:35:52.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/16: stat d1/d2 0 2024-09-10T09:35:52.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/17: write - no filename 2024-09-10T09:35:52.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/18: fdatasync - no filename 2024-09-10T09:35:52.240 INFO:tasks.workunit.client.1.smithi135.stdout:0/18: mkdir d8 0 2024-09-10T09:35:52.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/17: symlink l0 0 2024-09-10T09:35:52.244 INFO:tasks.workunit.client.1.smithi135.stdout:6/7: mknod c1 0 2024-09-10T09:35:52.244 INFO:tasks.workunit.client.1.smithi135.stdout:6/8: write - no filename 2024-09-10T09:35:52.244 INFO:tasks.workunit.client.1.smithi135.stdout:6/9: dread - no filename 2024-09-10T09:35:52.246 INFO:tasks.workunit.client.1.smithi135.stdout:4/19: creat d1/d2/f3 x:0 0 0 2024-09-10T09:35:52.246 INFO:tasks.workunit.client.1.smithi135.stdout:4/20: dread - d1/d2/f3 zero size 2024-09-10T09:35:52.246 INFO:tasks.workunit.client.1.smithi135.stdout:4/21: dread - d1/d2/f3 zero size 2024-09-10T09:35:52.246 INFO:tasks.workunit.client.1.smithi135.stdout:4/22: truncate d1/d2/f3 5756 0 2024-09-10T09:35:52.247 INFO:tasks.workunit.client.1.smithi135.stdout:0/19: link c2 d8/c9 0 2024-09-10T09:35:52.248 INFO:tasks.workunit.client.1.smithi135.stdout:0/20: read f4 [828709,121985] 0 2024-09-10T09:35:52.249 INFO:tasks.workunit.client.1.smithi135.stdout:9/0: rename - no filename 2024-09-10T09:35:52.250 INFO:tasks.workunit.client.1.smithi135.stdout:8/0: creat f0 x:0 0 0 2024-09-10T09:35:52.250 INFO:tasks.workunit.client.1.smithi135.stdout:8/1: chown f0 708 1 2024-09-10T09:35:52.250 INFO:tasks.workunit.client.1.smithi135.stdout:7/18: creat f1 x:0 0 0 2024-09-10T09:35:52.250 INFO:tasks.workunit.client.1.smithi135.stdout:7/19: write f1 [332771,121990] 0 2024-09-10T09:35:52.378 INFO:tasks.workunit.client.1.smithi135.stdout:9/1: mknod c0 0 2024-09-10T09:35:52.378 INFO:tasks.workunit.client.1.smithi135.stdout:9/2: write - no filename 2024-09-10T09:35:52.378 INFO:tasks.workunit.client.1.smithi135.stdout:9/3: dread - no filename 2024-09-10T09:35:52.378 INFO:tasks.workunit.client.1.smithi135.stdout:9/4: write - no filename 2024-09-10T09:35:52.378 INFO:tasks.workunit.client.1.smithi135.stdout:7/20: mkdir d2 0 2024-09-10T09:35:52.381 INFO:tasks.workunit.client.1.smithi135.stdout:9/5: creat f1 x:0 0 0 2024-09-10T09:35:52.381 INFO:tasks.workunit.client.1.smithi135.stdout:9/6: fdatasync f1 0 2024-09-10T09:35:52.381 INFO:tasks.workunit.client.1.smithi135.stdout:9/7: stat f1 0 2024-09-10T09:35:52.382 INFO:tasks.workunit.client.1.smithi135.stdout:9/8: read - f1 zero size 2024-09-10T09:35:52.382 INFO:tasks.workunit.client.1.smithi135.stdout:9/9: mknod c2 0 2024-09-10T09:35:52.382 INFO:tasks.workunit.client.1.smithi135.stdout:9/10: creat f3 x:0 0 0 2024-09-10T09:35:52.383 INFO:tasks.workunit.client.1.smithi135.stdout:9/11: dread - f1 zero size 2024-09-10T09:35:52.383 INFO:tasks.workunit.client.1.smithi135.stdout:9/12: chown f3 411331424 1 2024-09-10T09:35:52.383 INFO:tasks.workunit.client.1.smithi135.stdout:9/13: chown c0 9326749 1 2024-09-10T09:35:52.384 INFO:tasks.workunit.client.1.smithi135.stdout:9/14: truncate f3 371583 0 2024-09-10T09:35:52.407 INFO:tasks.workunit.client.1.smithi135.stdout:8/2: dwrite f0 [0,4194304] 0 2024-09-10T09:35:52.407 INFO:tasks.workunit.client.1.smithi135.stdout:8/3: fdatasync f0 0 2024-09-10T09:35:52.407 INFO:tasks.workunit.client.1.smithi135.stdout:8/4: rmdir - no directory 2024-09-10T09:35:52.410 INFO:tasks.workunit.client.1.smithi135.stdout:7/21: dread f1 [0,4194304] 0 2024-09-10T09:35:52.411 INFO:tasks.workunit.client.1.smithi135.stdout:7/22: mkdir d2/d3 0 2024-09-10T09:35:52.411 INFO:tasks.workunit.client.1.smithi135.stdout:7/23: chown d2/d3 42873 1 2024-09-10T09:35:52.412 INFO:tasks.workunit.client.1.smithi135.stdout:7/24: dread f1 [0,4194304] 0 2024-09-10T09:35:52.426 INFO:tasks.workunit.client.1.smithi135.stdout:7/25: dwrite f1 [0,4194304] 0 2024-09-10T09:35:52.426 INFO:tasks.workunit.client.1.smithi135.stdout:7/26: chown l0 0 1 2024-09-10T09:35:52.427 INFO:tasks.workunit.client.1.smithi135.stdout:7/27: creat d2/f4 x:0 0 0 2024-09-10T09:35:52.441 INFO:tasks.workunit.client.1.smithi135.stdout:7/28: dwrite d2/f4 [0,4194304] 0 2024-09-10T09:35:52.444 INFO:tasks.workunit.client.1.smithi135.stdout:7/29: creat d2/d3/f5 x:0 0 0 2024-09-10T09:35:52.592 INFO:tasks.workunit.client.1.smithi135.stdout:1/9: getdents . 0 2024-09-10T09:35:52.594 INFO:tasks.workunit.client.1.smithi135.stdout:1/10: symlink l1 0 2024-09-10T09:35:52.594 INFO:tasks.workunit.client.1.smithi135.stdout:1/11: truncate - no filename 2024-09-10T09:35:52.594 INFO:tasks.workunit.client.1.smithi135.stdout:1/12: dread - no filename 2024-09-10T09:35:52.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/2: fsync f0 0 2024-09-10T09:35:52.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/3: truncate f0 940979 0 2024-09-10T09:35:52.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/4: rmdir - no directory 2024-09-10T09:35:52.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/5: chown f0 29753675 1 2024-09-10T09:35:52.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/6: creat f1 x:0 0 0 2024-09-10T09:35:52.598 INFO:tasks.workunit.client.1.smithi135.stdout:2/5: getdents . 0 2024-09-10T09:35:52.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/7: dread f0 [0,4194304] 0 2024-09-10T09:35:52.603 INFO:tasks.workunit.client.1.smithi135.stdout:1/13: link c0 c2 0 2024-09-10T09:35:52.603 INFO:tasks.workunit.client.1.smithi135.stdout:1/14: readlink l1 0 2024-09-10T09:35:52.605 INFO:tasks.workunit.client.1.smithi135.stdout:2/6: rename f1 to f2 0 2024-09-10T09:35:52.617 INFO:tasks.workunit.client.1.smithi135.stdout:3/8: dwrite f0 [0,4194304] 0 2024-09-10T09:35:52.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/10: getdents . 0 2024-09-10T09:35:52.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/11: write - no filename 2024-09-10T09:35:52.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/12: write - no filename 2024-09-10T09:35:52.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/13: dread - no filename 2024-09-10T09:35:52.619 INFO:tasks.workunit.client.1.smithi135.stdout:6/14: readlink l0 0 2024-09-10T09:35:52.619 INFO:tasks.workunit.client.1.smithi135.stdout:6/15: write - no filename 2024-09-10T09:35:52.620 INFO:tasks.workunit.client.1.smithi135.stdout:4/23: getdents d1/d2 0 2024-09-10T09:35:52.620 INFO:tasks.workunit.client.1.smithi135.stdout:4/24: write d1/d2/f3 [1044607,19933] 0 2024-09-10T09:35:52.621 INFO:tasks.workunit.client.1.smithi135.stdout:0/21: getdents d8 0 2024-09-10T09:35:52.626 INFO:tasks.workunit.client.1.smithi135.stdout:4/25: dread d1/d2/f3 [0,4194304] 0 2024-09-10T09:35:52.627 INFO:tasks.workunit.client.1.smithi135.stdout:6/16: mknod c2 0 2024-09-10T09:35:52.628 INFO:tasks.workunit.client.1.smithi135.stdout:9/15: fsync f1 0 2024-09-10T09:35:52.629 INFO:tasks.workunit.client.1.smithi135.stdout:0/22: mknod d8/ca 0 2024-09-10T09:35:52.630 INFO:tasks.workunit.client.1.smithi135.stdout:4/26: symlink d1/l4 0 2024-09-10T09:35:52.632 INFO:tasks.workunit.client.1.smithi135.stdout:6/17: chown c1 1774634 1 2024-09-10T09:35:52.633 INFO:tasks.workunit.client.1.smithi135.stdout:4/27: dread d1/d2/f3 [0,4194304] 0 2024-09-10T09:35:52.633 INFO:tasks.workunit.client.1.smithi135.stdout:4/28: readlink l0 0 2024-09-10T09:35:52.633 INFO:tasks.workunit.client.1.smithi135.stdout:4/29: chown d1/d2 50741 1 2024-09-10T09:35:52.633 INFO:tasks.workunit.client.1.smithi135.stdout:4/30: chown d1/l4 84282459 1 2024-09-10T09:35:52.633 INFO:tasks.workunit.client.1.smithi135.stdout:7/30: write d2/f4 [4962728,3870] 0 2024-09-10T09:35:52.635 INFO:tasks.workunit.client.1.smithi135.stdout:0/23: creat d8/fb x:0 0 0 2024-09-10T09:35:52.635 INFO:tasks.workunit.client.1.smithi135.stdout:0/24: dread - f6 zero size 2024-09-10T09:35:52.635 INFO:tasks.workunit.client.1.smithi135.stdout:0/25: fdatasync f7 0 2024-09-10T09:35:52.635 INFO:tasks.workunit.client.1.smithi135.stdout:0/26: readlink - no filename 2024-09-10T09:35:52.636 INFO:tasks.workunit.client.1.smithi135.stdout:6/18: creat f3 x:0 0 0 2024-09-10T09:35:52.641 INFO:tasks.workunit.client.1.smithi135.stdout:4/31: rename l0 to d1/l5 0 2024-09-10T09:35:52.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/31: read f1 [3273303,20452] 0 2024-09-10T09:35:52.644 INFO:tasks.workunit.client.1.smithi135.stdout:9/16: rename f3 to f4 0 2024-09-10T09:35:52.656 INFO:tasks.workunit.client.1.smithi135.stdout:0/27: dwrite f3 [0,4194304] 0 2024-09-10T09:35:52.657 INFO:tasks.workunit.client.1.smithi135.stdout:9/17: symlink l5 0 2024-09-10T09:35:52.657 INFO:tasks.workunit.client.1.smithi135.stdout:9/18: truncate f4 887031 0 2024-09-10T09:35:52.657 INFO:tasks.workunit.client.1.smithi135.stdout:9/19: readlink l5 0 2024-09-10T09:35:52.657 INFO:tasks.workunit.client.1.smithi135.stdout:9/20: fdatasync f1 0 2024-09-10T09:35:52.658 INFO:tasks.workunit.client.1.smithi135.stdout:9/21: stat f4 0 2024-09-10T09:35:52.659 INFO:tasks.workunit.client.1.smithi135.stdout:0/28: dread f1 [0,4194304] 0 2024-09-10T09:35:52.659 INFO:tasks.workunit.client.1.smithi135.stdout:0/29: readlink - no filename 2024-09-10T09:35:52.661 INFO:tasks.workunit.client.1.smithi135.stdout:6/19: unlink l0 0 2024-09-10T09:35:52.661 INFO:tasks.workunit.client.1.smithi135.stdout:6/20: truncate f3 222510 0 2024-09-10T09:35:52.667 INFO:tasks.workunit.client.1.smithi135.stdout:6/21: creat f4 x:0 0 0 2024-09-10T09:35:52.667 INFO:tasks.workunit.client.1.smithi135.stdout:6/22: write f4 [138263,7468] 0 2024-09-10T09:35:52.674 INFO:tasks.workunit.client.1.smithi135.stdout:7/32: dwrite d2/f4 [0,4194304] 0 2024-09-10T09:35:52.674 INFO:tasks.workunit.client.1.smithi135.stdout:4/32: dwrite d1/d2/f3 [0,4194304] 0 2024-09-10T09:35:52.676 INFO:tasks.workunit.client.1.smithi135.stdout:7/33: symlink d2/l6 0 2024-09-10T09:35:52.678 INFO:tasks.workunit.client.1.smithi135.stdout:9/22: dwrite f4 [0,4194304] 0 2024-09-10T09:35:52.678 INFO:tasks.workunit.client.1.smithi135.stdout:4/33: creat d1/d2/f6 x:0 0 0 2024-09-10T09:35:52.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/23: dread f4 [0,4194304] 0 2024-09-10T09:35:52.680 INFO:tasks.workunit.client.1.smithi135.stdout:7/34: symlink d2/d3/l7 0 2024-09-10T09:35:52.680 INFO:tasks.workunit.client.1.smithi135.stdout:7/35: fsync f1 0 2024-09-10T09:35:52.680 INFO:tasks.workunit.client.1.smithi135.stdout:7/36: write d2/f4 [5424331,99810] 0 2024-09-10T09:35:52.685 INFO:tasks.workunit.client.1.smithi135.stdout:7/37: dread f1 [0,4194304] 0 2024-09-10T09:35:52.685 INFO:tasks.workunit.client.1.smithi135.stdout:7/38: read - d2/d3/f5 zero size 2024-09-10T09:35:52.685 INFO:tasks.workunit.client.1.smithi135.stdout:9/23: rename f1 to f6 0 2024-09-10T09:35:52.694 INFO:tasks.workunit.client.1.smithi135.stdout:6/24: mkdir d5 0 2024-09-10T09:35:52.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/25: creat d5/f6 x:0 0 0 2024-09-10T09:35:52.699 INFO:tasks.workunit.client.1.smithi135.stdout:6/26: link d5/f6 d5/f7 0 2024-09-10T09:35:52.701 INFO:tasks.workunit.client.1.smithi135.stdout:6/27: link c1 d5/c8 0 2024-09-10T09:35:52.739 INFO:tasks.workunit.client.1.smithi135.stdout:6/28: symlink d5/l9 0 2024-09-10T09:35:52.739 INFO:tasks.workunit.client.1.smithi135.stdout:6/29: readlink d5/l9 0 2024-09-10T09:35:52.740 INFO:tasks.workunit.client.1.smithi135.stdout:6/30: mknod d5/ca 0 2024-09-10T09:35:52.740 INFO:tasks.workunit.client.1.smithi135.stdout:6/31: rename d5 to d5/db 22 2024-09-10T09:35:52.758 INFO:tasks.workunit.client.1.smithi135.stdout:6/32: dwrite f3 [0,4194304] 0 2024-09-10T09:35:52.758 INFO:tasks.workunit.client.1.smithi135.stdout:6/33: creat d5/fc x:0 0 0 2024-09-10T09:35:52.777 INFO:tasks.workunit.client.1.smithi135.stdout:6/34: dwrite d5/f7 [0,4194304] 0 2024-09-10T09:35:52.825 INFO:tasks.workunit.client.1.smithi135.stdout:1/15: getdents . 0 2024-09-10T09:35:52.825 INFO:tasks.workunit.client.1.smithi135.stdout:1/16: dwrite - no filename 2024-09-10T09:35:52.826 INFO:tasks.workunit.client.1.smithi135.stdout:2/7: getdents . 0 2024-09-10T09:35:52.827 INFO:tasks.workunit.client.1.smithi135.stdout:1/17: creat f3 x:0 0 0 2024-09-10T09:35:52.829 INFO:tasks.workunit.client.1.smithi135.stdout:2/8: unlink f2 0 2024-09-10T09:35:52.830 INFO:tasks.workunit.client.1.smithi135.stdout:1/18: creat f4 x:0 0 0 2024-09-10T09:35:52.830 INFO:tasks.workunit.client.1.smithi135.stdout:1/19: fdatasync f4 0 2024-09-10T09:35:52.834 INFO:tasks.workunit.client.1.smithi135.stdout:1/20: unlink c2 0 2024-09-10T09:35:52.834 INFO:tasks.workunit.client.1.smithi135.stdout:1/21: write f3 [515450,84548] 0 2024-09-10T09:35:52.834 INFO:tasks.workunit.client.1.smithi135.stdout:1/22: dread - f4 zero size 2024-09-10T09:35:52.849 INFO:tasks.workunit.client.1.smithi135.stdout:6/35: fsync f3 0 2024-09-10T09:35:52.865 INFO:tasks.workunit.client.1.smithi135.stdout:6/36: dwrite f3 [0,4194304] 0 2024-09-10T09:35:52.866 INFO:tasks.workunit.client.1.smithi135.stdout:6/37: mkdir d5/dd 0 2024-09-10T09:35:52.878 INFO:tasks.workunit.client.1.smithi135.stdout:0/30: dwrite f3 [4194304,4194304] 0 2024-09-10T09:35:52.878 INFO:tasks.workunit.client.1.smithi135.stdout:0/31: fsync f3 0 2024-09-10T09:35:52.878 INFO:tasks.workunit.client.1.smithi135.stdout:0/32: chown f7 30 1 2024-09-10T09:35:52.878 INFO:tasks.workunit.client.1.smithi135.stdout:4/34: rename d1/d2 to d1/d7 0 2024-09-10T09:35:52.884 INFO:tasks.workunit.client.1.smithi135.stdout:4/35: creat d1/d7/f8 x:0 0 0 2024-09-10T09:35:52.887 INFO:tasks.workunit.client.1.smithi135.stdout:0/33: rename f1 to d8/fc 0 2024-09-10T09:35:52.888 INFO:tasks.workunit.client.1.smithi135.stdout:4/36: mkdir d1/d7/d9 0 2024-09-10T09:35:52.888 INFO:tasks.workunit.client.1.smithi135.stdout:4/37: fsync d1/d7/f3 0 2024-09-10T09:35:52.891 INFO:tasks.workunit.client.1.smithi135.stdout:0/34: unlink f3 0 2024-09-10T09:35:52.891 INFO:tasks.workunit.client.1.smithi135.stdout:0/35: chown f4 812 1 2024-09-10T09:35:52.891 INFO:tasks.workunit.client.1.smithi135.stdout:0/36: read - f7 zero size 2024-09-10T09:35:52.891 INFO:tasks.workunit.client.1.smithi135.stdout:0/37: fsync f6 0 2024-09-10T09:35:52.891 INFO:tasks.workunit.client.1.smithi135.stdout:7/39: truncate d2/f4 2374811 0 2024-09-10T09:35:52.896 INFO:tasks.workunit.client.1.smithi135.stdout:9/24: dwrite f4 [4194304,4194304] 0 2024-09-10T09:35:52.896 INFO:tasks.workunit.client.1.smithi135.stdout:9/25: chown f4 9 1 2024-09-10T09:35:52.907 INFO:tasks.workunit.client.1.smithi135.stdout:9/26: getdents . 0 2024-09-10T09:35:52.907 INFO:tasks.workunit.client.1.smithi135.stdout:9/27: readlink l5 0 2024-09-10T09:35:52.907 INFO:tasks.workunit.client.1.smithi135.stdout:9/28: fsync f4 0 2024-09-10T09:35:52.911 INFO:tasks.workunit.client.1.smithi135.stdout:9/29: creat f7 x:0 0 0 2024-09-10T09:35:52.911 INFO:tasks.workunit.client.1.smithi135.stdout:9/30: dread - f7 zero size 2024-09-10T09:35:52.911 INFO:tasks.workunit.client.1.smithi135.stdout:9/31: rmdir - no directory 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:0/38: dwrite f4 [0,4194304] 0 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:4/38: dwrite d1/d7/f8 [0,4194304] 0 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:0/39: read - d8/fb zero size 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:4/39: chown d1/l5 3989272 1 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:6/38: truncate d5/f7 2719164 0 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:6/39: stat f3 0 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:6/40: chown d5/fc 14158104 1 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:6/41: getdents d5/dd 0 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:6/42: readlink d5/l9 0 2024-09-10T09:35:52.918 INFO:tasks.workunit.client.1.smithi135.stdout:9/32: link c0 c8 0 2024-09-10T09:35:52.929 INFO:tasks.workunit.client.1.smithi135.stdout:6/43: symlink d5/le 0 2024-09-10T09:35:52.939 INFO:tasks.workunit.client.1.smithi135.stdout:9/33: write f4 [5815890,48791] 0 2024-09-10T09:35:52.944 INFO:tasks.workunit.client.1.smithi135.stdout:9/34: rename f7 to f9 0 2024-09-10T09:35:52.955 INFO:tasks.workunit.client.1.smithi135.stdout:1/23: truncate f3 286050 0 2024-09-10T09:35:52.955 INFO:tasks.workunit.client.1.smithi135.stdout:1/24: dread - f4 zero size 2024-09-10T09:35:52.955 INFO:tasks.workunit.client.1.smithi135.stdout:1/25: write f4 [592743,124029] 0 2024-09-10T09:35:52.989 INFO:tasks.workunit.client.1.smithi135.stdout:0/40: rmdir d8 39 2024-09-10T09:35:52.989 INFO:tasks.workunit.client.1.smithi135.stdout:0/41: readlink - no filename 2024-09-10T09:35:52.994 INFO:tasks.workunit.client.1.smithi135.stdout:7/40: rmdir d2 39 2024-09-10T09:35:52.994 INFO:tasks.workunit.client.1.smithi135.stdout:7/41: readlink d2/d3/l7 0 2024-09-10T09:35:52.995 INFO:tasks.workunit.client.1.smithi135.stdout:7/42: write f1 [3961931,27006] 0 2024-09-10T09:35:52.996 INFO:tasks.workunit.client.1.smithi135.stdout:4/40: truncate d1/d7/f3 1847812 0 2024-09-10T09:35:52.998 INFO:tasks.workunit.client.1.smithi135.stdout:7/43: rename d2/d3/f5 to d2/f8 0 2024-09-10T09:35:52.999 INFO:tasks.workunit.client.1.smithi135.stdout:4/41: read d1/d7/f8 [1056603,2389] 0 2024-09-10T09:35:52.999 INFO:tasks.workunit.client.1.smithi135.stdout:4/42: chown d1 17 1 2024-09-10T09:35:53.001 INFO:tasks.workunit.client.1.smithi135.stdout:7/44: symlink d2/l9 0 2024-09-10T09:35:53.019 INFO:tasks.workunit.client.1.smithi135.stdout:0/42: truncate f4 2003720 0 2024-09-10T09:35:53.023 INFO:tasks.workunit.client.1.smithi135.stdout:0/43: mkdir d8/dd 0 2024-09-10T09:35:53.026 INFO:tasks.workunit.client.1.smithi135.stdout:7/45: dwrite d2/f8 [0,4194304] 0 2024-09-10T09:35:53.027 INFO:tasks.workunit.client.1.smithi135.stdout:7/46: write d2/f4 [2718273,90271] 0 2024-09-10T09:35:53.027 INFO:tasks.workunit.client.1.smithi135.stdout:0/44: mkdir d8/de 0 2024-09-10T09:35:53.031 INFO:tasks.workunit.client.1.smithi135.stdout:7/47: write d2/f4 [218545,121472] 0 2024-09-10T09:35:53.036 INFO:tasks.workunit.client.1.smithi135.stdout:0/45: rename c2 to d8/de/cf 0 2024-09-10T09:35:53.049 INFO:tasks.workunit.client.1.smithi135.stdout:7/48: dwrite f1 [4194304,4194304] 0 2024-09-10T09:35:53.054 INFO:tasks.workunit.client.1.smithi135.stdout:7/49: mknod d2/ca 0 2024-09-10T09:35:53.056 INFO:tasks.workunit.client.1.smithi135.stdout:0/46: dwrite d8/fb [0,4194304] 0 2024-09-10T09:35:53.057 INFO:tasks.workunit.client.1.smithi135.stdout:0/47: read d8/fc [568087,2350] 0 2024-09-10T09:35:53.062 INFO:tasks.workunit.client.1.smithi135.stdout:0/48: creat d8/dd/f10 x:0 0 0 2024-09-10T09:35:53.065 INFO:tasks.workunit.client.1.smithi135.stdout:0/49: mkdir d8/dd/d11 0 2024-09-10T09:35:53.089 INFO:tasks.workunit.client.1.smithi135.stdout:7/50: dwrite d2/f8 [0,4194304] 0 2024-09-10T09:35:53.089 INFO:tasks.workunit.client.1.smithi135.stdout:0/50: dwrite d8/fc [0,4194304] 0 2024-09-10T09:35:53.096 INFO:tasks.workunit.client.1.smithi135.stdout:0/51: symlink d8/l12 0 2024-09-10T09:35:53.096 INFO:tasks.workunit.client.1.smithi135.stdout:0/52: readlink d8/l12 0 2024-09-10T09:35:53.096 INFO:tasks.workunit.client.1.smithi135.stdout:0/53: creat d8/dd/f13 x:0 0 0 2024-09-10T09:35:53.106 INFO:tasks.workunit.client.1.smithi135.stdout:4/43: unlink d1/d7/f3 0 2024-09-10T09:35:53.109 INFO:tasks.workunit.client.1.smithi135.stdout:4/44: link d1/l4 d1/d7/la 0 2024-09-10T09:35:53.195 INFO:tasks.workunit.client.1.smithi135.stdout:7/51: truncate f1 4676950 0 2024-09-10T09:35:53.197 INFO:tasks.workunit.client.1.smithi135.stdout:7/52: mknod d2/cb 0 2024-09-10T09:35:53.198 INFO:tasks.workunit.client.1.smithi135.stdout:0/54: getdents d8/dd 0 2024-09-10T09:35:53.198 INFO:tasks.workunit.client.1.smithi135.stdout:0/55: fsync d8/dd/f10 0 2024-09-10T09:35:53.200 INFO:tasks.workunit.client.1.smithi135.stdout:7/53: symlink d2/lc 0 2024-09-10T09:35:53.202 INFO:tasks.workunit.client.1.smithi135.stdout:0/56: symlink d8/dd/d11/l14 0 2024-09-10T09:35:53.203 INFO:tasks.workunit.client.1.smithi135.stdout:7/54: rmdir d2/d3 39 2024-09-10T09:35:53.208 INFO:tasks.workunit.client.1.smithi135.stdout:7/55: mknod d2/d3/cd 0 2024-09-10T09:35:53.209 INFO:tasks.workunit.client.1.smithi135.stdout:7/56: chown d2/l9 1860144 1 2024-09-10T09:35:53.210 INFO:tasks.workunit.client.1.smithi135.stdout:4/45: rename d1/d7 to d1/db 0 2024-09-10T09:35:53.212 INFO:tasks.workunit.client.1.smithi135.stdout:7/57: creat d2/d3/fe x:0 0 0 2024-09-10T09:35:53.212 INFO:tasks.workunit.client.1.smithi135.stdout:7/58: fdatasync f1 0 2024-09-10T09:35:53.213 INFO:tasks.workunit.client.1.smithi135.stdout:4/46: mkdir d1/db/dc 0 2024-09-10T09:35:53.215 INFO:tasks.workunit.client.1.smithi135.stdout:6/44: truncate d5/f6 519202 0 2024-09-10T09:35:53.241 INFO:tasks.workunit.client.1.smithi135.stdout:4/47: dwrite d1/db/f8 [0,4194304] 0 2024-09-10T09:35:53.241 INFO:tasks.workunit.client.1.smithi135.stdout:4/48: fdatasync d1/db/f8 0 2024-09-10T09:35:53.241 INFO:tasks.workunit.client.1.smithi135.stdout:6/45: dwrite d5/fc [0,4194304] 0 2024-09-10T09:35:53.244 INFO:tasks.workunit.client.1.smithi135.stdout:4/49: symlink d1/db/dc/ld 0 2024-09-10T09:35:53.245 INFO:tasks.workunit.client.1.smithi135.stdout:4/50: dread - d1/db/f6 zero size 2024-09-10T09:35:53.245 INFO:tasks.workunit.client.1.smithi135.stdout:4/51: dread - d1/db/f6 zero size 2024-09-10T09:35:53.245 INFO:tasks.workunit.client.1.smithi135.stdout:4/52: truncate d1/db/f6 989557 0 2024-09-10T09:35:53.245 INFO:tasks.workunit.client.1.smithi135.stdout:4/53: chown d1/db/dc/ld 1493658 1 2024-09-10T09:35:53.253 INFO:tasks.workunit.client.1.smithi135.stdout:4/54: write d1/db/f8 [3059971,37574] 0 2024-09-10T09:35:53.253 INFO:tasks.workunit.client.1.smithi135.stdout:4/55: chown d1/db/d9 2 1 2024-09-10T09:35:53.253 INFO:tasks.workunit.client.1.smithi135.stdout:4/56: truncate d1/db/f8 4776137 0 2024-09-10T09:35:53.255 INFO:tasks.workunit.client.1.smithi135.stdout:6/46: write f3 [1451244,103037] 0 2024-09-10T09:35:53.256 INFO:tasks.workunit.client.1.smithi135.stdout:6/47: fsync f4 0 2024-09-10T09:35:53.256 INFO:tasks.workunit.client.1.smithi135.stdout:4/57: fsync d1/db/f8 0 2024-09-10T09:35:53.256 INFO:tasks.workunit.client.1.smithi135.stdout:4/58: fsync d1/db/f8 0 2024-09-10T09:35:53.266 INFO:tasks.workunit.client.1.smithi135.stdout:6/48: getdents d5 0 2024-09-10T09:35:53.267 INFO:tasks.workunit.client.1.smithi135.stdout:6/49: dread f4 [0,4194304] 0 2024-09-10T09:35:53.267 INFO:tasks.workunit.client.1.smithi135.stdout:6/50: chown d5/l9 21 1 2024-09-10T09:35:53.273 INFO:tasks.workunit.client.1.smithi135.stdout:7/59: read f1 [1289446,43212] 0 2024-09-10T09:35:53.273 INFO:tasks.workunit.client.1.smithi135.stdout:7/60: chown d2/l9 0 1 2024-09-10T09:35:53.273 INFO:tasks.workunit.client.1.smithi135.stdout:7/61: chown d2 47819141 1 2024-09-10T09:35:53.275 INFO:tasks.workunit.client.1.smithi135.stdout:6/51: dread d5/fc [0,4194304] 0 2024-09-10T09:35:53.277 INFO:tasks.workunit.client.1.smithi135.stdout:7/62: creat d2/ff x:0 0 0 2024-09-10T09:35:53.280 INFO:tasks.workunit.client.1.smithi135.stdout:6/52: dread d5/fc [0,4194304] 0 2024-09-10T09:35:53.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/53: creat d5/ff x:0 0 0 2024-09-10T09:35:53.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/54: creat d5/f10 x:0 0 0 2024-09-10T09:35:53.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/55: dread - d5/ff zero size 2024-09-10T09:35:53.284 INFO:tasks.workunit.client.1.smithi135.stdout:0/57: getdents d8/dd/d11 0 2024-09-10T09:35:53.289 INFO:tasks.workunit.client.1.smithi135.stdout:6/56: dread d5/fc [0,4194304] 0 2024-09-10T09:35:53.289 INFO:tasks.workunit.client.1.smithi135.stdout:6/57: creat d5/f11 x:0 0 0 2024-09-10T09:35:53.290 INFO:tasks.workunit.client.1.smithi135.stdout:0/58: creat d8/f15 x:0 0 0 2024-09-10T09:35:53.290 INFO:tasks.workunit.client.1.smithi135.stdout:0/59: dread - d8/dd/f13 zero size 2024-09-10T09:35:53.296 INFO:tasks.workunit.client.1.smithi135.stdout:0/60: dread f4 [0,4194304] 0 2024-09-10T09:35:53.296 INFO:tasks.workunit.client.1.smithi135.stdout:0/61: chown f4 0 1 2024-09-10T09:35:53.296 INFO:tasks.workunit.client.1.smithi135.stdout:0/62: stat f4 0 2024-09-10T09:35:53.296 INFO:tasks.workunit.client.1.smithi135.stdout:0/63: stat d8/ca 0 2024-09-10T09:35:53.298 INFO:tasks.workunit.client.1.smithi135.stdout:7/63: dwrite d2/f4 [0,4194304] 0 2024-09-10T09:35:53.312 INFO:tasks.workunit.client.1.smithi135.stdout:0/64: dwrite f6 [0,4194304] 0 2024-09-10T09:35:53.318 INFO:tasks.workunit.client.1.smithi135.stdout:0/65: rename d8/ca to d8/c16 0 2024-09-10T09:35:53.325 INFO:tasks.workunit.client.1.smithi135.stdout:4/59: rename d1/db/dc to d1/de 0 2024-09-10T09:35:53.329 INFO:tasks.workunit.client.1.smithi135.stdout:4/60: unlink d1/de/ld 0 2024-09-10T09:35:53.330 INFO:tasks.workunit.client.1.smithi135.stdout:4/61: read d1/db/f8 [4459087,95688] 0 2024-09-10T09:35:53.330 INFO:tasks.workunit.client.1.smithi135.stdout:4/62: chown d1/db/f6 2 1 2024-09-10T09:35:53.332 INFO:tasks.workunit.client.1.smithi135.stdout:4/63: creat d1/db/ff x:0 0 0 2024-09-10T09:35:53.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/64: truncate d1/db/f8 4054904 0 2024-09-10T09:35:53.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/65: truncate d1/db/ff 126090 0 2024-09-10T09:35:53.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/66: chown d1/l4 1363 1 2024-09-10T09:35:53.344 INFO:tasks.workunit.client.1.smithi135.stdout:4/67: symlink d1/db/d9/l10 0 2024-09-10T09:35:53.344 INFO:tasks.workunit.client.1.smithi135.stdout:4/68: fdatasync d1/db/ff 0 2024-09-10T09:35:53.346 INFO:tasks.workunit.client.1.smithi135.stdout:4/69: mkdir d1/d11 0 2024-09-10T09:35:53.349 INFO:tasks.workunit.client.1.smithi135.stdout:4/70: rmdir d1/d11 0 2024-09-10T09:35:53.353 INFO:tasks.workunit.client.1.smithi135.stdout:7/64: rmdir d2 39 2024-09-10T09:35:53.358 INFO:tasks.workunit.client.1.smithi135.stdout:7/65: dread f1 [0,4194304] 0 2024-09-10T09:35:53.359 INFO:tasks.workunit.client.1.smithi135.stdout:7/66: getdents d2 0 2024-09-10T09:35:53.362 INFO:tasks.workunit.client.1.smithi135.stdout:7/67: creat d2/f10 x:0 0 0 2024-09-10T09:35:53.362 INFO:tasks.workunit.client.1.smithi135.stdout:7/68: truncate d2/f10 744266 0 2024-09-10T09:35:53.364 INFO:tasks.workunit.client.1.smithi135.stdout:7/69: stat d2/ca 0 2024-09-10T09:35:53.366 INFO:tasks.workunit.client.1.smithi135.stdout:7/70: mkdir d2/d11 0 2024-09-10T09:35:53.375 INFO:tasks.workunit.client.1.smithi135.stdout:7/71: write d2/f4 [862660,86137] 0 2024-09-10T09:35:53.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/66: truncate f6 2178651 0 2024-09-10T09:35:53.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/67: chown d8/de 28421856 1 2024-09-10T09:35:53.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/68: chown d8/dd/d11 1 1 2024-09-10T09:35:53.381 INFO:tasks.workunit.client.1.smithi135.stdout:0/69: mkdir d8/dd/d11/d17 0 2024-09-10T09:35:53.381 INFO:tasks.workunit.client.1.smithi135.stdout:0/70: write d8/dd/f10 [408046,19566] 0 2024-09-10T09:35:53.382 INFO:tasks.workunit.client.1.smithi135.stdout:7/72: creat d2/d3/f12 x:0 0 0 2024-09-10T09:35:53.384 INFO:tasks.workunit.client.1.smithi135.stdout:0/71: write f4 [701092,91021] 0 2024-09-10T09:35:53.384 INFO:tasks.workunit.client.1.smithi135.stdout:0/72: write f4 [250062,73751] 0 2024-09-10T09:35:53.384 INFO:tasks.workunit.client.1.smithi135.stdout:0/73: chown d8/l12 1734 1 2024-09-10T09:35:53.385 INFO:tasks.workunit.client.1.smithi135.stdout:0/74: chown f7 517001 1 2024-09-10T09:35:53.394 INFO:tasks.workunit.client.1.smithi135.stdout:4/71: getdents d1/db 0 2024-09-10T09:35:53.396 INFO:tasks.workunit.client.1.smithi135.stdout:4/72: rename d1/l4 to d1/l12 0 2024-09-10T09:35:53.398 INFO:tasks.workunit.client.1.smithi135.stdout:4/73: creat d1/de/f13 x:0 0 0 2024-09-10T09:35:53.398 INFO:tasks.workunit.client.1.smithi135.stdout:4/74: rename d1/db to d1/db/d9/d14 22 2024-09-10T09:35:53.405 INFO:tasks.workunit.client.1.smithi135.stdout:6/58: truncate d5/f6 513882 0 2024-09-10T09:35:53.406 INFO:tasks.workunit.client.1.smithi135.stdout:7/73: dwrite d2/f8 [4194304,4194304] 0 2024-09-10T09:35:53.410 INFO:tasks.workunit.client.1.smithi135.stdout:4/75: dread d1/db/f8 [0,4194304] 0 2024-09-10T09:35:53.410 INFO:tasks.workunit.client.1.smithi135.stdout:6/59: unlink d5/le 0 2024-09-10T09:35:53.411 INFO:tasks.workunit.client.1.smithi135.stdout:6/60: chown d5/l9 30 1 2024-09-10T09:35:53.415 INFO:tasks.workunit.client.1.smithi135.stdout:4/76: link d1/db/f8 d1/db/d9/f15 0 2024-09-10T09:35:53.417 INFO:tasks.workunit.client.1.smithi135.stdout:7/74: rename f1 to d2/f13 0 2024-09-10T09:35:53.419 INFO:tasks.workunit.client.1.smithi135.stdout:4/77: mkdir d1/de/d16 0 2024-09-10T09:35:53.421 INFO:tasks.workunit.client.1.smithi135.stdout:7/75: creat d2/d11/f14 x:0 0 0 2024-09-10T09:35:53.421 INFO:tasks.workunit.client.1.smithi135.stdout:7/76: chown l0 618 1 2024-09-10T09:35:53.425 INFO:tasks.workunit.client.1.smithi135.stdout:4/78: dread d1/db/f8 [0,4194304] 0 2024-09-10T09:35:53.425 INFO:tasks.workunit.client.1.smithi135.stdout:4/79: rename d1/db to d1/db/d9/d17 22 2024-09-10T09:35:53.425 INFO:tasks.workunit.client.1.smithi135.stdout:4/80: fdatasync d1/db/d9/f15 0 2024-09-10T09:35:53.428 INFO:tasks.workunit.client.1.smithi135.stdout:4/81: symlink d1/db/d9/l18 0 2024-09-10T09:35:53.428 INFO:tasks.workunit.client.1.smithi135.stdout:4/82: fsync d1/db/ff 0 2024-09-10T09:35:53.428 INFO:tasks.workunit.client.1.smithi135.stdout:4/83: write d1/db/f6 [1496963,38330] 0 2024-09-10T09:35:53.436 INFO:tasks.workunit.client.1.smithi135.stdout:6/61: dwrite d5/f11 [0,4194304] 0 2024-09-10T09:35:53.436 INFO:tasks.workunit.client.1.smithi135.stdout:6/62: fdatasync f4 0 2024-09-10T09:35:53.440 INFO:tasks.workunit.client.1.smithi135.stdout:6/63: mkdir d5/d12 0 2024-09-10T09:35:53.442 INFO:tasks.workunit.client.1.smithi135.stdout:6/64: mknod d5/d12/c13 0 2024-09-10T09:35:53.443 INFO:tasks.workunit.client.1.smithi135.stdout:6/65: dread f4 [0,4194304] 0 2024-09-10T09:35:53.446 INFO:tasks.workunit.client.1.smithi135.stdout:6/66: symlink d5/dd/l14 0 2024-09-10T09:35:53.446 INFO:tasks.workunit.client.1.smithi135.stdout:6/67: read f4 [16516,88741] 0 2024-09-10T09:35:53.446 INFO:tasks.workunit.client.1.smithi135.stdout:6/68: fdatasync d5/f7 0 2024-09-10T09:35:53.447 INFO:tasks.workunit.client.1.smithi135.stdout:7/77: rmdir d2/d3 39 2024-09-10T09:35:53.448 INFO:tasks.workunit.client.1.smithi135.stdout:6/69: mkdir d5/d15 0 2024-09-10T09:35:53.450 INFO:tasks.workunit.client.1.smithi135.stdout:4/84: dwrite d1/db/ff [0,4194304] 0 2024-09-10T09:35:53.450 INFO:tasks.workunit.client.1.smithi135.stdout:4/85: chown d1/db 14241897 1 2024-09-10T09:35:53.452 INFO:tasks.workunit.client.1.smithi135.stdout:6/70: mknod d5/d15/c16 0 2024-09-10T09:35:53.454 INFO:tasks.workunit.client.1.smithi135.stdout:6/71: fdatasync f3 0 2024-09-10T09:35:53.458 INFO:tasks.workunit.client.1.smithi135.stdout:4/86: creat d1/f19 x:0 0 0 2024-09-10T09:35:53.458 INFO:tasks.workunit.client.1.smithi135.stdout:4/87: readlink d1/l12 0 2024-09-10T09:35:53.461 INFO:tasks.workunit.client.1.smithi135.stdout:7/78: mkdir d2/d15 0 2024-09-10T09:35:53.466 INFO:tasks.workunit.client.1.smithi135.stdout:7/79: mkdir d2/d11/d16 0 2024-09-10T09:35:53.466 INFO:tasks.workunit.client.1.smithi135.stdout:7/80: chown d2/f10 1357 1 2024-09-10T09:35:53.467 INFO:tasks.workunit.client.1.smithi135.stdout:7/81: mknod d2/d11/c17 0 2024-09-10T09:35:53.473 INFO:tasks.workunit.client.1.smithi135.stdout:4/88: dwrite d1/de/f13 [0,4194304] 0 2024-09-10T09:35:53.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/72: link d5/f7 d5/f17 0 2024-09-10T09:35:53.485 INFO:tasks.workunit.client.1.smithi135.stdout:4/89: write d1/db/ff [1574055,86268] 0 2024-09-10T09:35:53.485 INFO:tasks.workunit.client.1.smithi135.stdout:4/90: rename d1/de/d16 to d1/de/d16/d1a 22 2024-09-10T09:35:53.509 INFO:tasks.workunit.client.1.smithi135.stdout:6/73: dwrite f4 [0,4194304] 0 2024-09-10T09:35:53.510 INFO:tasks.workunit.client.1.smithi135.stdout:4/91: dwrite d1/f19 [0,4194304] 0 2024-09-10T09:35:53.510 INFO:tasks.workunit.client.1.smithi135.stdout:4/92: getdents d1/db 0 2024-09-10T09:35:53.513 INFO:tasks.workunit.client.1.smithi135.stdout:6/74: dread d5/f17 [0,4194304] 0 2024-09-10T09:35:53.521 INFO:tasks.workunit.client.1.smithi135.stdout:6/75: symlink d5/d12/l18 0 2024-09-10T09:35:53.522 INFO:tasks.workunit.client.1.smithi135.stdout:6/76: chown c1 378144 1 2024-09-10T09:35:53.522 INFO:tasks.workunit.client.1.smithi135.stdout:6/77: chown c1 23576 1 2024-09-10T09:35:53.522 INFO:tasks.workunit.client.1.smithi135.stdout:0/75: truncate f6 828963 0 2024-09-10T09:35:53.524 INFO:tasks.workunit.client.1.smithi135.stdout:0/76: dread d8/dd/f10 [0,4194304] 0 2024-09-10T09:35:53.524 INFO:tasks.workunit.client.1.smithi135.stdout:0/77: chown d8/dd/d11 13735825 1 2024-09-10T09:35:53.525 INFO:tasks.workunit.client.1.smithi135.stdout:6/78: symlink d5/dd/l19 0 2024-09-10T09:35:53.525 INFO:tasks.workunit.client.1.smithi135.stdout:6/79: chown d5/c8 898 1 2024-09-10T09:35:53.529 INFO:tasks.workunit.client.1.smithi135.stdout:4/93: dwrite d1/db/d9/f15 [0,4194304] 0 2024-09-10T09:35:53.536 INFO:tasks.workunit.client.1.smithi135.stdout:6/80: dread f4 [0,4194304] 0 2024-09-10T09:35:53.538 INFO:tasks.workunit.client.1.smithi135.stdout:4/94: dread d1/f19 [0,4194304] 0 2024-09-10T09:35:53.538 INFO:tasks.workunit.client.1.smithi135.stdout:4/95: fsync d1/db/d9/f15 0 2024-09-10T09:35:53.538 INFO:tasks.workunit.client.1.smithi135.stdout:4/96: creat d1/de/f1b x:0 0 0 2024-09-10T09:35:53.538 INFO:tasks.workunit.client.1.smithi135.stdout:6/81: dread d5/f7 [0,4194304] 0 2024-09-10T09:35:53.539 INFO:tasks.workunit.client.1.smithi135.stdout:6/82: write d5/f10 [997196,77243] 0 2024-09-10T09:35:53.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/97: symlink d1/db/d9/l1c 0 2024-09-10T09:35:53.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/98: readlink d1/db/d9/l1c 0 2024-09-10T09:35:53.543 INFO:tasks.workunit.client.1.smithi135.stdout:6/83: rmdir d5/d15 39 2024-09-10T09:35:53.544 INFO:tasks.workunit.client.1.smithi135.stdout:4/99: symlink d1/de/d16/l1d 0 2024-09-10T09:35:53.546 INFO:tasks.workunit.client.1.smithi135.stdout:6/84: symlink d5/d15/l1a 0 2024-09-10T09:35:53.547 INFO:tasks.workunit.client.1.smithi135.stdout:4/100: mknod d1/c1e 0 2024-09-10T09:35:53.549 INFO:tasks.workunit.client.1.smithi135.stdout:6/85: mknod d5/dd/c1b 0 2024-09-10T09:35:53.549 INFO:tasks.workunit.client.1.smithi135.stdout:6/86: read - d5/ff zero size 2024-09-10T09:35:53.551 INFO:tasks.workunit.client.1.smithi135.stdout:4/101: link d1/l12 d1/l1f 0 2024-09-10T09:35:53.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/87: dread d5/f10 [0,4194304] 0 2024-09-10T09:35:53.554 INFO:tasks.workunit.client.1.smithi135.stdout:4/102: unlink d1/db/d9/l1c 0 2024-09-10T09:35:53.557 INFO:tasks.workunit.client.1.smithi135.stdout:6/88: creat d5/d15/f1c x:0 0 0 2024-09-10T09:35:53.557 INFO:tasks.workunit.client.1.smithi135.stdout:6/89: fdatasync f3 0 2024-09-10T09:35:53.557 INFO:tasks.workunit.client.1.smithi135.stdout:6/90: readlink d5/l9 0 2024-09-10T09:35:53.561 INFO:tasks.workunit.client.1.smithi135.stdout:6/91: link d5/f10 d5/d15/f1d 0 2024-09-10T09:35:53.580 INFO:tasks.workunit.client.1.smithi135.stdout:4/103: dwrite d1/db/ff [0,4194304] 0 2024-09-10T09:35:53.618 INFO:tasks.workunit.client.1.smithi135.stdout:4/104: symlink d1/l20 0 2024-09-10T09:35:53.620 INFO:tasks.workunit.client.1.smithi135.stdout:4/105: dread d1/db/f6 [0,4194304] 0 2024-09-10T09:35:53.627 INFO:tasks.workunit.client.1.smithi135.stdout:4/106: creat d1/de/d16/f21 x:0 0 0 2024-09-10T09:35:53.627 INFO:tasks.workunit.client.1.smithi135.stdout:4/107: creat d1/f22 x:0 0 0 2024-09-10T09:35:53.627 INFO:tasks.workunit.client.1.smithi135.stdout:4/108: chown d1/db 918653994 1 2024-09-10T09:35:53.631 INFO:tasks.workunit.client.1.smithi135.stdout:4/109: write d1/f19 [2258352,9558] 0 2024-09-10T09:35:53.631 INFO:tasks.workunit.client.1.smithi135.stdout:4/110: chown d1/l12 0 1 2024-09-10T09:35:53.652 INFO:tasks.workunit.client.1.smithi135.stdout:0/78: dwrite f6 [0,4194304] 0 2024-09-10T09:35:53.654 INFO:tasks.workunit.client.1.smithi135.stdout:0/79: mkdir d8/dd/d18 0 2024-09-10T09:35:53.663 INFO:tasks.workunit.client.1.smithi135.stdout:0/80: dread d8/fb [0,4194304] 0 2024-09-10T09:35:53.667 INFO:tasks.workunit.client.1.smithi135.stdout:4/111: rmdir d1/db/d9 39 2024-09-10T09:35:53.667 INFO:tasks.workunit.client.1.smithi135.stdout:4/112: read - d1/de/f1b zero size 2024-09-10T09:35:53.667 INFO:tasks.workunit.client.1.smithi135.stdout:4/113: stat d1/db 0 2024-09-10T09:35:53.669 INFO:tasks.workunit.client.1.smithi135.stdout:4/114: mkdir d1/db/d23 0 2024-09-10T09:35:53.669 INFO:tasks.workunit.client.1.smithi135.stdout:4/115: chown d1/l1f 15632 1 2024-09-10T09:35:53.669 INFO:tasks.workunit.client.1.smithi135.stdout:4/116: chown d1/db/d9/l10 120253572 1 2024-09-10T09:35:53.670 INFO:tasks.workunit.client.1.smithi135.stdout:0/81: write d8/fc [2796779,37683] 0 2024-09-10T09:35:53.672 INFO:tasks.workunit.client.1.smithi135.stdout:6/92: rmdir d5/d15 39 2024-09-10T09:35:53.672 INFO:tasks.workunit.client.1.smithi135.stdout:6/93: chown d5/d12 1845776 1 2024-09-10T09:35:53.677 INFO:tasks.workunit.client.1.smithi135.stdout:6/94: rmdir d5/d12 39 2024-09-10T09:35:53.677 INFO:tasks.workunit.client.1.smithi135.stdout:6/95: chown d5/d15 9 1 2024-09-10T09:35:53.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/117: read d1/de/f13 [2355832,17245] 0 2024-09-10T09:35:53.680 INFO:tasks.workunit.client.1.smithi135.stdout:6/96: mkdir d5/d1e 0 2024-09-10T09:35:53.682 INFO:tasks.workunit.client.1.smithi135.stdout:6/97: dread d5/f10 [0,4194304] 0 2024-09-10T09:35:53.682 INFO:tasks.workunit.client.1.smithi135.stdout:4/118: symlink d1/db/d9/l24 0 2024-09-10T09:35:53.690 INFO:tasks.workunit.client.1.smithi135.stdout:0/82: dwrite f7 [0,4194304] 0 2024-09-10T09:35:53.695 INFO:tasks.workunit.client.1.smithi135.stdout:0/83: mknod d8/dd/d18/c19 0 2024-09-10T09:35:53.695 INFO:tasks.workunit.client.1.smithi135.stdout:6/98: write d5/f11 [3737953,100606] 0 2024-09-10T09:35:53.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/99: dread d5/d15/f1d [0,4194304] 0 2024-09-10T09:35:53.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/100: getdents d5/d1e 0 2024-09-10T09:35:53.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/101: rename d5 to d5/d12/d1f 22 2024-09-10T09:35:53.697 INFO:tasks.workunit.client.1.smithi135.stdout:4/119: dwrite d1/f22 [0,4194304] 0 2024-09-10T09:35:53.698 INFO:tasks.workunit.client.1.smithi135.stdout:4/120: readlink d1/l20 0 2024-09-10T09:35:53.698 INFO:tasks.workunit.client.1.smithi135.stdout:0/84: creat d8/dd/d18/f1a x:0 0 0 2024-09-10T09:35:53.702 INFO:tasks.workunit.client.1.smithi135.stdout:6/102: dread d5/fc [0,4194304] 0 2024-09-10T09:35:53.703 INFO:tasks.workunit.client.1.smithi135.stdout:4/121: mknod d1/db/d23/c25 0 2024-09-10T09:35:53.706 INFO:tasks.workunit.client.1.smithi135.stdout:6/103: rename d5/d15/f1d to d5/dd/f20 0 2024-09-10T09:35:53.708 INFO:tasks.workunit.client.1.smithi135.stdout:4/122: rename d1/db/d23/c25 to d1/db/d9/c26 0 2024-09-10T09:35:53.710 INFO:tasks.workunit.client.1.smithi135.stdout:0/85: write f7 [1223712,81851] 0 2024-09-10T09:35:53.710 INFO:tasks.workunit.client.1.smithi135.stdout:0/86: write f4 [1831963,26612] 0 2024-09-10T09:35:53.711 INFO:tasks.workunit.client.1.smithi135.stdout:0/87: readlink d8/dd/d11/l14 0 2024-09-10T09:35:53.711 INFO:tasks.workunit.client.1.smithi135.stdout:6/104: creat d5/d12/f21 x:0 0 0 2024-09-10T09:35:53.711 INFO:tasks.workunit.client.1.smithi135.stdout:6/105: fsync d5/d15/f1c 0 2024-09-10T09:35:53.713 INFO:tasks.workunit.client.1.smithi135.stdout:4/123: truncate d1/db/f8 4176934 0 2024-09-10T09:35:53.715 INFO:tasks.workunit.client.1.smithi135.stdout:0/88: symlink d8/dd/l1b 0 2024-09-10T09:35:53.726 INFO:tasks.workunit.client.1.smithi135.stdout:0/89: mkdir d8/d1c 0 2024-09-10T09:35:53.731 INFO:tasks.workunit.client.1.smithi135.stdout:0/90: mknod d8/c1d 0 2024-09-10T09:35:53.736 INFO:tasks.workunit.client.1.smithi135.stdout:0/91: mkdir d8/dd/d1e 0 2024-09-10T09:35:53.736 INFO:tasks.workunit.client.1.smithi135.stdout:0/92: write f4 [189533,124214] 0 2024-09-10T09:35:53.738 INFO:tasks.workunit.client.1.smithi135.stdout:0/93: creat d8/dd/d11/f1f x:0 0 0 2024-09-10T09:35:53.758 INFO:tasks.workunit.client.1.smithi135.stdout:0/94: dwrite f4 [0,4194304] 0 2024-09-10T09:35:53.774 INFO:tasks.workunit.client.1.smithi135.stdout:0/95: dwrite d8/f15 [0,4194304] 0 2024-09-10T09:35:53.778 INFO:tasks.workunit.client.1.smithi135.stdout:0/96: symlink d8/dd/l20 0 2024-09-10T09:35:53.778 INFO:tasks.workunit.client.1.smithi135.stdout:0/97: fdatasync d8/fb 0 2024-09-10T09:35:53.780 INFO:tasks.workunit.client.1.smithi135.stdout:0/98: creat d8/dd/d1e/f21 x:0 0 0 2024-09-10T09:35:53.783 INFO:tasks.workunit.client.1.smithi135.stdout:0/99: rename f6 to d8/d1c/f22 0 2024-09-10T09:35:53.790 INFO:tasks.workunit.client.1.smithi135.stdout:4/124: dwrite d1/db/d9/f15 [0,4194304] 0 2024-09-10T09:35:53.792 INFO:tasks.workunit.client.1.smithi135.stdout:4/125: getdents d1/db/d23 0 2024-09-10T09:35:53.795 INFO:tasks.workunit.client.1.smithi135.stdout:4/126: mknod d1/db/d9/c27 0 2024-09-10T09:35:53.795 INFO:tasks.workunit.client.1.smithi135.stdout:4/127: truncate d1/db/f6 2317959 0 2024-09-10T09:35:53.795 INFO:tasks.workunit.client.1.smithi135.stdout:0/100: dread f4 [0,4194304] 0 2024-09-10T09:35:53.797 INFO:tasks.workunit.client.1.smithi135.stdout:4/128: mknod d1/db/d9/c28 0 2024-09-10T09:35:53.800 INFO:tasks.workunit.client.1.smithi135.stdout:0/101: link f4 d8/dd/d1e/f23 0 2024-09-10T09:35:53.800 INFO:tasks.workunit.client.1.smithi135.stdout:0/102: chown d8/d1c/f22 10730 1 2024-09-10T09:35:53.800 INFO:tasks.workunit.client.1.smithi135.stdout:0/103: chown d8 32157437 1 2024-09-10T09:35:53.800 INFO:tasks.workunit.client.1.smithi135.stdout:0/104: stat d8/dd/d1e/f21 0 2024-09-10T09:35:53.800 INFO:tasks.workunit.client.1.smithi135.stdout:0/105: write d8/fc [4135152,1883] 0 2024-09-10T09:35:53.801 INFO:tasks.workunit.client.1.smithi135.stdout:4/129: mknod d1/db/d23/c29 0 2024-09-10T09:35:53.810 INFO:tasks.workunit.client.1.smithi135.stdout:4/130: write d1/f22 [3984732,89868] 0 2024-09-10T09:35:53.814 INFO:tasks.workunit.client.1.smithi135.stdout:4/131: rename d1/db/d9/l18 to d1/db/d23/l2a 0 2024-09-10T09:35:53.818 INFO:tasks.workunit.client.1.smithi135.stdout:4/132: rmdir d1/de/d16 39 2024-09-10T09:35:53.819 INFO:tasks.workunit.client.1.smithi135.stdout:0/106: dwrite d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:35:53.820 INFO:tasks.workunit.client.1.smithi135.stdout:4/133: mknod d1/db/d9/c2b 0 2024-09-10T09:35:53.820 INFO:tasks.workunit.client.1.smithi135.stdout:4/134: rename d1/de/d16 to d1/de/d16/d2c 22 2024-09-10T09:35:53.825 INFO:tasks.workunit.client.1.smithi135.stdout:0/107: truncate f7 2534435 0 2024-09-10T09:35:53.827 INFO:tasks.workunit.client.1.smithi135.stdout:4/135: getdents d1/de/d16 0 2024-09-10T09:35:53.827 INFO:tasks.workunit.client.1.smithi135.stdout:4/136: chown d1/db/d9/f15 0 1 2024-09-10T09:35:53.829 INFO:tasks.workunit.client.1.smithi135.stdout:0/108: dread d8/dd/d1e/f23 [0,4194304] 0 2024-09-10T09:35:53.837 INFO:tasks.workunit.client.1.smithi135.stdout:4/137: dread d1/db/ff [0,4194304] 0 2024-09-10T09:35:53.841 INFO:tasks.workunit.client.1.smithi135.stdout:4/138: symlink d1/db/d9/l2d 0 2024-09-10T09:35:53.847 INFO:tasks.workunit.client.1.smithi135.stdout:0/109: dwrite d8/dd/d1e/f21 [0,4194304] 0 2024-09-10T09:35:53.854 INFO:tasks.workunit.client.1.smithi135.stdout:0/110: rmdir d8/d1c 39 2024-09-10T09:35:53.859 INFO:tasks.workunit.client.1.smithi135.stdout:4/139: dwrite d1/db/f6 [0,4194304] 0 2024-09-10T09:35:53.866 INFO:tasks.workunit.client.1.smithi135.stdout:4/140: unlink d1/db/la 0 2024-09-10T09:35:53.874 INFO:tasks.workunit.client.1.smithi135.stdout:0/111: dwrite d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:35:53.889 INFO:tasks.workunit.client.1.smithi135.stdout:4/141: dwrite d1/f22 [0,4194304] 0 2024-09-10T09:35:53.891 INFO:tasks.workunit.client.1.smithi135.stdout:0/112: read f7 [2098092,30452] 0 2024-09-10T09:35:53.897 INFO:tasks.workunit.client.1.smithi135.stdout:4/142: write d1/db/f6 [237779,74493] 0 2024-09-10T09:35:53.903 INFO:tasks.workunit.client.1.smithi135.stdout:0/113: dread d8/dd/d1e/f21 [0,4194304] 0 2024-09-10T09:35:53.905 INFO:tasks.workunit.client.1.smithi135.stdout:0/114: mknod d8/dd/c24 0 2024-09-10T09:35:53.911 INFO:tasks.workunit.client.1.smithi135.stdout:0/115: dread d8/f15 [0,4194304] 0 2024-09-10T09:35:53.911 INFO:tasks.workunit.client.1.smithi135.stdout:0/116: chown d8/dd 814317 1 2024-09-10T09:35:53.945 INFO:tasks.workunit.client.1.smithi135.stdout:4/143: truncate d1/f22 1270640 0 2024-09-10T09:35:53.945 INFO:tasks.workunit.client.1.smithi135.stdout:4/144: chown d1/l20 116701796 1 2024-09-10T09:35:53.945 INFO:tasks.workunit.client.1.smithi135.stdout:4/145: write d1/de/f1b [678147,78903] 0 2024-09-10T09:35:53.945 INFO:tasks.workunit.client.1.smithi135.stdout:4/146: readlink d1/l1f 0 2024-09-10T09:35:53.945 INFO:tasks.workunit.client.1.smithi135.stdout:4/147: chown d1/db/d23/c29 3 1 2024-09-10T09:35:53.946 INFO:tasks.workunit.client.1.smithi135.stdout:4/148: symlink d1/db/d9/l2e 0 2024-09-10T09:35:53.949 INFO:tasks.workunit.client.1.smithi135.stdout:4/149: creat d1/de/d16/f2f x:0 0 0 2024-09-10T09:35:53.951 INFO:tasks.workunit.client.1.smithi135.stdout:4/150: creat d1/db/d23/f30 x:0 0 0 2024-09-10T09:35:53.954 INFO:tasks.workunit.client.1.smithi135.stdout:4/151: unlink d1/db/d9/f15 0 2024-09-10T09:35:53.954 INFO:tasks.workunit.client.1.smithi135.stdout:4/152: write d1/de/d16/f2f [634816,114866] 0 2024-09-10T09:35:53.956 INFO:tasks.workunit.client.1.smithi135.stdout:4/153: rename d1/l5 to d1/de/l31 0 2024-09-10T09:35:53.959 INFO:tasks.workunit.client.1.smithi135.stdout:4/154: creat d1/db/d9/f32 x:0 0 0 2024-09-10T09:35:53.959 INFO:tasks.workunit.client.1.smithi135.stdout:4/155: chown d1/de 148 1 2024-09-10T09:35:53.959 INFO:tasks.workunit.client.1.smithi135.stdout:0/117: truncate d8/dd/d1e/f23 958096 0 2024-09-10T09:35:53.962 INFO:tasks.workunit.client.1.smithi135.stdout:4/156: mkdir d1/d33 0 2024-09-10T09:35:53.962 INFO:tasks.workunit.client.1.smithi135.stdout:4/157: getdents d1/d33 0 2024-09-10T09:35:53.962 INFO:tasks.workunit.client.1.smithi135.stdout:4/158: dread - d1/db/d9/f32 zero size 2024-09-10T09:35:53.970 INFO:tasks.workunit.client.1.smithi135.stdout:0/118: dread d8/fc [0,4194304] 0 2024-09-10T09:35:53.970 INFO:tasks.workunit.client.1.smithi135.stdout:0/119: chown d8/dd/l1b 2941 1 2024-09-10T09:35:53.974 INFO:tasks.workunit.client.1.smithi135.stdout:0/120: dread d8/fb [0,4194304] 0 2024-09-10T09:35:53.978 INFO:tasks.workunit.client.1.smithi135.stdout:4/159: dwrite d1/db/d9/f32 [0,4194304] 0 2024-09-10T09:35:53.979 INFO:tasks.workunit.client.1.smithi135.stdout:0/121: unlink d8/d1c/f22 0 2024-09-10T09:35:53.982 INFO:tasks.workunit.client.1.smithi135.stdout:4/160: read d1/db/ff [3286039,126642] 0 2024-09-10T09:35:54.029 INFO:tasks.workunit.client.1.smithi135.stdout:4/161: write d1/db/d9/f32 [4918244,67565] 0 2024-09-10T09:35:54.030 INFO:tasks.workunit.client.1.smithi135.stdout:4/162: dread - d1/de/d16/f21 zero size 2024-09-10T09:35:54.030 INFO:tasks.workunit.client.1.smithi135.stdout:4/163: creat d1/de/f34 x:0 0 0 2024-09-10T09:35:54.034 INFO:tasks.workunit.client.1.smithi135.stdout:4/164: symlink d1/d33/l35 0 2024-09-10T09:35:54.037 INFO:tasks.workunit.client.1.smithi135.stdout:4/165: mknod d1/d33/c36 0 2024-09-10T09:35:54.040 INFO:tasks.workunit.client.1.smithi135.stdout:4/166: dread d1/f22 [0,4194304] 0 2024-09-10T09:35:54.040 INFO:tasks.workunit.client.1.smithi135.stdout:4/167: chown d1/de/f13 60 1 2024-09-10T09:35:54.041 INFO:tasks.workunit.client.1.smithi135.stdout:4/168: fsync d1/db/f6 0 2024-09-10T09:35:54.043 INFO:tasks.workunit.client.1.smithi135.stdout:4/169: mkdir d1/db/d23/d37 0 2024-09-10T09:35:54.043 INFO:tasks.workunit.client.1.smithi135.stdout:4/170: fsync d1/de/f1b 0 2024-09-10T09:35:54.043 INFO:tasks.workunit.client.1.smithi135.stdout:4/171: creat d1/db/d9/f38 x:0 0 0 2024-09-10T09:35:54.044 INFO:tasks.workunit.client.1.smithi135.stdout:4/172: dread d1/de/d16/f2f [0,4194304] 0 2024-09-10T09:35:54.048 INFO:tasks.workunit.client.1.smithi135.stdout:4/173: dread d1/db/ff [0,4194304] 0 2024-09-10T09:35:54.065 INFO:tasks.workunit.client.1.smithi135.stdout:4/174: dwrite d1/de/f1b [0,4194304] 0 2024-09-10T09:35:54.116 INFO:tasks.workunit.client.1.smithi135.stdout:4/175: truncate d1/de/f1b 782630 0 2024-09-10T09:35:54.118 INFO:tasks.workunit.client.1.smithi135.stdout:4/176: mknod d1/d33/c39 0 2024-09-10T09:35:54.132 INFO:tasks.workunit.client.0.smithi079.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-10T09:35:54.133 INFO:tasks.workunit.client.0.smithi079.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-10T09:35:54.133 INFO:tasks.workunit.client.0.smithi079.stderr:+ make 2024-09-10T09:35:54.135 INFO:tasks.workunit.client.1.smithi135.stdout:4/177: dwrite d1/f19 [0,4194304] 0 2024-09-10T09:35:54.139 INFO:tasks.workunit.client.1.smithi135.stdout:4/178: getdents d1 0 2024-09-10T09:35:54.146 INFO:tasks.workunit.client.1.smithi135.stdout:4/179: write d1/db/d9/f32 [3442135,63864] 0 2024-09-10T09:35:54.146 INFO:tasks.workunit.client.1.smithi135.stdout:4/180: write d1/de/d16/f21 [179723,90903] 0 2024-09-10T09:35:54.148 INFO:tasks.workunit.client.1.smithi135.stdout:4/181: mknod d1/de/c3a 0 2024-09-10T09:35:54.149 INFO:tasks.workunit.client.1.smithi135.stdout:4/182: creat d1/de/d16/f3b x:0 0 0 2024-09-10T09:35:54.149 INFO:tasks.workunit.client.1.smithi135.stdout:4/183: creat d1/de/f3c x:0 0 0 2024-09-10T09:35:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:53 smithi079 ceph-mon[27592]: pgmap v251: 65 pgs: 65 active+clean; 192 MiB data, 904 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 365 op/s 2024-09-10T09:35:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:53 smithi135 ceph-mon[33411]: pgmap v251: 65 pgs: 65 active+clean; 192 MiB data, 904 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.6 MiB/s wr, 365 op/s 2024-09-10T09:35:54.262 INFO:tasks.workunit.client.1.smithi135.stdout:4/184: dwrite d1/db/f8 [0,4194304] 0 2024-09-10T09:35:54.262 INFO:tasks.workunit.client.1.smithi135.stdout:4/185: fdatasync d1/f19 0 2024-09-10T09:35:54.265 INFO:tasks.workunit.client.1.smithi135.stdout:4/186: creat d1/d33/f3d x:0 0 0 2024-09-10T09:35:54.283 INFO:tasks.workunit.client.1.smithi135.stdout:4/187: dwrite d1/de/f3c [0,4194304] 0 2024-09-10T09:35:54.286 INFO:tasks.workunit.client.1.smithi135.stdout:4/188: unlink d1/db/d9/l2e 0 2024-09-10T09:35:54.288 INFO:tasks.workunit.client.0.smithi079.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-10T09:35:54.301 INFO:tasks.workunit.client.1.smithi135.stdout:4/189: dwrite d1/de/d16/f21 [0,4194304] 0 2024-09-10T09:35:54.301 INFO:tasks.workunit.client.1.smithi135.stdout:4/190: write d1/db/d23/f30 [281104,119940] 0 2024-09-10T09:35:54.302 INFO:tasks.workunit.client.1.smithi135.stdout:4/191: getdents d1/db 0 2024-09-10T09:35:54.320 INFO:tasks.workunit.client.1.smithi135.stdout:4/192: dwrite d1/de/f1b [0,4194304] 0 2024-09-10T09:35:54.320 INFO:tasks.workunit.client.1.smithi135.stdout:4/193: write d1/db/ff [5202782,91543] 0 2024-09-10T09:35:54.320 INFO:tasks.workunit.client.1.smithi135.stdout:4/194: creat d1/db/d23/f3e x:0 0 0 2024-09-10T09:35:54.666 INFO:tasks.workunit.client.0.smithi079.stderr:++ readlink -f fsstress 2024-09-10T09:35:54.667 INFO:tasks.workunit.client.0.smithi079.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-10T09:35:54.667 INFO:tasks.workunit.client.0.smithi079.stderr:+ popd 2024-09-10T09:35:54.667 INFO:tasks.workunit.client.0.smithi079.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-10T09:35:54.667 INFO:tasks.workunit.client.0.smithi079.stderr:+ popd 2024-09-10T09:35:54.668 INFO:tasks.workunit.client.0.smithi079.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-10T09:35:54.668 INFO:tasks.workunit.client.0.smithi079.stderr:++ mktemp -d -p . 2024-09-10T09:35:54.669 INFO:tasks.workunit.client.0.smithi079.stderr:+ T=./tmp.f1KFAAp0W9 2024-09-10T09:35:54.669 INFO:tasks.workunit.client.0.smithi079.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.f1KFAAp0W9 -l 1 -n 1000 -p 10 -v 2024-09-10T09:35:54.670 INFO:tasks.workunit.client.0.smithi079.stdout:seed = 1726623515 2024-09-10T09:35:54.673 INFO:tasks.workunit.client.0.smithi079.stdout:0/0: write - no filename 2024-09-10T09:35:54.673 INFO:tasks.workunit.client.0.smithi079.stdout:0/1: rmdir - no directory 2024-09-10T09:35:54.673 INFO:tasks.workunit.client.0.smithi079.stdout:0/2: chown . 39 1 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/0: fsync - no filename 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/1: rename - no filename 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/2: dwrite - no filename 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/3: rename - no filename 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/4: fsync - no filename 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/5: dread - no filename 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/6: write - no filename 2024-09-10T09:35:54.674 INFO:tasks.workunit.client.0.smithi079.stdout:1/7: rename - no filename 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/8: read - no filename 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/9: write - no filename 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/10: fsync - no filename 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/11: chown . 1241048 1 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/12: unlink - no file 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:0/3: creat f0 x:0 0 0 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:0/4: creat f1 x:0 0 0 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:0/5: creat f2 x:0 0 0 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/13: mknod c0 0 2024-09-10T09:35:54.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/14: write - no filename 2024-09-10T09:35:54.676 INFO:tasks.workunit.client.0.smithi079.stdout:3/0: write - no filename 2024-09-10T09:35:54.677 INFO:tasks.workunit.client.0.smithi079.stdout:3/1: unlink - no file 2024-09-10T09:35:54.677 INFO:tasks.workunit.client.0.smithi079.stdout:2/0: symlink l0 0 2024-09-10T09:35:54.677 INFO:tasks.workunit.client.0.smithi079.stdout:2/1: rmdir - no directory 2024-09-10T09:35:54.677 INFO:tasks.workunit.client.0.smithi079.stdout:2/2: truncate - no filename 2024-09-10T09:35:54.677 INFO:tasks.workunit.client.0.smithi079.stdout:2/3: write - no filename 2024-09-10T09:35:54.678 INFO:tasks.workunit.client.0.smithi079.stdout:1/15: unlink c0 0 2024-09-10T09:35:54.678 INFO:tasks.workunit.client.0.smithi079.stdout:1/16: dwrite - no filename 2024-09-10T09:35:54.678 INFO:tasks.workunit.client.0.smithi079.stdout:1/17: dwrite - no filename 2024-09-10T09:35:54.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/2: mknod c0 0 2024-09-10T09:35:54.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/3: dread - no filename 2024-09-10T09:35:54.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/4: dread - no filename 2024-09-10T09:35:54.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/5: stat c0 0 2024-09-10T09:35:54.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/6: dread - no filename 2024-09-10T09:35:54.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/7: write - no filename 2024-09-10T09:35:54.680 INFO:tasks.workunit.client.0.smithi079.stdout:2/4: link l0 l1 0 2024-09-10T09:35:54.680 INFO:tasks.workunit.client.0.smithi079.stdout:2/5: chown l0 124 1 2024-09-10T09:35:54.680 INFO:tasks.workunit.client.0.smithi079.stdout:1/18: symlink l1 0 2024-09-10T09:35:54.680 INFO:tasks.workunit.client.0.smithi079.stdout:1/19: chown l1 16 1 2024-09-10T09:35:54.680 INFO:tasks.workunit.client.0.smithi079.stdout:1/20: dread - no filename 2024-09-10T09:35:54.681 INFO:tasks.workunit.client.0.smithi079.stdout:4/0: creat f0 x:0 0 0 2024-09-10T09:35:54.682 INFO:tasks.workunit.client.0.smithi079.stdout:3/8: mknod c1 0 2024-09-10T09:35:54.682 INFO:tasks.workunit.client.0.smithi079.stdout:3/9: write - no filename 2024-09-10T09:35:54.682 INFO:tasks.workunit.client.0.smithi079.stdout:3/10: dread - no filename 2024-09-10T09:35:54.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/6: link l1 l2 0 2024-09-10T09:35:54.683 INFO:tasks.workunit.client.0.smithi079.stdout:1/21: symlink l2 0 2024-09-10T09:35:54.684 INFO:tasks.workunit.client.0.smithi079.stdout:6/0: dwrite - no filename 2024-09-10T09:35:54.684 INFO:tasks.workunit.client.0.smithi079.stdout:6/1: dread - no filename 2024-09-10T09:35:54.684 INFO:tasks.workunit.client.0.smithi079.stdout:6/2: chown . 2728632 1 2024-09-10T09:35:54.684 INFO:tasks.workunit.client.0.smithi079.stdout:6/3: dread - no filename 2024-09-10T09:35:54.684 INFO:tasks.workunit.client.0.smithi079.stdout:6/4: fdatasync - no filename 2024-09-10T09:35:54.685 INFO:tasks.workunit.client.0.smithi079.stdout:5/0: symlink l0 0 2024-09-10T09:35:54.685 INFO:tasks.workunit.client.0.smithi079.stdout:5/1: write - no filename 2024-09-10T09:35:54.685 INFO:tasks.workunit.client.0.smithi079.stdout:5/2: readlink l0 0 2024-09-10T09:35:54.685 INFO:tasks.workunit.client.0.smithi079.stdout:4/1: mkdir d1 0 2024-09-10T09:35:54.685 INFO:tasks.workunit.client.0.smithi079.stdout:4/2: truncate f0 295341 0 2024-09-10T09:35:54.686 INFO:tasks.workunit.client.0.smithi079.stdout:3/11: creat f2 x:0 0 0 2024-09-10T09:35:54.686 INFO:tasks.workunit.client.0.smithi079.stdout:3/12: read - f2 zero size 2024-09-10T09:35:54.686 INFO:tasks.workunit.client.0.smithi079.stdout:3/13: creat f3 x:0 0 0 2024-09-10T09:35:54.686 INFO:tasks.workunit.client.0.smithi079.stdout:2/7: symlink l3 0 2024-09-10T09:35:54.687 INFO:tasks.workunit.client.0.smithi079.stdout:1/22: link l2 l3 0 2024-09-10T09:35:54.687 INFO:tasks.workunit.client.0.smithi079.stdout:1/23: dread - no filename 2024-09-10T09:35:54.687 INFO:tasks.workunit.client.0.smithi079.stdout:7/0: rename - no filename 2024-09-10T09:35:54.687 INFO:tasks.workunit.client.0.smithi079.stdout:7/1: rename - no filename 2024-09-10T09:35:54.688 INFO:tasks.workunit.client.0.smithi079.stdout:7/2: chown . 941667 1 2024-09-10T09:35:54.688 INFO:tasks.workunit.client.0.smithi079.stdout:6/5: symlink l0 0 2024-09-10T09:35:54.689 INFO:tasks.workunit.client.0.smithi079.stdout:5/3: rename l0 to l1 0 2024-09-10T09:35:54.689 INFO:tasks.workunit.client.0.smithi079.stdout:3/14: mkdir d4 0 2024-09-10T09:35:54.690 INFO:tasks.workunit.client.0.smithi079.stdout:2/8: mkdir d4 0 2024-09-10T09:35:54.691 INFO:tasks.workunit.client.0.smithi079.stdout:1/24: symlink l4 0 2024-09-10T09:35:54.691 INFO:tasks.workunit.client.0.smithi079.stdout:1/25: dread - no filename 2024-09-10T09:35:54.691 INFO:tasks.workunit.client.0.smithi079.stdout:1/26: dread - no filename 2024-09-10T09:35:54.691 INFO:tasks.workunit.client.0.smithi079.stdout:1/27: fdatasync - no filename 2024-09-10T09:35:54.692 INFO:tasks.workunit.client.0.smithi079.stdout:8/0: write - no filename 2024-09-10T09:35:54.692 INFO:tasks.workunit.client.0.smithi079.stdout:8/1: unlink - no file 2024-09-10T09:35:54.692 INFO:tasks.workunit.client.0.smithi079.stdout:8/2: dwrite - no filename 2024-09-10T09:35:54.692 INFO:tasks.workunit.client.0.smithi079.stdout:7/3: creat f0 x:0 0 0 2024-09-10T09:35:54.693 INFO:tasks.workunit.client.0.smithi079.stdout:6/6: rename l0 to l1 0 2024-09-10T09:35:54.693 INFO:tasks.workunit.client.0.smithi079.stdout:6/7: dread - no filename 2024-09-10T09:35:54.694 INFO:tasks.workunit.client.0.smithi079.stdout:5/4: stat l1 0 2024-09-10T09:35:54.694 INFO:tasks.workunit.client.0.smithi079.stdout:5/5: rmdir - no directory 2024-09-10T09:35:54.694 INFO:tasks.workunit.client.0.smithi079.stdout:5/6: dwrite - no filename 2024-09-10T09:35:54.695 INFO:tasks.workunit.client.0.smithi079.stdout:2/9: creat d4/f5 x:0 0 0 2024-09-10T09:35:54.695 INFO:tasks.workunit.client.0.smithi079.stdout:2/10: dread - d4/f5 zero size 2024-09-10T09:35:54.695 INFO:tasks.workunit.client.0.smithi079.stdout:2/11: dread - d4/f5 zero size 2024-09-10T09:35:54.696 INFO:tasks.workunit.client.0.smithi079.stdout:1/28: mkdir d5 0 2024-09-10T09:35:54.718 INFO:tasks.workunit.client.0.smithi079.stdout:7/4: mknod c1 0 2024-09-10T09:35:54.719 INFO:tasks.workunit.client.0.smithi079.stdout:7/5: dread - f0 zero size 2024-09-10T09:35:54.719 INFO:tasks.workunit.client.0.smithi079.stdout:5/7: mkdir d2 0 2024-09-10T09:35:54.719 INFO:tasks.workunit.client.0.smithi079.stdout:5/8: write - no filename 2024-09-10T09:35:54.719 INFO:tasks.workunit.client.0.smithi079.stdout:8/3: mknod c0 0 2024-09-10T09:35:54.719 INFO:tasks.workunit.client.0.smithi079.stdout:8/4: dwrite - no filename 2024-09-10T09:35:54.719 INFO:tasks.workunit.client.0.smithi079.stdout:8/5: dwrite - no filename 2024-09-10T09:35:54.721 INFO:tasks.workunit.client.0.smithi079.stdout:6/8: creat f2 x:0 0 0 2024-09-10T09:35:54.721 INFO:tasks.workunit.client.0.smithi079.stdout:6/9: creat f3 x:0 0 0 2024-09-10T09:35:54.721 INFO:tasks.workunit.client.0.smithi079.stdout:7/6: unlink c1 0 2024-09-10T09:35:54.721 INFO:tasks.workunit.client.0.smithi079.stdout:7/7: readlink - no filename 2024-09-10T09:35:54.721 INFO:tasks.workunit.client.0.smithi079.stdout:7/8: dread - f0 zero size 2024-09-10T09:35:54.721 INFO:tasks.workunit.client.0.smithi079.stdout:7/9: dread - f0 zero size 2024-09-10T09:35:54.733 INFO:tasks.workunit.client.0.smithi079.stdout:9/0: mknod c0 0 2024-09-10T09:35:54.733 INFO:tasks.workunit.client.0.smithi079.stdout:8/6: creat f1 x:0 0 0 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:5/9: mkdir d2/d3 0 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:5/10: write - no filename 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:5/11: write - no filename 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:5/12: dwrite - no filename 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:5/13: dwrite - no filename 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:6/10: mkdir d4 0 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:6/11: dread - f2 zero size 2024-09-10T09:35:54.734 INFO:tasks.workunit.client.0.smithi079.stdout:6/12: chown d4 11 1 2024-09-10T09:35:54.735 INFO:tasks.workunit.client.0.smithi079.stdout:9/1: link c0 c1 0 2024-09-10T09:35:54.736 INFO:tasks.workunit.client.0.smithi079.stdout:9/2: dread - no filename 2024-09-10T09:35:54.736 INFO:tasks.workunit.client.0.smithi079.stdout:9/3: write - no filename 2024-09-10T09:35:54.736 INFO:tasks.workunit.client.0.smithi079.stdout:8/7: mknod c2 0 2024-09-10T09:35:54.736 INFO:tasks.workunit.client.0.smithi079.stdout:8/8: write f1 [514497,99396] 0 2024-09-10T09:35:54.736 INFO:tasks.workunit.client.0.smithi079.stdout:8/9: write f1 [1121341,110544] 0 2024-09-10T09:35:54.737 INFO:tasks.workunit.client.0.smithi079.stdout:5/14: mknod d2/d3/c4 0 2024-09-10T09:35:54.737 INFO:tasks.workunit.client.0.smithi079.stdout:5/15: dread - no filename 2024-09-10T09:35:54.738 INFO:tasks.workunit.client.0.smithi079.stdout:4/3: dwrite f0 [0,4194304] 0 2024-09-10T09:35:54.738 INFO:tasks.workunit.client.0.smithi079.stdout:9/4: rename c1 to c2 0 2024-09-10T09:35:54.740 INFO:tasks.workunit.client.0.smithi079.stdout:6/13: creat d4/f5 x:0 0 0 2024-09-10T09:35:54.740 INFO:tasks.workunit.client.0.smithi079.stdout:6/14: creat d4/f6 x:0 0 0 2024-09-10T09:35:54.742 INFO:tasks.workunit.client.0.smithi079.stdout:5/16: symlink d2/d3/l5 0 2024-09-10T09:35:54.743 INFO:tasks.workunit.client.0.smithi079.stdout:9/5: stat c2 0 2024-09-10T09:35:54.743 INFO:tasks.workunit.client.0.smithi079.stdout:9/6: fdatasync - no filename 2024-09-10T09:35:54.743 INFO:tasks.workunit.client.0.smithi079.stdout:9/7: dread - no filename 2024-09-10T09:35:54.744 INFO:tasks.workunit.client.0.smithi079.stdout:6/15: mknod d4/c7 0 2024-09-10T09:35:54.745 INFO:tasks.workunit.client.0.smithi079.stdout:9/8: mkdir d3 0 2024-09-10T09:35:54.747 INFO:tasks.workunit.client.0.smithi079.stdout:6/16: mkdir d4/d8 0 2024-09-10T09:35:54.747 INFO:tasks.workunit.client.0.smithi079.stdout:6/17: dread - f2 zero size 2024-09-10T09:35:54.748 INFO:tasks.workunit.client.0.smithi079.stdout:6/18: mknod d4/d8/c9 0 2024-09-10T09:35:54.751 INFO:tasks.workunit.client.0.smithi079.stdout:6/19: link d4/f6 d4/d8/fa 0 2024-09-10T09:35:54.754 INFO:tasks.workunit.client.0.smithi079.stdout:6/20: creat d4/d8/fb x:0 0 0 2024-09-10T09:35:54.754 INFO:tasks.workunit.client.0.smithi079.stdout:6/21: truncate f3 706411 0 2024-09-10T09:35:54.754 INFO:tasks.workunit.client.0.smithi079.stdout:6/22: read - d4/d8/fb zero size 2024-09-10T09:35:54.754 INFO:tasks.workunit.client.0.smithi079.stdout:6/23: write d4/f5 [130727,91828] 0 2024-09-10T09:35:54.756 INFO:tasks.workunit.client.0.smithi079.stdout:6/24: mkdir d4/d8/dc 0 2024-09-10T09:35:54.757 INFO:tasks.workunit.client.0.smithi079.stdout:6/25: mkdir d4/d8/dd 0 2024-09-10T09:35:54.757 INFO:tasks.workunit.client.0.smithi079.stdout:6/26: chown d4/d8/c9 0 1 2024-09-10T09:35:54.758 INFO:tasks.workunit.client.0.smithi079.stdout:6/27: write d4/d8/fa [776731,61054] 0 2024-09-10T09:35:54.758 INFO:tasks.workunit.client.0.smithi079.stdout:6/28: truncate d4/d8/fa 1444187 0 2024-09-10T09:35:54.765 INFO:tasks.workunit.client.0.smithi079.stdout:2/12: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:54.765 INFO:tasks.workunit.client.0.smithi079.stdout:2/13: chown l2 108 1 2024-09-10T09:35:54.793 INFO:tasks.workunit.client.0.smithi079.stdout:0/6: dwrite f1 [0,4194304] 0 2024-09-10T09:35:54.806 INFO:tasks.workunit.client.0.smithi079.stdout:0/7: symlink l3 0 2024-09-10T09:35:55.469 INFO:tasks.workunit.client.0.smithi079.stdout:7/10: dwrite f0 [0,4194304] 0 2024-09-10T09:35:55.469 INFO:tasks.workunit.client.0.smithi079.stdout:7/11: chown f0 13290643 1 2024-09-10T09:35:55.469 INFO:tasks.workunit.client.0.smithi079.stdout:7/12: chown f0 118 1 2024-09-10T09:35:55.469 INFO:tasks.workunit.client.0.smithi079.stdout:7/13: creat f2 x:0 0 0 2024-09-10T09:35:55.469 INFO:tasks.workunit.client.0.smithi079.stdout:7/14: chown f0 49594413 1 2024-09-10T09:35:55.737 INFO:tasks.workunit.client.0.smithi079.stdout:6/29: dread d4/f6 [0,4194304] 0 2024-09-10T09:35:55.931 INFO:tasks.workunit.client.0.smithi079.stdout:8/10: dwrite f1 [0,4194304] 0 2024-09-10T09:35:55.999 INFO:tasks.workunit.client.0.smithi079.stdout:3/15: fsync f3 0 2024-09-10T09:35:56.014 INFO:tasks.workunit.client.0.smithi079.stdout:5/17: getdents d2 0 2024-09-10T09:35:56.023 INFO:tasks.workunit.client.0.smithi079.stdout:9/9: link c2 d3/c4 0 2024-09-10T09:35:56.024 INFO:tasks.workunit.client.0.smithi079.stdout:9/10: truncate - no filename 2024-09-10T09:35:56.024 INFO:tasks.workunit.client.0.smithi079.stdout:9/11: dread - no filename 2024-09-10T09:35:56.047 INFO:tasks.workunit.client.0.smithi079.stdout:4/4: dwrite f0 [4194304,4194304] 0 2024-09-10T09:35:56.075 INFO:tasks.workunit.client.0.smithi079.stdout:4/5: dwrite f0 [4194304,4194304] 0 2024-09-10T09:35:56.075 INFO:tasks.workunit.client.0.smithi079.stdout:4/6: readlink - no filename 2024-09-10T09:35:56.079 INFO:tasks.workunit.client.0.smithi079.stdout:0/8: getdents . 0 2024-09-10T09:35:56.079 INFO:tasks.workunit.client.0.smithi079.stdout:0/9: dread - f2 zero size 2024-09-10T09:35:56.091 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:55 smithi135 ceph-mon[33411]: pgmap v252: 65 pgs: 65 active+clean; 240 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.2 MiB/s rd, 9.8 MiB/s wr, 288 op/s 2024-09-10T09:35:56.091 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:55 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:55 smithi079 ceph-mon[27592]: pgmap v252: 65 pgs: 65 active+clean; 240 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.2 MiB/s rd, 9.8 MiB/s wr, 288 op/s 2024-09-10T09:35:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:55 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:35:57.269 INFO:tasks.workunit.client.0.smithi079.stdout:8/11: rename c2 to c3 0 2024-09-10T09:35:57.280 INFO:tasks.workunit.client.0.smithi079.stdout:3/16: mknod d4/c5 0 2024-09-10T09:35:57.280 INFO:tasks.workunit.client.0.smithi079.stdout:3/17: write f3 [743000,44127] 0 2024-09-10T09:35:57.280 INFO:tasks.workunit.client.0.smithi079.stdout:5/18: creat d2/f6 x:0 0 0 2024-09-10T09:35:57.282 INFO:tasks.workunit.client.0.smithi079.stdout:9/12: unlink d3/c4 0 2024-09-10T09:35:57.282 INFO:tasks.workunit.client.0.smithi079.stdout:9/13: dwrite - no filename 2024-09-10T09:35:57.282 INFO:tasks.workunit.client.0.smithi079.stdout:9/14: dwrite - no filename 2024-09-10T09:35:57.282 INFO:tasks.workunit.client.0.smithi079.stdout:9/15: chown d3 5430063 1 2024-09-10T09:35:57.285 INFO:tasks.workunit.client.0.smithi079.stdout:0/10: mkdir d4 0 2024-09-10T09:35:57.289 INFO:tasks.workunit.client.0.smithi079.stdout:8/12: dwrite f1 [0,4194304] 0 2024-09-10T09:35:57.290 INFO:tasks.workunit.client.0.smithi079.stdout:8/13: creat f4 x:0 0 0 2024-09-10T09:35:57.307 INFO:tasks.workunit.client.0.smithi079.stdout:8/14: dwrite f4 [0,4194304] 0 2024-09-10T09:35:57.308 INFO:tasks.workunit.client.0.smithi079.stdout:8/15: readlink - no filename 2024-09-10T09:35:57.318 INFO:tasks.workunit.client.0.smithi079.stdout:8/16: dread f4 [0,4194304] 0 2024-09-10T09:35:58.210 INFO:tasks.workunit.client.0.smithi079.stdout:6/30: link d4/f6 d4/d8/dc/fe 0 2024-09-10T09:35:58.211 INFO:tasks.workunit.client.0.smithi079.stdout:6/31: dread - f2 zero size 2024-09-10T09:35:58.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:57 smithi079 ceph-mon[27592]: pgmap v253: 65 pgs: 65 active+clean; 341 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 22 MiB/s wr, 457 op/s 2024-09-10T09:35:58.213 INFO:tasks.workunit.client.0.smithi079.stdout:3/18: unlink f3 0 2024-09-10T09:35:58.213 INFO:tasks.workunit.client.0.smithi079.stdout:3/19: write f2 [810933,47705] 0 2024-09-10T09:35:58.214 INFO:tasks.workunit.client.0.smithi079.stdout:5/19: rename d2 to d2/d3/d7 22 2024-09-10T09:35:58.215 INFO:tasks.workunit.client.0.smithi079.stdout:9/16: creat d3/f5 x:0 0 0 2024-09-10T09:35:58.217 INFO:tasks.workunit.client.0.smithi079.stdout:0/11: chown f1 42 1 2024-09-10T09:35:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:57 smithi135 ceph-mon[33411]: pgmap v253: 65 pgs: 65 active+clean; 341 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 22 MiB/s wr, 457 op/s 2024-09-10T09:35:58.220 INFO:tasks.workunit.client.0.smithi079.stdout:6/32: mkdir d4/d8/df 0 2024-09-10T09:35:58.221 INFO:tasks.workunit.client.0.smithi079.stdout:3/20: mknod d4/c6 0 2024-09-10T09:35:58.221 INFO:tasks.workunit.client.0.smithi079.stdout:3/21: truncate f2 1787139 0 2024-09-10T09:35:58.222 INFO:tasks.workunit.client.0.smithi079.stdout:3/22: write f2 [841021,41170] 0 2024-09-10T09:35:58.224 INFO:tasks.workunit.client.0.smithi079.stdout:0/12: creat d4/f5 x:0 0 0 2024-09-10T09:35:58.225 INFO:tasks.workunit.client.0.smithi079.stdout:8/17: link f4 f5 0 2024-09-10T09:35:58.229 INFO:tasks.workunit.client.0.smithi079.stdout:0/13: rename f1 to d4/f6 0 2024-09-10T09:35:58.232 INFO:tasks.workunit.client.0.smithi079.stdout:3/23: dread f2 [0,4194304] 0 2024-09-10T09:35:58.234 INFO:tasks.workunit.client.0.smithi079.stdout:5/20: dwrite d2/f6 [0,4194304] 0 2024-09-10T09:35:58.259 INFO:tasks.workunit.client.0.smithi079.stdout:6/33: dwrite d4/d8/fa [0,4194304] 0 2024-09-10T09:35:58.260 INFO:tasks.workunit.client.0.smithi079.stdout:5/21: dwrite d2/f6 [0,4194304] 0 2024-09-10T09:35:58.260 INFO:tasks.workunit.client.0.smithi079.stdout:8/18: dwrite f1 [0,4194304] 0 2024-09-10T09:35:58.261 INFO:tasks.workunit.client.0.smithi079.stdout:8/19: mknod c6 0 2024-09-10T09:35:58.262 INFO:tasks.workunit.client.0.smithi079.stdout:5/22: mknod d2/c8 0 2024-09-10T09:35:58.263 INFO:tasks.workunit.client.0.smithi079.stdout:8/20: link c0 c7 0 2024-09-10T09:35:58.268 INFO:tasks.workunit.client.0.smithi079.stdout:5/23: write d2/f6 [3273476,12154] 0 2024-09-10T09:35:58.269 INFO:tasks.workunit.client.0.smithi079.stdout:6/34: dread d4/d8/dc/fe [0,4194304] 0 2024-09-10T09:35:58.270 INFO:tasks.workunit.client.0.smithi079.stdout:6/35: creat d4/d8/df/f10 x:0 0 0 2024-09-10T09:35:58.271 INFO:tasks.workunit.client.0.smithi079.stdout:6/36: chown d4/d8/df/f10 0 1 2024-09-10T09:35:58.271 INFO:tasks.workunit.client.0.smithi079.stdout:6/37: stat d4/f5 0 2024-09-10T09:35:58.271 INFO:tasks.workunit.client.0.smithi079.stdout:6/38: truncate d4/f5 416359 0 2024-09-10T09:35:58.271 INFO:tasks.workunit.client.0.smithi079.stdout:6/39: fdatasync f3 0 2024-09-10T09:35:58.271 INFO:tasks.workunit.client.0.smithi079.stdout:6/40: creat d4/f11 x:0 0 0 2024-09-10T09:35:58.272 INFO:tasks.workunit.client.0.smithi079.stdout:6/41: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:58.272 INFO:tasks.workunit.client.0.smithi079.stdout:6/42: write d4/f11 [762686,100941] 0 2024-09-10T09:35:58.273 INFO:tasks.workunit.client.0.smithi079.stdout:7/15: getdents . 0 2024-09-10T09:35:58.273 INFO:tasks.workunit.client.0.smithi079.stdout:7/16: getdents . 0 2024-09-10T09:35:58.274 INFO:tasks.workunit.client.0.smithi079.stdout:7/17: mknod c3 0 2024-09-10T09:35:58.274 INFO:tasks.workunit.client.0.smithi079.stdout:7/18: chown f2 24 1 2024-09-10T09:35:58.275 INFO:tasks.workunit.client.0.smithi079.stdout:8/21: write f4 [1866796,19539] 0 2024-09-10T09:35:58.276 INFO:tasks.workunit.client.0.smithi079.stdout:5/24: dread d2/f6 [0,4194304] 0 2024-09-10T09:35:58.277 INFO:tasks.workunit.client.0.smithi079.stdout:5/25: mknod d2/d3/c9 0 2024-09-10T09:35:58.278 INFO:tasks.workunit.client.0.smithi079.stdout:8/22: fdatasync f5 0 2024-09-10T09:35:58.312 INFO:tasks.workunit.client.0.smithi079.stdout:6/43: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:58.313 INFO:tasks.workunit.client.0.smithi079.stdout:8/23: dwrite f5 [0,4194304] 0 2024-09-10T09:35:58.313 INFO:tasks.workunit.client.0.smithi079.stdout:7/19: dwrite f0 [0,4194304] 0 2024-09-10T09:35:58.313 INFO:tasks.workunit.client.0.smithi079.stdout:6/44: mkdir d4/d8/dc/d12 0 2024-09-10T09:35:58.315 INFO:tasks.workunit.client.0.smithi079.stdout:7/20: mkdir d4 0 2024-09-10T09:35:58.316 INFO:tasks.workunit.client.0.smithi079.stdout:6/45: mknod d4/d8/c13 0 2024-09-10T09:35:58.318 INFO:tasks.workunit.client.0.smithi079.stdout:6/46: mknod d4/d8/dc/c14 0 2024-09-10T09:35:58.322 INFO:tasks.workunit.client.0.smithi079.stdout:7/21: dread f0 [0,4194304] 0 2024-09-10T09:35:58.323 INFO:tasks.workunit.client.0.smithi079.stdout:7/22: creat d4/f5 x:0 0 0 2024-09-10T09:35:58.324 INFO:tasks.workunit.client.0.smithi079.stdout:7/23: mkdir d4/d6 0 2024-09-10T09:35:58.324 INFO:tasks.workunit.client.0.smithi079.stdout:7/24: write f2 [827757,58639] 0 2024-09-10T09:35:58.327 INFO:tasks.workunit.client.0.smithi079.stdout:7/25: dread f0 [0,4194304] 0 2024-09-10T09:35:58.416 INFO:tasks.workunit.client.0.smithi079.stdout:4/7: truncate f0 2018794 0 2024-09-10T09:35:58.417 INFO:tasks.workunit.client.0.smithi079.stdout:6/47: truncate f3 663921 0 2024-09-10T09:35:58.418 INFO:tasks.workunit.client.0.smithi079.stdout:4/8: symlink d1/l2 0 2024-09-10T09:35:58.419 INFO:tasks.workunit.client.0.smithi079.stdout:4/9: mknod d1/c3 0 2024-09-10T09:35:58.423 INFO:tasks.workunit.client.0.smithi079.stdout:6/48: write d4/d8/fa [3725472,43657] 0 2024-09-10T09:35:58.624 INFO:tasks.workunit.client.0.smithi079.stdout:9/17: rmdir d3 39 2024-09-10T09:35:58.624 INFO:tasks.workunit.client.0.smithi079.stdout:9/18: fdatasync d3/f5 0 2024-09-10T09:35:58.625 INFO:tasks.workunit.client.0.smithi079.stdout:9/19: mknod d3/c6 0 2024-09-10T09:35:58.625 INFO:tasks.workunit.client.0.smithi079.stdout:9/20: write d3/f5 [278145,89654] 0 2024-09-10T09:35:58.628 INFO:tasks.workunit.client.0.smithi079.stdout:0/14: unlink d4/f6 0 2024-09-10T09:35:58.629 INFO:tasks.workunit.client.0.smithi079.stdout:0/15: mknod d4/c7 0 2024-09-10T09:35:58.630 INFO:tasks.workunit.client.0.smithi079.stdout:3/24: truncate f2 1582377 0 2024-09-10T09:35:58.630 INFO:tasks.workunit.client.0.smithi079.stdout:9/21: dread d3/f5 [0,4194304] 0 2024-09-10T09:35:58.630 INFO:tasks.workunit.client.0.smithi079.stdout:0/16: dread - f2 zero size 2024-09-10T09:35:58.632 INFO:tasks.workunit.client.0.smithi079.stdout:3/25: creat d4/f7 x:0 0 0 2024-09-10T09:35:58.632 INFO:tasks.workunit.client.0.smithi079.stdout:3/26: creat d4/f8 x:0 0 0 2024-09-10T09:35:58.632 INFO:tasks.workunit.client.0.smithi079.stdout:3/27: read - d4/f7 zero size 2024-09-10T09:35:58.632 INFO:tasks.workunit.client.0.smithi079.stdout:3/28: chown c1 773 1 2024-09-10T09:35:58.632 INFO:tasks.workunit.client.0.smithi079.stdout:9/22: mkdir d3/d7 0 2024-09-10T09:35:58.633 INFO:tasks.workunit.client.0.smithi079.stdout:0/17: mkdir d4/d8 0 2024-09-10T09:35:58.635 INFO:tasks.workunit.client.0.smithi079.stdout:9/23: mknod d3/c8 0 2024-09-10T09:35:58.636 INFO:tasks.workunit.client.0.smithi079.stdout:0/18: mknod d4/c9 0 2024-09-10T09:35:58.639 INFO:tasks.workunit.client.0.smithi079.stdout:0/19: link l3 d4/la 0 2024-09-10T09:35:58.640 INFO:tasks.workunit.client.0.smithi079.stdout:0/20: write f0 [270795,130735] 0 2024-09-10T09:35:58.643 INFO:tasks.workunit.client.0.smithi079.stdout:8/24: truncate f5 81083 0 2024-09-10T09:35:58.643 INFO:tasks.workunit.client.0.smithi079.stdout:8/25: stat f4 0 2024-09-10T09:35:58.644 INFO:tasks.workunit.client.0.smithi079.stdout:6/49: getdents d4/d8/dc 0 2024-09-10T09:35:58.650 INFO:tasks.workunit.client.0.smithi079.stdout:1/29: sync 2024-09-10T09:35:58.650 INFO:tasks.workunit.client.0.smithi079.stdout:2/14: sync 2024-09-10T09:35:58.650 INFO:tasks.workunit.client.0.smithi079.stdout:1/30: dwrite - no filename 2024-09-10T09:35:58.650 INFO:tasks.workunit.client.0.smithi079.stdout:2/15: readlink l2 0 2024-09-10T09:35:58.652 INFO:tasks.workunit.client.0.smithi079.stdout:6/50: dread d4/d8/fa [0,4194304] 0 2024-09-10T09:35:58.652 INFO:tasks.workunit.client.0.smithi079.stdout:6/51: read - f2 zero size 2024-09-10T09:35:58.653 INFO:tasks.workunit.client.0.smithi079.stdout:6/52: creat d4/d8/df/f15 x:0 0 0 2024-09-10T09:35:58.654 INFO:tasks.workunit.client.0.smithi079.stdout:5/26: dwrite d2/f6 [4194304,4194304] 0 2024-09-10T09:35:58.654 INFO:tasks.workunit.client.0.smithi079.stdout:1/31: creat d5/f6 x:0 0 0 2024-09-10T09:35:58.661 INFO:tasks.workunit.client.0.smithi079.stdout:2/16: link d4/f5 d4/f6 0 2024-09-10T09:35:58.661 INFO:tasks.workunit.client.0.smithi079.stdout:6/53: mknod d4/d8/dc/c16 0 2024-09-10T09:35:58.661 INFO:tasks.workunit.client.0.smithi079.stdout:6/54: dread - d4/d8/df/f15 zero size 2024-09-10T09:35:58.664 INFO:tasks.workunit.client.0.smithi079.stdout:0/21: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:58.664 INFO:tasks.workunit.client.0.smithi079.stdout:4/10: dread f0 [0,4194304] 0 2024-09-10T09:35:58.665 INFO:tasks.workunit.client.0.smithi079.stdout:4/11: rename d1 to d1/d4 22 2024-09-10T09:35:58.665 INFO:tasks.workunit.client.0.smithi079.stdout:4/12: fdatasync f0 0 2024-09-10T09:35:58.665 INFO:tasks.workunit.client.0.smithi079.stdout:4/13: chown d1/c3 4203 1 2024-09-10T09:35:58.666 INFO:tasks.workunit.client.0.smithi079.stdout:5/27: creat d2/d3/fa x:0 0 0 2024-09-10T09:35:58.668 INFO:tasks.workunit.client.0.smithi079.stdout:2/17: mknod d4/c7 0 2024-09-10T09:35:58.669 INFO:tasks.workunit.client.0.smithi079.stdout:6/55: truncate d4/d8/fa 3483372 0 2024-09-10T09:35:58.669 INFO:tasks.workunit.client.0.smithi079.stdout:6/56: truncate d4/d8/df/f15 658238 0 2024-09-10T09:35:58.669 INFO:tasks.workunit.client.0.smithi079.stdout:6/57: fdatasync d4/d8/fb 0 2024-09-10T09:35:58.669 INFO:tasks.workunit.client.0.smithi079.stdout:4/14: dread f0 [0,4194304] 0 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/58: unlink d4/d8/c13 0 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/59: creat d4/f17 x:0 0 0 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/60: dread - d4/d8/df/f10 zero size 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/61: readlink l1 0 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:4/15: symlink d1/l5 0 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/62: write d4/f11 [28532,13935] 0 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/63: chown d4/d8/dc/c14 477202 1 2024-09-10T09:35:58.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/64: write d4/f17 [1033434,86958] 0 2024-09-10T09:35:58.682 INFO:tasks.workunit.client.0.smithi079.stdout:4/16: read f0 [379766,28932] 0 2024-09-10T09:35:58.682 INFO:tasks.workunit.client.0.smithi079.stdout:0/22: getdents d4 0 2024-09-10T09:35:58.682 INFO:tasks.workunit.client.0.smithi079.stdout:5/28: dread d2/f6 [4194304,4194304] 0 2024-09-10T09:35:58.682 INFO:tasks.workunit.client.0.smithi079.stdout:1/32: dwrite d5/f6 [0,4194304] 0 2024-09-10T09:35:58.682 INFO:tasks.workunit.client.0.smithi079.stdout:4/17: mknod d1/c6 0 2024-09-10T09:35:58.683 INFO:tasks.workunit.client.0.smithi079.stdout:0/23: creat d4/d8/fb x:0 0 0 2024-09-10T09:35:58.685 INFO:tasks.workunit.client.0.smithi079.stdout:8/26: rename f4 to f8 0 2024-09-10T09:35:58.685 INFO:tasks.workunit.client.0.smithi079.stdout:8/27: chown f5 20832423 1 2024-09-10T09:35:58.686 INFO:tasks.workunit.client.0.smithi079.stdout:4/18: dread f0 [0,4194304] 0 2024-09-10T09:35:58.686 INFO:tasks.workunit.client.0.smithi079.stdout:4/19: chown d1/l5 2 1 2024-09-10T09:35:58.688 INFO:tasks.workunit.client.0.smithi079.stdout:4/20: write f0 [1301644,1336] 0 2024-09-10T09:35:58.689 INFO:tasks.workunit.client.0.smithi079.stdout:4/21: chown f0 3295 1 2024-09-10T09:35:58.689 INFO:tasks.workunit.client.0.smithi079.stdout:4/22: chown d1/c6 53 1 2024-09-10T09:35:58.689 INFO:tasks.workunit.client.0.smithi079.stdout:3/29: dwrite f2 [0,4194304] 0 2024-09-10T09:35:58.691 INFO:tasks.workunit.client.0.smithi079.stdout:0/24: symlink d4/d8/lc 0 2024-09-10T09:35:58.691 INFO:tasks.workunit.client.0.smithi079.stdout:7/26: sync 2024-09-10T09:35:58.693 INFO:tasks.workunit.client.0.smithi079.stdout:8/28: rename c3 to c9 0 2024-09-10T09:35:58.693 INFO:tasks.workunit.client.0.smithi079.stdout:2/18: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:58.693 INFO:tasks.workunit.client.0.smithi079.stdout:8/29: creat fa x:0 0 0 2024-09-10T09:35:58.695 INFO:tasks.workunit.client.0.smithi079.stdout:4/23: creat d1/f7 x:0 0 0 2024-09-10T09:35:58.695 INFO:tasks.workunit.client.0.smithi079.stdout:4/24: creat d1/f8 x:0 0 0 2024-09-10T09:35:58.695 INFO:tasks.workunit.client.0.smithi079.stdout:4/25: chown d1/c6 67 1 2024-09-10T09:35:58.696 INFO:tasks.workunit.client.0.smithi079.stdout:4/26: dread - d1/f8 zero size 2024-09-10T09:35:58.696 INFO:tasks.workunit.client.0.smithi079.stdout:4/27: creat d1/f9 x:0 0 0 2024-09-10T09:35:58.696 INFO:tasks.workunit.client.0.smithi079.stdout:4/28: stat d1/c3 0 2024-09-10T09:35:58.696 INFO:tasks.workunit.client.0.smithi079.stdout:8/30: dread f8 [0,4194304] 0 2024-09-10T09:35:58.697 INFO:tasks.workunit.client.0.smithi079.stdout:6/65: dread d4/f17 [0,4194304] 0 2024-09-10T09:35:58.700 INFO:tasks.workunit.client.0.smithi079.stdout:3/30: link f2 d4/f9 0 2024-09-10T09:35:58.700 INFO:tasks.workunit.client.0.smithi079.stdout:3/31: readlink - no filename 2024-09-10T09:35:58.702 INFO:tasks.workunit.client.0.smithi079.stdout:0/25: creat d4/fd x:0 0 0 2024-09-10T09:35:58.702 INFO:tasks.workunit.client.0.smithi079.stdout:0/26: creat d4/fe x:0 0 0 2024-09-10T09:35:58.704 INFO:tasks.workunit.client.0.smithi079.stdout:4/29: dread f0 [0,4194304] 0 2024-09-10T09:35:58.704 INFO:tasks.workunit.client.0.smithi079.stdout:4/30: readlink d1/l5 0 2024-09-10T09:35:58.704 INFO:tasks.workunit.client.0.smithi079.stdout:4/31: dread - d1/f8 zero size 2024-09-10T09:35:58.704 INFO:tasks.workunit.client.0.smithi079.stdout:4/32: dread - d1/f7 zero size 2024-09-10T09:35:58.704 INFO:tasks.workunit.client.0.smithi079.stdout:2/19: mknod d4/c8 0 2024-09-10T09:35:58.711 INFO:tasks.workunit.client.0.smithi079.stdout:5/29: dwrite d2/f6 [4194304,4194304] 0 2024-09-10T09:35:58.711 INFO:tasks.workunit.client.0.smithi079.stdout:5/30: creat d2/d3/fb x:0 0 0 2024-09-10T09:35:58.711 INFO:tasks.workunit.client.0.smithi079.stdout:5/31: chown d2/c8 3 1 2024-09-10T09:35:58.711 INFO:tasks.workunit.client.0.smithi079.stdout:5/32: truncate d2/d3/fa 133132 0 2024-09-10T09:35:58.712 INFO:tasks.workunit.client.0.smithi079.stdout:0/27: symlink d4/lf 0 2024-09-10T09:35:58.713 INFO:tasks.workunit.client.0.smithi079.stdout:0/28: write d4/fe [813410,57832] 0 2024-09-10T09:35:58.714 INFO:tasks.workunit.client.0.smithi079.stdout:8/31: link f8 fb 0 2024-09-10T09:35:58.716 INFO:tasks.workunit.client.0.smithi079.stdout:4/33: mkdir d1/da 0 2024-09-10T09:35:58.716 INFO:tasks.workunit.client.0.smithi079.stdout:3/32: write d4/f9 [3633154,43135] 0 2024-09-10T09:35:58.718 INFO:tasks.workunit.client.0.smithi079.stdout:7/27: dwrite f2 [0,4194304] 0 2024-09-10T09:35:58.720 INFO:tasks.workunit.client.0.smithi079.stdout:4/34: dread f0 [0,4194304] 0 2024-09-10T09:35:58.723 INFO:tasks.workunit.client.0.smithi079.stdout:6/66: dwrite d4/d8/fb [0,4194304] 0 2024-09-10T09:35:58.723 INFO:tasks.workunit.client.0.smithi079.stdout:0/29: unlink d4/lf 0 2024-09-10T09:35:58.723 INFO:tasks.workunit.client.0.smithi079.stdout:0/30: dread - f2 zero size 2024-09-10T09:35:58.723 INFO:tasks.workunit.client.0.smithi079.stdout:1/33: write d5/f6 [4993068,18746] 0 2024-09-10T09:35:58.724 INFO:tasks.workunit.client.0.smithi079.stdout:8/32: symlink lc 0 2024-09-10T09:35:58.725 INFO:tasks.workunit.client.0.smithi079.stdout:2/20: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:58.727 INFO:tasks.workunit.client.0.smithi079.stdout:7/28: symlink d4/d6/l7 0 2024-09-10T09:35:58.727 INFO:tasks.workunit.client.0.smithi079.stdout:7/29: write d4/f5 [755102,55378] 0 2024-09-10T09:35:58.728 INFO:tasks.workunit.client.0.smithi079.stdout:4/35: creat d1/da/fb x:0 0 0 2024-09-10T09:35:58.731 INFO:tasks.workunit.client.0.smithi079.stdout:7/30: dread f0 [0,4194304] 0 2024-09-10T09:35:58.731 INFO:tasks.workunit.client.0.smithi079.stdout:7/31: chown f2 59728 1 2024-09-10T09:35:58.732 INFO:tasks.workunit.client.0.smithi079.stdout:6/67: symlink d4/d8/dc/d12/l18 0 2024-09-10T09:35:58.732 INFO:tasks.workunit.client.0.smithi079.stdout:6/68: write f2 [440212,128777] 0 2024-09-10T09:35:58.735 INFO:tasks.workunit.client.0.smithi079.stdout:5/33: dwrite d2/f6 [4194304,4194304] 0 2024-09-10T09:35:58.735 INFO:tasks.workunit.client.0.smithi079.stdout:5/34: write d2/d3/fa [551406,117422] 0 2024-09-10T09:35:58.735 INFO:tasks.workunit.client.0.smithi079.stdout:5/35: readlink l1 0 2024-09-10T09:35:58.736 INFO:tasks.workunit.client.0.smithi079.stdout:7/32: dread f0 [0,4194304] 0 2024-09-10T09:35:58.736 INFO:tasks.workunit.client.0.smithi079.stdout:7/33: fsync f0 0 2024-09-10T09:35:58.794 INFO:tasks.workunit.client.0.smithi079.stdout:0/31: truncate d4/f5 3839253 0 2024-09-10T09:35:58.795 INFO:tasks.workunit.client.0.smithi079.stdout:0/32: chown l3 7 1 2024-09-10T09:35:58.795 INFO:tasks.workunit.client.0.smithi079.stdout:0/33: chown f0 320046 1 2024-09-10T09:35:58.795 INFO:tasks.workunit.client.0.smithi079.stdout:0/34: creat d4/f10 x:0 0 0 2024-09-10T09:35:58.798 INFO:tasks.workunit.client.0.smithi079.stdout:2/21: link d4/c7 d4/c9 0 2024-09-10T09:35:58.801 INFO:tasks.workunit.client.0.smithi079.stdout:4/36: rename d1/f8 to d1/fc 0 2024-09-10T09:35:58.801 INFO:tasks.workunit.client.0.smithi079.stdout:4/37: creat d1/da/fd x:0 0 0 2024-09-10T09:35:58.802 INFO:tasks.workunit.client.0.smithi079.stdout:6/69: truncate d4/d8/fa 2897077 0 2024-09-10T09:35:58.805 INFO:tasks.workunit.client.0.smithi079.stdout:1/34: getdents d5 0 2024-09-10T09:35:58.809 INFO:tasks.workunit.client.0.smithi079.stdout:6/70: truncate d4/f5 2004254 0 2024-09-10T09:35:58.812 INFO:tasks.workunit.client.0.smithi079.stdout:1/35: symlink d5/l7 0 2024-09-10T09:35:58.813 INFO:tasks.workunit.client.0.smithi079.stdout:8/33: dwrite fb [0,4194304] 0 2024-09-10T09:35:58.813 INFO:tasks.workunit.client.0.smithi079.stdout:8/34: truncate fb 4561591 0 2024-09-10T09:35:58.813 INFO:tasks.workunit.client.0.smithi079.stdout:5/36: dwrite d2/d3/fb [0,4194304] 0 2024-09-10T09:35:58.817 INFO:tasks.workunit.client.0.smithi079.stdout:1/36: unlink l1 0 2024-09-10T09:35:58.817 INFO:tasks.workunit.client.0.smithi079.stdout:3/33: dwrite f2 [0,4194304] 0 2024-09-10T09:35:58.819 INFO:tasks.workunit.client.0.smithi079.stdout:8/35: symlink ld 0 2024-09-10T09:35:58.819 INFO:tasks.workunit.client.0.smithi079.stdout:8/36: creat fe x:0 0 0 2024-09-10T09:35:58.820 INFO:tasks.workunit.client.0.smithi079.stdout:8/37: creat ff x:0 0 0 2024-09-10T09:35:58.820 INFO:tasks.workunit.client.0.smithi079.stdout:8/38: stat ff 0 2024-09-10T09:35:58.832 INFO:tasks.workunit.client.0.smithi079.stdout:1/37: write d5/f6 [4479340,43042] 0 2024-09-10T09:35:58.832 INFO:tasks.workunit.client.0.smithi079.stdout:5/37: dread d2/d3/fb [0,4194304] 0 2024-09-10T09:35:58.834 INFO:tasks.workunit.client.0.smithi079.stdout:2/22: getdents d4 0 2024-09-10T09:35:58.835 INFO:tasks.workunit.client.0.smithi079.stdout:6/71: write d4/f6 [1047160,14560] 0 2024-09-10T09:35:58.836 INFO:tasks.workunit.client.0.smithi079.stdout:0/35: dwrite d4/d8/fb [0,4194304] 0 2024-09-10T09:35:58.836 INFO:tasks.workunit.client.0.smithi079.stdout:0/36: stat f0 0 2024-09-10T09:35:58.838 INFO:tasks.workunit.client.0.smithi079.stdout:0/37: creat d4/f11 x:0 0 0 2024-09-10T09:35:58.839 INFO:tasks.workunit.client.0.smithi079.stdout:3/34: mkdir d4/da 0 2024-09-10T09:35:58.839 INFO:tasks.workunit.client.0.smithi079.stdout:3/35: stat c0 0 2024-09-10T09:35:58.841 INFO:tasks.workunit.client.0.smithi079.stdout:1/38: creat d5/f8 x:0 0 0 2024-09-10T09:35:58.842 INFO:tasks.workunit.client.0.smithi079.stdout:5/38: symlink d2/d3/lc 0 2024-09-10T09:35:58.845 INFO:tasks.workunit.client.0.smithi079.stdout:2/23: symlink d4/la 0 2024-09-10T09:35:58.845 INFO:tasks.workunit.client.0.smithi079.stdout:2/24: chown d4/la 29 1 2024-09-10T09:35:58.848 INFO:tasks.workunit.client.0.smithi079.stdout:6/72: creat d4/d8/dd/f19 x:0 0 0 2024-09-10T09:35:58.848 INFO:tasks.workunit.client.0.smithi079.stdout:6/73: stat d4/f11 0 2024-09-10T09:35:58.849 INFO:tasks.workunit.client.0.smithi079.stdout:4/38: dwrite d1/da/fb [0,4194304] 0 2024-09-10T09:35:58.849 INFO:tasks.workunit.client.0.smithi079.stdout:4/39: fsync d1/f7 0 2024-09-10T09:35:58.849 INFO:tasks.workunit.client.0.smithi079.stdout:4/40: read - d1/fc zero size 2024-09-10T09:35:58.849 INFO:tasks.workunit.client.0.smithi079.stdout:4/41: dread - d1/da/fd zero size 2024-09-10T09:35:58.850 INFO:tasks.workunit.client.0.smithi079.stdout:7/34: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:58.858 INFO:tasks.workunit.client.0.smithi079.stdout:4/42: rename f0 to d1/fe 0 2024-09-10T09:35:58.858 INFO:tasks.workunit.client.0.smithi079.stdout:4/43: read - d1/f7 zero size 2024-09-10T09:35:58.859 INFO:tasks.workunit.client.0.smithi079.stdout:4/44: write d1/da/fd [510159,28978] 0 2024-09-10T09:35:58.859 INFO:tasks.workunit.client.0.smithi079.stdout:4/45: dread - d1/fc zero size 2024-09-10T09:35:58.859 INFO:tasks.workunit.client.0.smithi079.stdout:4/46: creat d1/ff x:0 0 0 2024-09-10T09:35:58.868 INFO:tasks.workunit.client.0.smithi079.stdout:0/38: dwrite d4/f11 [0,4194304] 0 2024-09-10T09:35:58.868 INFO:tasks.workunit.client.0.smithi079.stdout:8/39: dwrite fa [0,4194304] 0 2024-09-10T09:35:58.868 INFO:tasks.workunit.client.0.smithi079.stdout:8/40: write fe [783603,23593] 0 2024-09-10T09:35:58.869 INFO:tasks.workunit.client.0.smithi079.stdout:4/47: mknod d1/da/c10 0 2024-09-10T09:35:58.869 INFO:tasks.workunit.client.0.smithi079.stdout:4/48: creat d1/f11 x:0 0 0 2024-09-10T09:35:58.869 INFO:tasks.workunit.client.0.smithi079.stdout:4/49: readlink d1/l5 0 2024-09-10T09:35:58.871 INFO:tasks.workunit.client.0.smithi079.stdout:0/39: truncate d4/f5 2805538 0 2024-09-10T09:35:58.874 INFO:tasks.workunit.client.0.smithi079.stdout:4/50: symlink d1/da/l12 0 2024-09-10T09:35:58.874 INFO:tasks.workunit.client.0.smithi079.stdout:4/51: chown d1/da/fb 3178 1 2024-09-10T09:35:58.880 INFO:tasks.workunit.client.0.smithi079.stdout:6/74: truncate d4/f11 488018 0 2024-09-10T09:35:58.881 INFO:tasks.workunit.client.0.smithi079.stdout:9/24: sync 2024-09-10T09:35:58.883 INFO:tasks.workunit.client.0.smithi079.stdout:9/25: rmdir d3 39 2024-09-10T09:35:58.883 INFO:tasks.workunit.client.0.smithi079.stdout:9/26: symlink d3/l9 0 2024-09-10T09:35:58.884 INFO:tasks.workunit.client.0.smithi079.stdout:9/27: write d3/f5 [442986,60606] 0 2024-09-10T09:35:58.895 INFO:tasks.workunit.client.0.smithi079.stdout:3/36: dwrite d4/f9 [0,4194304] 0 2024-09-10T09:35:58.896 INFO:tasks.workunit.client.0.smithi079.stdout:7/35: dwrite f0 [0,4194304] 0 2024-09-10T09:35:58.896 INFO:tasks.workunit.client.0.smithi079.stdout:3/37: stat f2 0 2024-09-10T09:35:58.896 INFO:tasks.workunit.client.0.smithi079.stdout:3/38: write d4/f8 [43703,96655] 0 2024-09-10T09:35:58.896 INFO:tasks.workunit.client.0.smithi079.stdout:1/39: dwrite d5/f8 [0,4194304] 0 2024-09-10T09:35:58.896 INFO:tasks.workunit.client.0.smithi079.stdout:5/39: dwrite d2/f6 [8388608,4194304] 0 2024-09-10T09:35:58.896 INFO:tasks.workunit.client.0.smithi079.stdout:8/41: dwrite f5 [4194304,4194304] 0 2024-09-10T09:35:58.901 INFO:tasks.workunit.client.0.smithi079.stdout:0/40: write d4/f11 [5075437,82559] 0 2024-09-10T09:35:58.901 INFO:tasks.workunit.client.0.smithi079.stdout:0/41: readlink d4/la 0 2024-09-10T09:35:58.901 INFO:tasks.workunit.client.0.smithi079.stdout:0/42: write d4/f10 [36519,83629] 0 2024-09-10T09:35:58.902 INFO:tasks.workunit.client.0.smithi079.stdout:3/39: dread f2 [0,4194304] 0 2024-09-10T09:35:58.906 INFO:tasks.workunit.client.0.smithi079.stdout:3/40: dread d4/f8 [0,4194304] 0 2024-09-10T09:35:58.906 INFO:tasks.workunit.client.0.smithi079.stdout:3/41: write d4/f8 [1079251,10039] 0 2024-09-10T09:35:58.906 INFO:tasks.workunit.client.0.smithi079.stdout:3/42: chown d4/c6 418 1 2024-09-10T09:35:58.906 INFO:tasks.workunit.client.0.smithi079.stdout:3/43: dread - d4/f7 zero size 2024-09-10T09:35:58.907 INFO:tasks.workunit.client.0.smithi079.stdout:4/52: rmdir d1 39 2024-09-10T09:35:58.908 INFO:tasks.workunit.client.0.smithi079.stdout:8/42: rename lc to l10 0 2024-09-10T09:35:58.909 INFO:tasks.workunit.client.0.smithi079.stdout:7/36: rmdir d4 39 2024-09-10T09:35:58.909 INFO:tasks.workunit.client.0.smithi079.stdout:7/37: chown f2 316454 1 2024-09-10T09:35:58.909 INFO:tasks.workunit.client.0.smithi079.stdout:3/44: dread f2 [0,4194304] 0 2024-09-10T09:35:58.909 INFO:tasks.workunit.client.0.smithi079.stdout:3/45: chown d4/f7 1042 1 2024-09-10T09:35:58.909 INFO:tasks.workunit.client.0.smithi079.stdout:3/46: creat d4/fb x:0 0 0 2024-09-10T09:35:58.909 INFO:tasks.workunit.client.0.smithi079.stdout:3/47: dread - d4/f7 zero size 2024-09-10T09:35:58.910 INFO:tasks.workunit.client.0.smithi079.stdout:9/28: getdents d3 0 2024-09-10T09:35:58.912 INFO:tasks.workunit.client.0.smithi079.stdout:0/43: truncate d4/fe 93731 0 2024-09-10T09:35:58.913 INFO:tasks.workunit.client.0.smithi079.stdout:1/40: truncate d5/f6 295144 0 2024-09-10T09:35:58.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/40: mknod d2/cd 0 2024-09-10T09:35:58.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/41: chown d2/c8 52370898 1 2024-09-10T09:35:58.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/42: stat d2/cd 0 2024-09-10T09:35:58.915 INFO:tasks.workunit.client.0.smithi079.stdout:7/38: read f0 [1557107,72870] 0 2024-09-10T09:35:58.916 INFO:tasks.workunit.client.0.smithi079.stdout:4/53: link d1/fe d1/da/f13 0 2024-09-10T09:35:58.916 INFO:tasks.workunit.client.0.smithi079.stdout:4/54: write d1/da/fd [1291982,111889] 0 2024-09-10T09:35:58.916 INFO:tasks.workunit.client.0.smithi079.stdout:4/55: dread - d1/f7 zero size 2024-09-10T09:35:58.916 INFO:tasks.workunit.client.0.smithi079.stdout:4/56: write d1/fe [1112618,36071] 0 2024-09-10T09:35:58.918 INFO:tasks.workunit.client.0.smithi079.stdout:8/43: dread f8 [0,4194304] 0 2024-09-10T09:35:58.918 INFO:tasks.workunit.client.0.smithi079.stdout:9/29: dread d3/f5 [0,4194304] 0 2024-09-10T09:35:58.919 INFO:tasks.workunit.client.0.smithi079.stdout:3/48: rename d4/f9 to d4/fc 0 2024-09-10T09:35:58.919 INFO:tasks.workunit.client.0.smithi079.stdout:5/43: dread d2/d3/fa [0,4194304] 0 2024-09-10T09:35:58.919 INFO:tasks.workunit.client.0.smithi079.stdout:5/44: creat d2/d3/fe x:0 0 0 2024-09-10T09:35:58.920 INFO:tasks.workunit.client.0.smithi079.stdout:0/44: mkdir d4/d12 0 2024-09-10T09:35:58.920 INFO:tasks.workunit.client.0.smithi079.stdout:0/45: truncate d4/f5 2805833 0 2024-09-10T09:35:58.922 INFO:tasks.workunit.client.0.smithi079.stdout:7/39: mknod d4/c8 0 2024-09-10T09:35:58.924 INFO:tasks.workunit.client.0.smithi079.stdout:8/44: mkdir d11 0 2024-09-10T09:35:58.925 INFO:tasks.workunit.client.0.smithi079.stdout:9/30: creat d3/fa x:0 0 0 2024-09-10T09:35:58.925 INFO:tasks.workunit.client.0.smithi079.stdout:9/31: chown d3/fa 113358772 1 2024-09-10T09:35:58.926 INFO:tasks.workunit.client.0.smithi079.stdout:3/49: symlink d4/ld 0 2024-09-10T09:35:58.933 INFO:tasks.workunit.client.0.smithi079.stdout:0/46: creat d4/d12/f13 x:0 0 0 2024-09-10T09:35:58.933 INFO:tasks.workunit.client.0.smithi079.stdout:0/47: chown d4/f10 140 1 2024-09-10T09:35:58.940 INFO:tasks.workunit.client.0.smithi079.stdout:1/41: symlink d5/l9 0 2024-09-10T09:35:58.941 INFO:tasks.workunit.client.0.smithi079.stdout:7/40: mknod d4/c9 0 2024-09-10T09:35:58.941 INFO:tasks.workunit.client.0.smithi079.stdout:7/41: write d4/f5 [4402136,12653] 0 2024-09-10T09:35:58.944 INFO:tasks.workunit.client.0.smithi079.stdout:8/45: creat d11/f12 x:0 0 0 2024-09-10T09:35:58.945 INFO:tasks.workunit.client.0.smithi079.stdout:9/32: creat d3/d7/fb x:0 0 0 2024-09-10T09:35:58.948 INFO:tasks.workunit.client.0.smithi079.stdout:1/42: stat l3 0 2024-09-10T09:35:58.948 INFO:tasks.workunit.client.0.smithi079.stdout:1/43: fdatasync d5/f6 0 2024-09-10T09:35:58.974 INFO:tasks.workunit.client.0.smithi079.stdout:5/45: dwrite d2/d3/fa [0,4194304] 0 2024-09-10T09:35:58.974 INFO:tasks.workunit.client.0.smithi079.stdout:4/57: dwrite d1/fe [0,4194304] 0 2024-09-10T09:35:58.974 INFO:tasks.workunit.client.0.smithi079.stdout:3/50: dwrite d4/fc [0,4194304] 0 2024-09-10T09:35:58.975 INFO:tasks.workunit.client.0.smithi079.stdout:0/48: dwrite d4/fd [0,4194304] 0 2024-09-10T09:35:58.975 INFO:tasks.workunit.client.0.smithi079.stdout:8/46: dwrite f8 [4194304,4194304] 0 2024-09-10T09:35:58.975 INFO:tasks.workunit.client.0.smithi079.stdout:8/47: truncate d11/f12 259299 0 2024-09-10T09:35:58.975 INFO:tasks.workunit.client.0.smithi079.stdout:0/49: creat d4/d12/f14 x:0 0 0 2024-09-10T09:35:58.976 INFO:tasks.workunit.client.0.smithi079.stdout:1/44: dread d5/f6 [0,4194304] 0 2024-09-10T09:35:58.980 INFO:tasks.workunit.client.0.smithi079.stdout:5/46: write d2/d3/fb [1551607,73384] 0 2024-09-10T09:35:58.980 INFO:tasks.workunit.client.0.smithi079.stdout:5/47: creat d2/d3/ff x:0 0 0 2024-09-10T09:35:58.986 INFO:tasks.workunit.client.0.smithi079.stdout:3/51: mknod d4/ce 0 2024-09-10T09:35:58.990 INFO:tasks.workunit.client.0.smithi079.stdout:7/42: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:58.991 INFO:tasks.workunit.client.0.smithi079.stdout:8/48: unlink c7 0 2024-09-10T09:35:58.991 INFO:tasks.workunit.client.0.smithi079.stdout:8/49: chown d11 13009584 1 2024-09-10T09:35:58.991 INFO:tasks.workunit.client.0.smithi079.stdout:8/50: creat d11/f13 x:0 0 0 2024-09-10T09:35:58.994 INFO:tasks.workunit.client.0.smithi079.stdout:3/52: dread f2 [0,4194304] 0 2024-09-10T09:35:59.032 INFO:tasks.workunit.client.0.smithi079.stdout:4/58: write d1/da/f13 [542227,4725] 0 2024-09-10T09:35:59.036 INFO:tasks.workunit.client.0.smithi079.stdout:7/43: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:59.036 INFO:tasks.workunit.client.0.smithi079.stdout:0/50: dwrite d4/fd [0,4194304] 0 2024-09-10T09:35:59.036 INFO:tasks.workunit.client.0.smithi079.stdout:0/51: chown d4/c7 0 1 2024-09-10T09:35:59.038 INFO:tasks.workunit.client.0.smithi079.stdout:3/53: creat d4/da/ff x:0 0 0 2024-09-10T09:35:59.038 INFO:tasks.workunit.client.0.smithi079.stdout:1/45: rename d5/l9 to d5/la 0 2024-09-10T09:35:59.040 INFO:tasks.workunit.client.0.smithi079.stdout:7/44: unlink f2 0 2024-09-10T09:35:59.042 INFO:tasks.workunit.client.0.smithi079.stdout:8/51: rename d11/f13 to d11/f14 0 2024-09-10T09:35:59.043 INFO:tasks.workunit.client.0.smithi079.stdout:2/25: sync 2024-09-10T09:35:59.046 INFO:tasks.workunit.client.0.smithi079.stdout:0/52: dread d4/fd [0,4194304] 0 2024-09-10T09:35:59.046 INFO:tasks.workunit.client.0.smithi079.stdout:3/54: mknod d4/da/c10 0 2024-09-10T09:35:59.046 INFO:tasks.workunit.client.0.smithi079.stdout:3/55: creat d4/da/f11 x:0 0 0 2024-09-10T09:35:59.046 INFO:tasks.workunit.client.0.smithi079.stdout:5/48: dread d2/d3/fb [0,4194304] 0 2024-09-10T09:35:59.048 INFO:tasks.workunit.client.0.smithi079.stdout:7/45: creat d4/d6/fa x:0 0 0 2024-09-10T09:35:59.048 INFO:tasks.workunit.client.0.smithi079.stdout:7/46: fsync f0 0 2024-09-10T09:35:59.048 INFO:tasks.workunit.client.0.smithi079.stdout:6/75: sync 2024-09-10T09:35:59.052 INFO:tasks.workunit.client.0.smithi079.stdout:5/49: symlink d2/d3/l10 0 2024-09-10T09:35:59.058 INFO:tasks.workunit.client.0.smithi079.stdout:8/52: dread fa [0,4194304] 0 2024-09-10T09:35:59.059 INFO:tasks.workunit.client.0.smithi079.stdout:4/59: dwrite d1/fe [4194304,4194304] 0 2024-09-10T09:35:59.061 INFO:tasks.workunit.client.0.smithi079.stdout:4/60: mkdir d1/da/d14 0 2024-09-10T09:35:59.074 INFO:tasks.workunit.client.0.smithi079.stdout:7/47: rmdir d4/d6 39 2024-09-10T09:35:59.074 INFO:tasks.workunit.client.0.smithi079.stdout:7/48: chown d4/f5 29 1 2024-09-10T09:35:59.076 INFO:tasks.workunit.client.0.smithi079.stdout:7/49: mknod d4/d6/cb 0 2024-09-10T09:35:59.090 INFO:tasks.workunit.client.0.smithi079.stdout:4/61: dread d1/da/fb [0,4194304] 0 2024-09-10T09:35:59.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/53: dwrite d4/d8/fb [0,4194304] 0 2024-09-10T09:35:59.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/54: dread - d4/d12/f14 zero size 2024-09-10T09:35:59.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/55: write d4/f10 [655928,100166] 0 2024-09-10T09:35:59.101 INFO:tasks.workunit.client.0.smithi079.stdout:1/46: dwrite d5/f8 [0,4194304] 0 2024-09-10T09:35:59.105 INFO:tasks.workunit.client.0.smithi079.stdout:4/62: write d1/da/f13 [4296013,74876] 0 2024-09-10T09:35:59.106 INFO:tasks.workunit.client.0.smithi079.stdout:4/63: write d1/da/fd [49827,42720] 0 2024-09-10T09:35:59.106 INFO:tasks.workunit.client.0.smithi079.stdout:4/64: rename d1/da to d1/da/d14/d15 22 2024-09-10T09:35:59.109 INFO:tasks.workunit.client.0.smithi079.stdout:3/56: dwrite f2 [0,4194304] 0 2024-09-10T09:35:59.110 INFO:tasks.workunit.client.0.smithi079.stdout:7/50: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:35:59.111 INFO:tasks.workunit.client.0.smithi079.stdout:0/56: read d4/f5 [2528137,27176] 0 2024-09-10T09:35:59.111 INFO:tasks.workunit.client.0.smithi079.stdout:6/76: dwrite d4/f17 [0,4194304] 0 2024-09-10T09:35:59.111 INFO:tasks.workunit.client.0.smithi079.stdout:2/26: dwrite d4/f6 [0,4194304] 0 2024-09-10T09:35:59.111 INFO:tasks.workunit.client.0.smithi079.stdout:2/27: readlink l0 0 2024-09-10T09:35:59.111 INFO:tasks.workunit.client.0.smithi079.stdout:8/53: dwrite d11/f12 [0,4194304] 0 2024-09-10T09:35:59.112 INFO:tasks.workunit.client.0.smithi079.stdout:4/65: getdents d1/da 0 2024-09-10T09:35:59.112 INFO:tasks.workunit.client.0.smithi079.stdout:4/66: getdents d1/da 0 2024-09-10T09:35:59.113 INFO:tasks.workunit.client.0.smithi079.stdout:4/67: fdatasync d1/f11 0 2024-09-10T09:35:59.113 INFO:tasks.workunit.client.0.smithi079.stdout:4/68: chown d1/f9 38841 1 2024-09-10T09:35:59.113 INFO:tasks.workunit.client.0.smithi079.stdout:4/69: stat d1/f11 0 2024-09-10T09:35:59.115 INFO:tasks.workunit.client.0.smithi079.stdout:7/51: rmdir d4/d6 39 2024-09-10T09:35:59.115 INFO:tasks.workunit.client.0.smithi079.stdout:1/47: dread d5/f8 [0,4194304] 0 2024-09-10T09:35:59.115 INFO:tasks.workunit.client.0.smithi079.stdout:5/50: dwrite d2/f6 [12582912,4194304] 0 2024-09-10T09:35:59.115 INFO:tasks.workunit.client.0.smithi079.stdout:5/51: dread - d2/d3/ff zero size 2024-09-10T09:35:59.115 INFO:tasks.workunit.client.0.smithi079.stdout:5/52: dread - d2/d3/fe zero size 2024-09-10T09:35:59.115 INFO:tasks.workunit.client.0.smithi079.stdout:1/48: read d5/f6 [253391,7347] 0 2024-09-10T09:35:59.116 INFO:tasks.workunit.client.0.smithi079.stdout:0/57: mkdir d4/d12/d15 0 2024-09-10T09:35:59.118 INFO:tasks.workunit.client.0.smithi079.stdout:1/49: dread d5/f8 [0,4194304] 0 2024-09-10T09:35:59.119 INFO:tasks.workunit.client.0.smithi079.stdout:9/33: sync 2024-09-10T09:35:59.122 INFO:tasks.workunit.client.0.smithi079.stdout:2/28: creat d4/fb x:0 0 0 2024-09-10T09:35:59.123 INFO:tasks.workunit.client.0.smithi079.stdout:8/54: truncate f1 1771598 0 2024-09-10T09:35:59.123 INFO:tasks.workunit.client.0.smithi079.stdout:8/55: chown d11 5 1 2024-09-10T09:35:59.125 INFO:tasks.workunit.client.0.smithi079.stdout:4/70: rename d1/da/d14 to d1/da/d16 0 2024-09-10T09:35:59.126 INFO:tasks.workunit.client.0.smithi079.stdout:7/52: mkdir d4/dc 0 2024-09-10T09:35:59.127 INFO:tasks.workunit.client.0.smithi079.stdout:0/58: mkdir d4/d12/d16 0 2024-09-10T09:35:59.127 INFO:tasks.workunit.client.0.smithi079.stdout:0/59: getdents d4/d12/d15 0 2024-09-10T09:35:59.127 INFO:tasks.workunit.client.0.smithi079.stdout:0/60: getdents d4/d12/d16 0 2024-09-10T09:35:59.131 INFO:tasks.workunit.client.0.smithi079.stdout:9/34: mkdir d3/d7/dc 0 2024-09-10T09:35:59.131 INFO:tasks.workunit.client.0.smithi079.stdout:9/35: rename d3 to d3/d7/dc/dd 22 2024-09-10T09:35:59.134 INFO:tasks.workunit.client.0.smithi079.stdout:6/77: getdents d4/d8/df 0 2024-09-10T09:35:59.134 INFO:tasks.workunit.client.0.smithi079.stdout:6/78: truncate d4/d8/df/f15 691001 0 2024-09-10T09:35:59.136 INFO:tasks.workunit.client.0.smithi079.stdout:3/57: dwrite d4/da/ff [0,4194304] 0 2024-09-10T09:35:59.137 INFO:tasks.workunit.client.0.smithi079.stdout:0/61: dread d4/d8/fb [0,4194304] 0 2024-09-10T09:35:59.137 INFO:tasks.workunit.client.0.smithi079.stdout:4/71: creat d1/f17 x:0 0 0 2024-09-10T09:35:59.138 INFO:tasks.workunit.client.0.smithi079.stdout:5/53: mknod d2/c11 0 2024-09-10T09:35:59.140 INFO:tasks.workunit.client.0.smithi079.stdout:1/50: rename d5/la to d5/lb 0 2024-09-10T09:35:59.140 INFO:tasks.workunit.client.0.smithi079.stdout:1/51: readlink d5/l7 0 2024-09-10T09:35:59.140 INFO:tasks.workunit.client.0.smithi079.stdout:3/58: dread d4/f8 [0,4194304] 0 2024-09-10T09:35:59.140 INFO:tasks.workunit.client.0.smithi079.stdout:9/36: mkdir d3/d7/dc/de 0 2024-09-10T09:35:59.141 INFO:tasks.workunit.client.0.smithi079.stdout:6/79: getdents d4/d8/dc 0 2024-09-10T09:35:59.142 INFO:tasks.workunit.client.0.smithi079.stdout:2/29: mkdir d4/dc 0 2024-09-10T09:35:59.142 INFO:tasks.workunit.client.0.smithi079.stdout:2/30: stat l3 0 2024-09-10T09:35:59.142 INFO:tasks.workunit.client.0.smithi079.stdout:1/52: dread d5/f8 [0,4194304] 0 2024-09-10T09:35:59.144 INFO:tasks.workunit.client.0.smithi079.stdout:0/62: mknod d4/d8/c17 0 2024-09-10T09:35:59.145 INFO:tasks.workunit.client.0.smithi079.stdout:4/72: write d1/da/f13 [5579448,121861] 0 2024-09-10T09:35:59.145 INFO:tasks.workunit.client.0.smithi079.stdout:5/54: symlink d2/d3/l12 0 2024-09-10T09:35:59.146 INFO:tasks.workunit.client.0.smithi079.stdout:9/37: mkdir d3/d7/df 0 2024-09-10T09:35:59.146 INFO:tasks.workunit.client.0.smithi079.stdout:9/38: dread - d3/fa zero size 2024-09-10T09:35:59.147 INFO:tasks.workunit.client.0.smithi079.stdout:6/80: link d4/d8/fb d4/d8/df/f1a 0 2024-09-10T09:35:59.147 INFO:tasks.workunit.client.0.smithi079.stdout:6/81: fsync d4/d8/fa 0 2024-09-10T09:35:59.149 INFO:tasks.workunit.client.0.smithi079.stdout:0/63: symlink d4/d12/l18 0 2024-09-10T09:35:59.149 INFO:tasks.workunit.client.0.smithi079.stdout:0/64: write d4/fe [216211,70268] 0 2024-09-10T09:35:59.149 INFO:tasks.workunit.client.0.smithi079.stdout:0/65: creat d4/d8/f19 x:0 0 0 2024-09-10T09:35:59.150 INFO:tasks.workunit.client.0.smithi079.stdout:9/39: mknod d3/d7/dc/c10 0 2024-09-10T09:35:59.150 INFO:tasks.workunit.client.0.smithi079.stdout:1/53: mknod d5/cc 0 2024-09-10T09:35:59.151 INFO:tasks.workunit.client.0.smithi079.stdout:1/54: chown d5 466694422 1 2024-09-10T09:35:59.154 INFO:tasks.workunit.client.0.smithi079.stdout:6/82: dread f2 [0,4194304] 0 2024-09-10T09:35:59.155 INFO:tasks.workunit.client.0.smithi079.stdout:8/56: dwrite f5 [0,4194304] 0 2024-09-10T09:35:59.155 INFO:tasks.workunit.client.0.smithi079.stdout:9/40: rename d3/fa to d3/f11 0 2024-09-10T09:35:59.155 INFO:tasks.workunit.client.0.smithi079.stdout:9/41: read - d3/d7/fb zero size 2024-09-10T09:35:59.155 INFO:tasks.workunit.client.0.smithi079.stdout:9/42: getdents d3/d7/df 0 2024-09-10T09:35:59.157 INFO:tasks.workunit.client.0.smithi079.stdout:6/83: dread d4/d8/df/f15 [0,4194304] 0 2024-09-10T09:35:59.157 INFO:tasks.workunit.client.0.smithi079.stdout:8/57: unlink f5 0 2024-09-10T09:35:59.158 INFO:tasks.workunit.client.0.smithi079.stdout:4/73: write d1/da/fb [3324845,48943] 0 2024-09-10T09:35:59.158 INFO:tasks.workunit.client.0.smithi079.stdout:7/53: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:35:59.159 INFO:tasks.workunit.client.0.smithi079.stdout:9/43: mkdir d3/d7/df/d12 0 2024-09-10T09:35:59.168 INFO:tasks.workunit.client.0.smithi079.stdout:7/54: rmdir d4 39 2024-09-10T09:35:59.170 INFO:tasks.workunit.client.0.smithi079.stdout:3/59: dwrite f2 [0,4194304] 0 2024-09-10T09:35:59.171 INFO:tasks.workunit.client.0.smithi079.stdout:4/74: unlink d1/da/fd 0 2024-09-10T09:35:59.172 INFO:tasks.workunit.client.0.smithi079.stdout:7/55: mknod d4/cd 0 2024-09-10T09:35:59.176 INFO:tasks.workunit.client.0.smithi079.stdout:2/31: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:59.176 INFO:tasks.workunit.client.0.smithi079.stdout:5/55: dwrite d2/d3/fa [4194304,4194304] 0 2024-09-10T09:35:59.177 INFO:tasks.workunit.client.0.smithi079.stdout:8/58: dwrite fa [0,4194304] 0 2024-09-10T09:35:59.177 INFO:tasks.workunit.client.0.smithi079.stdout:8/59: creat d11/f15 x:0 0 0 2024-09-10T09:35:59.178 INFO:tasks.workunit.client.0.smithi079.stdout:8/60: creat d11/f16 x:0 0 0 2024-09-10T09:35:59.178 INFO:tasks.workunit.client.0.smithi079.stdout:8/61: write f1 [2589307,110504] 0 2024-09-10T09:35:59.180 INFO:tasks.workunit.client.0.smithi079.stdout:5/56: unlink d2/cd 0 2024-09-10T09:35:59.183 INFO:tasks.workunit.client.0.smithi079.stdout:2/32: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:59.186 INFO:tasks.workunit.client.0.smithi079.stdout:2/33: write d4/f6 [3663310,86628] 0 2024-09-10T09:35:59.186 INFO:tasks.workunit.client.0.smithi079.stdout:2/34: dread - d4/fb zero size 2024-09-10T09:35:59.203 INFO:tasks.workunit.client.0.smithi079.stdout:1/55: truncate d5/f8 3406081 0 2024-09-10T09:35:59.203 INFO:tasks.workunit.client.0.smithi079.stdout:1/56: chown d5/f8 109 1 2024-09-10T09:35:59.203 INFO:tasks.workunit.client.0.smithi079.stdout:0/66: rename d4/d8 to d4/d12/d1a 0 2024-09-10T09:35:59.205 INFO:tasks.workunit.client.0.smithi079.stdout:2/35: mkdir d4/dd 0 2024-09-10T09:35:59.205 INFO:tasks.workunit.client.0.smithi079.stdout:2/36: write d4/f6 [4919795,9464] 0 2024-09-10T09:35:59.208 INFO:tasks.workunit.client.0.smithi079.stdout:6/84: rename d4/f11 to d4/d8/dd/f1b 0 2024-09-10T09:35:59.208 INFO:tasks.workunit.client.0.smithi079.stdout:0/67: truncate d4/f10 558348 0 2024-09-10T09:35:59.210 INFO:tasks.workunit.client.0.smithi079.stdout:1/57: link d5/cc d5/cd 0 2024-09-10T09:35:59.210 INFO:tasks.workunit.client.0.smithi079.stdout:1/58: chown d5/f8 4429657 1 2024-09-10T09:35:59.212 INFO:tasks.workunit.client.0.smithi079.stdout:6/85: rename d4/d8/df to d4/d8/dc/d1c 0 2024-09-10T09:35:59.213 INFO:tasks.workunit.client.0.smithi079.stdout:4/75: dwrite d1/ff [0,4194304] 0 2024-09-10T09:35:59.213 INFO:tasks.workunit.client.0.smithi079.stdout:0/68: truncate d4/f11 1512587 0 2024-09-10T09:35:59.216 INFO:tasks.workunit.client.0.smithi079.stdout:4/76: rename d1/c6 to d1/c18 0 2024-09-10T09:35:59.216 INFO:tasks.workunit.client.0.smithi079.stdout:4/77: stat d1/da/fb 0 2024-09-10T09:35:59.216 INFO:tasks.workunit.client.0.smithi079.stdout:4/78: write d1/da/f13 [1807112,21213] 0 2024-09-10T09:35:59.217 INFO:tasks.workunit.client.0.smithi079.stdout:4/79: dread - d1/f9 zero size 2024-09-10T09:35:59.217 INFO:tasks.workunit.client.0.smithi079.stdout:0/69: symlink d4/d12/d16/l1b 0 2024-09-10T09:35:59.218 INFO:tasks.workunit.client.0.smithi079.stdout:4/80: mknod d1/c19 0 2024-09-10T09:35:59.224 INFO:tasks.workunit.client.0.smithi079.stdout:7/56: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:59.225 INFO:tasks.workunit.client.0.smithi079.stdout:3/60: dwrite d4/da/ff [0,4194304] 0 2024-09-10T09:35:59.226 INFO:tasks.workunit.client.0.smithi079.stdout:8/62: dwrite fb [4194304,4194304] 0 2024-09-10T09:35:59.228 INFO:tasks.workunit.client.0.smithi079.stdout:7/57: rename d4/d6/l7 to d4/le 0 2024-09-10T09:35:59.233 INFO:tasks.workunit.client.0.smithi079.stdout:8/63: unlink c9 0 2024-09-10T09:35:59.235 INFO:tasks.workunit.client.0.smithi079.stdout:3/61: rename d4/da/ff to d4/f12 0 2024-09-10T09:35:59.235 INFO:tasks.workunit.client.0.smithi079.stdout:3/62: creat d4/f13 x:0 0 0 2024-09-10T09:35:59.235 INFO:tasks.workunit.client.0.smithi079.stdout:3/63: write d4/f7 [494492,19230] 0 2024-09-10T09:35:59.238 INFO:tasks.workunit.client.0.smithi079.stdout:8/64: rename f1 to d11/f17 0 2024-09-10T09:35:59.240 INFO:tasks.workunit.client.0.smithi079.stdout:6/86: dwrite d4/d8/dc/d1c/f1a [0,4194304] 0 2024-09-10T09:35:59.240 INFO:tasks.workunit.client.0.smithi079.stdout:6/87: dread - d4/d8/dd/f19 zero size 2024-09-10T09:35:59.240 INFO:tasks.workunit.client.0.smithi079.stdout:3/64: truncate f2 194909 0 2024-09-10T09:35:59.242 INFO:tasks.workunit.client.0.smithi079.stdout:4/81: dwrite d1/fc [0,4194304] 0 2024-09-10T09:35:59.242 INFO:tasks.workunit.client.0.smithi079.stdout:8/65: symlink d11/l18 0 2024-09-10T09:35:59.242 INFO:tasks.workunit.client.0.smithi079.stdout:8/66: creat d11/f19 x:0 0 0 2024-09-10T09:35:59.243 INFO:tasks.workunit.client.0.smithi079.stdout:6/88: truncate d4/f5 927626 0 2024-09-10T09:35:59.245 INFO:tasks.workunit.client.0.smithi079.stdout:3/65: symlink d4/da/l14 0 2024-09-10T09:35:59.246 INFO:tasks.workunit.client.0.smithi079.stdout:5/57: truncate d2/f6 3538356 0 2024-09-10T09:35:59.246 INFO:tasks.workunit.client.0.smithi079.stdout:5/58: readlink d2/d3/l5 0 2024-09-10T09:35:59.246 INFO:tasks.workunit.client.0.smithi079.stdout:2/37: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:59.253 INFO:tasks.workunit.client.0.smithi079.stdout:7/58: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:35:59.253 INFO:tasks.workunit.client.0.smithi079.stdout:7/59: readlink d4/le 0 2024-09-10T09:35:59.253 INFO:tasks.workunit.client.0.smithi079.stdout:7/60: chown f0 1665 1 2024-09-10T09:35:59.256 INFO:tasks.workunit.client.0.smithi079.stdout:7/61: dread f0 [0,4194304] 0 2024-09-10T09:35:59.258 INFO:tasks.workunit.client.0.smithi079.stdout:4/82: unlink d1/c19 0 2024-09-10T09:35:59.262 INFO:tasks.workunit.client.0.smithi079.stdout:6/89: rename d4/d8/dd/f19 to d4/d8/dc/d1c/f1d 0 2024-09-10T09:35:59.264 INFO:tasks.workunit.client.0.smithi079.stdout:8/67: dwrite d11/f17 [0,4194304] 0 2024-09-10T09:35:59.264 INFO:tasks.workunit.client.0.smithi079.stdout:8/68: creat d11/f1a x:0 0 0 2024-09-10T09:35:59.268 INFO:tasks.workunit.client.0.smithi079.stdout:4/83: symlink d1/da/d16/l1a 0 2024-09-10T09:35:59.269 INFO:tasks.workunit.client.0.smithi079.stdout:4/84: readlink d1/l2 0 2024-09-10T09:35:59.269 INFO:tasks.workunit.client.0.smithi079.stdout:7/62: write d4/d6/fa [3819263,43542] 0 2024-09-10T09:35:59.269 INFO:tasks.workunit.client.0.smithi079.stdout:7/63: write d4/d6/fa [269189,99138] 0 2024-09-10T09:35:59.269 INFO:tasks.workunit.client.0.smithi079.stdout:7/64: chown f0 14733961 1 2024-09-10T09:35:59.269 INFO:tasks.workunit.client.0.smithi079.stdout:7/65: chown d4/le 37 1 2024-09-10T09:35:59.270 INFO:tasks.workunit.client.0.smithi079.stdout:0/70: rmdir d4/d12 39 2024-09-10T09:35:59.277 INFO:tasks.workunit.client.0.smithi079.stdout:8/69: unlink d11/f15 0 2024-09-10T09:35:59.277 INFO:tasks.workunit.client.0.smithi079.stdout:8/70: chown d11/f12 200802035 1 2024-09-10T09:35:59.277 INFO:tasks.workunit.client.0.smithi079.stdout:5/59: link d2/c11 d2/c13 0 2024-09-10T09:35:59.278 INFO:tasks.workunit.client.0.smithi079.stdout:3/66: truncate d4/f12 2353287 0 2024-09-10T09:35:59.280 INFO:tasks.workunit.client.0.smithi079.stdout:0/71: unlink d4/c7 0 2024-09-10T09:35:59.280 INFO:tasks.workunit.client.0.smithi079.stdout:0/72: fdatasync f0 0 2024-09-10T09:35:59.280 INFO:tasks.workunit.client.0.smithi079.stdout:0/73: readlink d4/d12/l18 0 2024-09-10T09:35:59.286 INFO:tasks.workunit.client.0.smithi079.stdout:4/85: mknod d1/da/c1b 0 2024-09-10T09:35:59.289 INFO:tasks.workunit.client.0.smithi079.stdout:0/74: mknod d4/d12/d16/c1c 0 2024-09-10T09:35:59.291 INFO:tasks.workunit.client.0.smithi079.stdout:0/75: mkdir d4/d1d 0 2024-09-10T09:35:59.291 INFO:tasks.workunit.client.0.smithi079.stdout:0/76: chown d4/d1d 0 1 2024-09-10T09:35:59.293 INFO:tasks.workunit.client.0.smithi079.stdout:4/86: dread d1/fc [0,4194304] 0 2024-09-10T09:35:59.294 INFO:tasks.workunit.client.0.smithi079.stdout:0/77: mknod d4/d1d/c1e 0 2024-09-10T09:35:59.301 INFO:tasks.workunit.client.0.smithi079.stdout:7/66: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:35:59.309 INFO:tasks.workunit.client.0.smithi079.stdout:8/71: getdents d11 0 2024-09-10T09:35:59.311 INFO:tasks.workunit.client.0.smithi079.stdout:8/72: rename ld to d11/l1b 0 2024-09-10T09:35:59.312 INFO:tasks.workunit.client.0.smithi079.stdout:9/44: sync 2024-09-10T09:35:59.312 INFO:tasks.workunit.client.0.smithi079.stdout:9/45: fdatasync d3/d7/fb 0 2024-09-10T09:35:59.314 INFO:tasks.workunit.client.0.smithi079.stdout:7/67: write d4/f5 [3847578,95191] 0 2024-09-10T09:35:59.315 INFO:tasks.workunit.client.0.smithi079.stdout:7/68: unlink f0 0 2024-09-10T09:35:59.317 INFO:tasks.workunit.client.0.smithi079.stdout:7/69: mkdir d4/df 0 2024-09-10T09:35:59.317 INFO:tasks.workunit.client.0.smithi079.stdout:7/70: stat d4/d6/fa 0 2024-09-10T09:35:59.324 INFO:tasks.workunit.client.0.smithi079.stdout:8/73: write d11/f17 [3950058,84200] 0 2024-09-10T09:35:59.324 INFO:tasks.workunit.client.0.smithi079.stdout:5/60: dwrite d2/d3/fb [4194304,4194304] 0 2024-09-10T09:35:59.325 INFO:tasks.workunit.client.0.smithi079.stdout:3/67: dwrite d4/da/f11 [0,4194304] 0 2024-09-10T09:35:59.325 INFO:tasks.workunit.client.0.smithi079.stdout:0/78: dwrite f2 [0,4194304] 0 2024-09-10T09:35:59.326 INFO:tasks.workunit.client.0.smithi079.stdout:3/68: write d4/fc [6735,80851] 0 2024-09-10T09:35:59.329 INFO:tasks.workunit.client.0.smithi079.stdout:5/61: stat l1 0 2024-09-10T09:35:59.341 INFO:tasks.workunit.client.0.smithi079.stdout:0/79: symlink d4/d1d/l1f 0 2024-09-10T09:35:59.342 INFO:tasks.workunit.client.0.smithi079.stdout:0/80: chown d4/d12 101 1 2024-09-10T09:35:59.342 INFO:tasks.workunit.client.0.smithi079.stdout:0/81: chown d4/d12/d15 0 1 2024-09-10T09:35:59.342 INFO:tasks.workunit.client.0.smithi079.stdout:7/71: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:59.342 INFO:tasks.workunit.client.0.smithi079.stdout:7/72: chown d4/cd 16829 1 2024-09-10T09:35:59.343 INFO:tasks.workunit.client.0.smithi079.stdout:3/69: mknod d4/da/c15 0 2024-09-10T09:35:59.346 INFO:tasks.workunit.client.0.smithi079.stdout:3/70: dread d4/f7 [0,4194304] 0 2024-09-10T09:35:59.346 INFO:tasks.workunit.client.0.smithi079.stdout:7/73: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:59.347 INFO:tasks.workunit.client.0.smithi079.stdout:7/74: readlink d4/le 0 2024-09-10T09:35:59.347 INFO:tasks.workunit.client.0.smithi079.stdout:3/71: rename c1 to d4/c16 0 2024-09-10T09:35:59.349 INFO:tasks.workunit.client.0.smithi079.stdout:3/72: mkdir d4/da/d17 0 2024-09-10T09:35:59.351 INFO:tasks.workunit.client.0.smithi079.stdout:0/82: write d4/fd [60079,57066] 0 2024-09-10T09:35:59.351 INFO:tasks.workunit.client.0.smithi079.stdout:3/73: mkdir d4/da/d18 0 2024-09-10T09:35:59.352 INFO:tasks.workunit.client.0.smithi079.stdout:8/74: dwrite d11/f19 [0,4194304] 0 2024-09-10T09:35:59.352 INFO:tasks.workunit.client.0.smithi079.stdout:7/75: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:59.354 INFO:tasks.workunit.client.0.smithi079.stdout:8/75: dread - d11/f1a zero size 2024-09-10T09:35:59.355 INFO:tasks.workunit.client.0.smithi079.stdout:7/76: rmdir d4/d6 39 2024-09-10T09:35:59.355 INFO:tasks.workunit.client.0.smithi079.stdout:7/77: fdatasync d4/d6/fa 0 2024-09-10T09:35:59.356 INFO:tasks.workunit.client.0.smithi079.stdout:3/74: rmdir d4/da 39 2024-09-10T09:35:59.357 INFO:tasks.workunit.client.0.smithi079.stdout:3/75: dread d4/fc [0,4194304] 0 2024-09-10T09:35:59.357 INFO:tasks.workunit.client.0.smithi079.stdout:7/78: mknod d4/d6/c10 0 2024-09-10T09:35:59.358 INFO:tasks.workunit.client.0.smithi079.stdout:8/76: symlink d11/l1c 0 2024-09-10T09:35:59.358 INFO:tasks.workunit.client.0.smithi079.stdout:8/77: write ff [447873,108788] 0 2024-09-10T09:35:59.359 INFO:tasks.workunit.client.0.smithi079.stdout:1/59: sync 2024-09-10T09:35:59.359 INFO:tasks.workunit.client.0.smithi079.stdout:3/76: rename d4/da/c10 to d4/da/d17/c19 0 2024-09-10T09:35:59.360 INFO:tasks.workunit.client.0.smithi079.stdout:7/79: creat d4/d6/f11 x:0 0 0 2024-09-10T09:35:59.360 INFO:tasks.workunit.client.0.smithi079.stdout:7/80: chown d4/cd 1 1 2024-09-10T09:35:59.360 INFO:tasks.workunit.client.0.smithi079.stdout:7/81: rename d4/df to d4/df/d12 22 2024-09-10T09:35:59.360 INFO:tasks.workunit.client.0.smithi079.stdout:7/82: stat d4/d6/fa 0 2024-09-10T09:35:59.360 INFO:tasks.workunit.client.0.smithi079.stdout:8/78: creat d11/f1d x:0 0 0 2024-09-10T09:35:59.362 INFO:tasks.workunit.client.0.smithi079.stdout:7/83: symlink d4/l13 0 2024-09-10T09:35:59.364 INFO:tasks.workunit.client.0.smithi079.stdout:1/60: rmdir d5 39 2024-09-10T09:35:59.364 INFO:tasks.workunit.client.0.smithi079.stdout:1/61: fsync d5/f6 0 2024-09-10T09:35:59.364 INFO:tasks.workunit.client.0.smithi079.stdout:1/62: stat l4 0 2024-09-10T09:35:59.364 INFO:tasks.workunit.client.0.smithi079.stdout:1/63: write d5/f6 [540676,130728] 0 2024-09-10T09:35:59.365 INFO:tasks.workunit.client.0.smithi079.stdout:7/84: mkdir d4/dc/d14 0 2024-09-10T09:35:59.365 INFO:tasks.workunit.client.0.smithi079.stdout:7/85: chown d4/df 2529 1 2024-09-10T09:35:59.365 INFO:tasks.workunit.client.0.smithi079.stdout:7/86: readlink d4/l13 0 2024-09-10T09:35:59.365 INFO:tasks.workunit.client.0.smithi079.stdout:7/87: write d4/f5 [5315397,32696] 0 2024-09-10T09:35:59.366 INFO:tasks.workunit.client.0.smithi079.stdout:7/88: dread - d4/d6/f11 zero size 2024-09-10T09:35:59.367 INFO:tasks.workunit.client.0.smithi079.stdout:8/79: rename fa to d11/f1e 0 2024-09-10T09:35:59.368 INFO:tasks.workunit.client.0.smithi079.stdout:1/64: creat d5/fe x:0 0 0 2024-09-10T09:35:59.371 INFO:tasks.workunit.client.0.smithi079.stdout:8/80: truncate d11/f14 220862 0 2024-09-10T09:35:59.371 INFO:tasks.workunit.client.0.smithi079.stdout:8/81: fdatasync d11/f17 0 2024-09-10T09:35:59.374 INFO:tasks.workunit.client.0.smithi079.stdout:8/82: unlink c6 0 2024-09-10T09:35:59.376 INFO:tasks.workunit.client.0.smithi079.stdout:1/65: mkdir d5/df 0 2024-09-10T09:35:59.377 INFO:tasks.workunit.client.0.smithi079.stdout:1/66: chown l4 43833861 1 2024-09-10T09:35:59.380 INFO:tasks.workunit.client.0.smithi079.stdout:1/67: rename l2 to d5/df/l10 0 2024-09-10T09:35:59.381 INFO:tasks.workunit.client.0.smithi079.stdout:8/83: mknod d11/c1f 0 2024-09-10T09:35:59.381 INFO:tasks.workunit.client.0.smithi079.stdout:8/84: readlink d11/l1b 0 2024-09-10T09:35:59.381 INFO:tasks.workunit.client.0.smithi079.stdout:1/68: truncate d5/f8 2739643 0 2024-09-10T09:35:59.382 INFO:tasks.workunit.client.0.smithi079.stdout:8/85: chown d11/f16 1938009 1 2024-09-10T09:35:59.383 INFO:tasks.workunit.client.0.smithi079.stdout:1/69: mkdir d5/df/d11 0 2024-09-10T09:35:59.383 INFO:tasks.workunit.client.0.smithi079.stdout:1/70: chown d5 107852120 1 2024-09-10T09:35:59.387 INFO:tasks.workunit.client.0.smithi079.stdout:3/77: dwrite f2 [0,4194304] 0 2024-09-10T09:35:59.388 INFO:tasks.workunit.client.0.smithi079.stdout:3/78: creat d4/da/d17/f1a x:0 0 0 2024-09-10T09:35:59.390 INFO:tasks.workunit.client.0.smithi079.stdout:3/79: symlink d4/da/d17/l1b 0 2024-09-10T09:35:59.395 INFO:tasks.workunit.client.0.smithi079.stdout:7/89: dwrite d4/d6/f11 [0,4194304] 0 2024-09-10T09:35:59.396 INFO:tasks.workunit.client.0.smithi079.stdout:5/62: dwrite d2/d3/fb [4194304,4194304] 0 2024-09-10T09:35:59.397 INFO:tasks.workunit.client.0.smithi079.stdout:7/90: fsync d4/f5 0 2024-09-10T09:35:59.400 INFO:tasks.workunit.client.0.smithi079.stdout:5/63: dread d2/f6 [0,4194304] 0 2024-09-10T09:35:59.402 INFO:tasks.workunit.client.0.smithi079.stdout:8/86: dwrite fe [0,4194304] 0 2024-09-10T09:35:59.403 INFO:tasks.workunit.client.0.smithi079.stdout:3/80: dread d4/fc [0,4194304] 0 2024-09-10T09:35:59.407 INFO:tasks.workunit.client.0.smithi079.stdout:3/81: read d4/f8 [717621,123892] 0 2024-09-10T09:35:59.407 INFO:tasks.workunit.client.0.smithi079.stdout:3/82: dread - d4/da/d17/f1a zero size 2024-09-10T09:35:59.413 INFO:tasks.workunit.client.0.smithi079.stdout:1/71: getdents d5 0 2024-09-10T09:35:59.420 INFO:tasks.workunit.client.0.smithi079.stdout:0/83: dwrite d4/fd [0,4194304] 0 2024-09-10T09:35:59.438 INFO:tasks.workunit.client.0.smithi079.stdout:0/84: dwrite d4/d12/f13 [0,4194304] 0 2024-09-10T09:35:59.439 INFO:tasks.workunit.client.0.smithi079.stdout:7/91: link d4/l13 d4/dc/l15 0 2024-09-10T09:35:59.439 INFO:tasks.workunit.client.0.smithi079.stdout:7/92: creat d4/d6/f16 x:0 0 0 2024-09-10T09:35:59.440 INFO:tasks.workunit.client.0.smithi079.stdout:0/85: dread f0 [0,4194304] 0 2024-09-10T09:35:59.441 INFO:tasks.workunit.client.0.smithi079.stdout:0/86: chown l3 2 1 2024-09-10T09:35:59.449 INFO:tasks.workunit.client.0.smithi079.stdout:0/87: write d4/fd [2323749,111145] 0 2024-09-10T09:35:59.449 INFO:tasks.workunit.client.0.smithi079.stdout:0/88: fsync f2 0 2024-09-10T09:35:59.449 INFO:tasks.workunit.client.0.smithi079.stdout:0/89: chown f0 3010 1 2024-09-10T09:35:59.453 INFO:tasks.workunit.client.0.smithi079.stdout:7/93: dwrite d4/d6/fa [4194304,4194304] 0 2024-09-10T09:35:59.477 INFO:tasks.workunit.client.0.smithi079.stdout:3/83: link d4/fc d4/da/d18/f1c 0 2024-09-10T09:35:59.483 INFO:tasks.workunit.client.0.smithi079.stdout:2/38: sync 2024-09-10T09:35:59.483 INFO:tasks.workunit.client.0.smithi079.stdout:4/87: sync 2024-09-10T09:35:59.483 INFO:tasks.workunit.client.0.smithi079.stdout:9/46: sync 2024-09-10T09:35:59.483 INFO:tasks.workunit.client.0.smithi079.stdout:6/90: sync 2024-09-10T09:35:59.489 INFO:tasks.workunit.client.0.smithi079.stdout:4/88: dread d1/fe [0,4194304] 0 2024-09-10T09:35:59.489 INFO:tasks.workunit.client.0.smithi079.stdout:1/72: creat d5/df/f12 x:0 0 0 2024-09-10T09:35:59.498 INFO:tasks.workunit.client.0.smithi079.stdout:0/90: rmdir d4/d12/d1a 39 2024-09-10T09:35:59.500 INFO:tasks.workunit.client.0.smithi079.stdout:7/94: unlink d4/dc/l15 0 2024-09-10T09:35:59.500 INFO:tasks.workunit.client.0.smithi079.stdout:0/91: dread f0 [0,4194304] 0 2024-09-10T09:35:59.500 INFO:tasks.workunit.client.0.smithi079.stdout:5/64: symlink d2/l14 0 2024-09-10T09:35:59.503 INFO:tasks.workunit.client.0.smithi079.stdout:8/87: link d11/f1a d11/f20 0 2024-09-10T09:35:59.503 INFO:tasks.workunit.client.0.smithi079.stdout:8/88: dread - d11/f20 zero size 2024-09-10T09:35:59.505 INFO:tasks.workunit.client.0.smithi079.stdout:3/84: symlink d4/da/l1d 0 2024-09-10T09:35:59.506 INFO:tasks.workunit.client.0.smithi079.stdout:9/47: dwrite d3/f11 [0,4194304] 0 2024-09-10T09:35:59.506 INFO:tasks.workunit.client.0.smithi079.stdout:2/39: symlink d4/dd/le 0 2024-09-10T09:35:59.508 INFO:tasks.workunit.client.0.smithi079.stdout:4/89: readlink d1/da/l12 0 2024-09-10T09:35:59.508 INFO:tasks.workunit.client.0.smithi079.stdout:4/90: chown d1/da/fb 2 1 2024-09-10T09:35:59.509 INFO:tasks.workunit.client.0.smithi079.stdout:0/92: read d4/d12/d1a/fb [3976875,30930] 0 2024-09-10T09:35:59.509 INFO:tasks.workunit.client.0.smithi079.stdout:0/93: rename d4/d12/d15 to d4/d12/d15/d20 22 2024-09-10T09:35:59.517 INFO:tasks.workunit.client.0.smithi079.stdout:9/48: mknod d3/d7/dc/c13 0 2024-09-10T09:35:59.519 INFO:tasks.workunit.client.0.smithi079.stdout:2/40: stat l1 0 2024-09-10T09:35:59.519 INFO:tasks.workunit.client.0.smithi079.stdout:2/41: chown l2 845803 1 2024-09-10T09:35:59.519 INFO:tasks.workunit.client.0.smithi079.stdout:2/42: readlink l2 0 2024-09-10T09:35:59.519 INFO:tasks.workunit.client.0.smithi079.stdout:2/43: write d4/fb [560829,82706] 0 2024-09-10T09:35:59.520 INFO:tasks.workunit.client.0.smithi079.stdout:4/91: getdents d1/da/d16 0 2024-09-10T09:35:59.520 INFO:tasks.workunit.client.0.smithi079.stdout:4/92: fdatasync d1/f11 0 2024-09-10T09:35:59.521 INFO:tasks.workunit.client.0.smithi079.stdout:1/73: dwrite d5/f6 [0,4194304] 0 2024-09-10T09:35:59.521 INFO:tasks.workunit.client.0.smithi079.stdout:1/74: creat d5/df/f13 x:0 0 0 2024-09-10T09:35:59.523 INFO:tasks.workunit.client.0.smithi079.stdout:4/93: dread d1/fc [0,4194304] 0 2024-09-10T09:35:59.529 INFO:tasks.workunit.client.0.smithi079.stdout:2/44: creat d4/dd/ff x:0 0 0 2024-09-10T09:35:59.530 INFO:tasks.workunit.client.0.smithi079.stdout:2/45: write d4/f6 [4420782,18990] 0 2024-09-10T09:35:59.530 INFO:tasks.workunit.client.0.smithi079.stdout:3/85: getdents d4/da/d18 0 2024-09-10T09:35:59.530 INFO:tasks.workunit.client.0.smithi079.stdout:3/86: chown d4/f12 1023459 1 2024-09-10T09:35:59.534 INFO:tasks.workunit.client.0.smithi079.stdout:3/87: write f2 [2917541,108626] 0 2024-09-10T09:35:59.534 INFO:tasks.workunit.client.0.smithi079.stdout:5/65: dwrite d2/d3/ff [0,4194304] 0 2024-09-10T09:35:59.537 INFO:tasks.workunit.client.0.smithi079.stdout:4/94: symlink d1/da/d16/l1c 0 2024-09-10T09:35:59.537 INFO:tasks.workunit.client.0.smithi079.stdout:9/49: dread d3/f11 [0,4194304] 0 2024-09-10T09:35:59.539 INFO:tasks.workunit.client.0.smithi079.stdout:8/89: dwrite d11/f14 [0,4194304] 0 2024-09-10T09:35:59.540 INFO:tasks.workunit.client.0.smithi079.stdout:2/46: fsync d4/fb 0 2024-09-10T09:35:59.542 INFO:tasks.workunit.client.0.smithi079.stdout:4/95: link d1/da/c1b d1/da/d16/c1d 0 2024-09-10T09:35:59.542 INFO:tasks.workunit.client.0.smithi079.stdout:4/96: fsync d1/ff 0 2024-09-10T09:35:59.542 INFO:tasks.workunit.client.0.smithi079.stdout:0/94: dwrite d4/d12/f13 [0,4194304] 0 2024-09-10T09:35:59.542 INFO:tasks.workunit.client.0.smithi079.stdout:0/95: readlink d4/d12/l18 0 2024-09-10T09:35:59.551 INFO:tasks.workunit.client.0.smithi079.stdout:9/50: write d3/f11 [3000450,20857] 0 2024-09-10T09:35:59.552 INFO:tasks.workunit.client.0.smithi079.stdout:4/97: symlink d1/da/d16/l1e 0 2024-09-10T09:35:59.552 INFO:tasks.workunit.client.0.smithi079.stdout:4/98: chown d1/f11 4578 1 2024-09-10T09:35:59.552 INFO:tasks.workunit.client.0.smithi079.stdout:4/99: write d1/f7 [992899,66486] 0 2024-09-10T09:35:59.552 INFO:tasks.workunit.client.0.smithi079.stdout:4/100: chown d1/ff 0 1 2024-09-10T09:35:59.553 INFO:tasks.workunit.client.0.smithi079.stdout:1/75: dwrite d5/f6 [0,4194304] 0 2024-09-10T09:35:59.554 INFO:tasks.workunit.client.0.smithi079.stdout:0/96: mkdir d4/d12/d21 0 2024-09-10T09:35:59.554 INFO:tasks.workunit.client.0.smithi079.stdout:0/97: fsync d4/f11 0 2024-09-10T09:35:59.554 INFO:tasks.workunit.client.0.smithi079.stdout:0/98: readlink l3 0 2024-09-10T09:35:59.555 INFO:tasks.workunit.client.0.smithi079.stdout:2/47: mkdir d4/d10 0 2024-09-10T09:35:59.557 INFO:tasks.workunit.client.0.smithi079.stdout:8/90: dread f8 [4194304,4194304] 0 2024-09-10T09:35:59.558 INFO:tasks.workunit.client.0.smithi079.stdout:9/51: rename d3/d7/fb to d3/f14 0 2024-09-10T09:35:59.559 INFO:tasks.workunit.client.0.smithi079.stdout:4/101: creat d1/da/d16/f1f x:0 0 0 2024-09-10T09:35:59.563 INFO:tasks.workunit.client.0.smithi079.stdout:3/88: dwrite d4/f12 [0,4194304] 0 2024-09-10T09:35:59.563 INFO:tasks.workunit.client.0.smithi079.stdout:3/89: chown d4/da 81 1 2024-09-10T09:35:59.563 INFO:tasks.workunit.client.0.smithi079.stdout:1/76: link d5/df/f12 d5/f14 0 2024-09-10T09:35:59.563 INFO:tasks.workunit.client.0.smithi079.stdout:1/77: chown d5 50 1 2024-09-10T09:35:59.564 INFO:tasks.workunit.client.0.smithi079.stdout:0/99: mknod d4/d12/c22 0 2024-09-10T09:35:59.565 INFO:tasks.workunit.client.0.smithi079.stdout:2/48: symlink d4/dc/l11 0 2024-09-10T09:35:59.566 INFO:tasks.workunit.client.0.smithi079.stdout:7/95: truncate d4/d6/fa 783387 0 2024-09-10T09:35:59.570 INFO:tasks.workunit.client.0.smithi079.stdout:0/100: mknod d4/d12/d16/c23 0 2024-09-10T09:35:59.570 INFO:tasks.workunit.client.0.smithi079.stdout:0/101: fsync d4/d12/d1a/fb 0 2024-09-10T09:35:59.572 INFO:tasks.workunit.client.0.smithi079.stdout:2/49: mknod d4/dc/c12 0 2024-09-10T09:35:59.575 INFO:tasks.workunit.client.0.smithi079.stdout:8/91: write d11/f1e [1637090,1470] 0 2024-09-10T09:35:59.576 INFO:tasks.workunit.client.0.smithi079.stdout:4/102: rename d1/da/d16/l1c to d1/da/l20 0 2024-09-10T09:35:59.576 INFO:tasks.workunit.client.0.smithi079.stdout:4/103: write d1/da/f13 [8657179,42990] 0 2024-09-10T09:35:59.577 INFO:tasks.workunit.client.0.smithi079.stdout:3/90: getdents d4/da/d17 0 2024-09-10T09:35:59.577 INFO:tasks.workunit.client.0.smithi079.stdout:3/91: readlink d4/da/d17/l1b 0 2024-09-10T09:35:59.585 INFO:tasks.workunit.client.0.smithi079.stdout:2/50: rename d4/d10 to d4/dc/d13 0 2024-09-10T09:35:59.588 INFO:tasks.workunit.client.0.smithi079.stdout:2/51: creat d4/dc/f14 x:0 0 0 2024-09-10T09:35:59.590 INFO:tasks.workunit.client.0.smithi079.stdout:2/52: creat d4/dc/d13/f15 x:0 0 0 2024-09-10T09:35:59.590 INFO:tasks.workunit.client.0.smithi079.stdout:2/53: chown d4/f5 3669 1 2024-09-10T09:35:59.590 INFO:tasks.workunit.client.0.smithi079.stdout:2/54: creat d4/dd/f16 x:0 0 0 2024-09-10T09:35:59.593 INFO:tasks.workunit.client.0.smithi079.stdout:2/55: link d4/c7 d4/dd/c17 0 2024-09-10T09:35:59.593 INFO:tasks.workunit.client.0.smithi079.stdout:2/56: write d4/dd/f16 [769004,13661] 0 2024-09-10T09:35:59.593 INFO:tasks.workunit.client.0.smithi079.stdout:2/57: write d4/dc/d13/f15 [828067,101027] 0 2024-09-10T09:35:59.594 INFO:tasks.workunit.client.0.smithi079.stdout:2/58: creat d4/f18 x:0 0 0 2024-09-10T09:35:59.601 INFO:tasks.workunit.client.0.smithi079.stdout:0/102: dwrite d4/f11 [0,4194304] 0 2024-09-10T09:35:59.602 INFO:tasks.workunit.client.0.smithi079.stdout:0/103: dread f0 [0,4194304] 0 2024-09-10T09:35:59.603 INFO:tasks.workunit.client.0.smithi079.stdout:0/104: write d4/fd [1016301,69449] 0 2024-09-10T09:35:59.622 INFO:tasks.workunit.client.0.smithi079.stdout:0/105: dwrite d4/fe [0,4194304] 0 2024-09-10T09:35:59.622 INFO:tasks.workunit.client.0.smithi079.stdout:0/106: chown d4/f10 228456316 1 2024-09-10T09:35:59.629 INFO:tasks.workunit.client.0.smithi079.stdout:0/107: dread f2 [0,4194304] 0 2024-09-10T09:35:59.630 INFO:tasks.workunit.client.0.smithi079.stdout:0/108: mkdir d4/d1d/d24 0 2024-09-10T09:35:59.639 INFO:tasks.workunit.client.0.smithi079.stdout:0/109: dread d4/f11 [0,4194304] 0 2024-09-10T09:35:59.643 INFO:tasks.workunit.client.0.smithi079.stdout:0/110: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:59.644 INFO:tasks.workunit.client.0.smithi079.stdout:0/111: rmdir d4/d1d 39 2024-09-10T09:35:59.645 INFO:tasks.workunit.client.0.smithi079.stdout:0/112: mknod d4/d12/d15/c25 0 2024-09-10T09:35:59.647 INFO:tasks.workunit.client.0.smithi079.stdout:0/113: link d4/d12/c22 d4/d12/d16/c26 0 2024-09-10T09:35:59.656 INFO:tasks.workunit.client.0.smithi079.stdout:0/114: dread d4/fe [0,4194304] 0 2024-09-10T09:35:59.656 INFO:tasks.workunit.client.0.smithi079.stdout:0/115: write d4/fd [1179902,75343] 0 2024-09-10T09:35:59.656 INFO:tasks.workunit.client.0.smithi079.stdout:0/116: chown d4/d12/d1a/c17 847 1 2024-09-10T09:35:59.657 INFO:tasks.workunit.client.0.smithi079.stdout:1/78: dwrite d5/f6 [0,4194304] 0 2024-09-10T09:35:59.658 INFO:tasks.workunit.client.0.smithi079.stdout:0/117: symlink d4/d12/d16/l27 0 2024-09-10T09:35:59.658 INFO:tasks.workunit.client.0.smithi079.stdout:0/118: fsync d4/fe 0 2024-09-10T09:35:59.658 INFO:tasks.workunit.client.0.smithi079.stdout:0/119: write d4/f5 [1266053,94027] 0 2024-09-10T09:35:59.667 INFO:tasks.workunit.client.0.smithi079.stdout:3/92: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:35:59.667 INFO:tasks.workunit.client.0.smithi079.stdout:8/92: dwrite d11/f12 [0,4194304] 0 2024-09-10T09:35:59.675 INFO:tasks.workunit.client.0.smithi079.stdout:0/120: truncate d4/f5 266610 0 2024-09-10T09:35:59.676 INFO:tasks.workunit.client.0.smithi079.stdout:1/79: dwrite d5/df/f12 [0,4194304] 0 2024-09-10T09:35:59.677 INFO:tasks.workunit.client.0.smithi079.stdout:0/121: truncate d4/f10 340918 0 2024-09-10T09:35:59.685 INFO:tasks.workunit.client.0.smithi079.stdout:8/93: write fb [4107763,98964] 0 2024-09-10T09:35:59.685 INFO:tasks.workunit.client.0.smithi079.stdout:8/94: chown d11/f1a 1 1 2024-09-10T09:35:59.691 INFO:tasks.workunit.client.0.smithi079.stdout:1/80: dread d5/f14 [0,4194304] 0 2024-09-10T09:35:59.693 INFO:tasks.workunit.client.0.smithi079.stdout:1/81: unlink d5/df/f12 0 2024-09-10T09:35:59.695 INFO:tasks.workunit.client.0.smithi079.stdout:8/95: dread d11/f12 [0,4194304] 0 2024-09-10T09:35:59.695 INFO:tasks.workunit.client.0.smithi079.stdout:8/96: write d11/f20 [52459,99537] 0 2024-09-10T09:35:59.695 INFO:tasks.workunit.client.0.smithi079.stdout:0/122: dread d4/d12/f13 [0,4194304] 0 2024-09-10T09:35:59.699 INFO:tasks.workunit.client.0.smithi079.stdout:3/93: dwrite d4/f7 [0,4194304] 0 2024-09-10T09:35:59.702 INFO:tasks.workunit.client.0.smithi079.stdout:8/97: link d11/f12 d11/f21 0 2024-09-10T09:35:59.707 INFO:tasks.workunit.client.0.smithi079.stdout:8/98: link d11/f1d d11/f22 0 2024-09-10T09:35:59.707 INFO:tasks.workunit.client.0.smithi079.stdout:8/99: write d11/f21 [4494656,125253] 0 2024-09-10T09:35:59.707 INFO:tasks.workunit.client.0.smithi079.stdout:8/100: write d11/f21 [4736391,83284] 0 2024-09-10T09:35:59.707 INFO:tasks.workunit.client.0.smithi079.stdout:8/101: fsync fe 0 2024-09-10T09:35:59.708 INFO:tasks.workunit.client.0.smithi079.stdout:0/123: truncate d4/f10 1023495 0 2024-09-10T09:35:59.708 INFO:tasks.workunit.client.0.smithi079.stdout:0/124: fdatasync d4/d12/d1a/fb 0 2024-09-10T09:35:59.710 INFO:tasks.workunit.client.0.smithi079.stdout:0/125: unlink f2 0 2024-09-10T09:35:59.710 INFO:tasks.workunit.client.0.smithi079.stdout:0/126: chown d4/d1d/l1f 1 1 2024-09-10T09:35:59.711 INFO:tasks.workunit.client.0.smithi079.stdout:3/94: dread d4/da/f11 [0,4194304] 0 2024-09-10T09:35:59.712 INFO:tasks.workunit.client.0.smithi079.stdout:0/127: creat d4/d12/d15/f28 x:0 0 0 2024-09-10T09:35:59.712 INFO:tasks.workunit.client.0.smithi079.stdout:6/91: sync 2024-09-10T09:35:59.715 INFO:tasks.workunit.client.0.smithi079.stdout:1/82: getdents d5/df 0 2024-09-10T09:35:59.719 INFO:tasks.workunit.client.0.smithi079.stdout:3/95: write d4/da/d17/f1a [2078053,86821] 0 2024-09-10T09:35:59.721 INFO:tasks.workunit.client.0.smithi079.stdout:0/128: write d4/fe [79347,86841] 0 2024-09-10T09:35:59.721 INFO:tasks.workunit.client.0.smithi079.stdout:1/83: creat d5/f15 x:0 0 0 2024-09-10T09:35:59.724 INFO:tasks.workunit.client.0.smithi079.stdout:3/96: rmdir d4/da/d18 39 2024-09-10T09:35:59.727 INFO:tasks.workunit.client.0.smithi079.stdout:5/66: sync 2024-09-10T09:35:59.727 INFO:tasks.workunit.client.0.smithi079.stdout:5/67: truncate d2/d3/fe 146556 0 2024-09-10T09:35:59.728 INFO:tasks.workunit.client.0.smithi079.stdout:8/102: dwrite d11/f16 [0,4194304] 0 2024-09-10T09:35:59.731 INFO:tasks.workunit.client.0.smithi079.stdout:3/97: truncate d4/da/d18/f1c 198622 0 2024-09-10T09:35:59.732 INFO:tasks.workunit.client.0.smithi079.stdout:0/129: getdents d4 0 2024-09-10T09:35:59.736 INFO:tasks.workunit.client.0.smithi079.stdout:8/103: creat d11/f23 x:0 0 0 2024-09-10T09:35:59.737 INFO:tasks.workunit.client.0.smithi079.stdout:1/84: creat d5/df/d11/f16 x:0 0 0 2024-09-10T09:35:59.737 INFO:tasks.workunit.client.0.smithi079.stdout:1/85: dread - d5/df/d11/f16 zero size 2024-09-10T09:35:59.738 INFO:tasks.workunit.client.0.smithi079.stdout:3/98: creat d4/da/d17/f1e x:0 0 0 2024-09-10T09:35:59.738 INFO:tasks.workunit.client.0.smithi079.stdout:3/99: write d4/f13 [22154,6004] 0 2024-09-10T09:35:59.738 INFO:tasks.workunit.client.0.smithi079.stdout:0/130: getdents d4/d12/d16 0 2024-09-10T09:35:59.738 INFO:tasks.workunit.client.0.smithi079.stdout:0/131: chown d4/d1d/l1f 187 1 2024-09-10T09:35:59.738 INFO:tasks.workunit.client.0.smithi079.stdout:0/132: write d4/d12/d1a/fb [2127738,57522] 0 2024-09-10T09:35:59.739 INFO:tasks.workunit.client.0.smithi079.stdout:1/86: write d5/fe [411472,75062] 0 2024-09-10T09:35:59.740 INFO:tasks.workunit.client.0.smithi079.stdout:0/133: mkdir d4/d12/d1a/d29 0 2024-09-10T09:35:59.742 INFO:tasks.workunit.client.0.smithi079.stdout:0/134: mknod d4/d12/d1a/d29/c2a 0 2024-09-10T09:35:59.742 INFO:tasks.workunit.client.0.smithi079.stdout:0/135: chown d4/d12/d1a/lc 15775229 1 2024-09-10T09:35:59.744 INFO:tasks.workunit.client.0.smithi079.stdout:5/68: dwrite d2/d3/ff [0,4194304] 0 2024-09-10T09:35:59.744 INFO:tasks.workunit.client.0.smithi079.stdout:5/69: fdatasync d2/d3/ff 0 2024-09-10T09:35:59.746 INFO:tasks.workunit.client.0.smithi079.stdout:6/92: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:35:59.747 INFO:tasks.workunit.client.0.smithi079.stdout:1/87: getdents d5 0 2024-09-10T09:35:59.750 INFO:tasks.workunit.client.0.smithi079.stdout:0/136: truncate d4/fe 3535049 0 2024-09-10T09:35:59.750 INFO:tasks.workunit.client.0.smithi079.stdout:0/137: write f0 [274527,39030] 0 2024-09-10T09:35:59.752 INFO:tasks.workunit.client.0.smithi079.stdout:6/93: dread d4/f6 [0,4194304] 0 2024-09-10T09:35:59.752 INFO:tasks.workunit.client.0.smithi079.stdout:6/94: truncate d4/d8/fa 3569273 0 2024-09-10T09:35:59.752 INFO:tasks.workunit.client.0.smithi079.stdout:6/95: chown d4/d8/dc/d1c/f15 489608 1 2024-09-10T09:35:59.752 INFO:tasks.workunit.client.0.smithi079.stdout:0/138: mkdir d4/d12/d15/d2b 0 2024-09-10T09:35:59.753 INFO:tasks.workunit.client.0.smithi079.stdout:5/70: write d2/d3/fa [7894517,88127] 0 2024-09-10T09:35:59.753 INFO:tasks.workunit.client.0.smithi079.stdout:0/139: creat d4/d12/d21/f2c x:0 0 0 2024-09-10T09:35:59.757 INFO:tasks.workunit.client.0.smithi079.stdout:5/71: creat d2/f15 x:0 0 0 2024-09-10T09:35:59.757 INFO:tasks.workunit.client.0.smithi079.stdout:5/72: creat d2/d3/f16 x:0 0 0 2024-09-10T09:35:59.758 INFO:tasks.workunit.client.0.smithi079.stdout:3/100: dwrite d4/fb [0,4194304] 0 2024-09-10T09:35:59.758 INFO:tasks.workunit.client.0.smithi079.stdout:3/101: chown d4/da/c15 5 1 2024-09-10T09:35:59.766 INFO:tasks.workunit.client.0.smithi079.stdout:8/104: dwrite d11/f12 [0,4194304] 0 2024-09-10T09:35:59.774 INFO:tasks.workunit.client.0.smithi079.stdout:0/140: write d4/f11 [4101302,41584] 0 2024-09-10T09:35:59.778 INFO:tasks.workunit.client.0.smithi079.stdout:0/141: mknod d4/d12/d21/c2d 0 2024-09-10T09:35:59.781 INFO:tasks.workunit.client.0.smithi079.stdout:8/105: dread fb [0,4194304] 0 2024-09-10T09:35:59.783 INFO:tasks.workunit.client.0.smithi079.stdout:8/106: truncate d11/f17 4112376 0 2024-09-10T09:35:59.785 INFO:tasks.workunit.client.0.smithi079.stdout:8/107: symlink d11/l24 0 2024-09-10T09:35:59.788 INFO:tasks.workunit.client.0.smithi079.stdout:5/73: dread d2/d3/fa [0,4194304] 0 2024-09-10T09:35:59.788 INFO:tasks.workunit.client.0.smithi079.stdout:0/142: dread d4/f10 [0,4194304] 0 2024-09-10T09:35:59.789 INFO:tasks.workunit.client.0.smithi079.stdout:0/143: mknod d4/c2e 0 2024-09-10T09:35:59.789 INFO:tasks.workunit.client.0.smithi079.stdout:0/144: truncate d4/f11 4894436 0 2024-09-10T09:35:59.790 INFO:tasks.workunit.client.0.smithi079.stdout:6/96: dwrite d4/d8/dc/fe [0,4194304] 0 2024-09-10T09:35:59.790 INFO:tasks.workunit.client.0.smithi079.stdout:6/97: chown d4/f6 531 1 2024-09-10T09:35:59.790 INFO:tasks.workunit.client.0.smithi079.stdout:0/145: mknod d4/d1d/d24/c2f 0 2024-09-10T09:35:59.790 INFO:tasks.workunit.client.0.smithi079.stdout:6/98: write d4/f17 [5234605,79607] 0 2024-09-10T09:35:59.791 INFO:tasks.workunit.client.0.smithi079.stdout:6/99: symlink d4/d8/dd/l1e 0 2024-09-10T09:35:59.792 INFO:tasks.workunit.client.0.smithi079.stdout:1/88: dwrite d5/fe [0,4194304] 0 2024-09-10T09:35:59.793 INFO:tasks.workunit.client.0.smithi079.stdout:1/89: mknod d5/c17 0 2024-09-10T09:35:59.795 INFO:tasks.workunit.client.0.smithi079.stdout:1/90: mknod d5/df/d11/c18 0 2024-09-10T09:35:59.796 INFO:tasks.workunit.client.0.smithi079.stdout:9/52: sync 2024-09-10T09:35:59.796 INFO:tasks.workunit.client.0.smithi079.stdout:7/96: sync 2024-09-10T09:35:59.797 INFO:tasks.workunit.client.0.smithi079.stdout:7/97: write d4/f5 [3039409,38113] 0 2024-09-10T09:35:59.798 INFO:tasks.workunit.client.0.smithi079.stdout:8/108: getdents d11 0 2024-09-10T09:35:59.798 INFO:tasks.workunit.client.0.smithi079.stdout:8/109: fdatasync d11/f16 0 2024-09-10T09:35:59.798 INFO:tasks.workunit.client.0.smithi079.stdout:8/110: write d11/f17 [674337,119256] 0 2024-09-10T09:35:59.799 INFO:tasks.workunit.client.0.smithi079.stdout:7/98: creat d4/dc/f17 x:0 0 0 2024-09-10T09:35:59.811 INFO:tasks.workunit.client.0.smithi079.stdout:8/111: creat d11/f25 x:0 0 0 2024-09-10T09:35:59.811 INFO:tasks.workunit.client.0.smithi079.stdout:8/112: write d11/f20 [584791,15243] 0 2024-09-10T09:35:59.811 INFO:tasks.workunit.client.0.smithi079.stdout:8/113: rename c0 to d11/c26 0 2024-09-10T09:35:59.811 INFO:tasks.workunit.client.0.smithi079.stdout:8/114: read - d11/f1d zero size 2024-09-10T09:35:59.820 INFO:tasks.workunit.client.0.smithi079.stdout:1/91: read d5/fe [4034048,91033] 0 2024-09-10T09:35:59.821 INFO:tasks.workunit.client.0.smithi079.stdout:3/102: dwrite d4/f12 [0,4194304] 0 2024-09-10T09:35:59.821 INFO:tasks.workunit.client.0.smithi079.stdout:1/92: write d5/df/f13 [408493,51087] 0 2024-09-10T09:35:59.825 INFO:tasks.workunit.client.0.smithi079.stdout:5/74: dwrite d2/d3/fe [0,4194304] 0 2024-09-10T09:35:59.825 INFO:tasks.workunit.client.0.smithi079.stdout:5/75: chown d2/d3/fa 756 1 2024-09-10T09:35:59.825 INFO:tasks.workunit.client.0.smithi079.stdout:5/76: stat d2/f15 0 2024-09-10T09:35:59.826 INFO:tasks.workunit.client.0.smithi079.stdout:3/103: creat d4/da/d18/f1f x:0 0 0 2024-09-10T09:35:59.829 INFO:tasks.workunit.client.0.smithi079.stdout:3/104: symlink d4/l20 0 2024-09-10T09:35:59.829 INFO:tasks.workunit.client.0.smithi079.stdout:3/105: readlink d4/da/l1d 0 2024-09-10T09:35:59.829 INFO:tasks.workunit.client.0.smithi079.stdout:3/106: dread - d4/da/d18/f1f zero size 2024-09-10T09:35:59.829 INFO:tasks.workunit.client.0.smithi079.stdout:3/107: write d4/da/d17/f1e [442527,113639] 0 2024-09-10T09:35:59.830 INFO:tasks.workunit.client.0.smithi079.stdout:3/108: chown d4/ce 159765337 1 2024-09-10T09:35:59.830 INFO:tasks.workunit.client.0.smithi079.stdout:5/77: rmdir d2/d3 39 2024-09-10T09:35:59.837 INFO:tasks.workunit.client.0.smithi079.stdout:1/93: dread d5/f14 [0,4194304] 0 2024-09-10T09:35:59.839 INFO:tasks.workunit.client.0.smithi079.stdout:6/100: dwrite f2 [0,4194304] 0 2024-09-10T09:35:59.839 INFO:tasks.workunit.client.0.smithi079.stdout:1/94: creat d5/f19 x:0 0 0 2024-09-10T09:35:59.839 INFO:tasks.workunit.client.0.smithi079.stdout:1/95: rename d5 to d5/df/d11/d1a 22 2024-09-10T09:35:59.839 INFO:tasks.workunit.client.0.smithi079.stdout:1/96: creat d5/df/d11/f1b x:0 0 0 2024-09-10T09:35:59.841 INFO:tasks.workunit.client.0.smithi079.stdout:9/53: dwrite d3/f5 [0,4194304] 0 2024-09-10T09:35:59.841 INFO:tasks.workunit.client.0.smithi079.stdout:3/109: write d4/fb [984281,54080] 0 2024-09-10T09:35:59.841 INFO:tasks.workunit.client.0.smithi079.stdout:0/146: dwrite d4/d12/d1a/f19 [0,4194304] 0 2024-09-10T09:35:59.841 INFO:tasks.workunit.client.0.smithi079.stdout:3/110: chown d4/c5 4 1 2024-09-10T09:35:59.841 INFO:tasks.workunit.client.0.smithi079.stdout:3/111: chown d4/da/d17/c19 235353733 1 2024-09-10T09:35:59.842 INFO:tasks.workunit.client.0.smithi079.stdout:6/101: mkdir d4/d8/dc/d12/d1f 0 2024-09-10T09:35:59.846 INFO:tasks.workunit.client.0.smithi079.stdout:1/97: rename d5/df/f13 to d5/df/f1c 0 2024-09-10T09:35:59.846 INFO:tasks.workunit.client.0.smithi079.stdout:1/98: write d5/f19 [780783,120869] 0 2024-09-10T09:35:59.846 INFO:tasks.workunit.client.0.smithi079.stdout:7/99: fsync d4/dc/f17 0 2024-09-10T09:35:59.846 INFO:tasks.workunit.client.0.smithi079.stdout:7/100: chown d4/dc/d14 348 1 2024-09-10T09:35:59.846 INFO:tasks.workunit.client.0.smithi079.stdout:7/101: truncate d4/d6/fa 907394 0 2024-09-10T09:35:59.847 INFO:tasks.workunit.client.0.smithi079.stdout:5/78: dwrite d2/d3/ff [0,4194304] 0 2024-09-10T09:35:59.851 INFO:tasks.workunit.client.0.smithi079.stdout:0/147: symlink d4/d1d/l30 0 2024-09-10T09:35:59.851 INFO:tasks.workunit.client.0.smithi079.stdout:0/148: fsync d4/f10 0 2024-09-10T09:35:59.853 INFO:tasks.workunit.client.0.smithi079.stdout:9/54: symlink d3/d7/dc/de/l15 0 2024-09-10T09:35:59.853 INFO:tasks.workunit.client.0.smithi079.stdout:9/55: chown d3/d7/dc/de/l15 82 1 2024-09-10T09:35:59.853 INFO:tasks.workunit.client.0.smithi079.stdout:9/56: stat d3/l9 0 2024-09-10T09:35:59.853 INFO:tasks.workunit.client.0.smithi079.stdout:9/57: creat d3/f16 x:0 0 0 2024-09-10T09:35:59.854 INFO:tasks.workunit.client.0.smithi079.stdout:9/58: chown d3/l9 1959 1 2024-09-10T09:35:59.854 INFO:tasks.workunit.client.0.smithi079.stdout:9/59: chown d3/d7/dc/c13 413622 1 2024-09-10T09:35:59.856 INFO:tasks.workunit.client.0.smithi079.stdout:3/112: rename d4/fc to d4/da/d17/f21 0 2024-09-10T09:35:59.856 INFO:tasks.workunit.client.0.smithi079.stdout:3/113: write d4/da/d18/f1f [427148,61649] 0 2024-09-10T09:35:59.856 INFO:tasks.workunit.client.0.smithi079.stdout:6/102: dread d4/f5 [0,4194304] 0 2024-09-10T09:35:59.856 INFO:tasks.workunit.client.0.smithi079.stdout:6/103: creat d4/d8/f20 x:0 0 0 2024-09-10T09:35:59.856 INFO:tasks.workunit.client.0.smithi079.stdout:1/99: symlink d5/df/l1d 0 2024-09-10T09:35:59.856 INFO:tasks.workunit.client.0.smithi079.stdout:1/100: truncate d5/f19 1458328 0 2024-09-10T09:35:59.857 INFO:tasks.workunit.client.0.smithi079.stdout:5/79: dread d2/d3/fe [0,4194304] 0 2024-09-10T09:35:59.857 INFO:tasks.workunit.client.0.smithi079.stdout:0/149: link d4/d12/d21/c2d d4/d12/c31 0 2024-09-10T09:35:59.857 INFO:tasks.workunit.client.0.smithi079.stdout:5/80: stat d2 0 2024-09-10T09:35:59.857 INFO:tasks.workunit.client.0.smithi079.stdout:0/150: chown d4/d12/d15/f28 3060577 1 2024-09-10T09:35:59.858 INFO:tasks.workunit.client.0.smithi079.stdout:9/60: rename d3/d7/df to d3/d7/dc/de/d17 0 2024-09-10T09:35:59.858 INFO:tasks.workunit.client.0.smithi079.stdout:9/61: truncate d3/f14 723434 0 2024-09-10T09:35:59.859 INFO:tasks.workunit.client.0.smithi079.stdout:9/62: read d3/f14 [720367,118745] 0 2024-09-10T09:35:59.859 INFO:tasks.workunit.client.0.smithi079.stdout:3/114: mknod d4/da/d18/c22 0 2024-09-10T09:35:59.860 INFO:tasks.workunit.client.0.smithi079.stdout:2/59: sync 2024-09-10T09:35:59.861 INFO:tasks.workunit.client.0.smithi079.stdout:2/60: dread - d4/dc/f14 zero size 2024-09-10T09:35:59.861 INFO:tasks.workunit.client.0.smithi079.stdout:4/104: sync 2024-09-10T09:35:59.862 INFO:tasks.workunit.client.0.smithi079.stdout:9/63: dread d3/f14 [0,4194304] 0 2024-09-10T09:35:59.862 INFO:tasks.workunit.client.0.smithi079.stdout:7/102: dwrite d4/d6/f11 [4194304,4194304] 0 2024-09-10T09:35:59.862 INFO:tasks.workunit.client.0.smithi079.stdout:1/101: symlink d5/df/d11/l1e 0 2024-09-10T09:35:59.863 INFO:tasks.workunit.client.0.smithi079.stdout:1/102: write d5/df/d11/f1b [375111,94331] 0 2024-09-10T09:35:59.864 INFO:tasks.workunit.client.0.smithi079.stdout:8/115: getdents d11 0 2024-09-10T09:35:59.864 INFO:tasks.workunit.client.0.smithi079.stdout:8/116: fsync d11/f1e 0 2024-09-10T09:35:59.865 INFO:tasks.workunit.client.0.smithi079.stdout:2/61: symlink d4/dd/l19 0 2024-09-10T09:35:59.865 INFO:tasks.workunit.client.0.smithi079.stdout:0/151: dread d4/d12/f13 [0,4194304] 0 2024-09-10T09:35:59.866 INFO:tasks.workunit.client.0.smithi079.stdout:6/104: truncate f2 3829398 0 2024-09-10T09:35:59.866 INFO:tasks.workunit.client.0.smithi079.stdout:6/105: chown d4/d8/dc/d12/l18 28097 1 2024-09-10T09:35:59.866 INFO:tasks.workunit.client.0.smithi079.stdout:6/106: stat f3 0 2024-09-10T09:35:59.866 INFO:tasks.workunit.client.0.smithi079.stdout:6/107: stat d4/f6 0 2024-09-10T09:35:59.867 INFO:tasks.workunit.client.0.smithi079.stdout:9/64: mknod d3/d7/dc/de/d17/c18 0 2024-09-10T09:35:59.868 INFO:tasks.workunit.client.0.smithi079.stdout:2/62: dread d4/fb [0,4194304] 0 2024-09-10T09:35:59.870 INFO:tasks.workunit.client.0.smithi079.stdout:7/103: truncate d4/f5 742198 0 2024-09-10T09:35:59.870 INFO:tasks.workunit.client.0.smithi079.stdout:7/104: chown d4/df 983963316 1 2024-09-10T09:35:59.870 INFO:tasks.workunit.client.0.smithi079.stdout:7/105: stat d4/dc/f17 0 2024-09-10T09:35:59.872 INFO:tasks.workunit.client.0.smithi079.stdout:1/103: symlink d5/df/d11/l1f 0 2024-09-10T09:35:59.872 INFO:tasks.workunit.client.0.smithi079.stdout:1/104: fsync d5/f8 0 2024-09-10T09:35:59.872 INFO:tasks.workunit.client.0.smithi079.stdout:1/105: creat d5/f20 x:0 0 0 2024-09-10T09:35:59.873 INFO:tasks.workunit.client.0.smithi079.stdout:0/152: mkdir d4/d12/d1a/d29/d32 0 2024-09-10T09:35:59.873 INFO:tasks.workunit.client.0.smithi079.stdout:0/153: chown d4 248926625 1 2024-09-10T09:35:59.874 INFO:tasks.workunit.client.0.smithi079.stdout:2/63: mknod d4/dc/c1a 0 2024-09-10T09:35:59.874 INFO:tasks.workunit.client.0.smithi079.stdout:2/64: chown l1 34624609 1 2024-09-10T09:35:59.874 INFO:tasks.workunit.client.0.smithi079.stdout:2/65: read - d4/dc/f14 zero size 2024-09-10T09:35:59.877 INFO:tasks.workunit.client.0.smithi079.stdout:1/106: rename d5/f8 to d5/df/f21 0 2024-09-10T09:35:59.879 INFO:tasks.workunit.client.0.smithi079.stdout:6/108: read d4/d8/dc/d1c/f1a [3690083,95483] 0 2024-09-10T09:35:59.879 INFO:tasks.workunit.client.0.smithi079.stdout:8/117: mknod d11/c27 0 2024-09-10T09:35:59.879 INFO:tasks.workunit.client.0.smithi079.stdout:5/81: dwrite d2/f6 [0,4194304] 0 2024-09-10T09:35:59.881 INFO:tasks.workunit.client.0.smithi079.stdout:0/154: link d4/c2e d4/d1d/d24/c33 0 2024-09-10T09:35:59.881 INFO:tasks.workunit.client.0.smithi079.stdout:0/155: truncate d4/d12/f14 482301 0 2024-09-10T09:35:59.882 INFO:tasks.workunit.client.0.smithi079.stdout:7/106: dread d4/d6/f11 [4194304,4194304] 0 2024-09-10T09:35:59.884 INFO:tasks.workunit.client.0.smithi079.stdout:2/66: unlink d4/dc/c12 0 2024-09-10T09:35:59.886 INFO:tasks.workunit.client.0.smithi079.stdout:1/107: truncate d5/f6 578649 0 2024-09-10T09:35:59.892 INFO:tasks.workunit.client.0.smithi079.stdout:2/67: mkdir d4/dd/d1b 0 2024-09-10T09:35:59.892 INFO:tasks.workunit.client.0.smithi079.stdout:2/68: write d4/dc/f14 [43592,79808] 0 2024-09-10T09:35:59.893 INFO:tasks.workunit.client.0.smithi079.stdout:5/82: getdents d2 0 2024-09-10T09:35:59.894 INFO:tasks.workunit.client.0.smithi079.stdout:9/65: dread d3/f11 [0,4194304] 0 2024-09-10T09:35:59.895 INFO:tasks.workunit.client.0.smithi079.stdout:0/156: getdents d4/d12/d21 0 2024-09-10T09:35:59.896 INFO:tasks.workunit.client.0.smithi079.stdout:0/157: read d4/f10 [1003715,77905] 0 2024-09-10T09:35:59.897 INFO:tasks.workunit.client.0.smithi079.stdout:9/66: mknod d3/c19 0 2024-09-10T09:35:59.899 INFO:tasks.workunit.client.0.smithi079.stdout:8/118: write d11/f19 [2802659,107542] 0 2024-09-10T09:35:59.901 INFO:tasks.workunit.client.0.smithi079.stdout:5/83: dread d2/f6 [0,4194304] 0 2024-09-10T09:35:59.901 INFO:tasks.workunit.client.0.smithi079.stdout:5/84: getdents d2 0 2024-09-10T09:35:59.901 INFO:tasks.workunit.client.0.smithi079.stdout:3/115: dwrite d4/da/d18/f1c [0,4194304] 0 2024-09-10T09:35:59.901 INFO:tasks.workunit.client.0.smithi079.stdout:3/116: fsync d4/f8 0 2024-09-10T09:35:59.901 INFO:tasks.workunit.client.0.smithi079.stdout:3/117: write d4/da/d18/f1f [1203409,2790] 0 2024-09-10T09:35:59.901 INFO:tasks.workunit.client.0.smithi079.stdout:3/118: chown d4/da/d18/f1f 815780 1 2024-09-10T09:35:59.901 INFO:tasks.workunit.client.0.smithi079.stdout:8/119: creat d11/f28 x:0 0 0 2024-09-10T09:35:59.902 INFO:tasks.workunit.client.0.smithi079.stdout:1/108: fsync d5/f19 0 2024-09-10T09:35:59.902 INFO:tasks.workunit.client.0.smithi079.stdout:1/109: fdatasync d5/fe 0 2024-09-10T09:35:59.902 INFO:tasks.workunit.client.0.smithi079.stdout:4/105: dwrite d1/f11 [0,4194304] 0 2024-09-10T09:35:59.903 INFO:tasks.workunit.client.0.smithi079.stdout:5/85: rename d2/d3/c4 to d2/d3/c17 0 2024-09-10T09:35:59.912 INFO:tasks.workunit.client.0.smithi079.stdout:3/119: write f2 [1556724,54652] 0 2024-09-10T09:35:59.912 INFO:tasks.workunit.client.0.smithi079.stdout:3/120: write f2 [4769582,97546] 0 2024-09-10T09:35:59.912 INFO:tasks.workunit.client.0.smithi079.stdout:3/121: rename d4/da to d4/da/d23 22 2024-09-10T09:35:59.918 INFO:tasks.workunit.client.0.smithi079.stdout:9/67: dread d3/f5 [0,4194304] 0 2024-09-10T09:35:59.918 INFO:tasks.workunit.client.0.smithi079.stdout:4/106: dread d1/f11 [0,4194304] 0 2024-09-10T09:35:59.927 INFO:tasks.workunit.client.0.smithi079.stdout:3/122: write d4/da/f11 [2632469,24321] 0 2024-09-10T09:35:59.927 INFO:tasks.workunit.client.0.smithi079.stdout:7/107: truncate d4/d6/f11 8187721 0 2024-09-10T09:35:59.928 INFO:tasks.workunit.client.0.smithi079.stdout:3/123: dread d4/f13 [0,4194304] 0 2024-09-10T09:35:59.928 INFO:tasks.workunit.client.0.smithi079.stdout:3/124: write d4/f13 [241703,5825] 0 2024-09-10T09:35:59.932 INFO:tasks.workunit.client.0.smithi079.stdout:9/68: dread d3/f5 [0,4194304] 0 2024-09-10T09:35:59.936 INFO:tasks.workunit.client.0.smithi079.stdout:4/107: mkdir d1/da/d16/d21 0 2024-09-10T09:35:59.936 INFO:tasks.workunit.client.0.smithi079.stdout:4/108: fsync d1/da/fb 0 2024-09-10T09:35:59.936 INFO:tasks.workunit.client.0.smithi079.stdout:4/109: creat d1/da/d16/f22 x:0 0 0 2024-09-10T09:35:59.936 INFO:tasks.workunit.client.0.smithi079.stdout:4/110: stat d1/fc 0 2024-09-10T09:35:59.936 INFO:tasks.workunit.client.0.smithi079.stdout:4/111: write d1/da/d16/f1f [172209,26199] 0 2024-09-10T09:35:59.938 INFO:tasks.workunit.client.0.smithi079.stdout:7/108: creat d4/df/f18 x:0 0 0 2024-09-10T09:35:59.938 INFO:tasks.workunit.client.0.smithi079.stdout:7/109: write d4/df/f18 [996916,28254] 0 2024-09-10T09:35:59.938 INFO:tasks.workunit.client.0.smithi079.stdout:7/110: write d4/df/f18 [846099,63602] 0 2024-09-10T09:35:59.939 INFO:tasks.workunit.client.0.smithi079.stdout:9/69: mknod d3/d7/dc/de/d17/d12/c1a 0 2024-09-10T09:35:59.945 INFO:tasks.workunit.client.0.smithi079.stdout:7/111: dread d4/d6/fa [0,4194304] 0 2024-09-10T09:35:59.945 INFO:tasks.workunit.client.0.smithi079.stdout:7/112: write d4/df/f18 [1812320,25035] 0 2024-09-10T09:35:59.958 INFO:tasks.workunit.client.0.smithi079.stdout:3/125: dread d4/f12 [0,4194304] 0 2024-09-10T09:35:59.958 INFO:tasks.workunit.client.0.smithi079.stdout:8/120: dwrite d11/f21 [0,4194304] 0 2024-09-10T09:35:59.958 INFO:tasks.workunit.client.0.smithi079.stdout:8/121: chown d11/f1d 31180633 1 2024-09-10T09:35:59.961 INFO:tasks.workunit.client.0.smithi079.stdout:3/126: dread d4/f8 [0,4194304] 0 2024-09-10T09:35:59.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:35:59 smithi079 ceph-mon[27592]: pgmap v254: 65 pgs: 65 active+clean; 341 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 22 MiB/s wr, 455 op/s 2024-09-10T09:35:59.963 INFO:tasks.workunit.client.0.smithi079.stdout:3/127: rmdir d4/da/d18 39 2024-09-10T09:35:59.963 INFO:tasks.workunit.client.0.smithi079.stdout:3/128: creat d4/da/d17/f24 x:0 0 0 2024-09-10T09:35:59.967 INFO:tasks.workunit.client.0.smithi079.stdout:3/129: mknod d4/da/c25 0 2024-09-10T09:35:59.967 INFO:tasks.workunit.client.0.smithi079.stdout:3/130: chown f2 109664 1 2024-09-10T09:35:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:35:59 smithi135 ceph-mon[33411]: pgmap v254: 65 pgs: 65 active+clean; 341 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 22 MiB/s wr, 455 op/s 2024-09-10T09:35:59.970 INFO:tasks.workunit.client.0.smithi079.stdout:1/110: dwrite d5/df/f1c [0,4194304] 0 2024-09-10T09:35:59.970 INFO:tasks.workunit.client.0.smithi079.stdout:3/131: rename d4/da/d17/l1b to d4/da/d17/l26 0 2024-09-10T09:35:59.970 INFO:tasks.workunit.client.0.smithi079.stdout:1/111: creat d5/f22 x:0 0 0 2024-09-10T09:35:59.972 INFO:tasks.workunit.client.0.smithi079.stdout:4/112: dwrite d1/f17 [0,4194304] 0 2024-09-10T09:35:59.972 INFO:tasks.workunit.client.0.smithi079.stdout:3/132: mknod d4/da/c27 0 2024-09-10T09:35:59.972 INFO:tasks.workunit.client.0.smithi079.stdout:3/133: chown d4/da/c27 78485792 1 2024-09-10T09:35:59.972 INFO:tasks.workunit.client.0.smithi079.stdout:3/134: rename d4 to d4/da/d18/d28 22 2024-09-10T09:35:59.972 INFO:tasks.workunit.client.0.smithi079.stdout:3/135: chown d4/da/d17/l26 2041 1 2024-09-10T09:35:59.972 INFO:tasks.workunit.client.0.smithi079.stdout:3/136: creat d4/f29 x:0 0 0 2024-09-10T09:35:59.972 INFO:tasks.workunit.client.0.smithi079.stdout:5/86: dwrite d2/d3/f16 [0,4194304] 0 2024-09-10T09:35:59.974 INFO:tasks.workunit.client.0.smithi079.stdout:1/112: rmdir d5/df 39 2024-09-10T09:35:59.975 INFO:tasks.workunit.client.0.smithi079.stdout:2/69: dwrite d4/dc/f14 [0,4194304] 0 2024-09-10T09:35:59.977 INFO:tasks.workunit.client.0.smithi079.stdout:9/70: dwrite d3/f16 [0,4194304] 0 2024-09-10T09:35:59.977 INFO:tasks.workunit.client.0.smithi079.stdout:9/71: stat d3/f14 0 2024-09-10T09:35:59.977 INFO:tasks.workunit.client.0.smithi079.stdout:9/72: fsync d3/f16 0 2024-09-10T09:35:59.977 INFO:tasks.workunit.client.0.smithi079.stdout:9/73: write d3/f14 [1378548,87928] 0 2024-09-10T09:35:59.981 INFO:tasks.workunit.client.0.smithi079.stdout:5/87: symlink d2/d3/l18 0 2024-09-10T09:35:59.981 INFO:tasks.workunit.client.0.smithi079.stdout:8/122: dwrite f8 [4194304,4194304] 0 2024-09-10T09:35:59.982 INFO:tasks.workunit.client.0.smithi079.stdout:4/113: fdatasync d1/da/d16/f1f 0 2024-09-10T09:35:59.983 INFO:tasks.workunit.client.0.smithi079.stdout:4/114: fdatasync d1/f9 0 2024-09-10T09:35:59.983 INFO:tasks.workunit.client.0.smithi079.stdout:4/115: chown d1/ff 5664 1 2024-09-10T09:35:59.983 INFO:tasks.workunit.client.0.smithi079.stdout:4/116: getdents d1/da/d16/d21 0 2024-09-10T09:35:59.983 INFO:tasks.workunit.client.0.smithi079.stdout:1/113: symlink d5/l23 0 2024-09-10T09:35:59.987 INFO:tasks.workunit.client.0.smithi079.stdout:9/74: dread d3/f11 [0,4194304] 0 2024-09-10T09:35:59.987 INFO:tasks.workunit.client.0.smithi079.stdout:9/75: fdatasync d3/f16 0 2024-09-10T09:35:59.993 INFO:tasks.workunit.client.0.smithi079.stdout:2/70: dwrite d4/fb [0,4194304] 0 2024-09-10T09:36:00.008 INFO:tasks.workunit.client.0.smithi079.stdout:5/88: mknod d2/c19 0 2024-09-10T09:36:00.011 INFO:tasks.workunit.client.0.smithi079.stdout:5/89: write d2/d3/fe [993236,33483] 0 2024-09-10T09:36:00.013 INFO:tasks.workunit.client.0.smithi079.stdout:4/117: symlink d1/da/d16/l23 0 2024-09-10T09:36:00.013 INFO:tasks.workunit.client.0.smithi079.stdout:4/118: chown d1/f9 70689 1 2024-09-10T09:36:00.013 INFO:tasks.workunit.client.0.smithi079.stdout:4/119: chown d1/da/d16/l1a 495807224 1 2024-09-10T09:36:00.013 INFO:tasks.workunit.client.0.smithi079.stdout:4/120: fdatasync d1/da/f13 0 2024-09-10T09:36:00.019 INFO:tasks.workunit.client.0.smithi079.stdout:8/123: rmdir d11 39 2024-09-10T09:36:00.019 INFO:tasks.workunit.client.0.smithi079.stdout:3/137: dwrite d4/da/f11 [0,4194304] 0 2024-09-10T09:36:00.019 INFO:tasks.workunit.client.0.smithi079.stdout:7/113: dread d4/d6/f11 [0,4194304] 0 2024-09-10T09:36:00.019 INFO:tasks.workunit.client.0.smithi079.stdout:3/138: creat d4/f2a x:0 0 0 2024-09-10T09:36:00.019 INFO:tasks.workunit.client.0.smithi079.stdout:7/114: chown d4/dc 105 1 2024-09-10T09:36:00.021 INFO:tasks.workunit.client.0.smithi079.stdout:5/90: creat d2/d3/f1a x:0 0 0 2024-09-10T09:36:00.025 INFO:tasks.workunit.client.0.smithi079.stdout:8/124: creat d11/f29 x:0 0 0 2024-09-10T09:36:00.028 INFO:tasks.workunit.client.0.smithi079.stdout:4/121: write d1/ff [1368365,76250] 0 2024-09-10T09:36:00.028 INFO:tasks.workunit.client.0.smithi079.stdout:4/122: creat d1/da/d16/f24 x:0 0 0 2024-09-10T09:36:00.028 INFO:tasks.workunit.client.0.smithi079.stdout:7/115: rmdir d4/dc/d14 0 2024-09-10T09:36:00.029 INFO:tasks.workunit.client.0.smithi079.stdout:7/116: chown d4/df 2418 1 2024-09-10T09:36:00.031 INFO:tasks.workunit.client.0.smithi079.stdout:5/91: creat d2/f1b x:0 0 0 2024-09-10T09:36:00.031 INFO:tasks.workunit.client.0.smithi079.stdout:5/92: truncate d2/f1b 558694 0 2024-09-10T09:36:00.031 INFO:tasks.workunit.client.0.smithi079.stdout:5/93: creat d2/f1c x:0 0 0 2024-09-10T09:36:00.031 INFO:tasks.workunit.client.0.smithi079.stdout:5/94: creat d2/f1d x:0 0 0 2024-09-10T09:36:00.039 INFO:tasks.workunit.client.0.smithi079.stdout:0/158: sync 2024-09-10T09:36:00.039 INFO:tasks.workunit.client.0.smithi079.stdout:6/109: sync 2024-09-10T09:36:00.041 INFO:tasks.workunit.client.0.smithi079.stdout:8/125: dwrite d11/f28 [0,4194304] 0 2024-09-10T09:36:00.041 INFO:tasks.workunit.client.0.smithi079.stdout:8/126: chown d11/f12 666 1 2024-09-10T09:36:00.041 INFO:tasks.workunit.client.0.smithi079.stdout:3/139: dwrite d4/f29 [0,4194304] 0 2024-09-10T09:36:00.041 INFO:tasks.workunit.client.0.smithi079.stdout:3/140: creat d4/f2b x:0 0 0 2024-09-10T09:36:00.041 INFO:tasks.workunit.client.0.smithi079.stdout:0/159: link d4/d1d/c1e d4/d12/d15/d2b/c34 0 2024-09-10T09:36:00.043 INFO:tasks.workunit.client.0.smithi079.stdout:6/110: creat d4/d8/dc/d1c/f21 x:0 0 0 2024-09-10T09:36:00.043 INFO:tasks.workunit.client.0.smithi079.stdout:6/111: dread - d4/d8/dc/d1c/f21 zero size 2024-09-10T09:36:00.043 INFO:tasks.workunit.client.0.smithi079.stdout:1/114: dwrite d5/f14 [0,4194304] 0 2024-09-10T09:36:00.043 INFO:tasks.workunit.client.0.smithi079.stdout:9/76: dwrite d3/f5 [0,4194304] 0 2024-09-10T09:36:00.043 INFO:tasks.workunit.client.0.smithi079.stdout:5/95: dread d2/d3/f16 [0,4194304] 0 2024-09-10T09:36:00.043 INFO:tasks.workunit.client.0.smithi079.stdout:1/115: dread - d5/f22 zero size 2024-09-10T09:36:00.044 INFO:tasks.workunit.client.0.smithi079.stdout:1/116: write d5/f20 [882975,34622] 0 2024-09-10T09:36:00.047 INFO:tasks.workunit.client.0.smithi079.stdout:1/117: fsync d5/f20 0 2024-09-10T09:36:00.047 INFO:tasks.workunit.client.0.smithi079.stdout:1/118: chown d5/cc 185 1 2024-09-10T09:36:00.047 INFO:tasks.workunit.client.0.smithi079.stdout:1/119: read d5/f19 [790251,101384] 0 2024-09-10T09:36:00.047 INFO:tasks.workunit.client.0.smithi079.stdout:1/120: chown d5/f6 11219 1 2024-09-10T09:36:00.056 INFO:tasks.workunit.client.0.smithi079.stdout:6/112: symlink d4/d8/dc/d12/l22 0 2024-09-10T09:36:00.056 INFO:tasks.workunit.client.0.smithi079.stdout:6/113: fdatasync d4/d8/dd/f1b 0 2024-09-10T09:36:00.060 INFO:tasks.workunit.client.0.smithi079.stdout:5/96: truncate d2/f6 950610 0 2024-09-10T09:36:00.063 INFO:tasks.workunit.client.0.smithi079.stdout:1/121: mkdir d5/d24 0 2024-09-10T09:36:00.063 INFO:tasks.workunit.client.0.smithi079.stdout:1/122: chown d5/df/d11/l1f 59252158 1 2024-09-10T09:36:00.063 INFO:tasks.workunit.client.0.smithi079.stdout:1/123: chown d5/df/d11/c18 1732 1 2024-09-10T09:36:00.064 INFO:tasks.workunit.client.0.smithi079.stdout:1/124: mknod d5/d24/c25 0 2024-09-10T09:36:00.065 INFO:tasks.workunit.client.0.smithi079.stdout:1/125: mknod d5/d24/c26 0 2024-09-10T09:36:00.066 INFO:tasks.workunit.client.0.smithi079.stdout:6/114: dread d4/d8/dc/d1c/f1a [0,4194304] 0 2024-09-10T09:36:00.067 INFO:tasks.workunit.client.0.smithi079.stdout:6/115: mknod d4/d8/dc/d12/d1f/c23 0 2024-09-10T09:36:00.069 INFO:tasks.workunit.client.0.smithi079.stdout:6/116: unlink d4/f5 0 2024-09-10T09:36:00.069 INFO:tasks.workunit.client.0.smithi079.stdout:6/117: chown d4/d8/fa 651810219 1 2024-09-10T09:36:00.070 INFO:tasks.workunit.client.0.smithi079.stdout:6/118: creat d4/d8/dc/f24 x:0 0 0 2024-09-10T09:36:00.070 INFO:tasks.workunit.client.0.smithi079.stdout:9/77: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:00.071 INFO:tasks.workunit.client.0.smithi079.stdout:8/127: dwrite d11/f21 [0,4194304] 0 2024-09-10T09:36:00.072 INFO:tasks.workunit.client.0.smithi079.stdout:5/97: dread d2/d3/ff [0,4194304] 0 2024-09-10T09:36:00.072 INFO:tasks.workunit.client.0.smithi079.stdout:3/141: dwrite d4/f12 [0,4194304] 0 2024-09-10T09:36:00.072 INFO:tasks.workunit.client.0.smithi079.stdout:3/142: fdatasync d4/da/d18/f1f 0 2024-09-10T09:36:00.076 INFO:tasks.workunit.client.0.smithi079.stdout:5/98: symlink d2/l1e 0 2024-09-10T09:36:00.076 INFO:tasks.workunit.client.0.smithi079.stdout:5/99: read - d2/f1c zero size 2024-09-10T09:36:00.076 INFO:tasks.workunit.client.0.smithi079.stdout:5/100: chown d2/d3/fe 29380 1 2024-09-10T09:36:00.081 INFO:tasks.workunit.client.0.smithi079.stdout:3/143: rename d4/da/d17/f1e to d4/f2c 0 2024-09-10T09:36:00.081 INFO:tasks.workunit.client.0.smithi079.stdout:3/144: write d4/f2c [743272,130557] 0 2024-09-10T09:36:00.081 INFO:tasks.workunit.client.0.smithi079.stdout:3/145: stat d4/c6 0 2024-09-10T09:36:00.087 INFO:tasks.workunit.client.0.smithi079.stdout:9/78: dread d3/f11 [0,4194304] 0 2024-09-10T09:36:00.093 INFO:tasks.workunit.client.0.smithi079.stdout:3/146: dread d4/da/d17/f21 [0,4194304] 0 2024-09-10T09:36:00.093 INFO:tasks.workunit.client.0.smithi079.stdout:3/147: stat d4/da/d17/f1a 0 2024-09-10T09:36:00.093 INFO:tasks.workunit.client.0.smithi079.stdout:9/79: unlink d3/d7/dc/de/d17/d12/c1a 0 2024-09-10T09:36:00.093 INFO:tasks.workunit.client.0.smithi079.stdout:9/80: chown d3 0 1 2024-09-10T09:36:00.094 INFO:tasks.workunit.client.0.smithi079.stdout:9/81: truncate d3/f14 3177999 0 2024-09-10T09:36:00.098 INFO:tasks.workunit.client.0.smithi079.stdout:1/126: dwrite d5/f14 [0,4194304] 0 2024-09-10T09:36:00.100 INFO:tasks.workunit.client.0.smithi079.stdout:1/127: mknod d5/df/d11/c27 0 2024-09-10T09:36:00.101 INFO:tasks.workunit.client.0.smithi079.stdout:8/128: dwrite d11/f12 [0,4194304] 0 2024-09-10T09:36:00.102 INFO:tasks.workunit.client.0.smithi079.stdout:1/128: mknod d5/c28 0 2024-09-10T09:36:00.102 INFO:tasks.workunit.client.0.smithi079.stdout:1/129: write d5/df/d11/f1b [667396,62923] 0 2024-09-10T09:36:00.105 INFO:tasks.workunit.client.0.smithi079.stdout:8/129: creat d11/f2a x:0 0 0 2024-09-10T09:36:00.105 INFO:tasks.workunit.client.0.smithi079.stdout:8/130: write d11/f20 [1289367,127685] 0 2024-09-10T09:36:00.105 INFO:tasks.workunit.client.0.smithi079.stdout:8/131: stat f8 0 2024-09-10T09:36:00.105 INFO:tasks.workunit.client.0.smithi079.stdout:8/132: fdatasync fe 0 2024-09-10T09:36:00.105 INFO:tasks.workunit.client.0.smithi079.stdout:8/133: write d11/f29 [181283,98337] 0 2024-09-10T09:36:00.105 INFO:tasks.workunit.client.0.smithi079.stdout:8/134: chown d11/f2a 555476 1 2024-09-10T09:36:00.105 INFO:tasks.workunit.client.0.smithi079.stdout:8/135: write d11/f1d [866407,23391] 0 2024-09-10T09:36:00.106 INFO:tasks.workunit.client.0.smithi079.stdout:6/119: dwrite d4/d8/fb [0,4194304] 0 2024-09-10T09:36:00.107 INFO:tasks.workunit.client.0.smithi079.stdout:1/130: dread d5/df/f21 [0,4194304] 0 2024-09-10T09:36:00.108 INFO:tasks.workunit.client.0.smithi079.stdout:1/131: fsync d5/f20 0 2024-09-10T09:36:00.108 INFO:tasks.workunit.client.0.smithi079.stdout:6/120: symlink d4/l25 0 2024-09-10T09:36:00.110 INFO:tasks.workunit.client.0.smithi079.stdout:6/121: link d4/d8/dc/c16 d4/d8/dd/c26 0 2024-09-10T09:36:00.112 INFO:tasks.workunit.client.0.smithi079.stdout:3/148: dwrite f2 [0,4194304] 0 2024-09-10T09:36:00.112 INFO:tasks.workunit.client.0.smithi079.stdout:3/149: readlink d4/da/d17/l26 0 2024-09-10T09:36:00.113 INFO:tasks.workunit.client.0.smithi079.stdout:6/122: dread d4/f17 [4194304,4194304] 0 2024-09-10T09:36:00.114 INFO:tasks.workunit.client.0.smithi079.stdout:1/132: rmdir d5 39 2024-09-10T09:36:00.116 INFO:tasks.workunit.client.0.smithi079.stdout:1/133: symlink d5/l29 0 2024-09-10T09:36:00.118 INFO:tasks.workunit.client.0.smithi079.stdout:8/136: rmdir d11 39 2024-09-10T09:36:00.122 INFO:tasks.workunit.client.0.smithi079.stdout:1/134: symlink d5/d24/l2a 0 2024-09-10T09:36:00.122 INFO:tasks.workunit.client.0.smithi079.stdout:1/135: chown d5/f22 2802 1 2024-09-10T09:36:00.125 INFO:tasks.workunit.client.0.smithi079.stdout:3/150: write d4/da/f11 [493832,30648] 0 2024-09-10T09:36:00.126 INFO:tasks.workunit.client.0.smithi079.stdout:3/151: dread - d4/da/d17/f24 zero size 2024-09-10T09:36:00.127 INFO:tasks.workunit.client.0.smithi079.stdout:3/152: mkdir d4/da/d17/d2d 0 2024-09-10T09:36:00.127 INFO:tasks.workunit.client.0.smithi079.stdout:3/153: truncate d4/da/f11 4983546 0 2024-09-10T09:36:00.128 INFO:tasks.workunit.client.0.smithi079.stdout:3/154: rename c0 to d4/da/d17/d2d/c2e 0 2024-09-10T09:36:00.129 INFO:tasks.workunit.client.0.smithi079.stdout:6/123: dread d4/d8/dc/fe [0,4194304] 0 2024-09-10T09:36:00.130 INFO:tasks.workunit.client.0.smithi079.stdout:6/124: chown d4/d8/dc/d12 2343501 1 2024-09-10T09:36:00.133 INFO:tasks.workunit.client.0.smithi079.stdout:1/136: dread d5/df/f1c [0,4194304] 0 2024-09-10T09:36:00.133 INFO:tasks.workunit.client.0.smithi079.stdout:1/137: chown d5/f19 88703 1 2024-09-10T09:36:00.133 INFO:tasks.workunit.client.0.smithi079.stdout:1/138: dread - d5/df/d11/f16 zero size 2024-09-10T09:36:00.134 INFO:tasks.workunit.client.0.smithi079.stdout:1/139: chown d5/f14 345715 1 2024-09-10T09:36:00.137 INFO:tasks.workunit.client.0.smithi079.stdout:3/155: dread d4/da/d18/f1c [0,4194304] 0 2024-09-10T09:36:00.142 INFO:tasks.workunit.client.0.smithi079.stdout:1/140: dread d5/f14 [0,4194304] 0 2024-09-10T09:36:00.150 INFO:tasks.workunit.client.0.smithi079.stdout:8/137: dread d11/f1a [0,4194304] 0 2024-09-10T09:36:00.150 INFO:tasks.workunit.client.0.smithi079.stdout:9/82: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:00.154 INFO:tasks.workunit.client.0.smithi079.stdout:3/156: rmdir d4 39 2024-09-10T09:36:00.157 INFO:tasks.workunit.client.0.smithi079.stdout:8/138: write d11/f21 [3945332,88113] 0 2024-09-10T09:36:00.159 INFO:tasks.workunit.client.0.smithi079.stdout:8/139: mkdir d11/d2b 0 2024-09-10T09:36:00.160 INFO:tasks.workunit.client.0.smithi079.stdout:8/140: write d11/f2a [718704,114366] 0 2024-09-10T09:36:00.160 INFO:tasks.workunit.client.0.smithi079.stdout:8/141: chown d11/f20 3805 1 2024-09-10T09:36:00.160 INFO:tasks.workunit.client.0.smithi079.stdout:8/142: mknod d11/d2b/c2c 0 2024-09-10T09:36:00.165 INFO:tasks.workunit.client.0.smithi079.stdout:1/141: dwrite d5/f14 [4194304,4194304] 0 2024-09-10T09:36:00.165 INFO:tasks.workunit.client.0.smithi079.stdout:9/83: dread d3/f16 [0,4194304] 0 2024-09-10T09:36:00.165 INFO:tasks.workunit.client.0.smithi079.stdout:6/125: dwrite d4/d8/dc/d1c/f1d [0,4194304] 0 2024-09-10T09:36:00.165 INFO:tasks.workunit.client.0.smithi079.stdout:6/126: creat d4/d8/dd/f27 x:0 0 0 2024-09-10T09:36:00.166 INFO:tasks.workunit.client.0.smithi079.stdout:6/127: stat d4/f6 0 2024-09-10T09:36:00.166 INFO:tasks.workunit.client.0.smithi079.stdout:6/128: stat d4/f17 0 2024-09-10T09:36:00.169 INFO:tasks.workunit.client.0.smithi079.stdout:1/142: unlink d5/f6 0 2024-09-10T09:36:00.169 INFO:tasks.workunit.client.0.smithi079.stdout:1/143: dread - d5/df/d11/f16 zero size 2024-09-10T09:36:00.172 INFO:tasks.workunit.client.0.smithi079.stdout:3/157: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:00.172 INFO:tasks.workunit.client.0.smithi079.stdout:3/158: fsync d4/f2b 0 2024-09-10T09:36:00.172 INFO:tasks.workunit.client.0.smithi079.stdout:3/159: dread - d4/f2a zero size 2024-09-10T09:36:00.174 INFO:tasks.workunit.client.0.smithi079.stdout:2/71: sync 2024-09-10T09:36:00.174 INFO:tasks.workunit.client.0.smithi079.stdout:2/72: readlink l2 0 2024-09-10T09:36:00.174 INFO:tasks.workunit.client.0.smithi079.stdout:9/84: dread d3/f16 [0,4194304] 0 2024-09-10T09:36:00.174 INFO:tasks.workunit.client.0.smithi079.stdout:9/85: fdatasync d3/f5 0 2024-09-10T09:36:00.174 INFO:tasks.workunit.client.0.smithi079.stdout:9/86: chown d3/d7/dc/c10 25400831 1 2024-09-10T09:36:00.174 INFO:tasks.workunit.client.0.smithi079.stdout:8/143: getdents d11 0 2024-09-10T09:36:00.175 INFO:tasks.workunit.client.0.smithi079.stdout:2/73: dread d4/dd/f16 [0,4194304] 0 2024-09-10T09:36:00.177 INFO:tasks.workunit.client.0.smithi079.stdout:6/129: symlink d4/d8/dd/l28 0 2024-09-10T09:36:00.177 INFO:tasks.workunit.client.0.smithi079.stdout:6/130: dread - d4/d8/dc/d1c/f10 zero size 2024-09-10T09:36:00.178 INFO:tasks.workunit.client.0.smithi079.stdout:6/131: read - d4/d8/dc/d1c/f21 zero size 2024-09-10T09:36:00.178 INFO:tasks.workunit.client.0.smithi079.stdout:6/132: chown f2 640401 1 2024-09-10T09:36:00.179 INFO:tasks.workunit.client.0.smithi079.stdout:1/144: creat d5/df/d11/f2b x:0 0 0 2024-09-10T09:36:00.180 INFO:tasks.workunit.client.0.smithi079.stdout:9/87: getdents d3/d7/dc/de 0 2024-09-10T09:36:00.180 INFO:tasks.workunit.client.0.smithi079.stdout:9/88: fdatasync d3/f14 0 2024-09-10T09:36:00.181 INFO:tasks.workunit.client.0.smithi079.stdout:6/133: mkdir d4/d8/dc/d12/d29 0 2024-09-10T09:36:00.181 INFO:tasks.workunit.client.0.smithi079.stdout:6/134: getdents d4/d8/dc/d12/d29 0 2024-09-10T09:36:00.183 INFO:tasks.workunit.client.0.smithi079.stdout:6/135: link d4/d8/dc/d1c/f1d d4/d8/dc/d1c/f2a 0 2024-09-10T09:36:00.184 INFO:tasks.workunit.client.0.smithi079.stdout:8/144: write d11/f28 [1330043,20576] 0 2024-09-10T09:36:00.188 INFO:tasks.workunit.client.0.smithi079.stdout:6/136: link l1 d4/d8/dc/d12/l2b 0 2024-09-10T09:36:00.188 INFO:tasks.workunit.client.0.smithi079.stdout:6/137: truncate d4/d8/dc/d1c/f15 1342907 0 2024-09-10T09:36:00.188 INFO:tasks.workunit.client.0.smithi079.stdout:2/74: dread d4/f5 [0,4194304] 0 2024-09-10T09:36:00.188 INFO:tasks.workunit.client.0.smithi079.stdout:2/75: truncate d4/dd/ff 606233 0 2024-09-10T09:36:00.191 INFO:tasks.workunit.client.0.smithi079.stdout:8/145: creat d11/d2b/f2d x:0 0 0 2024-09-10T09:36:00.193 INFO:tasks.workunit.client.0.smithi079.stdout:0/160: sync 2024-09-10T09:36:00.193 INFO:tasks.workunit.client.0.smithi079.stdout:7/117: sync 2024-09-10T09:36:00.193 INFO:tasks.workunit.client.0.smithi079.stdout:4/123: sync 2024-09-10T09:36:00.196 INFO:tasks.workunit.client.0.smithi079.stdout:6/138: creat d4/d8/dc/d12/d29/f2c x:0 0 0 2024-09-10T09:36:00.202 INFO:tasks.workunit.client.0.smithi079.stdout:8/146: creat d11/f2e x:0 0 0 2024-09-10T09:36:00.203 INFO:tasks.workunit.client.0.smithi079.stdout:7/118: mkdir d4/df/d19 0 2024-09-10T09:36:00.204 INFO:tasks.workunit.client.0.smithi079.stdout:6/139: symlink d4/d8/dc/d12/d29/l2d 0 2024-09-10T09:36:00.205 INFO:tasks.workunit.client.0.smithi079.stdout:6/140: creat d4/d8/dd/f2e x:0 0 0 2024-09-10T09:36:00.205 INFO:tasks.workunit.client.0.smithi079.stdout:5/101: sync 2024-09-10T09:36:00.205 INFO:tasks.workunit.client.0.smithi079.stdout:3/160: dwrite d4/da/d17/f21 [0,4194304] 0 2024-09-10T09:36:00.205 INFO:tasks.workunit.client.0.smithi079.stdout:4/124: rmdir d1/da/d16 39 2024-09-10T09:36:00.211 INFO:tasks.workunit.client.0.smithi079.stdout:7/119: truncate d4/d6/f11 3334697 0 2024-09-10T09:36:00.212 INFO:tasks.workunit.client.0.smithi079.stdout:6/141: truncate d4/d8/dc/fe 3969947 0 2024-09-10T09:36:00.212 INFO:tasks.workunit.client.0.smithi079.stdout:5/102: rename d2/d3/l18 to d2/l1f 0 2024-09-10T09:36:00.214 INFO:tasks.workunit.client.0.smithi079.stdout:3/161: unlink d4/ld 0 2024-09-10T09:36:00.214 INFO:tasks.workunit.client.0.smithi079.stdout:3/162: chown d4/da/c15 65 1 2024-09-10T09:36:00.215 INFO:tasks.workunit.client.0.smithi079.stdout:8/147: rename d11/l18 to d11/l2f 0 2024-09-10T09:36:00.216 INFO:tasks.workunit.client.0.smithi079.stdout:5/103: rename d2/f1c to d2/f20 0 2024-09-10T09:36:00.217 INFO:tasks.workunit.client.0.smithi079.stdout:5/104: truncate d2/f6 403872 0 2024-09-10T09:36:00.219 INFO:tasks.workunit.client.0.smithi079.stdout:5/105: mkdir d2/d3/d21 0 2024-09-10T09:36:00.219 INFO:tasks.workunit.client.0.smithi079.stdout:5/106: chown d2/l1e 1774370677 1 2024-09-10T09:36:00.219 INFO:tasks.workunit.client.0.smithi079.stdout:5/107: creat d2/f22 x:0 0 0 2024-09-10T09:36:00.220 INFO:tasks.workunit.client.0.smithi079.stdout:5/108: dread - d2/f1d zero size 2024-09-10T09:36:00.220 INFO:tasks.workunit.client.0.smithi079.stdout:5/109: read d2/f1b [547165,67234] 0 2024-09-10T09:36:00.220 INFO:tasks.workunit.client.0.smithi079.stdout:5/110: readlink d2/d3/l10 0 2024-09-10T09:36:00.223 INFO:tasks.workunit.client.0.smithi079.stdout:4/125: write d1/f17 [2776650,2319] 0 2024-09-10T09:36:00.225 INFO:tasks.workunit.client.0.smithi079.stdout:4/126: read d1/f7 [727762,71445] 0 2024-09-10T09:36:00.230 INFO:tasks.workunit.client.0.smithi079.stdout:4/127: dread d1/fc [0,4194304] 0 2024-09-10T09:36:00.231 INFO:tasks.workunit.client.0.smithi079.stdout:4/128: unlink d1/da/l12 0 2024-09-10T09:36:00.234 INFO:tasks.workunit.client.0.smithi079.stdout:6/142: write d4/d8/dc/d1c/f2a [3501285,93023] 0 2024-09-10T09:36:00.234 INFO:tasks.workunit.client.0.smithi079.stdout:6/143: truncate d4/d8/dd/f2e 1047558 0 2024-09-10T09:36:00.234 INFO:tasks.workunit.client.0.smithi079.stdout:6/144: write d4/d8/f20 [186130,76869] 0 2024-09-10T09:36:00.234 INFO:tasks.workunit.client.0.smithi079.stdout:6/145: creat d4/d8/dc/d12/d29/f2f x:0 0 0 2024-09-10T09:36:00.234 INFO:tasks.workunit.client.0.smithi079.stdout:6/146: stat d4/d8/dc/d12/d29/l2d 0 2024-09-10T09:36:00.235 INFO:tasks.workunit.client.0.smithi079.stdout:4/129: creat d1/da/d16/d21/f25 x:0 0 0 2024-09-10T09:36:00.235 INFO:tasks.workunit.client.0.smithi079.stdout:1/145: dwrite d5/fe [0,4194304] 0 2024-09-10T09:36:00.235 INFO:tasks.workunit.client.0.smithi079.stdout:9/89: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:00.235 INFO:tasks.workunit.client.0.smithi079.stdout:2/76: dwrite d4/f18 [0,4194304] 0 2024-09-10T09:36:00.235 INFO:tasks.workunit.client.0.smithi079.stdout:0/161: dwrite d4/d12/d1a/f19 [0,4194304] 0 2024-09-10T09:36:00.236 INFO:tasks.workunit.client.0.smithi079.stdout:6/147: link f3 d4/d8/dc/d12/f30 0 2024-09-10T09:36:00.236 INFO:tasks.workunit.client.0.smithi079.stdout:6/148: truncate d4/d8/dc/d1c/f10 922696 0 2024-09-10T09:36:00.236 INFO:tasks.workunit.client.0.smithi079.stdout:6/149: chown d4/d8 130781 1 2024-09-10T09:36:00.238 INFO:tasks.workunit.client.0.smithi079.stdout:4/130: rename d1/da/f13 to d1/da/d16/f26 0 2024-09-10T09:36:00.240 INFO:tasks.workunit.client.0.smithi079.stdout:1/146: symlink d5/l2c 0 2024-09-10T09:36:00.240 INFO:tasks.workunit.client.0.smithi079.stdout:1/147: read - d5/df/d11/f16 zero size 2024-09-10T09:36:00.242 INFO:tasks.workunit.client.0.smithi079.stdout:9/90: mknod d3/d7/dc/c1b 0 2024-09-10T09:36:00.246 INFO:tasks.workunit.client.0.smithi079.stdout:2/77: dread d4/f18 [0,4194304] 0 2024-09-10T09:36:00.255 INFO:tasks.workunit.client.0.smithi079.stdout:0/162: mknod d4/d12/d1a/d29/d32/c35 0 2024-09-10T09:36:00.258 INFO:tasks.workunit.client.0.smithi079.stdout:8/148: getdents d11 0 2024-09-10T09:36:00.258 INFO:tasks.workunit.client.0.smithi079.stdout:8/149: creat d11/d2b/f30 x:0 0 0 2024-09-10T09:36:00.260 INFO:tasks.workunit.client.0.smithi079.stdout:6/150: unlink d4/d8/dc/d1c/f10 0 2024-09-10T09:36:00.260 INFO:tasks.workunit.client.0.smithi079.stdout:6/151: creat d4/d8/dc/d12/d29/f31 x:0 0 0 2024-09-10T09:36:00.260 INFO:tasks.workunit.client.0.smithi079.stdout:6/152: chown d4/d8/f20 1704785110 1 2024-09-10T09:36:00.260 INFO:tasks.workunit.client.0.smithi079.stdout:6/153: write d4/d8/dc/d12/f30 [1647646,60346] 0 2024-09-10T09:36:00.261 INFO:tasks.workunit.client.0.smithi079.stdout:7/120: dread d4/d6/f11 [0,4194304] 0 2024-09-10T09:36:00.263 INFO:tasks.workunit.client.0.smithi079.stdout:4/131: creat d1/da/d16/f27 x:0 0 0 2024-09-10T09:36:00.263 INFO:tasks.workunit.client.0.smithi079.stdout:4/132: chown d1/da/d16/l1e 0 1 2024-09-10T09:36:00.265 INFO:tasks.workunit.client.0.smithi079.stdout:1/148: rename d5/df/f21 to d5/df/d11/f2d 0 2024-09-10T09:36:00.265 INFO:tasks.workunit.client.0.smithi079.stdout:1/149: read - d5/df/d11/f16 zero size 2024-09-10T09:36:00.265 INFO:tasks.workunit.client.0.smithi079.stdout:1/150: fdatasync d5/fe 0 2024-09-10T09:36:00.266 INFO:tasks.workunit.client.0.smithi079.stdout:2/78: mkdir d4/dc/d1c 0 2024-09-10T09:36:00.266 INFO:tasks.workunit.client.0.smithi079.stdout:7/121: dread d4/d6/f11 [0,4194304] 0 2024-09-10T09:36:00.269 INFO:tasks.workunit.client.0.smithi079.stdout:0/163: mknod d4/d12/d1a/c36 0 2024-09-10T09:36:00.271 INFO:tasks.workunit.client.0.smithi079.stdout:9/91: dwrite d3/f5 [0,4194304] 0 2024-09-10T09:36:00.272 INFO:tasks.workunit.client.0.smithi079.stdout:8/150: creat d11/f31 x:0 0 0 2024-09-10T09:36:00.277 INFO:tasks.workunit.client.0.smithi079.stdout:1/151: mkdir d5/df/d2e 0 2024-09-10T09:36:00.278 INFO:tasks.workunit.client.0.smithi079.stdout:9/92: write d3/f16 [641859,107794] 0 2024-09-10T09:36:00.278 INFO:tasks.workunit.client.0.smithi079.stdout:9/93: creat d3/f1c x:0 0 0 2024-09-10T09:36:00.280 INFO:tasks.workunit.client.0.smithi079.stdout:7/122: mknod d4/df/d19/c1a 0 2024-09-10T09:36:00.280 INFO:tasks.workunit.client.0.smithi079.stdout:7/123: write d4/dc/f17 [886743,77346] 0 2024-09-10T09:36:00.283 INFO:tasks.workunit.client.0.smithi079.stdout:0/164: creat d4/d12/d1a/d29/f37 x:0 0 0 2024-09-10T09:36:00.285 INFO:tasks.workunit.client.0.smithi079.stdout:8/151: write d11/f23 [523950,10126] 0 2024-09-10T09:36:00.286 INFO:tasks.workunit.client.0.smithi079.stdout:6/154: dwrite d4/f6 [0,4194304] 0 2024-09-10T09:36:00.286 INFO:tasks.workunit.client.0.smithi079.stdout:4/133: mkdir d1/da/d28 0 2024-09-10T09:36:00.288 INFO:tasks.workunit.client.0.smithi079.stdout:1/152: creat d5/d24/f2f x:0 0 0 2024-09-10T09:36:00.288 INFO:tasks.workunit.client.0.smithi079.stdout:1/153: stat d5/d24 0 2024-09-10T09:36:00.289 INFO:tasks.workunit.client.0.smithi079.stdout:1/154: dread - d5/df/d11/f16 zero size 2024-09-10T09:36:00.291 INFO:tasks.workunit.client.0.smithi079.stdout:9/94: dread d3/f16 [0,4194304] 0 2024-09-10T09:36:00.292 INFO:tasks.workunit.client.0.smithi079.stdout:2/79: unlink d4/c8 0 2024-09-10T09:36:00.301 INFO:tasks.workunit.client.0.smithi079.stdout:6/155: rename d4/f6 to d4/d8/dc/d1c/f32 0 2024-09-10T09:36:00.302 INFO:tasks.workunit.client.0.smithi079.stdout:4/134: link d1/da/d16/f22 d1/da/d28/f29 0 2024-09-10T09:36:00.302 INFO:tasks.workunit.client.0.smithi079.stdout:4/135: readlink d1/da/d16/l1e 0 2024-09-10T09:36:00.303 INFO:tasks.workunit.client.0.smithi079.stdout:9/95: creat d3/d7/dc/de/d17/f1d x:0 0 0 2024-09-10T09:36:00.303 INFO:tasks.workunit.client.0.smithi079.stdout:9/96: truncate d3/f16 4910479 0 2024-09-10T09:36:00.303 INFO:tasks.workunit.client.0.smithi079.stdout:9/97: write d3/d7/dc/de/d17/f1d [314056,2191] 0 2024-09-10T09:36:00.305 INFO:tasks.workunit.client.0.smithi079.stdout:4/136: write d1/fc [2537574,10982] 0 2024-09-10T09:36:00.305 INFO:tasks.workunit.client.0.smithi079.stdout:4/137: fdatasync d1/fe 0 2024-09-10T09:36:00.305 INFO:tasks.workunit.client.0.smithi079.stdout:4/138: creat d1/f2a x:0 0 0 2024-09-10T09:36:00.305 INFO:tasks.workunit.client.0.smithi079.stdout:4/139: write d1/fe [9006100,130763] 0 2024-09-10T09:36:00.306 INFO:tasks.workunit.client.0.smithi079.stdout:1/155: rename d5/df/l1d to d5/df/d11/l30 0 2024-09-10T09:36:00.307 INFO:tasks.workunit.client.0.smithi079.stdout:6/156: creat d4/d8/dc/d12/d1f/f33 x:0 0 0 2024-09-10T09:36:00.307 INFO:tasks.workunit.client.0.smithi079.stdout:6/157: chown d4/d8/dc/d12/d1f 3992441 1 2024-09-10T09:36:00.308 INFO:tasks.workunit.client.0.smithi079.stdout:9/98: symlink d3/d7/dc/de/l1e 0 2024-09-10T09:36:00.308 INFO:tasks.workunit.client.0.smithi079.stdout:9/99: creat d3/d7/dc/de/d17/f1f x:0 0 0 2024-09-10T09:36:00.308 INFO:tasks.workunit.client.0.smithi079.stdout:9/100: write d3/f1c [188699,3977] 0 2024-09-10T09:36:00.309 INFO:tasks.workunit.client.0.smithi079.stdout:2/80: getdents d4/dd 0 2024-09-10T09:36:00.309 INFO:tasks.workunit.client.0.smithi079.stdout:2/81: chown d4/dc/d13/f15 1 1 2024-09-10T09:36:00.311 INFO:tasks.workunit.client.0.smithi079.stdout:8/152: rename d11/f29 to d11/f32 0 2024-09-10T09:36:00.312 INFO:tasks.workunit.client.0.smithi079.stdout:6/158: dread d4/d8/dc/d1c/f2a [0,4194304] 0 2024-09-10T09:36:00.312 INFO:tasks.workunit.client.0.smithi079.stdout:6/159: write d4/d8/dc/d1c/f1d [3991357,48834] 0 2024-09-10T09:36:00.312 INFO:tasks.workunit.client.0.smithi079.stdout:6/160: fdatasync d4/d8/dc/f24 0 2024-09-10T09:36:00.316 INFO:tasks.workunit.client.0.smithi079.stdout:4/140: creat d1/da/f2b x:0 0 0 2024-09-10T09:36:00.316 INFO:tasks.workunit.client.0.smithi079.stdout:4/141: truncate d1/da/d16/f22 966065 0 2024-09-10T09:36:00.316 INFO:tasks.workunit.client.0.smithi079.stdout:4/142: dread - d1/da/d16/f27 zero size 2024-09-10T09:36:00.316 INFO:tasks.workunit.client.0.smithi079.stdout:4/143: readlink d1/da/d16/l23 0 2024-09-10T09:36:00.317 INFO:tasks.workunit.client.0.smithi079.stdout:1/156: symlink d5/l31 0 2024-09-10T09:36:00.317 INFO:tasks.workunit.client.0.smithi079.stdout:1/157: creat d5/df/d11/f32 x:0 0 0 2024-09-10T09:36:00.317 INFO:tasks.workunit.client.0.smithi079.stdout:9/101: dread d3/f5 [0,4194304] 0 2024-09-10T09:36:00.319 INFO:tasks.workunit.client.0.smithi079.stdout:2/82: mknod d4/dd/c1d 0 2024-09-10T09:36:00.320 INFO:tasks.workunit.client.0.smithi079.stdout:1/158: dread d5/df/f1c [0,4194304] 0 2024-09-10T09:36:00.320 INFO:tasks.workunit.client.0.smithi079.stdout:1/159: write d5/df/d11/f2b [238086,96960] 0 2024-09-10T09:36:00.322 INFO:tasks.workunit.client.0.smithi079.stdout:6/161: mknod d4/d8/dc/c34 0 2024-09-10T09:36:00.323 INFO:tasks.workunit.client.0.smithi079.stdout:1/160: dread d5/df/f1c [0,4194304] 0 2024-09-10T09:36:00.323 INFO:tasks.workunit.client.0.smithi079.stdout:1/161: chown d5/df/d11/l1f 1 1 2024-09-10T09:36:00.327 INFO:tasks.workunit.client.0.smithi079.stdout:2/83: symlink d4/dc/d13/l1e 0 2024-09-10T09:36:00.327 INFO:tasks.workunit.client.0.smithi079.stdout:5/111: sync 2024-09-10T09:36:00.327 INFO:tasks.workunit.client.0.smithi079.stdout:3/163: sync 2024-09-10T09:36:00.328 INFO:tasks.workunit.client.0.smithi079.stdout:8/153: symlink d11/d2b/l33 0 2024-09-10T09:36:00.330 INFO:tasks.workunit.client.0.smithi079.stdout:6/162: mkdir d4/d35 0 2024-09-10T09:36:00.330 INFO:tasks.workunit.client.0.smithi079.stdout:6/163: fsync d4/d8/dd/f27 0 2024-09-10T09:36:00.332 INFO:tasks.workunit.client.0.smithi079.stdout:4/144: rename d1/f17 to d1/da/f2c 0 2024-09-10T09:36:00.332 INFO:tasks.workunit.client.0.smithi079.stdout:4/145: readlink d1/da/l20 0 2024-09-10T09:36:00.334 INFO:tasks.workunit.client.0.smithi079.stdout:5/112: rmdir d2/d3/d21 0 2024-09-10T09:36:00.334 INFO:tasks.workunit.client.0.smithi079.stdout:5/113: fsync d2/f15 0 2024-09-10T09:36:00.336 INFO:tasks.workunit.client.0.smithi079.stdout:6/164: symlink d4/d8/dc/d12/d29/l36 0 2024-09-10T09:36:00.338 INFO:tasks.workunit.client.0.smithi079.stdout:6/165: link d4/d8/dd/f1b d4/d8/dc/f37 0 2024-09-10T09:36:00.338 INFO:tasks.workunit.client.0.smithi079.stdout:6/166: readlink d4/d8/dc/d12/l18 0 2024-09-10T09:36:00.338 INFO:tasks.workunit.client.0.smithi079.stdout:6/167: creat d4/d8/dc/d1c/f38 x:0 0 0 2024-09-10T09:36:00.339 INFO:tasks.workunit.client.0.smithi079.stdout:2/84: write d4/fb [2198401,37938] 0 2024-09-10T09:36:00.341 INFO:tasks.workunit.client.0.smithi079.stdout:3/164: dread f2 [0,4194304] 0 2024-09-10T09:36:00.341 INFO:tasks.workunit.client.0.smithi079.stdout:8/154: write d11/f1d [571491,89412] 0 2024-09-10T09:36:00.342 INFO:tasks.workunit.client.0.smithi079.stdout:3/165: getdents d4/da/d18 0 2024-09-10T09:36:00.345 INFO:tasks.workunit.client.0.smithi079.stdout:9/102: dwrite d3/f11 [4194304,4194304] 0 2024-09-10T09:36:00.345 INFO:tasks.workunit.client.0.smithi079.stdout:8/155: symlink d11/l34 0 2024-09-10T09:36:00.345 INFO:tasks.workunit.client.0.smithi079.stdout:9/103: write d3/d7/dc/de/d17/f1d [819609,25800] 0 2024-09-10T09:36:00.345 INFO:tasks.workunit.client.0.smithi079.stdout:3/166: rmdir d4 39 2024-09-10T09:36:00.346 INFO:tasks.workunit.client.0.smithi079.stdout:3/167: read d4/f13 [121092,44120] 0 2024-09-10T09:36:00.346 INFO:tasks.workunit.client.0.smithi079.stdout:5/114: dread d2/d3/fe [0,4194304] 0 2024-09-10T09:36:00.347 INFO:tasks.workunit.client.0.smithi079.stdout:9/104: link d3/l9 d3/d7/l20 0 2024-09-10T09:36:00.348 INFO:tasks.workunit.client.0.smithi079.stdout:8/156: dread d11/f32 [0,4194304] 0 2024-09-10T09:36:00.349 INFO:tasks.workunit.client.0.smithi079.stdout:1/162: dwrite d5/df/d11/f2d [0,4194304] 0 2024-09-10T09:36:00.351 INFO:tasks.workunit.client.0.smithi079.stdout:8/157: symlink d11/d2b/l35 0 2024-09-10T09:36:00.351 INFO:tasks.workunit.client.0.smithi079.stdout:1/163: symlink d5/df/d2e/l33 0 2024-09-10T09:36:00.351 INFO:tasks.workunit.client.0.smithi079.stdout:1/164: dread - d5/df/d11/f32 zero size 2024-09-10T09:36:00.355 INFO:tasks.workunit.client.0.smithi079.stdout:1/165: creat d5/df/f34 x:0 0 0 2024-09-10T09:36:00.357 INFO:tasks.workunit.client.0.smithi079.stdout:9/105: dread d3/f14 [0,4194304] 0 2024-09-10T09:36:00.358 INFO:tasks.workunit.client.0.smithi079.stdout:8/158: unlink d11/c27 0 2024-09-10T09:36:00.367 INFO:tasks.workunit.client.0.smithi079.stdout:1/166: mknod d5/d24/c35 0 2024-09-10T09:36:00.367 INFO:tasks.workunit.client.0.smithi079.stdout:1/167: write d5/df/d11/f16 [447902,54042] 0 2024-09-10T09:36:00.369 INFO:tasks.workunit.client.0.smithi079.stdout:9/106: rename d3/f5 to d3/d7/dc/de/d17/f21 0 2024-09-10T09:36:00.369 INFO:tasks.workunit.client.0.smithi079.stdout:9/107: readlink d3/d7/l20 0 2024-09-10T09:36:00.371 INFO:tasks.workunit.client.0.smithi079.stdout:1/168: mkdir d5/d24/d36 0 2024-09-10T09:36:00.371 INFO:tasks.workunit.client.0.smithi079.stdout:1/169: chown d5/df/d11/l1e 37851 1 2024-09-10T09:36:00.371 INFO:tasks.workunit.client.0.smithi079.stdout:1/170: chown d5/df/f1c 0 1 2024-09-10T09:36:00.372 INFO:tasks.workunit.client.0.smithi079.stdout:8/159: symlink d11/l36 0 2024-09-10T09:36:00.372 INFO:tasks.workunit.client.0.smithi079.stdout:1/171: symlink d5/df/l37 0 2024-09-10T09:36:00.375 INFO:tasks.workunit.client.0.smithi079.stdout:1/172: rename d5/cc to d5/df/c38 0 2024-09-10T09:36:00.377 INFO:tasks.workunit.client.0.smithi079.stdout:1/173: write d5/f20 [649632,123681] 0 2024-09-10T09:36:00.378 INFO:tasks.workunit.client.0.smithi079.stdout:1/174: readlink d5/l29 0 2024-09-10T09:36:00.378 INFO:tasks.workunit.client.0.smithi079.stdout:8/160: symlink d11/l37 0 2024-09-10T09:36:00.379 INFO:tasks.workunit.client.0.smithi079.stdout:8/161: truncate d11/f1a 1685029 0 2024-09-10T09:36:00.382 INFO:tasks.workunit.client.0.smithi079.stdout:8/162: symlink d11/d2b/l38 0 2024-09-10T09:36:00.382 INFO:tasks.workunit.client.0.smithi079.stdout:8/163: fdatasync f8 0 2024-09-10T09:36:00.382 INFO:tasks.workunit.client.0.smithi079.stdout:6/168: dwrite d4/d8/dc/d1c/f2a [0,4194304] 0 2024-09-10T09:36:00.383 INFO:tasks.workunit.client.0.smithi079.stdout:2/85: dwrite d4/fb [0,4194304] 0 2024-09-10T09:36:00.383 INFO:tasks.workunit.client.0.smithi079.stdout:3/168: dwrite d4/f13 [0,4194304] 0 2024-09-10T09:36:00.383 INFO:tasks.workunit.client.0.smithi079.stdout:5/115: dwrite d2/d3/fa [0,4194304] 0 2024-09-10T09:36:00.383 INFO:tasks.workunit.client.0.smithi079.stdout:4/146: dwrite d1/da/d16/f1f [0,4194304] 0 2024-09-10T09:36:00.385 INFO:tasks.workunit.client.0.smithi079.stdout:6/169: mkdir d4/d35/d39 0 2024-09-10T09:36:00.385 INFO:tasks.workunit.client.0.smithi079.stdout:6/170: creat d4/d8/dc/d12/d1f/f3a x:0 0 0 2024-09-10T09:36:00.385 INFO:tasks.workunit.client.0.smithi079.stdout:6/171: creat d4/d8/f3b x:0 0 0 2024-09-10T09:36:00.385 INFO:tasks.workunit.client.0.smithi079.stdout:6/172: write d4/d8/dc/d1c/f21 [1038826,127517] 0 2024-09-10T09:36:00.388 INFO:tasks.workunit.client.0.smithi079.stdout:3/169: creat d4/da/d17/d2d/f2f x:0 0 0 2024-09-10T09:36:00.389 INFO:tasks.workunit.client.0.smithi079.stdout:5/116: mknod d2/c23 0 2024-09-10T09:36:00.390 INFO:tasks.workunit.client.0.smithi079.stdout:5/117: creat d2/f24 x:0 0 0 2024-09-10T09:36:00.399 INFO:tasks.workunit.client.0.smithi079.stdout:2/86: dread d4/dc/f14 [0,4194304] 0 2024-09-10T09:36:00.399 INFO:tasks.workunit.client.0.smithi079.stdout:9/108: dwrite d3/f16 [0,4194304] 0 2024-09-10T09:36:00.399 INFO:tasks.workunit.client.0.smithi079.stdout:9/109: chown d3/d7/dc/de/l1e 237255 1 2024-09-10T09:36:00.400 INFO:tasks.workunit.client.0.smithi079.stdout:8/164: dread d11/f22 [0,4194304] 0 2024-09-10T09:36:00.400 INFO:tasks.workunit.client.0.smithi079.stdout:8/165: creat d11/d2b/f39 x:0 0 0 2024-09-10T09:36:00.401 INFO:tasks.workunit.client.0.smithi079.stdout:1/175: dwrite d5/df/d11/f2b [0,4194304] 0 2024-09-10T09:36:00.402 INFO:tasks.workunit.client.0.smithi079.stdout:9/110: write d3/f14 [3206635,114085] 0 2024-09-10T09:36:00.402 INFO:tasks.workunit.client.0.smithi079.stdout:1/176: fdatasync d5/f14 0 2024-09-10T09:36:00.402 INFO:tasks.workunit.client.0.smithi079.stdout:9/111: write d3/d7/dc/de/d17/f1f [642867,113874] 0 2024-09-10T09:36:00.407 INFO:tasks.workunit.client.0.smithi079.stdout:4/147: rename d1/fc to d1/da/d16/d21/f2d 0 2024-09-10T09:36:00.409 INFO:tasks.workunit.client.0.smithi079.stdout:1/177: dread d5/df/d11/f2d [0,4194304] 0 2024-09-10T09:36:00.409 INFO:tasks.workunit.client.0.smithi079.stdout:1/178: dread - d5/df/f34 zero size 2024-09-10T09:36:00.409 INFO:tasks.workunit.client.0.smithi079.stdout:1/179: stat d5/df/d11/l1e 0 2024-09-10T09:36:00.409 INFO:tasks.workunit.client.0.smithi079.stdout:1/180: readlink d5/df/l10 0 2024-09-10T09:36:00.409 INFO:tasks.workunit.client.0.smithi079.stdout:1/181: truncate d5/df/d11/f32 834250 0 2024-09-10T09:36:00.410 INFO:tasks.workunit.client.0.smithi079.stdout:6/173: mkdir d4/d8/dc/d3c 0 2024-09-10T09:36:00.410 INFO:tasks.workunit.client.0.smithi079.stdout:6/174: getdents d4/d8/dc/d3c 0 2024-09-10T09:36:00.411 INFO:tasks.workunit.client.0.smithi079.stdout:3/170: creat d4/da/d17/f30 x:0 0 0 2024-09-10T09:36:00.411 INFO:tasks.workunit.client.0.smithi079.stdout:3/171: chown f2 13357 1 2024-09-10T09:36:00.414 INFO:tasks.workunit.client.0.smithi079.stdout:5/118: symlink d2/d3/l25 0 2024-09-10T09:36:00.416 INFO:tasks.workunit.client.0.smithi079.stdout:2/87: creat d4/dc/d13/f1f x:0 0 0 2024-09-10T09:36:00.416 INFO:tasks.workunit.client.0.smithi079.stdout:2/88: stat l2 0 2024-09-10T09:36:00.419 INFO:tasks.workunit.client.0.smithi079.stdout:9/112: mkdir d3/d7/dc/de/d17/d12/d22 0 2024-09-10T09:36:00.421 INFO:tasks.workunit.client.0.smithi079.stdout:1/182: link d5/f20 d5/df/d2e/f39 0 2024-09-10T09:36:00.421 INFO:tasks.workunit.client.0.smithi079.stdout:1/183: truncate d5/df/f34 234521 0 2024-09-10T09:36:00.421 INFO:tasks.workunit.client.0.smithi079.stdout:1/184: read d5/df/d2e/f39 [592653,55872] 0 2024-09-10T09:36:00.422 INFO:tasks.workunit.client.0.smithi079.stdout:6/175: mknod d4/d8/dc/d12/d29/c3d 0 2024-09-10T09:36:00.422 INFO:tasks.workunit.client.0.smithi079.stdout:8/166: dread d11/f19 [0,4194304] 0 2024-09-10T09:36:00.424 INFO:tasks.workunit.client.0.smithi079.stdout:5/119: rename d2/d3/ff to d2/f26 0 2024-09-10T09:36:00.426 INFO:tasks.workunit.client.0.smithi079.stdout:2/89: dread d4/dd/ff [0,4194304] 0 2024-09-10T09:36:00.427 INFO:tasks.workunit.client.0.smithi079.stdout:2/90: fdatasync d4/f18 0 2024-09-10T09:36:00.430 INFO:tasks.workunit.client.0.smithi079.stdout:4/148: getdents d1/da/d16 0 2024-09-10T09:36:00.430 INFO:tasks.workunit.client.0.smithi079.stdout:4/149: creat d1/f2e x:0 0 0 2024-09-10T09:36:00.430 INFO:tasks.workunit.client.0.smithi079.stdout:4/150: fdatasync d1/da/f2c 0 2024-09-10T09:36:00.433 INFO:tasks.workunit.client.0.smithi079.stdout:1/185: mkdir d5/d24/d36/d3a 0 2024-09-10T09:36:00.434 INFO:tasks.workunit.client.0.smithi079.stdout:1/186: chown d5/df/c38 47186940 1 2024-09-10T09:36:00.434 INFO:tasks.workunit.client.0.smithi079.stdout:0/165: sync 2024-09-10T09:36:00.434 INFO:tasks.workunit.client.0.smithi079.stdout:7/124: sync 2024-09-10T09:36:00.434 INFO:tasks.workunit.client.0.smithi079.stdout:0/166: truncate d4/d12/d21/f2c 669877 0 2024-09-10T09:36:00.434 INFO:tasks.workunit.client.0.smithi079.stdout:0/167: fdatasync d4/f11 0 2024-09-10T09:36:00.434 INFO:tasks.workunit.client.0.smithi079.stdout:5/120: mkdir d2/d3/d27 0 2024-09-10T09:36:00.443 INFO:tasks.workunit.client.0.smithi079.stdout:9/113: rmdir d3/d7 39 2024-09-10T09:36:00.445 INFO:tasks.workunit.client.0.smithi079.stdout:4/151: rmdir d1/da/d16 39 2024-09-10T09:36:00.445 INFO:tasks.workunit.client.0.smithi079.stdout:4/152: chown d1/f7 47978320 1 2024-09-10T09:36:00.445 INFO:tasks.workunit.client.0.smithi079.stdout:4/153: truncate d1/fe 9670067 0 2024-09-10T09:36:00.450 INFO:tasks.workunit.client.0.smithi079.stdout:9/114: write d3/d7/dc/de/d17/f21 [3530970,122090] 0 2024-09-10T09:36:00.451 INFO:tasks.workunit.client.0.smithi079.stdout:0/168: rename d4/d1d/l1f to d4/d12/d1a/d29/l38 0 2024-09-10T09:36:00.452 INFO:tasks.workunit.client.0.smithi079.stdout:0/169: write d4/f5 [1094776,43324] 0 2024-09-10T09:36:00.452 INFO:tasks.workunit.client.0.smithi079.stdout:0/170: write d4/f11 [4934249,20234] 0 2024-09-10T09:36:00.453 INFO:tasks.workunit.client.0.smithi079.stdout:4/154: dread d1/fe [4194304,4194304] 0 2024-09-10T09:36:00.454 INFO:tasks.workunit.client.0.smithi079.stdout:0/171: dread f0 [0,4194304] 0 2024-09-10T09:36:00.454 INFO:tasks.workunit.client.0.smithi079.stdout:5/121: link d2/f26 d2/d3/f28 0 2024-09-10T09:36:00.455 INFO:tasks.workunit.client.0.smithi079.stdout:5/122: dread - d2/f15 zero size 2024-09-10T09:36:00.455 INFO:tasks.workunit.client.0.smithi079.stdout:5/123: dread - d2/f22 zero size 2024-09-10T09:36:00.455 INFO:tasks.workunit.client.0.smithi079.stdout:2/91: symlink d4/dd/d1b/l20 0 2024-09-10T09:36:00.456 INFO:tasks.workunit.client.0.smithi079.stdout:7/125: rmdir d4/d6 39 2024-09-10T09:36:00.458 INFO:tasks.workunit.client.0.smithi079.stdout:9/115: creat d3/d7/dc/de/d17/d12/d22/f23 x:0 0 0 2024-09-10T09:36:00.458 INFO:tasks.workunit.client.0.smithi079.stdout:6/176: dwrite d4/d8/dc/d1c/f32 [0,4194304] 0 2024-09-10T09:36:00.460 INFO:tasks.workunit.client.0.smithi079.stdout:4/155: symlink d1/l2f 0 2024-09-10T09:36:00.463 INFO:tasks.workunit.client.0.smithi079.stdout:0/172: mkdir d4/d12/d39 0 2024-09-10T09:36:00.463 INFO:tasks.workunit.client.0.smithi079.stdout:7/126: dread d4/df/f18 [0,4194304] 0 2024-09-10T09:36:00.463 INFO:tasks.workunit.client.0.smithi079.stdout:1/187: dwrite d5/df/d11/f32 [0,4194304] 0 2024-09-10T09:36:00.463 INFO:tasks.workunit.client.0.smithi079.stdout:8/167: dwrite d11/f28 [0,4194304] 0 2024-09-10T09:36:00.463 INFO:tasks.workunit.client.0.smithi079.stdout:8/168: write d11/f1d [1391693,44360] 0 2024-09-10T09:36:00.464 INFO:tasks.workunit.client.0.smithi079.stdout:5/124: symlink d2/d3/l29 0 2024-09-10T09:36:00.464 INFO:tasks.workunit.client.0.smithi079.stdout:2/92: truncate d4/f18 4023751 0 2024-09-10T09:36:00.464 INFO:tasks.workunit.client.0.smithi079.stdout:2/93: dread - d4/dc/d13/f1f zero size 2024-09-10T09:36:00.464 INFO:tasks.workunit.client.0.smithi079.stdout:2/94: stat d4/dc/d13/f15 0 2024-09-10T09:36:00.467 INFO:tasks.workunit.client.0.smithi079.stdout:6/177: symlink d4/d8/dd/l3e 0 2024-09-10T09:36:00.467 INFO:tasks.workunit.client.0.smithi079.stdout:6/178: creat d4/d8/dc/d1c/f3f x:0 0 0 2024-09-10T09:36:00.467 INFO:tasks.workunit.client.0.smithi079.stdout:6/179: getdents d4/d8/dc/d3c 0 2024-09-10T09:36:00.467 INFO:tasks.workunit.client.0.smithi079.stdout:6/180: creat d4/f40 x:0 0 0 2024-09-10T09:36:00.467 INFO:tasks.workunit.client.0.smithi079.stdout:6/181: fdatasync d4/d8/dc/d12/f30 0 2024-09-10T09:36:00.467 INFO:tasks.workunit.client.0.smithi079.stdout:6/182: write d4/d8/dd/f2e [1311979,106604] 0 2024-09-10T09:36:00.468 INFO:tasks.workunit.client.0.smithi079.stdout:0/173: creat d4/d1d/f3a x:0 0 0 2024-09-10T09:36:00.468 INFO:tasks.workunit.client.0.smithi079.stdout:0/174: write d4/d12/f13 [5207923,75814] 0 2024-09-10T09:36:00.468 INFO:tasks.workunit.client.0.smithi079.stdout:4/156: dread d1/da/d16/d21/f2d [0,4194304] 0 2024-09-10T09:36:00.468 INFO:tasks.workunit.client.0.smithi079.stdout:2/95: read d4/f6 [600213,17288] 0 2024-09-10T09:36:00.468 INFO:tasks.workunit.client.0.smithi079.stdout:7/127: mknod d4/df/c1b 0 2024-09-10T09:36:00.468 INFO:tasks.workunit.client.0.smithi079.stdout:6/183: dread d4/d8/dc/f37 [0,4194304] 0 2024-09-10T09:36:00.471 INFO:tasks.workunit.client.0.smithi079.stdout:8/169: chown d11/f16 19 1 2024-09-10T09:36:00.471 INFO:tasks.workunit.client.0.smithi079.stdout:5/125: mknod d2/d3/c2a 0 2024-09-10T09:36:00.472 INFO:tasks.workunit.client.0.smithi079.stdout:5/126: chown d2/c23 791288427 1 2024-09-10T09:36:00.475 INFO:tasks.workunit.client.0.smithi079.stdout:9/116: dwrite d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:00.477 INFO:tasks.workunit.client.0.smithi079.stdout:0/175: unlink d4/c9 0 2024-09-10T09:36:00.477 INFO:tasks.workunit.client.0.smithi079.stdout:0/176: fdatasync d4/d12/d15/f28 0 2024-09-10T09:36:00.478 INFO:tasks.workunit.client.0.smithi079.stdout:0/177: dread d4/d12/d21/f2c [0,4194304] 0 2024-09-10T09:36:00.480 INFO:tasks.workunit.client.0.smithi079.stdout:4/157: creat d1/da/d16/f30 x:0 0 0 2024-09-10T09:36:00.480 INFO:tasks.workunit.client.0.smithi079.stdout:2/96: chown d4/dd/c17 57 1 2024-09-10T09:36:00.480 INFO:tasks.workunit.client.0.smithi079.stdout:4/158: chown d1 7413733 1 2024-09-10T09:36:00.482 INFO:tasks.workunit.client.0.smithi079.stdout:7/128: creat d4/f1c x:0 0 0 2024-09-10T09:36:00.482 INFO:tasks.workunit.client.0.smithi079.stdout:7/129: fdatasync d4/df/f18 0 2024-09-10T09:36:00.482 INFO:tasks.workunit.client.0.smithi079.stdout:7/130: truncate d4/d6/f16 262884 0 2024-09-10T09:36:00.485 INFO:tasks.workunit.client.0.smithi079.stdout:6/184: mkdir d4/d8/dd/d41 0 2024-09-10T09:36:00.485 INFO:tasks.workunit.client.0.smithi079.stdout:6/185: truncate d4/d8/dc/fe 4753786 0 2024-09-10T09:36:00.485 INFO:tasks.workunit.client.0.smithi079.stdout:6/186: write d4/d8/dd/f27 [23299,7546] 0 2024-09-10T09:36:00.489 INFO:tasks.workunit.client.0.smithi079.stdout:5/127: link d2/c19 d2/d3/c2b 0 2024-09-10T09:36:00.489 INFO:tasks.workunit.client.0.smithi079.stdout:5/128: chown d2/f1b 339587 1 2024-09-10T09:36:00.490 INFO:tasks.workunit.client.0.smithi079.stdout:0/178: write d4/d12/d1a/f19 [3999975,95087] 0 2024-09-10T09:36:00.490 INFO:tasks.workunit.client.0.smithi079.stdout:0/179: fsync d4/d12/d15/f28 0 2024-09-10T09:36:00.491 INFO:tasks.workunit.client.0.smithi079.stdout:0/180: fdatasync d4/d12/f14 0 2024-09-10T09:36:00.491 INFO:tasks.workunit.client.0.smithi079.stdout:0/181: readlink d4/d12/d16/l27 0 2024-09-10T09:36:00.495 INFO:tasks.workunit.client.0.smithi079.stdout:7/131: link d4/d6/fa d4/df/f1d 0 2024-09-10T09:36:00.495 INFO:tasks.workunit.client.0.smithi079.stdout:7/132: write d4/df/f18 [294536,47860] 0 2024-09-10T09:36:00.496 INFO:tasks.workunit.client.0.smithi079.stdout:6/187: symlink d4/d8/dc/d1c/l42 0 2024-09-10T09:36:00.496 INFO:tasks.workunit.client.0.smithi079.stdout:4/159: dwrite d1/f2a [0,4194304] 0 2024-09-10T09:36:00.500 INFO:tasks.workunit.client.0.smithi079.stdout:8/170: rmdir d11 39 2024-09-10T09:36:00.500 INFO:tasks.workunit.client.0.smithi079.stdout:7/133: write d4/d6/f11 [3123867,72976] 0 2024-09-10T09:36:00.501 INFO:tasks.workunit.client.0.smithi079.stdout:7/134: chown d4/df 23 1 2024-09-10T09:36:00.501 INFO:tasks.workunit.client.0.smithi079.stdout:5/129: creat d2/d3/d27/f2c x:0 0 0 2024-09-10T09:36:00.504 INFO:tasks.workunit.client.0.smithi079.stdout:9/117: dwrite d3/d7/dc/de/d17/d12/d22/f23 [0,4194304] 0 2024-09-10T09:36:00.504 INFO:tasks.workunit.client.0.smithi079.stdout:0/182: symlink d4/d12/l3b 0 2024-09-10T09:36:00.505 INFO:tasks.workunit.client.0.smithi079.stdout:2/97: getdents d4/dc 0 2024-09-10T09:36:00.511 INFO:tasks.workunit.client.0.smithi079.stdout:4/160: link d1/l5 d1/da/d16/d21/l31 0 2024-09-10T09:36:00.514 INFO:tasks.workunit.client.0.smithi079.stdout:7/135: symlink d4/df/d19/l1e 0 2024-09-10T09:36:00.518 INFO:tasks.workunit.client.0.smithi079.stdout:9/118: link d3/d7/dc/de/l15 d3/d7/dc/de/l24 0 2024-09-10T09:36:00.519 INFO:tasks.workunit.client.0.smithi079.stdout:0/183: rename d4/d12/l18 to d4/d12/d15/l3c 0 2024-09-10T09:36:00.520 INFO:tasks.workunit.client.0.smithi079.stdout:2/98: rmdir d4/dc/d13 39 2024-09-10T09:36:00.523 INFO:tasks.workunit.client.0.smithi079.stdout:7/136: symlink d4/dc/l1f 0 2024-09-10T09:36:00.524 INFO:tasks.workunit.client.0.smithi079.stdout:9/119: mkdir d3/d7/dc/de/d17/d12/d25 0 2024-09-10T09:36:00.526 INFO:tasks.workunit.client.0.smithi079.stdout:7/137: mknod d4/df/c20 0 2024-09-10T09:36:00.531 INFO:tasks.workunit.client.0.smithi079.stdout:2/99: dread d4/dc/f14 [0,4194304] 0 2024-09-10T09:36:00.533 INFO:tasks.workunit.client.0.smithi079.stdout:2/100: mkdir d4/dd/d21 0 2024-09-10T09:36:00.535 INFO:tasks.workunit.client.0.smithi079.stdout:8/171: dwrite d11/f28 [0,4194304] 0 2024-09-10T09:36:00.535 INFO:tasks.workunit.client.0.smithi079.stdout:8/172: readlink d11/l34 0 2024-09-10T09:36:00.537 INFO:tasks.workunit.client.0.smithi079.stdout:2/101: dread d4/f5 [0,4194304] 0 2024-09-10T09:36:00.537 INFO:tasks.workunit.client.0.smithi079.stdout:8/173: rename d11/l1b to d11/l3a 0 2024-09-10T09:36:00.537 INFO:tasks.workunit.client.0.smithi079.stdout:2/102: read d4/dd/ff [262847,58378] 0 2024-09-10T09:36:00.538 INFO:tasks.workunit.client.0.smithi079.stdout:8/174: unlink d11/f23 0 2024-09-10T09:36:00.539 INFO:tasks.workunit.client.0.smithi079.stdout:2/103: dread - d4/dc/d13/f1f zero size 2024-09-10T09:36:00.540 INFO:tasks.workunit.client.0.smithi079.stdout:8/175: stat d11/l2f 0 2024-09-10T09:36:00.541 INFO:tasks.workunit.client.0.smithi079.stdout:2/104: unlink d4/dd/d1b/l20 0 2024-09-10T09:36:00.543 INFO:tasks.workunit.client.0.smithi079.stdout:2/105: creat d4/dc/f22 x:0 0 0 2024-09-10T09:36:00.544 INFO:tasks.workunit.client.0.smithi079.stdout:8/176: mkdir d11/d3b 0 2024-09-10T09:36:00.544 INFO:tasks.workunit.client.0.smithi079.stdout:2/106: creat d4/f23 x:0 0 0 2024-09-10T09:36:00.546 INFO:tasks.workunit.client.0.smithi079.stdout:5/130: dwrite d2/f1d [0,4194304] 0 2024-09-10T09:36:00.546 INFO:tasks.workunit.client.0.smithi079.stdout:5/131: truncate d2/f24 464608 0 2024-09-10T09:36:00.546 INFO:tasks.workunit.client.0.smithi079.stdout:6/188: dwrite d4/d8/dc/f37 [0,4194304] 0 2024-09-10T09:36:00.546 INFO:tasks.workunit.client.0.smithi079.stdout:0/184: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:36:00.546 INFO:tasks.workunit.client.0.smithi079.stdout:4/161: dwrite d1/f9 [0,4194304] 0 2024-09-10T09:36:00.550 INFO:tasks.workunit.client.0.smithi079.stdout:2/107: write d4/dc/f14 [2586232,13276] 0 2024-09-10T09:36:00.556 INFO:tasks.workunit.client.0.smithi079.stdout:4/162: dread d1/f11 [0,4194304] 0 2024-09-10T09:36:00.558 INFO:tasks.workunit.client.0.smithi079.stdout:0/185: creat d4/d12/d21/f3d x:0 0 0 2024-09-10T09:36:00.560 INFO:tasks.workunit.client.0.smithi079.stdout:9/120: getdents d3/d7/dc/de/d17/d12 0 2024-09-10T09:36:00.560 INFO:tasks.workunit.client.0.smithi079.stdout:9/121: fdatasync d3/d7/dc/de/d17/f21 0 2024-09-10T09:36:00.568 INFO:tasks.workunit.client.0.smithi079.stdout:2/108: symlink d4/dd/d21/l24 0 2024-09-10T09:36:00.570 INFO:tasks.workunit.client.0.smithi079.stdout:5/132: rmdir d2/d3/d27 39 2024-09-10T09:36:00.570 INFO:tasks.workunit.client.0.smithi079.stdout:6/189: dwrite d4/d8/dc/d1c/f21 [0,4194304] 0 2024-09-10T09:36:00.571 INFO:tasks.workunit.client.0.smithi079.stdout:6/190: stat d4/d8/dc/d12/d1f 0 2024-09-10T09:36:00.571 INFO:tasks.workunit.client.0.smithi079.stdout:6/191: chown d4/d35 325 1 2024-09-10T09:36:00.572 INFO:tasks.workunit.client.0.smithi079.stdout:0/186: symlink d4/d12/d15/d2b/l3e 0 2024-09-10T09:36:00.574 INFO:tasks.workunit.client.0.smithi079.stdout:4/163: read d1/da/d16/f1f [3703080,49500] 0 2024-09-10T09:36:00.576 INFO:tasks.workunit.client.0.smithi079.stdout:6/192: mknod d4/d8/dc/d12/d29/c43 0 2024-09-10T09:36:00.576 INFO:tasks.workunit.client.0.smithi079.stdout:9/122: dread d3/f11 [4194304,4194304] 0 2024-09-10T09:36:00.577 INFO:tasks.workunit.client.0.smithi079.stdout:0/187: mkdir d4/d12/d21/d3f 0 2024-09-10T09:36:00.578 INFO:tasks.workunit.client.0.smithi079.stdout:2/109: mknod d4/dd/c25 0 2024-09-10T09:36:00.579 INFO:tasks.workunit.client.0.smithi079.stdout:4/164: stat d1/da/d16/d21/l31 0 2024-09-10T09:36:00.586 INFO:tasks.workunit.client.0.smithi079.stdout:4/165: mkdir d1/da/d16/d21/d32 0 2024-09-10T09:36:00.594 INFO:tasks.workunit.client.0.smithi079.stdout:2/110: mknod d4/c26 0 2024-09-10T09:36:00.595 INFO:tasks.workunit.client.0.smithi079.stdout:2/111: creat d4/dc/d13/f27 x:0 0 0 2024-09-10T09:36:00.599 INFO:tasks.workunit.client.0.smithi079.stdout:2/112: creat d4/dc/d1c/f28 x:0 0 0 2024-09-10T09:36:00.603 INFO:tasks.workunit.client.0.smithi079.stdout:6/193: rmdir d4 39 2024-09-10T09:36:00.603 INFO:tasks.workunit.client.0.smithi079.stdout:6/194: dread d4/d8/dc/d1c/f15 [0,4194304] 0 2024-09-10T09:36:00.603 INFO:tasks.workunit.client.0.smithi079.stdout:6/195: write d4/d8/dc/d12/d1f/f33 [832551,26279] 0 2024-09-10T09:36:00.603 INFO:tasks.workunit.client.0.smithi079.stdout:6/196: chown d4/d8/dc/d1c/f3f 286172 1 2024-09-10T09:36:00.606 INFO:tasks.workunit.client.0.smithi079.stdout:2/113: rename d4/dd to d4/dc/d29 0 2024-09-10T09:36:00.607 INFO:tasks.workunit.client.0.smithi079.stdout:5/133: dwrite d2/f1b [0,4194304] 0 2024-09-10T09:36:00.610 INFO:tasks.workunit.client.0.smithi079.stdout:5/134: mknod d2/c2d 0 2024-09-10T09:36:00.611 INFO:tasks.workunit.client.0.smithi079.stdout:5/135: dread - d2/d3/f1a zero size 2024-09-10T09:36:00.611 INFO:tasks.workunit.client.0.smithi079.stdout:5/136: mknod d2/d3/d27/c2e 0 2024-09-10T09:36:00.613 INFO:tasks.workunit.client.0.smithi079.stdout:5/137: rename d2/d3/d27/c2e to d2/d3/c2f 0 2024-09-10T09:36:00.613 INFO:tasks.workunit.client.0.smithi079.stdout:5/138: fsync d2/d3/fa 0 2024-09-10T09:36:00.613 INFO:tasks.workunit.client.0.smithi079.stdout:6/197: write d4/d8/dc/d1c/f1a [3926260,113969] 0 2024-09-10T09:36:00.613 INFO:tasks.workunit.client.0.smithi079.stdout:6/198: chown d4/c7 22282 1 2024-09-10T09:36:00.615 INFO:tasks.workunit.client.0.smithi079.stdout:6/199: creat d4/d8/dc/d12/d29/f44 x:0 0 0 2024-09-10T09:36:00.615 INFO:tasks.workunit.client.0.smithi079.stdout:6/200: truncate d4/d8/dc/d12/d29/f2c 415643 0 2024-09-10T09:36:00.615 INFO:tasks.workunit.client.0.smithi079.stdout:6/201: read - d4/d8/dc/d1c/f3f zero size 2024-09-10T09:36:00.618 INFO:tasks.workunit.client.0.smithi079.stdout:0/188: dwrite d4/d12/d21/f3d [0,4194304] 0 2024-09-10T09:36:00.622 INFO:tasks.workunit.client.0.smithi079.stdout:0/189: creat d4/d12/f40 x:0 0 0 2024-09-10T09:36:00.624 INFO:tasks.workunit.client.0.smithi079.stdout:9/123: dwrite d3/f1c [0,4194304] 0 2024-09-10T09:36:00.631 INFO:tasks.workunit.client.0.smithi079.stdout:3/172: sync 2024-09-10T09:36:00.632 INFO:tasks.workunit.client.0.smithi079.stdout:4/166: dwrite d1/da/d16/f1f [0,4194304] 0 2024-09-10T09:36:00.641 INFO:tasks.workunit.client.0.smithi079.stdout:3/173: write d4/da/d17/f1a [2742721,41003] 0 2024-09-10T09:36:00.642 INFO:tasks.workunit.client.0.smithi079.stdout:3/174: readlink d4/da/l1d 0 2024-09-10T09:36:00.642 INFO:tasks.workunit.client.0.smithi079.stdout:3/175: creat d4/da/d17/d2d/f31 x:0 0 0 2024-09-10T09:36:00.642 INFO:tasks.workunit.client.0.smithi079.stdout:3/176: write d4/f2c [904350,107174] 0 2024-09-10T09:36:00.648 INFO:tasks.workunit.client.0.smithi079.stdout:2/114: dwrite d4/dc/d29/f16 [0,4194304] 0 2024-09-10T09:36:00.648 INFO:tasks.workunit.client.0.smithi079.stdout:2/115: write d4/f5 [5765028,62562] 0 2024-09-10T09:36:00.648 INFO:tasks.workunit.client.0.smithi079.stdout:2/116: truncate d4/f5 6316504 0 2024-09-10T09:36:00.648 INFO:tasks.workunit.client.0.smithi079.stdout:2/117: readlink l1 0 2024-09-10T09:36:00.651 INFO:tasks.workunit.client.0.smithi079.stdout:3/177: write d4/f29 [90929,95608] 0 2024-09-10T09:36:00.658 INFO:tasks.workunit.client.0.smithi079.stdout:3/178: write d4/da/d18/f1f [982044,107126] 0 2024-09-10T09:36:00.659 INFO:tasks.workunit.client.0.smithi079.stdout:3/179: creat d4/da/d17/f32 x:0 0 0 2024-09-10T09:36:00.661 INFO:tasks.workunit.client.0.smithi079.stdout:5/139: dwrite d2/d3/f1a [0,4194304] 0 2024-09-10T09:36:00.661 INFO:tasks.workunit.client.0.smithi079.stdout:5/140: write d2/f15 [476797,104305] 0 2024-09-10T09:36:00.662 INFO:tasks.workunit.client.0.smithi079.stdout:3/180: unlink d4/f2c 0 2024-09-10T09:36:00.662 INFO:tasks.workunit.client.0.smithi079.stdout:3/181: chown d4/da/d18/f1c 2 1 2024-09-10T09:36:00.662 INFO:tasks.workunit.client.0.smithi079.stdout:3/182: creat d4/da/d17/f33 x:0 0 0 2024-09-10T09:36:00.675 INFO:tasks.workunit.client.0.smithi079.stdout:6/202: dwrite d4/d8/dc/d12/f30 [0,4194304] 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:5/141: write d2/d3/fa [1809032,69873] 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:9/124: dwrite d3/d7/dc/de/d17/f1d [0,4194304] 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:9/125: chown d3/d7/dc/de/d17 51524223 1 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:9/126: read d3/f11 [3127283,130057] 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:4/167: dwrite d1/da/d16/f27 [0,4194304] 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:0/190: truncate d4/d12/d21/f3d 3730743 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:2/118: dwrite d4/dc/f14 [0,4194304] 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:2/119: write d4/f6 [2039283,68782] 0 2024-09-10T09:36:00.676 INFO:tasks.workunit.client.0.smithi079.stdout:2/120: readlink d4/dc/d29/d21/l24 0 2024-09-10T09:36:00.678 INFO:tasks.workunit.client.0.smithi079.stdout:6/203: creat d4/d8/dd/d41/f45 x:0 0 0 2024-09-10T09:36:00.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/183: dwrite d4/da/d17/f24 [0,4194304] 0 2024-09-10T09:36:00.692 INFO:tasks.workunit.client.0.smithi079.stdout:4/168: symlink d1/da/d16/l33 0 2024-09-10T09:36:00.692 INFO:tasks.workunit.client.0.smithi079.stdout:4/169: write d1/da/fb [756866,14790] 0 2024-09-10T09:36:00.692 INFO:tasks.workunit.client.0.smithi079.stdout:4/170: fdatasync d1/f9 0 2024-09-10T09:36:00.692 INFO:tasks.workunit.client.0.smithi079.stdout:0/191: symlink d4/d12/d16/l41 0 2024-09-10T09:36:00.693 INFO:tasks.workunit.client.0.smithi079.stdout:2/121: mknod d4/dc/d13/c2a 0 2024-09-10T09:36:00.694 INFO:tasks.workunit.client.0.smithi079.stdout:2/122: chown d4/dc/f14 2 1 2024-09-10T09:36:00.700 INFO:tasks.workunit.client.0.smithi079.stdout:6/204: dread d4/d8/dc/fe [0,4194304] 0 2024-09-10T09:36:00.703 INFO:tasks.workunit.client.0.smithi079.stdout:4/171: stat d1/da/l20 0 2024-09-10T09:36:00.705 INFO:tasks.workunit.client.0.smithi079.stdout:0/192: rename d4/d12/d16/c1c to d4/d12/d21/d3f/c42 0 2024-09-10T09:36:00.705 INFO:tasks.workunit.client.0.smithi079.stdout:0/193: creat d4/d12/d21/f43 x:0 0 0 2024-09-10T09:36:00.706 INFO:tasks.workunit.client.0.smithi079.stdout:2/123: creat d4/f2b x:0 0 0 2024-09-10T09:36:00.706 INFO:tasks.workunit.client.0.smithi079.stdout:2/124: fsync d4/dc/d13/f1f 0 2024-09-10T09:36:00.706 INFO:tasks.workunit.client.0.smithi079.stdout:2/125: truncate d4/dc/d13/f27 702006 0 2024-09-10T09:36:00.707 INFO:tasks.workunit.client.0.smithi079.stdout:4/172: mkdir d1/da/d16/d21/d34 0 2024-09-10T09:36:00.712 INFO:tasks.workunit.client.0.smithi079.stdout:0/194: rename d4/d12/f13 to d4/d12/d15/f44 0 2024-09-10T09:36:00.713 INFO:tasks.workunit.client.0.smithi079.stdout:1/188: sync 2024-09-10T09:36:00.713 INFO:tasks.workunit.client.0.smithi079.stdout:1/189: truncate d5/f15 362582 0 2024-09-10T09:36:00.713 INFO:tasks.workunit.client.0.smithi079.stdout:2/126: write d4/dc/d13/f15 [503363,37969] 0 2024-09-10T09:36:00.713 INFO:tasks.workunit.client.0.smithi079.stdout:2/127: readlink d4/dc/d13/l1e 0 2024-09-10T09:36:00.715 INFO:tasks.workunit.client.0.smithi079.stdout:4/173: rmdir d1/da/d16/d21/d34 0 2024-09-10T09:36:00.715 INFO:tasks.workunit.client.0.smithi079.stdout:4/174: stat d1/da/d16/f22 0 2024-09-10T09:36:00.715 INFO:tasks.workunit.client.0.smithi079.stdout:4/175: read d1/da/d16/f26 [7551625,128418] 0 2024-09-10T09:36:00.715 INFO:tasks.workunit.client.0.smithi079.stdout:1/190: link d5/l2c d5/df/l3b 0 2024-09-10T09:36:00.717 INFO:tasks.workunit.client.0.smithi079.stdout:4/176: symlink d1/da/d16/d21/l35 0 2024-09-10T09:36:00.717 INFO:tasks.workunit.client.0.smithi079.stdout:4/177: chown d1/fe 156739475 1 2024-09-10T09:36:00.717 INFO:tasks.workunit.client.0.smithi079.stdout:9/127: dwrite d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:00.718 INFO:tasks.workunit.client.0.smithi079.stdout:1/191: mkdir d5/d24/d36/d3a/d3c 0 2024-09-10T09:36:00.719 INFO:tasks.workunit.client.0.smithi079.stdout:2/128: mknod d4/dc/d29/c2c 0 2024-09-10T09:36:00.720 INFO:tasks.workunit.client.0.smithi079.stdout:9/128: rename d3/d7/dc/de/d17/d12/d25 to d3/d7/d26 0 2024-09-10T09:36:00.720 INFO:tasks.workunit.client.0.smithi079.stdout:9/129: chown d3/d7/dc/de 19 1 2024-09-10T09:36:00.721 INFO:tasks.workunit.client.0.smithi079.stdout:1/192: creat d5/d24/d36/d3a/f3d x:0 0 0 2024-09-10T09:36:00.722 INFO:tasks.workunit.client.0.smithi079.stdout:9/130: symlink d3/d7/d26/l27 0 2024-09-10T09:36:00.724 INFO:tasks.workunit.client.0.smithi079.stdout:9/131: creat d3/d7/dc/de/d17/f28 x:0 0 0 2024-09-10T09:36:00.730 INFO:tasks.workunit.client.0.smithi079.stdout:3/184: dwrite d4/f7 [0,4194304] 0 2024-09-10T09:36:00.730 INFO:tasks.workunit.client.0.smithi079.stdout:3/185: dread - d4/da/d17/f33 zero size 2024-09-10T09:36:00.730 INFO:tasks.workunit.client.0.smithi079.stdout:5/142: dwrite d2/d3/f16 [0,4194304] 0 2024-09-10T09:36:00.730 INFO:tasks.workunit.client.0.smithi079.stdout:6/205: dwrite d4/d8/f20 [0,4194304] 0 2024-09-10T09:36:00.733 INFO:tasks.workunit.client.0.smithi079.stdout:9/132: write d3/f11 [5121553,73256] 0 2024-09-10T09:36:00.733 INFO:tasks.workunit.client.0.smithi079.stdout:9/133: truncate d3/d7/dc/de/d17/f21 5126586 0 2024-09-10T09:36:00.734 INFO:tasks.workunit.client.0.smithi079.stdout:3/186: link d4/da/d17/f30 d4/da/d17/d2d/f34 0 2024-09-10T09:36:00.734 INFO:tasks.workunit.client.0.smithi079.stdout:3/187: truncate d4/da/d18/f1c 5228265 0 2024-09-10T09:36:00.739 INFO:tasks.workunit.client.0.smithi079.stdout:0/195: dwrite d4/d12/d1a/fb [4194304,4194304] 0 2024-09-10T09:36:00.744 INFO:tasks.workunit.client.0.smithi079.stdout:6/206: unlink d4/f17 0 2024-09-10T09:36:00.746 INFO:tasks.workunit.client.0.smithi079.stdout:3/188: creat d4/da/f35 x:0 0 0 2024-09-10T09:36:00.746 INFO:tasks.workunit.client.0.smithi079.stdout:3/189: dread - d4/da/f35 zero size 2024-09-10T09:36:00.747 INFO:tasks.workunit.client.0.smithi079.stdout:3/190: fdatasync d4/da/d17/f33 0 2024-09-10T09:36:00.747 INFO:tasks.workunit.client.0.smithi079.stdout:0/196: write d4/d12/d15/f44 [2855500,72762] 0 2024-09-10T09:36:00.747 INFO:tasks.workunit.client.0.smithi079.stdout:5/143: rmdir d2/d3 39 2024-09-10T09:36:00.749 INFO:tasks.workunit.client.0.smithi079.stdout:7/138: sync 2024-09-10T09:36:00.750 INFO:tasks.workunit.client.0.smithi079.stdout:6/207: rename d4/d8/dc/d12/d1f to d4/d35/d46 0 2024-09-10T09:36:00.751 INFO:tasks.workunit.client.0.smithi079.stdout:4/178: dwrite d1/da/d16/f22 [0,4194304] 0 2024-09-10T09:36:00.752 INFO:tasks.workunit.client.0.smithi079.stdout:3/191: symlink d4/da/d18/l36 0 2024-09-10T09:36:00.752 INFO:tasks.workunit.client.0.smithi079.stdout:1/193: dwrite d5/df/d11/f2d [0,4194304] 0 2024-09-10T09:36:00.753 INFO:tasks.workunit.client.0.smithi079.stdout:2/129: dwrite d4/dc/f22 [0,4194304] 0 2024-09-10T09:36:00.753 INFO:tasks.workunit.client.0.smithi079.stdout:2/130: stat d4/f18 0 2024-09-10T09:36:00.753 INFO:tasks.workunit.client.0.smithi079.stdout:2/131: chown d4/dc/d29/d21/l24 211 1 2024-09-10T09:36:00.754 INFO:tasks.workunit.client.0.smithi079.stdout:6/208: link d4/d8/dc/fe d4/d8/dc/d12/d29/f47 0 2024-09-10T09:36:00.754 INFO:tasks.workunit.client.0.smithi079.stdout:6/209: chown d4/d8/dc/d12/l18 57721138 1 2024-09-10T09:36:00.760 INFO:tasks.workunit.client.0.smithi079.stdout:5/144: rename d2/l14 to d2/d3/l30 0 2024-09-10T09:36:00.760 INFO:tasks.workunit.client.0.smithi079.stdout:5/145: chown d2/c2d 5397441 1 2024-09-10T09:36:00.760 INFO:tasks.workunit.client.0.smithi079.stdout:5/146: creat d2/f31 x:0 0 0 2024-09-10T09:36:00.760 INFO:tasks.workunit.client.0.smithi079.stdout:5/147: chown d2/d3/l25 564847 1 2024-09-10T09:36:00.762 INFO:tasks.workunit.client.0.smithi079.stdout:1/194: dread d5/df/d11/f2b [0,4194304] 0 2024-09-10T09:36:00.770 INFO:tasks.workunit.client.0.smithi079.stdout:6/210: rename d4/d8/dd/c26 to d4/d35/d46/c48 0 2024-09-10T09:36:00.771 INFO:tasks.workunit.client.0.smithi079.stdout:1/195: rename d5/d24 to d5/d24/d36/d3e 22 2024-09-10T09:36:00.771 INFO:tasks.workunit.client.0.smithi079.stdout:6/211: write d4/d8/dc/d1c/f3f [600608,16456] 0 2024-09-10T09:36:00.771 INFO:tasks.workunit.client.0.smithi079.stdout:6/212: readlink d4/d8/dc/d12/l22 0 2024-09-10T09:36:00.771 INFO:tasks.workunit.client.0.smithi079.stdout:1/196: write d5/df/d2e/f39 [1137384,114472] 0 2024-09-10T09:36:00.776 INFO:tasks.workunit.client.0.smithi079.stdout:5/148: mkdir d2/d3/d27/d32 0 2024-09-10T09:36:00.781 INFO:tasks.workunit.client.0.smithi079.stdout:6/213: creat d4/d35/d39/f49 x:0 0 0 2024-09-10T09:36:00.782 INFO:tasks.workunit.client.0.smithi079.stdout:9/134: dread d3/f11 [0,4194304] 0 2024-09-10T09:36:00.782 INFO:tasks.workunit.client.0.smithi079.stdout:0/197: dwrite d4/fd [0,4194304] 0 2024-09-10T09:36:00.782 INFO:tasks.workunit.client.0.smithi079.stdout:0/198: readlink d4/d12/d15/d2b/l3e 0 2024-09-10T09:36:00.783 INFO:tasks.workunit.client.0.smithi079.stdout:1/197: symlink d5/df/d2e/l3f 0 2024-09-10T09:36:00.783 INFO:tasks.workunit.client.0.smithi079.stdout:1/198: fdatasync d5/df/d11/f32 0 2024-09-10T09:36:00.783 INFO:tasks.workunit.client.0.smithi079.stdout:1/199: fsync d5/df/d11/f32 0 2024-09-10T09:36:00.785 INFO:tasks.workunit.client.0.smithi079.stdout:5/149: rename l1 to d2/d3/l33 0 2024-09-10T09:36:00.787 INFO:tasks.workunit.client.0.smithi079.stdout:6/214: symlink d4/d8/dc/d12/d29/l4a 0 2024-09-10T09:36:00.787 INFO:tasks.workunit.client.0.smithi079.stdout:6/215: chown d4/d8/dd/d41 28636 1 2024-09-10T09:36:00.787 INFO:tasks.workunit.client.0.smithi079.stdout:6/216: chown d4/d8/dc/d3c 0 1 2024-09-10T09:36:00.787 INFO:tasks.workunit.client.0.smithi079.stdout:6/217: write d4/d8/dc/d1c/f15 [2013655,9524] 0 2024-09-10T09:36:00.788 INFO:tasks.workunit.client.0.smithi079.stdout:1/200: mkdir d5/d40 0 2024-09-10T09:36:00.788 INFO:tasks.workunit.client.0.smithi079.stdout:1/201: chown d5/df/l3b 1 1 2024-09-10T09:36:00.791 INFO:tasks.workunit.client.0.smithi079.stdout:8/177: sync 2024-09-10T09:36:00.791 INFO:tasks.workunit.client.0.smithi079.stdout:6/218: write d4/d8/f20 [4349805,16896] 0 2024-09-10T09:36:00.792 INFO:tasks.workunit.client.0.smithi079.stdout:8/178: truncate d11/f16 1538186 0 2024-09-10T09:36:00.793 INFO:tasks.workunit.client.0.smithi079.stdout:8/179: readlink d11/l2f 0 2024-09-10T09:36:00.793 INFO:tasks.workunit.client.0.smithi079.stdout:8/180: write d11/d2b/f30 [816356,91206] 0 2024-09-10T09:36:00.797 INFO:tasks.workunit.client.0.smithi079.stdout:8/181: creat d11/d3b/f3c x:0 0 0 2024-09-10T09:36:00.797 INFO:tasks.workunit.client.0.smithi079.stdout:7/139: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:36:00.798 INFO:tasks.workunit.client.0.smithi079.stdout:2/132: dwrite d4/dc/d29/f16 [0,4194304] 0 2024-09-10T09:36:00.798 INFO:tasks.workunit.client.0.smithi079.stdout:9/135: dread d3/d7/dc/de/d17/d12/d22/f23 [0,4194304] 0 2024-09-10T09:36:00.798 INFO:tasks.workunit.client.0.smithi079.stdout:9/136: fsync d3/f14 0 2024-09-10T09:36:00.798 INFO:tasks.workunit.client.0.smithi079.stdout:9/137: truncate d3/d7/dc/de/d17/f28 878265 0 2024-09-10T09:36:00.803 INFO:tasks.workunit.client.0.smithi079.stdout:8/182: write d11/f21 [3047033,111786] 0 2024-09-10T09:36:00.804 INFO:tasks.workunit.client.0.smithi079.stdout:5/150: dwrite d2/d3/f28 [0,4194304] 0 2024-09-10T09:36:00.809 INFO:tasks.workunit.client.0.smithi079.stdout:9/138: dread d3/d7/dc/de/d17/d12/d22/f23 [0,4194304] 0 2024-09-10T09:36:00.819 INFO:tasks.workunit.client.0.smithi079.stdout:2/133: rename d4/dc/d13/c2a to d4/dc/d29/d1b/c2d 0 2024-09-10T09:36:00.820 INFO:tasks.workunit.client.0.smithi079.stdout:2/134: read d4/dc/d13/f27 [584018,30481] 0 2024-09-10T09:36:00.822 INFO:tasks.workunit.client.0.smithi079.stdout:5/151: rename d2/c23 to d2/d3/d27/c34 0 2024-09-10T09:36:00.823 INFO:tasks.workunit.client.0.smithi079.stdout:5/152: symlink d2/d3/l35 0 2024-09-10T09:36:00.825 INFO:tasks.workunit.client.0.smithi079.stdout:6/219: rmdir d4/d8/dc/d12/d29 39 2024-09-10T09:36:00.825 INFO:tasks.workunit.client.0.smithi079.stdout:6/220: chown d4/d8/dc/f37 1077232 1 2024-09-10T09:36:00.827 INFO:tasks.workunit.client.0.smithi079.stdout:8/183: dread d11/f2a [0,4194304] 0 2024-09-10T09:36:00.829 INFO:tasks.workunit.client.0.smithi079.stdout:8/184: chown d11/f12 3521664 1 2024-09-10T09:36:00.831 INFO:tasks.workunit.client.0.smithi079.stdout:1/202: dwrite d5/df/d11/f1b [0,4194304] 0 2024-09-10T09:36:00.832 INFO:tasks.workunit.client.0.smithi079.stdout:9/139: dwrite d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:00.834 INFO:tasks.workunit.client.0.smithi079.stdout:7/140: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:36:00.834 INFO:tasks.workunit.client.0.smithi079.stdout:7/141: fdatasync d4/dc/f17 0 2024-09-10T09:36:00.838 INFO:tasks.workunit.client.0.smithi079.stdout:9/140: symlink d3/d7/d26/l29 0 2024-09-10T09:36:00.840 INFO:tasks.workunit.client.0.smithi079.stdout:9/141: creat d3/d7/f2a x:0 0 0 2024-09-10T09:36:00.841 INFO:tasks.workunit.client.0.smithi079.stdout:9/142: creat d3/f2b x:0 0 0 2024-09-10T09:36:00.841 INFO:tasks.workunit.client.0.smithi079.stdout:9/143: fsync d3/d7/dc/de/d17/f28 0 2024-09-10T09:36:00.841 INFO:tasks.workunit.client.0.smithi079.stdout:5/153: dread d2/d3/f16 [0,4194304] 0 2024-09-10T09:36:00.841 INFO:tasks.workunit.client.0.smithi079.stdout:5/154: fdatasync d2/f31 0 2024-09-10T09:36:00.842 INFO:tasks.workunit.client.0.smithi079.stdout:1/203: dread d5/f19 [0,4194304] 0 2024-09-10T09:36:00.845 INFO:tasks.workunit.client.0.smithi079.stdout:1/204: dread d5/df/f1c [0,4194304] 0 2024-09-10T09:36:00.849 INFO:tasks.workunit.client.0.smithi079.stdout:2/135: dwrite d4/dc/d29/ff [0,4194304] 0 2024-09-10T09:36:00.850 INFO:tasks.workunit.client.0.smithi079.stdout:1/205: unlink l4 0 2024-09-10T09:36:00.859 INFO:tasks.workunit.client.0.smithi079.stdout:6/221: dwrite f3 [0,4194304] 0 2024-09-10T09:36:00.859 INFO:tasks.workunit.client.0.smithi079.stdout:1/206: unlink d5/d24/c25 0 2024-09-10T09:36:00.859 INFO:tasks.workunit.client.0.smithi079.stdout:1/207: write d5/df/d11/f16 [1204406,62902] 0 2024-09-10T09:36:00.863 INFO:tasks.workunit.client.0.smithi079.stdout:2/136: rename d4/dc/d29/c17 to d4/dc/c2e 0 2024-09-10T09:36:00.864 INFO:tasks.workunit.client.0.smithi079.stdout:6/222: mkdir d4/d35/d39/d4b 0 2024-09-10T09:36:00.864 INFO:tasks.workunit.client.0.smithi079.stdout:6/223: write d4/d8/dc/f24 [508212,24516] 0 2024-09-10T09:36:00.865 INFO:tasks.workunit.client.0.smithi079.stdout:9/144: rmdir d3/d7 39 2024-09-10T09:36:00.868 INFO:tasks.workunit.client.0.smithi079.stdout:2/137: truncate d4/dc/d13/f15 494826 0 2024-09-10T09:36:00.868 INFO:tasks.workunit.client.0.smithi079.stdout:2/138: chown d4/dc/d29/c1d 1860 1 2024-09-10T09:36:00.868 INFO:tasks.workunit.client.0.smithi079.stdout:6/224: creat d4/d35/d39/d4b/f4c x:0 0 0 2024-09-10T09:36:00.871 INFO:tasks.workunit.client.0.smithi079.stdout:7/142: dwrite d4/dc/f17 [0,4194304] 0 2024-09-10T09:36:00.871 INFO:tasks.workunit.client.0.smithi079.stdout:7/143: creat d4/dc/f21 x:0 0 0 2024-09-10T09:36:00.871 INFO:tasks.workunit.client.0.smithi079.stdout:2/139: symlink d4/dc/d13/l2f 0 2024-09-10T09:36:00.872 INFO:tasks.workunit.client.0.smithi079.stdout:9/145: write d3/d7/dc/de/d17/d12/d22/f23 [777374,91234] 0 2024-09-10T09:36:00.872 INFO:tasks.workunit.client.0.smithi079.stdout:6/225: stat l1 0 2024-09-10T09:36:00.872 INFO:tasks.workunit.client.0.smithi079.stdout:8/185: dwrite d11/f1a [0,4194304] 0 2024-09-10T09:36:00.872 INFO:tasks.workunit.client.0.smithi079.stdout:9/146: chown d3/c19 251053261 1 2024-09-10T09:36:00.872 INFO:tasks.workunit.client.0.smithi079.stdout:6/226: creat d4/d35/d39/d4b/f4d x:0 0 0 2024-09-10T09:36:00.881 INFO:tasks.workunit.client.0.smithi079.stdout:1/208: dwrite d5/df/f34 [0,4194304] 0 2024-09-10T09:36:00.883 INFO:tasks.workunit.client.0.smithi079.stdout:2/140: mkdir d4/dc/d29/d21/d30 0 2024-09-10T09:36:00.886 INFO:tasks.workunit.client.0.smithi079.stdout:1/209: dread d5/df/d11/f16 [0,4194304] 0 2024-09-10T09:36:00.888 INFO:tasks.workunit.client.0.smithi079.stdout:8/186: write d11/f25 [632986,78692] 0 2024-09-10T09:36:00.889 INFO:tasks.workunit.client.0.smithi079.stdout:9/147: truncate d3/f16 673681 0 2024-09-10T09:36:00.893 INFO:tasks.workunit.client.0.smithi079.stdout:6/227: creat d4/d8/dc/f4e x:0 0 0 2024-09-10T09:36:00.894 INFO:tasks.workunit.client.0.smithi079.stdout:7/144: rmdir d4 39 2024-09-10T09:36:00.899 INFO:tasks.workunit.client.0.smithi079.stdout:0/199: sync 2024-09-10T09:36:00.899 INFO:tasks.workunit.client.0.smithi079.stdout:3/192: sync 2024-09-10T09:36:00.900 INFO:tasks.workunit.client.0.smithi079.stdout:2/141: mkdir d4/dc/d29/d21/d30/d31 0 2024-09-10T09:36:00.900 INFO:tasks.workunit.client.0.smithi079.stdout:2/142: getdents d4/dc/d29/d21/d30/d31 0 2024-09-10T09:36:00.902 INFO:tasks.workunit.client.0.smithi079.stdout:7/145: rmdir d4/df/d19 39 2024-09-10T09:36:00.905 INFO:tasks.workunit.client.0.smithi079.stdout:4/179: sync 2024-09-10T09:36:00.906 INFO:tasks.workunit.client.0.smithi079.stdout:4/180: dread - d1/da/f2b zero size 2024-09-10T09:36:00.906 INFO:tasks.workunit.client.0.smithi079.stdout:8/187: dwrite d11/f12 [0,4194304] 0 2024-09-10T09:36:00.907 INFO:tasks.workunit.client.0.smithi079.stdout:8/188: dread d11/f2a [0,4194304] 0 2024-09-10T09:36:00.907 INFO:tasks.workunit.client.0.smithi079.stdout:8/189: creat d11/d3b/f3d x:0 0 0 2024-09-10T09:36:00.908 INFO:tasks.workunit.client.0.smithi079.stdout:0/200: creat d4/d12/d15/d2b/f45 x:0 0 0 2024-09-10T09:36:00.908 INFO:tasks.workunit.client.0.smithi079.stdout:3/193: unlink d4/da/c25 0 2024-09-10T09:36:00.908 INFO:tasks.workunit.client.0.smithi079.stdout:3/194: creat d4/da/d17/f37 x:0 0 0 2024-09-10T09:36:00.908 INFO:tasks.workunit.client.0.smithi079.stdout:2/143: getdents d4/dc/d29/d1b 0 2024-09-10T09:36:00.912 INFO:tasks.workunit.client.0.smithi079.stdout:1/210: rmdir d5 39 2024-09-10T09:36:00.913 INFO:tasks.workunit.client.0.smithi079.stdout:4/181: creat d1/da/f36 x:0 0 0 2024-09-10T09:36:00.914 INFO:tasks.workunit.client.0.smithi079.stdout:8/190: fsync d11/f1e 0 2024-09-10T09:36:00.914 INFO:tasks.workunit.client.0.smithi079.stdout:8/191: creat d11/d3b/f3e x:0 0 0 2024-09-10T09:36:00.915 INFO:tasks.workunit.client.0.smithi079.stdout:3/195: mkdir d4/da/d17/d38 0 2024-09-10T09:36:00.916 INFO:tasks.workunit.client.0.smithi079.stdout:6/228: dwrite d4/f40 [0,4194304] 0 2024-09-10T09:36:00.916 INFO:tasks.workunit.client.0.smithi079.stdout:2/144: mknod d4/dc/d29/d1b/c32 0 2024-09-10T09:36:00.917 INFO:tasks.workunit.client.0.smithi079.stdout:1/211: unlink d5/df/d11/l1e 0 2024-09-10T09:36:00.919 INFO:tasks.workunit.client.0.smithi079.stdout:0/201: dread d4/fd [0,4194304] 0 2024-09-10T09:36:00.919 INFO:tasks.workunit.client.0.smithi079.stdout:4/182: link d1/da/d16/d21/l31 d1/l37 0 2024-09-10T09:36:00.920 INFO:tasks.workunit.client.0.smithi079.stdout:8/192: rename d11/f21 to d11/d2b/f3f 0 2024-09-10T09:36:00.922 INFO:tasks.workunit.client.0.smithi079.stdout:6/229: symlink d4/d8/dc/d12/l4f 0 2024-09-10T09:36:00.923 INFO:tasks.workunit.client.0.smithi079.stdout:1/212: mkdir d5/df/d41 0 2024-09-10T09:36:00.924 INFO:tasks.workunit.client.0.smithi079.stdout:0/202: creat d4/d12/d39/f46 x:0 0 0 2024-09-10T09:36:00.925 INFO:tasks.workunit.client.0.smithi079.stdout:4/183: mkdir d1/d38 0 2024-09-10T09:36:00.925 INFO:tasks.workunit.client.0.smithi079.stdout:4/184: read d1/da/f2c [2097616,75080] 0 2024-09-10T09:36:00.926 INFO:tasks.workunit.client.0.smithi079.stdout:3/196: write d4/da/d17/f24 [55801,33926] 0 2024-09-10T09:36:00.926 INFO:tasks.workunit.client.0.smithi079.stdout:8/193: link d11/f32 d11/d2b/f40 0 2024-09-10T09:36:00.928 INFO:tasks.workunit.client.0.smithi079.stdout:6/230: link d4/d8/dc/d12/d29/l4a d4/d8/dd/l50 0 2024-09-10T09:36:00.929 INFO:tasks.workunit.client.0.smithi079.stdout:0/203: mkdir d4/d47 0 2024-09-10T09:36:00.929 INFO:tasks.workunit.client.0.smithi079.stdout:0/204: creat d4/d12/d39/f48 x:0 0 0 2024-09-10T09:36:00.930 INFO:tasks.workunit.client.0.smithi079.stdout:0/205: write f0 [384962,63312] 0 2024-09-10T09:36:00.930 INFO:tasks.workunit.client.0.smithi079.stdout:0/206: dread - d4/d12/d39/f48 zero size 2024-09-10T09:36:00.931 INFO:tasks.workunit.client.0.smithi079.stdout:4/185: rename d1/da/d16/l1e to d1/da/d28/l39 0 2024-09-10T09:36:00.931 INFO:tasks.workunit.client.0.smithi079.stdout:4/186: fsync d1/f2a 0 2024-09-10T09:36:00.931 INFO:tasks.workunit.client.0.smithi079.stdout:4/187: write d1/da/d16/f26 [1221814,12498] 0 2024-09-10T09:36:00.931 INFO:tasks.workunit.client.0.smithi079.stdout:4/188: creat d1/f3a x:0 0 0 2024-09-10T09:36:00.932 INFO:tasks.workunit.client.0.smithi079.stdout:4/189: readlink d1/da/d16/l23 0 2024-09-10T09:36:00.932 INFO:tasks.workunit.client.0.smithi079.stdout:4/190: dread - d1/da/d16/f24 zero size 2024-09-10T09:36:00.932 INFO:tasks.workunit.client.0.smithi079.stdout:4/191: dread - d1/da/d16/f24 zero size 2024-09-10T09:36:00.936 INFO:tasks.workunit.client.0.smithi079.stdout:8/194: chown d11/l1c 1033 1 2024-09-10T09:36:00.938 INFO:tasks.workunit.client.0.smithi079.stdout:6/231: mkdir d4/d8/dd/d41/d51 0 2024-09-10T09:36:00.939 INFO:tasks.workunit.client.0.smithi079.stdout:6/232: truncate d4/d8/dc/d1c/f3f 1279739 0 2024-09-10T09:36:00.939 INFO:tasks.workunit.client.0.smithi079.stdout:6/233: dread - d4/d8/f3b zero size 2024-09-10T09:36:00.939 INFO:tasks.workunit.client.0.smithi079.stdout:6/234: chown d4/d8/dc/d12/d29 1816571 1 2024-09-10T09:36:00.940 INFO:tasks.workunit.client.0.smithi079.stdout:0/207: mkdir d4/d47/d49 0 2024-09-10T09:36:00.940 INFO:tasks.workunit.client.0.smithi079.stdout:0/208: chown d4/d12/d15/d2b 38 1 2024-09-10T09:36:00.941 INFO:tasks.workunit.client.0.smithi079.stdout:0/209: dread - d4/d1d/f3a zero size 2024-09-10T09:36:00.941 INFO:tasks.workunit.client.0.smithi079.stdout:4/192: read d1/f9 [2244447,63484] 0 2024-09-10T09:36:00.941 INFO:tasks.workunit.client.0.smithi079.stdout:3/197: getdents d4/da/d17/d2d 0 2024-09-10T09:36:00.943 INFO:tasks.workunit.client.0.smithi079.stdout:6/235: rename d4/d8/dc/d12/l4f to d4/d8/dc/d1c/l52 0 2024-09-10T09:36:00.943 INFO:tasks.workunit.client.0.smithi079.stdout:6/236: fdatasync d4/d8/dd/d41/f45 0 2024-09-10T09:36:00.943 INFO:tasks.workunit.client.0.smithi079.stdout:0/210: symlink d4/d12/d21/l4a 0 2024-09-10T09:36:00.944 INFO:tasks.workunit.client.0.smithi079.stdout:0/211: readlink d4/d12/d1a/lc 0 2024-09-10T09:36:00.945 INFO:tasks.workunit.client.0.smithi079.stdout:0/212: symlink d4/d12/d15/l4b 0 2024-09-10T09:36:00.947 INFO:tasks.workunit.client.0.smithi079.stdout:3/198: dread d4/da/d17/f21 [4194304,4194304] 0 2024-09-10T09:36:00.952 INFO:tasks.workunit.client.0.smithi079.stdout:2/145: dwrite d4/dc/d1c/f28 [0,4194304] 0 2024-09-10T09:36:00.953 INFO:tasks.workunit.client.0.smithi079.stdout:8/195: read fb [4973856,108852] 0 2024-09-10T09:36:00.954 INFO:tasks.workunit.client.0.smithi079.stdout:0/213: write f0 [150584,51806] 0 2024-09-10T09:36:00.956 INFO:tasks.workunit.client.0.smithi079.stdout:2/146: getdents d4/dc/d29/d21 0 2024-09-10T09:36:00.957 INFO:tasks.workunit.client.0.smithi079.stdout:4/193: dread d1/da/d16/f1f [0,4194304] 0 2024-09-10T09:36:00.957 INFO:tasks.workunit.client.0.smithi079.stdout:1/213: dwrite d5/d24/f2f [0,4194304] 0 2024-09-10T09:36:00.957 INFO:tasks.workunit.client.0.smithi079.stdout:1/214: chown d5/df/d2e/l3f 14 1 2024-09-10T09:36:00.961 INFO:tasks.workunit.client.0.smithi079.stdout:0/214: creat d4/d47/f4c x:0 0 0 2024-09-10T09:36:00.963 INFO:tasks.workunit.client.0.smithi079.stdout:2/147: link d4/dc/d29/f16 d4/dc/d13/f33 0 2024-09-10T09:36:00.963 INFO:tasks.workunit.client.0.smithi079.stdout:2/148: chown d4/f2b 651373 1 2024-09-10T09:36:00.963 INFO:tasks.workunit.client.0.smithi079.stdout:2/149: write d4/f2b [157424,130313] 0 2024-09-10T09:36:00.964 INFO:tasks.workunit.client.0.smithi079.stdout:3/199: dwrite d4/f29 [0,4194304] 0 2024-09-10T09:36:00.965 INFO:tasks.workunit.client.0.smithi079.stdout:1/215: creat d5/d40/f42 x:0 0 0 2024-09-10T09:36:00.966 INFO:tasks.workunit.client.0.smithi079.stdout:8/196: getdents d11 0 2024-09-10T09:36:00.967 INFO:tasks.workunit.client.0.smithi079.stdout:8/197: write d11/f2a [401474,106339] 0 2024-09-10T09:36:00.967 INFO:tasks.workunit.client.0.smithi079.stdout:8/198: write f8 [2770660,16859] 0 2024-09-10T09:36:00.968 INFO:tasks.workunit.client.0.smithi079.stdout:8/199: read - d11/d3b/f3e zero size 2024-09-10T09:36:00.968 INFO:tasks.workunit.client.0.smithi079.stdout:0/215: symlink d4/d12/d39/l4d 0 2024-09-10T09:36:00.968 INFO:tasks.workunit.client.0.smithi079.stdout:2/150: link d4/dc/d29/ff d4/dc/d1c/f34 0 2024-09-10T09:36:00.972 INFO:tasks.workunit.client.0.smithi079.stdout:2/151: dread d4/f2b [0,4194304] 0 2024-09-10T09:36:00.974 INFO:tasks.workunit.client.0.smithi079.stdout:4/194: mkdir d1/da/d3b 0 2024-09-10T09:36:00.975 INFO:tasks.workunit.client.0.smithi079.stdout:1/216: getdents d5/d24/d36 0 2024-09-10T09:36:00.975 INFO:tasks.workunit.client.0.smithi079.stdout:1/217: chown d5/df/d2e/l33 3166 1 2024-09-10T09:36:00.975 INFO:tasks.workunit.client.0.smithi079.stdout:1/218: fsync d5/f14 0 2024-09-10T09:36:00.975 INFO:tasks.workunit.client.0.smithi079.stdout:1/219: dread - d5/d40/f42 zero size 2024-09-10T09:36:00.977 INFO:tasks.workunit.client.0.smithi079.stdout:0/216: symlink d4/d47/l4e 0 2024-09-10T09:36:00.977 INFO:tasks.workunit.client.0.smithi079.stdout:8/200: write d11/f14 [1982657,37270] 0 2024-09-10T09:36:00.980 INFO:tasks.workunit.client.0.smithi079.stdout:3/200: rmdir d4 39 2024-09-10T09:36:00.983 INFO:tasks.workunit.client.0.smithi079.stdout:0/217: rmdir d4/d47/d49 0 2024-09-10T09:36:00.986 INFO:tasks.workunit.client.0.smithi079.stdout:2/152: mknod d4/dc/c35 0 2024-09-10T09:36:00.986 INFO:tasks.workunit.client.0.smithi079.stdout:2/153: write d4/dc/d13/f15 [1050239,101933] 0 2024-09-10T09:36:00.986 INFO:tasks.workunit.client.0.smithi079.stdout:2/154: write d4/dc/d13/f1f [691241,16467] 0 2024-09-10T09:36:00.988 INFO:tasks.workunit.client.0.smithi079.stdout:8/201: unlink d11/f22 0 2024-09-10T09:36:00.990 INFO:tasks.workunit.client.0.smithi079.stdout:3/201: mknod d4/da/d18/c39 0 2024-09-10T09:36:00.990 INFO:tasks.workunit.client.0.smithi079.stdout:3/202: chown d4 3927717 1 2024-09-10T09:36:00.990 INFO:tasks.workunit.client.0.smithi079.stdout:3/203: truncate d4/da/d17/f33 353224 0 2024-09-10T09:36:00.990 INFO:tasks.workunit.client.0.smithi079.stdout:3/204: chown d4/da/d18 19978288 1 2024-09-10T09:36:00.992 INFO:tasks.workunit.client.0.smithi079.stdout:2/155: symlink d4/dc/d1c/l36 0 2024-09-10T09:36:00.993 INFO:tasks.workunit.client.0.smithi079.stdout:1/220: dwrite d5/d40/f42 [0,4194304] 0 2024-09-10T09:36:00.994 INFO:tasks.workunit.client.0.smithi079.stdout:3/205: link d4/da/c15 d4/c3a 0 2024-09-10T09:36:00.994 INFO:tasks.workunit.client.0.smithi079.stdout:3/206: readlink d4/da/d17/l26 0 2024-09-10T09:36:00.994 INFO:tasks.workunit.client.0.smithi079.stdout:3/207: readlink d4/da/l1d 0 2024-09-10T09:36:00.994 INFO:tasks.workunit.client.0.smithi079.stdout:3/208: chown d4/c6 16 1 2024-09-10T09:36:00.995 INFO:tasks.workunit.client.0.smithi079.stdout:3/209: write d4/da/d17/f24 [4172262,70598] 0 2024-09-10T09:36:00.998 INFO:tasks.workunit.client.0.smithi079.stdout:1/221: rename d5/cd to d5/df/d41/c43 0 2024-09-10T09:36:01.000 INFO:tasks.workunit.client.0.smithi079.stdout:3/210: symlink d4/da/d17/d38/l3b 0 2024-09-10T09:36:01.001 INFO:tasks.workunit.client.0.smithi079.stdout:3/211: truncate d4/f13 4409127 0 2024-09-10T09:36:01.002 INFO:tasks.workunit.client.0.smithi079.stdout:4/195: dwrite d1/da/f2c [4194304,4194304] 0 2024-09-10T09:36:01.002 INFO:tasks.workunit.client.0.smithi079.stdout:1/222: unlink d5/df/l3b 0 2024-09-10T09:36:01.003 INFO:tasks.workunit.client.0.smithi079.stdout:5/155: sync 2024-09-10T09:36:01.007 INFO:tasks.workunit.client.0.smithi079.stdout:3/212: mknod d4/da/d17/c3c 0 2024-09-10T09:36:01.007 INFO:tasks.workunit.client.0.smithi079.stdout:4/196: mknod d1/da/d16/d21/c3c 0 2024-09-10T09:36:01.012 INFO:tasks.workunit.client.0.smithi079.stdout:5/156: mknod d2/c36 0 2024-09-10T09:36:01.012 INFO:tasks.workunit.client.0.smithi079.stdout:5/157: creat d2/f37 x:0 0 0 2024-09-10T09:36:01.012 INFO:tasks.workunit.client.0.smithi079.stdout:5/158: fsync d2/f15 0 2024-09-10T09:36:01.015 INFO:tasks.workunit.client.0.smithi079.stdout:3/213: symlink d4/da/d17/d2d/l3d 0 2024-09-10T09:36:01.015 INFO:tasks.workunit.client.0.smithi079.stdout:3/214: stat d4/da/d17/d38/l3b 0 2024-09-10T09:36:01.015 INFO:tasks.workunit.client.0.smithi079.stdout:4/197: mkdir d1/da/d28/d3d 0 2024-09-10T09:36:01.017 INFO:tasks.workunit.client.0.smithi079.stdout:4/198: truncate d1/f9 3406996 0 2024-09-10T09:36:01.017 INFO:tasks.workunit.client.0.smithi079.stdout:4/199: fsync d1/f2e 0 2024-09-10T09:36:01.018 INFO:tasks.workunit.client.0.smithi079.stdout:2/156: dwrite d4/dc/d29/f16 [4194304,4194304] 0 2024-09-10T09:36:01.018 INFO:tasks.workunit.client.0.smithi079.stdout:1/223: dread d5/fe [0,4194304] 0 2024-09-10T09:36:01.018 INFO:tasks.workunit.client.0.smithi079.stdout:8/202: dwrite d11/f1a [0,4194304] 0 2024-09-10T09:36:01.018 INFO:tasks.workunit.client.0.smithi079.stdout:4/200: symlink d1/l3e 0 2024-09-10T09:36:01.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/224: dread d5/df/d2e/f39 [0,4194304] 0 2024-09-10T09:36:01.027 INFO:tasks.workunit.client.0.smithi079.stdout:4/201: unlink d1/fe 0 2024-09-10T09:36:01.027 INFO:tasks.workunit.client.0.smithi079.stdout:4/202: readlink d1/da/d16/d21/l35 0 2024-09-10T09:36:01.056 INFO:tasks.workunit.client.0.smithi079.stdout:4/203: write d1/da/d16/f27 [3955244,12941] 0 2024-09-10T09:36:01.056 INFO:tasks.workunit.client.0.smithi079.stdout:3/215: dwrite d4/da/f35 [0,4194304] 0 2024-09-10T09:36:01.057 INFO:tasks.workunit.client.0.smithi079.stdout:5/159: dwrite d2/d3/fa [4194304,4194304] 0 2024-09-10T09:36:01.058 INFO:tasks.workunit.client.0.smithi079.stdout:9/148: sync 2024-09-10T09:36:01.059 INFO:tasks.workunit.client.0.smithi079.stdout:4/204: creat d1/da/f3f x:0 0 0 2024-09-10T09:36:01.061 INFO:tasks.workunit.client.0.smithi079.stdout:5/160: creat d2/d3/f38 x:0 0 0 2024-09-10T09:36:01.063 INFO:tasks.workunit.client.0.smithi079.stdout:4/205: truncate d1/f7 68679 0 2024-09-10T09:36:01.063 INFO:tasks.workunit.client.0.smithi079.stdout:9/149: dread d3/f11 [4194304,4194304] 0 2024-09-10T09:36:01.072 INFO:tasks.workunit.client.0.smithi079.stdout:9/150: dread d3/d7/dc/de/d17/f1d [0,4194304] 0 2024-09-10T09:36:01.116 INFO:tasks.workunit.client.0.smithi079.stdout:4/206: mkdir d1/da/d16/d21/d32/d40 0 2024-09-10T09:36:01.117 INFO:tasks.workunit.client.0.smithi079.stdout:4/207: chown d1/da/d3b 152152411 1 2024-09-10T09:36:01.136 INFO:tasks.workunit.client.0.smithi079.stdout:5/161: dwrite d2/f31 [0,4194304] 0 2024-09-10T09:36:01.138 INFO:tasks.workunit.client.0.smithi079.stdout:5/162: mkdir d2/d3/d27/d32/d39 0 2024-09-10T09:36:01.142 INFO:tasks.workunit.client.0.smithi079.stdout:3/216: dwrite d4/da/f35 [0,4194304] 0 2024-09-10T09:36:01.142 INFO:tasks.workunit.client.0.smithi079.stdout:9/151: dwrite d3/d7/dc/de/d17/f21 [0,4194304] 0 2024-09-10T09:36:01.144 INFO:tasks.workunit.client.0.smithi079.stdout:3/217: mkdir d4/da/d17/d38/d3e 0 2024-09-10T09:36:01.150 INFO:tasks.workunit.client.0.smithi079.stdout:9/152: rmdir d3/d7/dc/de/d17 39 2024-09-10T09:36:01.150 INFO:tasks.workunit.client.0.smithi079.stdout:9/153: write d3/d7/dc/de/d17/d12/d22/f23 [1790228,106716] 0 2024-09-10T09:36:01.150 INFO:tasks.workunit.client.0.smithi079.stdout:9/154: chown d3/d7/d26/l29 739513 1 2024-09-10T09:36:01.151 INFO:tasks.workunit.client.0.smithi079.stdout:3/218: creat d4/da/d17/f3f x:0 0 0 2024-09-10T09:36:01.153 INFO:tasks.workunit.client.0.smithi079.stdout:5/163: dwrite d2/d3/fe [0,4194304] 0 2024-09-10T09:36:01.154 INFO:tasks.workunit.client.0.smithi079.stdout:5/164: creat d2/f3a x:0 0 0 2024-09-10T09:36:01.154 INFO:tasks.workunit.client.0.smithi079.stdout:5/165: chown d2/f22 1894 1 2024-09-10T09:36:01.154 INFO:tasks.workunit.client.0.smithi079.stdout:5/166: write d2/f1b [5148800,15494] 0 2024-09-10T09:36:01.154 INFO:tasks.workunit.client.0.smithi079.stdout:5/167: creat d2/f3b x:0 0 0 2024-09-10T09:36:01.155 INFO:tasks.workunit.client.0.smithi079.stdout:9/155: rename d3/f1c to d3/d7/dc/de/f2c 0 2024-09-10T09:36:01.155 INFO:tasks.workunit.client.0.smithi079.stdout:9/156: dread d3/d7/dc/de/d17/f28 [0,4194304] 0 2024-09-10T09:36:01.157 INFO:tasks.workunit.client.0.smithi079.stdout:6/237: sync 2024-09-10T09:36:01.157 INFO:tasks.workunit.client.0.smithi079.stdout:0/218: sync 2024-09-10T09:36:01.157 INFO:tasks.workunit.client.0.smithi079.stdout:6/238: write d4/d8/dc/d12/d29/f2f [617030,24304] 0 2024-09-10T09:36:01.157 INFO:tasks.workunit.client.0.smithi079.stdout:6/239: readlink d4/d8/dc/d1c/l52 0 2024-09-10T09:36:01.158 INFO:tasks.workunit.client.0.smithi079.stdout:7/146: sync 2024-09-10T09:36:01.158 INFO:tasks.workunit.client.0.smithi079.stdout:3/219: rename d4/da/d17/d2d/f2f to d4/f40 0 2024-09-10T09:36:01.159 INFO:tasks.workunit.client.0.smithi079.stdout:9/157: symlink d3/d7/dc/de/d17/l2d 0 2024-09-10T09:36:01.162 INFO:tasks.workunit.client.0.smithi079.stdout:0/219: mknod d4/d12/d15/c4f 0 2024-09-10T09:36:01.163 INFO:tasks.workunit.client.0.smithi079.stdout:0/220: fsync d4/fe 0 2024-09-10T09:36:01.164 INFO:tasks.workunit.client.0.smithi079.stdout:5/168: rename d2/d3/l10 to d2/d3/d27/d32/l3c 0 2024-09-10T09:36:01.164 INFO:tasks.workunit.client.0.smithi079.stdout:5/169: fsync d2/f15 0 2024-09-10T09:36:01.164 INFO:tasks.workunit.client.0.smithi079.stdout:5/170: chown d2/d3/fe 5112 1 2024-09-10T09:36:01.165 INFO:tasks.workunit.client.0.smithi079.stdout:5/171: creat d2/f3d x:0 0 0 2024-09-10T09:36:01.167 INFO:tasks.workunit.client.0.smithi079.stdout:0/221: mknod d4/d12/d21/c50 0 2024-09-10T09:36:01.167 INFO:tasks.workunit.client.0.smithi079.stdout:0/222: dread - d4/d12/d15/f28 zero size 2024-09-10T09:36:01.171 INFO:tasks.workunit.client.0.smithi079.stdout:9/158: dread d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:01.172 INFO:tasks.workunit.client.0.smithi079.stdout:0/223: creat d4/d12/d1a/f51 x:0 0 0 2024-09-10T09:36:01.172 INFO:tasks.workunit.client.0.smithi079.stdout:0/224: write d4/d12/f14 [633311,124146] 0 2024-09-10T09:36:01.172 INFO:tasks.workunit.client.0.smithi079.stdout:7/147: write d4/f5 [1200366,121344] 0 2024-09-10T09:36:01.173 INFO:tasks.workunit.client.0.smithi079.stdout:9/159: creat d3/d7/dc/f2e x:0 0 0 2024-09-10T09:36:01.173 INFO:tasks.workunit.client.0.smithi079.stdout:9/160: truncate d3/d7/dc/de/d17/f1d 4296116 0 2024-09-10T09:36:01.173 INFO:tasks.workunit.client.0.smithi079.stdout:9/161: read - d3/d7/f2a zero size 2024-09-10T09:36:01.175 INFO:tasks.workunit.client.0.smithi079.stdout:7/148: mknod d4/c22 0 2024-09-10T09:36:01.175 INFO:tasks.workunit.client.0.smithi079.stdout:7/149: chown c3 1499 1 2024-09-10T09:36:01.175 INFO:tasks.workunit.client.0.smithi079.stdout:7/150: chown d4/df/d19 1723717 1 2024-09-10T09:36:01.175 INFO:tasks.workunit.client.0.smithi079.stdout:3/220: dread d4/f7 [0,4194304] 0 2024-09-10T09:36:01.175 INFO:tasks.workunit.client.0.smithi079.stdout:3/221: read - d4/da/d17/f37 zero size 2024-09-10T09:36:01.177 INFO:tasks.workunit.client.0.smithi079.stdout:5/172: dread d2/d3/fa [0,4194304] 0 2024-09-10T09:36:01.177 INFO:tasks.workunit.client.0.smithi079.stdout:5/173: fdatasync d2/f24 0 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:5/174: truncate d2/f3d 197331 0 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:5/175: readlink d2/d3/l33 0 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:5/176: chown d2/f22 68 1 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:6/240: dwrite d4/d8/dc/d12/f30 [0,4194304] 0 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:9/162: getdents d3/d7/dc/de/d17 0 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:9/163: readlink d3/l9 0 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:8/203: sync 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:2/157: sync 2024-09-10T09:36:01.178 INFO:tasks.workunit.client.0.smithi079.stdout:1/225: sync 2024-09-10T09:36:01.179 INFO:tasks.workunit.client.0.smithi079.stdout:4/208: sync 2024-09-10T09:36:01.179 INFO:tasks.workunit.client.0.smithi079.stdout:0/225: rmdir d4/d47 39 2024-09-10T09:36:01.179 INFO:tasks.workunit.client.0.smithi079.stdout:7/151: symlink d4/l23 0 2024-09-10T09:36:01.180 INFO:tasks.workunit.client.0.smithi079.stdout:3/222: creat d4/da/d17/d38/d3e/f41 x:0 0 0 2024-09-10T09:36:01.181 INFO:tasks.workunit.client.0.smithi079.stdout:6/241: creat d4/d8/dc/d1c/f53 x:0 0 0 2024-09-10T09:36:01.181 INFO:tasks.workunit.client.0.smithi079.stdout:6/242: fsync d4/d8/dc/d12/f30 0 2024-09-10T09:36:01.185 INFO:tasks.workunit.client.0.smithi079.stdout:0/226: dread d4/f11 [0,4194304] 0 2024-09-10T09:36:01.185 INFO:tasks.workunit.client.0.smithi079.stdout:2/158: readlink d4/dc/d29/l19 0 2024-09-10T09:36:01.185 INFO:tasks.workunit.client.0.smithi079.stdout:0/227: truncate d4/d47/f4c 434487 0 2024-09-10T09:36:01.185 INFO:tasks.workunit.client.0.smithi079.stdout:0/228: write d4/d12/d39/f46 [612800,24727] 0 2024-09-10T09:36:01.185 INFO:tasks.workunit.client.0.smithi079.stdout:8/204: creat d11/d2b/f41 x:0 0 0 2024-09-10T09:36:01.185 INFO:tasks.workunit.client.0.smithi079.stdout:8/205: chown d11/c1f 17991632 1 2024-09-10T09:36:01.186 INFO:tasks.workunit.client.0.smithi079.stdout:8/206: chown d11/f17 56 1 2024-09-10T09:36:01.186 INFO:tasks.workunit.client.0.smithi079.stdout:1/226: link d5/df/l10 d5/df/l44 0 2024-09-10T09:36:01.186 INFO:tasks.workunit.client.0.smithi079.stdout:7/152: creat d4/df/d19/f24 x:0 0 0 2024-09-10T09:36:01.186 INFO:tasks.workunit.client.0.smithi079.stdout:7/153: chown d4/c9 0 1 2024-09-10T09:36:01.187 INFO:tasks.workunit.client.0.smithi079.stdout:3/223: getdents d4/da/d17/d38 0 2024-09-10T09:36:01.187 INFO:tasks.workunit.client.0.smithi079.stdout:0/229: getdents d4/d12/d16 0 2024-09-10T09:36:01.187 INFO:tasks.workunit.client.0.smithi079.stdout:0/230: write d4/d12/d39/f48 [547758,97852] 0 2024-09-10T09:36:01.191 INFO:tasks.workunit.client.0.smithi079.stdout:8/207: mknod d11/d2b/c42 0 2024-09-10T09:36:01.191 INFO:tasks.workunit.client.0.smithi079.stdout:1/227: creat d5/df/d2e/f45 x:0 0 0 2024-09-10T09:36:01.193 INFO:tasks.workunit.client.0.smithi079.stdout:7/154: rename d4/d6/f11 to d4/dc/f25 0 2024-09-10T09:36:01.193 INFO:tasks.workunit.client.0.smithi079.stdout:9/164: write d3/d7/dc/de/f2c [3561543,32842] 0 2024-09-10T09:36:01.194 INFO:tasks.workunit.client.0.smithi079.stdout:3/224: unlink d4/c6 0 2024-09-10T09:36:01.198 INFO:tasks.workunit.client.0.smithi079.stdout:1/228: mkdir d5/d40/d46 0 2024-09-10T09:36:01.200 INFO:tasks.workunit.client.0.smithi079.stdout:2/159: dread d4/dc/f14 [0,4194304] 0 2024-09-10T09:36:01.202 INFO:tasks.workunit.client.0.smithi079.stdout:5/177: dwrite d2/f3d [0,4194304] 0 2024-09-10T09:36:01.202 INFO:tasks.workunit.client.0.smithi079.stdout:9/165: mkdir d3/d7/dc/de/d17/d2f 0 2024-09-10T09:36:01.204 INFO:tasks.workunit.client.0.smithi079.stdout:3/225: truncate d4/fb 3174745 0 2024-09-10T09:36:01.204 INFO:tasks.workunit.client.0.smithi079.stdout:3/226: write d4/da/d17/f32 [367977,37484] 0 2024-09-10T09:36:01.205 INFO:tasks.workunit.client.0.smithi079.stdout:2/160: dread d4/f2b [0,4194304] 0 2024-09-10T09:36:01.205 INFO:tasks.workunit.client.0.smithi079.stdout:2/161: write d4/f23 [88006,78561] 0 2024-09-10T09:36:01.207 INFO:tasks.workunit.client.0.smithi079.stdout:8/208: link d11/f16 d11/f43 0 2024-09-10T09:36:01.207 INFO:tasks.workunit.client.0.smithi079.stdout:8/209: chown d11/d2b/f41 691498246 1 2024-09-10T09:36:01.208 INFO:tasks.workunit.client.0.smithi079.stdout:4/209: dwrite d1/f2a [0,4194304] 0 2024-09-10T09:36:01.215 INFO:tasks.workunit.client.0.smithi079.stdout:2/162: read d4/dc/d1c/f28 [3096305,81109] 0 2024-09-10T09:36:01.215 INFO:tasks.workunit.client.0.smithi079.stdout:2/163: write d4/dc/d13/f1f [895849,63579] 0 2024-09-10T09:36:01.219 INFO:tasks.workunit.client.0.smithi079.stdout:3/227: mkdir d4/da/d17/d38/d42 0 2024-09-10T09:36:01.220 INFO:tasks.workunit.client.0.smithi079.stdout:8/210: symlink d11/d2b/l44 0 2024-09-10T09:36:01.222 INFO:tasks.workunit.client.0.smithi079.stdout:2/164: dread d4/f5 [0,4194304] 0 2024-09-10T09:36:01.222 INFO:tasks.workunit.client.0.smithi079.stdout:2/165: fsync d4/dc/d29/ff 0 2024-09-10T09:36:01.222 INFO:tasks.workunit.client.0.smithi079.stdout:2/166: readlink d4/la 0 2024-09-10T09:36:01.222 INFO:tasks.workunit.client.0.smithi079.stdout:2/167: truncate d4/f2b 1041056 0 2024-09-10T09:36:01.223 INFO:tasks.workunit.client.0.smithi079.stdout:4/210: symlink d1/da/d28/l41 0 2024-09-10T09:36:01.224 INFO:tasks.workunit.client.0.smithi079.stdout:5/178: getdents d2/d3 0 2024-09-10T09:36:01.226 INFO:tasks.workunit.client.0.smithi079.stdout:0/231: dwrite d4/d12/d1a/fb [4194304,4194304] 0 2024-09-10T09:36:01.226 INFO:tasks.workunit.client.0.smithi079.stdout:3/228: mkdir d4/da/d17/d2d/d43 0 2024-09-10T09:36:01.231 INFO:tasks.workunit.client.0.smithi079.stdout:0/232: rename d4/d12/d1a/lc to d4/d12/d15/l52 0 2024-09-10T09:36:01.233 INFO:tasks.workunit.client.0.smithi079.stdout:7/155: dwrite d4/dc/f21 [0,4194304] 0 2024-09-10T09:36:01.235 INFO:tasks.workunit.client.0.smithi079.stdout:3/229: rename d4/ce to d4/da/c44 0 2024-09-10T09:36:01.238 INFO:tasks.workunit.client.0.smithi079.stdout:2/168: read d4/f18 [2233692,114323] 0 2024-09-10T09:36:01.238 INFO:tasks.workunit.client.0.smithi079.stdout:1/229: dwrite d5/f19 [0,4194304] 0 2024-09-10T09:36:01.238 INFO:tasks.workunit.client.0.smithi079.stdout:6/243: dwrite d4/d8/dc/d1c/f32 [4194304,4194304] 0 2024-09-10T09:36:01.239 INFO:tasks.workunit.client.0.smithi079.stdout:6/244: stat l1 0 2024-09-10T09:36:01.239 INFO:tasks.workunit.client.0.smithi079.stdout:6/245: creat d4/d8/dd/d41/f54 x:0 0 0 2024-09-10T09:36:01.240 INFO:tasks.workunit.client.0.smithi079.stdout:7/156: creat d4/df/f26 x:0 0 0 2024-09-10T09:36:01.242 INFO:tasks.workunit.client.0.smithi079.stdout:5/179: dwrite d2/f6 [0,4194304] 0 2024-09-10T09:36:01.246 INFO:tasks.workunit.client.0.smithi079.stdout:3/230: write d4/fb [1421350,115074] 0 2024-09-10T09:36:01.251 INFO:tasks.workunit.client.0.smithi079.stdout:6/246: write d4/f40 [2971462,87400] 0 2024-09-10T09:36:01.251 INFO:tasks.workunit.client.0.smithi079.stdout:6/247: fsync d4/d35/d46/f3a 0 2024-09-10T09:36:01.252 INFO:tasks.workunit.client.0.smithi079.stdout:6/248: write d4/d8/dc/d1c/f15 [593023,98221] 0 2024-09-10T09:36:01.260 INFO:tasks.workunit.client.0.smithi079.stdout:1/230: mknod d5/df/d2e/c47 0 2024-09-10T09:36:01.260 INFO:tasks.workunit.client.0.smithi079.stdout:0/233: dwrite d4/d12/d21/f3d [0,4194304] 0 2024-09-10T09:36:01.260 INFO:tasks.workunit.client.0.smithi079.stdout:8/211: dwrite d11/d3b/f3c [0,4194304] 0 2024-09-10T09:36:01.261 INFO:tasks.workunit.client.0.smithi079.stdout:5/180: dwrite d2/f6 [0,4194304] 0 2024-09-10T09:36:01.262 INFO:tasks.workunit.client.0.smithi079.stdout:0/234: write d4/d12/d15/f44 [5010001,62250] 0 2024-09-10T09:36:01.263 INFO:tasks.workunit.client.0.smithi079.stdout:7/157: mknod d4/dc/c27 0 2024-09-10T09:36:01.263 INFO:tasks.workunit.client.0.smithi079.stdout:3/231: write d4/f12 [2272816,8749] 0 2024-09-10T09:36:01.265 INFO:tasks.workunit.client.0.smithi079.stdout:4/211: rename d1/da/c10 to d1/da/d16/d21/d32/d40/c42 0 2024-09-10T09:36:01.265 INFO:tasks.workunit.client.0.smithi079.stdout:4/212: write d1/da/f2b [597619,94253] 0 2024-09-10T09:36:01.267 INFO:tasks.workunit.client.0.smithi079.stdout:3/232: dread d4/da/d18/f1f [0,4194304] 0 2024-09-10T09:36:01.267 INFO:tasks.workunit.client.0.smithi079.stdout:3/233: chown d4/da/c27 380247526 1 2024-09-10T09:36:01.271 INFO:tasks.workunit.client.0.smithi079.stdout:1/231: write d5/df/f34 [171641,118601] 0 2024-09-10T09:36:01.274 INFO:tasks.workunit.client.0.smithi079.stdout:8/212: creat d11/f45 x:0 0 0 2024-09-10T09:36:01.276 INFO:tasks.workunit.client.0.smithi079.stdout:0/235: dread d4/fd [0,4194304] 0 2024-09-10T09:36:01.277 INFO:tasks.workunit.client.0.smithi079.stdout:0/236: chown d4/d12/d15/l3c 226426 1 2024-09-10T09:36:01.282 INFO:tasks.workunit.client.0.smithi079.stdout:1/232: write d5/d40/f42 [686379,2329] 0 2024-09-10T09:36:01.282 INFO:tasks.workunit.client.0.smithi079.stdout:1/233: readlink d5/l2c 0 2024-09-10T09:36:01.285 INFO:tasks.workunit.client.0.smithi079.stdout:2/169: rename d4/dc/d29/d21/l24 to d4/dc/d29/d21/d30/d31/l37 0 2024-09-10T09:36:01.286 INFO:tasks.workunit.client.0.smithi079.stdout:4/213: getdents d1/da/d16 0 2024-09-10T09:36:01.289 INFO:tasks.workunit.client.0.smithi079.stdout:8/213: symlink d11/d3b/l46 0 2024-09-10T09:36:01.289 INFO:tasks.workunit.client.0.smithi079.stdout:8/214: creat d11/d2b/f47 x:0 0 0 2024-09-10T09:36:01.290 INFO:tasks.workunit.client.0.smithi079.stdout:0/237: mkdir d4/d12/d16/d53 0 2024-09-10T09:36:01.290 INFO:tasks.workunit.client.0.smithi079.stdout:0/238: creat d4/d12/d21/f54 x:0 0 0 2024-09-10T09:36:01.293 INFO:tasks.workunit.client.0.smithi079.stdout:4/214: mknod d1/da/d16/c43 0 2024-09-10T09:36:01.296 INFO:tasks.workunit.client.0.smithi079.stdout:1/234: read d5/df/f1c [1574028,71186] 0 2024-09-10T09:36:01.298 INFO:tasks.workunit.client.0.smithi079.stdout:8/215: mkdir d11/d48 0 2024-09-10T09:36:01.298 INFO:tasks.workunit.client.0.smithi079.stdout:8/216: chown d11/d3b/l46 338923 1 2024-09-10T09:36:01.299 INFO:tasks.workunit.client.0.smithi079.stdout:3/234: dwrite d4/da/d18/f1f [0,4194304] 0 2024-09-10T09:36:01.300 INFO:tasks.workunit.client.0.smithi079.stdout:3/235: fdatasync d4/da/d18/f1f 0 2024-09-10T09:36:01.301 INFO:tasks.workunit.client.0.smithi079.stdout:2/170: write d4/dc/d1c/f34 [2867412,111636] 0 2024-09-10T09:36:01.301 INFO:tasks.workunit.client.0.smithi079.stdout:7/158: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:36:01.301 INFO:tasks.workunit.client.0.smithi079.stdout:7/159: stat d4/dc 0 2024-09-10T09:36:01.301 INFO:tasks.workunit.client.0.smithi079.stdout:7/160: chown d4/l23 5176 1 2024-09-10T09:36:01.301 INFO:tasks.workunit.client.0.smithi079.stdout:7/161: write d4/df/f26 [545127,101331] 0 2024-09-10T09:36:01.301 INFO:tasks.workunit.client.0.smithi079.stdout:7/162: chown d4/c22 2 1 2024-09-10T09:36:01.301 INFO:tasks.workunit.client.0.smithi079.stdout:8/217: dread ff [0,4194304] 0 2024-09-10T09:36:01.305 INFO:tasks.workunit.client.0.smithi079.stdout:1/235: dread d5/df/d11/f2b [0,4194304] 0 2024-09-10T09:36:01.305 INFO:tasks.workunit.client.0.smithi079.stdout:5/181: dwrite d2/f3a [0,4194304] 0 2024-09-10T09:36:01.306 INFO:tasks.workunit.client.0.smithi079.stdout:7/163: mkdir d4/dc/d28 0 2024-09-10T09:36:01.306 INFO:tasks.workunit.client.0.smithi079.stdout:7/164: stat d4/df/d19/c1a 0 2024-09-10T09:36:01.306 INFO:tasks.workunit.client.0.smithi079.stdout:7/165: truncate d4/d6/f16 1020585 0 2024-09-10T09:36:01.316 INFO:tasks.workunit.client.0.smithi079.stdout:5/182: creat d2/d3/d27/f3e x:0 0 0 2024-09-10T09:36:01.320 INFO:tasks.workunit.client.0.smithi079.stdout:4/215: dwrite d1/f11 [4194304,4194304] 0 2024-09-10T09:36:01.320 INFO:tasks.workunit.client.0.smithi079.stdout:1/236: mkdir d5/d24/d36/d3a/d48 0 2024-09-10T09:36:01.320 INFO:tasks.workunit.client.0.smithi079.stdout:1/237: read - d5/d24/d36/d3a/f3d zero size 2024-09-10T09:36:01.320 INFO:tasks.workunit.client.0.smithi079.stdout:1/238: creat d5/df/d2e/f49 x:0 0 0 2024-09-10T09:36:01.323 INFO:tasks.workunit.client.0.smithi079.stdout:5/183: mknod d2/c3f 0 2024-09-10T09:36:01.323 INFO:tasks.workunit.client.0.smithi079.stdout:5/184: chown d2/d3/l35 51 1 2024-09-10T09:36:01.329 INFO:tasks.workunit.client.0.smithi079.stdout:1/239: read d5/df/d11/f2d [1518141,104159] 0 2024-09-10T09:36:01.332 INFO:tasks.workunit.client.0.smithi079.stdout:5/185: mknod d2/c40 0 2024-09-10T09:36:01.332 INFO:tasks.workunit.client.0.smithi079.stdout:5/186: chown d2/f1d 65485536 1 2024-09-10T09:36:01.333 INFO:tasks.workunit.client.0.smithi079.stdout:1/240: symlink d5/d40/d46/l4a 0 2024-09-10T09:36:01.334 INFO:tasks.workunit.client.0.smithi079.stdout:5/187: mkdir d2/d41 0 2024-09-10T09:36:01.334 INFO:tasks.workunit.client.0.smithi079.stdout:5/188: readlink d2/d3/l12 0 2024-09-10T09:36:01.334 INFO:tasks.workunit.client.0.smithi079.stdout:5/189: fsync d2/f3b 0 2024-09-10T09:36:01.335 INFO:tasks.workunit.client.0.smithi079.stdout:2/171: dwrite d4/dc/d1c/f28 [4194304,4194304] 0 2024-09-10T09:36:01.335 INFO:tasks.workunit.client.0.smithi079.stdout:7/166: write d4/dc/f21 [1227374,77162] 0 2024-09-10T09:36:01.335 INFO:tasks.workunit.client.0.smithi079.stdout:1/241: getdents d5/d24 0 2024-09-10T09:36:01.335 INFO:tasks.workunit.client.0.smithi079.stdout:1/242: readlink d5/df/d2e/l33 0 2024-09-10T09:36:01.335 INFO:tasks.workunit.client.0.smithi079.stdout:1/243: chown d5/d24/l2a 3481 1 2024-09-10T09:36:01.337 INFO:tasks.workunit.client.0.smithi079.stdout:7/167: rmdir d4 39 2024-09-10T09:36:01.338 INFO:tasks.workunit.client.0.smithi079.stdout:1/244: creat d5/d24/d36/d3a/f4b x:0 0 0 2024-09-10T09:36:01.339 INFO:tasks.workunit.client.0.smithi079.stdout:2/172: mkdir d4/dc/d29/d1b/d38 0 2024-09-10T09:36:01.339 INFO:tasks.workunit.client.0.smithi079.stdout:2/173: write d4/dc/d1c/f34 [5059530,128468] 0 2024-09-10T09:36:01.339 INFO:tasks.workunit.client.0.smithi079.stdout:3/236: dwrite d4/da/d17/d2d/f31 [0,4194304] 0 2024-09-10T09:36:01.339 INFO:tasks.workunit.client.0.smithi079.stdout:3/237: chown d4/da/l1d 5 1 2024-09-10T09:36:01.340 INFO:tasks.workunit.client.0.smithi079.stdout:7/168: symlink d4/dc/l29 0 2024-09-10T09:36:01.341 INFO:tasks.workunit.client.0.smithi079.stdout:2/174: readlink d4/dc/l11 0 2024-09-10T09:36:01.342 INFO:tasks.workunit.client.0.smithi079.stdout:8/218: dwrite d11/f19 [0,4194304] 0 2024-09-10T09:36:01.342 INFO:tasks.workunit.client.0.smithi079.stdout:1/245: dread d5/df/d2e/f39 [0,4194304] 0 2024-09-10T09:36:01.343 INFO:tasks.workunit.client.0.smithi079.stdout:5/190: write d2/f6 [690987,64816] 0 2024-09-10T09:36:01.345 INFO:tasks.workunit.client.0.smithi079.stdout:7/169: link d4/c9 d4/df/d19/c2a 0 2024-09-10T09:36:01.345 INFO:tasks.workunit.client.0.smithi079.stdout:7/170: write d4/df/f18 [2692188,71034] 0 2024-09-10T09:36:01.345 INFO:tasks.workunit.client.0.smithi079.stdout:7/171: creat d4/df/d19/f2b x:0 0 0 2024-09-10T09:36:01.349 INFO:tasks.workunit.client.0.smithi079.stdout:2/175: rename d4/dc/d29/d21/d30 to d4/dc/d29/d1b/d38/d39 0 2024-09-10T09:36:01.349 INFO:tasks.workunit.client.0.smithi079.stdout:2/176: truncate d4/dc/d13/f27 1340928 0 2024-09-10T09:36:01.349 INFO:tasks.workunit.client.0.smithi079.stdout:2/177: readlink d4/dc/d1c/l36 0 2024-09-10T09:36:01.356 INFO:tasks.workunit.client.0.smithi079.stdout:9/166: sync 2024-09-10T09:36:01.357 INFO:tasks.workunit.client.0.smithi079.stdout:7/172: mknod d4/dc/c2c 0 2024-09-10T09:36:01.360 INFO:tasks.workunit.client.0.smithi079.stdout:3/238: dwrite f2 [4194304,4194304] 0 2024-09-10T09:36:01.360 INFO:tasks.workunit.client.0.smithi079.stdout:3/239: dread - d4/da/d17/f37 zero size 2024-09-10T09:36:01.360 INFO:tasks.workunit.client.0.smithi079.stdout:3/240: creat d4/da/d17/d38/d3e/f45 x:0 0 0 2024-09-10T09:36:01.360 INFO:tasks.workunit.client.0.smithi079.stdout:3/241: write d4/f8 [1873882,6845] 0 2024-09-10T09:36:01.362 INFO:tasks.workunit.client.0.smithi079.stdout:8/219: rename d11/f25 to d11/d3b/f49 0 2024-09-10T09:36:01.362 INFO:tasks.workunit.client.0.smithi079.stdout:8/220: write fb [4775282,82098] 0 2024-09-10T09:36:01.362 INFO:tasks.workunit.client.0.smithi079.stdout:8/221: chown d11/f31 845 1 2024-09-10T09:36:01.362 INFO:tasks.workunit.client.0.smithi079.stdout:8/222: creat d11/d3b/f4a x:0 0 0 2024-09-10T09:36:01.362 INFO:tasks.workunit.client.0.smithi079.stdout:8/223: getdents d11/d48 0 2024-09-10T09:36:01.366 INFO:tasks.workunit.client.0.smithi079.stdout:2/178: rmdir d4/dc/d29/d1b 39 2024-09-10T09:36:01.366 INFO:tasks.workunit.client.0.smithi079.stdout:2/179: creat d4/dc/d13/f3a x:0 0 0 2024-09-10T09:36:01.366 INFO:tasks.workunit.client.0.smithi079.stdout:2/180: write d4/dc/d13/f3a [75132,24087] 0 2024-09-10T09:36:01.368 INFO:tasks.workunit.client.0.smithi079.stdout:7/173: rmdir d4/dc/d28 0 2024-09-10T09:36:01.368 INFO:tasks.workunit.client.0.smithi079.stdout:7/174: readlink d4/l13 0 2024-09-10T09:36:01.368 INFO:tasks.workunit.client.0.smithi079.stdout:7/175: chown d4/df/f26 3740 1 2024-09-10T09:36:01.368 INFO:tasks.workunit.client.0.smithi079.stdout:1/246: dwrite d5/df/f34 [0,4194304] 0 2024-09-10T09:36:01.370 INFO:tasks.workunit.client.0.smithi079.stdout:5/191: rename d2/d3/d27/f3e to d2/d3/f42 0 2024-09-10T09:36:01.370 INFO:tasks.workunit.client.0.smithi079.stdout:5/192: creat d2/d3/d27/f43 x:0 0 0 2024-09-10T09:36:01.374 INFO:tasks.workunit.client.0.smithi079.stdout:8/224: mkdir d11/d2b/d4b 0 2024-09-10T09:36:01.374 INFO:tasks.workunit.client.0.smithi079.stdout:8/225: truncate d11/f31 651601 0 2024-09-10T09:36:01.376 INFO:tasks.workunit.client.0.smithi079.stdout:9/167: dwrite d3/f11 [0,4194304] 0 2024-09-10T09:36:01.377 INFO:tasks.workunit.client.0.smithi079.stdout:2/181: creat d4/dc/d29/d1b/d38/d39/d31/f3b x:0 0 0 2024-09-10T09:36:01.378 INFO:tasks.workunit.client.0.smithi079.stdout:7/176: creat d4/d6/f2d x:0 0 0 2024-09-10T09:36:01.378 INFO:tasks.workunit.client.0.smithi079.stdout:7/177: chown d4/dc/f21 47933693 1 2024-09-10T09:36:01.378 INFO:tasks.workunit.client.0.smithi079.stdout:6/249: sync 2024-09-10T09:36:01.380 INFO:tasks.workunit.client.0.smithi079.stdout:1/247: link d5/df/d11/c18 d5/d24/d36/c4c 0 2024-09-10T09:36:01.381 INFO:tasks.workunit.client.0.smithi079.stdout:3/242: rename d4/da/f35 to d4/da/d18/f46 0 2024-09-10T09:36:01.381 INFO:tasks.workunit.client.0.smithi079.stdout:3/243: truncate d4/da/d17/d2d/f34 138408 0 2024-09-10T09:36:01.384 INFO:tasks.workunit.client.0.smithi079.stdout:8/226: link d11/f12 d11/d2b/f4c 0 2024-09-10T09:36:01.385 INFO:tasks.workunit.client.0.smithi079.stdout:8/227: chown d11/f14 32874794 1 2024-09-10T09:36:01.385 INFO:tasks.workunit.client.0.smithi079.stdout:6/250: symlink d4/d8/dc/d12/d29/l55 0 2024-09-10T09:36:01.388 INFO:tasks.workunit.client.0.smithi079.stdout:1/248: symlink d5/d24/d36/d3a/l4d 0 2024-09-10T09:36:01.390 INFO:tasks.workunit.client.0.smithi079.stdout:5/193: dwrite d2/f26 [0,4194304] 0 2024-09-10T09:36:01.390 INFO:tasks.workunit.client.0.smithi079.stdout:1/249: stat d5/df/d11/l30 0 2024-09-10T09:36:01.390 INFO:tasks.workunit.client.0.smithi079.stdout:1/250: chown d5/df/d2e/f39 803 1 2024-09-10T09:36:01.391 INFO:tasks.workunit.client.0.smithi079.stdout:3/244: dread d4/f7 [0,4194304] 0 2024-09-10T09:36:01.395 INFO:tasks.workunit.client.0.smithi079.stdout:3/245: creat d4/da/d18/f47 x:0 0 0 2024-09-10T09:36:01.395 INFO:tasks.workunit.client.0.smithi079.stdout:3/246: write d4/f2b [817180,116938] 0 2024-09-10T09:36:01.395 INFO:tasks.workunit.client.0.smithi079.stdout:3/247: write d4/fb [2289567,2658] 0 2024-09-10T09:36:01.398 INFO:tasks.workunit.client.0.smithi079.stdout:8/228: write d11/d2b/f4c [949571,17347] 0 2024-09-10T09:36:01.403 INFO:tasks.workunit.client.0.smithi079.stdout:8/229: mknod d11/d2b/d4b/c4d 0 2024-09-10T09:36:01.414 INFO:tasks.workunit.client.0.smithi079.stdout:3/248: write d4/da/d18/f46 [1371718,29007] 0 2024-09-10T09:36:01.414 INFO:tasks.workunit.client.0.smithi079.stdout:3/249: stat d4/da/d17/d2d/l3d 0 2024-09-10T09:36:01.415 INFO:tasks.workunit.client.0.smithi079.stdout:3/250: readlink d4/da/l1d 0 2024-09-10T09:36:01.416 INFO:tasks.workunit.client.0.smithi079.stdout:9/168: dwrite d3/d7/dc/de/f2c [0,4194304] 0 2024-09-10T09:36:01.416 INFO:tasks.workunit.client.0.smithi079.stdout:9/169: truncate d3/d7/dc/de/d17/f21 5201959 0 2024-09-10T09:36:01.417 INFO:tasks.workunit.client.0.smithi079.stdout:8/230: write d11/f43 [467913,21983] 0 2024-09-10T09:36:01.422 INFO:tasks.workunit.client.0.smithi079.stdout:3/251: rename d4/fb to d4/da/d18/f48 0 2024-09-10T09:36:01.424 INFO:tasks.workunit.client.0.smithi079.stdout:8/231: link d11/d3b/f3e d11/d2b/f4e 0 2024-09-10T09:36:01.424 INFO:tasks.workunit.client.0.smithi079.stdout:8/232: read - d11/d3b/f3e zero size 2024-09-10T09:36:01.424 INFO:tasks.workunit.client.0.smithi079.stdout:8/233: dread - d11/d3b/f3e zero size 2024-09-10T09:36:01.424 INFO:tasks.workunit.client.0.smithi079.stdout:8/234: dread - d11/d2b/f4e zero size 2024-09-10T09:36:01.424 INFO:tasks.workunit.client.0.smithi079.stdout:8/235: chown d11/d3b/f3e 2 1 2024-09-10T09:36:01.425 INFO:tasks.workunit.client.0.smithi079.stdout:8/236: chown d11/d3b 2 1 2024-09-10T09:36:01.425 INFO:tasks.workunit.client.0.smithi079.stdout:2/182: dwrite d4/dc/d29/f16 [4194304,4194304] 0 2024-09-10T09:36:01.428 INFO:tasks.workunit.client.0.smithi079.stdout:9/170: dread d3/d7/dc/de/f2c [0,4194304] 0 2024-09-10T09:36:01.430 INFO:tasks.workunit.client.0.smithi079.stdout:9/171: rmdir d3/d7/dc 39 2024-09-10T09:36:01.433 INFO:tasks.workunit.client.0.smithi079.stdout:9/172: unlink d3/d7/dc/c10 0 2024-09-10T09:36:01.436 INFO:tasks.workunit.client.0.smithi079.stdout:9/173: rename d3/d7/dc/de/d17/d12/d22 to d3/d7/dc/de/d17/d2f/d30 0 2024-09-10T09:36:01.438 INFO:tasks.workunit.client.0.smithi079.stdout:7/178: dwrite d4/d6/f16 [0,4194304] 0 2024-09-10T09:36:01.444 INFO:tasks.workunit.client.0.smithi079.stdout:5/194: dwrite d2/d3/fa [0,4194304] 0 2024-09-10T09:36:01.444 INFO:tasks.workunit.client.0.smithi079.stdout:5/195: chown d2/d3/c9 6 1 2024-09-10T09:36:01.448 INFO:tasks.workunit.client.0.smithi079.stdout:5/196: mkdir d2/d3/d27/d32/d44 0 2024-09-10T09:36:01.448 INFO:tasks.workunit.client.0.smithi079.stdout:1/251: dwrite d5/d24/d36/d3a/f3d [0,4194304] 0 2024-09-10T09:36:01.449 INFO:tasks.workunit.client.0.smithi079.stdout:6/251: dwrite d4/d8/dc/f24 [0,4194304] 0 2024-09-10T09:36:01.449 INFO:tasks.workunit.client.0.smithi079.stdout:6/252: creat d4/d8/dd/d41/f56 x:0 0 0 2024-09-10T09:36:01.450 INFO:tasks.workunit.client.0.smithi079.stdout:3/252: dwrite d4/da/d17/d2d/f31 [0,4194304] 0 2024-09-10T09:36:01.452 INFO:tasks.workunit.client.0.smithi079.stdout:5/197: creat d2/d41/f45 x:0 0 0 2024-09-10T09:36:01.452 INFO:tasks.workunit.client.0.smithi079.stdout:5/198: write d2/f37 [630561,25064] 0 2024-09-10T09:36:01.454 INFO:tasks.workunit.client.0.smithi079.stdout:1/252: mknod d5/d24/d36/d3a/d3c/c4e 0 2024-09-10T09:36:01.476 INFO:tasks.workunit.client.0.smithi079.stdout:9/174: dwrite d3/f11 [0,4194304] 0 2024-09-10T09:36:01.486 INFO:tasks.workunit.client.0.smithi079.stdout:6/253: read d4/d8/dd/f1b [1065058,100270] 0 2024-09-10T09:36:01.486 INFO:tasks.workunit.client.0.smithi079.stdout:6/254: chown d4/d8/dd/d41/f54 844350472 1 2024-09-10T09:36:01.486 INFO:tasks.workunit.client.0.smithi079.stdout:6/255: readlink d4/d8/dd/l28 0 2024-09-10T09:36:01.490 INFO:tasks.workunit.client.0.smithi079.stdout:5/199: dwrite d2/f26 [4194304,4194304] 0 2024-09-10T09:36:01.491 INFO:tasks.workunit.client.0.smithi079.stdout:1/253: mkdir d5/d4f 0 2024-09-10T09:36:01.493 INFO:tasks.workunit.client.0.smithi079.stdout:7/179: dwrite d4/dc/f17 [0,4194304] 0 2024-09-10T09:36:01.493 INFO:tasks.workunit.client.0.smithi079.stdout:7/180: creat d4/df/d19/f2e x:0 0 0 2024-09-10T09:36:01.494 INFO:tasks.workunit.client.0.smithi079.stdout:8/237: dwrite d11/f16 [0,4194304] 0 2024-09-10T09:36:01.497 INFO:tasks.workunit.client.0.smithi079.stdout:6/256: unlink d4/d8/dd/f27 0 2024-09-10T09:36:01.498 INFO:tasks.workunit.client.0.smithi079.stdout:2/183: truncate d4/dc/d13/f27 626308 0 2024-09-10T09:36:01.498 INFO:tasks.workunit.client.0.smithi079.stdout:2/184: readlink l2 0 2024-09-10T09:36:01.500 INFO:tasks.workunit.client.0.smithi079.stdout:6/257: dread d4/d8/dc/d1c/f15 [0,4194304] 0 2024-09-10T09:36:01.507 INFO:tasks.workunit.client.0.smithi079.stdout:9/175: dwrite d3/f16 [0,4194304] 0 2024-09-10T09:36:01.507 INFO:tasks.workunit.client.0.smithi079.stdout:9/176: dread - d3/d7/dc/f2e zero size 2024-09-10T09:36:01.513 INFO:tasks.workunit.client.0.smithi079.stdout:2/185: creat d4/dc/d29/d1b/d38/d39/f3c x:0 0 0 2024-09-10T09:36:01.518 INFO:tasks.workunit.client.0.smithi079.stdout:8/238: mknod d11/c4f 0 2024-09-10T09:36:01.518 INFO:tasks.workunit.client.0.smithi079.stdout:8/239: chown d11/d3b 155 1 2024-09-10T09:36:01.520 INFO:tasks.workunit.client.0.smithi079.stdout:8/240: dread ff [0,4194304] 0 2024-09-10T09:36:01.520 INFO:tasks.workunit.client.0.smithi079.stdout:8/241: write d11/f20 [4938673,35442] 0 2024-09-10T09:36:01.520 INFO:tasks.workunit.client.0.smithi079.stdout:2/186: creat d4/dc/d29/d1b/d38/f3d x:0 0 0 2024-09-10T09:36:01.526 INFO:tasks.workunit.client.0.smithi079.stdout:2/187: mknod d4/dc/c3e 0 2024-09-10T09:36:01.533 INFO:tasks.workunit.client.0.smithi079.stdout:4/216: sync 2024-09-10T09:36:01.533 INFO:tasks.workunit.client.0.smithi079.stdout:0/239: sync 2024-09-10T09:36:01.534 INFO:tasks.workunit.client.0.smithi079.stdout:1/254: dwrite d5/df/d11/f32 [0,4194304] 0 2024-09-10T09:36:01.534 INFO:tasks.workunit.client.0.smithi079.stdout:1/255: creat d5/d24/d36/d3a/f50 x:0 0 0 2024-09-10T09:36:01.535 INFO:tasks.workunit.client.0.smithi079.stdout:0/240: mknod d4/d12/d21/c55 0 2024-09-10T09:36:01.538 INFO:tasks.workunit.client.0.smithi079.stdout:7/181: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:36:01.539 INFO:tasks.workunit.client.0.smithi079.stdout:4/217: link d1/f2a d1/da/d16/d21/d32/f44 0 2024-09-10T09:36:01.540 INFO:tasks.workunit.client.0.smithi079.stdout:6/258: dwrite d4/d8/dc/d12/d29/f2f [0,4194304] 0 2024-09-10T09:36:01.540 INFO:tasks.workunit.client.0.smithi079.stdout:0/241: truncate d4/d12/d39/f48 405625 0 2024-09-10T09:36:01.541 INFO:tasks.workunit.client.0.smithi079.stdout:7/182: symlink d4/df/l2f 0 2024-09-10T09:36:01.542 INFO:tasks.workunit.client.0.smithi079.stdout:1/256: read d5/df/f34 [599231,10347] 0 2024-09-10T09:36:01.545 INFO:tasks.workunit.client.0.smithi079.stdout:8/242: dwrite d11/d3b/f3c [0,4194304] 0 2024-09-10T09:36:01.546 INFO:tasks.workunit.client.0.smithi079.stdout:0/242: mknod d4/d12/d16/c56 0 2024-09-10T09:36:01.546 INFO:tasks.workunit.client.0.smithi079.stdout:2/188: fsync d4/dc/d29/d1b/d38/d39/f3c 0 2024-09-10T09:36:01.547 INFO:tasks.workunit.client.0.smithi079.stdout:1/257: truncate d5/f20 494165 0 2024-09-10T09:36:01.547 INFO:tasks.workunit.client.0.smithi079.stdout:1/258: stat d5/l31 0 2024-09-10T09:36:01.550 INFO:tasks.workunit.client.0.smithi079.stdout:4/218: rename d1/f11 to d1/da/f45 0 2024-09-10T09:36:01.550 INFO:tasks.workunit.client.0.smithi079.stdout:4/219: write d1/da/d16/d21/d32/f44 [4906885,92628] 0 2024-09-10T09:36:01.552 INFO:tasks.workunit.client.0.smithi079.stdout:9/177: truncate d3/f16 784854 0 2024-09-10T09:36:01.554 INFO:tasks.workunit.client.0.smithi079.stdout:0/243: dread d4/f5 [0,4194304] 0 2024-09-10T09:36:01.555 INFO:tasks.workunit.client.0.smithi079.stdout:0/244: write d4/d12/d39/f46 [460159,76904] 0 2024-09-10T09:36:01.555 INFO:tasks.workunit.client.0.smithi079.stdout:0/245: chown d4/d12/d16/l41 1 1 2024-09-10T09:36:01.556 INFO:tasks.workunit.client.0.smithi079.stdout:1/259: creat d5/d24/d36/d3a/d48/f51 x:0 0 0 2024-09-10T09:36:01.560 INFO:tasks.workunit.client.0.smithi079.stdout:4/220: symlink d1/d38/l46 0 2024-09-10T09:36:01.561 INFO:tasks.workunit.client.0.smithi079.stdout:9/178: rename d3/d7/dc/de/d17/f1d to d3/d7/dc/de/d17/f31 0 2024-09-10T09:36:01.562 INFO:tasks.workunit.client.0.smithi079.stdout:2/189: getdents d4/dc/d29/d1b/d38 0 2024-09-10T09:36:01.562 INFO:tasks.workunit.client.0.smithi079.stdout:2/190: fsync d4/f2b 0 2024-09-10T09:36:01.563 INFO:tasks.workunit.client.0.smithi079.stdout:7/183: write d4/f5 [1507097,45548] 0 2024-09-10T09:36:01.563 INFO:tasks.workunit.client.0.smithi079.stdout:1/260: creat d5/df/f52 x:0 0 0 2024-09-10T09:36:01.564 INFO:tasks.workunit.client.0.smithi079.stdout:4/221: rename d1/da/d16/d21/d32/d40 to d1/da/d28/d47 0 2024-09-10T09:36:01.566 INFO:tasks.workunit.client.0.smithi079.stdout:2/191: dread d4/f2b [0,4194304] 0 2024-09-10T09:36:01.568 INFO:tasks.workunit.client.0.smithi079.stdout:6/259: write d4/d8/dc/d1c/f21 [2728782,47924] 0 2024-09-10T09:36:01.568 INFO:tasks.workunit.client.0.smithi079.stdout:7/184: unlink d4/df/f26 0 2024-09-10T09:36:01.568 INFO:tasks.workunit.client.0.smithi079.stdout:7/185: write d4/dc/f25 [4109487,8641] 0 2024-09-10T09:36:01.568 INFO:tasks.workunit.client.0.smithi079.stdout:7/186: read - d4/df/d19/f2e zero size 2024-09-10T09:36:01.568 INFO:tasks.workunit.client.0.smithi079.stdout:0/246: read d4/d12/d39/f48 [5642,80282] 0 2024-09-10T09:36:01.569 INFO:tasks.workunit.client.0.smithi079.stdout:9/179: rename d3/d7/dc/c1b to d3/d7/dc/de/c32 0 2024-09-10T09:36:01.571 INFO:tasks.workunit.client.0.smithi079.stdout:7/187: symlink d4/dc/l30 0 2024-09-10T09:36:01.574 INFO:tasks.workunit.client.0.smithi079.stdout:1/261: write d5/d24/d36/d3a/f3d [3003177,108666] 0 2024-09-10T09:36:01.574 INFO:tasks.workunit.client.0.smithi079.stdout:1/262: chown d5/df/d11/f1b 16203 1 2024-09-10T09:36:01.575 INFO:tasks.workunit.client.0.smithi079.stdout:6/260: dread f3 [0,4194304] 0 2024-09-10T09:36:01.575 INFO:tasks.workunit.client.0.smithi079.stdout:6/261: write d4/d8/dc/d1c/f3f [2232852,28781] 0 2024-09-10T09:36:01.575 INFO:tasks.workunit.client.0.smithi079.stdout:9/180: link d3/f11 d3/d7/dc/de/f33 0 2024-09-10T09:36:01.575 INFO:tasks.workunit.client.0.smithi079.stdout:4/222: symlink d1/da/d16/l48 0 2024-09-10T09:36:01.577 INFO:tasks.workunit.client.0.smithi079.stdout:7/188: mknod d4/c31 0 2024-09-10T09:36:01.579 INFO:tasks.workunit.client.0.smithi079.stdout:8/243: dwrite d11/d3b/f3c [0,4194304] 0 2024-09-10T09:36:01.579 INFO:tasks.workunit.client.0.smithi079.stdout:8/244: write d11/f32 [831839,41490] 0 2024-09-10T09:36:01.579 INFO:tasks.workunit.client.0.smithi079.stdout:8/245: chown d11/c1f 61498 1 2024-09-10T09:36:01.580 INFO:tasks.workunit.client.0.smithi079.stdout:2/192: rename d4/f5 to d4/dc/d29/f3f 0 2024-09-10T09:36:01.580 INFO:tasks.workunit.client.0.smithi079.stdout:2/193: chown d4/dc/f14 103520 1 2024-09-10T09:36:01.580 INFO:tasks.workunit.client.0.smithi079.stdout:2/194: chown d4/dc/d29/ff 3343087 1 2024-09-10T09:36:01.580 INFO:tasks.workunit.client.0.smithi079.stdout:4/223: dread d1/da/f2b [0,4194304] 0 2024-09-10T09:36:01.581 INFO:tasks.workunit.client.0.smithi079.stdout:1/263: mkdir d5/d24/d36/d53 0 2024-09-10T09:36:01.587 INFO:tasks.workunit.client.0.smithi079.stdout:6/262: write d4/d8/fa [5318725,32018] 0 2024-09-10T09:36:01.587 INFO:tasks.workunit.client.0.smithi079.stdout:6/263: chown d4/d8/dc/d12/d29/c43 0 1 2024-09-10T09:36:01.591 INFO:tasks.workunit.client.0.smithi079.stdout:7/189: dwrite d4/df/d19/f24 [0,4194304] 0 2024-09-10T09:36:01.594 INFO:tasks.workunit.client.0.smithi079.stdout:8/246: mkdir d11/d2b/d4b/d50 0 2024-09-10T09:36:01.594 INFO:tasks.workunit.client.0.smithi079.stdout:8/247: readlink d11/l1c 0 2024-09-10T09:36:01.596 INFO:tasks.workunit.client.0.smithi079.stdout:0/247: rename d4/d1d/d24/c2f to d4/d12/d1a/c57 0 2024-09-10T09:36:01.599 INFO:tasks.workunit.client.0.smithi079.stdout:2/195: mknod d4/dc/d13/c40 0 2024-09-10T09:36:01.599 INFO:tasks.workunit.client.0.smithi079.stdout:2/196: chown d4/dc/d13 13 1 2024-09-10T09:36:01.599 INFO:tasks.workunit.client.0.smithi079.stdout:2/197: write d4/dc/d29/d1b/d38/f3d [75442,33043] 0 2024-09-10T09:36:01.600 INFO:tasks.workunit.client.0.smithi079.stdout:8/248: write d11/f28 [3061825,47956] 0 2024-09-10T09:36:01.606 INFO:tasks.workunit.client.0.smithi079.stdout:6/264: symlink d4/l57 0 2024-09-10T09:36:01.610 INFO:tasks.workunit.client.0.smithi079.stdout:7/190: dwrite d4/d6/f16 [4194304,4194304] 0 2024-09-10T09:36:01.610 INFO:tasks.workunit.client.0.smithi079.stdout:7/191: stat d4/df 0 2024-09-10T09:36:01.611 INFO:tasks.workunit.client.0.smithi079.stdout:9/181: rename c2 to d3/d7/c34 0 2024-09-10T09:36:01.612 INFO:tasks.workunit.client.0.smithi079.stdout:9/182: chown d3/d7/dc/de/f33 175689095 1 2024-09-10T09:36:01.613 INFO:tasks.workunit.client.0.smithi079.stdout:0/248: mknod d4/d12/d21/d3f/c58 0 2024-09-10T09:36:01.613 INFO:tasks.workunit.client.0.smithi079.stdout:0/249: write d4/d12/d1a/f51 [377618,72931] 0 2024-09-10T09:36:01.614 INFO:tasks.workunit.client.0.smithi079.stdout:2/198: symlink d4/dc/d13/l41 0 2024-09-10T09:36:01.616 INFO:tasks.workunit.client.0.smithi079.stdout:9/183: dread d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:01.617 INFO:tasks.workunit.client.0.smithi079.stdout:9/184: fdatasync d3/f11 0 2024-09-10T09:36:01.618 INFO:tasks.workunit.client.0.smithi079.stdout:4/224: mkdir d1/da/d16/d49 0 2024-09-10T09:36:01.620 INFO:tasks.workunit.client.0.smithi079.stdout:1/264: truncate d5/d24/d36/d3a/f3d 2912507 0 2024-09-10T09:36:01.620 INFO:tasks.workunit.client.0.smithi079.stdout:1/265: chown d5/d24/d36/d3a/d3c/c4e 333 1 2024-09-10T09:36:01.622 INFO:tasks.workunit.client.0.smithi079.stdout:6/265: mkdir d4/d35/d46/d58 0 2024-09-10T09:36:01.622 INFO:tasks.workunit.client.0.smithi079.stdout:0/250: dread d4/d12/d15/f44 [0,4194304] 0 2024-09-10T09:36:01.627 INFO:tasks.workunit.client.0.smithi079.stdout:7/192: creat d4/dc/f32 x:0 0 0 2024-09-10T09:36:01.629 INFO:tasks.workunit.client.0.smithi079.stdout:3/253: sync 2024-09-10T09:36:01.629 INFO:tasks.workunit.client.0.smithi079.stdout:5/200: sync 2024-09-10T09:36:01.630 INFO:tasks.workunit.client.0.smithi079.stdout:9/185: creat d3/d7/f35 x:0 0 0 2024-09-10T09:36:01.634 INFO:tasks.workunit.client.0.smithi079.stdout:8/249: rmdir d11 39 2024-09-10T09:36:01.634 INFO:tasks.workunit.client.0.smithi079.stdout:8/250: write d11/f1e [1753081,122030] 0 2024-09-10T09:36:01.635 INFO:tasks.workunit.client.0.smithi079.stdout:0/251: dread d4/fe [0,4194304] 0 2024-09-10T09:36:01.635 INFO:tasks.workunit.client.0.smithi079.stdout:0/252: stat d4/d12/d21 0 2024-09-10T09:36:01.638 INFO:tasks.workunit.client.0.smithi079.stdout:4/225: rename d1/da/d28/l41 to d1/l4a 0 2024-09-10T09:36:01.640 INFO:tasks.workunit.client.0.smithi079.stdout:1/266: creat d5/d24/d36/d3a/d3c/f54 x:0 0 0 2024-09-10T09:36:01.640 INFO:tasks.workunit.client.0.smithi079.stdout:1/267: readlink d5/lb 0 2024-09-10T09:36:01.640 INFO:tasks.workunit.client.0.smithi079.stdout:1/268: creat d5/df/f55 x:0 0 0 2024-09-10T09:36:01.640 INFO:tasks.workunit.client.0.smithi079.stdout:7/193: mknod d4/df/d19/c33 0 2024-09-10T09:36:01.644 INFO:tasks.workunit.client.0.smithi079.stdout:5/201: dread d2/f1d [0,4194304] 0 2024-09-10T09:36:01.645 INFO:tasks.workunit.client.0.smithi079.stdout:8/251: mkdir d11/d3b/d51 0 2024-09-10T09:36:01.645 INFO:tasks.workunit.client.0.smithi079.stdout:8/252: dread - d11/d2b/f4e zero size 2024-09-10T09:36:01.646 INFO:tasks.workunit.client.0.smithi079.stdout:4/226: symlink d1/da/d28/d47/l4b 0 2024-09-10T09:36:01.646 INFO:tasks.workunit.client.0.smithi079.stdout:4/227: fsync d1/da/f3f 0 2024-09-10T09:36:01.646 INFO:tasks.workunit.client.0.smithi079.stdout:4/228: write d1/f7 [851431,108043] 0 2024-09-10T09:36:01.646 INFO:tasks.workunit.client.0.smithi079.stdout:4/229: fdatasync d1/f2e 0 2024-09-10T09:36:01.648 INFO:tasks.workunit.client.0.smithi079.stdout:3/254: dread d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:01.648 INFO:tasks.workunit.client.0.smithi079.stdout:6/266: rename d4/d8/dc/d1c/f2a to d4/d35/f59 0 2024-09-10T09:36:01.648 INFO:tasks.workunit.client.0.smithi079.stdout:6/267: read - d4/d8/dd/d41/f54 zero size 2024-09-10T09:36:01.649 INFO:tasks.workunit.client.0.smithi079.stdout:6/268: chown d4/d8/dc/d1c/l42 351 1 2024-09-10T09:36:01.649 INFO:tasks.workunit.client.0.smithi079.stdout:6/269: chown d4/d35/d46/f3a 154192779 1 2024-09-10T09:36:01.649 INFO:tasks.workunit.client.0.smithi079.stdout:2/199: dwrite d4/dc/d29/ff [4194304,4194304] 0 2024-09-10T09:36:01.650 INFO:tasks.workunit.client.0.smithi079.stdout:9/186: dwrite d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:01.653 INFO:tasks.workunit.client.0.smithi079.stdout:6/270: truncate d4/d8/dc/d1c/f21 3850310 0 2024-09-10T09:36:01.653 INFO:tasks.workunit.client.0.smithi079.stdout:6/271: dread - d4/d35/d39/f49 zero size 2024-09-10T09:36:01.656 INFO:tasks.workunit.client.0.smithi079.stdout:5/202: rename d2/d3/d27/c34 to d2/d3/d27/d32/c46 0 2024-09-10T09:36:01.656 INFO:tasks.workunit.client.0.smithi079.stdout:5/203: dread - d2/f22 zero size 2024-09-10T09:36:01.656 INFO:tasks.workunit.client.0.smithi079.stdout:5/204: dread - d2/d3/d27/f2c zero size 2024-09-10T09:36:01.660 INFO:tasks.workunit.client.0.smithi079.stdout:9/187: creat d3/d7/dc/f36 x:0 0 0 2024-09-10T09:36:01.662 INFO:tasks.workunit.client.0.smithi079.stdout:8/253: mknod d11/c52 0 2024-09-10T09:36:01.663 INFO:tasks.workunit.client.0.smithi079.stdout:7/194: dwrite d4/df/d19/f2b [0,4194304] 0 2024-09-10T09:36:01.666 INFO:tasks.workunit.client.0.smithi079.stdout:6/272: creat d4/d8/dd/d41/d51/f5a x:0 0 0 2024-09-10T09:36:01.678 INFO:tasks.workunit.client.0.smithi079.stdout:2/200: mknod d4/c42 0 2024-09-10T09:36:01.680 INFO:tasks.workunit.client.0.smithi079.stdout:8/254: creat d11/d3b/d51/f53 x:0 0 0 2024-09-10T09:36:01.683 INFO:tasks.workunit.client.0.smithi079.stdout:4/230: dwrite d1/da/d16/d21/f25 [0,4194304] 0 2024-09-10T09:36:01.685 INFO:tasks.workunit.client.0.smithi079.stdout:2/201: dread d4/dc/d1c/f28 [0,4194304] 0 2024-09-10T09:36:01.688 INFO:tasks.workunit.client.0.smithi079.stdout:6/273: rename d4/d8/dc/d1c/f15 to d4/d8/dd/d41/d51/f5b 0 2024-09-10T09:36:01.690 INFO:tasks.workunit.client.0.smithi079.stdout:3/255: dwrite d4/f2a [0,4194304] 0 2024-09-10T09:36:01.690 INFO:tasks.workunit.client.0.smithi079.stdout:8/255: unlink d11/l37 0 2024-09-10T09:36:01.690 INFO:tasks.workunit.client.0.smithi079.stdout:8/256: chown d11/f17 9271012 1 2024-09-10T09:36:01.695 INFO:tasks.workunit.client.0.smithi079.stdout:2/202: creat d4/f43 x:0 0 0 2024-09-10T09:36:01.696 INFO:tasks.workunit.client.0.smithi079.stdout:6/274: truncate d4/d8/dd/d41/d51/f5b 1967442 0 2024-09-10T09:36:01.696 INFO:tasks.workunit.client.0.smithi079.stdout:6/275: truncate d4/d8/dd/f1b 4365946 0 2024-09-10T09:36:01.697 INFO:tasks.workunit.client.0.smithi079.stdout:3/256: mkdir d4/da/d17/d2d/d43/d49 0 2024-09-10T09:36:01.697 INFO:tasks.workunit.client.0.smithi079.stdout:3/257: chown d4/da/d18/c22 8156 1 2024-09-10T09:36:01.731 INFO:tasks.workunit.client.0.smithi079.stdout:5/205: dwrite d2/d3/fa [4194304,4194304] 0 2024-09-10T09:36:01.731 INFO:tasks.workunit.client.0.smithi079.stdout:5/206: chown d2/d3/d27/d32/d44 1 1 2024-09-10T09:36:01.732 INFO:tasks.workunit.client.0.smithi079.stdout:2/203: dread d4/f23 [0,4194304] 0 2024-09-10T09:36:01.734 INFO:tasks.workunit.client.0.smithi079.stdout:5/207: mkdir d2/d3/d27/d32/d39/d47 0 2024-09-10T09:36:01.735 INFO:tasks.workunit.client.0.smithi079.stdout:2/204: symlink d4/dc/d29/d1b/d38/d39/d31/l44 0 2024-09-10T09:36:01.737 INFO:tasks.workunit.client.0.smithi079.stdout:5/208: symlink d2/d3/d27/d32/l48 0 2024-09-10T09:36:01.737 INFO:tasks.workunit.client.0.smithi079.stdout:5/209: readlink d2/l1f 0 2024-09-10T09:36:01.737 INFO:tasks.workunit.client.0.smithi079.stdout:5/210: stat d2/d3/l30 0 2024-09-10T09:36:01.741 INFO:tasks.workunit.client.0.smithi079.stdout:2/205: rename d4/f43 to d4/dc/d29/d1b/d38/d39/f45 0 2024-09-10T09:36:01.741 INFO:tasks.workunit.client.0.smithi079.stdout:2/206: chown d4/f18 9123 1 2024-09-10T09:36:01.741 INFO:tasks.workunit.client.0.smithi079.stdout:9/188: dwrite d3/d7/dc/de/d17/f1f [4194304,4194304] 0 2024-09-10T09:36:01.741 INFO:tasks.workunit.client.0.smithi079.stdout:9/189: read d3/f14 [243523,88830] 0 2024-09-10T09:36:01.741 INFO:tasks.workunit.client.0.smithi079.stdout:9/190: dread - d3/d7/f35 zero size 2024-09-10T09:36:01.742 INFO:tasks.workunit.client.0.smithi079.stdout:7/195: dwrite d4/f1c [0,4194304] 0 2024-09-10T09:36:01.743 INFO:tasks.workunit.client.0.smithi079.stdout:2/207: link d4/f2b d4/dc/d29/d1b/d38/d39/d31/f46 0 2024-09-10T09:36:01.747 INFO:tasks.workunit.client.0.smithi079.stdout:9/191: truncate d3/d7/dc/de/d17/f31 4250081 0 2024-09-10T09:36:01.747 INFO:tasks.workunit.client.0.smithi079.stdout:8/257: dwrite d11/d2b/f40 [0,4194304] 0 2024-09-10T09:36:01.748 INFO:tasks.workunit.client.0.smithi079.stdout:6/276: dread d4/d8/dc/d1c/f1d [0,4194304] 0 2024-09-10T09:36:01.749 INFO:tasks.workunit.client.0.smithi079.stdout:4/231: dwrite d1/da/d16/d21/f2d [0,4194304] 0 2024-09-10T09:36:01.750 INFO:tasks.workunit.client.0.smithi079.stdout:3/258: dwrite d4/da/d17/f30 [0,4194304] 0 2024-09-10T09:36:01.751 INFO:tasks.workunit.client.0.smithi079.stdout:3/259: dread - d4/f40 zero size 2024-09-10T09:36:01.751 INFO:tasks.workunit.client.0.smithi079.stdout:3/260: dread - d4/da/d18/f47 zero size 2024-09-10T09:36:01.751 INFO:tasks.workunit.client.0.smithi079.stdout:2/208: truncate d4/f18 226717 0 2024-09-10T09:36:01.753 INFO:tasks.workunit.client.0.smithi079.stdout:9/192: rmdir d3/d7/dc/de/d17/d2f/d30 39 2024-09-10T09:36:01.757 INFO:tasks.workunit.client.0.smithi079.stdout:8/258: unlink d11/d2b/l35 0 2024-09-10T09:36:01.759 INFO:tasks.workunit.client.0.smithi079.stdout:9/193: dread d3/f14 [0,4194304] 0 2024-09-10T09:36:01.759 INFO:tasks.workunit.client.0.smithi079.stdout:9/194: write d3/d7/dc/f2e [1027083,95968] 0 2024-09-10T09:36:01.759 INFO:tasks.workunit.client.0.smithi079.stdout:9/195: creat d3/d7/dc/f37 x:0 0 0 2024-09-10T09:36:01.759 INFO:tasks.workunit.client.0.smithi079.stdout:4/232: creat d1/da/d28/d47/f4c x:0 0 0 2024-09-10T09:36:01.759 INFO:tasks.workunit.client.0.smithi079.stdout:2/209: write d4/fb [2845782,38902] 0 2024-09-10T09:36:01.759 INFO:tasks.workunit.client.0.smithi079.stdout:5/211: dwrite d2/d3/f42 [0,4194304] 0 2024-09-10T09:36:01.759 INFO:tasks.workunit.client.0.smithi079.stdout:5/212: creat d2/d3/d27/f49 x:0 0 0 2024-09-10T09:36:01.760 INFO:tasks.workunit.client.0.smithi079.stdout:2/210: dread d4/dc/d13/f3a [0,4194304] 0 2024-09-10T09:36:01.762 INFO:tasks.workunit.client.0.smithi079.stdout:7/196: rmdir d4/df 39 2024-09-10T09:36:01.762 INFO:tasks.workunit.client.0.smithi079.stdout:7/197: rename d4/d6 to d4/d6/d34 22 2024-09-10T09:36:01.767 INFO:tasks.workunit.client.0.smithi079.stdout:3/261: unlink d4/f8 0 2024-09-10T09:36:01.770 INFO:tasks.workunit.client.0.smithi079.stdout:8/259: mknod d11/d48/c54 0 2024-09-10T09:36:01.771 INFO:tasks.workunit.client.0.smithi079.stdout:9/196: getdents d3/d7/d26 0 2024-09-10T09:36:01.774 INFO:tasks.workunit.client.0.smithi079.stdout:4/233: rmdir d1/da/d28/d3d 0 2024-09-10T09:36:01.784 INFO:tasks.workunit.client.0.smithi079.stdout:5/213: dwrite d2/d3/d27/f49 [0,4194304] 0 2024-09-10T09:36:01.785 INFO:tasks.workunit.client.0.smithi079.stdout:8/260: read d11/f19 [3893391,97612] 0 2024-09-10T09:36:01.786 INFO:tasks.workunit.client.0.smithi079.stdout:8/261: write d11/d2b/f47 [928217,51898] 0 2024-09-10T09:36:01.786 INFO:tasks.workunit.client.0.smithi079.stdout:8/262: stat d11/d2b/f4e 0 2024-09-10T09:36:01.786 INFO:tasks.workunit.client.0.smithi079.stdout:8/263: readlink d11/l2f 0 2024-09-10T09:36:01.786 INFO:tasks.workunit.client.0.smithi079.stdout:3/262: dwrite f2 [4194304,4194304] 0 2024-09-10T09:36:01.788 INFO:tasks.workunit.client.0.smithi079.stdout:2/211: symlink d4/dc/d29/d1b/d38/d39/l47 0 2024-09-10T09:36:01.788 INFO:tasks.workunit.client.0.smithi079.stdout:2/212: truncate d4/dc/d29/d1b/d38/d39/d31/f3b 361040 0 2024-09-10T09:36:01.789 INFO:tasks.workunit.client.0.smithi079.stdout:2/213: readlink d4/dc/d13/l41 0 2024-09-10T09:36:01.789 INFO:tasks.workunit.client.0.smithi079.stdout:2/214: chown d4/dc/f14 3 1 2024-09-10T09:36:01.789 INFO:tasks.workunit.client.0.smithi079.stdout:2/215: truncate d4/dc/d29/d1b/d38/d39/d31/f3b 527748 0 2024-09-10T09:36:01.789 INFO:tasks.workunit.client.0.smithi079.stdout:8/264: dread d11/f12 [0,4194304] 0 2024-09-10T09:36:01.791 INFO:tasks.workunit.client.0.smithi079.stdout:9/197: creat d3/d7/dc/de/d17/d2f/f38 x:0 0 0 2024-09-10T09:36:01.796 INFO:tasks.workunit.client.0.smithi079.stdout:3/263: symlink d4/da/d17/d38/l4a 0 2024-09-10T09:36:01.799 INFO:tasks.workunit.client.0.smithi079.stdout:2/216: rmdir d4/dc/d29 39 2024-09-10T09:36:01.799 INFO:tasks.workunit.client.0.smithi079.stdout:2/217: chown d4/dc/f22 3 1 2024-09-10T09:36:01.799 INFO:tasks.workunit.client.0.smithi079.stdout:2/218: chown d4/dc/d29/d1b/d38/d39/d31/f3b 40858 1 2024-09-10T09:36:01.803 INFO:tasks.workunit.client.0.smithi079.stdout:7/198: rmdir d4/d6 39 2024-09-10T09:36:01.803 INFO:tasks.workunit.client.0.smithi079.stdout:7/199: chown c3 1077644444 1 2024-09-10T09:36:01.806 INFO:tasks.workunit.client.0.smithi079.stdout:9/198: symlink d3/d7/d26/l39 0 2024-09-10T09:36:01.806 INFO:tasks.workunit.client.0.smithi079.stdout:9/199: write d3/d7/dc/de/d17/d2f/d30/f23 [1089242,88579] 0 2024-09-10T09:36:01.806 INFO:tasks.workunit.client.0.smithi079.stdout:9/200: chown d3/d7/dc/de/l15 1 1 2024-09-10T09:36:01.807 INFO:tasks.workunit.client.0.smithi079.stdout:4/234: mkdir d1/da/d16/d4d 0 2024-09-10T09:36:01.810 INFO:tasks.workunit.client.0.smithi079.stdout:2/219: truncate d4/dc/d13/f27 121696 0 2024-09-10T09:36:01.810 INFO:tasks.workunit.client.0.smithi079.stdout:2/220: readlink d4/dc/d29/d1b/d38/d39/d31/l37 0 2024-09-10T09:36:01.814 INFO:tasks.workunit.client.0.smithi079.stdout:3/264: dwrite d4/da/d17/f37 [0,4194304] 0 2024-09-10T09:36:01.814 INFO:tasks.workunit.client.0.smithi079.stdout:7/200: mknod d4/dc/c35 0 2024-09-10T09:36:01.815 INFO:tasks.workunit.client.0.smithi079.stdout:0/253: sync 2024-09-10T09:36:01.815 INFO:tasks.workunit.client.0.smithi079.stdout:1/269: sync 2024-09-10T09:36:01.815 INFO:tasks.workunit.client.0.smithi079.stdout:0/254: chown d4/d12/d21/c50 33434387 1 2024-09-10T09:36:01.815 INFO:tasks.workunit.client.0.smithi079.stdout:1/270: readlink d5/l31 0 2024-09-10T09:36:01.815 INFO:tasks.workunit.client.0.smithi079.stdout:1/271: chown d5/d24/d36/d3a/f4b 64813 1 2024-09-10T09:36:01.815 INFO:tasks.workunit.client.0.smithi079.stdout:0/255: creat d4/d12/d1a/d29/f59 x:0 0 0 2024-09-10T09:36:01.815 INFO:tasks.workunit.client.0.smithi079.stdout:0/256: readlink d4/d1d/l30 0 2024-09-10T09:36:01.816 INFO:tasks.workunit.client.0.smithi079.stdout:9/201: creat d3/d7/dc/de/d17/d2f/d30/f3a x:0 0 0 2024-09-10T09:36:01.816 INFO:tasks.workunit.client.0.smithi079.stdout:9/202: write d3/d7/dc/f37 [544200,85216] 0 2024-09-10T09:36:01.816 INFO:tasks.workunit.client.0.smithi079.stdout:9/203: fdatasync d3/d7/f35 0 2024-09-10T09:36:01.816 INFO:tasks.workunit.client.0.smithi079.stdout:9/204: dread - d3/f2b zero size 2024-09-10T09:36:01.817 INFO:tasks.workunit.client.0.smithi079.stdout:4/235: truncate d1/da/f2b 509939 0 2024-09-10T09:36:01.819 INFO:tasks.workunit.client.0.smithi079.stdout:2/221: link d4/dc/d29/d1b/d38/d39/d31/l44 d4/dc/d29/d1b/d38/d39/l48 0 2024-09-10T09:36:01.820 INFO:tasks.workunit.client.0.smithi079.stdout:2/222: chown d4/dc/d29/d1b/d38/d39/d31/f3b 372922 1 2024-09-10T09:36:01.821 INFO:tasks.workunit.client.0.smithi079.stdout:8/265: rename d11/d3b/d51 to d11/d2b/d4b/d50/d55 0 2024-09-10T09:36:01.821 INFO:tasks.workunit.client.0.smithi079.stdout:5/214: getdents d2/d3/d27 0 2024-09-10T09:36:01.823 INFO:tasks.workunit.client.0.smithi079.stdout:1/272: dread d5/df/f1c [0,4194304] 0 2024-09-10T09:36:01.824 INFO:tasks.workunit.client.0.smithi079.stdout:1/273: chown d5/df/d2e/c47 29286458 1 2024-09-10T09:36:01.826 INFO:tasks.workunit.client.0.smithi079.stdout:3/265: link d4/da/d17/f37 d4/da/d17/d2d/d43/d49/f4b 0 2024-09-10T09:36:01.832 INFO:tasks.workunit.client.0.smithi079.stdout:0/257: unlink d4/d1d/d24/c33 0 2024-09-10T09:36:01.834 INFO:tasks.workunit.client.0.smithi079.stdout:4/236: symlink d1/da/d16/d21/l4e 0 2024-09-10T09:36:01.834 INFO:tasks.workunit.client.0.smithi079.stdout:1/274: write d5/df/d11/f1b [410914,42711] 0 2024-09-10T09:36:01.834 INFO:tasks.workunit.client.0.smithi079.stdout:1/275: truncate d5/df/d2e/f45 261412 0 2024-09-10T09:36:01.835 INFO:tasks.workunit.client.0.smithi079.stdout:4/237: write d1/f9 [1346597,30526] 0 2024-09-10T09:36:01.835 INFO:tasks.workunit.client.0.smithi079.stdout:4/238: stat d1/da/fb 0 2024-09-10T09:36:01.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/223: mkdir d4/dc/d29/d1b/d38/d39/d31/d49 0 2024-09-10T09:36:01.836 INFO:tasks.workunit.client.0.smithi079.stdout:7/201: dwrite d4/f5 [4194304,4194304] 0 2024-09-10T09:36:01.838 INFO:tasks.workunit.client.0.smithi079.stdout:0/258: write d4/d12/d21/f3d [373579,111461] 0 2024-09-10T09:36:01.838 INFO:tasks.workunit.client.0.smithi079.stdout:0/259: chown d4/d12/d1a/c57 147112840 1 2024-09-10T09:36:01.839 INFO:tasks.workunit.client.0.smithi079.stdout:5/215: creat d2/d3/d27/d32/d39/f4a x:0 0 0 2024-09-10T09:36:01.839 INFO:tasks.workunit.client.0.smithi079.stdout:5/216: dread - d2/f20 zero size 2024-09-10T09:36:01.842 INFO:tasks.workunit.client.0.smithi079.stdout:3/266: mkdir d4/da/d17/d2d/d43/d4c 0 2024-09-10T09:36:01.847 INFO:tasks.workunit.client.0.smithi079.stdout:8/266: rmdir d11/d2b/d4b/d50/d55 39 2024-09-10T09:36:01.848 INFO:tasks.workunit.client.0.smithi079.stdout:9/205: rmdir d3/d7/dc 39 2024-09-10T09:36:01.853 INFO:tasks.workunit.client.0.smithi079.stdout:2/224: creat d4/dc/d29/d21/f4a x:0 0 0 2024-09-10T09:36:01.857 INFO:tasks.workunit.client.0.smithi079.stdout:7/202: getdents d4/df 0 2024-09-10T09:36:01.862 INFO:tasks.workunit.client.0.smithi079.stdout:5/217: rmdir d2/d3/d27/d32/d39/d47 0 2024-09-10T09:36:01.862 INFO:tasks.workunit.client.0.smithi079.stdout:9/206: read d3/f16 [267872,31732] 0 2024-09-10T09:36:01.863 INFO:tasks.workunit.client.0.smithi079.stdout:8/267: creat d11/d2b/d4b/f56 x:0 0 0 2024-09-10T09:36:01.863 INFO:tasks.workunit.client.0.smithi079.stdout:8/268: stat d11/d2b/d4b/d50/d55/f53 0 2024-09-10T09:36:01.865 INFO:tasks.workunit.client.0.smithi079.stdout:2/225: truncate d4/fb 2974669 0 2024-09-10T09:36:01.866 INFO:tasks.workunit.client.0.smithi079.stdout:2/226: readlink d4/dc/d29/d1b/d38/d39/d31/l37 0 2024-09-10T09:36:01.866 INFO:tasks.workunit.client.0.smithi079.stdout:2/227: write d4/dc/d13/f3a [960485,101129] 0 2024-09-10T09:36:01.868 INFO:tasks.workunit.client.0.smithi079.stdout:8/269: truncate d11/f14 1137455 0 2024-09-10T09:36:01.869 INFO:tasks.workunit.client.0.smithi079.stdout:8/270: dread - d11/d3b/f4a zero size 2024-09-10T09:36:01.869 INFO:tasks.workunit.client.0.smithi079.stdout:8/271: fsync d11/f45 0 2024-09-10T09:36:01.870 INFO:tasks.workunit.client.0.smithi079.stdout:7/203: write d4/f5 [7963166,80218] 0 2024-09-10T09:36:01.871 INFO:tasks.workunit.client.0.smithi079.stdout:2/228: dread d4/dc/d29/d1b/d38/f3d [0,4194304] 0 2024-09-10T09:36:01.871 INFO:tasks.workunit.client.0.smithi079.stdout:1/276: dwrite d5/df/d11/f1b [4194304,4194304] 0 2024-09-10T09:36:01.873 INFO:tasks.workunit.client.0.smithi079.stdout:8/272: dread d11/f12 [4194304,4194304] 0 2024-09-10T09:36:01.875 INFO:tasks.workunit.client.0.smithi079.stdout:3/267: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:01.876 INFO:tasks.workunit.client.0.smithi079.stdout:0/260: dwrite d4/f10 [0,4194304] 0 2024-09-10T09:36:01.876 INFO:tasks.workunit.client.0.smithi079.stdout:7/204: rename d4/df/f1d to d4/dc/f36 0 2024-09-10T09:36:01.877 INFO:tasks.workunit.client.0.smithi079.stdout:4/239: write d1/da/d16/f1f [2433116,53503] 0 2024-09-10T09:36:01.878 INFO:tasks.workunit.client.0.smithi079.stdout:1/277: dread d5/f15 [0,4194304] 0 2024-09-10T09:36:01.878 INFO:tasks.workunit.client.0.smithi079.stdout:1/278: fdatasync d5/df/f55 0 2024-09-10T09:36:01.878 INFO:tasks.workunit.client.0.smithi079.stdout:1/279: chown d5/d24/d36/c4c 7058727 1 2024-09-10T09:36:01.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/229: link d4/c26 d4/dc/d29/d1b/d38/d39/d31/c4b 0 2024-09-10T09:36:01.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/230: creat d4/dc/d29/d1b/d38/d39/f4c x:0 0 0 2024-09-10T09:36:01.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/231: truncate d4/dc/d29/d21/f4a 448884 0 2024-09-10T09:36:01.879 INFO:tasks.workunit.client.0.smithi079.stdout:1/280: dread d5/f15 [0,4194304] 0 2024-09-10T09:36:01.879 INFO:tasks.workunit.client.0.smithi079.stdout:1/281: creat d5/d24/d36/d3a/d48/f56 x:0 0 0 2024-09-10T09:36:01.880 INFO:tasks.workunit.client.0.smithi079.stdout:8/273: truncate f8 1157596 0 2024-09-10T09:36:01.887 INFO:tasks.workunit.client.0.smithi079.stdout:0/261: mknod d4/d12/d16/c5a 0 2024-09-10T09:36:01.888 INFO:tasks.workunit.client.0.smithi079.stdout:3/268: write d4/da/d17/f21 [7200302,82624] 0 2024-09-10T09:36:01.890 INFO:tasks.workunit.client.0.smithi079.stdout:2/232: stat d4/c7 0 2024-09-10T09:36:01.891 INFO:tasks.workunit.client.0.smithi079.stdout:9/207: dwrite d3/d7/f35 [0,4194304] 0 2024-09-10T09:36:01.894 INFO:tasks.workunit.client.0.smithi079.stdout:1/282: mkdir d5/d24/d36/d3a/d3c/d57 0 2024-09-10T09:36:01.895 INFO:tasks.workunit.client.0.smithi079.stdout:5/218: dwrite d2/d3/fe [0,4194304] 0 2024-09-10T09:36:01.895 INFO:tasks.workunit.client.0.smithi079.stdout:9/208: dread d3/d7/dc/f2e [0,4194304] 0 2024-09-10T09:36:01.895 INFO:tasks.workunit.client.0.smithi079.stdout:5/219: truncate d2/f22 506694 0 2024-09-10T09:36:01.895 INFO:tasks.workunit.client.0.smithi079.stdout:5/220: fsync d2/f26 0 2024-09-10T09:36:01.895 INFO:tasks.workunit.client.0.smithi079.stdout:9/209: write d3/f16 [1382899,100654] 0 2024-09-10T09:36:01.901 INFO:tasks.workunit.client.0.smithi079.stdout:1/283: truncate d5/df/d11/f32 1269307 0 2024-09-10T09:36:01.902 INFO:tasks.workunit.client.0.smithi079.stdout:4/240: dwrite d1/da/d16/d21/d32/f44 [4194304,4194304] 0 2024-09-10T09:36:01.903 INFO:tasks.workunit.client.0.smithi079.stdout:3/269: write d4/da/d17/d2d/d43/d49/f4b [796376,48088] 0 2024-09-10T09:36:01.905 INFO:tasks.workunit.client.0.smithi079.stdout:7/205: dwrite d4/d6/f2d [0,4194304] 0 2024-09-10T09:36:01.908 INFO:tasks.workunit.client.0.smithi079.stdout:1/284: dread d5/d24/d36/d3a/f3d [0,4194304] 0 2024-09-10T09:36:01.908 INFO:tasks.workunit.client.0.smithi079.stdout:1/285: truncate d5/d24/d36/d3a/f4b 221944 0 2024-09-10T09:36:01.913 INFO:tasks.workunit.client.0.smithi079.stdout:5/221: write d2/f31 [672027,22053] 0 2024-09-10T09:36:01.917 INFO:tasks.workunit.client.0.smithi079.stdout:7/206: write d4/d6/f16 [2455689,24577] 0 2024-09-10T09:36:01.921 INFO:tasks.workunit.client.0.smithi079.stdout:9/210: truncate d3/d7/dc/de/d17/f21 3082852 0 2024-09-10T09:36:01.922 INFO:tasks.workunit.client.0.smithi079.stdout:0/262: rmdir d4/d12/d39 39 2024-09-10T09:36:01.922 INFO:tasks.workunit.client.0.smithi079.stdout:0/263: chown d4/d12/d39/f48 7133 1 2024-09-10T09:36:01.924 INFO:tasks.workunit.client.0.smithi079.stdout:2/233: mknod d4/dc/d29/d1b/c4d 0 2024-09-10T09:36:01.924 INFO:tasks.workunit.client.0.smithi079.stdout:2/234: chown d4/dc/d29/d1b/d38/d39/l47 67 1 2024-09-10T09:36:01.925 INFO:tasks.workunit.client.0.smithi079.stdout:2/235: readlink l0 0 2024-09-10T09:36:01.928 INFO:tasks.workunit.client.0.smithi079.stdout:3/270: dwrite d4/da/d18/f47 [0,4194304] 0 2024-09-10T09:36:01.928 INFO:tasks.workunit.client.0.smithi079.stdout:4/241: dwrite d1/da/d16/d21/f2d [0,4194304] 0 2024-09-10T09:36:01.928 INFO:tasks.workunit.client.0.smithi079.stdout:4/242: stat d1/da/d16/d21/f2d 0 2024-09-10T09:36:01.930 INFO:tasks.workunit.client.0.smithi079.stdout:1/286: mknod d5/d24/d36/d53/c58 0 2024-09-10T09:36:01.931 INFO:tasks.workunit.client.0.smithi079.stdout:5/222: link d2/d3/l35 d2/d3/d27/d32/d39/l4b 0 2024-09-10T09:36:01.933 INFO:tasks.workunit.client.0.smithi079.stdout:7/207: creat d4/f37 x:0 0 0 2024-09-10T09:36:01.933 INFO:tasks.workunit.client.0.smithi079.stdout:7/208: chown d4/df/d19/f2e 1252828 1 2024-09-10T09:36:01.936 INFO:tasks.workunit.client.0.smithi079.stdout:9/211: rename d3/d7/dc/de/d17/f31 to d3/d7/f3b 0 2024-09-10T09:36:01.936 INFO:tasks.workunit.client.0.smithi079.stdout:2/236: mknod d4/dc/d13/c4e 0 2024-09-10T09:36:01.939 INFO:tasks.workunit.client.0.smithi079.stdout:2/237: dread d4/dc/d13/f1f [0,4194304] 0 2024-09-10T09:36:01.939 INFO:tasks.workunit.client.0.smithi079.stdout:4/243: write d1/da/d16/f27 [4664589,70216] 0 2024-09-10T09:36:01.941 INFO:tasks.workunit.client.0.smithi079.stdout:6/277: sync 2024-09-10T09:36:01.947 INFO:tasks.workunit.client.0.smithi079.stdout:7/209: mkdir d4/d6/d38 0 2024-09-10T09:36:01.949 INFO:tasks.workunit.client.0.smithi079.stdout:6/278: write d4/d8/dc/d12/f30 [2544760,1739] 0 2024-09-10T09:36:01.950 INFO:tasks.workunit.client.0.smithi079.stdout:3/271: rename d4/da/d17/f33 to d4/f4d 0 2024-09-10T09:36:01.950 INFO:tasks.workunit.client.0.smithi079.stdout:3/272: write d4/da/d17/d2d/f34 [4861505,80168] 0 2024-09-10T09:36:01.953 INFO:tasks.workunit.client.0.smithi079.stdout:9/212: unlink d3/d7/dc/f2e 0 2024-09-10T09:36:01.954 INFO:tasks.workunit.client.0.smithi079.stdout:2/238: symlink d4/dc/d29/d1b/d38/d39/d31/d49/l4f 0 2024-09-10T09:36:01.957 INFO:tasks.workunit.client.0.smithi079.stdout:1/287: dwrite d5/df/f55 [0,4194304] 0 2024-09-10T09:36:01.962 INFO:tasks.workunit.client.0.smithi079.stdout:5/223: dwrite d2/f1b [0,4194304] 0 2024-09-10T09:36:01.962 INFO:tasks.workunit.client.0.smithi079.stdout:5/224: write d2/f6 [566963,57063] 0 2024-09-10T09:36:01.962 INFO:tasks.workunit.client.0.smithi079.stdout:5/225: stat d2/d3/d27 0 2024-09-10T09:36:01.964 INFO:tasks.workunit.client.0.smithi079.stdout:9/213: rename d3/d7/dc/de/d17/l2d to d3/d7/dc/de/d17/d12/l3c 0 2024-09-10T09:36:01.966 INFO:tasks.workunit.client.0.smithi079.stdout:2/239: read d4/dc/f22 [2552638,122388] 0 2024-09-10T09:36:01.967 INFO:tasks.workunit.client.0.smithi079.stdout:2/240: creat d4/dc/d29/d21/f50 x:0 0 0 2024-09-10T09:36:01.969 INFO:tasks.workunit.client.0.smithi079.stdout:1/288: write d5/df/f55 [1371790,56202] 0 2024-09-10T09:36:01.969 INFO:tasks.workunit.client.0.smithi079.stdout:9/214: dread d3/d7/dc/de/f2c [0,4194304] 0 2024-09-10T09:36:01.972 INFO:tasks.workunit.client.0.smithi079.stdout:6/279: dwrite d4/d8/dc/f37 [0,4194304] 0 2024-09-10T09:36:01.972 INFO:tasks.workunit.client.0.smithi079.stdout:6/280: write d4/d8/fa [4358673,73455] 0 2024-09-10T09:36:01.972 INFO:tasks.workunit.client.0.smithi079.stdout:6/281: creat d4/d8/dd/d41/d51/f5c x:0 0 0 2024-09-10T09:36:01.973 INFO:tasks.workunit.client.0.smithi079.stdout:3/273: write d4/da/d18/f47 [4287019,42995] 0 2024-09-10T09:36:01.976 INFO:tasks.workunit.client.0.smithi079.stdout:1/289: link d5/d24/d36/d53/c58 d5/d24/d36/c59 0 2024-09-10T09:36:01.978 INFO:tasks.workunit.client.0.smithi079.stdout:9/215: mkdir d3/d7/d26/d3d 0 2024-09-10T09:36:01.980 INFO:tasks.workunit.client.0.smithi079.stdout:7/210: truncate d4/d6/f16 1331253 0 2024-09-10T09:36:01.980 INFO:tasks.workunit.client.0.smithi079.stdout:7/211: dread - d4/dc/f32 zero size 2024-09-10T09:36:01.986 INFO:tasks.workunit.client.0.smithi079.stdout:6/282: creat d4/d8/f5d x:0 0 0 2024-09-10T09:36:01.986 INFO:tasks.workunit.client.0.smithi079.stdout:6/283: chown d4/d8/dd/d41/d51/f5c 193389279 1 2024-09-10T09:36:01.990 INFO:tasks.workunit.client.0.smithi079.stdout:9/216: symlink d3/l3e 0 2024-09-10T09:36:01.993 INFO:tasks.workunit.client.0.smithi079.stdout:5/226: dwrite d2/d3/f1a [4194304,4194304] 0 2024-09-10T09:36:01.995 INFO:tasks.workunit.client.0.smithi079.stdout:6/284: write d4/d8/fa [1996636,47984] 0 2024-09-10T09:36:01.995 INFO:tasks.workunit.client.0.smithi079.stdout:6/285: write d4/d8/dd/d41/f45 [464477,86533] 0 2024-09-10T09:36:02.052 INFO:tasks.workunit.client.0.smithi079.stdout:1/290: rmdir d5/d24/d36/d3a 39 2024-09-10T09:36:02.055 INFO:tasks.workunit.client.0.smithi079.stdout:9/217: symlink d3/d7/dc/de/d17/d2f/d30/l3f 0 2024-09-10T09:36:02.058 INFO:tasks.workunit.client.0.smithi079.stdout:6/286: rename d4/d8/dc/c16 to d4/d8/dd/d41/d51/c5e 0 2024-09-10T09:36:02.058 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:01 smithi135 ceph-mon[33411]: pgmap v255: 65 pgs: 65 active+clean; 463 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 28 MiB/s rd, 41 MiB/s wr, 743 op/s 2024-09-10T09:36:02.062 INFO:tasks.workunit.client.0.smithi079.stdout:1/291: unlink d5/l31 0 2024-09-10T09:36:02.063 INFO:tasks.workunit.client.0.smithi079.stdout:9/218: mkdir d3/d40 0 2024-09-10T09:36:02.064 INFO:tasks.workunit.client.0.smithi079.stdout:6/287: symlink d4/d8/dd/d41/l5f 0 2024-09-10T09:36:02.064 INFO:tasks.workunit.client.0.smithi079.stdout:6/288: read - d4/d8/dc/f4e zero size 2024-09-10T09:36:02.066 INFO:tasks.workunit.client.0.smithi079.stdout:9/219: creat d3/d7/dc/f41 x:0 0 0 2024-09-10T09:36:02.067 INFO:tasks.workunit.client.0.smithi079.stdout:3/274: dwrite d4/f7 [0,4194304] 0 2024-09-10T09:36:02.067 INFO:tasks.workunit.client.0.smithi079.stdout:2/241: dwrite d4/dc/d29/d1b/d38/d39/f45 [0,4194304] 0 2024-09-10T09:36:02.067 INFO:tasks.workunit.client.0.smithi079.stdout:2/242: creat d4/dc/d29/d21/f51 x:0 0 0 2024-09-10T09:36:02.068 INFO:tasks.workunit.client.0.smithi079.stdout:6/289: stat d4/d35/d46/c48 0 2024-09-10T09:36:02.070 INFO:tasks.workunit.client.0.smithi079.stdout:9/220: truncate d3/d7/f35 2855982 0 2024-09-10T09:36:02.076 INFO:tasks.workunit.client.0.smithi079.stdout:3/275: read d4/da/d17/f30 [3747324,87208] 0 2024-09-10T09:36:02.078 INFO:tasks.workunit.client.0.smithi079.stdout:2/243: mkdir d4/dc/d29/d1b/d38/d39/d31/d52 0 2024-09-10T09:36:02.078 INFO:tasks.workunit.client.0.smithi079.stdout:2/244: write d4/dc/f14 [4213079,108418] 0 2024-09-10T09:36:02.079 INFO:tasks.workunit.client.0.smithi079.stdout:2/245: stat d4/dc/d29/c25 0 2024-09-10T09:36:02.079 INFO:tasks.workunit.client.0.smithi079.stdout:1/292: dwrite d5/df/f55 [0,4194304] 0 2024-09-10T09:36:02.079 INFO:tasks.workunit.client.0.smithi079.stdout:6/290: symlink d4/d8/l60 0 2024-09-10T09:36:02.081 INFO:tasks.workunit.client.0.smithi079.stdout:5/227: dwrite d2/d3/f1a [0,4194304] 0 2024-09-10T09:36:02.084 INFO:tasks.workunit.client.0.smithi079.stdout:1/293: creat d5/d24/d36/f5a x:0 0 0 2024-09-10T09:36:02.084 INFO:tasks.workunit.client.0.smithi079.stdout:9/221: dread d3/f11 [0,4194304] 0 2024-09-10T09:36:02.085 INFO:tasks.workunit.client.0.smithi079.stdout:2/246: dread d4/dc/d29/d1b/d38/d39/d31/f46 [0,4194304] 0 2024-09-10T09:36:02.085 INFO:tasks.workunit.client.0.smithi079.stdout:2/247: write d4/f6 [1914803,125983] 0 2024-09-10T09:36:02.089 INFO:tasks.workunit.client.0.smithi079.stdout:6/291: read f2 [644558,51428] 0 2024-09-10T09:36:02.097 INFO:tasks.workunit.client.0.smithi079.stdout:1/294: unlink d5/d24/d36/d53/c58 0 2024-09-10T09:36:02.100 INFO:tasks.workunit.client.0.smithi079.stdout:9/222: creat d3/d7/d26/d3d/f42 x:0 0 0 2024-09-10T09:36:02.100 INFO:tasks.workunit.client.0.smithi079.stdout:9/223: dread - d3/d7/f2a zero size 2024-09-10T09:36:02.102 INFO:tasks.workunit.client.0.smithi079.stdout:2/248: rmdir d4/dc/d29/d1b/d38/d39/d31/d49 39 2024-09-10T09:36:02.105 INFO:tasks.workunit.client.0.smithi079.stdout:6/292: unlink d4/d8/dc/c34 0 2024-09-10T09:36:02.107 INFO:tasks.workunit.client.0.smithi079.stdout:1/295: mknod d5/d24/d36/d3a/d3c/c5b 0 2024-09-10T09:36:02.109 INFO:tasks.workunit.client.0.smithi079.stdout:9/224: symlink d3/d7/l43 0 2024-09-10T09:36:02.110 INFO:tasks.workunit.client.0.smithi079.stdout:3/276: dwrite d4/da/d18/f48 [0,4194304] 0 2024-09-10T09:36:02.111 INFO:tasks.workunit.client.0.smithi079.stdout:1/296: mknod d5/d24/d36/d3a/d3c/d57/c5c 0 2024-09-10T09:36:02.113 INFO:tasks.workunit.client.0.smithi079.stdout:9/225: symlink d3/d7/dc/de/d17/l44 0 2024-09-10T09:36:02.113 INFO:tasks.workunit.client.0.smithi079.stdout:9/226: write d3/d7/dc/de/d17/d2f/d30/f23 [4329754,6696] 0 2024-09-10T09:36:02.113 INFO:tasks.workunit.client.0.smithi079.stdout:9/227: chown d3/d7/dc/de/d17/l44 37307072 1 2024-09-10T09:36:02.114 INFO:tasks.workunit.client.0.smithi079.stdout:5/228: dwrite d2/d3/f1a [0,4194304] 0 2024-09-10T09:36:02.115 INFO:tasks.workunit.client.0.smithi079.stdout:3/277: truncate d4/da/d17/d2d/d43/d49/f4b 988427 0 2024-09-10T09:36:02.116 INFO:tasks.workunit.client.0.smithi079.stdout:8/274: sync 2024-09-10T09:36:02.118 INFO:tasks.workunit.client.0.smithi079.stdout:9/228: creat d3/d7/dc/de/d17/d2f/d30/f45 x:0 0 0 2024-09-10T09:36:02.118 INFO:tasks.workunit.client.0.smithi079.stdout:9/229: stat d3/d7/f35 0 2024-09-10T09:36:02.118 INFO:tasks.workunit.client.0.smithi079.stdout:9/230: truncate d3/d7/f35 3229894 0 2024-09-10T09:36:02.118 INFO:tasks.workunit.client.0.smithi079.stdout:9/231: chown c0 5359 1 2024-09-10T09:36:02.120 INFO:tasks.workunit.client.0.smithi079.stdout:3/278: mknod d4/da/c4e 0 2024-09-10T09:36:02.121 INFO:tasks.workunit.client.0.smithi079.stdout:1/297: rmdir d5/d40 39 2024-09-10T09:36:02.127 INFO:tasks.workunit.client.0.smithi079.stdout:5/229: write d2/f3a [3156638,81283] 0 2024-09-10T09:36:02.129 INFO:tasks.workunit.client.0.smithi079.stdout:0/264: sync 2024-09-10T09:36:02.129 INFO:tasks.workunit.client.0.smithi079.stdout:4/244: sync 2024-09-10T09:36:02.129 INFO:tasks.workunit.client.0.smithi079.stdout:0/265: fdatasync d4/f11 0 2024-09-10T09:36:02.129 INFO:tasks.workunit.client.0.smithi079.stdout:0/266: dread - d4/d12/d15/f28 zero size 2024-09-10T09:36:02.129 INFO:tasks.workunit.client.0.smithi079.stdout:7/212: sync 2024-09-10T09:36:02.130 INFO:tasks.workunit.client.0.smithi079.stdout:2/249: dwrite d4/dc/d29/f3f [4194304,4194304] 0 2024-09-10T09:36:02.130 INFO:tasks.workunit.client.0.smithi079.stdout:5/230: creat d2/d3/d27/d32/d44/f4c x:0 0 0 2024-09-10T09:36:02.130 INFO:tasks.workunit.client.0.smithi079.stdout:5/231: chown d2/d41/f45 847735047 1 2024-09-10T09:36:02.131 INFO:tasks.workunit.client.0.smithi079.stdout:6/293: dwrite d4/d35/d39/d4b/f4c [0,4194304] 0 2024-09-10T09:36:02.131 INFO:tasks.workunit.client.0.smithi079.stdout:6/294: chown d4/d35/d46/d58 422943483 1 2024-09-10T09:36:02.131 INFO:tasks.workunit.client.0.smithi079.stdout:6/295: truncate d4/d8/dc/d12/d29/f31 910353 0 2024-09-10T09:36:02.132 INFO:tasks.workunit.client.0.smithi079.stdout:4/245: symlink d1/da/d3b/l4f 0 2024-09-10T09:36:02.132 INFO:tasks.workunit.client.0.smithi079.stdout:7/213: symlink d4/df/l39 0 2024-09-10T09:36:02.138 INFO:tasks.workunit.client.0.smithi079.stdout:2/250: creat d4/dc/d29/d1b/d38/f53 x:0 0 0 2024-09-10T09:36:02.138 INFO:tasks.workunit.client.0.smithi079.stdout:2/251: truncate d4/dc/d13/f27 804094 0 2024-09-10T09:36:02.138 INFO:tasks.workunit.client.0.smithi079.stdout:2/252: fdatasync d4/dc/d29/f3f 0 2024-09-10T09:36:02.138 INFO:tasks.workunit.client.0.smithi079.stdout:3/279: dread d4/da/d17/f24 [0,4194304] 0 2024-09-10T09:36:02.138 INFO:tasks.workunit.client.0.smithi079.stdout:3/280: write d4/da/d17/f3f [528296,113866] 0 2024-09-10T09:36:02.140 INFO:tasks.workunit.client.0.smithi079.stdout:5/232: mkdir d2/d41/d4d 0 2024-09-10T09:36:02.145 INFO:tasks.workunit.client.0.smithi079.stdout:7/214: write d4/df/d19/f24 [3964705,70315] 0 2024-09-10T09:36:02.145 INFO:tasks.workunit.client.0.smithi079.stdout:7/215: chown d4/l23 0 1 2024-09-10T09:36:02.145 INFO:tasks.workunit.client.0.smithi079.stdout:7/216: truncate d4/df/d19/f2e 529572 0 2024-09-10T09:36:02.146 INFO:tasks.workunit.client.0.smithi079.stdout:6/296: dread d4/d8/dc/d1c/f21 [0,4194304] 0 2024-09-10T09:36:02.146 INFO:tasks.workunit.client.0.smithi079.stdout:3/281: mknod d4/da/d17/c4f 0 2024-09-10T09:36:02.146 INFO:tasks.workunit.client.0.smithi079.stdout:3/282: chown d4/da 7 1 2024-09-10T09:36:02.151 INFO:tasks.workunit.client.0.smithi079.stdout:3/283: dread d4/f2b [0,4194304] 0 2024-09-10T09:36:02.151 INFO:tasks.workunit.client.0.smithi079.stdout:6/297: getdents d4/d35/d46 0 2024-09-10T09:36:02.151 INFO:tasks.workunit.client.0.smithi079.stdout:5/233: symlink d2/d3/d27/d32/d39/l4e 0 2024-09-10T09:36:02.159 INFO:tasks.workunit.client.0.smithi079.stdout:6/298: unlink d4/d8/dd/d41/d51/f5a 0 2024-09-10T09:36:02.159 INFO:tasks.workunit.client.0.smithi079.stdout:8/275: dwrite d11/f1e [0,4194304] 0 2024-09-10T09:36:02.160 INFO:tasks.workunit.client.0.smithi079.stdout:5/234: creat d2/d3/d27/d32/f4f x:0 0 0 2024-09-10T09:36:02.160 INFO:tasks.workunit.client.0.smithi079.stdout:5/235: chown d2/f26 1307576 1 2024-09-10T09:36:02.162 INFO:tasks.workunit.client.0.smithi079.stdout:9/232: dwrite d3/f11 [4194304,4194304] 0 2024-09-10T09:36:02.165 INFO:tasks.workunit.client.0.smithi079.stdout:6/299: symlink d4/d8/dd/d41/l61 0 2024-09-10T09:36:02.167 INFO:tasks.workunit.client.0.smithi079.stdout:5/236: dread d2/d3/fe [0,4194304] 0 2024-09-10T09:36:02.169 INFO:tasks.workunit.client.0.smithi079.stdout:8/276: rename d11/d3b/f3c to d11/d2b/d4b/d50/f57 0 2024-09-10T09:36:02.169 INFO:tasks.workunit.client.0.smithi079.stdout:3/284: write d4/da/d18/f48 [687,33827] 0 2024-09-10T09:36:02.169 INFO:tasks.workunit.client.0.smithi079.stdout:8/277: stat d11/d2b/d4b/d50 0 2024-09-10T09:36:02.173 INFO:tasks.workunit.client.0.smithi079.stdout:9/233: creat d3/d7/dc/de/f46 x:0 0 0 2024-09-10T09:36:02.173 INFO:tasks.workunit.client.0.smithi079.stdout:9/234: write d3/f2b [44519,76542] 0 2024-09-10T09:36:02.173 INFO:tasks.workunit.client.0.smithi079.stdout:9/235: chown d3/d7/dc/de 36 1 2024-09-10T09:36:02.175 INFO:tasks.workunit.client.0.smithi079.stdout:3/285: unlink d4/da/c44 0 2024-09-10T09:36:02.175 INFO:tasks.workunit.client.0.smithi079.stdout:5/237: dread d2/f26 [4194304,4194304] 0 2024-09-10T09:36:02.176 INFO:tasks.workunit.client.0.smithi079.stdout:8/278: symlink d11/d2b/l58 0 2024-09-10T09:36:02.176 INFO:tasks.workunit.client.0.smithi079.stdout:8/279: stat d11/l2f 0 2024-09-10T09:36:02.176 INFO:tasks.workunit.client.0.smithi079.stdout:8/280: dread - d11/d2b/d4b/d50/d55/f53 zero size 2024-09-10T09:36:02.176 INFO:tasks.workunit.client.0.smithi079.stdout:8/281: dread - d11/d2b/f2d zero size 2024-09-10T09:36:02.176 INFO:tasks.workunit.client.0.smithi079.stdout:8/282: write d11/f2a [966188,47772] 0 2024-09-10T09:36:02.176 INFO:tasks.workunit.client.0.smithi079.stdout:9/236: getdents d3/d7/dc/de/d17/d2f 0 2024-09-10T09:36:02.179 INFO:tasks.workunit.client.0.smithi079.stdout:8/283: mknod d11/c59 0 2024-09-10T09:36:02.181 INFO:tasks.workunit.client.0.smithi079.stdout:8/284: symlink d11/d3b/l5a 0 2024-09-10T09:36:02.182 INFO:tasks.workunit.client.0.smithi079.stdout:4/246: dwrite d1/da/d28/d47/f4c [0,4194304] 0 2024-09-10T09:36:02.182 INFO:tasks.workunit.client.0.smithi079.stdout:4/247: readlink d1/l2 0 2024-09-10T09:36:02.182 INFO:tasks.workunit.client.0.smithi079.stdout:5/238: dread d2/d3/f28 [0,4194304] 0 2024-09-10T09:36:02.183 INFO:tasks.workunit.client.0.smithi079.stdout:7/217: dwrite d4/dc/f17 [4194304,4194304] 0 2024-09-10T09:36:02.183 INFO:tasks.workunit.client.0.smithi079.stdout:7/218: creat d4/dc/f3a x:0 0 0 2024-09-10T09:36:02.183 INFO:tasks.workunit.client.0.smithi079.stdout:8/285: mknod d11/d2b/d4b/c5b 0 2024-09-10T09:36:02.183 INFO:tasks.workunit.client.0.smithi079.stdout:8/286: write d11/f17 [367794,130217] 0 2024-09-10T09:36:02.186 INFO:tasks.workunit.client.0.smithi079.stdout:0/267: dwrite d4/d12/d1a/fb [0,4194304] 0 2024-09-10T09:36:02.186 INFO:tasks.workunit.client.0.smithi079.stdout:0/268: truncate d4/d1d/f3a 878184 0 2024-09-10T09:36:02.189 INFO:tasks.workunit.client.0.smithi079.stdout:5/239: mknod d2/d3/c50 0 2024-09-10T09:36:02.189 INFO:tasks.workunit.client.0.smithi079.stdout:5/240: creat d2/d41/f51 x:0 0 0 2024-09-10T09:36:02.189 INFO:tasks.workunit.client.0.smithi079.stdout:5/241: readlink d2/d3/l29 0 2024-09-10T09:36:02.193 INFO:tasks.workunit.client.0.smithi079.stdout:3/286: dread d4/f12 [0,4194304] 0 2024-09-10T09:36:02.193 INFO:tasks.workunit.client.0.smithi079.stdout:3/287: truncate d4/da/d17/f3f 834540 0 2024-09-10T09:36:02.194 INFO:tasks.workunit.client.0.smithi079.stdout:7/219: unlink d4/df/d19/c33 0 2024-09-10T09:36:02.195 INFO:tasks.workunit.client.0.smithi079.stdout:8/287: rmdir d11/d3b 39 2024-09-10T09:36:02.202 INFO:tasks.workunit.client.0.smithi079.stdout:0/269: link d4/d12/d16/c56 d4/d12/d1a/d29/c5b 0 2024-09-10T09:36:02.205 INFO:tasks.workunit.client.0.smithi079.stdout:8/288: mkdir d11/d2b/d4b/d50/d5c 0 2024-09-10T09:36:02.206 INFO:tasks.workunit.client.0.smithi079.stdout:0/270: mknod d4/d12/d21/c5c 0 2024-09-10T09:36:02.208 INFO:tasks.workunit.client.0.smithi079.stdout:7/220: write d4/df/d19/f2b [2233824,27040] 0 2024-09-10T09:36:02.208 INFO:tasks.workunit.client.0.smithi079.stdout:7/221: fdatasync d4/d6/f16 0 2024-09-10T09:36:02.208 INFO:tasks.workunit.client.0.smithi079.stdout:7/222: fdatasync d4/dc/f17 0 2024-09-10T09:36:02.208 INFO:tasks.workunit.client.0.smithi079.stdout:8/289: unlink d11/d3b/f4a 0 2024-09-10T09:36:02.211 INFO:tasks.workunit.client.0.smithi079.stdout:0/271: mknod d4/d12/d39/c5d 0 2024-09-10T09:36:02.211 INFO:tasks.workunit.client.0.smithi079.stdout:8/290: write d11/d2b/f47 [528605,40114] 0 2024-09-10T09:36:02.211 INFO:tasks.workunit.client.0.smithi079.stdout:8/291: write d11/d2b/f41 [973576,118342] 0 2024-09-10T09:36:02.211 INFO:tasks.workunit.client.0.smithi079.stdout:8/292: readlink d11/d2b/l44 0 2024-09-10T09:36:02.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:01 smithi079 ceph-mon[27592]: pgmap v255: 65 pgs: 65 active+clean; 463 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 28 MiB/s rd, 41 MiB/s wr, 743 op/s 2024-09-10T09:36:02.212 INFO:tasks.workunit.client.0.smithi079.stdout:7/223: rename d4/c22 to d4/df/d19/c3b 0 2024-09-10T09:36:02.215 INFO:tasks.workunit.client.0.smithi079.stdout:4/248: dwrite d1/f2e [0,4194304] 0 2024-09-10T09:36:02.215 INFO:tasks.workunit.client.0.smithi079.stdout:4/249: readlink d1/da/d16/l48 0 2024-09-10T09:36:02.215 INFO:tasks.workunit.client.0.smithi079.stdout:4/250: truncate d1/da/f3f 1028308 0 2024-09-10T09:36:02.215 INFO:tasks.workunit.client.0.smithi079.stdout:8/293: mknod d11/d48/c5d 0 2024-09-10T09:36:02.215 INFO:tasks.workunit.client.0.smithi079.stdout:8/294: stat d11/f14 0 2024-09-10T09:36:02.220 INFO:tasks.workunit.client.0.smithi079.stdout:4/251: truncate d1/da/d16/f30 966319 0 2024-09-10T09:36:02.220 INFO:tasks.workunit.client.0.smithi079.stdout:3/288: dwrite d4/da/d18/f46 [0,4194304] 0 2024-09-10T09:36:02.221 INFO:tasks.workunit.client.0.smithi079.stdout:9/237: dwrite d3/d7/dc/de/d17/d2f/d30/f23 [0,4194304] 0 2024-09-10T09:36:02.221 INFO:tasks.workunit.client.0.smithi079.stdout:5/242: dwrite d2/d41/f51 [0,4194304] 0 2024-09-10T09:36:02.221 INFO:tasks.workunit.client.0.smithi079.stdout:5/243: creat d2/d3/d27/d32/f52 x:0 0 0 2024-09-10T09:36:02.224 INFO:tasks.workunit.client.0.smithi079.stdout:8/295: symlink d11/d3b/l5e 0 2024-09-10T09:36:02.224 INFO:tasks.workunit.client.0.smithi079.stdout:8/296: chown d11/d2b/f47 1509872 1 2024-09-10T09:36:02.224 INFO:tasks.workunit.client.0.smithi079.stdout:7/224: dread d4/dc/f36 [0,4194304] 0 2024-09-10T09:36:02.225 INFO:tasks.workunit.client.0.smithi079.stdout:4/252: mknod d1/da/d28/d47/c50 0 2024-09-10T09:36:02.227 INFO:tasks.workunit.client.0.smithi079.stdout:3/289: mknod d4/da/d17/d2d/d43/d4c/c50 0 2024-09-10T09:36:02.228 INFO:tasks.workunit.client.0.smithi079.stdout:3/290: write d4/f4d [43401,66511] 0 2024-09-10T09:36:02.229 INFO:tasks.workunit.client.0.smithi079.stdout:8/297: dread d11/f19 [0,4194304] 0 2024-09-10T09:36:02.231 INFO:tasks.workunit.client.0.smithi079.stdout:0/272: dwrite d4/d12/f14 [0,4194304] 0 2024-09-10T09:36:02.232 INFO:tasks.workunit.client.0.smithi079.stdout:9/238: truncate d3/f16 765118 0 2024-09-10T09:36:02.234 INFO:tasks.workunit.client.0.smithi079.stdout:5/244: mknod d2/d41/c53 0 2024-09-10T09:36:02.239 INFO:tasks.workunit.client.0.smithi079.stdout:7/225: mknod d4/dc/c3c 0 2024-09-10T09:36:02.240 INFO:tasks.workunit.client.0.smithi079.stdout:4/253: symlink d1/da/d16/d49/l51 0 2024-09-10T09:36:02.242 INFO:tasks.workunit.client.0.smithi079.stdout:9/239: dread d3/d7/dc/de/f33 [4194304,4194304] 0 2024-09-10T09:36:02.242 INFO:tasks.workunit.client.0.smithi079.stdout:3/291: rename d4/da/d17/c4f to d4/da/d17/c51 0 2024-09-10T09:36:02.245 INFO:tasks.workunit.client.0.smithi079.stdout:8/298: dwrite d11/d2b/d4b/d50/d55/f53 [0,4194304] 0 2024-09-10T09:36:02.245 INFO:tasks.workunit.client.0.smithi079.stdout:8/299: fdatasync d11/f14 0 2024-09-10T09:36:02.245 INFO:tasks.workunit.client.0.smithi079.stdout:8/300: chown d11/d2b/d4b/c4d 45433 1 2024-09-10T09:36:02.246 INFO:tasks.workunit.client.0.smithi079.stdout:0/273: mknod d4/d12/d16/d53/c5e 0 2024-09-10T09:36:02.249 INFO:tasks.workunit.client.0.smithi079.stdout:7/226: dread d4/f5 [0,4194304] 0 2024-09-10T09:36:02.256 INFO:tasks.workunit.client.0.smithi079.stdout:3/292: dwrite d4/da/d18/f47 [0,4194304] 0 2024-09-10T09:36:02.257 INFO:tasks.workunit.client.0.smithi079.stdout:3/293: creat d4/da/d17/f52 x:0 0 0 2024-09-10T09:36:02.258 INFO:tasks.workunit.client.0.smithi079.stdout:4/254: write d1/da/d16/f24 [611451,115037] 0 2024-09-10T09:36:02.258 INFO:tasks.workunit.client.0.smithi079.stdout:4/255: write d1/f2a [8780790,65942] 0 2024-09-10T09:36:02.259 INFO:tasks.workunit.client.0.smithi079.stdout:9/240: creat d3/d40/f47 x:0 0 0 2024-09-10T09:36:02.260 INFO:tasks.workunit.client.0.smithi079.stdout:9/241: write d3/d7/dc/f36 [1016231,48758] 0 2024-09-10T09:36:02.263 INFO:tasks.workunit.client.0.smithi079.stdout:8/301: mknod d11/d2b/d4b/d50/d55/c5f 0 2024-09-10T09:36:02.264 INFO:tasks.workunit.client.0.smithi079.stdout:8/302: chown d11/d2b/f40 2206 1 2024-09-10T09:36:02.264 INFO:tasks.workunit.client.0.smithi079.stdout:8/303: truncate d11/f20 5680085 0 2024-09-10T09:36:02.264 INFO:tasks.workunit.client.0.smithi079.stdout:0/274: mknod d4/d12/c5f 0 2024-09-10T09:36:02.266 INFO:tasks.workunit.client.0.smithi079.stdout:7/227: mkdir d4/df/d3d 0 2024-09-10T09:36:02.276 INFO:tasks.workunit.client.0.smithi079.stdout:3/294: link d4/f29 d4/da/d17/d38/d42/f53 0 2024-09-10T09:36:02.276 INFO:tasks.workunit.client.0.smithi079.stdout:5/245: rmdir d2/d41 39 2024-09-10T09:36:02.276 INFO:tasks.workunit.client.0.smithi079.stdout:8/304: dread d11/f43 [0,4194304] 0 2024-09-10T09:36:02.276 INFO:tasks.workunit.client.0.smithi079.stdout:4/256: rmdir d1/d38 39 2024-09-10T09:36:02.278 INFO:tasks.workunit.client.0.smithi079.stdout:0/275: symlink d4/l60 0 2024-09-10T09:36:02.278 INFO:tasks.workunit.client.0.smithi079.stdout:0/276: fdatasync d4/d12/d1a/d29/f59 0 2024-09-10T09:36:02.278 INFO:tasks.workunit.client.0.smithi079.stdout:9/242: dwrite d3/f14 [4194304,4194304] 0 2024-09-10T09:36:02.279 INFO:tasks.workunit.client.0.smithi079.stdout:7/228: mkdir d4/d6/d3e 0 2024-09-10T09:36:02.282 INFO:tasks.workunit.client.0.smithi079.stdout:5/246: symlink d2/d3/l54 0 2024-09-10T09:36:02.283 INFO:tasks.workunit.client.0.smithi079.stdout:8/305: creat d11/d48/f60 x:0 0 0 2024-09-10T09:36:02.284 INFO:tasks.workunit.client.0.smithi079.stdout:4/257: truncate d1/da/f45 5362083 0 2024-09-10T09:36:02.285 INFO:tasks.workunit.client.0.smithi079.stdout:0/277: creat d4/d1d/d24/f61 x:0 0 0 2024-09-10T09:36:02.288 INFO:tasks.workunit.client.0.smithi079.stdout:9/243: mknod d3/d7/d26/d3d/c48 0 2024-09-10T09:36:02.289 INFO:tasks.workunit.client.0.smithi079.stdout:7/229: creat d4/d6/d38/f3f x:0 0 0 2024-09-10T09:36:02.289 INFO:tasks.workunit.client.0.smithi079.stdout:7/230: dread - d4/f37 zero size 2024-09-10T09:36:02.293 INFO:tasks.workunit.client.0.smithi079.stdout:3/295: rename d4/da/d17/d38/d3e to d4/da/d17/d54 0 2024-09-10T09:36:02.295 INFO:tasks.workunit.client.0.smithi079.stdout:1/298: sync 2024-09-10T09:36:02.295 INFO:tasks.workunit.client.0.smithi079.stdout:1/299: chown d5/f14 1692912 1 2024-09-10T09:36:02.295 INFO:tasks.workunit.client.0.smithi079.stdout:5/247: getdents d2/d3/d27/d32/d39 0 2024-09-10T09:36:02.296 INFO:tasks.workunit.client.0.smithi079.stdout:7/231: write d4/dc/f36 [512303,96899] 0 2024-09-10T09:36:02.305 INFO:tasks.workunit.client.0.smithi079.stdout:8/306: rmdir d11/d2b 39 2024-09-10T09:36:02.306 INFO:tasks.workunit.client.0.smithi079.stdout:3/296: dread d4/da/d17/d38/d42/f53 [0,4194304] 0 2024-09-10T09:36:02.306 INFO:tasks.workunit.client.0.smithi079.stdout:3/297: creat d4/da/d18/f55 x:0 0 0 2024-09-10T09:36:02.308 INFO:tasks.workunit.client.0.smithi079.stdout:7/232: rename d4/df/f18 to d4/df/d3d/f40 0 2024-09-10T09:36:02.308 INFO:tasks.workunit.client.0.smithi079.stdout:7/233: chown d4/df/l39 1539005 1 2024-09-10T09:36:02.311 INFO:tasks.workunit.client.0.smithi079.stdout:8/307: mkdir d11/d48/d61 0 2024-09-10T09:36:02.312 INFO:tasks.workunit.client.0.smithi079.stdout:6/300: sync 2024-09-10T09:36:02.312 INFO:tasks.workunit.client.0.smithi079.stdout:2/253: sync 2024-09-10T09:36:02.312 INFO:tasks.workunit.client.0.smithi079.stdout:6/301: stat d4/d35/d46/d58 0 2024-09-10T09:36:02.314 INFO:tasks.workunit.client.0.smithi079.stdout:3/298: unlink d4/da/d17/d2d/d43/d49/f4b 0 2024-09-10T09:36:02.317 INFO:tasks.workunit.client.0.smithi079.stdout:7/234: creat d4/df/d3d/f41 x:0 0 0 2024-09-10T09:36:02.318 INFO:tasks.workunit.client.0.smithi079.stdout:8/308: creat d11/d2b/d4b/f62 x:0 0 0 2024-09-10T09:36:02.319 INFO:tasks.workunit.client.0.smithi079.stdout:3/299: truncate d4/f29 323431 0 2024-09-10T09:36:02.319 INFO:tasks.workunit.client.0.smithi079.stdout:3/300: readlink d4/da/d18/l36 0 2024-09-10T09:36:02.320 INFO:tasks.workunit.client.0.smithi079.stdout:6/302: write d4/d35/d39/d4b/f4c [935566,44111] 0 2024-09-10T09:36:02.320 INFO:tasks.workunit.client.0.smithi079.stdout:1/300: rename d5/d24/d36/d3a/l4d to d5/d24/d36/l5d 0 2024-09-10T09:36:02.321 INFO:tasks.workunit.client.0.smithi079.stdout:8/309: symlink d11/d2b/l63 0 2024-09-10T09:36:02.323 INFO:tasks.workunit.client.0.smithi079.stdout:3/301: mkdir d4/da/d56 0 2024-09-10T09:36:02.323 INFO:tasks.workunit.client.0.smithi079.stdout:3/302: fsync d4/da/d18/f47 0 2024-09-10T09:36:02.323 INFO:tasks.workunit.client.0.smithi079.stdout:3/303: fsync d4/da/d18/f46 0 2024-09-10T09:36:02.324 INFO:tasks.workunit.client.0.smithi079.stdout:0/278: dwrite d4/d12/d21/f43 [0,4194304] 0 2024-09-10T09:36:02.325 INFO:tasks.workunit.client.0.smithi079.stdout:6/303: unlink d4/d8/dc/f24 0 2024-09-10T09:36:02.326 INFO:tasks.workunit.client.0.smithi079.stdout:2/254: rename d4/dc/d29/d21/f50 to d4/dc/d1c/f54 0 2024-09-10T09:36:02.327 INFO:tasks.workunit.client.0.smithi079.stdout:1/301: unlink d5/f14 0 2024-09-10T09:36:02.327 INFO:tasks.workunit.client.0.smithi079.stdout:1/302: fsync d5/d24/f2f 0 2024-09-10T09:36:02.327 INFO:tasks.workunit.client.0.smithi079.stdout:1/303: stat d5/d24 0 2024-09-10T09:36:02.327 INFO:tasks.workunit.client.0.smithi079.stdout:1/304: truncate d5/df/d2e/f39 928868 0 2024-09-10T09:36:02.329 INFO:tasks.workunit.client.0.smithi079.stdout:4/258: dwrite d1/da/f36 [0,4194304] 0 2024-09-10T09:36:02.329 INFO:tasks.workunit.client.0.smithi079.stdout:9/244: dwrite d3/d7/dc/de/f2c [0,4194304] 0 2024-09-10T09:36:02.329 INFO:tasks.workunit.client.0.smithi079.stdout:8/310: creat d11/d3b/f64 x:0 0 0 2024-09-10T09:36:02.329 INFO:tasks.workunit.client.0.smithi079.stdout:8/311: read d11/f17 [3992240,1513] 0 2024-09-10T09:36:02.331 INFO:tasks.workunit.client.0.smithi079.stdout:1/305: read d5/f20 [504419,8587] 0 2024-09-10T09:36:02.331 INFO:tasks.workunit.client.0.smithi079.stdout:5/248: dwrite d2/f20 [0,4194304] 0 2024-09-10T09:36:02.331 INFO:tasks.workunit.client.0.smithi079.stdout:7/235: write d4/dc/f17 [416167,108271] 0 2024-09-10T09:36:02.331 INFO:tasks.workunit.client.0.smithi079.stdout:5/249: write d2/f15 [1157937,63442] 0 2024-09-10T09:36:02.331 INFO:tasks.workunit.client.0.smithi079.stdout:7/236: chown d4/df/d19/f2b 354075677 1 2024-09-10T09:36:02.331 INFO:tasks.workunit.client.0.smithi079.stdout:5/250: readlink d2/d3/l30 0 2024-09-10T09:36:02.334 INFO:tasks.workunit.client.0.smithi079.stdout:0/279: rename d4/d12/c5f to d4/d12/d16/c62 0 2024-09-10T09:36:02.334 INFO:tasks.workunit.client.0.smithi079.stdout:0/280: creat d4/d12/d15/d2b/f63 x:0 0 0 2024-09-10T09:36:02.334 INFO:tasks.workunit.client.0.smithi079.stdout:0/281: fsync d4/d12/f40 0 2024-09-10T09:36:02.335 INFO:tasks.workunit.client.0.smithi079.stdout:2/255: creat d4/dc/d29/f55 x:0 0 0 2024-09-10T09:36:02.337 INFO:tasks.workunit.client.0.smithi079.stdout:6/304: dread d4/d8/dc/d1c/f32 [0,4194304] 0 2024-09-10T09:36:02.338 INFO:tasks.workunit.client.0.smithi079.stdout:8/312: write fe [91455,28311] 0 2024-09-10T09:36:02.338 INFO:tasks.workunit.client.0.smithi079.stdout:4/259: mkdir d1/da/d28/d47/d52 0 2024-09-10T09:36:02.339 INFO:tasks.workunit.client.0.smithi079.stdout:1/306: dread d5/df/f55 [0,4194304] 0 2024-09-10T09:36:02.340 INFO:tasks.workunit.client.0.smithi079.stdout:3/304: dread d4/da/d17/d2d/f31 [0,4194304] 0 2024-09-10T09:36:02.341 INFO:tasks.workunit.client.0.smithi079.stdout:9/245: truncate d3/d7/dc/de/d17/f1f 898999 0 2024-09-10T09:36:02.348 INFO:tasks.workunit.client.0.smithi079.stdout:5/251: symlink d2/d3/d27/d32/d44/l55 0 2024-09-10T09:36:02.348 INFO:tasks.workunit.client.0.smithi079.stdout:5/252: chown d2/d3/l30 2 1 2024-09-10T09:36:02.354 INFO:tasks.workunit.client.0.smithi079.stdout:2/256: mknod d4/dc/d29/d1b/d38/d39/c56 0 2024-09-10T09:36:02.355 INFO:tasks.workunit.client.0.smithi079.stdout:6/305: rename f2 to d4/d8/dc/d12/d29/f62 0 2024-09-10T09:36:02.356 INFO:tasks.workunit.client.0.smithi079.stdout:3/305: write d4/da/d18/f1c [2714606,1799] 0 2024-09-10T09:36:02.356 INFO:tasks.workunit.client.0.smithi079.stdout:9/246: dread d3/d7/dc/de/f33 [4194304,4194304] 0 2024-09-10T09:36:02.358 INFO:tasks.workunit.client.0.smithi079.stdout:1/307: creat d5/d24/d36/d3a/d3c/f5e x:0 0 0 2024-09-10T09:36:02.360 INFO:tasks.workunit.client.0.smithi079.stdout:5/253: mknod d2/d41/d4d/c56 0 2024-09-10T09:36:02.360 INFO:tasks.workunit.client.0.smithi079.stdout:5/254: write d2/f31 [2065997,30645] 0 2024-09-10T09:36:02.361 INFO:tasks.workunit.client.0.smithi079.stdout:8/313: rename d11/f1a to d11/d2b/d4b/d50/d55/f65 0 2024-09-10T09:36:02.361 INFO:tasks.workunit.client.0.smithi079.stdout:8/314: read - d11/d2b/d4b/f62 zero size 2024-09-10T09:36:02.363 INFO:tasks.workunit.client.0.smithi079.stdout:7/237: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:36:02.363 INFO:tasks.workunit.client.0.smithi079.stdout:8/315: dread d11/d2b/f3f [4194304,4194304] 0 2024-09-10T09:36:02.363 INFO:tasks.workunit.client.0.smithi079.stdout:7/238: chown d4/le 111376 1 2024-09-10T09:36:02.363 INFO:tasks.workunit.client.0.smithi079.stdout:7/239: fdatasync d4/df/d19/f2b 0 2024-09-10T09:36:02.364 INFO:tasks.workunit.client.0.smithi079.stdout:6/306: mknod d4/d8/dc/d12/d29/c63 0 2024-09-10T09:36:02.365 INFO:tasks.workunit.client.0.smithi079.stdout:1/308: write d5/df/d11/f32 [854510,111643] 0 2024-09-10T09:36:02.366 INFO:tasks.workunit.client.0.smithi079.stdout:3/306: getdents d4/da/d17/d2d 0 2024-09-10T09:36:02.367 INFO:tasks.workunit.client.0.smithi079.stdout:5/255: rmdir d2/d41/d4d 39 2024-09-10T09:36:02.370 INFO:tasks.workunit.client.0.smithi079.stdout:5/256: fdatasync d2/f31 0 2024-09-10T09:36:02.370 INFO:tasks.workunit.client.0.smithi079.stdout:5/257: truncate d2/d41/f45 1045286 0 2024-09-10T09:36:02.380 INFO:tasks.workunit.client.0.smithi079.stdout:0/282: rmdir d4/d12/d15/d2b 39 2024-09-10T09:36:02.385 INFO:tasks.workunit.client.0.smithi079.stdout:6/307: rmdir d4/d35/d46/d58 0 2024-09-10T09:36:02.386 INFO:tasks.workunit.client.0.smithi079.stdout:1/309: mknod d5/df/d11/c5f 0 2024-09-10T09:36:02.388 INFO:tasks.workunit.client.0.smithi079.stdout:4/260: rename d1/da/d16/d49/l51 to d1/da/l53 0 2024-09-10T09:36:02.389 INFO:tasks.workunit.client.0.smithi079.stdout:5/258: creat d2/d41/d4d/f57 x:0 0 0 2024-09-10T09:36:02.389 INFO:tasks.workunit.client.0.smithi079.stdout:5/259: creat d2/f58 x:0 0 0 2024-09-10T09:36:02.391 INFO:tasks.workunit.client.0.smithi079.stdout:6/308: truncate d4/d8/dc/fe 7806259 0 2024-09-10T09:36:02.395 INFO:tasks.workunit.client.0.smithi079.stdout:3/307: rename d4/da/d17/d54/f45 to d4/da/f57 0 2024-09-10T09:36:02.399 INFO:tasks.workunit.client.0.smithi079.stdout:8/316: dwrite d11/d2b/f30 [0,4194304] 0 2024-09-10T09:36:02.402 INFO:tasks.workunit.client.0.smithi079.stdout:5/260: mkdir d2/d3/d59 0 2024-09-10T09:36:02.404 INFO:tasks.workunit.client.0.smithi079.stdout:6/309: symlink d4/d8/dd/d41/l64 0 2024-09-10T09:36:02.404 INFO:tasks.workunit.client.0.smithi079.stdout:6/310: chown d4/d8/dc/d12/f30 11988 1 2024-09-10T09:36:02.404 INFO:tasks.workunit.client.0.smithi079.stdout:3/308: mknod d4/da/d17/d38/c58 0 2024-09-10T09:36:02.404 INFO:tasks.workunit.client.0.smithi079.stdout:4/261: dread d1/da/d16/d21/f25 [0,4194304] 0 2024-09-10T09:36:02.406 INFO:tasks.workunit.client.0.smithi079.stdout:7/240: dwrite d4/dc/f3a [0,4194304] 0 2024-09-10T09:36:02.406 INFO:tasks.workunit.client.0.smithi079.stdout:7/241: creat d4/f42 x:0 0 0 2024-09-10T09:36:02.406 INFO:tasks.workunit.client.0.smithi079.stdout:8/317: link d11/f17 d11/d48/f66 0 2024-09-10T09:36:02.407 INFO:tasks.workunit.client.0.smithi079.stdout:6/311: symlink d4/d8/dd/d41/d51/l65 0 2024-09-10T09:36:02.411 INFO:tasks.workunit.client.0.smithi079.stdout:0/283: dwrite d4/d12/d15/f44 [4194304,4194304] 0 2024-09-10T09:36:02.411 INFO:tasks.workunit.client.0.smithi079.stdout:4/262: rename d1/l3e to d1/da/d3b/l54 0 2024-09-10T09:36:02.411 INFO:tasks.workunit.client.0.smithi079.stdout:4/263: stat d1/da/d16/d21/f2d 0 2024-09-10T09:36:02.412 INFO:tasks.workunit.client.0.smithi079.stdout:4/264: stat d1/da/d28/d47/c50 0 2024-09-10T09:36:02.412 INFO:tasks.workunit.client.0.smithi079.stdout:1/310: dwrite d5/f22 [0,4194304] 0 2024-09-10T09:36:02.412 INFO:tasks.workunit.client.0.smithi079.stdout:1/311: write d5/df/d11/f1b [1403286,26570] 0 2024-09-10T09:36:02.413 INFO:tasks.workunit.client.0.smithi079.stdout:7/242: getdents d4/df 0 2024-09-10T09:36:02.415 INFO:tasks.workunit.client.0.smithi079.stdout:8/318: symlink d11/d2b/d4b/d50/d5c/l67 0 2024-09-10T09:36:02.419 INFO:tasks.workunit.client.0.smithi079.stdout:0/284: creat d4/d12/d16/d53/f64 x:0 0 0 2024-09-10T09:36:02.420 INFO:tasks.workunit.client.0.smithi079.stdout:7/243: dread d4/df/d19/f24 [0,4194304] 0 2024-09-10T09:36:02.420 INFO:tasks.workunit.client.0.smithi079.stdout:7/244: readlink d4/df/l39 0 2024-09-10T09:36:02.420 INFO:tasks.workunit.client.0.smithi079.stdout:7/245: fsync d4/d6/d38/f3f 0 2024-09-10T09:36:02.420 INFO:tasks.workunit.client.0.smithi079.stdout:7/246: read d4/dc/f21 [3250139,93678] 0 2024-09-10T09:36:02.426 INFO:tasks.workunit.client.0.smithi079.stdout:1/312: symlink d5/df/d41/l60 0 2024-09-10T09:36:02.427 INFO:tasks.workunit.client.0.smithi079.stdout:8/319: creat d11/d48/d61/f68 x:0 0 0 2024-09-10T09:36:02.427 INFO:tasks.workunit.client.0.smithi079.stdout:8/320: write f8 [1647198,55942] 0 2024-09-10T09:36:02.430 INFO:tasks.workunit.client.0.smithi079.stdout:0/285: link d4/d12/d21/c50 d4/d12/d16/c65 0 2024-09-10T09:36:02.430 INFO:tasks.workunit.client.0.smithi079.stdout:0/286: write d4/d1d/d24/f61 [453593,56656] 0 2024-09-10T09:36:02.432 INFO:tasks.workunit.client.0.smithi079.stdout:7/247: mkdir d4/dc/d43 0 2024-09-10T09:36:02.437 INFO:tasks.workunit.client.0.smithi079.stdout:0/287: creat d4/d12/d21/d3f/f66 x:0 0 0 2024-09-10T09:36:02.440 INFO:tasks.workunit.client.0.smithi079.stdout:7/248: rename d4/df/l39 to d4/df/d19/l44 0 2024-09-10T09:36:02.441 INFO:tasks.workunit.client.0.smithi079.stdout:1/313: creat d5/d24/d36/d53/f61 x:0 0 0 2024-09-10T09:36:02.443 INFO:tasks.workunit.client.0.smithi079.stdout:0/288: mknod d4/d12/d21/c67 0 2024-09-10T09:36:02.443 INFO:tasks.workunit.client.0.smithi079.stdout:0/289: write d4/fe [624657,104327] 0 2024-09-10T09:36:02.444 INFO:tasks.workunit.client.0.smithi079.stdout:1/314: mknod d5/df/d11/c62 0 2024-09-10T09:36:02.446 INFO:tasks.workunit.client.0.smithi079.stdout:3/309: rmdir d4/da/d17 39 2024-09-10T09:36:02.446 INFO:tasks.workunit.client.0.smithi079.stdout:3/310: truncate d4/da/d18/f55 54770 0 2024-09-10T09:36:02.447 INFO:tasks.workunit.client.0.smithi079.stdout:8/321: dread d11/d48/f66 [0,4194304] 0 2024-09-10T09:36:02.447 INFO:tasks.workunit.client.0.smithi079.stdout:1/315: symlink d5/d40/l63 0 2024-09-10T09:36:02.451 INFO:tasks.workunit.client.0.smithi079.stdout:3/311: truncate d4/da/d17/d2d/f31 2402685 0 2024-09-10T09:36:02.452 INFO:tasks.workunit.client.0.smithi079.stdout:8/322: rename d11/d48/d61/f68 to d11/d2b/d4b/f69 0 2024-09-10T09:36:02.454 INFO:tasks.workunit.client.0.smithi079.stdout:3/312: getdents d4/da/d17/d2d/d43 0 2024-09-10T09:36:02.454 INFO:tasks.workunit.client.0.smithi079.stdout:3/313: write d4/da/f57 [670965,70646] 0 2024-09-10T09:36:02.454 INFO:tasks.workunit.client.0.smithi079.stdout:3/314: fdatasync d4/f12 0 2024-09-10T09:36:02.456 INFO:tasks.workunit.client.0.smithi079.stdout:3/315: rmdir d4/da/d17 39 2024-09-10T09:36:02.457 INFO:tasks.workunit.client.0.smithi079.stdout:3/316: mknod d4/da/d17/c59 0 2024-09-10T09:36:02.458 INFO:tasks.workunit.client.0.smithi079.stdout:5/261: dwrite d2/d3/fb [4194304,4194304] 0 2024-09-10T09:36:02.459 INFO:tasks.workunit.client.0.smithi079.stdout:3/317: creat d4/da/d17/d2d/d43/d4c/f5a x:0 0 0 2024-09-10T09:36:02.461 INFO:tasks.workunit.client.0.smithi079.stdout:3/318: symlink d4/da/d18/l5b 0 2024-09-10T09:36:02.462 INFO:tasks.workunit.client.0.smithi079.stdout:1/316: dread d5/f22 [0,4194304] 0 2024-09-10T09:36:02.462 INFO:tasks.workunit.client.0.smithi079.stdout:0/290: truncate d4/d12/d15/f44 4452780 0 2024-09-10T09:36:02.462 INFO:tasks.workunit.client.0.smithi079.stdout:0/291: truncate d4/d47/f4c 689604 0 2024-09-10T09:36:02.463 INFO:tasks.workunit.client.0.smithi079.stdout:0/292: chown l3 28639321 1 2024-09-10T09:36:02.463 INFO:tasks.workunit.client.0.smithi079.stdout:0/293: fdatasync d4/d12/d1a/f19 0 2024-09-10T09:36:02.465 INFO:tasks.workunit.client.0.smithi079.stdout:7/249: dwrite d4/df/d19/f2e [0,4194304] 0 2024-09-10T09:36:02.467 INFO:tasks.workunit.client.0.smithi079.stdout:3/319: unlink d4/da/d18/f1f 0 2024-09-10T09:36:02.467 INFO:tasks.workunit.client.0.smithi079.stdout:4/265: dwrite d1/da/d16/f26 [4194304,4194304] 0 2024-09-10T09:36:02.468 INFO:tasks.workunit.client.0.smithi079.stdout:6/312: dwrite d4/d8/dc/d1c/f1d [0,4194304] 0 2024-09-10T09:36:02.468 INFO:tasks.workunit.client.0.smithi079.stdout:4/266: chown d1/da/d16/d21/l35 1641028 1 2024-09-10T09:36:02.468 INFO:tasks.workunit.client.0.smithi079.stdout:4/267: chown d1/c3 68 1 2024-09-10T09:36:02.468 INFO:tasks.workunit.client.0.smithi079.stdout:8/323: write d11/f1e [1012026,93580] 0 2024-09-10T09:36:02.473 INFO:tasks.workunit.client.0.smithi079.stdout:7/250: symlink d4/df/d3d/l45 0 2024-09-10T09:36:02.476 INFO:tasks.workunit.client.0.smithi079.stdout:4/268: read d1/da/d16/d21/f25 [3992320,13649] 0 2024-09-10T09:36:02.476 INFO:tasks.workunit.client.0.smithi079.stdout:4/269: fsync d1/da/d16/f24 0 2024-09-10T09:36:02.489 INFO:tasks.workunit.client.0.smithi079.stdout:3/320: symlink d4/da/d17/d38/l5c 0 2024-09-10T09:36:02.489 INFO:tasks.workunit.client.0.smithi079.stdout:3/321: readlink d4/da/l14 0 2024-09-10T09:36:02.489 INFO:tasks.workunit.client.0.smithi079.stdout:6/313: dwrite d4/d8/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:02.489 INFO:tasks.workunit.client.0.smithi079.stdout:6/314: write d4/d8/fb [2375609,12301] 0 2024-09-10T09:36:02.489 INFO:tasks.workunit.client.0.smithi079.stdout:6/315: stat l1 0 2024-09-10T09:36:02.489 INFO:tasks.workunit.client.0.smithi079.stdout:1/317: dwrite d5/df/f55 [4194304,4194304] 0 2024-09-10T09:36:02.490 INFO:tasks.workunit.client.0.smithi079.stdout:1/318: read - d5/d24/d36/d3a/d48/f51 zero size 2024-09-10T09:36:02.491 INFO:tasks.workunit.client.0.smithi079.stdout:0/294: getdents d4/d12/d21 0 2024-09-10T09:36:02.492 INFO:tasks.workunit.client.0.smithi079.stdout:7/251: mknod d4/d6/d3e/c46 0 2024-09-10T09:36:02.494 INFO:tasks.workunit.client.0.smithi079.stdout:4/270: symlink d1/da/d28/l55 0 2024-09-10T09:36:02.496 INFO:tasks.workunit.client.0.smithi079.stdout:3/322: mknod d4/da/d17/d2d/d43/d49/c5d 0 2024-09-10T09:36:02.503 INFO:tasks.workunit.client.0.smithi079.stdout:1/319: rename d5/df/d2e/f45 to d5/d24/d36/d3a/d3c/f64 0 2024-09-10T09:36:02.503 INFO:tasks.workunit.client.0.smithi079.stdout:1/320: chown d5/d24/d36/d3a 11164 1 2024-09-10T09:36:02.503 INFO:tasks.workunit.client.0.smithi079.stdout:4/271: dread d1/da/f45 [0,4194304] 0 2024-09-10T09:36:02.504 INFO:tasks.workunit.client.0.smithi079.stdout:1/321: dread d5/f15 [0,4194304] 0 2024-09-10T09:36:02.507 INFO:tasks.workunit.client.0.smithi079.stdout:8/324: rmdir d11 39 2024-09-10T09:36:02.507 INFO:tasks.workunit.client.0.smithi079.stdout:8/325: write d11/d3b/f3e [66489,44565] 0 2024-09-10T09:36:02.509 INFO:tasks.workunit.client.0.smithi079.stdout:0/295: mkdir d4/d12/d16/d68 0 2024-09-10T09:36:02.510 INFO:tasks.workunit.client.0.smithi079.stdout:6/316: dwrite d4/d8/dc/d12/d29/f31 [0,4194304] 0 2024-09-10T09:36:02.510 INFO:tasks.workunit.client.0.smithi079.stdout:6/317: creat d4/d8/dc/f66 x:0 0 0 2024-09-10T09:36:02.511 INFO:tasks.workunit.client.0.smithi079.stdout:1/322: creat d5/df/d41/f65 x:0 0 0 2024-09-10T09:36:02.516 INFO:tasks.workunit.client.0.smithi079.stdout:0/296: mkdir d4/d12/d15/d69 0 2024-09-10T09:36:02.516 INFO:tasks.workunit.client.0.smithi079.stdout:9/247: sync 2024-09-10T09:36:02.516 INFO:tasks.workunit.client.0.smithi079.stdout:2/257: sync 2024-09-10T09:36:02.523 INFO:tasks.workunit.client.0.smithi079.stdout:3/323: dwrite d4/da/d18/f55 [0,4194304] 0 2024-09-10T09:36:02.523 INFO:tasks.workunit.client.0.smithi079.stdout:3/324: chown d4/da/d17/d2d/d43/d49/c5d 2959 1 2024-09-10T09:36:02.523 INFO:tasks.workunit.client.0.smithi079.stdout:3/325: chown d4/da/d18/f46 1 1 2024-09-10T09:36:02.523 INFO:tasks.workunit.client.0.smithi079.stdout:7/252: dwrite d4/df/d3d/f40 [0,4194304] 0 2024-09-10T09:36:02.523 INFO:tasks.workunit.client.0.smithi079.stdout:7/253: stat d4/dc 0 2024-09-10T09:36:02.523 INFO:tasks.workunit.client.0.smithi079.stdout:7/254: fsync d4/dc/f32 0 2024-09-10T09:36:02.525 INFO:tasks.workunit.client.0.smithi079.stdout:0/297: mkdir d4/d12/d16/d53/d6a 0 2024-09-10T09:36:02.525 INFO:tasks.workunit.client.0.smithi079.stdout:0/298: readlink d4/l60 0 2024-09-10T09:36:02.527 INFO:tasks.workunit.client.0.smithi079.stdout:0/299: write d4/d47/f4c [367049,56988] 0 2024-09-10T09:36:02.530 INFO:tasks.workunit.client.0.smithi079.stdout:3/326: dread d4/f2a [0,4194304] 0 2024-09-10T09:36:02.532 INFO:tasks.workunit.client.0.smithi079.stdout:7/255: rename d4/df/d3d/l45 to d4/df/l47 0 2024-09-10T09:36:02.533 INFO:tasks.workunit.client.0.smithi079.stdout:4/272: dwrite d1/da/d16/f1f [0,4194304] 0 2024-09-10T09:36:02.535 INFO:tasks.workunit.client.0.smithi079.stdout:8/326: rmdir d11/d48/d61 0 2024-09-10T09:36:02.537 INFO:tasks.workunit.client.0.smithi079.stdout:0/300: mkdir d4/d12/d15/d6b 0 2024-09-10T09:36:02.537 INFO:tasks.workunit.client.0.smithi079.stdout:0/301: fdatasync d4/d12/f40 0 2024-09-10T09:36:02.537 INFO:tasks.workunit.client.0.smithi079.stdout:0/302: creat d4/d12/d16/d53/f6c x:0 0 0 2024-09-10T09:36:02.539 INFO:tasks.workunit.client.0.smithi079.stdout:3/327: rmdir d4/da/d17/d2d/d43/d49 39 2024-09-10T09:36:02.541 INFO:tasks.workunit.client.0.smithi079.stdout:4/273: creat d1/d38/f56 x:0 0 0 2024-09-10T09:36:02.541 INFO:tasks.workunit.client.0.smithi079.stdout:1/323: dread d5/d24/f2f [0,4194304] 0 2024-09-10T09:36:02.546 INFO:tasks.workunit.client.0.smithi079.stdout:7/256: dread d4/df/d3d/f40 [0,4194304] 0 2024-09-10T09:36:02.547 INFO:tasks.workunit.client.0.smithi079.stdout:8/327: creat d11/d48/f6a x:0 0 0 2024-09-10T09:36:02.547 INFO:tasks.workunit.client.0.smithi079.stdout:8/328: fdatasync d11/d2b/f2d 0 2024-09-10T09:36:02.550 INFO:tasks.workunit.client.0.smithi079.stdout:0/303: mkdir d4/d12/d1a/d6d 0 2024-09-10T09:36:02.550 INFO:tasks.workunit.client.0.smithi079.stdout:0/304: fdatasync d4/d12/d1a/d29/f37 0 2024-09-10T09:36:02.550 INFO:tasks.workunit.client.0.smithi079.stdout:1/324: stat d5/df/d41/c43 0 2024-09-10T09:36:02.551 INFO:tasks.workunit.client.0.smithi079.stdout:1/325: write d5/df/d41/f65 [318777,61461] 0 2024-09-10T09:36:02.553 INFO:tasks.workunit.client.0.smithi079.stdout:2/258: dwrite d4/dc/d29/d1b/d38/d39/f4c [0,4194304] 0 2024-09-10T09:36:02.553 INFO:tasks.workunit.client.0.smithi079.stdout:2/259: fsync d4/dc/d29/d1b/d38/f3d 0 2024-09-10T09:36:02.553 INFO:tasks.workunit.client.0.smithi079.stdout:2/260: fsync d4/dc/d1c/f34 0 2024-09-10T09:36:02.553 INFO:tasks.workunit.client.0.smithi079.stdout:2/261: rename d4/dc/d29/d1b/d38/d39/d31 to d4/dc/d29/d1b/d38/d39/d31/d49/d57 22 2024-09-10T09:36:02.553 INFO:tasks.workunit.client.0.smithi079.stdout:0/305: creat d4/d12/d39/f6e x:0 0 0 2024-09-10T09:36:02.553 INFO:tasks.workunit.client.0.smithi079.stdout:0/306: fsync d4/d12/d15/f28 0 2024-09-10T09:36:02.554 INFO:tasks.workunit.client.0.smithi079.stdout:0/307: chown d4/d12/d21/f2c 1528516230 1 2024-09-10T09:36:02.554 INFO:tasks.workunit.client.0.smithi079.stdout:0/308: chown d4/d12/d16 55 1 2024-09-10T09:36:02.554 INFO:tasks.workunit.client.0.smithi079.stdout:9/248: dwrite d3/d7/f2a [0,4194304] 0 2024-09-10T09:36:02.554 INFO:tasks.workunit.client.0.smithi079.stdout:4/274: dread d1/da/d16/d21/f2d [0,4194304] 0 2024-09-10T09:36:02.555 INFO:tasks.workunit.client.0.smithi079.stdout:1/326: creat d5/d24/f66 x:0 0 0 2024-09-10T09:36:02.556 INFO:tasks.workunit.client.0.smithi079.stdout:3/328: dread d4/da/f11 [0,4194304] 0 2024-09-10T09:36:02.557 INFO:tasks.workunit.client.0.smithi079.stdout:7/257: dread d4/d6/fa [0,4194304] 0 2024-09-10T09:36:02.557 INFO:tasks.workunit.client.0.smithi079.stdout:7/258: chown d4/dc/l1f 3936 1 2024-09-10T09:36:02.561 INFO:tasks.workunit.client.0.smithi079.stdout:1/327: dread d5/df/d11/f32 [0,4194304] 0 2024-09-10T09:36:02.562 INFO:tasks.workunit.client.0.smithi079.stdout:2/262: symlink d4/dc/d29/d1b/d38/l58 0 2024-09-10T09:36:02.564 INFO:tasks.workunit.client.0.smithi079.stdout:0/309: link d4/d12/d16/d53/c5e d4/d12/d39/c6f 0 2024-09-10T09:36:02.564 INFO:tasks.workunit.client.0.smithi079.stdout:0/310: getdents d4/d12/d21 0 2024-09-10T09:36:02.574 INFO:tasks.workunit.client.0.smithi079.stdout:3/329: truncate d4/da/d18/f47 1106789 0 2024-09-10T09:36:02.574 INFO:tasks.workunit.client.0.smithi079.stdout:3/330: chown d4/da/d17/d2d 64284686 1 2024-09-10T09:36:02.576 INFO:tasks.workunit.client.0.smithi079.stdout:7/259: creat d4/df/d19/f48 x:0 0 0 2024-09-10T09:36:02.576 INFO:tasks.workunit.client.0.smithi079.stdout:8/329: dwrite d11/d48/f66 [4194304,4194304] 0 2024-09-10T09:36:02.577 INFO:tasks.workunit.client.0.smithi079.stdout:1/328: symlink d5/l67 0 2024-09-10T09:36:02.578 INFO:tasks.workunit.client.0.smithi079.stdout:1/329: write d5/df/d11/f1b [2058313,25416] 0 2024-09-10T09:36:02.581 INFO:tasks.workunit.client.0.smithi079.stdout:8/330: creat d11/d2b/d4b/f6b x:0 0 0 2024-09-10T09:36:02.582 INFO:tasks.workunit.client.0.smithi079.stdout:1/330: dread - d5/d24/d36/f5a zero size 2024-09-10T09:36:02.583 INFO:tasks.workunit.client.0.smithi079.stdout:3/331: dread d4/da/d18/f48 [0,4194304] 0 2024-09-10T09:36:02.585 INFO:tasks.workunit.client.0.smithi079.stdout:2/263: rename d4/dc/d29/d21 to d4/dc/d1c/d59 0 2024-09-10T09:36:02.587 INFO:tasks.workunit.client.0.smithi079.stdout:4/275: dwrite d1/da/d16/d21/f2d [0,4194304] 0 2024-09-10T09:36:02.587 INFO:tasks.workunit.client.0.smithi079.stdout:3/332: getdents d4/da/d17/d38 0 2024-09-10T09:36:02.588 INFO:tasks.workunit.client.0.smithi079.stdout:9/249: dwrite d3/d7/dc/f37 [0,4194304] 0 2024-09-10T09:36:02.590 INFO:tasks.workunit.client.0.smithi079.stdout:0/311: rename d4/d12/d15/f44 to d4/f70 0 2024-09-10T09:36:02.591 INFO:tasks.workunit.client.0.smithi079.stdout:0/312: dread - d4/d12/d15/d2b/f45 zero size 2024-09-10T09:36:02.591 INFO:tasks.workunit.client.0.smithi079.stdout:0/313: fsync d4/fe 0 2024-09-10T09:36:02.591 INFO:tasks.workunit.client.0.smithi079.stdout:9/250: dread d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:02.591 INFO:tasks.workunit.client.0.smithi079.stdout:9/251: write d3/d7/dc/de/d17/d2f/f38 [159362,60090] 0 2024-09-10T09:36:02.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/333: creat d4/da/d56/f5e x:0 0 0 2024-09-10T09:36:02.593 INFO:tasks.workunit.client.0.smithi079.stdout:0/314: dread d4/d47/f4c [0,4194304] 0 2024-09-10T09:36:02.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/334: write d4/da/f11 [5506616,42397] 0 2024-09-10T09:36:02.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/335: fsync d4/da/d17/f37 0 2024-09-10T09:36:02.596 INFO:tasks.workunit.client.0.smithi079.stdout:5/262: sync 2024-09-10T09:36:02.596 INFO:tasks.workunit.client.0.smithi079.stdout:5/263: dread - d2/d3/f38 zero size 2024-09-10T09:36:02.602 INFO:tasks.workunit.client.0.smithi079.stdout:7/260: rename d4/dc/l29 to d4/df/l49 0 2024-09-10T09:36:02.602 INFO:tasks.workunit.client.0.smithi079.stdout:4/276: dread d1/da/f45 [0,4194304] 0 2024-09-10T09:36:02.603 INFO:tasks.workunit.client.0.smithi079.stdout:1/331: dwrite d5/d24/f66 [0,4194304] 0 2024-09-10T09:36:02.603 INFO:tasks.workunit.client.0.smithi079.stdout:1/332: write d5/df/d2e/f49 [467521,108413] 0 2024-09-10T09:36:02.603 INFO:tasks.workunit.client.0.smithi079.stdout:1/333: fsync d5/df/d11/f32 0 2024-09-10T09:36:02.605 INFO:tasks.workunit.client.0.smithi079.stdout:9/252: mknod d3/d7/dc/de/d17/d2f/d30/c49 0 2024-09-10T09:36:02.606 INFO:tasks.workunit.client.0.smithi079.stdout:7/261: write d4/d6/fa [603831,1115] 0 2024-09-10T09:36:02.606 INFO:tasks.workunit.client.0.smithi079.stdout:7/262: truncate d4/d6/d38/f3f 873996 0 2024-09-10T09:36:02.606 INFO:tasks.workunit.client.0.smithi079.stdout:0/315: symlink d4/d1d/l71 0 2024-09-10T09:36:02.608 INFO:tasks.workunit.client.0.smithi079.stdout:5/264: unlink d2/d3/l30 0 2024-09-10T09:36:02.608 INFO:tasks.workunit.client.0.smithi079.stdout:5/265: creat d2/d41/d4d/f5a x:0 0 0 2024-09-10T09:36:02.609 INFO:tasks.workunit.client.0.smithi079.stdout:5/266: chown d2/d3/d27/d32/f4f 478053 1 2024-09-10T09:36:02.610 INFO:tasks.workunit.client.0.smithi079.stdout:8/331: rename d11/c26 to d11/d2b/d4b/d50/d5c/c6c 0 2024-09-10T09:36:02.610 INFO:tasks.workunit.client.0.smithi079.stdout:8/332: chown d11/f43 0 1 2024-09-10T09:36:02.610 INFO:tasks.workunit.client.0.smithi079.stdout:4/277: write d1/da/d28/f29 [2080533,128866] 0 2024-09-10T09:36:02.611 INFO:tasks.workunit.client.0.smithi079.stdout:6/318: sync 2024-09-10T09:36:02.611 INFO:tasks.workunit.client.0.smithi079.stdout:6/319: dread - d4/d35/d39/f49 zero size 2024-09-10T09:36:02.611 INFO:tasks.workunit.client.0.smithi079.stdout:6/320: truncate d4/d8/dd/d41/f54 705066 0 2024-09-10T09:36:02.611 INFO:tasks.workunit.client.0.smithi079.stdout:6/321: chown d4/c7 26330 1 2024-09-10T09:36:02.612 INFO:tasks.workunit.client.0.smithi079.stdout:3/336: dwrite d4/da/d17/d2d/f34 [4194304,4194304] 0 2024-09-10T09:36:02.612 INFO:tasks.workunit.client.0.smithi079.stdout:3/337: chown d4/da/d17/d2d/f31 9484611 1 2024-09-10T09:36:02.613 INFO:tasks.workunit.client.0.smithi079.stdout:1/334: mknod d5/d24/d36/d3a/d3c/d57/c68 0 2024-09-10T09:36:02.613 INFO:tasks.workunit.client.0.smithi079.stdout:1/335: chown d5/d24/d36/d3a/d3c/d57/c68 3072 1 2024-09-10T09:36:02.614 INFO:tasks.workunit.client.0.smithi079.stdout:9/253: symlink d3/d7/dc/de/l4a 0 2024-09-10T09:36:02.614 INFO:tasks.workunit.client.0.smithi079.stdout:8/333: dread fe [0,4194304] 0 2024-09-10T09:36:02.616 INFO:tasks.workunit.client.0.smithi079.stdout:7/263: unlink d4/df/d19/f24 0 2024-09-10T09:36:02.616 INFO:tasks.workunit.client.0.smithi079.stdout:7/264: creat d4/dc/f4a x:0 0 0 2024-09-10T09:36:02.616 INFO:tasks.workunit.client.0.smithi079.stdout:7/265: chown d4/d6/d3e 37084 1 2024-09-10T09:36:02.620 INFO:tasks.workunit.client.0.smithi079.stdout:5/267: link d2/c11 d2/d3/c5b 0 2024-09-10T09:36:02.622 INFO:tasks.workunit.client.0.smithi079.stdout:9/254: dread d3/d7/f35 [0,4194304] 0 2024-09-10T09:36:02.624 INFO:tasks.workunit.client.0.smithi079.stdout:9/255: read d3/d7/dc/de/d17/f1f [294635,58847] 0 2024-09-10T09:36:02.624 INFO:tasks.workunit.client.0.smithi079.stdout:9/256: stat d3/d7/dc 0 2024-09-10T09:36:02.625 INFO:tasks.workunit.client.0.smithi079.stdout:6/322: truncate d4/d35/f59 3486548 0 2024-09-10T09:36:02.629 INFO:tasks.workunit.client.0.smithi079.stdout:3/338: unlink d4/da/d17/d38/c58 0 2024-09-10T09:36:02.630 INFO:tasks.workunit.client.0.smithi079.stdout:3/339: dread - d4/da/d56/f5e zero size 2024-09-10T09:36:02.630 INFO:tasks.workunit.client.0.smithi079.stdout:3/340: chown d4/f13 601 1 2024-09-10T09:36:02.630 INFO:tasks.workunit.client.0.smithi079.stdout:3/341: write d4/da/d17/f52 [779913,40782] 0 2024-09-10T09:36:02.631 INFO:tasks.workunit.client.0.smithi079.stdout:6/323: dread d4/d8/dc/d12/d29/f47 [0,4194304] 0 2024-09-10T09:36:02.635 INFO:tasks.workunit.client.0.smithi079.stdout:7/266: dwrite d4/f37 [0,4194304] 0 2024-09-10T09:36:02.636 INFO:tasks.workunit.client.0.smithi079.stdout:7/267: fsync d4/f37 0 2024-09-10T09:36:02.637 INFO:tasks.workunit.client.0.smithi079.stdout:0/316: getdents d4/d12/d39 0 2024-09-10T09:36:02.638 INFO:tasks.workunit.client.0.smithi079.stdout:0/317: stat d4/f11 0 2024-09-10T09:36:02.641 INFO:tasks.workunit.client.0.smithi079.stdout:4/278: mkdir d1/da/d16/d57 0 2024-09-10T09:36:02.641 INFO:tasks.workunit.client.0.smithi079.stdout:4/279: write d1/d38/f56 [177210,92342] 0 2024-09-10T09:36:02.644 INFO:tasks.workunit.client.0.smithi079.stdout:9/257: mknod d3/c4b 0 2024-09-10T09:36:02.648 INFO:tasks.workunit.client.0.smithi079.stdout:5/268: dwrite d2/d3/f38 [0,4194304] 0 2024-09-10T09:36:02.650 INFO:tasks.workunit.client.0.smithi079.stdout:1/336: link d5/df/d11/f2d d5/d24/d36/f69 0 2024-09-10T09:36:02.650 INFO:tasks.workunit.client.0.smithi079.stdout:1/337: write d5/d24/d36/d3a/d48/f51 [331674,126249] 0 2024-09-10T09:36:02.651 INFO:tasks.workunit.client.0.smithi079.stdout:3/342: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:02.653 INFO:tasks.workunit.client.0.smithi079.stdout:8/334: getdents d11/d2b/d4b 0 2024-09-10T09:36:02.653 INFO:tasks.workunit.client.0.smithi079.stdout:8/335: creat d11/d48/f6d x:0 0 0 2024-09-10T09:36:02.653 INFO:tasks.workunit.client.0.smithi079.stdout:8/336: dread - d11/d2b/f2d zero size 2024-09-10T09:36:02.654 INFO:tasks.workunit.client.0.smithi079.stdout:3/343: read d4/f2a [3078484,8628] 0 2024-09-10T09:36:02.656 INFO:tasks.workunit.client.0.smithi079.stdout:0/318: mkdir d4/d1d/d24/d72 0 2024-09-10T09:36:02.657 INFO:tasks.workunit.client.0.smithi079.stdout:7/268: dwrite d4/dc/f21 [0,4194304] 0 2024-09-10T09:36:02.660 INFO:tasks.workunit.client.0.smithi079.stdout:4/280: symlink d1/da/d28/d47/d52/l58 0 2024-09-10T09:36:02.660 INFO:tasks.workunit.client.0.smithi079.stdout:4/281: readlink d1/da/d28/l39 0 2024-09-10T09:36:02.661 INFO:tasks.workunit.client.0.smithi079.stdout:9/258: mkdir d3/d7/dc/de/d17/d4c 0 2024-09-10T09:36:02.666 INFO:tasks.workunit.client.0.smithi079.stdout:5/269: creat d2/d3/d27/d32/d39/f5c x:0 0 0 2024-09-10T09:36:02.676 INFO:tasks.workunit.client.0.smithi079.stdout:8/337: rmdir d11 39 2024-09-10T09:36:02.678 INFO:tasks.workunit.client.0.smithi079.stdout:0/319: creat d4/d12/d39/f73 x:0 0 0 2024-09-10T09:36:02.678 INFO:tasks.workunit.client.0.smithi079.stdout:0/320: dread - d4/d12/d15/d2b/f45 zero size 2024-09-10T09:36:02.679 INFO:tasks.workunit.client.0.smithi079.stdout:0/321: truncate d4/d12/d16/d53/f64 260272 0 2024-09-10T09:36:02.679 INFO:tasks.workunit.client.0.smithi079.stdout:7/269: mknod d4/d6/d38/c4b 0 2024-09-10T09:36:02.682 INFO:tasks.workunit.client.0.smithi079.stdout:4/282: rename d1/da/d16/d49 to d1/da/d3b/d59 0 2024-09-10T09:36:02.683 INFO:tasks.workunit.client.0.smithi079.stdout:9/259: creat d3/d7/d26/f4d x:0 0 0 2024-09-10T09:36:02.686 INFO:tasks.workunit.client.0.smithi079.stdout:5/270: unlink d2/l1f 0 2024-09-10T09:36:02.686 INFO:tasks.workunit.client.0.smithi079.stdout:5/271: write d2/d41/d4d/f5a [75657,125734] 0 2024-09-10T09:36:02.688 INFO:tasks.workunit.client.0.smithi079.stdout:1/338: unlink d5/d24/d36/c59 0 2024-09-10T09:36:02.691 INFO:tasks.workunit.client.0.smithi079.stdout:8/338: creat d11/d2b/d4b/d50/d5c/f6e x:0 0 0 2024-09-10T09:36:02.691 INFO:tasks.workunit.client.0.smithi079.stdout:8/339: dread - d11/d48/f6d zero size 2024-09-10T09:36:02.691 INFO:tasks.workunit.client.0.smithi079.stdout:5/272: fdatasync d2/d41/d4d/f5a 0 2024-09-10T09:36:02.693 INFO:tasks.workunit.client.0.smithi079.stdout:0/322: unlink d4/d12/d1a/d29/l38 0 2024-09-10T09:36:02.693 INFO:tasks.workunit.client.0.smithi079.stdout:2/264: sync 2024-09-10T09:36:02.694 INFO:tasks.workunit.client.0.smithi079.stdout:7/270: dwrite d4/d6/d38/f3f [0,4194304] 0 2024-09-10T09:36:02.694 INFO:tasks.workunit.client.0.smithi079.stdout:4/283: mkdir d1/da/d3b/d5a 0 2024-09-10T09:36:02.695 INFO:tasks.workunit.client.0.smithi079.stdout:4/284: chown d1/da/d16/l48 24411848 1 2024-09-10T09:36:02.696 INFO:tasks.workunit.client.0.smithi079.stdout:9/260: rename d3/d7/f35 to d3/d40/f4e 0 2024-09-10T09:36:02.697 INFO:tasks.workunit.client.0.smithi079.stdout:1/339: mkdir d5/df/d41/d6a 0 2024-09-10T09:36:02.702 INFO:tasks.workunit.client.0.smithi079.stdout:5/273: creat d2/d41/f5d x:0 0 0 2024-09-10T09:36:02.704 INFO:tasks.workunit.client.0.smithi079.stdout:9/261: dread d3/d7/dc/de/d17/f21 [0,4194304] 0 2024-09-10T09:36:02.706 INFO:tasks.workunit.client.0.smithi079.stdout:2/265: creat d4/dc/d29/d1b/d38/d39/d31/d52/f5a x:0 0 0 2024-09-10T09:36:02.710 INFO:tasks.workunit.client.0.smithi079.stdout:7/271: creat d4/df/f4c x:0 0 0 2024-09-10T09:36:02.712 INFO:tasks.workunit.client.0.smithi079.stdout:1/340: dwrite d5/d24/d36/d3a/d3c/f5e [0,4194304] 0 2024-09-10T09:36:02.714 INFO:tasks.workunit.client.0.smithi079.stdout:4/285: link d1/l4a d1/da/d16/d57/l5b 0 2024-09-10T09:36:02.715 INFO:tasks.workunit.client.0.smithi079.stdout:7/272: dread d4/dc/f36 [0,4194304] 0 2024-09-10T09:36:02.715 INFO:tasks.workunit.client.0.smithi079.stdout:8/340: getdents d11/d48 0 2024-09-10T09:36:02.716 INFO:tasks.workunit.client.0.smithi079.stdout:8/341: readlink d11/d3b/l5a 0 2024-09-10T09:36:02.716 INFO:tasks.workunit.client.0.smithi079.stdout:5/274: mkdir d2/d3/d5e 0 2024-09-10T09:36:02.717 INFO:tasks.workunit.client.0.smithi079.stdout:0/323: rmdir d4/d1d/d24 39 2024-09-10T09:36:02.717 INFO:tasks.workunit.client.0.smithi079.stdout:0/324: creat d4/d12/d1a/d29/f74 x:0 0 0 2024-09-10T09:36:02.718 INFO:tasks.workunit.client.0.smithi079.stdout:9/262: rename d3/d7/l43 to d3/d7/dc/de/d17/d4c/l4f 0 2024-09-10T09:36:02.721 INFO:tasks.workunit.client.0.smithi079.stdout:4/286: symlink d1/da/d16/d4d/l5c 0 2024-09-10T09:36:02.721 INFO:tasks.workunit.client.0.smithi079.stdout:6/324: sync 2024-09-10T09:36:02.722 INFO:tasks.workunit.client.0.smithi079.stdout:7/273: mkdir d4/dc/d43/d4d 0 2024-09-10T09:36:02.724 INFO:tasks.workunit.client.0.smithi079.stdout:8/342: creat d11/d3b/f6f x:0 0 0 2024-09-10T09:36:02.726 INFO:tasks.workunit.client.0.smithi079.stdout:5/275: symlink d2/d3/d27/d32/l5f 0 2024-09-10T09:36:02.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/325: mknod d4/d47/c75 0 2024-09-10T09:36:02.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/326: write d4/d12/d39/f6e [863788,17246] 0 2024-09-10T09:36:02.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/327: write d4/d12/d16/d53/f64 [986388,64095] 0 2024-09-10T09:36:02.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/328: stat d4/d12/d15/d2b/f45 0 2024-09-10T09:36:02.729 INFO:tasks.workunit.client.0.smithi079.stdout:4/287: truncate d1/da/f36 3487173 0 2024-09-10T09:36:02.730 INFO:tasks.workunit.client.0.smithi079.stdout:1/341: write d5/df/d11/f1b [6269977,119098] 0 2024-09-10T09:36:02.730 INFO:tasks.workunit.client.0.smithi079.stdout:7/274: mknod d4/d6/c4e 0 2024-09-10T09:36:02.733 INFO:tasks.workunit.client.0.smithi079.stdout:8/343: symlink d11/d2b/d4b/d50/d5c/l70 0 2024-09-10T09:36:02.733 INFO:tasks.workunit.client.0.smithi079.stdout:8/344: fsync d11/d2b/f4e 0 2024-09-10T09:36:02.733 INFO:tasks.workunit.client.0.smithi079.stdout:8/345: truncate d11/d3b/f49 1083378 0 2024-09-10T09:36:02.733 INFO:tasks.workunit.client.0.smithi079.stdout:0/329: symlink d4/d12/d1a/d6d/l76 0 2024-09-10T09:36:02.735 INFO:tasks.workunit.client.0.smithi079.stdout:1/342: symlink d5/df/d41/l6b 0 2024-09-10T09:36:02.736 INFO:tasks.workunit.client.0.smithi079.stdout:1/343: chown d5/d24/d36/d3a/f50 0 1 2024-09-10T09:36:02.737 INFO:tasks.workunit.client.0.smithi079.stdout:7/275: mkdir d4/d6/d4f 0 2024-09-10T09:36:02.738 INFO:tasks.workunit.client.0.smithi079.stdout:0/330: mknod d4/d1d/d24/c77 0 2024-09-10T09:36:02.742 INFO:tasks.workunit.client.0.smithi079.stdout:4/288: rename d1/da/d16/l1a to d1/da/d3b/d5a/l5d 0 2024-09-10T09:36:02.743 INFO:tasks.workunit.client.0.smithi079.stdout:2/266: dwrite d4/f6 [0,4194304] 0 2024-09-10T09:36:02.747 INFO:tasks.workunit.client.0.smithi079.stdout:0/331: mkdir d4/d78 0 2024-09-10T09:36:02.747 INFO:tasks.workunit.client.0.smithi079.stdout:0/332: fsync d4/d12/d15/d2b/f45 0 2024-09-10T09:36:02.747 INFO:tasks.workunit.client.0.smithi079.stdout:0/333: getdents d4/d12/d15/d6b 0 2024-09-10T09:36:02.748 INFO:tasks.workunit.client.0.smithi079.stdout:4/289: symlink d1/l5e 0 2024-09-10T09:36:02.752 INFO:tasks.workunit.client.0.smithi079.stdout:9/263: dwrite d3/d7/dc/de/d17/f1f [0,4194304] 0 2024-09-10T09:36:02.761 INFO:tasks.workunit.client.0.smithi079.stdout:0/334: truncate d4/f5 1708953 0 2024-09-10T09:36:02.761 INFO:tasks.workunit.client.0.smithi079.stdout:4/290: mkdir d1/da/d3b/d5f 0 2024-09-10T09:36:02.767 INFO:tasks.workunit.client.0.smithi079.stdout:0/335: mkdir d4/d12/d16/d53/d79 0 2024-09-10T09:36:02.767 INFO:tasks.workunit.client.0.smithi079.stdout:0/336: fdatasync d4/d12/d39/f48 0 2024-09-10T09:36:02.769 INFO:tasks.workunit.client.0.smithi079.stdout:4/291: truncate d1/d38/f56 181643 0 2024-09-10T09:36:02.769 INFO:tasks.workunit.client.0.smithi079.stdout:4/292: chown d1/ff 395 1 2024-09-10T09:36:02.769 INFO:tasks.workunit.client.0.smithi079.stdout:4/293: write d1/da/f3f [719424,88656] 0 2024-09-10T09:36:02.776 INFO:tasks.workunit.client.0.smithi079.stdout:6/325: dwrite f3 [0,4194304] 0 2024-09-10T09:36:02.776 INFO:tasks.workunit.client.0.smithi079.stdout:5/276: dwrite d2/f26 [0,4194304] 0 2024-09-10T09:36:02.776 INFO:tasks.workunit.client.0.smithi079.stdout:6/326: creat d4/d8/f67 x:0 0 0 2024-09-10T09:36:02.776 INFO:tasks.workunit.client.0.smithi079.stdout:6/327: stat d4/d8/dd/d41/d51/f5b 0 2024-09-10T09:36:02.776 INFO:tasks.workunit.client.0.smithi079.stdout:6/328: write d4/d8/f67 [484503,86144] 0 2024-09-10T09:36:02.777 INFO:tasks.workunit.client.0.smithi079.stdout:8/346: dwrite d11/d2b/f3f [0,4194304] 0 2024-09-10T09:36:02.777 INFO:tasks.workunit.client.0.smithi079.stdout:8/347: stat d11/f14 0 2024-09-10T09:36:02.777 INFO:tasks.workunit.client.0.smithi079.stdout:8/348: creat d11/d2b/d4b/d50/d5c/f71 x:0 0 0 2024-09-10T09:36:02.779 INFO:tasks.workunit.client.0.smithi079.stdout:5/277: truncate d2/f20 2677928 0 2024-09-10T09:36:02.779 INFO:tasks.workunit.client.0.smithi079.stdout:5/278: creat d2/f60 x:0 0 0 2024-09-10T09:36:02.783 INFO:tasks.workunit.client.0.smithi079.stdout:1/344: dwrite d5/d24/d36/d3a/f50 [0,4194304] 0 2024-09-10T09:36:02.784 INFO:tasks.workunit.client.0.smithi079.stdout:7/276: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:36:02.784 INFO:tasks.workunit.client.0.smithi079.stdout:7/277: readlink d4/le 0 2024-09-10T09:36:02.786 INFO:tasks.workunit.client.0.smithi079.stdout:5/279: mkdir d2/d3/d5e/d61 0 2024-09-10T09:36:02.790 INFO:tasks.workunit.client.0.smithi079.stdout:8/349: rename d11/f28 to d11/f72 0 2024-09-10T09:36:02.792 INFO:tasks.workunit.client.0.smithi079.stdout:5/280: dread d2/f31 [0,4194304] 0 2024-09-10T09:36:02.793 INFO:tasks.workunit.client.0.smithi079.stdout:1/345: rename d5/d40/d46/l4a to d5/df/d41/d6a/l6c 0 2024-09-10T09:36:02.795 INFO:tasks.workunit.client.0.smithi079.stdout:7/278: rmdir d4/dc/d43/d4d 0 2024-09-10T09:36:02.797 INFO:tasks.workunit.client.0.smithi079.stdout:8/350: symlink d11/d2b/d4b/d50/l73 0 2024-09-10T09:36:02.798 INFO:tasks.workunit.client.0.smithi079.stdout:2/267: dwrite d4/dc/d29/d1b/d38/d39/d31/f46 [0,4194304] 0 2024-09-10T09:36:02.798 INFO:tasks.workunit.client.0.smithi079.stdout:5/281: symlink d2/d3/d27/d32/l62 0 2024-09-10T09:36:02.799 INFO:tasks.workunit.client.0.smithi079.stdout:9/264: dwrite d3/d7/dc/de/f46 [0,4194304] 0 2024-09-10T09:36:02.799 INFO:tasks.workunit.client.0.smithi079.stdout:9/265: chown d3/d7/f3b 388498 1 2024-09-10T09:36:02.799 INFO:tasks.workunit.client.0.smithi079.stdout:6/329: dwrite d4/d8/dd/d41/f54 [0,4194304] 0 2024-09-10T09:36:02.799 INFO:tasks.workunit.client.0.smithi079.stdout:6/330: dread - d4/d8/f3b zero size 2024-09-10T09:36:02.803 INFO:tasks.workunit.client.0.smithi079.stdout:8/351: mkdir d11/d2b/d4b/d74 0 2024-09-10T09:36:02.804 INFO:tasks.workunit.client.0.smithi079.stdout:3/344: sync 2024-09-10T09:36:02.812 INFO:tasks.workunit.client.0.smithi079.stdout:5/282: creat d2/d3/f63 x:0 0 0 2024-09-10T09:36:02.812 INFO:tasks.workunit.client.0.smithi079.stdout:4/294: rmdir d1/d38 39 2024-09-10T09:36:02.812 INFO:tasks.workunit.client.0.smithi079.stdout:4/295: fdatasync d1/da/d16/f27 0 2024-09-10T09:36:02.812 INFO:tasks.workunit.client.0.smithi079.stdout:7/279: read d4/df/d19/f2e [2808077,125153] 0 2024-09-10T09:36:02.813 INFO:tasks.workunit.client.0.smithi079.stdout:7/280: chown d4 15871646 1 2024-09-10T09:36:02.817 INFO:tasks.workunit.client.0.smithi079.stdout:9/266: mknod d3/d7/c50 0 2024-09-10T09:36:02.817 INFO:tasks.workunit.client.0.smithi079.stdout:9/267: creat d3/d7/d26/f51 x:0 0 0 2024-09-10T09:36:02.819 INFO:tasks.workunit.client.0.smithi079.stdout:1/346: dwrite d5/d24/d36/d53/f61 [0,4194304] 0 2024-09-10T09:36:02.819 INFO:tasks.workunit.client.0.smithi079.stdout:1/347: write d5/df/f52 [46541,123773] 0 2024-09-10T09:36:02.821 INFO:tasks.workunit.client.0.smithi079.stdout:6/331: symlink d4/d8/dc/d12/d29/l68 0 2024-09-10T09:36:02.824 INFO:tasks.workunit.client.0.smithi079.stdout:3/345: dwrite d4/f13 [4194304,4194304] 0 2024-09-10T09:36:02.824 INFO:tasks.workunit.client.0.smithi079.stdout:3/346: readlink d4/da/l1d 0 2024-09-10T09:36:02.828 INFO:tasks.workunit.client.0.smithi079.stdout:8/352: unlink d11/d48/f6d 0 2024-09-10T09:36:02.828 INFO:tasks.workunit.client.0.smithi079.stdout:8/353: read - d11/d48/f6a zero size 2024-09-10T09:36:02.829 INFO:tasks.workunit.client.0.smithi079.stdout:8/354: read d11/d2b/d4b/d50/d55/f65 [4474171,14777] 0 2024-09-10T09:36:02.829 INFO:tasks.workunit.client.0.smithi079.stdout:8/355: chown d11/d2b/d4b/f6b 539578 1 2024-09-10T09:36:02.829 INFO:tasks.workunit.client.0.smithi079.stdout:8/356: readlink d11/d2b/l44 0 2024-09-10T09:36:02.830 INFO:tasks.workunit.client.0.smithi079.stdout:2/268: link d4/c9 d4/dc/d1c/c5b 0 2024-09-10T09:36:02.833 INFO:tasks.workunit.client.0.smithi079.stdout:4/296: mknod d1/da/d16/d21/d32/c60 0 2024-09-10T09:36:02.834 INFO:tasks.workunit.client.0.smithi079.stdout:7/281: symlink d4/df/d19/l50 0 2024-09-10T09:36:02.839 INFO:tasks.workunit.client.0.smithi079.stdout:9/268: rename d3/d7/dc/de/f33 to d3/d7/dc/de/d17/f52 0 2024-09-10T09:36:02.839 INFO:tasks.workunit.client.0.smithi079.stdout:9/269: chown d3/d7/dc/de/d17/d2f/d30/c49 986 1 2024-09-10T09:36:02.839 INFO:tasks.workunit.client.0.smithi079.stdout:9/270: chown d3/d7 73739252 1 2024-09-10T09:36:02.843 INFO:tasks.workunit.client.0.smithi079.stdout:6/332: symlink d4/d35/d39/d4b/l69 0 2024-09-10T09:36:02.844 INFO:tasks.workunit.client.0.smithi079.stdout:6/333: chown d4/d8/dd/d41 153879889 1 2024-09-10T09:36:02.845 INFO:tasks.workunit.client.0.smithi079.stdout:3/347: mknod d4/da/d17/d2d/d43/d49/c5f 0 2024-09-10T09:36:02.845 INFO:tasks.workunit.client.0.smithi079.stdout:3/348: fdatasync d4/da/d17/f32 0 2024-09-10T09:36:02.845 INFO:tasks.workunit.client.0.smithi079.stdout:3/349: creat d4/da/d17/d2d/d43/d4c/f60 x:0 0 0 2024-09-10T09:36:02.846 INFO:tasks.workunit.client.0.smithi079.stdout:2/269: mknod d4/dc/d29/d1b/d38/c5c 0 2024-09-10T09:36:02.846 INFO:tasks.workunit.client.0.smithi079.stdout:2/270: chown d4/dc/d29/d1b/d38/d39/f45 1738 1 2024-09-10T09:36:02.853 INFO:tasks.workunit.client.0.smithi079.stdout:6/334: dread d4/d8/dc/f37 [0,4194304] 0 2024-09-10T09:36:02.853 INFO:tasks.workunit.client.0.smithi079.stdout:6/335: chown d4/f40 1555 1 2024-09-10T09:36:02.860 INFO:tasks.workunit.client.0.smithi079.stdout:6/336: dread d4/d8/dc/d12/d29/f62 [0,4194304] 0 2024-09-10T09:36:02.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/283: rmdir d2 39 2024-09-10T09:36:02.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/284: readlink d2/d3/d27/d32/l5f 0 2024-09-10T09:36:02.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/285: fsync d2/d3/fe 0 2024-09-10T09:36:02.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/286: write d2/f6 [1649513,756] 0 2024-09-10T09:36:02.915 INFO:tasks.workunit.client.0.smithi079.stdout:5/287: chown d2/d3/l5 15 1 2024-09-10T09:36:02.916 INFO:tasks.workunit.client.0.smithi079.stdout:4/297: symlink d1/da/d3b/d5f/l61 0 2024-09-10T09:36:02.916 INFO:tasks.workunit.client.0.smithi079.stdout:4/298: readlink d1/l4a 0 2024-09-10T09:36:02.916 INFO:tasks.workunit.client.0.smithi079.stdout:4/299: write d1/da/f2c [1464412,3796] 0 2024-09-10T09:36:02.923 INFO:tasks.workunit.client.0.smithi079.stdout:5/288: dread d2/f6 [0,4194304] 0 2024-09-10T09:36:02.937 INFO:tasks.workunit.client.0.smithi079.stdout:5/289: dwrite d2/f1d [0,4194304] 0 2024-09-10T09:36:02.971 INFO:tasks.workunit.client.0.smithi079.stdout:1/348: rename d5/df/c38 to d5/df/d2e/c6d 0 2024-09-10T09:36:02.971 INFO:tasks.workunit.client.0.smithi079.stdout:1/349: readlink d5/df/d41/d6a/l6c 0 2024-09-10T09:36:02.972 INFO:tasks.workunit.client.0.smithi079.stdout:1/350: stat d5/df/d11/l1f 0 2024-09-10T09:36:02.975 INFO:tasks.workunit.client.0.smithi079.stdout:3/350: unlink d4/da/d17/d2d/f31 0 2024-09-10T09:36:02.975 INFO:tasks.workunit.client.0.smithi079.stdout:3/351: chown d4/da/d17/d2d/d43 240391 1 2024-09-10T09:36:02.977 INFO:tasks.workunit.client.0.smithi079.stdout:6/337: creat d4/d8/dc/d3c/f6a x:0 0 0 2024-09-10T09:36:02.982 INFO:tasks.workunit.client.0.smithi079.stdout:7/282: getdents d4/dc 0 2024-09-10T09:36:02.983 INFO:tasks.workunit.client.0.smithi079.stdout:7/283: fsync d4/df/d19/f48 0 2024-09-10T09:36:02.983 INFO:tasks.workunit.client.0.smithi079.stdout:7/284: write d4/d6/f16 [1544601,106822] 0 2024-09-10T09:36:02.986 INFO:tasks.workunit.client.0.smithi079.stdout:8/357: rename d11/f14 to d11/d2b/f75 0 2024-09-10T09:36:02.988 INFO:tasks.workunit.client.0.smithi079.stdout:1/351: mkdir d5/df/d41/d6e 0 2024-09-10T09:36:02.989 INFO:tasks.workunit.client.0.smithi079.stdout:2/271: mkdir d4/d5d 0 2024-09-10T09:36:02.989 INFO:tasks.workunit.client.0.smithi079.stdout:6/338: dread d4/d8/f20 [0,4194304] 0 2024-09-10T09:36:02.989 INFO:tasks.workunit.client.0.smithi079.stdout:6/339: fdatasync d4/d35/d39/d4b/f4c 0 2024-09-10T09:36:02.990 INFO:tasks.workunit.client.0.smithi079.stdout:7/285: creat d4/d6/d3e/f51 x:0 0 0 2024-09-10T09:36:02.992 INFO:tasks.workunit.client.0.smithi079.stdout:9/271: rename d3/d7/l20 to d3/l53 0 2024-09-10T09:36:02.992 INFO:tasks.workunit.client.0.smithi079.stdout:0/337: sync 2024-09-10T09:36:02.992 INFO:tasks.workunit.client.0.smithi079.stdout:3/352: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:02.994 INFO:tasks.workunit.client.0.smithi079.stdout:6/340: rename d4/c7 to d4/c6b 0 2024-09-10T09:36:02.994 INFO:tasks.workunit.client.0.smithi079.stdout:6/341: chown d4/d8/dc/d12/d29/l4a 22857040 1 2024-09-10T09:36:02.994 INFO:tasks.workunit.client.0.smithi079.stdout:1/352: dread d5/f22 [0,4194304] 0 2024-09-10T09:36:02.994 INFO:tasks.workunit.client.0.smithi079.stdout:9/272: dread d3/f16 [0,4194304] 0 2024-09-10T09:36:02.994 INFO:tasks.workunit.client.0.smithi079.stdout:3/353: dread d4/da/d17/d38/d42/f53 [0,4194304] 0 2024-09-10T09:36:02.998 INFO:tasks.workunit.client.0.smithi079.stdout:4/300: rename d1/da/d16/f30 to d1/da/d3b/d5f/f62 0 2024-09-10T09:36:02.998 INFO:tasks.workunit.client.0.smithi079.stdout:4/301: chown d1/da/d16/f27 7 1 2024-09-10T09:36:02.998 INFO:tasks.workunit.client.0.smithi079.stdout:4/302: fdatasync d1/d38/f56 0 2024-09-10T09:36:02.998 INFO:tasks.workunit.client.0.smithi079.stdout:4/303: stat d1/d38/f56 0 2024-09-10T09:36:02.999 INFO:tasks.workunit.client.0.smithi079.stdout:3/354: dread d4/da/d17/f3f [0,4194304] 0 2024-09-10T09:36:02.999 INFO:tasks.workunit.client.0.smithi079.stdout:8/358: dread d11/d2b/f4c [0,4194304] 0 2024-09-10T09:36:03.002 INFO:tasks.workunit.client.0.smithi079.stdout:6/342: link d4/d8/dd/l50 d4/d8/dd/d41/d51/l6c 0 2024-09-10T09:36:03.002 INFO:tasks.workunit.client.0.smithi079.stdout:2/272: dread d4/dc/d29/f3f [4194304,4194304] 0 2024-09-10T09:36:03.003 INFO:tasks.workunit.client.0.smithi079.stdout:7/286: getdents d4/df 0 2024-09-10T09:36:03.006 INFO:tasks.workunit.client.0.smithi079.stdout:1/353: symlink d5/d40/l6f 0 2024-09-10T09:36:03.012 INFO:tasks.workunit.client.0.smithi079.stdout:4/304: creat d1/da/d3b/d5a/f63 x:0 0 0 2024-09-10T09:36:03.013 INFO:tasks.workunit.client.0.smithi079.stdout:4/305: stat d1/da/d16/f1f 0 2024-09-10T09:36:03.015 INFO:tasks.workunit.client.0.smithi079.stdout:3/355: symlink d4/da/d17/d2d/d43/d4c/l61 0 2024-09-10T09:36:03.016 INFO:tasks.workunit.client.0.smithi079.stdout:3/356: write d4/da/d17/d2d/d43/d4c/f60 [852014,32794] 0 2024-09-10T09:36:03.017 INFO:tasks.workunit.client.0.smithi079.stdout:0/338: dwrite d4/d12/f40 [0,4194304] 0 2024-09-10T09:36:03.018 INFO:tasks.workunit.client.0.smithi079.stdout:8/359: rename d11/f72 to d11/d2b/f76 0 2024-09-10T09:36:03.021 INFO:tasks.workunit.client.0.smithi079.stdout:7/287: creat d4/d6/d4f/f52 x:0 0 0 2024-09-10T09:36:03.022 INFO:tasks.workunit.client.0.smithi079.stdout:7/288: creat d4/df/d19/f53 x:0 0 0 2024-09-10T09:36:03.022 INFO:tasks.workunit.client.0.smithi079.stdout:7/289: write d4/d6/f16 [990132,38962] 0 2024-09-10T09:36:03.024 INFO:tasks.workunit.client.0.smithi079.stdout:0/339: symlink d4/d12/d1a/d6d/l7a 0 2024-09-10T09:36:03.026 INFO:tasks.workunit.client.0.smithi079.stdout:8/360: creat d11/d2b/d4b/f77 x:0 0 0 2024-09-10T09:36:03.027 INFO:tasks.workunit.client.0.smithi079.stdout:8/361: fsync ff 0 2024-09-10T09:36:03.027 INFO:tasks.workunit.client.0.smithi079.stdout:8/362: read - d11/d2b/d4b/f6b zero size 2024-09-10T09:36:03.027 INFO:tasks.workunit.client.0.smithi079.stdout:2/273: write d4/dc/d13/f33 [2934287,53622] 0 2024-09-10T09:36:03.030 INFO:tasks.workunit.client.0.smithi079.stdout:6/343: dwrite d4/d8/dc/d12/d29/f44 [0,4194304] 0 2024-09-10T09:36:03.031 INFO:tasks.workunit.client.0.smithi079.stdout:0/340: mkdir d4/d12/d1a/d6d/d7b 0 2024-09-10T09:36:03.032 INFO:tasks.workunit.client.0.smithi079.stdout:2/274: mknod d4/dc/d13/c5e 0 2024-09-10T09:36:03.034 INFO:tasks.workunit.client.0.smithi079.stdout:6/344: link d4/d8/c9 d4/d35/d39/d4b/c6d 0 2024-09-10T09:36:03.035 INFO:tasks.workunit.client.0.smithi079.stdout:6/345: creat d4/d35/d39/f6e x:0 0 0 2024-09-10T09:36:03.035 INFO:tasks.workunit.client.0.smithi079.stdout:6/346: creat d4/d8/dc/f6f x:0 0 0 2024-09-10T09:36:03.038 INFO:tasks.workunit.client.0.smithi079.stdout:6/347: mkdir d4/d8/dc/d12/d70 0 2024-09-10T09:36:03.038 INFO:tasks.workunit.client.0.smithi079.stdout:9/273: dwrite d3/d7/dc/de/d17/f21 [0,4194304] 0 2024-09-10T09:36:03.038 INFO:tasks.workunit.client.0.smithi079.stdout:1/354: write d5/d24/d36/d3a/f50 [1012014,88112] 0 2024-09-10T09:36:03.038 INFO:tasks.workunit.client.0.smithi079.stdout:9/274: write d3/f2b [367486,84186] 0 2024-09-10T09:36:03.040 INFO:tasks.workunit.client.0.smithi079.stdout:7/290: dwrite d4/df/d19/f53 [0,4194304] 0 2024-09-10T09:36:03.040 INFO:tasks.workunit.client.0.smithi079.stdout:7/291: creat d4/d6/d38/f54 x:0 0 0 2024-09-10T09:36:03.040 INFO:tasks.workunit.client.0.smithi079.stdout:7/292: write d4/d6/f16 [655699,52772] 0 2024-09-10T09:36:03.040 INFO:tasks.workunit.client.0.smithi079.stdout:7/293: truncate d4/d6/d38/f54 522475 0 2024-09-10T09:36:03.040 INFO:tasks.workunit.client.0.smithi079.stdout:7/294: dread - d4/f42 zero size 2024-09-10T09:36:03.040 INFO:tasks.workunit.client.0.smithi079.stdout:0/341: getdents d4/d12/d15 0 2024-09-10T09:36:03.041 INFO:tasks.workunit.client.0.smithi079.stdout:4/306: dwrite d1/da/fb [0,4194304] 0 2024-09-10T09:36:03.041 INFO:tasks.workunit.client.0.smithi079.stdout:4/307: readlink d1/l37 0 2024-09-10T09:36:03.041 INFO:tasks.workunit.client.0.smithi079.stdout:0/342: write d4/d12/d1a/f51 [1093489,70042] 0 2024-09-10T09:36:03.041 INFO:tasks.workunit.client.0.smithi079.stdout:0/343: dread - d4/d12/d21/f54 zero size 2024-09-10T09:36:03.042 INFO:tasks.workunit.client.0.smithi079.stdout:6/348: link d4/d8/dd/d41/f56 d4/d35/f71 0 2024-09-10T09:36:03.045 INFO:tasks.workunit.client.0.smithi079.stdout:1/355: unlink d5/d24/d36/f69 0 2024-09-10T09:36:03.049 INFO:tasks.workunit.client.0.smithi079.stdout:9/275: link d3/d7/dc/de/d17/c18 d3/d7/c54 0 2024-09-10T09:36:03.049 INFO:tasks.workunit.client.0.smithi079.stdout:9/276: chown d3/d7 10 1 2024-09-10T09:36:03.050 INFO:tasks.workunit.client.0.smithi079.stdout:2/275: dread d4/dc/d29/f16 [0,4194304] 0 2024-09-10T09:36:03.057 INFO:tasks.workunit.client.0.smithi079.stdout:7/295: mkdir d4/d6/d38/d55 0 2024-09-10T09:36:03.058 INFO:tasks.workunit.client.0.smithi079.stdout:0/344: dwrite d4/d12/d39/f46 [0,4194304] 0 2024-09-10T09:36:03.060 INFO:tasks.workunit.client.0.smithi079.stdout:0/345: dread d4/d12/d39/f6e [0,4194304] 0 2024-09-10T09:36:03.062 INFO:tasks.workunit.client.0.smithi079.stdout:1/356: write d5/d24/f2f [4025007,85157] 0 2024-09-10T09:36:03.062 INFO:tasks.workunit.client.0.smithi079.stdout:6/349: rename d4/d8/dd/d41/l64 to d4/d8/dc/d1c/l72 0 2024-09-10T09:36:03.067 INFO:tasks.workunit.client.0.smithi079.stdout:9/277: dread d3/d7/dc/de/f46 [0,4194304] 0 2024-09-10T09:36:03.067 INFO:tasks.workunit.client.0.smithi079.stdout:9/278: chown d3/f11 3315892 1 2024-09-10T09:36:03.067 INFO:tasks.workunit.client.0.smithi079.stdout:4/308: getdents d1/da 0 2024-09-10T09:36:03.075 INFO:tasks.workunit.client.0.smithi079.stdout:0/346: symlink d4/d12/d1a/d6d/l7c 0 2024-09-10T09:36:03.078 INFO:tasks.workunit.client.0.smithi079.stdout:7/296: dwrite d4/df/d19/f2e [4194304,4194304] 0 2024-09-10T09:36:03.079 INFO:tasks.workunit.client.0.smithi079.stdout:2/276: getdents d4/dc/d13 0 2024-09-10T09:36:03.082 INFO:tasks.workunit.client.0.smithi079.stdout:9/279: unlink d3/l53 0 2024-09-10T09:36:03.082 INFO:tasks.workunit.client.0.smithi079.stdout:1/357: mkdir d5/d4f/d70 0 2024-09-10T09:36:03.085 INFO:tasks.workunit.client.0.smithi079.stdout:0/347: truncate d4/d12/f40 2905991 0 2024-09-10T09:36:03.090 INFO:tasks.workunit.client.0.smithi079.stdout:6/350: dwrite d4/d8/dc/d1c/f53 [0,4194304] 0 2024-09-10T09:36:03.090 INFO:tasks.workunit.client.0.smithi079.stdout:6/351: write d4/d8/dc/d1c/f38 [897224,61105] 0 2024-09-10T09:36:03.101 INFO:tasks.workunit.client.0.smithi079.stdout:9/280: rmdir d3/d7/dc/de/d17 39 2024-09-10T09:36:03.101 INFO:tasks.workunit.client.0.smithi079.stdout:4/309: rename d1/da/d16/f22 to d1/da/d16/d21/d32/f64 0 2024-09-10T09:36:03.101 INFO:tasks.workunit.client.0.smithi079.stdout:4/310: truncate d1/f3a 278459 0 2024-09-10T09:36:03.103 INFO:tasks.workunit.client.0.smithi079.stdout:4/311: dread d1/da/f3f [0,4194304] 0 2024-09-10T09:36:03.105 INFO:tasks.workunit.client.0.smithi079.stdout:6/352: stat d4/d8/dc/d1c/l72 0 2024-09-10T09:36:03.105 INFO:tasks.workunit.client.0.smithi079.stdout:6/353: truncate d4/d8/f5d 42572 0 2024-09-10T09:36:03.108 INFO:tasks.workunit.client.0.smithi079.stdout:1/358: rename d5/df/d41/l6b to d5/df/d2e/l71 0 2024-09-10T09:36:03.109 INFO:tasks.workunit.client.0.smithi079.stdout:4/312: rmdir d1/da/d28/d47/d52 39 2024-09-10T09:36:03.115 INFO:tasks.workunit.client.0.smithi079.stdout:6/354: creat d4/d8/dc/d12/f73 x:0 0 0 2024-09-10T09:36:03.115 INFO:tasks.workunit.client.0.smithi079.stdout:6/355: truncate d4/d8/dc/f66 802090 0 2024-09-10T09:36:03.117 INFO:tasks.workunit.client.0.smithi079.stdout:7/297: dwrite d4/dc/f25 [0,4194304] 0 2024-09-10T09:36:03.117 INFO:tasks.workunit.client.0.smithi079.stdout:7/298: creat d4/df/d3d/f56 x:0 0 0 2024-09-10T09:36:03.117 INFO:tasks.workunit.client.0.smithi079.stdout:7/299: fdatasync d4/df/d19/f2b 0 2024-09-10T09:36:03.119 INFO:tasks.workunit.client.0.smithi079.stdout:0/348: dwrite d4/d12/d15/d2b/f63 [0,4194304] 0 2024-09-10T09:36:03.121 INFO:tasks.workunit.client.0.smithi079.stdout:4/313: mknod d1/da/d16/c65 0 2024-09-10T09:36:03.121 INFO:tasks.workunit.client.0.smithi079.stdout:1/359: dread d5/d24/f2f [0,4194304] 0 2024-09-10T09:36:03.121 INFO:tasks.workunit.client.0.smithi079.stdout:1/360: readlink d5/d24/d36/l5d 0 2024-09-10T09:36:03.122 INFO:tasks.workunit.client.0.smithi079.stdout:6/356: getdents d4 0 2024-09-10T09:36:03.122 INFO:tasks.workunit.client.0.smithi079.stdout:6/357: stat d4/d8/dd/d41/d51/f5c 0 2024-09-10T09:36:03.126 INFO:tasks.workunit.client.0.smithi079.stdout:7/300: creat d4/dc/d43/f57 x:0 0 0 2024-09-10T09:36:03.137 INFO:tasks.workunit.client.0.smithi079.stdout:9/281: dwrite d3/d40/f4e [0,4194304] 0 2024-09-10T09:36:03.139 INFO:tasks.workunit.client.0.smithi079.stdout:4/314: dread d1/da/d28/d47/f4c [0,4194304] 0 2024-09-10T09:36:03.142 INFO:tasks.workunit.client.0.smithi079.stdout:5/290: sync 2024-09-10T09:36:03.142 INFO:tasks.workunit.client.0.smithi079.stdout:5/291: chown d2/d3/f38 1235522 1 2024-09-10T09:36:03.144 INFO:tasks.workunit.client.0.smithi079.stdout:0/349: unlink d4/d1d/d24/f61 0 2024-09-10T09:36:03.144 INFO:tasks.workunit.client.0.smithi079.stdout:0/350: write d4/d12/d39/f6e [950072,108128] 0 2024-09-10T09:36:03.144 INFO:tasks.workunit.client.0.smithi079.stdout:0/351: readlink d4/d12/l3b 0 2024-09-10T09:36:03.144 INFO:tasks.workunit.client.0.smithi079.stdout:0/352: stat d4/d1d/l30 0 2024-09-10T09:36:03.145 INFO:tasks.workunit.client.0.smithi079.stdout:7/301: symlink d4/d6/d38/l58 0 2024-09-10T09:36:03.146 INFO:tasks.workunit.client.0.smithi079.stdout:9/282: symlink d3/d7/d26/d3d/l55 0 2024-09-10T09:36:03.146 INFO:tasks.workunit.client.0.smithi079.stdout:9/283: creat d3/d7/dc/de/d17/d2f/d30/f56 x:0 0 0 2024-09-10T09:36:03.147 INFO:tasks.workunit.client.0.smithi079.stdout:4/315: mknod d1/da/c66 0 2024-09-10T09:36:03.147 INFO:tasks.workunit.client.0.smithi079.stdout:4/316: write d1/da/f3f [1477127,47386] 0 2024-09-10T09:36:03.147 INFO:tasks.workunit.client.0.smithi079.stdout:4/317: chown d1/da/d28/f29 4017 1 2024-09-10T09:36:03.147 INFO:tasks.workunit.client.0.smithi079.stdout:5/292: mknod d2/d41/c64 0 2024-09-10T09:36:03.148 INFO:tasks.workunit.client.0.smithi079.stdout:5/293: fdatasync d2/d41/d4d/f57 0 2024-09-10T09:36:03.149 INFO:tasks.workunit.client.0.smithi079.stdout:0/353: mkdir d4/d12/d1a/d29/d32/d7d 0 2024-09-10T09:36:03.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/302: symlink d4/df/d19/l59 0 2024-09-10T09:36:03.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/303: dread - d4/df/d3d/f41 zero size 2024-09-10T09:36:03.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/304: chown d4/d6/d3e/f51 89 1 2024-09-10T09:36:03.153 INFO:tasks.workunit.client.0.smithi079.stdout:1/361: dwrite d5/f20 [0,4194304] 0 2024-09-10T09:36:03.153 INFO:tasks.workunit.client.0.smithi079.stdout:1/362: creat d5/d24/d36/d3a/d3c/f72 x:0 0 0 2024-09-10T09:36:03.153 INFO:tasks.workunit.client.0.smithi079.stdout:9/284: rename d3/d7/dc/de/d17/c18 to d3/d7/dc/de/d17/d2f/c57 0 2024-09-10T09:36:03.154 INFO:tasks.workunit.client.0.smithi079.stdout:6/358: dwrite d4/d8/f67 [0,4194304] 0 2024-09-10T09:36:03.154 INFO:tasks.workunit.client.0.smithi079.stdout:6/359: readlink d4/d8/dd/d41/l5f 0 2024-09-10T09:36:03.154 INFO:tasks.workunit.client.0.smithi079.stdout:4/318: chown d1/da/d16/c1d 20 1 2024-09-10T09:36:03.154 INFO:tasks.workunit.client.0.smithi079.stdout:4/319: fdatasync d1/da/f45 0 2024-09-10T09:36:03.154 INFO:tasks.workunit.client.0.smithi079.stdout:4/320: read d1/da/d28/f29 [1877430,111908] 0 2024-09-10T09:36:03.154 INFO:tasks.workunit.client.0.smithi079.stdout:4/321: read d1/da/d16/f24 [725647,31996] 0 2024-09-10T09:36:03.155 INFO:tasks.workunit.client.0.smithi079.stdout:4/322: readlink d1/da/d28/l39 0 2024-09-10T09:36:03.157 INFO:tasks.workunit.client.0.smithi079.stdout:5/294: unlink d2/d3/d27/d32/f52 0 2024-09-10T09:36:03.159 INFO:tasks.workunit.client.0.smithi079.stdout:0/354: symlink d4/d12/d1a/d6d/l7e 0 2024-09-10T09:36:03.160 INFO:tasks.workunit.client.0.smithi079.stdout:7/305: mknod d4/d6/d38/d55/c5a 0 2024-09-10T09:36:03.169 INFO:tasks.workunit.client.0.smithi079.stdout:1/363: rename d5/f20 to d5/d4f/f73 0 2024-09-10T09:36:03.172 INFO:tasks.workunit.client.0.smithi079.stdout:7/306: write d4/df/d19/f2e [5169332,129215] 0 2024-09-10T09:36:03.174 INFO:tasks.workunit.client.0.smithi079.stdout:6/360: unlink d4/d35/d39/f6e 0 2024-09-10T09:36:03.176 INFO:tasks.workunit.client.0.smithi079.stdout:5/295: link d2/c2d d2/d3/d27/d32/d44/c65 0 2024-09-10T09:36:03.176 INFO:tasks.workunit.client.0.smithi079.stdout:5/296: readlink d2/d3/d27/d32/d39/l4b 0 2024-09-10T09:36:03.176 INFO:tasks.workunit.client.0.smithi079.stdout:5/297: getdents d2/d3/d5e/d61 0 2024-09-10T09:36:03.176 INFO:tasks.workunit.client.0.smithi079.stdout:5/298: write d2/d3/d27/f43 [1002644,41227] 0 2024-09-10T09:36:03.177 INFO:tasks.workunit.client.0.smithi079.stdout:0/355: symlink d4/d1d/l7f 0 2024-09-10T09:36:03.178 INFO:tasks.workunit.client.0.smithi079.stdout:1/364: mkdir d5/df/d41/d6e/d74 0 2024-09-10T09:36:03.178 INFO:tasks.workunit.client.0.smithi079.stdout:1/365: chown d5/df 10493 1 2024-09-10T09:36:03.178 INFO:tasks.workunit.client.0.smithi079.stdout:1/366: truncate d5/df/f52 660774 0 2024-09-10T09:36:03.178 INFO:tasks.workunit.client.0.smithi079.stdout:1/367: fdatasync d5/df/d2e/f39 0 2024-09-10T09:36:03.178 INFO:tasks.workunit.client.0.smithi079.stdout:7/307: mknod d4/dc/d43/c5b 0 2024-09-10T09:36:03.180 INFO:tasks.workunit.client.0.smithi079.stdout:5/299: creat d2/d3/d27/d32/d44/f66 x:0 0 0 2024-09-10T09:36:03.181 INFO:tasks.workunit.client.0.smithi079.stdout:0/356: mkdir d4/d12/d21/d3f/d80 0 2024-09-10T09:36:03.181 INFO:tasks.workunit.client.0.smithi079.stdout:1/368: truncate d5/df/d11/f2d 4306660 0 2024-09-10T09:36:03.182 INFO:tasks.workunit.client.0.smithi079.stdout:5/300: mknod d2/c67 0 2024-09-10T09:36:03.183 INFO:tasks.workunit.client.0.smithi079.stdout:9/285: dwrite d3/d7/dc/de/d17/d2f/d30/f45 [0,4194304] 0 2024-09-10T09:36:03.185 INFO:tasks.workunit.client.0.smithi079.stdout:0/357: rename d4/d12/d15/f28 to d4/f81 0 2024-09-10T09:36:03.185 INFO:tasks.workunit.client.0.smithi079.stdout:0/358: fsync d4/d12/d21/f54 0 2024-09-10T09:36:03.185 INFO:tasks.workunit.client.0.smithi079.stdout:4/323: dwrite d1/da/f2b [0,4194304] 0 2024-09-10T09:36:03.185 INFO:tasks.workunit.client.0.smithi079.stdout:1/369: rmdir d5/d24/d36/d3a/d48 39 2024-09-10T09:36:03.186 INFO:tasks.workunit.client.0.smithi079.stdout:7/308: write d4/f37 [3129763,14227] 0 2024-09-10T09:36:03.186 INFO:tasks.workunit.client.0.smithi079.stdout:7/309: write d4/f5 [4970145,71715] 0 2024-09-10T09:36:03.186 INFO:tasks.workunit.client.0.smithi079.stdout:7/310: chown d4/df/c20 121 1 2024-09-10T09:36:03.191 INFO:tasks.workunit.client.0.smithi079.stdout:9/286: mkdir d3/d7/dc/de/d58 0 2024-09-10T09:36:03.192 INFO:tasks.workunit.client.0.smithi079.stdout:5/301: dread d2/d3/fa [4194304,4194304] 0 2024-09-10T09:36:03.207 INFO:tasks.workunit.client.0.smithi079.stdout:3/357: sync 2024-09-10T09:36:03.210 INFO:tasks.workunit.client.0.smithi079.stdout:1/370: rename d5/d24/d36/f5a to d5/df/d11/f75 0 2024-09-10T09:36:03.211 INFO:tasks.workunit.client.0.smithi079.stdout:5/302: dread d2/d3/f16 [0,4194304] 0 2024-09-10T09:36:03.214 INFO:tasks.workunit.client.0.smithi079.stdout:0/359: dwrite d4/d12/d21/f3d [0,4194304] 0 2024-09-10T09:36:03.214 INFO:tasks.workunit.client.0.smithi079.stdout:0/360: creat d4/d12/d1a/f82 x:0 0 0 2024-09-10T09:36:03.216 INFO:tasks.workunit.client.0.smithi079.stdout:7/311: unlink d4/l13 0 2024-09-10T09:36:03.216 INFO:tasks.workunit.client.0.smithi079.stdout:7/312: fdatasync d4/dc/f25 0 2024-09-10T09:36:03.216 INFO:tasks.workunit.client.0.smithi079.stdout:7/313: dread - d4/dc/d43/f57 zero size 2024-09-10T09:36:03.218 INFO:tasks.workunit.client.0.smithi079.stdout:1/371: rmdir d5/d4f/d70 0 2024-09-10T09:36:03.219 INFO:tasks.workunit.client.0.smithi079.stdout:3/358: write d4/f13 [1115862,66748] 0 2024-09-10T09:36:03.219 INFO:tasks.workunit.client.0.smithi079.stdout:4/324: dwrite d1/f2e [0,4194304] 0 2024-09-10T09:36:03.220 INFO:tasks.workunit.client.0.smithi079.stdout:5/303: unlink d2/d41/c53 0 2024-09-10T09:36:03.223 INFO:tasks.workunit.client.0.smithi079.stdout:9/287: dwrite d3/d7/dc/de/d17/f21 [0,4194304] 0 2024-09-10T09:36:03.226 INFO:tasks.workunit.client.0.smithi079.stdout:0/361: truncate d4/d12/f40 22228 0 2024-09-10T09:36:03.226 INFO:tasks.workunit.client.0.smithi079.stdout:0/362: write d4/f70 [1511434,82330] 0 2024-09-10T09:36:03.231 INFO:tasks.workunit.client.0.smithi079.stdout:7/314: getdents d4/dc/d43 0 2024-09-10T09:36:03.231 INFO:tasks.workunit.client.0.smithi079.stdout:7/315: read - d4/df/d3d/f56 zero size 2024-09-10T09:36:03.232 INFO:tasks.workunit.client.0.smithi079.stdout:7/316: write d4/df/f4c [642180,56255] 0 2024-09-10T09:36:03.235 INFO:tasks.workunit.client.0.smithi079.stdout:7/317: creat d4/d6/d38/d55/f5c x:0 0 0 2024-09-10T09:36:03.236 INFO:tasks.workunit.client.0.smithi079.stdout:7/318: fsync d4/df/d3d/f56 0 2024-09-10T09:36:03.236 INFO:tasks.workunit.client.0.smithi079.stdout:7/319: chown d4/d6/f16 27 1 2024-09-10T09:36:03.236 INFO:tasks.workunit.client.0.smithi079.stdout:9/288: write d3/d7/f2a [355259,84584] 0 2024-09-10T09:36:03.241 INFO:tasks.workunit.client.0.smithi079.stdout:5/304: dread d2/f26 [0,4194304] 0 2024-09-10T09:36:03.241 INFO:tasks.workunit.client.0.smithi079.stdout:5/305: write d2/d3/d27/f43 [1236806,50525] 0 2024-09-10T09:36:03.241 INFO:tasks.workunit.client.0.smithi079.stdout:5/306: fsync d2/d3/f63 0 2024-09-10T09:36:03.246 INFO:tasks.workunit.client.0.smithi079.stdout:8/363: sync 2024-09-10T09:36:03.246 INFO:tasks.workunit.client.0.smithi079.stdout:2/277: sync 2024-09-10T09:36:03.246 INFO:tasks.workunit.client.0.smithi079.stdout:8/364: chown d11/c4f 282 1 2024-09-10T09:36:03.246 INFO:tasks.workunit.client.0.smithi079.stdout:2/278: fsync d4/dc/d29/f3f 0 2024-09-10T09:36:03.255 INFO:tasks.workunit.client.0.smithi079.stdout:8/365: write d11/f12 [3130692,97422] 0 2024-09-10T09:36:03.258 INFO:tasks.workunit.client.0.smithi079.stdout:1/372: dwrite d5/d24/d36/d3a/d48/f51 [0,4194304] 0 2024-09-10T09:36:03.263 INFO:tasks.workunit.client.0.smithi079.stdout:8/366: creat d11/d2b/d4b/d50/d55/f78 x:0 0 0 2024-09-10T09:36:03.265 INFO:tasks.workunit.client.0.smithi079.stdout:2/279: dread d4/dc/d29/d1b/d38/d39/f45 [0,4194304] 0 2024-09-10T09:36:03.265 INFO:tasks.workunit.client.0.smithi079.stdout:2/280: read d4/dc/d29/f16 [1026076,42192] 0 2024-09-10T09:36:03.265 INFO:tasks.workunit.client.0.smithi079.stdout:2/281: truncate d4/dc/d1c/f54 41301 0 2024-09-10T09:36:03.266 INFO:tasks.workunit.client.0.smithi079.stdout:7/320: fdatasync d4/df/f4c 0 2024-09-10T09:36:03.266 INFO:tasks.workunit.client.0.smithi079.stdout:7/321: chown d4 3 1 2024-09-10T09:36:03.266 INFO:tasks.workunit.client.0.smithi079.stdout:7/322: fdatasync d4/f42 0 2024-09-10T09:36:03.266 INFO:tasks.workunit.client.0.smithi079.stdout:7/323: readlink d4/dc/l1f 0 2024-09-10T09:36:03.268 INFO:tasks.workunit.client.0.smithi079.stdout:2/282: symlink d4/dc/d29/d1b/d38/d39/l5f 0 2024-09-10T09:36:03.268 INFO:tasks.workunit.client.0.smithi079.stdout:2/283: dread - d4/dc/d29/d1b/d38/f53 zero size 2024-09-10T09:36:03.268 INFO:tasks.workunit.client.0.smithi079.stdout:2/284: chown d4/dc/d29/d1b/d38/f53 0 1 2024-09-10T09:36:03.268 INFO:tasks.workunit.client.0.smithi079.stdout:2/285: read d4/dc/d1c/f28 [2885182,83932] 0 2024-09-10T09:36:03.268 INFO:tasks.workunit.client.0.smithi079.stdout:2/286: chown d4/dc/d29/d1b/d38/d39/f3c 3 1 2024-09-10T09:36:03.268 INFO:tasks.workunit.client.0.smithi079.stdout:4/325: dwrite d1/f9 [0,4194304] 0 2024-09-10T09:36:03.268 INFO:tasks.workunit.client.0.smithi079.stdout:3/359: dwrite d4/da/d17/d38/d42/f53 [0,4194304] 0 2024-09-10T09:36:03.269 INFO:tasks.workunit.client.0.smithi079.stdout:3/360: write d4/da/d17/d2d/f34 [731407,4344] 0 2024-09-10T09:36:03.269 INFO:tasks.workunit.client.0.smithi079.stdout:3/361: fdatasync d4/da/d18/f1c 0 2024-09-10T09:36:03.271 INFO:tasks.workunit.client.0.smithi079.stdout:1/373: rmdir d5 39 2024-09-10T09:36:03.273 INFO:tasks.workunit.client.0.smithi079.stdout:8/367: symlink d11/l79 0 2024-09-10T09:36:03.273 INFO:tasks.workunit.client.0.smithi079.stdout:0/363: dwrite d4/d47/f4c [0,4194304] 0 2024-09-10T09:36:03.277 INFO:tasks.workunit.client.0.smithi079.stdout:2/287: rename d4/dc/d1c/l36 to d4/dc/d29/d1b/d38/d39/l60 0 2024-09-10T09:36:03.278 INFO:tasks.workunit.client.0.smithi079.stdout:4/326: symlink d1/da/d16/d21/d32/l67 0 2024-09-10T09:36:03.278 INFO:tasks.workunit.client.0.smithi079.stdout:5/307: dwrite d2/f3d [0,4194304] 0 2024-09-10T09:36:03.278 INFO:tasks.workunit.client.0.smithi079.stdout:5/308: fsync d2/d41/f45 0 2024-09-10T09:36:03.278 INFO:tasks.workunit.client.0.smithi079.stdout:5/309: write d2/f3a [4235328,7819] 0 2024-09-10T09:36:03.278 INFO:tasks.workunit.client.0.smithi079.stdout:5/310: read - d2/d3/d27/d32/d44/f4c zero size 2024-09-10T09:36:03.278 INFO:tasks.workunit.client.0.smithi079.stdout:5/311: readlink d2/d3/d27/d32/d39/l4e 0 2024-09-10T09:36:03.279 INFO:tasks.workunit.client.0.smithi079.stdout:9/289: dwrite d3/d7/d26/f51 [0,4194304] 0 2024-09-10T09:36:03.279 INFO:tasks.workunit.client.0.smithi079.stdout:9/290: fsync d3/d40/f47 0 2024-09-10T09:36:03.279 INFO:tasks.workunit.client.0.smithi079.stdout:9/291: readlink d3/d7/dc/de/d17/d2f/d30/l3f 0 2024-09-10T09:36:03.279 INFO:tasks.workunit.client.0.smithi079.stdout:3/362: mkdir d4/da/d17/d62 0 2024-09-10T09:36:03.281 INFO:tasks.workunit.client.0.smithi079.stdout:1/374: mkdir d5/df/d11/d76 0 2024-09-10T09:36:03.281 INFO:tasks.workunit.client.0.smithi079.stdout:1/375: truncate d5/df/f52 832980 0 2024-09-10T09:36:03.285 INFO:tasks.workunit.client.0.smithi079.stdout:0/364: symlink d4/d12/d1a/d29/d32/l83 0 2024-09-10T09:36:03.285 INFO:tasks.workunit.client.0.smithi079.stdout:0/365: chown d4/d12/d1a/d6d/d7b 100 1 2024-09-10T09:36:03.292 INFO:tasks.workunit.client.0.smithi079.stdout:2/288: mkdir d4/dc/d13/d61 0 2024-09-10T09:36:03.295 INFO:tasks.workunit.client.0.smithi079.stdout:4/327: rmdir d1/da/d16/d4d 39 2024-09-10T09:36:03.299 INFO:tasks.workunit.client.0.smithi079.stdout:7/324: dwrite d4/d6/f2d [4194304,4194304] 0 2024-09-10T09:36:03.304 INFO:tasks.workunit.client.0.smithi079.stdout:3/363: dread d4/f7 [0,4194304] 0 2024-09-10T09:36:03.314 INFO:tasks.workunit.client.0.smithi079.stdout:0/366: unlink d4/d12/d16/c26 0 2024-09-10T09:36:03.315 INFO:tasks.workunit.client.0.smithi079.stdout:4/328: mknod d1/da/c68 0 2024-09-10T09:36:03.330 INFO:tasks.workunit.client.0.smithi079.stdout:3/364: symlink d4/da/d17/d2d/d43/l63 0 2024-09-10T09:36:03.330 INFO:tasks.workunit.client.0.smithi079.stdout:3/365: truncate d4/da/d17/f52 1278271 0 2024-09-10T09:36:03.331 INFO:tasks.workunit.client.0.smithi079.stdout:4/329: mknod d1/da/d3b/d5f/c69 0 2024-09-10T09:36:03.337 INFO:tasks.workunit.client.0.smithi079.stdout:4/330: unlink d1/da/f2c 0 2024-09-10T09:36:03.338 INFO:tasks.workunit.client.0.smithi079.stdout:0/367: write d4/d12/d15/d2b/f63 [4038187,67944] 0 2024-09-10T09:36:03.340 INFO:tasks.workunit.client.0.smithi079.stdout:0/368: read d4/d12/d1a/f51 [2463,22598] 0 2024-09-10T09:36:03.340 INFO:tasks.workunit.client.0.smithi079.stdout:0/369: fdatasync d4/d12/d16/d53/f6c 0 2024-09-10T09:36:03.340 INFO:tasks.workunit.client.0.smithi079.stdout:0/370: stat d4/d12/d1a/d29/f74 0 2024-09-10T09:36:03.350 INFO:tasks.workunit.client.0.smithi079.stdout:0/371: write d4/d12/d21/f3d [249532,122691] 0 2024-09-10T09:36:03.350 INFO:tasks.workunit.client.0.smithi079.stdout:9/292: dwrite d3/d7/dc/de/d17/d2f/f38 [0,4194304] 0 2024-09-10T09:36:03.351 INFO:tasks.workunit.client.0.smithi079.stdout:9/293: stat d3/d7/dc/de/d17 0 2024-09-10T09:36:03.351 INFO:tasks.workunit.client.0.smithi079.stdout:8/368: dwrite f8 [0,4194304] 0 2024-09-10T09:36:03.357 INFO:tasks.workunit.client.0.smithi079.stdout:2/289: dwrite d4/dc/d29/d1b/d38/d39/d31/d52/f5a [0,4194304] 0 2024-09-10T09:36:03.362 INFO:tasks.workunit.client.0.smithi079.stdout:7/325: dwrite d4/d6/f2d [4194304,4194304] 0 2024-09-10T09:36:03.362 INFO:tasks.workunit.client.0.smithi079.stdout:7/326: creat d4/f5d x:0 0 0 2024-09-10T09:36:03.363 INFO:tasks.workunit.client.0.smithi079.stdout:1/376: dwrite d5/d24/d36/d3a/f3d [0,4194304] 0 2024-09-10T09:36:03.363 INFO:tasks.workunit.client.0.smithi079.stdout:5/312: dwrite d2/d3/d27/f43 [0,4194304] 0 2024-09-10T09:36:03.376 INFO:tasks.workunit.client.0.smithi079.stdout:3/366: dwrite f2 [0,4194304] 0 2024-09-10T09:36:03.376 INFO:tasks.workunit.client.0.smithi079.stdout:4/331: dwrite d1/da/d28/d47/f4c [0,4194304] 0 2024-09-10T09:36:03.377 INFO:tasks.workunit.client.0.smithi079.stdout:7/327: symlink d4/d6/d38/d55/l5e 0 2024-09-10T09:36:03.382 INFO:tasks.workunit.client.0.smithi079.stdout:1/377: creat d5/d4f/f77 x:0 0 0 2024-09-10T09:36:03.383 INFO:tasks.workunit.client.0.smithi079.stdout:4/332: write d1/da/d16/d21/f2d [1791745,6299] 0 2024-09-10T09:36:03.385 INFO:tasks.workunit.client.0.smithi079.stdout:6/361: sync 2024-09-10T09:36:03.389 INFO:tasks.workunit.client.0.smithi079.stdout:3/367: mknod d4/da/d17/d2d/c64 0 2024-09-10T09:36:03.389 INFO:tasks.workunit.client.0.smithi079.stdout:5/313: dread d2/d3/d27/f49 [0,4194304] 0 2024-09-10T09:36:03.390 INFO:tasks.workunit.client.0.smithi079.stdout:1/378: creat d5/d24/d36/d3a/d3c/f78 x:0 0 0 2024-09-10T09:36:03.390 INFO:tasks.workunit.client.0.smithi079.stdout:1/379: write d5/df/d11/f1b [5227607,114662] 0 2024-09-10T09:36:03.391 INFO:tasks.workunit.client.0.smithi079.stdout:1/380: write d5/d40/f42 [559857,109678] 0 2024-09-10T09:36:03.393 INFO:tasks.workunit.client.0.smithi079.stdout:9/294: dwrite d3/d7/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:03.393 INFO:tasks.workunit.client.0.smithi079.stdout:9/295: fsync d3/d7/dc/de/d17/f52 0 2024-09-10T09:36:03.393 INFO:tasks.workunit.client.0.smithi079.stdout:9/296: fdatasync d3/d7/dc/de/d17/f52 0 2024-09-10T09:36:03.394 INFO:tasks.workunit.client.0.smithi079.stdout:8/369: dwrite d11/f2e [0,4194304] 0 2024-09-10T09:36:03.394 INFO:tasks.workunit.client.0.smithi079.stdout:4/333: link d1/da/c66 d1/da/d28/c6a 0 2024-09-10T09:36:03.394 INFO:tasks.workunit.client.0.smithi079.stdout:4/334: fdatasync d1/da/f36 0 2024-09-10T09:36:03.395 INFO:tasks.workunit.client.0.smithi079.stdout:4/335: fsync d1/da/f36 0 2024-09-10T09:36:03.395 INFO:tasks.workunit.client.0.smithi079.stdout:7/328: write d4/d6/f2d [6985063,119523] 0 2024-09-10T09:36:03.395 INFO:tasks.workunit.client.0.smithi079.stdout:7/329: truncate d4/dc/f3a 4198980 0 2024-09-10T09:36:03.396 INFO:tasks.workunit.client.0.smithi079.stdout:2/290: dwrite d4/dc/d1c/f28 [4194304,4194304] 0 2024-09-10T09:36:03.397 INFO:tasks.workunit.client.0.smithi079.stdout:6/362: unlink d4/d8/fb 0 2024-09-10T09:36:03.397 INFO:tasks.workunit.client.0.smithi079.stdout:6/363: write d4/d35/d39/f49 [717167,11942] 0 2024-09-10T09:36:03.398 INFO:tasks.workunit.client.0.smithi079.stdout:3/368: mknod d4/da/d56/c65 0 2024-09-10T09:36:03.402 INFO:tasks.workunit.client.0.smithi079.stdout:9/297: dread d3/d7/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:03.402 INFO:tasks.workunit.client.0.smithi079.stdout:9/298: write d3/d40/f47 [37888,3646] 0 2024-09-10T09:36:03.411 INFO:tasks.workunit.client.0.smithi079.stdout:8/370: creat d11/d2b/d4b/d74/f7a x:0 0 0 2024-09-10T09:36:03.411 INFO:tasks.workunit.client.0.smithi079.stdout:8/371: write d11/d3b/f64 [601021,51762] 0 2024-09-10T09:36:03.411 INFO:tasks.workunit.client.0.smithi079.stdout:4/336: creat d1/da/d3b/d59/f6b x:0 0 0 2024-09-10T09:36:03.413 INFO:tasks.workunit.client.0.smithi079.stdout:7/330: link d4/d6/cb d4/df/d3d/c5f 0 2024-09-10T09:36:03.415 INFO:tasks.workunit.client.0.smithi079.stdout:6/364: write d4/d35/f59 [23856,6160] 0 2024-09-10T09:36:03.415 INFO:tasks.workunit.client.0.smithi079.stdout:8/372: creat d11/d48/f7b x:0 0 0 2024-09-10T09:36:03.416 INFO:tasks.workunit.client.0.smithi079.stdout:4/337: symlink d1/da/d3b/d5a/l6c 0 2024-09-10T09:36:03.418 INFO:tasks.workunit.client.0.smithi079.stdout:7/331: unlink d4/c9 0 2024-09-10T09:36:03.418 INFO:tasks.workunit.client.0.smithi079.stdout:7/332: dread - d4/d6/d3e/f51 zero size 2024-09-10T09:36:03.418 INFO:tasks.workunit.client.0.smithi079.stdout:7/333: chown d4/dc 18409 1 2024-09-10T09:36:03.419 INFO:tasks.workunit.client.0.smithi079.stdout:2/291: rmdir d4/dc/d1c 39 2024-09-10T09:36:03.421 INFO:tasks.workunit.client.0.smithi079.stdout:5/314: dwrite d2/d3/d27/d32/d39/f4a [0,4194304] 0 2024-09-10T09:36:03.421 INFO:tasks.workunit.client.0.smithi079.stdout:5/315: chown d2/f31 19219 1 2024-09-10T09:36:03.425 INFO:tasks.workunit.client.0.smithi079.stdout:8/373: rename fb to d11/d2b/d4b/d74/f7c 0 2024-09-10T09:36:03.427 INFO:tasks.workunit.client.0.smithi079.stdout:6/365: stat d4/d35/d39/d4b/c6d 0 2024-09-10T09:36:03.427 INFO:tasks.workunit.client.0.smithi079.stdout:8/374: dread d11/d3b/f3e [0,4194304] 0 2024-09-10T09:36:03.428 INFO:tasks.workunit.client.0.smithi079.stdout:5/316: write d2/f37 [75983,20445] 0 2024-09-10T09:36:03.429 INFO:tasks.workunit.client.0.smithi079.stdout:4/338: getdents d1/da/d3b/d5f 0 2024-09-10T09:36:03.432 INFO:tasks.workunit.client.0.smithi079.stdout:7/334: mknod d4/d6/d3e/c60 0 2024-09-10T09:36:03.435 INFO:tasks.workunit.client.0.smithi079.stdout:2/292: mkdir d4/dc/d13/d61/d62 0 2024-09-10T09:36:03.436 INFO:tasks.workunit.client.0.smithi079.stdout:3/369: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:03.436 INFO:tasks.workunit.client.0.smithi079.stdout:3/370: fsync f2 0 2024-09-10T09:36:03.436 INFO:tasks.workunit.client.0.smithi079.stdout:3/371: truncate d4/f40 957564 0 2024-09-10T09:36:03.440 INFO:tasks.workunit.client.0.smithi079.stdout:6/366: mkdir d4/d8/d74 0 2024-09-10T09:36:03.440 INFO:tasks.workunit.client.0.smithi079.stdout:6/367: creat d4/d8/dd/d41/f75 x:0 0 0 2024-09-10T09:36:03.441 INFO:tasks.workunit.client.0.smithi079.stdout:7/335: write d4/d6/fa [3423983,45924] 0 2024-09-10T09:36:03.441 INFO:tasks.workunit.client.0.smithi079.stdout:7/336: chown d4/df/c1b 5544929 1 2024-09-10T09:36:03.441 INFO:tasks.workunit.client.0.smithi079.stdout:7/337: readlink d4/df/d19/l59 0 2024-09-10T09:36:03.441 INFO:tasks.workunit.client.0.smithi079.stdout:7/338: stat d4/d6/c10 0 2024-09-10T09:36:03.441 INFO:tasks.workunit.client.0.smithi079.stdout:5/317: truncate d2/d3/fa 7516626 0 2024-09-10T09:36:03.441 INFO:tasks.workunit.client.0.smithi079.stdout:5/318: fsync d2/d3/d27/d32/d44/f4c 0 2024-09-10T09:36:03.442 INFO:tasks.workunit.client.0.smithi079.stdout:4/339: creat d1/da/d3b/d5f/f6d x:0 0 0 2024-09-10T09:36:03.444 INFO:tasks.workunit.client.0.smithi079.stdout:2/293: symlink d4/dc/d13/l63 0 2024-09-10T09:36:03.444 INFO:tasks.workunit.client.0.smithi079.stdout:2/294: chown d4/dc/d29/l19 357424006 1 2024-09-10T09:36:03.444 INFO:tasks.workunit.client.0.smithi079.stdout:2/295: write d4/dc/d29/d1b/d38/f3d [344346,120574] 0 2024-09-10T09:36:03.444 INFO:tasks.workunit.client.0.smithi079.stdout:2/296: fdatasync d4/dc/d29/f16 0 2024-09-10T09:36:03.444 INFO:tasks.workunit.client.0.smithi079.stdout:2/297: chown d4/dc/d29/d1b/d38/d39/l5f 76 1 2024-09-10T09:36:03.445 INFO:tasks.workunit.client.0.smithi079.stdout:8/375: dwrite d11/d2b/f4c [4194304,4194304] 0 2024-09-10T09:36:03.445 INFO:tasks.workunit.client.0.smithi079.stdout:1/381: dwrite d5/d24/d36/d3a/d3c/f5e [4194304,4194304] 0 2024-09-10T09:36:03.447 INFO:tasks.workunit.client.0.smithi079.stdout:9/299: dwrite d3/d7/d26/f51 [0,4194304] 0 2024-09-10T09:36:03.447 INFO:tasks.workunit.client.0.smithi079.stdout:3/372: unlink d4/c5 0 2024-09-10T09:36:03.453 INFO:tasks.workunit.client.0.smithi079.stdout:1/382: write d5/d24/d36/d3a/d3c/f5e [6135220,128110] 0 2024-09-10T09:36:03.453 INFO:tasks.workunit.client.0.smithi079.stdout:1/383: read - d5/d24/d36/d3a/d3c/f54 zero size 2024-09-10T09:36:03.457 INFO:tasks.workunit.client.0.smithi079.stdout:1/384: dread d5/df/d2e/f49 [0,4194304] 0 2024-09-10T09:36:03.458 INFO:tasks.workunit.client.0.smithi079.stdout:1/385: readlink d5/l29 0 2024-09-10T09:36:03.463 INFO:tasks.workunit.client.0.smithi079.stdout:7/339: rename d4/df/d19/f2b to d4/f61 0 2024-09-10T09:36:03.463 INFO:tasks.workunit.client.0.smithi079.stdout:7/340: chown d4/dc/c35 322488703 1 2024-09-10T09:36:03.465 INFO:tasks.workunit.client.0.smithi079.stdout:5/319: symlink d2/d3/d27/d32/l68 0 2024-09-10T09:36:03.466 INFO:tasks.workunit.client.0.smithi079.stdout:4/340: dwrite d1/f7 [0,4194304] 0 2024-09-10T09:36:03.467 INFO:tasks.workunit.client.0.smithi079.stdout:2/298: dwrite d4/dc/d29/d1b/d38/d39/d31/f3b [0,4194304] 0 2024-09-10T09:36:03.471 INFO:tasks.workunit.client.0.smithi079.stdout:9/300: mknod d3/d7/dc/c59 0 2024-09-10T09:36:03.473 INFO:tasks.workunit.client.0.smithi079.stdout:3/373: symlink d4/da/d17/d2d/d43/d49/l66 0 2024-09-10T09:36:03.476 INFO:tasks.workunit.client.0.smithi079.stdout:6/368: getdents d4/d8/dd/d41/d51 0 2024-09-10T09:36:03.476 INFO:tasks.workunit.client.0.smithi079.stdout:6/369: getdents d4 0 2024-09-10T09:36:03.476 INFO:tasks.workunit.client.0.smithi079.stdout:6/370: chown d4/l57 3016547 1 2024-09-10T09:36:03.478 INFO:tasks.workunit.client.0.smithi079.stdout:2/299: dread d4/f2b [0,4194304] 0 2024-09-10T09:36:03.478 INFO:tasks.workunit.client.0.smithi079.stdout:2/300: chown l3 19 1 2024-09-10T09:36:03.478 INFO:tasks.workunit.client.0.smithi079.stdout:7/341: symlink d4/l62 0 2024-09-10T09:36:03.492 INFO:tasks.workunit.client.0.smithi079.stdout:4/341: dwrite d1/da/d28/f29 [0,4194304] 0 2024-09-10T09:36:03.492 INFO:tasks.workunit.client.0.smithi079.stdout:3/374: dwrite f2 [4194304,4194304] 0 2024-09-10T09:36:03.506 INFO:tasks.workunit.client.0.smithi079.stdout:8/376: getdents d11/d48 0 2024-09-10T09:36:03.507 INFO:tasks.workunit.client.0.smithi079.stdout:8/377: dread ff [0,4194304] 0 2024-09-10T09:36:03.509 INFO:tasks.workunit.client.0.smithi079.stdout:9/301: mkdir d3/d7/d5a 0 2024-09-10T09:36:03.509 INFO:tasks.workunit.client.0.smithi079.stdout:9/302: creat d3/d7/f5b x:0 0 0 2024-09-10T09:36:03.509 INFO:tasks.workunit.client.0.smithi079.stdout:9/303: creat d3/f5c x:0 0 0 2024-09-10T09:36:03.509 INFO:tasks.workunit.client.0.smithi079.stdout:9/304: fsync d3/d7/dc/f37 0 2024-09-10T09:36:03.509 INFO:tasks.workunit.client.0.smithi079.stdout:9/305: creat d3/d40/f5d x:0 0 0 2024-09-10T09:36:03.510 INFO:tasks.workunit.client.0.smithi079.stdout:1/386: rename d5/df/d41/d6e/d74 to d5/d24/d36/d79 0 2024-09-10T09:36:03.512 INFO:tasks.workunit.client.0.smithi079.stdout:2/301: creat d4/dc/d29/d1b/d38/d39/d31/d49/f64 x:0 0 0 2024-09-10T09:36:03.512 INFO:tasks.workunit.client.0.smithi079.stdout:2/302: truncate d4/dc/d29/d1b/d38/d39/f4c 4756935 0 2024-09-10T09:36:03.517 INFO:tasks.workunit.client.0.smithi079.stdout:4/342: mknod d1/da/c6e 0 2024-09-10T09:36:03.517 INFO:tasks.workunit.client.0.smithi079.stdout:4/343: creat d1/da/d28/d47/f6f x:0 0 0 2024-09-10T09:36:03.519 INFO:tasks.workunit.client.0.smithi079.stdout:3/375: mkdir d4/da/d67 0 2024-09-10T09:36:03.519 INFO:tasks.workunit.client.0.smithi079.stdout:3/376: dread - d4/da/d56/f5e zero size 2024-09-10T09:36:03.520 INFO:tasks.workunit.client.0.smithi079.stdout:0/372: sync 2024-09-10T09:36:03.520 INFO:tasks.workunit.client.0.smithi079.stdout:0/373: write d4/d12/d21/f2c [1126852,74576] 0 2024-09-10T09:36:03.523 INFO:tasks.workunit.client.0.smithi079.stdout:8/378: mknod d11/d48/c7d 0 2024-09-10T09:36:03.529 INFO:tasks.workunit.client.0.smithi079.stdout:9/306: creat d3/d7/dc/de/d17/d2f/f5e x:0 0 0 2024-09-10T09:36:03.531 INFO:tasks.workunit.client.0.smithi079.stdout:5/320: rename d2/d3/f1a to d2/d3/d27/f69 0 2024-09-10T09:36:03.531 INFO:tasks.workunit.client.0.smithi079.stdout:5/321: truncate d2/d3/d27/f69 9398305 0 2024-09-10T09:36:03.531 INFO:tasks.workunit.client.0.smithi079.stdout:1/387: dwrite d5/fe [0,4194304] 0 2024-09-10T09:36:03.531 INFO:tasks.workunit.client.0.smithi079.stdout:1/388: readlink d5/lb 0 2024-09-10T09:36:03.532 INFO:tasks.workunit.client.0.smithi079.stdout:2/303: mkdir d4/dc/d13/d61/d65 0 2024-09-10T09:36:03.532 INFO:tasks.workunit.client.0.smithi079.stdout:2/304: fsync d4/dc/d29/d1b/d38/f53 0 2024-09-10T09:36:03.532 INFO:tasks.workunit.client.0.smithi079.stdout:7/342: rmdir d4/d6/d38 39 2024-09-10T09:36:03.535 INFO:tasks.workunit.client.0.smithi079.stdout:4/344: symlink d1/da/d28/d47/l70 0 2024-09-10T09:36:03.545 INFO:tasks.workunit.client.0.smithi079.stdout:0/374: mkdir d4/d12/d1a/d6d/d84 0 2024-09-10T09:36:03.545 INFO:tasks.workunit.client.0.smithi079.stdout:8/379: mkdir d11/d2b/d4b/d7e 0 2024-09-10T09:36:03.546 INFO:tasks.workunit.client.0.smithi079.stdout:2/305: chown d4/dc/d29/d1b/c2d 90301 1 2024-09-10T09:36:03.546 INFO:tasks.workunit.client.0.smithi079.stdout:2/306: fsync d4/dc/d29/d1b/d38/d39/d31/f3b 0 2024-09-10T09:36:03.546 INFO:tasks.workunit.client.0.smithi079.stdout:7/343: unlink d4/cd 0 2024-09-10T09:36:03.547 INFO:tasks.workunit.client.0.smithi079.stdout:4/345: unlink d1/da/d16/d21/f2d 0 2024-09-10T09:36:03.547 INFO:tasks.workunit.client.0.smithi079.stdout:4/346: fdatasync d1/f7 0 2024-09-10T09:36:03.547 INFO:tasks.workunit.client.0.smithi079.stdout:4/347: truncate d1/da/d3b/d5a/f63 191453 0 2024-09-10T09:36:03.548 INFO:tasks.workunit.client.0.smithi079.stdout:3/377: getdents d4/da/d17/d38 0 2024-09-10T09:36:03.548 INFO:tasks.workunit.client.0.smithi079.stdout:3/378: stat d4/da/l14 0 2024-09-10T09:36:03.548 INFO:tasks.workunit.client.0.smithi079.stdout:3/379: write d4/da/f11 [2593701,46049] 0 2024-09-10T09:36:03.550 INFO:tasks.workunit.client.0.smithi079.stdout:1/389: dread d5/d24/d36/d3a/f3d [0,4194304] 0 2024-09-10T09:36:03.550 INFO:tasks.workunit.client.0.smithi079.stdout:4/348: write d1/da/d16/f24 [317131,33313] 0 2024-09-10T09:36:03.550 INFO:tasks.workunit.client.0.smithi079.stdout:9/307: read d3/d7/dc/de/d17/f21 [3305854,76] 0 2024-09-10T09:36:03.551 INFO:tasks.workunit.client.0.smithi079.stdout:6/371: rename d4/d35 to d4/d8/dd/d76 0 2024-09-10T09:36:03.554 INFO:tasks.workunit.client.0.smithi079.stdout:7/344: link d4/df/f4c d4/d6/d38/f63 0 2024-09-10T09:36:03.555 INFO:tasks.workunit.client.0.smithi079.stdout:7/345: creat d4/df/d3d/f64 x:0 0 0 2024-09-10T09:36:03.555 INFO:tasks.workunit.client.0.smithi079.stdout:8/380: dread d11/d2b/d4b/d50/d55/f53 [0,4194304] 0 2024-09-10T09:36:03.556 INFO:tasks.workunit.client.0.smithi079.stdout:3/380: creat d4/da/d17/d2d/d43/d49/f68 x:0 0 0 2024-09-10T09:36:03.557 INFO:tasks.workunit.client.0.smithi079.stdout:1/390: truncate d5/d40/f42 3533292 0 2024-09-10T09:36:03.559 INFO:tasks.workunit.client.0.smithi079.stdout:5/322: dwrite d2/d3/fa [0,4194304] 0 2024-09-10T09:36:03.560 INFO:tasks.workunit.client.0.smithi079.stdout:4/349: symlink d1/da/d16/d21/d32/l71 0 2024-09-10T09:36:03.560 INFO:tasks.workunit.client.0.smithi079.stdout:4/350: stat d1/da/d28/d47/c50 0 2024-09-10T09:36:03.560 INFO:tasks.workunit.client.0.smithi079.stdout:4/351: dread - d1/da/d28/d47/f6f zero size 2024-09-10T09:36:03.561 INFO:tasks.workunit.client.0.smithi079.stdout:9/308: mknod d3/d7/d26/c5f 0 2024-09-10T09:36:03.561 INFO:tasks.workunit.client.0.smithi079.stdout:9/309: truncate d3/d7/dc/de/d17/d2f/d30/f56 151775 0 2024-09-10T09:36:03.567 INFO:tasks.workunit.client.0.smithi079.stdout:6/372: link d4/d8/c9 d4/d8/dd/c77 0 2024-09-10T09:36:03.567 INFO:tasks.workunit.client.0.smithi079.stdout:6/373: chown d4/d8/dd/d76/d46/c23 124467 1 2024-09-10T09:36:03.570 INFO:tasks.workunit.client.0.smithi079.stdout:8/381: truncate d11/f43 2120113 0 2024-09-10T09:36:03.572 INFO:tasks.workunit.client.0.smithi079.stdout:1/391: link d5/d24/d36/d3a/d3c/f5e d5/d24/d36/d3a/d3c/f7a 0 2024-09-10T09:36:03.577 INFO:tasks.workunit.client.0.smithi079.stdout:2/307: rename d4/dc/d29/d1b/d38/f3d to d4/f66 0 2024-09-10T09:36:03.577 INFO:tasks.workunit.client.0.smithi079.stdout:2/308: creat d4/dc/d29/d1b/d38/d39/d31/f67 x:0 0 0 2024-09-10T09:36:03.577 INFO:tasks.workunit.client.0.smithi079.stdout:8/382: mknod d11/d2b/d4b/d50/d5c/c7f 0 2024-09-10T09:36:03.578 INFO:tasks.workunit.client.0.smithi079.stdout:1/392: symlink d5/df/d2e/l7b 0 2024-09-10T09:36:03.578 INFO:tasks.workunit.client.0.smithi079.stdout:1/393: chown d5/f19 21754398 1 2024-09-10T09:36:03.580 INFO:tasks.workunit.client.0.smithi079.stdout:3/381: rename d4/da/d18/c39 to d4/da/d17/d2d/d43/c69 0 2024-09-10T09:36:03.583 INFO:tasks.workunit.client.0.smithi079.stdout:3/382: dread d4/f2b [0,4194304] 0 2024-09-10T09:36:03.583 INFO:tasks.workunit.client.0.smithi079.stdout:6/374: rename d4/d8/dd/d41/l5f to d4/d8/dc/l78 0 2024-09-10T09:36:03.585 INFO:tasks.workunit.client.0.smithi079.stdout:6/375: creat d4/d8/dd/d76/d46/f79 x:0 0 0 2024-09-10T09:36:03.585 INFO:tasks.workunit.client.0.smithi079.stdout:6/376: fdatasync d4/d8/dd/d41/f75 0 2024-09-10T09:36:03.585 INFO:tasks.workunit.client.0.smithi079.stdout:8/383: dread d11/f32 [0,4194304] 0 2024-09-10T09:36:03.586 INFO:tasks.workunit.client.0.smithi079.stdout:6/377: read d4/d8/dc/d1c/f1a [2783334,120149] 0 2024-09-10T09:36:03.589 INFO:tasks.workunit.client.0.smithi079.stdout:3/383: write d4/da/d18/f46 [1326689,87046] 0 2024-09-10T09:36:03.590 INFO:tasks.workunit.client.0.smithi079.stdout:8/384: mkdir d11/d2b/d4b/d50/d80 0 2024-09-10T09:36:03.590 INFO:tasks.workunit.client.0.smithi079.stdout:6/378: mknod d4/d8/dc/d12/c7a 0 2024-09-10T09:36:03.590 INFO:tasks.workunit.client.0.smithi079.stdout:6/379: stat d4/d8/dd/d41/f56 0 2024-09-10T09:36:03.592 INFO:tasks.workunit.client.0.smithi079.stdout:0/375: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:36:03.593 INFO:tasks.workunit.client.0.smithi079.stdout:5/323: dwrite d2/d3/d27/d32/f4f [0,4194304] 0 2024-09-10T09:36:03.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/384: mknod d4/da/d17/d2d/c6a 0 2024-09-10T09:36:03.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/385: creat d4/da/d56/f6b x:0 0 0 2024-09-10T09:36:03.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/386: chown d4/da/d17/d38/l5c 142584 1 2024-09-10T09:36:03.594 INFO:tasks.workunit.client.0.smithi079.stdout:7/346: dwrite d4/df/d3d/f64 [0,4194304] 0 2024-09-10T09:36:03.594 INFO:tasks.workunit.client.0.smithi079.stdout:8/385: mknod d11/d2b/d4b/d50/d80/c81 0 2024-09-10T09:36:03.595 INFO:tasks.workunit.client.0.smithi079.stdout:6/380: symlink d4/l7b 0 2024-09-10T09:36:03.600 INFO:tasks.workunit.client.0.smithi079.stdout:5/324: rename d2/d3/f42 to d2/d3/f6a 0 2024-09-10T09:36:03.603 INFO:tasks.workunit.client.0.smithi079.stdout:7/347: write d4/dc/f17 [8372397,63996] 0 2024-09-10T09:36:03.603 INFO:tasks.workunit.client.0.smithi079.stdout:7/348: creat d4/df/d3d/f65 x:0 0 0 2024-09-10T09:36:03.605 INFO:tasks.workunit.client.0.smithi079.stdout:4/352: getdents d1/da/d16/d21 0 2024-09-10T09:36:03.617 INFO:tasks.workunit.client.0.smithi079.stdout:0/376: dread d4/d47/f4c [0,4194304] 0 2024-09-10T09:36:03.617 INFO:tasks.workunit.client.0.smithi079.stdout:1/394: dwrite d5/d24/d36/d3a/d48/f56 [0,4194304] 0 2024-09-10T09:36:03.619 INFO:tasks.workunit.client.0.smithi079.stdout:6/381: mknod d4/d8/dc/d12/d29/c7c 0 2024-09-10T09:36:03.619 INFO:tasks.workunit.client.0.smithi079.stdout:6/382: creat d4/d8/f7d x:0 0 0 2024-09-10T09:36:03.622 INFO:tasks.workunit.client.0.smithi079.stdout:7/349: readlink d4/df/d19/l50 0 2024-09-10T09:36:03.622 INFO:tasks.workunit.client.0.smithi079.stdout:7/350: read - d4/dc/f32 zero size 2024-09-10T09:36:03.622 INFO:tasks.workunit.client.0.smithi079.stdout:7/351: dread - d4/d6/d38/d55/f5c zero size 2024-09-10T09:36:03.622 INFO:tasks.workunit.client.0.smithi079.stdout:7/352: fsync d4/df/d3d/f40 0 2024-09-10T09:36:03.623 INFO:tasks.workunit.client.0.smithi079.stdout:7/353: fsync d4/df/d3d/f41 0 2024-09-10T09:36:03.623 INFO:tasks.workunit.client.0.smithi079.stdout:7/354: readlink d4/d6/d38/l58 0 2024-09-10T09:36:03.625 INFO:tasks.workunit.client.0.smithi079.stdout:0/377: write d4/d12/d1a/fb [8224945,66816] 0 2024-09-10T09:36:03.626 INFO:tasks.workunit.client.0.smithi079.stdout:0/378: truncate d4/d12/d1a/f82 559984 0 2024-09-10T09:36:03.627 INFO:tasks.workunit.client.0.smithi079.stdout:2/309: dwrite d4/dc/d29/d1b/d38/d39/f45 [0,4194304] 0 2024-09-10T09:36:03.628 INFO:tasks.workunit.client.0.smithi079.stdout:3/387: getdents d4/da/d17/d2d/d43/d49 0 2024-09-10T09:36:03.632 INFO:tasks.workunit.client.0.smithi079.stdout:6/383: symlink d4/d8/dd/d76/l7e 0 2024-09-10T09:36:03.634 INFO:tasks.workunit.client.0.smithi079.stdout:4/353: getdents d1 0 2024-09-10T09:36:03.634 INFO:tasks.workunit.client.0.smithi079.stdout:8/386: dwrite d11/d2b/f75 [0,4194304] 0 2024-09-10T09:36:03.634 INFO:tasks.workunit.client.0.smithi079.stdout:4/354: readlink d1/da/d16/d21/l35 0 2024-09-10T09:36:03.634 INFO:tasks.workunit.client.0.smithi079.stdout:4/355: fdatasync d1/da/d16/d21/d32/f64 0 2024-09-10T09:36:03.634 INFO:tasks.workunit.client.0.smithi079.stdout:5/325: dwrite d2/d3/fa [0,4194304] 0 2024-09-10T09:36:03.634 INFO:tasks.workunit.client.0.smithi079.stdout:0/379: creat d4/d12/d1a/d6d/d7b/f85 x:0 0 0 2024-09-10T09:36:03.635 INFO:tasks.workunit.client.0.smithi079.stdout:0/380: getdents d4/d12/d16/d53/d79 0 2024-09-10T09:36:03.636 INFO:tasks.workunit.client.0.smithi079.stdout:2/310: creat d4/d5d/f68 x:0 0 0 2024-09-10T09:36:03.636 INFO:tasks.workunit.client.0.smithi079.stdout:1/395: dwrite d5/d24/f2f [4194304,4194304] 0 2024-09-10T09:36:03.638 INFO:tasks.workunit.client.0.smithi079.stdout:3/388: rmdir d4/da/d17 39 2024-09-10T09:36:03.638 INFO:tasks.workunit.client.0.smithi079.stdout:3/389: readlink d4/da/d17/d2d/d43/l63 0 2024-09-10T09:36:03.638 INFO:tasks.workunit.client.0.smithi079.stdout:3/390: readlink d4/da/d17/d38/l4a 0 2024-09-10T09:36:03.638 INFO:tasks.workunit.client.0.smithi079.stdout:3/391: chown d4/c16 104470190 1 2024-09-10T09:36:03.638 INFO:tasks.workunit.client.0.smithi079.stdout:3/392: stat d4/da/d18/f46 0 2024-09-10T09:36:03.642 INFO:tasks.workunit.client.0.smithi079.stdout:8/387: mknod d11/d2b/d4b/d50/d5c/c82 0 2024-09-10T09:36:03.645 INFO:tasks.workunit.client.0.smithi079.stdout:4/356: rename d1/da/c66 to d1/da/d28/d47/d52/c72 0 2024-09-10T09:36:03.645 INFO:tasks.workunit.client.0.smithi079.stdout:4/357: dread - d1/da/d3b/d5f/f6d zero size 2024-09-10T09:36:03.648 INFO:tasks.workunit.client.0.smithi079.stdout:5/326: link d2/f31 d2/d41/f6b 0 2024-09-10T09:36:03.650 INFO:tasks.workunit.client.0.smithi079.stdout:2/311: read d4/dc/d29/d1b/d38/d39/d31/f3b [3757235,31585] 0 2024-09-10T09:36:03.650 INFO:tasks.workunit.client.0.smithi079.stdout:2/312: fdatasync d4/f23 0 2024-09-10T09:36:03.651 INFO:tasks.workunit.client.0.smithi079.stdout:6/384: dwrite d4/d8/dc/d12/f30 [0,4194304] 0 2024-09-10T09:36:03.651 INFO:tasks.workunit.client.0.smithi079.stdout:0/381: rmdir d4/d12/d16/d68 0 2024-09-10T09:36:03.651 INFO:tasks.workunit.client.0.smithi079.stdout:0/382: creat d4/d12/f86 x:0 0 0 2024-09-10T09:36:03.655 INFO:tasks.workunit.client.0.smithi079.stdout:1/396: getdents d5/df/d2e 0 2024-09-10T09:36:03.656 INFO:tasks.workunit.client.0.smithi079.stdout:5/327: dread d2/f3d [0,4194304] 0 2024-09-10T09:36:03.656 INFO:tasks.workunit.client.0.smithi079.stdout:5/328: chown d2/d3/d27/f49 128732 1 2024-09-10T09:36:03.656 INFO:tasks.workunit.client.0.smithi079.stdout:5/329: readlink d2/d3/l25 0 2024-09-10T09:36:03.657 INFO:tasks.workunit.client.0.smithi079.stdout:3/393: creat d4/da/f6c x:0 0 0 2024-09-10T09:36:03.657 INFO:tasks.workunit.client.0.smithi079.stdout:8/388: rmdir d11/d48 39 2024-09-10T09:36:03.658 INFO:tasks.workunit.client.0.smithi079.stdout:4/358: mkdir d1/da/d28/d47/d52/d73 0 2024-09-10T09:36:03.660 INFO:tasks.workunit.client.0.smithi079.stdout:2/313: mknod d4/dc/d1c/c69 0 2024-09-10T09:36:03.661 INFO:tasks.workunit.client.0.smithi079.stdout:6/385: symlink d4/d8/dc/d3c/l7f 0 2024-09-10T09:36:03.663 INFO:tasks.workunit.client.0.smithi079.stdout:0/383: symlink d4/d12/d16/d53/d6a/l87 0 2024-09-10T09:36:03.663 INFO:tasks.workunit.client.0.smithi079.stdout:8/389: write d11/f43 [2080003,56237] 0 2024-09-10T09:36:03.663 INFO:tasks.workunit.client.0.smithi079.stdout:8/390: creat d11/d2b/d4b/d74/f83 x:0 0 0 2024-09-10T09:36:03.663 INFO:tasks.workunit.client.0.smithi079.stdout:1/397: creat d5/d40/d46/f7c x:0 0 0 2024-09-10T09:36:03.663 INFO:tasks.workunit.client.0.smithi079.stdout:1/398: write d5/f15 [1009259,26277] 0 2024-09-10T09:36:03.664 INFO:tasks.workunit.client.0.smithi079.stdout:5/330: creat d2/d3/d5e/d61/f6c x:0 0 0 2024-09-10T09:36:03.664 INFO:tasks.workunit.client.0.smithi079.stdout:5/331: stat d2/l1e 0 2024-09-10T09:36:03.665 INFO:tasks.workunit.client.0.smithi079.stdout:1/399: dread d5/df/d41/f65 [0,4194304] 0 2024-09-10T09:36:03.666 INFO:tasks.workunit.client.0.smithi079.stdout:3/394: rename d4/da/d17/d2d/d43/d4c/f5a to d4/da/d18/f6d 0 2024-09-10T09:36:03.667 INFO:tasks.workunit.client.0.smithi079.stdout:4/359: creat d1/d38/f74 x:0 0 0 2024-09-10T09:36:03.675 INFO:tasks.workunit.client.0.smithi079.stdout:0/384: dread d4/f70 [0,4194304] 0 2024-09-10T09:36:03.676 INFO:tasks.workunit.client.0.smithi079.stdout:5/332: link d2/d3/d27/d32/f4f d2/d3/d27/d32/f6d 0 2024-09-10T09:36:03.676 INFO:tasks.workunit.client.0.smithi079.stdout:6/386: write d4/d8/dc/d12/d29/f2f [485783,76393] 0 2024-09-10T09:36:03.679 INFO:tasks.workunit.client.0.smithi079.stdout:8/391: rename d11/d2b/l44 to d11/d48/l84 0 2024-09-10T09:36:03.680 INFO:tasks.workunit.client.0.smithi079.stdout:8/392: readlink d11/d2b/l38 0 2024-09-10T09:36:03.682 INFO:tasks.workunit.client.0.smithi079.stdout:3/395: symlink d4/da/l6e 0 2024-09-10T09:36:03.683 INFO:tasks.workunit.client.0.smithi079.stdout:4/360: symlink d1/da/d16/d57/l75 0 2024-09-10T09:36:03.683 INFO:tasks.workunit.client.0.smithi079.stdout:4/361: creat d1/da/d3b/d5f/f76 x:0 0 0 2024-09-10T09:36:03.685 INFO:tasks.workunit.client.0.smithi079.stdout:2/314: mknod d4/dc/d29/c6a 0 2024-09-10T09:36:03.687 INFO:tasks.workunit.client.0.smithi079.stdout:8/393: creat d11/d2b/d4b/d7e/f85 x:0 0 0 2024-09-10T09:36:03.687 INFO:tasks.workunit.client.0.smithi079.stdout:8/394: fdatasync d11/d2b/d4b/f77 0 2024-09-10T09:36:03.687 INFO:tasks.workunit.client.0.smithi079.stdout:8/395: write d11/d2b/d4b/d74/f7a [139569,130676] 0 2024-09-10T09:36:03.687 INFO:tasks.workunit.client.0.smithi079.stdout:8/396: creat d11/d2b/d4b/d74/f86 x:0 0 0 2024-09-10T09:36:03.687 INFO:tasks.workunit.client.0.smithi079.stdout:1/400: dwrite d5/df/f1c [0,4194304] 0 2024-09-10T09:36:03.691 INFO:tasks.workunit.client.0.smithi079.stdout:4/362: creat d1/da/d16/f77 x:0 0 0 2024-09-10T09:36:03.696 INFO:tasks.workunit.client.0.smithi079.stdout:2/315: mknod d4/dc/d29/d1b/d38/d39/d31/d49/c6b 0 2024-09-10T09:36:03.696 INFO:tasks.workunit.client.0.smithi079.stdout:2/316: dread - d4/dc/d29/f55 zero size 2024-09-10T09:36:03.696 INFO:tasks.workunit.client.0.smithi079.stdout:2/317: chown d4/d5d 6083 1 2024-09-10T09:36:03.701 INFO:tasks.workunit.client.0.smithi079.stdout:8/397: mkdir d11/d2b/d4b/d50/d55/d87 0 2024-09-10T09:36:03.701 INFO:tasks.workunit.client.0.smithi079.stdout:8/398: write d11/d48/f60 [741182,69731] 0 2024-09-10T09:36:03.701 INFO:tasks.workunit.client.0.smithi079.stdout:8/399: read d11/f19 [1607941,54170] 0 2024-09-10T09:36:03.702 INFO:tasks.workunit.client.0.smithi079.stdout:4/363: write d1/da/f2b [66079,113418] 0 2024-09-10T09:36:03.703 INFO:tasks.workunit.client.0.smithi079.stdout:1/401: getdents d5/d40 0 2024-09-10T09:36:03.704 INFO:tasks.workunit.client.0.smithi079.stdout:1/402: dread d5/d24/d36/d3a/f4b [0,4194304] 0 2024-09-10T09:36:03.705 INFO:tasks.workunit.client.0.smithi079.stdout:1/403: dread d5/d24/d36/d3a/d3c/f64 [0,4194304] 0 2024-09-10T09:36:03.705 INFO:tasks.workunit.client.0.smithi079.stdout:1/404: write d5/d24/d36/d3a/d3c/f64 [587676,107187] 0 2024-09-10T09:36:03.709 INFO:tasks.workunit.client.0.smithi079.stdout:8/400: creat d11/f88 x:0 0 0 2024-09-10T09:36:03.709 INFO:tasks.workunit.client.0.smithi079.stdout:9/310: sync 2024-09-10T09:36:03.709 INFO:tasks.workunit.client.0.smithi079.stdout:2/318: getdents d4/dc/d29/d1b/d38/d39 0 2024-09-10T09:36:03.711 INFO:tasks.workunit.client.0.smithi079.stdout:8/401: creat d11/d2b/d4b/d50/f89 x:0 0 0 2024-09-10T09:36:03.711 INFO:tasks.workunit.client.0.smithi079.stdout:8/402: chown d11/d2b/d4b/d50/d55/c5f 5203726 1 2024-09-10T09:36:03.711 INFO:tasks.workunit.client.0.smithi079.stdout:9/311: creat d3/d7/dc/de/d58/f60 x:0 0 0 2024-09-10T09:36:03.712 INFO:tasks.workunit.client.0.smithi079.stdout:2/319: mknod d4/dc/d13/c6c 0 2024-09-10T09:36:03.714 INFO:tasks.workunit.client.0.smithi079.stdout:8/403: dread d11/f1d [0,4194304] 0 2024-09-10T09:36:03.715 INFO:tasks.workunit.client.0.smithi079.stdout:8/404: dread - d11/f88 zero size 2024-09-10T09:36:03.715 INFO:tasks.workunit.client.0.smithi079.stdout:8/405: write d11/d2b/f4e [251101,125702] 0 2024-09-10T09:36:03.715 INFO:tasks.workunit.client.0.smithi079.stdout:8/406: dread - d11/d2b/d4b/d7e/f85 zero size 2024-09-10T09:36:03.721 INFO:tasks.workunit.client.0.smithi079.stdout:1/405: dread d5/d24/d36/d53/f61 [0,4194304] 0 2024-09-10T09:36:03.724 INFO:tasks.workunit.client.0.smithi079.stdout:4/364: read d1/da/d16/f26 [5047289,19580] 0 2024-09-10T09:36:03.724 INFO:tasks.workunit.client.0.smithi079.stdout:4/365: fsync d1/da/d28/d47/f4c 0 2024-09-10T09:36:03.724 INFO:tasks.workunit.client.0.smithi079.stdout:4/366: dread - d1/da/d28/d47/f6f zero size 2024-09-10T09:36:03.724 INFO:tasks.workunit.client.0.smithi079.stdout:0/385: dwrite d4/d12/d39/f73 [0,4194304] 0 2024-09-10T09:36:03.724 INFO:tasks.workunit.client.0.smithi079.stdout:0/386: truncate d4/d12/d39/f48 1010601 0 2024-09-10T09:36:03.727 INFO:tasks.workunit.client.0.smithi079.stdout:9/312: dread d3/d7/f3b [0,4194304] 0 2024-09-10T09:36:03.727 INFO:tasks.workunit.client.0.smithi079.stdout:9/313: chown d3/d7 153168 1 2024-09-10T09:36:03.727 INFO:tasks.workunit.client.0.smithi079.stdout:4/367: truncate d1/da/d28/f29 1811662 0 2024-09-10T09:36:03.727 INFO:tasks.workunit.client.0.smithi079.stdout:4/368: creat d1/da/d3b/d5a/f78 x:0 0 0 2024-09-10T09:36:03.728 INFO:tasks.workunit.client.0.smithi079.stdout:5/333: dwrite d2/f37 [0,4194304] 0 2024-09-10T09:36:03.729 INFO:tasks.workunit.client.0.smithi079.stdout:5/334: readlink d2/d3/l54 0 2024-09-10T09:36:03.730 INFO:tasks.workunit.client.0.smithi079.stdout:2/320: dread d4/dc/d29/f16 [0,4194304] 0 2024-09-10T09:36:03.730 INFO:tasks.workunit.client.0.smithi079.stdout:2/321: truncate d4/dc/d29/d1b/d38/d39/d31/f46 5182047 0 2024-09-10T09:36:03.731 INFO:tasks.workunit.client.0.smithi079.stdout:0/387: mkdir d4/d12/d21/d3f/d88 0 2024-09-10T09:36:03.731 INFO:tasks.workunit.client.0.smithi079.stdout:6/387: dwrite d4/d8/dc/d12/d29/f62 [0,4194304] 0 2024-09-10T09:36:03.733 INFO:tasks.workunit.client.0.smithi079.stdout:9/314: rename d3/d7/dc/c13 to d3/d7/dc/de/d17/d12/c61 0 2024-09-10T09:36:03.734 INFO:tasks.workunit.client.0.smithi079.stdout:4/369: dread d1/da/d16/d21/d32/f44 [4194304,4194304] 0 2024-09-10T09:36:03.739 INFO:tasks.workunit.client.0.smithi079.stdout:1/406: dread d5/d24/d36/d3a/d48/f56 [0,4194304] 0 2024-09-10T09:36:03.739 INFO:tasks.workunit.client.0.smithi079.stdout:1/407: creat d5/d24/d36/d3a/d3c/f7d x:0 0 0 2024-09-10T09:36:03.739 INFO:tasks.workunit.client.0.smithi079.stdout:1/408: truncate d5/df/d11/f32 2074185 0 2024-09-10T09:36:03.739 INFO:tasks.workunit.client.0.smithi079.stdout:1/409: write d5/df/d11/f32 [744577,105601] 0 2024-09-10T09:36:03.740 INFO:tasks.workunit.client.0.smithi079.stdout:8/407: dwrite d11/d48/f6a [0,4194304] 0 2024-09-10T09:36:03.741 INFO:tasks.workunit.client.0.smithi079.stdout:5/335: creat d2/d3/f6e x:0 0 0 2024-09-10T09:36:03.743 INFO:tasks.workunit.client.0.smithi079.stdout:0/388: symlink d4/d12/d16/d53/d79/l89 0 2024-09-10T09:36:03.743 INFO:tasks.workunit.client.0.smithi079.stdout:0/389: fdatasync d4/f11 0 2024-09-10T09:36:03.745 INFO:tasks.workunit.client.0.smithi079.stdout:9/315: mkdir d3/d7/dc/d62 0 2024-09-10T09:36:03.745 INFO:tasks.workunit.client.0.smithi079.stdout:9/316: chown d3/d7/dc/de/d17/d2f/d30/f56 38835930 1 2024-09-10T09:36:03.745 INFO:tasks.workunit.client.0.smithi079.stdout:9/317: chown d3/d40 120613 1 2024-09-10T09:36:03.745 INFO:tasks.workunit.client.0.smithi079.stdout:9/318: creat d3/d7/f63 x:0 0 0 2024-09-10T09:36:03.746 INFO:tasks.workunit.client.0.smithi079.stdout:4/370: truncate d1/da/d28/d47/f4c 2016367 0 2024-09-10T09:36:03.746 INFO:tasks.workunit.client.0.smithi079.stdout:4/371: chown d1/da/d16/f27 442946 1 2024-09-10T09:36:03.746 INFO:tasks.workunit.client.0.smithi079.stdout:4/372: dread - d1/da/d3b/d5f/f76 zero size 2024-09-10T09:36:03.747 INFO:tasks.workunit.client.0.smithi079.stdout:1/410: dread d5/df/d11/f2b [0,4194304] 0 2024-09-10T09:36:03.750 INFO:tasks.workunit.client.0.smithi079.stdout:8/408: dread d11/d48/f60 [0,4194304] 0 2024-09-10T09:36:03.751 INFO:tasks.workunit.client.0.smithi079.stdout:5/336: mknod d2/d41/c6f 0 2024-09-10T09:36:03.751 INFO:tasks.workunit.client.0.smithi079.stdout:5/337: write d2/d3/d27/f2c [573120,116206] 0 2024-09-10T09:36:03.752 INFO:tasks.workunit.client.0.smithi079.stdout:2/322: dwrite d4/f23 [0,4194304] 0 2024-09-10T09:36:03.752 INFO:tasks.workunit.client.0.smithi079.stdout:8/409: dread d11/d3b/f64 [0,4194304] 0 2024-09-10T09:36:03.752 INFO:tasks.workunit.client.0.smithi079.stdout:2/323: write d4/f66 [1476943,57156] 0 2024-09-10T09:36:03.753 INFO:tasks.workunit.client.0.smithi079.stdout:8/410: chown d11/d2b/d4b/d50/d5c/l70 1309326229 1 2024-09-10T09:36:03.753 INFO:tasks.workunit.client.0.smithi079.stdout:8/411: fsync d11/d3b/f3e 0 2024-09-10T09:36:03.753 INFO:tasks.workunit.client.0.smithi079.stdout:7/355: sync 2024-09-10T09:36:03.757 INFO:tasks.workunit.client.0.smithi079.stdout:4/373: rename d1/d38/f56 to d1/da/d28/d47/d52/f79 0 2024-09-10T09:36:03.759 INFO:tasks.workunit.client.0.smithi079.stdout:6/388: write d4/d8/dc/d1c/f53 [2238087,105038] 0 2024-09-10T09:36:03.759 INFO:tasks.workunit.client.0.smithi079.stdout:6/389: write d4/d8/dd/d76/d46/f33 [1019602,99776] 0 2024-09-10T09:36:03.759 INFO:tasks.workunit.client.0.smithi079.stdout:6/390: chown d4/d8/dc/d12/d29/l68 2479 1 2024-09-10T09:36:03.759 INFO:tasks.workunit.client.0.smithi079.stdout:5/338: unlink d2/f6 0 2024-09-10T09:36:03.762 INFO:tasks.workunit.client.0.smithi079.stdout:2/324: truncate d4/f6 3100084 0 2024-09-10T09:36:03.763 INFO:tasks.workunit.client.0.smithi079.stdout:2/325: chown d4/dc/d29/ff 31745399 1 2024-09-10T09:36:03.773 INFO:tasks.workunit.client.0.smithi079.stdout:8/412: symlink d11/d2b/l8a 0 2024-09-10T09:36:03.774 INFO:tasks.workunit.client.0.smithi079.stdout:0/390: getdents d4/d12/d1a/d6d/d7b 0 2024-09-10T09:36:03.776 INFO:tasks.workunit.client.0.smithi079.stdout:7/356: mkdir d4/d6/d4f/d66 0 2024-09-10T09:36:03.778 INFO:tasks.workunit.client.0.smithi079.stdout:1/411: rename d5/df/d11/c18 to d5/df/d2e/c7e 0 2024-09-10T09:36:03.779 INFO:tasks.workunit.client.0.smithi079.stdout:4/374: link d1/da/d16/d4d/l5c d1/d38/l7a 0 2024-09-10T09:36:03.780 INFO:tasks.workunit.client.0.smithi079.stdout:5/339: dwrite d2/d3/fb [4194304,4194304] 0 2024-09-10T09:36:03.784 INFO:tasks.workunit.client.0.smithi079.stdout:6/391: creat d4/d8/dd/d76/d39/d4b/f80 x:0 0 0 2024-09-10T09:36:03.785 INFO:tasks.workunit.client.0.smithi079.stdout:2/326: creat d4/dc/f6d x:0 0 0 2024-09-10T09:36:03.788 INFO:tasks.workunit.client.0.smithi079.stdout:0/391: link d4/d12/d16/d53/d6a/l87 d4/d12/d39/l8a 0 2024-09-10T09:36:03.790 INFO:tasks.workunit.client.0.smithi079.stdout:7/357: rename d4/dc/f25 to d4/d6/d38/f67 0 2024-09-10T09:36:03.792 INFO:tasks.workunit.client.0.smithi079.stdout:1/412: symlink d5/d24/d36/d79/l7f 0 2024-09-10T09:36:03.795 INFO:tasks.workunit.client.0.smithi079.stdout:4/375: unlink d1/f9 0 2024-09-10T09:36:03.797 INFO:tasks.workunit.client.0.smithi079.stdout:5/340: mkdir d2/d3/d27/d70 0 2024-09-10T09:36:03.798 INFO:tasks.workunit.client.0.smithi079.stdout:1/413: write d5/d24/d36/d3a/f3d [1849494,87945] 0 2024-09-10T09:36:03.798 INFO:tasks.workunit.client.0.smithi079.stdout:1/414: chown d5/c17 2905 1 2024-09-10T09:36:03.799 INFO:tasks.workunit.client.0.smithi079.stdout:2/327: symlink d4/dc/d29/d1b/d38/d39/l6e 0 2024-09-10T09:36:03.803 INFO:tasks.workunit.client.0.smithi079.stdout:8/413: rmdir d11/d2b/d4b/d50 39 2024-09-10T09:36:03.803 INFO:tasks.workunit.client.0.smithi079.stdout:7/358: write d4/d6/d38/f67 [1520460,87327] 0 2024-09-10T09:36:03.807 INFO:tasks.workunit.client.0.smithi079.stdout:8/414: unlink d11/d3b/f3e 0 2024-09-10T09:36:03.808 INFO:tasks.workunit.client.0.smithi079.stdout:8/415: chown d11/d2b/d4b/d50/d55/c5f 48106530 1 2024-09-10T09:36:03.811 INFO:tasks.workunit.client.0.smithi079.stdout:5/341: dread d2/d3/f28 [4194304,4194304] 0 2024-09-10T09:36:03.874 INFO:tasks.workunit.client.0.smithi079.stdout:6/392: rename d4/d8/f67 to d4/d8/dc/d1c/f81 0 2024-09-10T09:36:03.876 INFO:tasks.workunit.client.0.smithi079.stdout:8/416: creat d11/d2b/f8b x:0 0 0 2024-09-10T09:36:03.877 INFO:tasks.workunit.client.0.smithi079.stdout:5/342: truncate d2/d3/f16 433542 0 2024-09-10T09:36:03.878 INFO:tasks.workunit.client.0.smithi079.stdout:5/343: readlink d2/d3/lc 0 2024-09-10T09:36:03.880 INFO:tasks.workunit.client.0.smithi079.stdout:8/417: link d11/l2f d11/d3b/l8c 0 2024-09-10T09:36:03.880 INFO:tasks.workunit.client.0.smithi079.stdout:8/418: write d11/d48/f66 [3972389,85713] 0 2024-09-10T09:36:03.880 INFO:tasks.workunit.client.0.smithi079.stdout:8/419: truncate d11/d2b/d4b/d50/f89 332066 0 2024-09-10T09:36:03.880 INFO:tasks.workunit.client.0.smithi079.stdout:8/420: stat d11/d2b/d4b/d50/d55/d87 0 2024-09-10T09:36:03.886 INFO:tasks.workunit.client.0.smithi079.stdout:5/344: mkdir d2/d3/d5e/d61/d71 0 2024-09-10T09:36:03.892 INFO:tasks.workunit.client.0.smithi079.stdout:3/396: sync 2024-09-10T09:36:03.892 INFO:tasks.workunit.client.0.smithi079.stdout:3/397: getdents d4/da/d67 0 2024-09-10T09:36:03.892 INFO:tasks.workunit.client.0.smithi079.stdout:5/345: creat d2/d3/d27/d32/f72 x:0 0 0 2024-09-10T09:36:03.894 INFO:tasks.workunit.client.0.smithi079.stdout:0/392: dwrite d4/fd [0,4194304] 0 2024-09-10T09:36:03.896 INFO:tasks.workunit.client.0.smithi079.stdout:8/421: dread d11/d2b/f30 [0,4194304] 0 2024-09-10T09:36:03.896 INFO:tasks.workunit.client.0.smithi079.stdout:8/422: write d11/d48/f7b [150572,56238] 0 2024-09-10T09:36:03.896 INFO:tasks.workunit.client.0.smithi079.stdout:8/423: chown d11/d2b/d4b/d50/d5c/c7f 35433 1 2024-09-10T09:36:03.896 INFO:tasks.workunit.client.0.smithi079.stdout:2/328: dwrite d4/dc/d29/d1b/d38/d39/f4c [0,4194304] 0 2024-09-10T09:36:03.897 INFO:tasks.workunit.client.0.smithi079.stdout:2/329: mknod d4/dc/d13/d61/d62/c6f 0 2024-09-10T09:36:03.898 INFO:tasks.workunit.client.0.smithi079.stdout:5/346: read d2/d3/f28 [4285078,22373] 0 2024-09-10T09:36:03.898 INFO:tasks.workunit.client.0.smithi079.stdout:5/347: dread - d2/d41/f5d zero size 2024-09-10T09:36:03.898 INFO:tasks.workunit.client.0.smithi079.stdout:2/330: rmdir d4/dc/d1c 39 2024-09-10T09:36:03.903 INFO:tasks.workunit.client.0.smithi079.stdout:0/393: dread d4/fd [0,4194304] 0 2024-09-10T09:36:03.903 INFO:tasks.workunit.client.0.smithi079.stdout:0/394: write d4/d12/d1a/d29/f37 [888051,49185] 0 2024-09-10T09:36:03.904 INFO:tasks.workunit.client.0.smithi079.stdout:0/395: stat d4/d12/d21/d3f/d88 0 2024-09-10T09:36:03.904 INFO:tasks.workunit.client.0.smithi079.stdout:4/376: dwrite d1/da/d3b/d5a/f78 [0,4194304] 0 2024-09-10T09:36:03.904 INFO:tasks.workunit.client.0.smithi079.stdout:1/415: dwrite d5/df/d11/f75 [0,4194304] 0 2024-09-10T09:36:03.904 INFO:tasks.workunit.client.0.smithi079.stdout:8/424: fdatasync d11/d48/f66 0 2024-09-10T09:36:03.905 INFO:tasks.workunit.client.0.smithi079.stdout:6/393: dwrite d4/d8/dc/f4e [0,4194304] 0 2024-09-10T09:36:03.907 INFO:tasks.workunit.client.0.smithi079.stdout:0/396: mkdir d4/d12/d8b 0 2024-09-10T09:36:03.910 INFO:tasks.workunit.client.0.smithi079.stdout:2/331: dread d4/dc/d29/f16 [4194304,4194304] 0 2024-09-10T09:36:03.910 INFO:tasks.workunit.client.0.smithi079.stdout:2/332: chown d4/dc/d13/f3a 3952 1 2024-09-10T09:36:03.911 INFO:tasks.workunit.client.0.smithi079.stdout:4/377: rmdir d1/da/d16/d57 39 2024-09-10T09:36:03.919 INFO:tasks.workunit.client.0.smithi079.stdout:3/398: dwrite d4/da/d17/f32 [0,4194304] 0 2024-09-10T09:36:03.927 INFO:tasks.workunit.client.0.smithi079.stdout:5/348: fsync d2/d3/d27/d32/f72 0 2024-09-10T09:36:03.932 INFO:tasks.workunit.client.0.smithi079.stdout:1/416: symlink d5/d24/d36/d3a/d3c/l80 0 2024-09-10T09:36:03.932 INFO:tasks.workunit.client.0.smithi079.stdout:1/417: truncate d5/d24/d36/d3a/d3c/f54 1028718 0 2024-09-10T09:36:03.934 INFO:tasks.workunit.client.0.smithi079.stdout:7/359: dwrite d4/d6/d38/f67 [0,4194304] 0 2024-09-10T09:36:03.934 INFO:tasks.workunit.client.0.smithi079.stdout:7/360: truncate d4/dc/f36 4972905 0 2024-09-10T09:36:03.934 INFO:tasks.workunit.client.0.smithi079.stdout:8/425: dwrite d11/d48/f66 [0,4194304] 0 2024-09-10T09:36:03.935 INFO:tasks.workunit.client.0.smithi079.stdout:6/394: unlink d4/d8/dd/d76/d46/c23 0 2024-09-10T09:36:03.935 INFO:tasks.workunit.client.0.smithi079.stdout:6/395: read - d4/d8/dd/d76/d39/d4b/f80 zero size 2024-09-10T09:36:03.937 INFO:tasks.workunit.client.0.smithi079.stdout:0/397: rmdir d4/d78 0 2024-09-10T09:36:03.938 INFO:tasks.workunit.client.0.smithi079.stdout:2/333: creat d4/dc/f70 x:0 0 0 2024-09-10T09:36:03.939 INFO:tasks.workunit.client.0.smithi079.stdout:4/378: unlink d1/da/d16/f77 0 2024-09-10T09:36:03.942 INFO:tasks.workunit.client.0.smithi079.stdout:3/399: creat d4/da/d17/d2d/d43/d49/f6f x:0 0 0 2024-09-10T09:36:03.947 INFO:tasks.workunit.client.0.smithi079.stdout:5/349: mkdir d2/d3/d5e/d73 0 2024-09-10T09:36:03.950 INFO:tasks.workunit.client.0.smithi079.stdout:1/418: rename d5/df/d2e/l3f to d5/d24/l81 0 2024-09-10T09:36:03.950 INFO:tasks.workunit.client.0.smithi079.stdout:1/419: truncate d5/d24/d36/d3a/d3c/f7d 67963 0 2024-09-10T09:36:03.951 INFO:tasks.workunit.client.0.smithi079.stdout:7/361: creat d4/df/f68 x:0 0 0 2024-09-10T09:36:03.953 INFO:tasks.workunit.client.0.smithi079.stdout:8/426: chown d11/d2b/d4b/d7e 5436 1 2024-09-10T09:36:03.954 INFO:tasks.workunit.client.0.smithi079.stdout:6/396: creat d4/d8/d74/f82 x:0 0 0 2024-09-10T09:36:03.954 INFO:tasks.workunit.client.0.smithi079.stdout:6/397: fsync d4/d8/fa 0 2024-09-10T09:36:03.954 INFO:tasks.workunit.client.0.smithi079.stdout:6/398: readlink d4/d8/l60 0 2024-09-10T09:36:03.954 INFO:tasks.workunit.client.0.smithi079.stdout:6/399: creat d4/d8/f83 x:0 0 0 2024-09-10T09:36:03.954 INFO:tasks.workunit.client.0.smithi079.stdout:9/319: sync 2024-09-10T09:36:03.954 INFO:tasks.workunit.client.0.smithi079.stdout:9/320: stat d3/d7/d26/d3d/l55 0 2024-09-10T09:36:03.955 INFO:tasks.workunit.client.0.smithi079.stdout:0/398: creat d4/d12/d21/d3f/d88/f8c x:0 0 0 2024-09-10T09:36:03.955 INFO:tasks.workunit.client.0.smithi079.stdout:0/399: write d4/f10 [5054076,87125] 0 2024-09-10T09:36:03.956 INFO:tasks.workunit.client.0.smithi079.stdout:2/334: mknod d4/dc/d13/d61/c71 0 2024-09-10T09:36:03.957 INFO:tasks.workunit.client.0.smithi079.stdout:3/400: symlink d4/da/d18/l70 0 2024-09-10T09:36:03.957 INFO:tasks.workunit.client.0.smithi079.stdout:3/401: stat d4/da/d17/d2d/f34 0 2024-09-10T09:36:03.957 INFO:tasks.workunit.client.0.smithi079.stdout:3/402: stat d4/da/d17/c3c 0 2024-09-10T09:36:03.958 INFO:tasks.workunit.client.0.smithi079.stdout:0/400: write d4/d12/d16/d53/f64 [80835,125107] 0 2024-09-10T09:36:03.959 INFO:tasks.workunit.client.0.smithi079.stdout:5/350: rename d2/d3/d27/d32/d39/f4a to d2/d41/f74 0 2024-09-10T09:36:03.960 INFO:tasks.workunit.client.0.smithi079.stdout:4/379: dwrite d1/f7 [0,4194304] 0 2024-09-10T09:36:03.960 INFO:tasks.workunit.client.0.smithi079.stdout:5/351: creat d2/d3/d27/d32/f75 x:0 0 0 2024-09-10T09:36:03.960 INFO:tasks.workunit.client.0.smithi079.stdout:5/352: dread - d2/d3/d27/d32/d39/f5c zero size 2024-09-10T09:36:03.960 INFO:tasks.workunit.client.0.smithi079.stdout:5/353: dread - d2/d3/d5e/d61/f6c zero size 2024-09-10T09:36:03.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:03 smithi079 ceph-mon[27592]: pgmap v256: 65 pgs: 65 active+clean; 592 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 47 MiB/s rd, 61 MiB/s wr, 610 op/s 2024-09-10T09:36:03.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:03.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:03.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:03 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:36:03.966 INFO:tasks.workunit.client.0.smithi079.stdout:6/400: read d4/d8/dc/d1c/f1d [1674389,14685] 0 2024-09-10T09:36:03.966 INFO:tasks.workunit.client.0.smithi079.stdout:9/321: unlink d3/d7/d26/d3d/c48 0 2024-09-10T09:36:03.979 INFO:tasks.workunit.client.0.smithi079.stdout:5/354: link d2/c19 d2/d3/d27/d70/c76 0 2024-09-10T09:36:03.984 INFO:tasks.workunit.client.0.smithi079.stdout:1/420: symlink d5/d24/d36/l82 0 2024-09-10T09:36:03.985 INFO:tasks.workunit.client.0.smithi079.stdout:8/427: link d11/l2f d11/l8d 0 2024-09-10T09:36:03.988 INFO:tasks.workunit.client.0.smithi079.stdout:6/401: creat d4/d8/dc/d12/d70/f84 x:0 0 0 2024-09-10T09:36:03.990 INFO:tasks.workunit.client.0.smithi079.stdout:1/421: rmdir d5/df/d2e 39 2024-09-10T09:36:03.993 INFO:tasks.workunit.client.0.smithi079.stdout:1/422: creat d5/df/d2e/f83 x:0 0 0 2024-09-10T09:36:03.995 INFO:tasks.workunit.client.0.smithi079.stdout:5/355: read d2/d3/d27/f43 [2171410,17133] 0 2024-09-10T09:36:03.995 INFO:tasks.workunit.client.0.smithi079.stdout:5/356: stat d2/d3/d27/d32/l48 0 2024-09-10T09:36:03.995 INFO:tasks.workunit.client.0.smithi079.stdout:6/402: unlink d4/d8/dc/d1c/l72 0 2024-09-10T09:36:03.995 INFO:tasks.workunit.client.0.smithi079.stdout:6/403: stat d4/d8/d74 0 2024-09-10T09:36:03.996 INFO:tasks.workunit.client.0.smithi079.stdout:6/404: truncate d4/d8/dc/d12/f73 1043174 0 2024-09-10T09:36:03.997 INFO:tasks.workunit.client.0.smithi079.stdout:5/357: mknod d2/c77 0 2024-09-10T09:36:04.001 INFO:tasks.workunit.client.0.smithi079.stdout:6/405: rename d4/d8/dd/d76/d46/f79 to d4/d8/dd/f85 0 2024-09-10T09:36:04.002 INFO:tasks.workunit.client.0.smithi079.stdout:6/406: write f3 [4978027,5805] 0 2024-09-10T09:36:04.004 INFO:tasks.workunit.client.0.smithi079.stdout:1/423: dread d5/d24/d36/d3a/d3c/f7a [4194304,4194304] 0 2024-09-10T09:36:04.006 INFO:tasks.workunit.client.0.smithi079.stdout:6/407: link d4/c6b d4/d8/dc/d1c/c86 0 2024-09-10T09:36:04.006 INFO:tasks.workunit.client.0.smithi079.stdout:6/408: write d4/d8/dc/d1c/f53 [184641,15978] 0 2024-09-10T09:36:04.011 INFO:tasks.workunit.client.0.smithi079.stdout:3/403: dwrite d4/da/d17/d2d/d43/d49/f68 [0,4194304] 0 2024-09-10T09:36:04.014 INFO:tasks.workunit.client.0.smithi079.stdout:3/404: symlink d4/da/d17/d38/d42/l71 0 2024-09-10T09:36:04.014 INFO:tasks.workunit.client.0.smithi079.stdout:5/358: dread d2/d3/f38 [0,4194304] 0 2024-09-10T09:36:04.016 INFO:tasks.workunit.client.0.smithi079.stdout:5/359: mkdir d2/d41/d4d/d78 0 2024-09-10T09:36:04.016 INFO:tasks.workunit.client.0.smithi079.stdout:5/360: creat d2/d3/f79 x:0 0 0 2024-09-10T09:36:04.018 INFO:tasks.workunit.client.0.smithi079.stdout:5/361: creat d2/d3/d5e/d73/f7a x:0 0 0 2024-09-10T09:36:04.020 INFO:tasks.workunit.client.0.smithi079.stdout:0/401: dwrite d4/d12/d39/f48 [0,4194304] 0 2024-09-10T09:36:04.020 INFO:tasks.workunit.client.0.smithi079.stdout:0/402: chown d4/d12/d21/f54 868656 1 2024-09-10T09:36:04.020 INFO:tasks.workunit.client.0.smithi079.stdout:5/362: getdents d2/d3/d5e/d61 0 2024-09-10T09:36:04.021 INFO:tasks.workunit.client.0.smithi079.stdout:3/405: dread d4/da/d17/f37 [0,4194304] 0 2024-09-10T09:36:04.022 INFO:tasks.workunit.client.0.smithi079.stdout:7/362: dwrite d4/d6/d38/f3f [0,4194304] 0 2024-09-10T09:36:04.023 INFO:tasks.workunit.client.0.smithi079.stdout:2/335: dwrite d4/f23 [4194304,4194304] 0 2024-09-10T09:36:04.023 INFO:tasks.workunit.client.0.smithi079.stdout:2/336: write d4/dc/d29/f16 [904344,22800] 0 2024-09-10T09:36:04.023 INFO:tasks.workunit.client.0.smithi079.stdout:2/337: chown d4/dc/d1c/f28 8 1 2024-09-10T09:36:04.023 INFO:tasks.workunit.client.0.smithi079.stdout:2/338: fdatasync d4/dc/d29/d1b/d38/d39/d31/f46 0 2024-09-10T09:36:04.023 INFO:tasks.workunit.client.0.smithi079.stdout:4/380: dwrite d1/da/d28/d47/f6f [0,4194304] 0 2024-09-10T09:36:04.024 INFO:tasks.workunit.client.0.smithi079.stdout:2/339: write d4/f66 [1398589,29234] 0 2024-09-10T09:36:04.024 INFO:tasks.workunit.client.0.smithi079.stdout:5/363: rename d2/f60 to d2/d3/d27/d32/d39/f7b 0 2024-09-10T09:36:04.025 INFO:tasks.workunit.client.0.smithi079.stdout:7/363: creat d4/d6/d4f/d66/f69 x:0 0 0 2024-09-10T09:36:04.026 INFO:tasks.workunit.client.0.smithi079.stdout:9/322: dwrite d3/d7/dc/de/d17/f52 [4194304,4194304] 0 2024-09-10T09:36:04.028 INFO:tasks.workunit.client.0.smithi079.stdout:1/424: dwrite d5/df/d11/f2d [0,4194304] 0 2024-09-10T09:36:04.028 INFO:tasks.workunit.client.0.smithi079.stdout:6/409: dwrite d4/d8/dd/d41/f45 [0,4194304] 0 2024-09-10T09:36:04.029 INFO:tasks.workunit.client.0.smithi079.stdout:4/381: creat d1/da/f7b x:0 0 0 2024-09-10T09:36:04.030 INFO:tasks.workunit.client.0.smithi079.stdout:2/340: truncate d4/dc/d1c/f28 5385458 0 2024-09-10T09:36:04.032 INFO:tasks.workunit.client.0.smithi079.stdout:0/403: dread d4/d12/d1a/d29/f37 [0,4194304] 0 2024-09-10T09:36:04.032 INFO:tasks.workunit.client.0.smithi079.stdout:5/364: stat d2/d3/l35 0 2024-09-10T09:36:04.034 INFO:tasks.workunit.client.0.smithi079.stdout:7/364: rmdir d4/d6/d38 39 2024-09-10T09:36:04.034 INFO:tasks.workunit.client.0.smithi079.stdout:7/365: truncate d4/dc/f4a 649734 0 2024-09-10T09:36:04.035 INFO:tasks.workunit.client.0.smithi079.stdout:7/366: dread d4/dc/f4a [0,4194304] 0 2024-09-10T09:36:04.037 INFO:tasks.workunit.client.0.smithi079.stdout:9/323: link d3/d7/dc/de/l1e d3/d7/d26/l64 0 2024-09-10T09:36:04.039 INFO:tasks.workunit.client.0.smithi079.stdout:1/425: symlink d5/d24/d36/d79/l84 0 2024-09-10T09:36:04.043 INFO:tasks.workunit.client.0.smithi079.stdout:4/382: dread d1/da/d16/f27 [0,4194304] 0 2024-09-10T09:36:04.045 INFO:tasks.workunit.client.0.smithi079.stdout:0/404: dread d4/d12/d39/f46 [0,4194304] 0 2024-09-10T09:36:04.046 INFO:tasks.workunit.client.0.smithi079.stdout:0/405: chown d4/d12/d16/c65 32209013 1 2024-09-10T09:36:04.050 INFO:tasks.workunit.client.0.smithi079.stdout:9/324: creat d3/d7/d5a/f65 x:0 0 0 2024-09-10T09:36:04.052 INFO:tasks.workunit.client.0.smithi079.stdout:2/341: dwrite d4/f6 [0,4194304] 0 2024-09-10T09:36:04.052 INFO:tasks.workunit.client.0.smithi079.stdout:2/342: chown d4/dc/d13/d61/d62 420196624 1 2024-09-10T09:36:04.053 INFO:tasks.workunit.client.0.smithi079.stdout:4/383: unlink d1/da/d28/d47/f4c 0 2024-09-10T09:36:04.057 INFO:tasks.workunit.client.0.smithi079.stdout:7/367: unlink d4/df/d19/f53 0 2024-09-10T09:36:04.058 INFO:tasks.workunit.client.0.smithi079.stdout:7/368: dread - d4/df/f68 zero size 2024-09-10T09:36:04.058 INFO:tasks.workunit.client.0.smithi079.stdout:7/369: chown d4/d6/d38/d55/f5c 10566 1 2024-09-10T09:36:04.058 INFO:tasks.workunit.client.0.smithi079.stdout:1/426: read d5/f19 [318919,40324] 0 2024-09-10T09:36:04.060 INFO:tasks.workunit.client.0.smithi079.stdout:9/325: truncate d3/f14 1489693 0 2024-09-10T09:36:04.064 INFO:tasks.workunit.client.0.smithi079.stdout:4/384: unlink d1/ff 0 2024-09-10T09:36:04.065 INFO:tasks.workunit.client.0.smithi079.stdout:0/406: getdents d4/d12 0 2024-09-10T09:36:04.066 INFO:tasks.workunit.client.0.smithi079.stdout:7/370: mknod d4/dc/c6a 0 2024-09-10T09:36:04.066 INFO:tasks.workunit.client.0.smithi079.stdout:7/371: stat d4/d6/d4f 0 2024-09-10T09:36:04.067 INFO:tasks.workunit.client.0.smithi079.stdout:9/326: mkdir d3/d7/d26/d66 0 2024-09-10T09:36:04.067 INFO:tasks.workunit.client.0.smithi079.stdout:9/327: stat d3/d7/f5b 0 2024-09-10T09:36:04.068 INFO:tasks.workunit.client.0.smithi079.stdout:0/407: rename d4/d12/d15/d2b/f45 to d4/d12/d39/f8d 0 2024-09-10T09:36:04.068 INFO:tasks.workunit.client.0.smithi079.stdout:0/408: write d4/d12/d39/f8d [309707,12097] 0 2024-09-10T09:36:04.069 INFO:tasks.workunit.client.0.smithi079.stdout:3/406: dwrite d4/f2a [0,4194304] 0 2024-09-10T09:36:04.070 INFO:tasks.workunit.client.0.smithi079.stdout:7/372: mkdir d4/df/d6b 0 2024-09-10T09:36:04.070 INFO:tasks.workunit.client.0.smithi079.stdout:7/373: write d4/df/d3d/f65 [233010,92315] 0 2024-09-10T09:36:04.070 INFO:tasks.workunit.client.0.smithi079.stdout:8/428: dwrite d11/d48/f7b [0,4194304] 0 2024-09-10T09:36:04.071 INFO:tasks.workunit.client.0.smithi079.stdout:5/365: dwrite d2/d3/d27/f2c [0,4194304] 0 2024-09-10T09:36:04.071 INFO:tasks.workunit.client.0.smithi079.stdout:5/366: creat d2/d3/d27/d32/d44/f7c x:0 0 0 2024-09-10T09:36:04.072 INFO:tasks.workunit.client.0.smithi079.stdout:0/409: creat d4/d12/d16/d53/d79/f8e x:0 0 0 2024-09-10T09:36:04.075 INFO:tasks.workunit.client.0.smithi079.stdout:3/407: mkdir d4/da/d17/d72 0 2024-09-10T09:36:04.075 INFO:tasks.workunit.client.0.smithi079.stdout:3/408: truncate d4/f4d 680683 0 2024-09-10T09:36:04.075 INFO:tasks.workunit.client.0.smithi079.stdout:3/409: read d4/f4d [80415,129093] 0 2024-09-10T09:36:04.075 INFO:tasks.workunit.client.0.smithi079.stdout:3/410: readlink d4/da/d17/d38/l5c 0 2024-09-10T09:36:04.081 INFO:tasks.workunit.client.0.smithi079.stdout:3/411: write d4/da/d18/f47 [616613,8148] 0 2024-09-10T09:36:04.083 INFO:tasks.workunit.client.0.smithi079.stdout:6/410: dread f3 [0,4194304] 0 2024-09-10T09:36:04.084 INFO:tasks.workunit.client.0.smithi079.stdout:0/410: dread d4/d12/d39/f8d [0,4194304] 0 2024-09-10T09:36:04.089 INFO:tasks.workunit.client.0.smithi079.stdout:5/367: creat d2/d3/d59/f7d x:0 0 0 2024-09-10T09:36:04.090 INFO:tasks.workunit.client.0.smithi079.stdout:3/412: write d4/da/d17/f1a [1657202,85538] 0 2024-09-10T09:36:04.092 INFO:tasks.workunit.client.0.smithi079.stdout:7/374: getdents d4/d6/d4f/d66 0 2024-09-10T09:36:04.099 INFO:tasks.workunit.client.0.smithi079.stdout:9/328: dwrite d3/d7/dc/de/d58/f60 [0,4194304] 0 2024-09-10T09:36:04.101 INFO:tasks.workunit.client.0.smithi079.stdout:8/429: dwrite d11/f88 [0,4194304] 0 2024-09-10T09:36:04.102 INFO:tasks.workunit.client.0.smithi079.stdout:7/375: dread d4/df/d3d/f40 [0,4194304] 0 2024-09-10T09:36:04.113 INFO:tasks.workunit.client.0.smithi079.stdout:5/368: mkdir d2/d41/d7e 0 2024-09-10T09:36:04.114 INFO:tasks.workunit.client.0.smithi079.stdout:0/411: getdents d4/d1d/d24 0 2024-09-10T09:36:04.117 INFO:tasks.workunit.client.0.smithi079.stdout:9/329: rename d3/l3e to d3/d7/dc/de/d58/l67 0 2024-09-10T09:36:04.117 INFO:tasks.workunit.client.0.smithi079.stdout:9/330: chown d3/d7/dc/de/d17/d2f/d30/f3a 6 1 2024-09-10T09:36:04.121 INFO:tasks.workunit.client.0.smithi079.stdout:5/369: read d2/d3/f28 [2900834,79426] 0 2024-09-10T09:36:04.124 INFO:tasks.workunit.client.0.smithi079.stdout:8/430: dwrite d11/d3b/f6f [0,4194304] 0 2024-09-10T09:36:04.126 INFO:tasks.workunit.client.0.smithi079.stdout:0/412: write d4/d12/d39/f48 [3127028,74963] 0 2024-09-10T09:36:04.126 INFO:tasks.workunit.client.0.smithi079.stdout:3/413: dwrite d4/da/d18/f1c [4194304,4194304] 0 2024-09-10T09:36:04.189 INFO:tasks.workunit.client.0.smithi079.stdout:7/376: creat d4/dc/f6c x:0 0 0 2024-09-10T09:36:04.189 INFO:tasks.workunit.client.0.smithi079.stdout:6/411: dwrite d4/d8/dc/d1c/f53 [0,4194304] 0 2024-09-10T09:36:04.189 INFO:tasks.workunit.client.0.smithi079.stdout:2/343: truncate d4/dc/d1c/f28 3143590 0 2024-09-10T09:36:04.190 INFO:tasks.workunit.client.0.smithi079.stdout:5/370: mknod d2/d3/d5e/d73/c7f 0 2024-09-10T09:36:04.193 INFO:tasks.workunit.client.0.smithi079.stdout:8/431: readlink d11/d2b/l8a 0 2024-09-10T09:36:04.208 INFO:tasks.workunit.client.0.smithi079.stdout:9/331: dwrite d3/d7/d26/d3d/f42 [0,4194304] 0 2024-09-10T09:36:04.209 INFO:tasks.workunit.client.0.smithi079.stdout:2/344: dread d4/dc/f22 [0,4194304] 0 2024-09-10T09:36:04.209 INFO:tasks.workunit.client.0.smithi079.stdout:9/332: chown d3/d7/dc/c59 46662614 1 2024-09-10T09:36:04.209 INFO:tasks.workunit.client.0.smithi079.stdout:9/333: stat d3/d7/d26/d66 0 2024-09-10T09:36:04.209 INFO:tasks.workunit.client.0.smithi079.stdout:9/334: truncate d3/d7/dc/de/d17/d2f/f5e 652917 0 2024-09-10T09:36:04.213 INFO:tasks.workunit.client.0.smithi079.stdout:9/335: dread d3/d7/dc/de/f46 [0,4194304] 0 2024-09-10T09:36:04.214 INFO:tasks.workunit.client.0.smithi079.stdout:9/336: chown d3/d7/dc/de/d17/d2f/c57 1034 1 2024-09-10T09:36:04.214 INFO:tasks.workunit.client.0.smithi079.stdout:9/337: dread - d3/d40/f5d zero size 2024-09-10T09:36:04.214 INFO:tasks.workunit.client.0.smithi079.stdout:9/338: chown d3/d7/d26/d3d 208 1 2024-09-10T09:36:04.214 INFO:tasks.workunit.client.0.smithi079.stdout:9/339: creat d3/d7/d5a/f68 x:0 0 0 2024-09-10T09:36:04.216 INFO:tasks.workunit.client.0.smithi079.stdout:6/412: dwrite d4/d8/dd/d41/f54 [0,4194304] 0 2024-09-10T09:36:04.216 INFO:tasks.workunit.client.0.smithi079.stdout:6/413: write d4/d8/f7d [887890,25303] 0 2024-09-10T09:36:04.216 INFO:tasks.workunit.client.0.smithi079.stdout:5/371: dwrite d2/f26 [8388608,4194304] 0 2024-09-10T09:36:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:03 smithi135 ceph-mon[33411]: pgmap v256: 65 pgs: 65 active+clean; 592 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 47 MiB/s rd, 61 MiB/s wr, 610 op/s 2024-09-10T09:36:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:03 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:36:04.230 INFO:tasks.workunit.client.0.smithi079.stdout:0/413: mknod d4/d12/d16/d53/c8f 0 2024-09-10T09:36:04.231 INFO:tasks.workunit.client.0.smithi079.stdout:3/414: rename d4/da/d18/f46 to d4/f73 0 2024-09-10T09:36:04.232 INFO:tasks.workunit.client.0.smithi079.stdout:7/377: unlink d4/df/d19/l50 0 2024-09-10T09:36:04.233 INFO:tasks.workunit.client.0.smithi079.stdout:8/432: symlink d11/d48/l8e 0 2024-09-10T09:36:04.243 INFO:tasks.workunit.client.0.smithi079.stdout:9/340: mkdir d3/d7/d26/d69 0 2024-09-10T09:36:04.244 INFO:tasks.workunit.client.0.smithi079.stdout:6/414: creat d4/d8/dc/d1c/f87 x:0 0 0 2024-09-10T09:36:04.246 INFO:tasks.workunit.client.0.smithi079.stdout:5/372: mkdir d2/d3/d27/d70/d80 0 2024-09-10T09:36:04.246 INFO:tasks.workunit.client.0.smithi079.stdout:5/373: chown d2/d3/d27/d32/d44 2017262157 1 2024-09-10T09:36:04.247 INFO:tasks.workunit.client.0.smithi079.stdout:0/414: mknod d4/d12/d1a/d29/d32/d7d/c90 0 2024-09-10T09:36:04.248 INFO:tasks.workunit.client.0.smithi079.stdout:0/415: dread d4/d1d/f3a [0,4194304] 0 2024-09-10T09:36:04.251 INFO:tasks.workunit.client.0.smithi079.stdout:2/345: rename d4/dc/d29/d1b/d38/d39/f3c to d4/dc/d13/d61/f72 0 2024-09-10T09:36:04.254 INFO:tasks.workunit.client.0.smithi079.stdout:3/415: creat d4/da/d17/d2d/d43/f74 x:0 0 0 2024-09-10T09:36:04.254 INFO:tasks.workunit.client.0.smithi079.stdout:3/416: truncate d4/da/d17/d2d/d43/d4c/f60 1499364 0 2024-09-10T09:36:04.255 INFO:tasks.workunit.client.0.smithi079.stdout:8/433: dwrite d11/d48/f60 [0,4194304] 0 2024-09-10T09:36:04.256 INFO:tasks.workunit.client.0.smithi079.stdout:6/415: mkdir d4/d8/dd/d76/d46/d88 0 2024-09-10T09:36:04.256 INFO:tasks.workunit.client.0.smithi079.stdout:6/416: creat d4/d8/dc/d12/f89 x:0 0 0 2024-09-10T09:36:04.258 INFO:tasks.workunit.client.0.smithi079.stdout:7/378: rename d4/d6/d4f/d66/f69 to d4/dc/f6d 0 2024-09-10T09:36:04.258 INFO:tasks.workunit.client.0.smithi079.stdout:7/379: write d4/d6/d3e/f51 [478797,95572] 0 2024-09-10T09:36:04.258 INFO:tasks.workunit.client.0.smithi079.stdout:7/380: write d4/df/d3d/f56 [137472,37600] 0 2024-09-10T09:36:04.258 INFO:tasks.workunit.client.0.smithi079.stdout:7/381: creat d4/df/f6e x:0 0 0 2024-09-10T09:36:04.258 INFO:tasks.workunit.client.0.smithi079.stdout:7/382: write d4/f5 [3251844,14335] 0 2024-09-10T09:36:04.258 INFO:tasks.workunit.client.0.smithi079.stdout:7/383: fdatasync d4/dc/f32 0 2024-09-10T09:36:04.259 INFO:tasks.workunit.client.0.smithi079.stdout:7/384: chown d4/d6/d3e 644653052 1 2024-09-10T09:36:04.262 INFO:tasks.workunit.client.0.smithi079.stdout:5/374: read d2/d3/d27/f69 [171840,40763] 0 2024-09-10T09:36:04.267 INFO:tasks.workunit.client.0.smithi079.stdout:6/417: unlink d4/d8/dc/c14 0 2024-09-10T09:36:04.271 INFO:tasks.workunit.client.0.smithi079.stdout:9/341: rename d3/d7/dc/de/d58/f60 to d3/d7/dc/de/f6a 0 2024-09-10T09:36:04.277 INFO:tasks.workunit.client.0.smithi079.stdout:5/375: dread d2/f1b [0,4194304] 0 2024-09-10T09:36:04.277 INFO:tasks.workunit.client.0.smithi079.stdout:5/376: stat d2/d3/c2f 0 2024-09-10T09:36:04.278 INFO:tasks.workunit.client.0.smithi079.stdout:7/385: creat d4/d6/d38/d55/f6f x:0 0 0 2024-09-10T09:36:04.278 INFO:tasks.workunit.client.0.smithi079.stdout:7/386: stat d4/d6 0 2024-09-10T09:36:04.278 INFO:tasks.workunit.client.0.smithi079.stdout:7/387: chown d4/d6/d3e/c46 92175 1 2024-09-10T09:36:04.278 INFO:tasks.workunit.client.0.smithi079.stdout:9/342: dread d3/f16 [0,4194304] 0 2024-09-10T09:36:04.278 INFO:tasks.workunit.client.0.smithi079.stdout:6/418: write d4/d8/dc/d1c/f21 [268893,113305] 0 2024-09-10T09:36:04.279 INFO:tasks.workunit.client.0.smithi079.stdout:5/377: rename d2/d3/l35 to d2/d3/d5e/l81 0 2024-09-10T09:36:04.280 INFO:tasks.workunit.client.0.smithi079.stdout:1/427: sync 2024-09-10T09:36:04.280 INFO:tasks.workunit.client.0.smithi079.stdout:4/385: sync 2024-09-10T09:36:04.281 INFO:tasks.workunit.client.0.smithi079.stdout:9/343: creat d3/d7/dc/d62/f6b x:0 0 0 2024-09-10T09:36:04.281 INFO:tasks.workunit.client.0.smithi079.stdout:9/344: readlink d3/d7/dc/de/d17/d2f/d30/l3f 0 2024-09-10T09:36:04.282 INFO:tasks.workunit.client.0.smithi079.stdout:4/386: write d1/da/d3b/d5f/f62 [451546,62632] 0 2024-09-10T09:36:04.283 INFO:tasks.workunit.client.0.smithi079.stdout:6/419: truncate d4/d8/dc/f4e 2688255 0 2024-09-10T09:36:04.283 INFO:tasks.workunit.client.0.smithi079.stdout:6/420: truncate d4/d8/dc/d12/d70/f84 130722 0 2024-09-10T09:36:04.287 INFO:tasks.workunit.client.0.smithi079.stdout:2/346: dwrite d4/dc/d29/f3f [0,4194304] 0 2024-09-10T09:36:04.287 INFO:tasks.workunit.client.0.smithi079.stdout:3/417: dwrite d4/f2b [0,4194304] 0 2024-09-10T09:36:04.287 INFO:tasks.workunit.client.0.smithi079.stdout:8/434: dwrite d11/d2b/d4b/d50/f89 [0,4194304] 0 2024-09-10T09:36:04.287 INFO:tasks.workunit.client.0.smithi079.stdout:0/416: dwrite d4/d12/d21/f43 [0,4194304] 0 2024-09-10T09:36:04.288 INFO:tasks.workunit.client.0.smithi079.stdout:1/428: mkdir d5/d24/d36/d3a/d85 0 2024-09-10T09:36:04.288 INFO:tasks.workunit.client.0.smithi079.stdout:1/429: write d5/df/d2e/f83 [967843,67197] 0 2024-09-10T09:36:04.290 INFO:tasks.workunit.client.0.smithi079.stdout:4/387: rmdir d1/da/d28 39 2024-09-10T09:36:04.290 INFO:tasks.workunit.client.0.smithi079.stdout:4/388: creat d1/da/d3b/d5a/f7c x:0 0 0 2024-09-10T09:36:04.291 INFO:tasks.workunit.client.0.smithi079.stdout:6/421: mkdir d4/d8/dd/d76/d39/d8a 0 2024-09-10T09:36:04.291 INFO:tasks.workunit.client.0.smithi079.stdout:6/422: write d4/d8/dd/f85 [582023,53620] 0 2024-09-10T09:36:04.291 INFO:tasks.workunit.client.0.smithi079.stdout:6/423: chown d4/d8/f7d 78921 1 2024-09-10T09:36:04.293 INFO:tasks.workunit.client.0.smithi079.stdout:5/378: getdents d2/d3/d59 0 2024-09-10T09:36:04.293 INFO:tasks.workunit.client.0.smithi079.stdout:7/388: dwrite d4/d6/fa [4194304,4194304] 0 2024-09-10T09:36:04.294 INFO:tasks.workunit.client.0.smithi079.stdout:1/430: write d5/df/d41/f65 [63814,122399] 0 2024-09-10T09:36:04.294 INFO:tasks.workunit.client.0.smithi079.stdout:1/431: write d5/d24/f2f [13084,68074] 0 2024-09-10T09:36:04.295 INFO:tasks.workunit.client.0.smithi079.stdout:1/432: dread - d5/d24/d36/d3a/d3c/f72 zero size 2024-09-10T09:36:04.299 INFO:tasks.workunit.client.0.smithi079.stdout:5/379: write d2/d3/f16 [34137,68501] 0 2024-09-10T09:36:04.301 INFO:tasks.workunit.client.0.smithi079.stdout:3/418: unlink d4/da/d17/d2d/c2e 0 2024-09-10T09:36:04.302 INFO:tasks.workunit.client.0.smithi079.stdout:3/419: truncate d4/da/d17/d2d/d43/f74 87312 0 2024-09-10T09:36:04.316 INFO:tasks.workunit.client.0.smithi079.stdout:4/389: creat d1/da/d16/d57/f7d x:0 0 0 2024-09-10T09:36:04.316 INFO:tasks.workunit.client.0.smithi079.stdout:4/390: fsync d1/f2e 0 2024-09-10T09:36:04.316 INFO:tasks.workunit.client.0.smithi079.stdout:6/424: creat d4/d8/dc/d12/d29/f8b x:0 0 0 2024-09-10T09:36:04.317 INFO:tasks.workunit.client.0.smithi079.stdout:2/347: dwrite d4/f66 [0,4194304] 0 2024-09-10T09:36:04.318 INFO:tasks.workunit.client.0.smithi079.stdout:7/389: mkdir d4/d6/d4f/d70 0 2024-09-10T09:36:04.318 INFO:tasks.workunit.client.0.smithi079.stdout:7/390: dread - d4/dc/d43/f57 zero size 2024-09-10T09:36:04.320 INFO:tasks.workunit.client.0.smithi079.stdout:0/417: dwrite d4/d12/f14 [0,4194304] 0 2024-09-10T09:36:04.326 INFO:tasks.workunit.client.0.smithi079.stdout:1/433: dwrite d5/d24/d36/d3a/d48/f56 [0,4194304] 0 2024-09-10T09:36:04.326 INFO:tasks.workunit.client.0.smithi079.stdout:1/434: fdatasync d5/d24/d36/d3a/f3d 0 2024-09-10T09:36:04.327 INFO:tasks.workunit.client.0.smithi079.stdout:5/380: mknod d2/c82 0 2024-09-10T09:36:04.327 INFO:tasks.workunit.client.0.smithi079.stdout:5/381: creat d2/d3/f83 x:0 0 0 2024-09-10T09:36:04.327 INFO:tasks.workunit.client.0.smithi079.stdout:5/382: creat d2/d3/f84 x:0 0 0 2024-09-10T09:36:04.327 INFO:tasks.workunit.client.0.smithi079.stdout:5/383: readlink d2/d3/l5 0 2024-09-10T09:36:04.328 INFO:tasks.workunit.client.0.smithi079.stdout:3/420: creat d4/da/d17/d72/f75 x:0 0 0 2024-09-10T09:36:04.328 INFO:tasks.workunit.client.0.smithi079.stdout:8/435: truncate d11/d2b/f76 3570581 0 2024-09-10T09:36:04.329 INFO:tasks.workunit.client.0.smithi079.stdout:4/391: mknod d1/da/d3b/d59/c7e 0 2024-09-10T09:36:04.329 INFO:tasks.workunit.client.0.smithi079.stdout:4/392: chown d1/da/d28/f29 16084351 1 2024-09-10T09:36:04.329 INFO:tasks.workunit.client.0.smithi079.stdout:4/393: stat d1/c3 0 2024-09-10T09:36:04.331 INFO:tasks.workunit.client.0.smithi079.stdout:6/425: symlink d4/d8/dd/d76/d39/d8a/l8c 0 2024-09-10T09:36:04.333 INFO:tasks.workunit.client.0.smithi079.stdout:2/348: dwrite d4/dc/f70 [0,4194304] 0 2024-09-10T09:36:04.340 INFO:tasks.workunit.client.0.smithi079.stdout:1/435: link d5/d24/d36/d79/l84 d5/d40/l86 0 2024-09-10T09:36:04.340 INFO:tasks.workunit.client.0.smithi079.stdout:1/436: chown d5/c17 741821 1 2024-09-10T09:36:04.340 INFO:tasks.workunit.client.0.smithi079.stdout:1/437: chown d5/d24/d36/d3a/d3c/d57 207807 1 2024-09-10T09:36:04.345 INFO:tasks.workunit.client.0.smithi079.stdout:5/384: rmdir d2/d41/d4d/d78 0 2024-09-10T09:36:04.345 INFO:tasks.workunit.client.0.smithi079.stdout:5/385: read d2/f3a [1608333,59796] 0 2024-09-10T09:36:04.347 INFO:tasks.workunit.client.0.smithi079.stdout:3/421: rename d4/f7 to d4/da/d17/d2d/f76 0 2024-09-10T09:36:04.348 INFO:tasks.workunit.client.0.smithi079.stdout:4/394: creat d1/da/d3b/f7f x:0 0 0 2024-09-10T09:36:04.351 INFO:tasks.workunit.client.0.smithi079.stdout:1/438: symlink d5/d24/d36/d3a/d48/l87 0 2024-09-10T09:36:04.352 INFO:tasks.workunit.client.0.smithi079.stdout:1/439: write d5/d24/d36/d3a/d3c/f72 [968072,107820] 0 2024-09-10T09:36:04.352 INFO:tasks.workunit.client.0.smithi079.stdout:5/386: mkdir d2/d3/d5e/d85 0 2024-09-10T09:36:04.354 INFO:tasks.workunit.client.0.smithi079.stdout:6/426: rename d4/d8/dc/d1c/c86 to d4/d8/dd/d41/d51/c8d 0 2024-09-10T09:36:04.354 INFO:tasks.workunit.client.0.smithi079.stdout:6/427: write d4/d8/dc/d3c/f6a [617142,33690] 0 2024-09-10T09:36:04.354 INFO:tasks.workunit.client.0.smithi079.stdout:6/428: creat d4/d8/dd/d76/d39/d4b/f8e x:0 0 0 2024-09-10T09:36:04.355 INFO:tasks.workunit.client.0.smithi079.stdout:3/422: symlink d4/da/d17/d2d/d43/d49/l77 0 2024-09-10T09:36:04.357 INFO:tasks.workunit.client.0.smithi079.stdout:1/440: truncate d5/d24/d36/d3a/d3c/f7a 6100523 0 2024-09-10T09:36:04.358 INFO:tasks.workunit.client.0.smithi079.stdout:2/349: dwrite d4/dc/d29/f3f [0,4194304] 0 2024-09-10T09:36:04.359 INFO:tasks.workunit.client.0.smithi079.stdout:2/350: write d4/f2b [5700357,2101] 0 2024-09-10T09:36:04.360 INFO:tasks.workunit.client.0.smithi079.stdout:5/387: mknod d2/d3/d5e/d73/c86 0 2024-09-10T09:36:04.361 INFO:tasks.workunit.client.0.smithi079.stdout:4/395: read d1/da/f45 [1520609,50300] 0 2024-09-10T09:36:04.361 INFO:tasks.workunit.client.0.smithi079.stdout:8/436: dwrite d11/d2b/d4b/d50/d55/f65 [0,4194304] 0 2024-09-10T09:36:04.361 INFO:tasks.workunit.client.0.smithi079.stdout:7/391: dwrite d4/df/d19/f48 [0,4194304] 0 2024-09-10T09:36:04.361 INFO:tasks.workunit.client.0.smithi079.stdout:4/396: dread d1/da/d3b/d5a/f63 [0,4194304] 0 2024-09-10T09:36:04.362 INFO:tasks.workunit.client.0.smithi079.stdout:6/429: creat d4/d8/dd/d76/f8f x:0 0 0 2024-09-10T09:36:04.363 INFO:tasks.workunit.client.0.smithi079.stdout:1/441: truncate d5/df/f52 435591 0 2024-09-10T09:36:04.369 INFO:tasks.workunit.client.0.smithi079.stdout:7/392: dread d4/f5 [0,4194304] 0 2024-09-10T09:36:04.369 INFO:tasks.workunit.client.0.smithi079.stdout:7/393: fdatasync d4/df/d3d/f64 0 2024-09-10T09:36:04.371 INFO:tasks.workunit.client.0.smithi079.stdout:5/388: link d2/d3/f16 d2/d3/d27/f87 0 2024-09-10T09:36:04.376 INFO:tasks.workunit.client.0.smithi079.stdout:4/397: symlink d1/da/d16/d21/l80 0 2024-09-10T09:36:04.377 INFO:tasks.workunit.client.0.smithi079.stdout:6/430: mknod d4/d8/c90 0 2024-09-10T09:36:04.377 INFO:tasks.workunit.client.0.smithi079.stdout:6/431: stat d4/d8/dd/d76/d39/d4b/l69 0 2024-09-10T09:36:04.377 INFO:tasks.workunit.client.0.smithi079.stdout:6/432: write d4/d8/f5d [121917,103203] 0 2024-09-10T09:36:04.377 INFO:tasks.workunit.client.0.smithi079.stdout:7/394: mknod d4/d6/c71 0 2024-09-10T09:36:04.378 INFO:tasks.workunit.client.0.smithi079.stdout:5/389: mkdir d2/d3/d27/d70/d88 0 2024-09-10T09:36:04.379 INFO:tasks.workunit.client.0.smithi079.stdout:8/437: rmdir d11/d2b/d4b/d7e 39 2024-09-10T09:36:04.380 INFO:tasks.workunit.client.0.smithi079.stdout:1/442: dwrite d5/d40/f42 [0,4194304] 0 2024-09-10T09:36:04.383 INFO:tasks.workunit.client.0.smithi079.stdout:6/433: write d4/d8/dc/d1c/f38 [384391,53910] 0 2024-09-10T09:36:04.383 INFO:tasks.workunit.client.0.smithi079.stdout:6/434: chown d4/d8/f83 49106 1 2024-09-10T09:36:04.384 INFO:tasks.workunit.client.0.smithi079.stdout:7/395: mknod d4/df/d6b/c72 0 2024-09-10T09:36:04.384 INFO:tasks.workunit.client.0.smithi079.stdout:7/396: creat d4/dc/f73 x:0 0 0 2024-09-10T09:36:04.384 INFO:tasks.workunit.client.0.smithi079.stdout:7/397: write d4/d6/f16 [566606,114398] 0 2024-09-10T09:36:04.384 INFO:tasks.workunit.client.0.smithi079.stdout:7/398: creat d4/dc/f74 x:0 0 0 2024-09-10T09:36:04.384 INFO:tasks.workunit.client.0.smithi079.stdout:5/390: link d2/d3/d27/f43 d2/d3/d5e/d85/f89 0 2024-09-10T09:36:04.387 INFO:tasks.workunit.client.0.smithi079.stdout:1/443: mkdir d5/df/d41/d6a/d88 0 2024-09-10T09:36:04.388 INFO:tasks.workunit.client.0.smithi079.stdout:4/398: getdents d1/da/d3b 0 2024-09-10T09:36:04.388 INFO:tasks.workunit.client.0.smithi079.stdout:4/399: dread - d1/da/f7b zero size 2024-09-10T09:36:04.390 INFO:tasks.workunit.client.0.smithi079.stdout:5/391: dread d2/f31 [0,4194304] 0 2024-09-10T09:36:04.405 INFO:tasks.workunit.client.0.smithi079.stdout:6/435: dwrite d4/d8/dd/d76/d39/d4b/f4d [0,4194304] 0 2024-09-10T09:36:04.407 INFO:tasks.workunit.client.0.smithi079.stdout:4/400: dwrite d1/da/fb [4194304,4194304] 0 2024-09-10T09:36:04.408 INFO:tasks.workunit.client.0.smithi079.stdout:4/401: write d1/da/f2b [1324925,1537] 0 2024-09-10T09:36:04.408 INFO:tasks.workunit.client.0.smithi079.stdout:4/402: fsync d1/da/d16/d21/d32/f64 0 2024-09-10T09:36:04.408 INFO:tasks.workunit.client.0.smithi079.stdout:4/403: creat d1/d38/f81 x:0 0 0 2024-09-10T09:36:04.409 INFO:tasks.workunit.client.0.smithi079.stdout:4/404: dread d1/f3a [0,4194304] 0 2024-09-10T09:36:04.409 INFO:tasks.workunit.client.0.smithi079.stdout:4/405: chown d1/da/d28/d47/c42 425357912 1 2024-09-10T09:36:04.431 INFO:tasks.workunit.client.0.smithi079.stdout:6/436: dwrite d4/d8/dd/d76/d39/f49 [0,4194304] 0 2024-09-10T09:36:04.431 INFO:tasks.workunit.client.0.smithi079.stdout:6/437: truncate d4/d8/dd/d76/f8f 867966 0 2024-09-10T09:36:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.430+0000 7f3d88dbf700 1 -- 172.21.15.79:0/3239556755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 msgr2=0x7f3d84102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.430+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/3239556755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84102e10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009910 tx=0x7f3d74009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.430+0000 7f3d88dbf700 1 -- 172.21.15.79:0/3239556755 shutdown_connections 2024-09-10T09:36:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.430+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/3239556755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d84103350 0x7f3d84105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.430+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/3239556755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84102e10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.430+0000 7f3d88dbf700 1 -- 172.21.15.79:0/3239556755 >> 172.21.15.79:0/3239556755 conn(0x7f3d840fa780 msgr2=0x7f3d840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 -- 172.21.15.79:0/3239556755 shutdown_connections 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 -- 172.21.15.79:0/3239556755 wait complete. 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 Processor -- start 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 -- start start 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d84103350 0x7f3d84195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d841965e0 con 0x7f3d84069230 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.431+0000 7f3d88dbf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d84196720 con 0x7f3d84103350 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d8259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d8259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49196/0 (socket says 172.21.15.79:49196) 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d8259c700 1 -- 172.21.15.79:0/2308154288 learned_addr learned my addr 172.21.15.79:0/2308154288 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:04.435 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d81d9b700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d84103350 0x7f3d84195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d8259c700 1 -- 172.21.15.79:0/2308154288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d84103350 msgr2=0x7f3d84195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d8259c700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d84103350 0x7f3d84195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d8259c700 1 -- 172.21.15.79:0/2308154288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d740095f0 con 0x7f3d84069230 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d81d9b700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d84103350 0x7f3d84195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d8259c700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84195a80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400bd70 tx=0x7f3d7400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d737fe700 1 -- 172.21.15.79:0/2308154288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d7401d070 con 0x7f3d84069230 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d737fe700 1 -- 172.21.15.79:0/2308154288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3d7400f460 con 0x7f3d84069230 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8419b170 con 0x7f3d84069230 2024-09-10T09:36:04.436 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d737fe700 1 -- 172.21.15.79:0/2308154288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d74021640 con 0x7f3d84069230 2024-09-10T09:36:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.432+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8419b660 con 0x7f3d84069230 2024-09-10T09:36:04.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.433+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d84108cf0 con 0x7f3d84069230 2024-09-10T09:36:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.434+0000 7f3d737fe700 1 -- 172.21.15.79:0/2308154288 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f3d7400fa40 con 0x7f3d84069230 2024-09-10T09:36:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.434+0000 7f3d737fe700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f3d6c06c680 0x7f3d6c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.435+0000 7f3d81d9b700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f3d6c06c680 0x7f3d6c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.435+0000 7f3d737fe700 1 -- 172.21.15.79:0/2308154288 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3d7408cb30 con 0x7f3d84069230 2024-09-10T09:36:04.438 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.435+0000 7f3d81d9b700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f3d6c06c680 0x7f3d6c06eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005950 tx=0x7f3d780058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:04.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.439+0000 7f3d737fe700 1 -- 172.21.15.79:0/2308154288 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f3d7405acf0 con 0x7f3d84069230 2024-09-10T09:36:04.457 INFO:tasks.workunit.client.0.smithi079.stdout:4/406: dwrite d1/da/d3b/d5a/f7c [0,4194304] 0 2024-09-10T09:36:04.460 INFO:tasks.workunit.client.0.smithi079.stdout:7/399: mkdir d4/df/d3d/d75 0 2024-09-10T09:36:04.483 INFO:tasks.workunit.client.0.smithi079.stdout:6/438: creat d4/d8/dd/f91 x:0 0 0 2024-09-10T09:36:04.485 INFO:tasks.workunit.client.0.smithi079.stdout:6/439: dread d4/d8/dd/f85 [0,4194304] 0 2024-09-10T09:36:04.536 INFO:tasks.workunit.client.0.smithi079.stdout:4/407: mknod d1/da/d16/d57/c82 0 2024-09-10T09:36:04.536 INFO:tasks.workunit.client.0.smithi079.stdout:4/408: write d1/da/d3b/d59/f6b [104679,80203] 0 2024-09-10T09:36:04.538 INFO:tasks.workunit.client.0.smithi079.stdout:7/400: symlink d4/d6/d38/l76 0 2024-09-10T09:36:04.541 INFO:tasks.workunit.client.0.smithi079.stdout:6/440: creat d4/d8/dd/d76/d46/d88/f92 x:0 0 0 2024-09-10T09:36:04.546 INFO:tasks.workunit.client.0.smithi079.stdout:6/441: unlink d4/d8/dc/d1c/f38 0 2024-09-10T09:36:04.546 INFO:tasks.workunit.client.0.smithi079.stdout:6/442: truncate d4/d8/dd/f91 1024472 0 2024-09-10T09:36:04.550 INFO:tasks.workunit.client.0.smithi079.stdout:7/401: read d4/dc/f21 [3447598,74952] 0 2024-09-10T09:36:04.590 INFO:tasks.workunit.client.0.smithi079.stdout:5/392: mknod d2/c8a 0 2024-09-10T09:36:04.590 INFO:tasks.workunit.client.0.smithi079.stdout:5/393: chown d2/d3/d27/d32/d39/f7b 100988757 1 2024-09-10T09:36:04.590 INFO:tasks.workunit.client.0.smithi079.stdout:5/394: creat d2/d3/d5e/d73/f8b x:0 0 0 2024-09-10T09:36:04.590 INFO:tasks.workunit.client.0.smithi079.stdout:5/395: readlink d2/d3/d27/d32/d39/l4b 0 2024-09-10T09:36:04.597 INFO:tasks.workunit.client.0.smithi079.stdout:5/396: dread d2/d3/d27/f43 [0,4194304] 0 2024-09-10T09:36:04.597 INFO:tasks.workunit.client.0.smithi079.stdout:5/397: truncate d2/d3/f79 371150 0 2024-09-10T09:36:04.599 INFO:tasks.workunit.client.0.smithi079.stdout:5/398: truncate d2/f26 3144808 0 2024-09-10T09:36:04.601 INFO:tasks.workunit.client.0.smithi079.stdout:5/399: link d2/d3/c5b d2/d3/d27/d32/d44/c8c 0 2024-09-10T09:36:04.601 INFO:tasks.workunit.client.0.smithi079.stdout:5/400: fdatasync d2/f58 0 2024-09-10T09:36:04.603 INFO:tasks.workunit.client.0.smithi079.stdout:5/401: mknod d2/d3/d27/c8d 0 2024-09-10T09:36:04.617 INFO:tasks.workunit.client.0.smithi079.stdout:5/402: dwrite d2/d3/d5e/d73/f7a [0,4194304] 0 2024-09-10T09:36:04.620 INFO:tasks.workunit.client.0.smithi079.stdout:5/403: creat d2/d3/d5e/d85/f8e x:0 0 0 2024-09-10T09:36:04.630 INFO:tasks.workunit.client.0.smithi079.stdout:0/418: sync 2024-09-10T09:36:04.630 INFO:tasks.workunit.client.0.smithi079.stdout:1/444: sync 2024-09-10T09:36:04.630 INFO:tasks.workunit.client.0.smithi079.stdout:2/351: sync 2024-09-10T09:36:04.630 INFO:tasks.workunit.client.0.smithi079.stdout:9/345: sync 2024-09-10T09:36:04.630 INFO:tasks.workunit.client.0.smithi079.stdout:3/423: sync 2024-09-10T09:36:04.631 INFO:tasks.workunit.client.0.smithi079.stdout:8/438: sync 2024-09-10T09:36:04.631 INFO:tasks.workunit.client.0.smithi079.stdout:9/346: readlink d3/d7/dc/de/l1e 0 2024-09-10T09:36:04.631 INFO:tasks.workunit.client.0.smithi079.stdout:1/445: mknod d5/d24/d36/d3a/c89 0 2024-09-10T09:36:04.632 INFO:tasks.workunit.client.0.smithi079.stdout:0/419: mkdir d4/d12/d1a/d6d/d91 0 2024-09-10T09:36:04.632 INFO:tasks.workunit.client.0.smithi079.stdout:0/420: write d4/d12/d21/d3f/f66 [547747,54611] 0 2024-09-10T09:36:04.633 INFO:tasks.workunit.client.0.smithi079.stdout:2/352: link d4/dc/d29/f55 d4/dc/d1c/d59/f73 0 2024-09-10T09:36:04.633 INFO:tasks.workunit.client.0.smithi079.stdout:2/353: dread - d4/dc/d1c/d59/f73 zero size 2024-09-10T09:36:04.633 INFO:tasks.workunit.client.0.smithi079.stdout:8/439: write d11/d2b/f75 [4774933,116160] 0 2024-09-10T09:36:04.634 INFO:tasks.workunit.client.0.smithi079.stdout:9/347: symlink d3/d7/d26/d69/l6c 0 2024-09-10T09:36:04.635 INFO:tasks.workunit.client.0.smithi079.stdout:1/446: mkdir d5/d4f/d8a 0 2024-09-10T09:36:04.639 INFO:tasks.workunit.client.0.smithi079.stdout:8/440: unlink d11/d3b/f49 0 2024-09-10T09:36:04.639 INFO:tasks.workunit.client.0.smithi079.stdout:8/441: write d11/f1d [705535,27019] 0 2024-09-10T09:36:04.640 INFO:tasks.workunit.client.0.smithi079.stdout:8/442: fsync d11/f43 0 2024-09-10T09:36:04.640 INFO:tasks.workunit.client.0.smithi079.stdout:8/443: dread - d11/d2b/d4b/d74/f86 zero size 2024-09-10T09:36:04.643 INFO:tasks.workunit.client.0.smithi079.stdout:1/447: symlink d5/d40/l8b 0 2024-09-10T09:36:04.646 INFO:tasks.workunit.client.0.smithi079.stdout:0/421: dread d4/f11 [0,4194304] 0 2024-09-10T09:36:04.646 INFO:tasks.workunit.client.0.smithi079.stdout:0/422: dread - d4/d12/d16/d53/d79/f8e zero size 2024-09-10T09:36:04.649 INFO:tasks.workunit.client.0.smithi079.stdout:8/444: creat d11/d48/f8f x:0 0 0 2024-09-10T09:36:04.649 INFO:tasks.workunit.client.0.smithi079.stdout:8/445: write d11/f88 [4990636,17800] 0 2024-09-10T09:36:04.649 INFO:tasks.workunit.client.0.smithi079.stdout:2/354: dread d4/dc/d29/d1b/d38/d39/d31/d52/f5a [0,4194304] 0 2024-09-10T09:36:04.649 INFO:tasks.workunit.client.0.smithi079.stdout:9/348: rmdir d3/d7/dc/d62 39 2024-09-10T09:36:04.651 INFO:tasks.workunit.client.0.smithi079.stdout:3/424: write d4/da/d17/d2d/d43/d49/f68 [695488,57304] 0 2024-09-10T09:36:04.651 INFO:tasks.workunit.client.0.smithi079.stdout:1/448: truncate d5/df/d41/f65 47817 0 2024-09-10T09:36:04.653 INFO:tasks.workunit.client.0.smithi079.stdout:8/446: mknod d11/d2b/d4b/c90 0 2024-09-10T09:36:04.655 INFO:tasks.workunit.client.0.smithi079.stdout:9/349: mknod d3/d7/dc/c6d 0 2024-09-10T09:36:04.656 INFO:tasks.workunit.client.0.smithi079.stdout:6/443: rename d4/d8/dd/d76/d39 to d4/d8/dc/d93 0 2024-09-10T09:36:04.658 INFO:tasks.workunit.client.0.smithi079.stdout:3/425: mkdir d4/da/d17/d2d/d78 0 2024-09-10T09:36:04.658 INFO:tasks.workunit.client.0.smithi079.stdout:3/426: fsync d4/da/d17/f32 0 2024-09-10T09:36:04.660 INFO:tasks.workunit.client.0.smithi079.stdout:1/449: rmdir d5/df/d41/d6a 39 2024-09-10T09:36:04.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/404: rename d2/d3/d27/d32/c46 to d2/d3/c8f 0 2024-09-10T09:36:04.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/405: creat d2/d3/d27/d32/f90 x:0 0 0 2024-09-10T09:36:04.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/406: write d2/d3/d5e/d73/f7a [4890873,54537] 0 2024-09-10T09:36:04.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/407: stat d2/d3/l29 0 2024-09-10T09:36:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.667+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d8419bd00 con 0x7f3d6c06c680 2024-09-10T09:36:04.669 INFO:tasks.workunit.client.0.smithi079.stdout:8/447: mkdir d11/d91 0 2024-09-10T09:36:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.669+0000 7f3d737fe700 1 -- 172.21.15.79:0/2308154288 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f3d8419bd00 con 0x7f3d6c06c680 2024-09-10T09:36:04.670 INFO:tasks.workunit.client.0.smithi079.stdout:9/350: write d3/d7/d26/f51 [2040449,8613] 0 2024-09-10T09:36:04.670 INFO:tasks.workunit.client.0.smithi079.stdout:9/351: truncate d3/d7/dc/f37 9215681 0 2024-09-10T09:36:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f3d6c06c680 msgr2=0x7f3d6c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f3d6c06c680 0x7f3d6c06eb30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005950 tx=0x7f3d780058e0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 msgr2=0x7f3d84195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84195a80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400bd70 tx=0x7f3d7400be50 comp rx=0 tx=0).stop 2024-09-10T09:36:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 shutdown_connections 2024-09-10T09:36:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f3d6c06c680 0x7f3d6c06eb30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d84069230 0x7f3d84195a80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 --2- 172.21.15.79:0/2308154288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d84103350 0x7f3d84195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 >> 172.21.15.79:0/2308154288 conn(0x7f3d840fa780 msgr2=0x7f3d840fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 shutdown_connections 2024-09-10T09:36:04.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.671+0000 7f3d88dbf700 1 -- 172.21.15.79:0/2308154288 wait complete. 2024-09-10T09:36:04.674 INFO:tasks.workunit.client.0.smithi079.stdout:3/427: getdents d4/da/d18 0 2024-09-10T09:36:04.674 INFO:tasks.workunit.client.0.smithi079.stdout:3/428: read d4/da/d18/f47 [335224,120067] 0 2024-09-10T09:36:04.674 INFO:tasks.workunit.client.0.smithi079.stdout:3/429: write d4/da/f6c [925209,110433] 0 2024-09-10T09:36:04.674 INFO:tasks.workunit.client.0.smithi079.stdout:3/430: readlink d4/da/l6e 0 2024-09-10T09:36:04.677 INFO:tasks.workunit.client.0.smithi079.stdout:1/450: dread d5/d24/d36/d3a/f3d [0,4194304] 0 2024-09-10T09:36:04.677 INFO:tasks.workunit.client.0.smithi079.stdout:1/451: readlink d5/df/l44 0 2024-09-10T09:36:04.677 INFO:tasks.workunit.client.0.smithi079.stdout:1/452: write d5/df/f34 [1625611,117548] 0 2024-09-10T09:36:04.677 INFO:tasks.workunit.client.0.smithi079.stdout:5/408: creat d2/d3/d27/d70/d80/f91 x:0 0 0 2024-09-10T09:36:04.679 INFO:tasks.workunit.client.0.smithi079.stdout:5/409: write d2/d41/f45 [590696,42502] 0 2024-09-10T09:36:04.679 INFO:tasks.workunit.client.0.smithi079.stdout:5/410: chown d2/d3/c2f 235 1 2024-09-10T09:36:04.679 INFO:tasks.workunit.client.0.smithi079.stdout:8/448: mknod d11/d2b/d4b/d74/c92 0 2024-09-10T09:36:04.681 INFO:tasks.workunit.client.0.smithi079.stdout:9/352: mkdir d3/d7/dc/de/d17/d6e 0 2024-09-10T09:36:04.686 INFO:tasks.workunit.client.0.smithi079.stdout:3/431: mkdir d4/da/d17/d2d/d78/d79 0 2024-09-10T09:36:04.686 INFO:tasks.workunit.client.0.smithi079.stdout:3/432: chown d4/da/d17/d72 1366 1 2024-09-10T09:36:04.686 INFO:tasks.workunit.client.0.smithi079.stdout:1/453: dread d5/f19 [0,4194304] 0 2024-09-10T09:36:04.687 INFO:tasks.workunit.client.0.smithi079.stdout:1/454: fdatasync d5/d24/d36/d3a/f3d 0 2024-09-10T09:36:04.687 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:36:04.687 INFO:tasks.workunit.client.0.smithi079.stdout:5/411: creat d2/d41/d4d/f92 x:0 0 0 2024-09-10T09:36:04.689 INFO:tasks.workunit.client.0.smithi079.stdout:9/353: creat d3/f6f x:0 0 0 2024-09-10T09:36:04.689 INFO:tasks.workunit.client.0.smithi079.stdout:9/354: write d3/d40/f47 [592148,10218] 0 2024-09-10T09:36:04.689 INFO:tasks.workunit.client.0.smithi079.stdout:9/355: chown d3/f2b 11875225 1 2024-09-10T09:36:04.690 INFO:tasks.workunit.client.0.smithi079.stdout:0/423: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:36:04.691 INFO:tasks.workunit.client.0.smithi079.stdout:3/433: mkdir d4/d7a 0 2024-09-10T09:36:04.694 INFO:tasks.workunit.client.0.smithi079.stdout:3/434: mkdir d4/da/d56/d7b 0 2024-09-10T09:36:04.696 INFO:tasks.workunit.client.0.smithi079.stdout:2/355: dwrite d4/dc/f14 [0,4194304] 0 2024-09-10T09:36:04.696 INFO:tasks.workunit.client.0.smithi079.stdout:6/444: dwrite d4/d8/dd/d76/f71 [0,4194304] 0 2024-09-10T09:36:04.701 INFO:tasks.workunit.client.0.smithi079.stdout:4/409: sync 2024-09-10T09:36:04.704 INFO:tasks.workunit.client.0.smithi079.stdout:3/435: write d4/da/d17/f21 [4503868,82841] 0 2024-09-10T09:36:04.706 INFO:tasks.workunit.client.0.smithi079.stdout:1/455: dread d5/df/f34 [0,4194304] 0 2024-09-10T09:36:04.710 INFO:tasks.workunit.client.0.smithi079.stdout:9/356: getdents d3/d7/dc/de/d17 0 2024-09-10T09:36:04.710 INFO:tasks.workunit.client.0.smithi079.stdout:9/357: truncate d3/d7/d26/f4d 284692 0 2024-09-10T09:36:04.710 INFO:tasks.workunit.client.0.smithi079.stdout:9/358: stat d3/d7/dc/de/f2c 0 2024-09-10T09:36:04.710 INFO:tasks.workunit.client.0.smithi079.stdout:9/359: write d3/d7/f2a [228353,117912] 0 2024-09-10T09:36:04.713 INFO:tasks.workunit.client.0.smithi079.stdout:4/410: mkdir d1/da/d28/d47/d52/d83 0 2024-09-10T09:36:04.713 INFO:tasks.workunit.client.0.smithi079.stdout:4/411: fdatasync d1/da/d16/f1f 0 2024-09-10T09:36:04.713 INFO:tasks.workunit.client.0.smithi079.stdout:4/412: readlink d1/da/d16/d57/l5b 0 2024-09-10T09:36:04.715 INFO:tasks.workunit.client.0.smithi079.stdout:3/436: mkdir d4/da/d7c 0 2024-09-10T09:36:04.715 INFO:tasks.workunit.client.0.smithi079.stdout:5/412: fsync d2/d41/d4d/f92 0 2024-09-10T09:36:04.716 INFO:tasks.workunit.client.0.smithi079.stdout:3/437: creat d4/da/d17/d2d/d43/f7d x:0 0 0 2024-09-10T09:36:04.716 INFO:tasks.workunit.client.0.smithi079.stdout:5/413: stat d2/c36 0 2024-09-10T09:36:04.716 INFO:tasks.workunit.client.0.smithi079.stdout:1/456: mkdir d5/d24/d36/d3a/d3c/d57/d8c 0 2024-09-10T09:36:04.716 INFO:tasks.workunit.client.0.smithi079.stdout:1/457: fsync d5/df/d2e/f83 0 2024-09-10T09:36:04.717 INFO:tasks.workunit.client.0.smithi079.stdout:5/414: symlink d2/d3/d27/d70/d80/l93 0 2024-09-10T09:36:04.718 INFO:tasks.workunit.client.0.smithi079.stdout:2/356: dread d4/dc/d29/d1b/d38/d39/f45 [0,4194304] 0 2024-09-10T09:36:04.719 INFO:tasks.workunit.client.0.smithi079.stdout:5/415: mkdir d2/d3/d27/d70/d80/d94 0 2024-09-10T09:36:04.720 INFO:tasks.workunit.client.0.smithi079.stdout:2/357: unlink d4/dc/d1c/c5b 0 2024-09-10T09:36:04.721 INFO:tasks.workunit.client.0.smithi079.stdout:2/358: fdatasync d4/f66 0 2024-09-10T09:36:04.721 INFO:tasks.workunit.client.0.smithi079.stdout:2/359: write d4/dc/f6d [497188,82573] 0 2024-09-10T09:36:04.724 INFO:tasks.workunit.client.0.smithi079.stdout:5/416: link d2/d3/lc d2/d3/d27/l95 0 2024-09-10T09:36:04.724 INFO:tasks.workunit.client.0.smithi079.stdout:5/417: fsync d2/d3/d27/f43 0 2024-09-10T09:36:04.728 INFO:tasks.workunit.client.0.smithi079.stdout:5/418: rmdir d2/d41 39 2024-09-10T09:36:04.728 INFO:tasks.workunit.client.0.smithi079.stdout:5/419: readlink d2/d3/d27/d32/d39/l4e 0 2024-09-10T09:36:04.729 INFO:tasks.workunit.client.0.smithi079.stdout:3/438: write d4/f29 [3198247,27589] 0 2024-09-10T09:36:04.735 INFO:tasks.workunit.client.0.smithi079.stdout:5/420: symlink d2/d3/d27/d32/d44/l96 0 2024-09-10T09:36:04.735 INFO:tasks.workunit.client.0.smithi079.stdout:6/445: dwrite d4/d8/dd/d41/d51/f5b [0,4194304] 0 2024-09-10T09:36:04.735 INFO:tasks.workunit.client.0.smithi079.stdout:6/446: chown d4/d8/dd/d41/d51/c8d 0 1 2024-09-10T09:36:04.735 INFO:tasks.workunit.client.0.smithi079.stdout:0/424: dwrite d4/d12/d16/d53/f64 [0,4194304] 0 2024-09-10T09:36:04.737 INFO:tasks.workunit.client.0.smithi079.stdout:3/439: creat d4/da/d17/d38/d42/f7e x:0 0 0 2024-09-10T09:36:04.737 INFO:tasks.workunit.client.0.smithi079.stdout:0/425: write d4/d12/d21/f2c [309280,85191] 0 2024-09-10T09:36:04.739 INFO:tasks.workunit.client.0.smithi079.stdout:7/402: sync 2024-09-10T09:36:04.739 INFO:tasks.workunit.client.0.smithi079.stdout:7/403: fdatasync d4/d6/d38/f63 0 2024-09-10T09:36:04.742 INFO:tasks.workunit.client.0.smithi079.stdout:9/360: dwrite d3/d7/d5a/f68 [0,4194304] 0 2024-09-10T09:36:04.742 INFO:tasks.workunit.client.0.smithi079.stdout:9/361: fsync d3/d7/dc/de/d17/d2f/d30/f3a 0 2024-09-10T09:36:04.743 INFO:tasks.workunit.client.0.smithi079.stdout:6/447: mknod d4/d8/dd/d76/d46/d88/c94 0 2024-09-10T09:36:04.746 INFO:tasks.workunit.client.0.smithi079.stdout:4/413: dwrite d1/da/d3b/d5a/f7c [0,4194304] 0 2024-09-10T09:36:04.746 INFO:tasks.workunit.client.0.smithi079.stdout:2/360: dwrite d4/dc/d13/f1f [0,4194304] 0 2024-09-10T09:36:04.747 INFO:tasks.workunit.client.0.smithi079.stdout:4/414: write d1/da/d16/f26 [8566725,99454] 0 2024-09-10T09:36:04.748 INFO:tasks.workunit.client.0.smithi079.stdout:4/415: read d1/da/d3b/d59/f6b [86249,9938] 0 2024-09-10T09:36:04.748 INFO:tasks.workunit.client.0.smithi079.stdout:4/416: truncate d1/f3a 683062 0 2024-09-10T09:36:04.749 INFO:tasks.workunit.client.0.smithi079.stdout:3/440: mknod d4/da/d17/d2d/c7f 0 2024-09-10T09:36:04.750 INFO:tasks.workunit.client.0.smithi079.stdout:7/404: truncate d4/dc/f4a 472482 0 2024-09-10T09:36:04.751 INFO:tasks.workunit.client.0.smithi079.stdout:7/405: creat d4/df/f77 x:0 0 0 2024-09-10T09:36:04.754 INFO:tasks.workunit.client.0.smithi079.stdout:9/362: mkdir d3/d7/d70 0 2024-09-10T09:36:04.755 INFO:tasks.workunit.client.0.smithi079.stdout:6/448: truncate d4/d8/dc/d93/d4b/f4c 788614 0 2024-09-10T09:36:04.756 INFO:tasks.workunit.client.0.smithi079.stdout:1/458: dwrite d5/df/d11/f2b [0,4194304] 0 2024-09-10T09:36:04.757 INFO:tasks.workunit.client.0.smithi079.stdout:6/449: dread d4/d8/dc/d12/f73 [0,4194304] 0 2024-09-10T09:36:04.757 INFO:tasks.workunit.client.0.smithi079.stdout:6/450: creat d4/d8/dd/d41/f95 x:0 0 0 2024-09-10T09:36:04.757 INFO:tasks.workunit.client.0.smithi079.stdout:6/451: truncate d4/d8/dd/d76/d46/f33 2063493 0 2024-09-10T09:36:04.757 INFO:tasks.workunit.client.0.smithi079.stdout:6/452: truncate d4/d8/dd/d41/f95 147363 0 2024-09-10T09:36:04.758 INFO:tasks.workunit.client.0.smithi079.stdout:2/361: mkdir d4/dc/d13/d61/d62/d74 0 2024-09-10T09:36:04.758 INFO:tasks.workunit.client.0.smithi079.stdout:3/441: mkdir d4/da/d17/d62/d80 0 2024-09-10T09:36:04.760 INFO:tasks.workunit.client.0.smithi079.stdout:9/363: truncate d3/d7/d26/f51 62452 0 2024-09-10T09:36:04.761 INFO:tasks.workunit.client.0.smithi079.stdout:9/364: fdatasync d3/d7/f3b 0 2024-09-10T09:36:04.762 INFO:tasks.workunit.client.0.smithi079.stdout:0/426: dwrite d4/d12/d1a/fb [4194304,4194304] 0 2024-09-10T09:36:04.762 INFO:tasks.workunit.client.0.smithi079.stdout:5/421: dwrite d2/f3b [0,4194304] 0 2024-09-10T09:36:04.764 INFO:tasks.workunit.client.0.smithi079.stdout:3/442: rename d4/da/d17/d2d/c64 to d4/c81 0 2024-09-10T09:36:04.764 INFO:tasks.workunit.client.0.smithi079.stdout:3/443: fdatasync d4/f40 0 2024-09-10T09:36:04.765 INFO:tasks.workunit.client.0.smithi079.stdout:7/406: mknod d4/df/d19/c78 0 2024-09-10T09:36:04.767 INFO:tasks.workunit.client.0.smithi079.stdout:9/365: link d3/d7/f63 d3/d7/d70/f71 0 2024-09-10T09:36:04.767 INFO:tasks.workunit.client.0.smithi079.stdout:9/366: write d3/f16 [301407,70923] 0 2024-09-10T09:36:04.775 INFO:tasks.workunit.client.0.smithi079.stdout:2/362: rmdir d4/dc/d29 39 2024-09-10T09:36:04.776 INFO:tasks.workunit.client.0.smithi079.stdout:7/407: dread d4/d6/f2d [0,4194304] 0 2024-09-10T09:36:04.783 INFO:tasks.workunit.client.0.smithi079.stdout:5/422: symlink d2/l97 0 2024-09-10T09:36:04.783 INFO:tasks.workunit.client.0.smithi079.stdout:5/423: readlink d2/l1e 0 2024-09-10T09:36:04.783 INFO:tasks.workunit.client.0.smithi079.stdout:3/444: symlink d4/da/d17/d2d/l82 0 2024-09-10T09:36:04.787 INFO:tasks.workunit.client.0.smithi079.stdout:1/459: dwrite d5/df/d11/f2d [0,4194304] 0 2024-09-10T09:36:04.787 INFO:tasks.workunit.client.0.smithi079.stdout:1/460: write d5/d24/d36/d3a/d3c/f5e [6765233,81127] 0 2024-09-10T09:36:04.792 INFO:tasks.workunit.client.0.smithi079.stdout:5/424: dread d2/f31 [0,4194304] 0 2024-09-10T09:36:04.793 INFO:tasks.workunit.client.0.smithi079.stdout:2/363: rename d4/dc/d1c/d59/f73 to d4/dc/d13/f75 0 2024-09-10T09:36:04.793 INFO:tasks.workunit.client.0.smithi079.stdout:2/364: chown d4 46345336 1 2024-09-10T09:36:04.794 INFO:tasks.workunit.client.0.smithi079.stdout:3/445: rmdir d4/da/d17 39 2024-09-10T09:36:04.794 INFO:tasks.workunit.client.0.smithi079.stdout:3/446: chown d4/da/c15 2230192 1 2024-09-10T09:36:04.795 INFO:tasks.workunit.client.0.smithi079.stdout:5/425: rmdir d2/d41/d7e 0 2024-09-10T09:36:04.795 INFO:tasks.workunit.client.0.smithi079.stdout:5/426: chown d2/d3/d27/d32/l48 5783386 1 2024-09-10T09:36:04.801 INFO:tasks.workunit.client.0.smithi079.stdout:7/408: rename d4/dc/f6c to d4/df/d3d/f79 0 2024-09-10T09:36:04.801 INFO:tasks.workunit.client.0.smithi079.stdout:7/409: write d4/f42 [109794,744] 0 2024-09-10T09:36:04.801 INFO:tasks.workunit.client.0.smithi079.stdout:3/447: mknod d4/c83 0 2024-09-10T09:36:04.801 INFO:tasks.workunit.client.0.smithi079.stdout:3/448: creat d4/da/d17/d38/d42/f84 x:0 0 0 2024-09-10T09:36:04.801 INFO:tasks.workunit.client.0.smithi079.stdout:3/449: write d4/da/d17/d72/f75 [742521,33021] 0 2024-09-10T09:36:04.801 INFO:tasks.workunit.client.0.smithi079.stdout:5/427: creat d2/d3/d59/f98 x:0 0 0 2024-09-10T09:36:04.801 INFO:tasks.workunit.client.0.smithi079.stdout:5/428: creat d2/d3/f99 x:0 0 0 2024-09-10T09:36:04.802 INFO:tasks.workunit.client.0.smithi079.stdout:1/461: rename d5/df/d11/c62 to d5/d24/d36/d3a/c8d 0 2024-09-10T09:36:04.802 INFO:tasks.workunit.client.0.smithi079.stdout:1/462: truncate d5/df/d2e/f49 1107612 0 2024-09-10T09:36:04.802 INFO:tasks.workunit.client.0.smithi079.stdout:1/463: chown d5/d40/l63 0 1 2024-09-10T09:36:04.802 INFO:tasks.workunit.client.0.smithi079.stdout:1/464: stat d5/d4f/f77 0 2024-09-10T09:36:04.804 INFO:tasks.workunit.client.0.smithi079.stdout:3/450: unlink d4/da/d18/f1c 0 2024-09-10T09:36:04.804 INFO:tasks.workunit.client.0.smithi079.stdout:3/451: write d4/da/d17/d54/f41 [353652,79065] 0 2024-09-10T09:36:04.805 INFO:tasks.workunit.client.0.smithi079.stdout:3/452: chown d4/da/d56/d7b 2444 1 2024-09-10T09:36:04.805 INFO:tasks.workunit.client.0.smithi079.stdout:3/453: readlink d4/da/d17/d38/l5c 0 2024-09-10T09:36:04.805 INFO:tasks.workunit.client.0.smithi079.stdout:0/427: dwrite d4/d12/d16/d53/f6c [0,4194304] 0 2024-09-10T09:36:04.805 INFO:tasks.workunit.client.0.smithi079.stdout:0/428: chown d4/fd 782948 1 2024-09-10T09:36:04.806 INFO:tasks.workunit.client.0.smithi079.stdout:3/454: rmdir d4/da/d17 39 2024-09-10T09:36:04.808 INFO:tasks.workunit.client.0.smithi079.stdout:6/453: dwrite d4/d8/dd/d41/d51/f5c [0,4194304] 0 2024-09-10T09:36:04.808 INFO:tasks.workunit.client.0.smithi079.stdout:6/454: creat d4/d8/d74/f96 x:0 0 0 2024-09-10T09:36:04.811 INFO:tasks.workunit.client.0.smithi079.stdout:9/367: dwrite d3/f2b [0,4194304] 0 2024-09-10T09:36:04.811 INFO:tasks.workunit.client.0.smithi079.stdout:9/368: fdatasync d3/d7/dc/de/f6a 0 2024-09-10T09:36:04.812 INFO:tasks.workunit.client.0.smithi079.stdout:0/429: unlink d4/d12/d21/c55 0 2024-09-10T09:36:04.818 INFO:tasks.workunit.client.0.smithi079.stdout:6/455: mknod d4/c97 0 2024-09-10T09:36:04.822 INFO:tasks.workunit.client.0.smithi079.stdout:9/369: rmdir d3/d7/d26/d69 39 2024-09-10T09:36:04.823 INFO:tasks.workunit.client.0.smithi079.stdout:0/430: creat d4/d12/d8b/f92 x:0 0 0 2024-09-10T09:36:04.824 INFO:tasks.workunit.client.0.smithi079.stdout:6/456: mkdir d4/d8/dc/d98 0 2024-09-10T09:36:04.827 INFO:tasks.workunit.client.0.smithi079.stdout:1/465: dwrite d5/f15 [0,4194304] 0 2024-09-10T09:36:04.827 INFO:tasks.workunit.client.0.smithi079.stdout:6/457: rename d4/d8/dc/d3c/f6a to d4/d8/dc/d3c/f99 0 2024-09-10T09:36:04.828 INFO:tasks.workunit.client.0.smithi079.stdout:6/458: read d4/d8/dc/d12/d29/f2f [908923,66594] 0 2024-09-10T09:36:04.828 INFO:tasks.workunit.client.0.smithi079.stdout:6/459: dread - d4/d8/dc/f6f zero size 2024-09-10T09:36:04.831 INFO:tasks.workunit.client.0.smithi079.stdout:9/370: getdents d3/d7/dc/de 0 2024-09-10T09:36:04.831 INFO:tasks.workunit.client.0.smithi079.stdout:3/455: dwrite d4/f13 [0,4194304] 0 2024-09-10T09:36:04.832 INFO:tasks.workunit.client.0.smithi079.stdout:6/460: dread d4/d8/dd/f2e [0,4194304] 0 2024-09-10T09:36:04.832 INFO:tasks.workunit.client.0.smithi079.stdout:6/461: write d4/d8/dd/d76/d46/f3a [509092,119990] 0 2024-09-10T09:36:04.833 INFO:tasks.workunit.client.0.smithi079.stdout:9/371: rmdir d3/d7/dc/de/d17/d4c 39 2024-09-10T09:36:04.833 INFO:tasks.workunit.client.0.smithi079.stdout:0/431: dread d4/f10 [0,4194304] 0 2024-09-10T09:36:04.833 INFO:tasks.workunit.client.0.smithi079.stdout:0/432: write d4/d12/d21/f2c [466767,17984] 0 2024-09-10T09:36:04.833 INFO:tasks.workunit.client.0.smithi079.stdout:0/433: write d4/d12/d21/d3f/f66 [568915,88444] 0 2024-09-10T09:36:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 -- 172.21.15.79:0/1128515491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0ff660 msgr2=0x7f872c0ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 --2- 172.21.15.79:0/1128515491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0ff660 0x7f872c0ffa70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8728009910 tx=0x7f8728009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 -- 172.21.15.79:0/1128515491 shutdown_connections 2024-09-10T09:36:04.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 --2- 172.21.15.79:0/1128515491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f872c0fffb0 0x7f872c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 --2- 172.21.15.79:0/1128515491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0ff660 0x7f872c0ffa70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 -- 172.21.15.79:0/1128515491 >> 172.21.15.79:0/1128515491 conn(0x7f872c0f9f10 msgr2=0x7f872c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 -- 172.21.15.79:0/1128515491 shutdown_connections 2024-09-10T09:36:04.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.836+0000 7f8733900700 1 -- 172.21.15.79:0/1128515491 wait complete. 2024-09-10T09:36:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.837+0000 7f8733900700 1 Processor -- start 2024-09-10T09:36:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.837+0000 7f8733900700 1 -- start start 2024-09-10T09:36:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.837+0000 7f8733900700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f872c0ff660 0x7f872c1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.837+0000 7f8733900700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0fffb0 0x7f872c101800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.837+0000 7f8733900700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c101d40 con 0x7f872c0fffb0 2024-09-10T09:36:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.837+0000 7f8733900700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c101e80 con 0x7f872c0ff660 2024-09-10T09:36:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f8730e9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0fffb0 0x7f872c101800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f8730e9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0fffb0 0x7f872c101800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49220/0 (socket says 172.21.15.79:49220) 2024-09-10T09:36:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f8730e9b700 1 -- 172.21.15.79:0/3437405372 learned_addr learned my addr 172.21.15.79:0/3437405372 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f873169c700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f872c0ff660 0x7f872c1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f8730e9b700 1 -- 172.21.15.79:0/3437405372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f872c0ff660 msgr2=0x7f872c1031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f8730e9b700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f872c0ff660 0x7f872c1031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f8730e9b700 1 -- 172.21.15.79:0/3437405372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280095f0 con 0x7f872c0fffb0 2024-09-10T09:36:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f873169c700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f872c0ff660 0x7f872c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:36:04.843 INFO:tasks.workunit.client.0.smithi079.stdout:1/466: write d5/df/d11/f2d [1915553,59194] 0 2024-09-10T09:36:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.838+0000 7f8730e9b700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0fffb0 0x7f872c101800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e8f0 tx=0x7f871c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.839+0000 7f87227fc700 1 -- 172.21.15.79:0/3437405372 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f871c009790 con 0x7f872c0fffb0 2024-09-10T09:36:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.839+0000 7f87227fc700 1 -- 172.21.15.79:0/3437405372 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f871c004ce0 con 0x7f872c0fffb0 2024-09-10T09:36:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.839+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c102160 con 0x7f872c0fffb0 2024-09-10T09:36:04.845 INFO:tasks.workunit.client.0.smithi079.stdout:3/456: rename d4/c16 to d4/da/d17/d38/c85 0 2024-09-10T09:36:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.839+0000 7f87227fc700 1 -- 172.21.15.79:0/3437405372 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f871c005690 con 0x7f872c0fffb0 2024-09-10T09:36:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.839+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c102650 con 0x7f872c0fffb0 2024-09-10T09:36:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.840+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c107c20 con 0x7f872c0fffb0 2024-09-10T09:36:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.841+0000 7f87227fc700 1 -- 172.21.15.79:0/3437405372 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f871c0104c0 con 0x7f872c0fffb0 2024-09-10T09:36:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.842+0000 7f87227fc700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f871806c680 0x7f871806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:04.846 INFO:tasks.workunit.client.0.smithi079.stdout:6/462: truncate d4/d8/dc/d12/f30 1418758 0 2024-09-10T09:36:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.842+0000 7f87227fc700 1 -- 172.21.15.79:0/3437405372 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f871c014070 con 0x7f872c0fffb0 2024-09-10T09:36:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.842+0000 7f873169c700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f871806c680 0x7f871806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.842+0000 7f873169c700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f871806c680 0x7f871806eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8728000c00 tx=0x7f8728009f70 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:04.847 INFO:tasks.workunit.client.0.smithi079.stdout:3/457: dread d4/da/d17/d54/f41 [0,4194304] 0 2024-09-10T09:36:04.847 INFO:tasks.workunit.client.0.smithi079.stdout:5/429: rmdir d2/d3/d59 39 2024-09-10T09:36:04.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:04.846+0000 7f87227fc700 1 -- 172.21.15.79:0/3437405372 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f871c059ef0 con 0x7f872c0fffb0 2024-09-10T09:36:04.850 INFO:tasks.workunit.client.0.smithi079.stdout:1/467: symlink d5/df/d41/l8e 0 2024-09-10T09:36:04.851 INFO:tasks.workunit.client.0.smithi079.stdout:6/463: unlink d4/d8/dc/f4e 0 2024-09-10T09:36:04.852 INFO:tasks.workunit.client.0.smithi079.stdout:3/458: mknod d4/da/d17/d72/c86 0 2024-09-10T09:36:04.853 INFO:tasks.workunit.client.0.smithi079.stdout:1/468: symlink d5/d24/d36/d3a/d85/l8f 0 2024-09-10T09:36:04.853 INFO:tasks.workunit.client.0.smithi079.stdout:3/459: read d4/da/f57 [119333,65803] 0 2024-09-10T09:36:04.854 INFO:tasks.workunit.client.0.smithi079.stdout:6/464: mknod d4/d8/dc/d98/c9a 0 2024-09-10T09:36:04.854 INFO:tasks.workunit.client.0.smithi079.stdout:6/465: stat d4/d8/dc/d12/d29/c3d 0 2024-09-10T09:36:04.854 INFO:tasks.workunit.client.0.smithi079.stdout:0/434: dread d4/d12/d1a/f19 [0,4194304] 0 2024-09-10T09:36:04.855 INFO:tasks.workunit.client.0.smithi079.stdout:5/430: dread d2/f22 [0,4194304] 0 2024-09-10T09:36:04.855 INFO:tasks.workunit.client.0.smithi079.stdout:5/431: getdents d2/d3/d27/d70/d88 0 2024-09-10T09:36:04.855 INFO:tasks.workunit.client.0.smithi079.stdout:5/432: truncate d2/f24 1083026 0 2024-09-10T09:36:04.855 INFO:tasks.workunit.client.0.smithi079.stdout:9/372: dwrite d3/d7/f63 [0,4194304] 0 2024-09-10T09:36:04.856 INFO:tasks.workunit.client.0.smithi079.stdout:9/373: write d3/d7/dc/de/d17/d2f/d30/f3a [45237,89042] 0 2024-09-10T09:36:04.856 INFO:tasks.workunit.client.0.smithi079.stdout:1/469: symlink d5/d24/d36/d3a/d3c/l90 0 2024-09-10T09:36:04.856 INFO:tasks.workunit.client.0.smithi079.stdout:1/470: write d5/df/d41/f65 [62691,106209] 0 2024-09-10T09:36:04.856 INFO:tasks.workunit.client.0.smithi079.stdout:1/471: chown d5/f22 5 1 2024-09-10T09:36:04.857 INFO:tasks.workunit.client.0.smithi079.stdout:3/460: mknod d4/da/d17/d2d/d43/d49/c87 0 2024-09-10T09:36:04.857 INFO:tasks.workunit.client.0.smithi079.stdout:3/461: fsync d4/da/d56/f5e 0 2024-09-10T09:36:04.857 INFO:tasks.workunit.client.0.smithi079.stdout:3/462: fdatasync d4/da/d17/d38/d42/f53 0 2024-09-10T09:36:04.858 INFO:tasks.workunit.client.0.smithi079.stdout:5/433: getdents d2/d3/d59 0 2024-09-10T09:36:04.864 INFO:tasks.workunit.client.0.smithi079.stdout:3/463: dread d4/f12 [0,4194304] 0 2024-09-10T09:36:04.865 INFO:tasks.workunit.client.0.smithi079.stdout:1/472: symlink d5/d4f/d8a/l91 0 2024-09-10T09:36:04.865 INFO:tasks.workunit.client.0.smithi079.stdout:1/473: truncate d5/d24/d36/d3a/d3c/f7d 92520 0 2024-09-10T09:36:04.865 INFO:tasks.workunit.client.0.smithi079.stdout:1/474: chown d5/d40/l63 31 1 2024-09-10T09:36:04.869 INFO:tasks.workunit.client.0.smithi079.stdout:3/464: mknod d4/da/d17/d72/c88 0 2024-09-10T09:36:04.870 INFO:tasks.workunit.client.0.smithi079.stdout:6/466: dwrite d4/d8/d74/f96 [0,4194304] 0 2024-09-10T09:36:04.871 INFO:tasks.workunit.client.0.smithi079.stdout:1/475: rename d5/d24/d36/d3a/f50 to d5/df/d41/d6a/d88/f92 0 2024-09-10T09:36:04.871 INFO:tasks.workunit.client.0.smithi079.stdout:1/476: chown d5/d4f/f73 682 1 2024-09-10T09:36:04.874 INFO:tasks.workunit.client.0.smithi079.stdout:8/449: sync 2024-09-10T09:36:04.874 INFO:tasks.workunit.client.0.smithi079.stdout:8/450: creat d11/d2b/d4b/f93 x:0 0 0 2024-09-10T09:36:04.877 INFO:tasks.workunit.client.0.smithi079.stdout:1/477: truncate d5/d24/d36/d3a/d3c/f5e 2207387 0 2024-09-10T09:36:04.877 INFO:tasks.workunit.client.0.smithi079.stdout:1/478: stat d5/f22 0 2024-09-10T09:36:04.879 INFO:tasks.workunit.client.0.smithi079.stdout:6/467: dread d4/d8/f20 [0,4194304] 0 2024-09-10T09:36:04.881 INFO:tasks.workunit.client.0.smithi079.stdout:8/451: getdents d11/d48 0 2024-09-10T09:36:04.886 INFO:tasks.workunit.client.0.smithi079.stdout:9/374: write d3/d7/d70/f71 [4749506,123779] 0 2024-09-10T09:36:04.887 INFO:tasks.workunit.client.0.smithi079.stdout:9/375: truncate d3/d7/f5b 634110 0 2024-09-10T09:36:04.887 INFO:tasks.workunit.client.0.smithi079.stdout:9/376: write d3/d40/f5d [1033860,13453] 0 2024-09-10T09:36:04.894 INFO:tasks.workunit.client.0.smithi079.stdout:9/377: unlink d3/d7/d26/f51 0 2024-09-10T09:36:04.894 INFO:tasks.workunit.client.0.smithi079.stdout:9/378: readlink d3/l9 0 2024-09-10T09:36:04.896 INFO:tasks.workunit.client.0.smithi079.stdout:8/452: dread d11/d48/f60 [0,4194304] 0 2024-09-10T09:36:04.896 INFO:tasks.workunit.client.0.smithi079.stdout:8/453: chown d11/d2b/d4b/d50/d5c/l70 0 1 2024-09-10T09:36:04.897 INFO:tasks.workunit.client.0.smithi079.stdout:9/379: mknod d3/d7/dc/de/d17/d2f/c72 0 2024-09-10T09:36:04.897 INFO:tasks.workunit.client.0.smithi079.stdout:4/417: sync 2024-09-10T09:36:04.897 INFO:tasks.workunit.client.0.smithi079.stdout:4/418: stat d1/d38/f81 0 2024-09-10T09:36:04.898 INFO:tasks.workunit.client.0.smithi079.stdout:9/380: mkdir d3/d7/d26/d73 0 2024-09-10T09:36:04.903 INFO:tasks.workunit.client.0.smithi079.stdout:4/419: link d1/da/d3b/l4f d1/da/d16/l84 0 2024-09-10T09:36:04.905 INFO:tasks.workunit.client.0.smithi079.stdout:8/454: read d11/d2b/d4b/d50/f89 [3773024,89145] 0 2024-09-10T09:36:04.905 INFO:tasks.workunit.client.0.smithi079.stdout:8/455: getdents d11/d2b/d4b/d50/d55/d87 0 2024-09-10T09:36:04.908 INFO:tasks.workunit.client.0.smithi079.stdout:1/479: dwrite d5/df/d11/f75 [4194304,4194304] 0 2024-09-10T09:36:04.908 INFO:tasks.workunit.client.0.smithi079.stdout:1/480: readlink d5/df/d11/l1f 0 2024-09-10T09:36:04.909 INFO:tasks.workunit.client.0.smithi079.stdout:4/420: rename d1/da/d16/d4d/l5c to d1/da/l85 0 2024-09-10T09:36:04.909 INFO:tasks.workunit.client.0.smithi079.stdout:6/468: dwrite d4/d8/f20 [0,4194304] 0 2024-09-10T09:36:04.911 INFO:tasks.workunit.client.0.smithi079.stdout:1/481: mknod d5/d24/d36/d3a/d48/c93 0 2024-09-10T09:36:04.911 INFO:tasks.workunit.client.0.smithi079.stdout:1/482: fdatasync d5/d24/d36/d3a/d3c/f5e 0 2024-09-10T09:36:04.926 INFO:tasks.workunit.client.0.smithi079.stdout:8/456: write f8 [3994709,48204] 0 2024-09-10T09:36:04.928 INFO:tasks.workunit.client.0.smithi079.stdout:9/381: dwrite d3/d7/dc/de/d17/f52 [0,4194304] 0 2024-09-10T09:36:04.929 INFO:tasks.workunit.client.0.smithi079.stdout:1/483: dread d5/d24/d36/d3a/d3c/f54 [0,4194304] 0 2024-09-10T09:36:04.931 INFO:tasks.workunit.client.0.smithi079.stdout:1/484: creat d5/df/d41/d6a/d88/f94 x:0 0 0 2024-09-10T09:36:04.933 INFO:tasks.workunit.client.0.smithi079.stdout:1/485: mkdir d5/d4f/d95 0 2024-09-10T09:36:04.933 INFO:tasks.workunit.client.0.smithi079.stdout:1/486: creat d5/d4f/f96 x:0 0 0 2024-09-10T09:36:04.933 INFO:tasks.workunit.client.0.smithi079.stdout:1/487: chown d5/df/d2e/l7b 14 1 2024-09-10T09:36:04.936 INFO:tasks.workunit.client.0.smithi079.stdout:1/488: link d5/d24/d36/d3a/d3c/l80 d5/d40/l97 0 2024-09-10T09:36:04.941 INFO:tasks.workunit.client.0.smithi079.stdout:9/382: write d3/d7/dc/de/f2c [2050375,101202] 0 2024-09-10T09:36:04.945 INFO:tasks.workunit.client.0.smithi079.stdout:9/383: unlink d3/d7/dc/de/f2c 0 2024-09-10T09:36:04.945 INFO:tasks.workunit.client.0.smithi079.stdout:9/384: chown d3/d7/d26/l29 48257 1 2024-09-10T09:36:04.945 INFO:tasks.workunit.client.0.smithi079.stdout:9/385: getdents d3/d7/d26/d66 0 2024-09-10T09:36:04.945 INFO:tasks.workunit.client.0.smithi079.stdout:9/386: stat d3/d7/f63 0 2024-09-10T09:36:04.945 INFO:tasks.workunit.client.0.smithi079.stdout:6/469: dwrite d4/d8/d74/f82 [0,4194304] 0 2024-09-10T09:36:04.946 INFO:tasks.workunit.client.0.smithi079.stdout:9/387: mkdir d3/d7/dc/de/d17/d2f/d74 0 2024-09-10T09:36:04.946 INFO:tasks.workunit.client.0.smithi079.stdout:9/388: chown d3/d7/dc/de/d17/d2f/d30/f56 5091061 1 2024-09-10T09:36:04.949 INFO:tasks.workunit.client.0.smithi079.stdout:4/421: dwrite d1/f2e [4194304,4194304] 0 2024-09-10T09:36:04.949 INFO:tasks.workunit.client.0.smithi079.stdout:9/389: creat d3/d7/dc/d62/f75 x:0 0 0 2024-09-10T09:36:04.950 INFO:tasks.workunit.client.0.smithi079.stdout:1/489: write d5/d40/f42 [2187657,19976] 0 2024-09-10T09:36:04.950 INFO:tasks.workunit.client.0.smithi079.stdout:8/457: dwrite d11/d2b/f40 [0,4194304] 0 2024-09-10T09:36:04.951 INFO:tasks.workunit.client.0.smithi079.stdout:8/458: creat d11/d3b/f94 x:0 0 0 2024-09-10T09:36:04.958 INFO:tasks.workunit.client.0.smithi079.stdout:1/490: mknod d5/d4f/d95/c98 0 2024-09-10T09:36:04.960 INFO:tasks.workunit.client.0.smithi079.stdout:8/459: link d11/f1e d11/d2b/d4b/d50/d5c/f95 0 2024-09-10T09:36:04.960 INFO:tasks.workunit.client.0.smithi079.stdout:8/460: fsync d11/d2b/d4b/d50/d55/f65 0 2024-09-10T09:36:04.961 INFO:tasks.workunit.client.0.smithi079.stdout:4/422: dread d1/da/d28/d47/f6f [0,4194304] 0 2024-09-10T09:36:04.964 INFO:tasks.workunit.client.0.smithi079.stdout:9/390: rmdir d3/d7/d26/d66 0 2024-09-10T09:36:04.966 INFO:tasks.workunit.client.0.smithi079.stdout:4/423: unlink d1/da/d3b/d59/f6b 0 2024-09-10T09:36:04.967 INFO:tasks.workunit.client.0.smithi079.stdout:6/470: dwrite d4/d8/dc/d12/d29/f2c [0,4194304] 0 2024-09-10T09:36:04.967 INFO:tasks.workunit.client.0.smithi079.stdout:6/471: write d4/d8/dc/d12/d29/f8b [751077,3521] 0 2024-09-10T09:36:04.968 INFO:tasks.workunit.client.0.smithi079.stdout:6/472: fsync d4/d8/f7d 0 2024-09-10T09:36:04.969 INFO:tasks.workunit.client.0.smithi079.stdout:9/391: link d3/d7/d26/d3d/f42 d3/d7/f76 0 2024-09-10T09:36:04.969 INFO:tasks.workunit.client.0.smithi079.stdout:9/392: chown d3/d7/dc/de/d17/d2f/c57 12 1 2024-09-10T09:36:04.974 INFO:tasks.workunit.client.0.smithi079.stdout:1/491: read d5/d24/f66 [1306301,15975] 0 2024-09-10T09:36:04.974 INFO:tasks.workunit.client.0.smithi079.stdout:9/393: mknod d3/d7/d26/c77 0 2024-09-10T09:36:04.978 INFO:tasks.workunit.client.0.smithi079.stdout:9/394: creat d3/d7/dc/de/d17/f78 x:0 0 0 2024-09-10T09:36:04.979 INFO:tasks.workunit.client.0.smithi079.stdout:6/473: dread d4/d8/dd/d76/f71 [0,4194304] 0 2024-09-10T09:36:04.979 INFO:tasks.workunit.client.0.smithi079.stdout:1/492: truncate d5/d40/f42 3683824 0 2024-09-10T09:36:04.981 INFO:tasks.workunit.client.0.smithi079.stdout:9/395: unlink d3/d7/dc/de/f6a 0 2024-09-10T09:36:04.981 INFO:tasks.workunit.client.0.smithi079.stdout:9/396: creat d3/d7/dc/de/d17/d2f/f79 x:0 0 0 2024-09-10T09:36:04.982 INFO:tasks.workunit.client.0.smithi079.stdout:6/474: mknod d4/d8/d74/c9b 0 2024-09-10T09:36:04.982 INFO:tasks.workunit.client.0.smithi079.stdout:6/475: chown d4/d8/dc/d3c/f99 538 1 2024-09-10T09:36:04.983 INFO:tasks.workunit.client.0.smithi079.stdout:1/493: creat d5/d24/d36/d3a/d48/f99 x:0 0 0 2024-09-10T09:36:04.985 INFO:tasks.workunit.client.0.smithi079.stdout:6/476: link d4/d8/dd/d41/d51/c8d d4/d8/dc/d12/c9c 0 2024-09-10T09:36:04.987 INFO:tasks.workunit.client.0.smithi079.stdout:6/477: mkdir d4/d8/dc/d12/d9d 0 2024-09-10T09:36:04.988 INFO:tasks.workunit.client.0.smithi079.stdout:4/424: dwrite d1/da/d28/d47/f6f [0,4194304] 0 2024-09-10T09:36:04.993 INFO:tasks.workunit.client.0.smithi079.stdout:4/425: symlink d1/da/d28/d47/d52/l86 0 2024-09-10T09:36:04.998 INFO:tasks.workunit.client.0.smithi079.stdout:4/426: mknod d1/da/d16/c87 0 2024-09-10T09:36:05.001 INFO:tasks.workunit.client.0.smithi079.stdout:4/427: mkdir d1/da/d16/d88 0 2024-09-10T09:36:05.001 INFO:tasks.workunit.client.0.smithi079.stdout:4/428: creat d1/da/d3b/d59/f89 x:0 0 0 2024-09-10T09:36:05.001 INFO:tasks.workunit.client.0.smithi079.stdout:4/429: chown d1/da/d28/l39 15 1 2024-09-10T09:36:05.004 INFO:tasks.workunit.client.0.smithi079.stdout:4/430: stat d1/da/d28/d47/d52/l58 0 2024-09-10T09:36:05.005 INFO:tasks.workunit.client.0.smithi079.stdout:4/431: mknod d1/da/d3b/d59/c8a 0 2024-09-10T09:36:05.013 INFO:tasks.workunit.client.0.smithi079.stdout:1/494: dwrite d5/df/d2e/f39 [4194304,4194304] 0 2024-09-10T09:36:05.013 INFO:tasks.workunit.client.0.smithi079.stdout:6/478: dwrite d4/d8/dc/f66 [0,4194304] 0 2024-09-10T09:36:05.016 INFO:tasks.workunit.client.0.smithi079.stdout:1/495: creat d5/d24/d36/f9a x:0 0 0 2024-09-10T09:36:05.019 INFO:tasks.workunit.client.0.smithi079.stdout:1/496: link d5/d24/d36/d3a/d3c/f7a d5/df/d41/f9b 0 2024-09-10T09:36:05.019 INFO:tasks.workunit.client.0.smithi079.stdout:1/497: write d5/d24/d36/d3a/d3c/f7d [533274,86605] 0 2024-09-10T09:36:05.019 INFO:tasks.workunit.client.0.smithi079.stdout:1/498: write d5/d24/d36/d3a/f3d [2966674,7980] 0 2024-09-10T09:36:05.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/499: readlink d5/d24/d36/d79/l84 0 2024-09-10T09:36:05.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/500: dread - d5/d24/d36/f9a zero size 2024-09-10T09:36:05.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/501: creat d5/d24/d36/d3a/d3c/f9c x:0 0 0 2024-09-10T09:36:05.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/502: write d5/d40/f42 [3172062,2942] 0 2024-09-10T09:36:05.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/503: dread - d5/d40/d46/f7c zero size 2024-09-10T09:36:05.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/504: chown d5/c28 243261682 1 2024-09-10T09:36:05.021 INFO:tasks.workunit.client.0.smithi079.stdout:6/479: rename d4/d8/dd/d76/d46/d88/c94 to d4/d8/dc/d1c/c9e 0 2024-09-10T09:36:05.021 INFO:tasks.workunit.client.0.smithi079.stdout:7/410: sync 2024-09-10T09:36:05.021 INFO:tasks.workunit.client.0.smithi079.stdout:2/365: sync 2024-09-10T09:36:05.021 INFO:tasks.workunit.client.0.smithi079.stdout:2/366: stat d4/dc/d29/c2c 0 2024-09-10T09:36:05.021 INFO:tasks.workunit.client.0.smithi079.stdout:7/411: creat d4/d6/d3e/f7a x:0 0 0 2024-09-10T09:36:05.021 INFO:tasks.workunit.client.0.smithi079.stdout:2/367: fsync d4/dc/d1c/f28 0 2024-09-10T09:36:05.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/505: link d5/d24/d36/d3a/d3c/f72 d5/f9d 0 2024-09-10T09:36:05.023 INFO:tasks.workunit.client.0.smithi079.stdout:4/432: dwrite d1/da/d16/f26 [0,4194304] 0 2024-09-10T09:36:05.023 INFO:tasks.workunit.client.0.smithi079.stdout:4/433: truncate d1/da/f7b 353600 0 2024-09-10T09:36:05.026 INFO:tasks.workunit.client.0.smithi079.stdout:2/368: creat d4/dc/d13/d61/d62/f76 x:0 0 0 2024-09-10T09:36:05.027 INFO:tasks.workunit.client.0.smithi079.stdout:1/506: mkdir d5/d9e 0 2024-09-10T09:36:05.030 INFO:tasks.workunit.client.0.smithi079.stdout:4/434: unlink d1/da/d3b/d59/f89 0 2024-09-10T09:36:05.030 INFO:tasks.workunit.client.0.smithi079.stdout:4/435: write d1/d38/f81 [489541,22764] 0 2024-09-10T09:36:05.033 INFO:tasks.workunit.client.0.smithi079.stdout:2/369: dread d4/dc/d29/d1b/d38/d39/d31/d52/f5a [0,4194304] 0 2024-09-10T09:36:05.033 INFO:tasks.workunit.client.0.smithi079.stdout:2/370: write d4/dc/d1c/f28 [2572128,7186] 0 2024-09-10T09:36:05.033 INFO:tasks.workunit.client.0.smithi079.stdout:2/371: write d4/d5d/f68 [544146,111684] 0 2024-09-10T09:36:05.035 INFO:tasks.workunit.client.0.smithi079.stdout:6/480: dread d4/d8/d74/f82 [0,4194304] 0 2024-09-10T09:36:05.036 INFO:tasks.workunit.client.0.smithi079.stdout:2/372: mkdir d4/dc/d13/d61/d65/d77 0 2024-09-10T09:36:05.036 INFO:tasks.workunit.client.0.smithi079.stdout:2/373: write d4/dc/d1c/d59/f51 [841290,17686] 0 2024-09-10T09:36:05.036 INFO:tasks.workunit.client.0.smithi079.stdout:2/374: stat d4/dc/d13/f27 0 2024-09-10T09:36:05.051 INFO:tasks.workunit.client.0.smithi079.stdout:1/507: dwrite d5/d4f/f96 [0,4194304] 0 2024-09-10T09:36:05.051 INFO:tasks.workunit.client.0.smithi079.stdout:1/508: fdatasync d5/df/d41/d6a/d88/f94 0 2024-09-10T09:36:05.054 INFO:tasks.workunit.client.0.smithi079.stdout:6/481: dwrite d4/d8/f3b [0,4194304] 0 2024-09-10T09:36:05.054 INFO:tasks.workunit.client.0.smithi079.stdout:7/412: dwrite d4/df/d3d/f56 [0,4194304] 0 2024-09-10T09:36:05.054 INFO:tasks.workunit.client.0.smithi079.stdout:7/413: chown d4/dc/c35 236282 1 2024-09-10T09:36:05.054 INFO:tasks.workunit.client.0.smithi079.stdout:7/414: fdatasync d4/df/d3d/f56 0 2024-09-10T09:36:05.054 INFO:tasks.workunit.client.0.smithi079.stdout:7/415: fdatasync d4/dc/f3a 0 2024-09-10T09:36:05.054 INFO:tasks.workunit.client.0.smithi079.stdout:1/509: creat d5/d24/d36/d79/f9f x:0 0 0 2024-09-10T09:36:05.057 INFO:tasks.workunit.client.0.smithi079.stdout:6/482: creat d4/f9f x:0 0 0 2024-09-10T09:36:05.061 INFO:tasks.workunit.client.0.smithi079.stdout:1/510: write d5/d4f/f96 [2408452,46548] 0 2024-09-10T09:36:05.061 INFO:tasks.workunit.client.0.smithi079.stdout:1/511: truncate d5/d24/d36/d3a/d3c/f5e 2754217 0 2024-09-10T09:36:05.061 INFO:tasks.workunit.client.0.smithi079.stdout:1/512: write d5/d24/d36/d3a/d48/f99 [843694,108120] 0 2024-09-10T09:36:05.061 INFO:tasks.workunit.client.0.smithi079.stdout:1/513: write d5/d40/d46/f7c [103405,16227] 0 2024-09-10T09:36:05.061 INFO:tasks.workunit.client.0.smithi079.stdout:1/514: stat d5/d4f/d8a 0 2024-09-10T09:36:05.064 INFO:tasks.workunit.client.0.smithi079.stdout:6/483: mkdir d4/d8/dc/d93/da0 0 2024-09-10T09:36:05.069 INFO:tasks.workunit.client.0.smithi079.stdout:6/484: symlink d4/d8/dc/d3c/la1 0 2024-09-10T09:36:05.074 INFO:tasks.workunit.client.0.smithi079.stdout:6/485: creat d4/d8/dc/d98/fa2 x:0 0 0 2024-09-10T09:36:05.082 INFO:tasks.workunit.client.0.smithi079.stdout:6/486: dread d4/d8/f20 [0,4194304] 0 2024-09-10T09:36:05.095 INFO:tasks.workunit.client.0.smithi079.stdout:6/487: dwrite d4/d8/dd/d41/f54 [0,4194304] 0 2024-09-10T09:36:05.095 INFO:tasks.workunit.client.0.smithi079.stdout:6/488: fsync d4/d8/dd/d41/f56 0 2024-09-10T09:36:05.107 INFO:tasks.workunit.client.0.smithi079.stdout:6/489: write d4/d8/dc/d12/d29/f31 [505553,95010] 0 2024-09-10T09:36:05.120 INFO:tasks.workunit.client.0.smithi079.stdout:6/490: dwrite d4/d8/dc/d12/d29/f44 [0,4194304] 0 2024-09-10T09:36:05.121 INFO:tasks.workunit.client.0.smithi079.stdout:6/491: mknod d4/d8/d74/ca3 0 2024-09-10T09:36:05.122 INFO:tasks.workunit.client.0.smithi079.stdout:6/492: mknod d4/d8/dc/d93/d4b/ca4 0 2024-09-10T09:36:05.122 INFO:tasks.workunit.client.0.smithi079.stdout:6/493: chown d4/d8/f3b 63 1 2024-09-10T09:36:05.123 INFO:tasks.workunit.client.0.smithi079.stdout:6/494: dread d4/d8/dd/d41/f95 [0,4194304] 0 2024-09-10T09:36:05.124 INFO:tasks.workunit.client.0.smithi079.stdout:6/495: mkdir d4/d8/da5 0 2024-09-10T09:36:05.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.124+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f872c0fe970 con 0x7f871806c680 2024-09-10T09:36:05.125 INFO:tasks.workunit.client.0.smithi079.stdout:3/465: sync 2024-09-10T09:36:05.125 INFO:tasks.workunit.client.0.smithi079.stdout:0/435: sync 2024-09-10T09:36:05.125 INFO:tasks.workunit.client.0.smithi079.stdout:5/434: sync 2024-09-10T09:36:05.125 INFO:tasks.workunit.client.0.smithi079.stdout:5/435: getdents d2/d3/d27/d70/d88 0 2024-09-10T09:36:05.125 INFO:tasks.workunit.client.0.smithi079.stdout:5/436: dread - d2/d3/d27/d32/d44/f66 zero size 2024-09-10T09:36:05.125 INFO:tasks.workunit.client.0.smithi079.stdout:5/437: write d2/d3/f99 [920525,32646] 0 2024-09-10T09:36:05.126 INFO:tasks.workunit.client.0.smithi079.stdout:0/436: mknod d4/d12/d15/d6b/c93 0 2024-09-10T09:36:05.126 INFO:tasks.workunit.client.0.smithi079.stdout:0/437: read - d4/d12/f86 zero size 2024-09-10T09:36:05.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.125+0000 7f87227fc700 1 -- 172.21.15.79:0/3437405372 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f872c0fe970 con 0x7f871806c680 2024-09-10T09:36:05.127 INFO:tasks.workunit.client.0.smithi079.stdout:0/438: unlink d4/d12/d39/f73 0 2024-09-10T09:36:05.128 INFO:tasks.workunit.client.0.smithi079.stdout:0/439: symlink d4/d12/d39/l94 0 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f871806c680 msgr2=0x7f871806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f871806c680 0x7f871806eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8728000c00 tx=0x7f8728009f70 comp rx=0 tx=0).stop 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0fffb0 msgr2=0x7f872c101800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0fffb0 0x7f872c101800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e8f0 tx=0x7f871c00ecb0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 shutdown_connections 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f871806c680 0x7f871806eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f872c0ff660 0x7f872c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 --2- 172.21.15.79:0/3437405372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f872c0fffb0 0x7f872c101800 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.128+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 >> 172.21.15.79:0/3437405372 conn(0x7f872c0f9f10 msgr2=0x7f872c0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:05.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.129+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 shutdown_connections 2024-09-10T09:36:05.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.129+0000 7f8733900700 1 -- 172.21.15.79:0/3437405372 wait complete. 2024-09-10T09:36:05.131 INFO:tasks.workunit.client.0.smithi079.stdout:0/440: rename d4/d12/d21/f3d to d4/d12/d21/d3f/d88/f95 0 2024-09-10T09:36:05.133 INFO:tasks.workunit.client.0.smithi079.stdout:5/438: dread d2/d3/fe [0,4194304] 0 2024-09-10T09:36:05.135 INFO:tasks.workunit.client.0.smithi079.stdout:5/439: mknod d2/d3/d27/d32/c9a 0 2024-09-10T09:36:05.135 INFO:tasks.workunit.client.0.smithi079.stdout:5/440: truncate d2/f24 1332879 0 2024-09-10T09:36:05.140 INFO:tasks.workunit.client.0.smithi079.stdout:0/441: dread d4/d12/d16/d53/f6c [0,4194304] 0 2024-09-10T09:36:05.142 INFO:tasks.workunit.client.0.smithi079.stdout:5/441: write d2/d3/d27/d32/f4f [1979416,16347] 0 2024-09-10T09:36:05.145 INFO:tasks.workunit.client.0.smithi079.stdout:6/496: dread d4/d8/dc/f66 [0,4194304] 0 2024-09-10T09:36:05.146 INFO:tasks.workunit.client.0.smithi079.stdout:6/497: symlink d4/d8/dc/d3c/la6 0 2024-09-10T09:36:05.148 INFO:tasks.workunit.client.0.smithi079.stdout:6/498: getdents d4/d8/dd/d41/d51 0 2024-09-10T09:36:05.148 INFO:tasks.workunit.client.0.smithi079.stdout:3/466: dread d4/da/d18/f48 [0,4194304] 0 2024-09-10T09:36:05.150 INFO:tasks.workunit.client.0.smithi079.stdout:6/499: rename d4/d8/dd/l28 to d4/la7 0 2024-09-10T09:36:05.150 INFO:tasks.workunit.client.0.smithi079.stdout:6/500: creat d4/d8/dc/d12/d29/fa8 x:0 0 0 2024-09-10T09:36:05.150 INFO:tasks.workunit.client.0.smithi079.stdout:6/501: truncate d4/d8/dd/f2e 1671238 0 2024-09-10T09:36:05.151 INFO:tasks.workunit.client.0.smithi079.stdout:3/467: getdents d4 0 2024-09-10T09:36:05.152 INFO:tasks.workunit.client.0.smithi079.stdout:0/442: dread d4/d12/d1a/f19 [0,4194304] 0 2024-09-10T09:36:05.153 INFO:tasks.workunit.client.0.smithi079.stdout:3/468: mknod d4/da/d17/d38/d42/c89 0 2024-09-10T09:36:05.153 INFO:tasks.workunit.client.0.smithi079.stdout:3/469: chown d4/da/d17/d2d/d43/d49/c5f 0 1 2024-09-10T09:36:05.154 INFO:tasks.workunit.client.0.smithi079.stdout:0/443: truncate d4/d1d/f3a 188088 0 2024-09-10T09:36:05.156 INFO:tasks.workunit.client.0.smithi079.stdout:5/442: write d2/f37 [2001951,56540] 0 2024-09-10T09:36:05.159 INFO:tasks.workunit.client.0.smithi079.stdout:5/443: symlink d2/d3/l9b 0 2024-09-10T09:36:05.160 INFO:tasks.workunit.client.0.smithi079.stdout:5/444: rmdir d2/d41 39 2024-09-10T09:36:05.160 INFO:tasks.workunit.client.0.smithi079.stdout:6/502: write d4/d8/dc/d12/d29/f44 [454193,87042] 0 2024-09-10T09:36:05.162 INFO:tasks.workunit.client.0.smithi079.stdout:5/445: symlink d2/d41/l9c 0 2024-09-10T09:36:05.163 INFO:tasks.workunit.client.0.smithi079.stdout:5/446: write d2/d3/d5e/d85/f8e [780647,116389] 0 2024-09-10T09:36:05.163 INFO:tasks.workunit.client.0.smithi079.stdout:5/447: creat d2/d3/d27/d32/f9d x:0 0 0 2024-09-10T09:36:05.163 INFO:tasks.workunit.client.0.smithi079.stdout:5/448: write d2/f24 [1814050,69585] 0 2024-09-10T09:36:05.166 INFO:tasks.workunit.client.0.smithi079.stdout:6/503: symlink d4/la9 0 2024-09-10T09:36:05.166 INFO:tasks.workunit.client.0.smithi079.stdout:6/504: write d4/d8/dc/d12/d29/f8b [1037894,34140] 0 2024-09-10T09:36:05.166 INFO:tasks.workunit.client.0.smithi079.stdout:6/505: readlink d4/d8/dd/d41/d51/l65 0 2024-09-10T09:36:05.166 INFO:tasks.workunit.client.0.smithi079.stdout:6/506: readlink d4/d8/dc/d3c/l7f 0 2024-09-10T09:36:05.166 INFO:tasks.workunit.client.0.smithi079.stdout:3/470: read d4/da/d17/d2d/f76 [919201,6087] 0 2024-09-10T09:36:05.167 INFO:tasks.workunit.client.0.smithi079.stdout:3/471: write d4/da/d56/f5e [669634,39090] 0 2024-09-10T09:36:05.167 INFO:tasks.workunit.client.0.smithi079.stdout:5/449: truncate d2/d3/fe 3287375 0 2024-09-10T09:36:05.169 INFO:tasks.workunit.client.0.smithi079.stdout:3/472: mkdir d4/da/d8a 0 2024-09-10T09:36:05.169 INFO:tasks.workunit.client.0.smithi079.stdout:0/444: dwrite d4/d12/d21/f2c [0,4194304] 0 2024-09-10T09:36:05.170 INFO:tasks.workunit.client.0.smithi079.stdout:5/450: creat d2/d3/d27/d70/d88/f9e x:0 0 0 2024-09-10T09:36:05.170 INFO:tasks.workunit.client.0.smithi079.stdout:0/445: dread d4/d12/f40 [0,4194304] 0 2024-09-10T09:36:05.171 INFO:tasks.workunit.client.0.smithi079.stdout:6/507: getdents d4/d8/d74 0 2024-09-10T09:36:05.183 INFO:tasks.workunit.client.0.smithi079.stdout:0/446: unlink d4/d12/d15/c25 0 2024-09-10T09:36:05.183 INFO:tasks.workunit.client.0.smithi079.stdout:0/447: dread - d4/d12/d16/d53/d79/f8e zero size 2024-09-10T09:36:05.183 INFO:tasks.workunit.client.0.smithi079.stdout:0/448: stat d4/d1d/d24/d72 0 2024-09-10T09:36:05.185 INFO:tasks.workunit.client.0.smithi079.stdout:6/508: rmdir d4/d8/dc/d98 39 2024-09-10T09:36:05.185 INFO:tasks.workunit.client.0.smithi079.stdout:6/509: truncate d4/d8/dd/d76/d46/d88/f92 476741 0 2024-09-10T09:36:05.185 INFO:tasks.workunit.client.0.smithi079.stdout:6/510: creat d4/d8/dc/d12/d70/faa x:0 0 0 2024-09-10T09:36:05.186 INFO:tasks.workunit.client.0.smithi079.stdout:0/449: getdents d4/d12/d1a/d29 0 2024-09-10T09:36:05.186 INFO:tasks.workunit.client.0.smithi079.stdout:5/451: write d2/d41/f51 [3935633,108446] 0 2024-09-10T09:36:05.187 INFO:tasks.workunit.client.0.smithi079.stdout:6/511: mkdir d4/d8/dc/d93/d8a/dab 0 2024-09-10T09:36:05.188 INFO:tasks.workunit.client.0.smithi079.stdout:6/512: read d4/d8/dc/d12/d70/f84 [66327,50850] 0 2024-09-10T09:36:05.189 INFO:tasks.workunit.client.0.smithi079.stdout:0/450: creat d4/d12/f96 x:0 0 0 2024-09-10T09:36:05.190 INFO:tasks.workunit.client.0.smithi079.stdout:5/452: mknod d2/d3/d27/d70/d80/c9f 0 2024-09-10T09:36:05.190 INFO:tasks.workunit.client.0.smithi079.stdout:5/453: write d2/d41/d4d/f5a [366899,104963] 0 2024-09-10T09:36:05.191 INFO:tasks.workunit.client.0.smithi079.stdout:6/513: symlink d4/d8/dd/lac 0 2024-09-10T09:36:05.192 INFO:tasks.workunit.client.0.smithi079.stdout:0/451: mknod d4/d12/d21/d3f/d80/c97 0 2024-09-10T09:36:05.192 INFO:tasks.workunit.client.0.smithi079.stdout:6/514: read d4/d8/dc/d3c/f99 [183012,79052] 0 2024-09-10T09:36:05.193 INFO:tasks.workunit.client.0.smithi079.stdout:3/473: dwrite d4/da/d17/d2d/d43/d49/f6f [0,4194304] 0 2024-09-10T09:36:05.193 INFO:tasks.workunit.client.0.smithi079.stdout:3/474: write d4/da/d56/f6b [157586,104458] 0 2024-09-10T09:36:05.194 INFO:tasks.workunit.client.0.smithi079.stdout:3/475: readlink d4/da/d18/l5b 0 2024-09-10T09:36:05.195 INFO:tasks.workunit.client.0.smithi079.stdout:5/454: unlink d2/d41/f5d 0 2024-09-10T09:36:05.196 INFO:tasks.workunit.client.0.smithi079.stdout:6/515: rename d4/d8/d74/f82 to d4/d8/dc/d93/fad 0 2024-09-10T09:36:05.197 INFO:tasks.workunit.client.0.smithi079.stdout:0/452: creat d4/d47/f98 x:0 0 0 2024-09-10T09:36:05.197 INFO:tasks.workunit.client.0.smithi079.stdout:0/453: write d4/d12/d15/d2b/f63 [5124651,72439] 0 2024-09-10T09:36:05.197 INFO:tasks.workunit.client.0.smithi079.stdout:9/397: sync 2024-09-10T09:36:05.197 INFO:tasks.workunit.client.0.smithi079.stdout:8/461: sync 2024-09-10T09:36:05.197 INFO:tasks.workunit.client.0.smithi079.stdout:8/462: readlink d11/d48/l8e 0 2024-09-10T09:36:05.200 INFO:tasks.workunit.client.0.smithi079.stdout:0/454: dread d4/d12/f40 [0,4194304] 0 2024-09-10T09:36:05.200 INFO:tasks.workunit.client.0.smithi079.stdout:0/455: fdatasync d4/d12/d21/f54 0 2024-09-10T09:36:05.200 INFO:tasks.workunit.client.0.smithi079.stdout:0/456: write d4/d12/d21/d3f/d88/f95 [2090516,22905] 0 2024-09-10T09:36:05.203 INFO:tasks.workunit.client.0.smithi079.stdout:5/455: dread d2/d3/d27/d32/f6d [0,4194304] 0 2024-09-10T09:36:05.209 INFO:tasks.workunit.client.0.smithi079.stdout:6/516: rename d4/d8/dd/d41/f95 to d4/d8/fae 0 2024-09-10T09:36:05.210 INFO:tasks.workunit.client.0.smithi079.stdout:8/463: dread d11/d2b/d4b/d50/d5c/f95 [0,4194304] 0 2024-09-10T09:36:05.210 INFO:tasks.workunit.client.0.smithi079.stdout:9/398: mkdir d3/d7/dc/d7a 0 2024-09-10T09:36:05.211 INFO:tasks.workunit.client.0.smithi079.stdout:0/457: creat d4/d12/d21/f99 x:0 0 0 2024-09-10T09:36:05.215 INFO:tasks.workunit.client.0.smithi079.stdout:7/416: sync 2024-09-10T09:36:05.215 INFO:tasks.workunit.client.0.smithi079.stdout:2/375: sync 2024-09-10T09:36:05.215 INFO:tasks.workunit.client.0.smithi079.stdout:7/417: write d4/dc/d43/f57 [931429,69344] 0 2024-09-10T09:36:05.215 INFO:tasks.workunit.client.0.smithi079.stdout:4/436: sync 2024-09-10T09:36:05.216 INFO:tasks.workunit.client.0.smithi079.stdout:1/515: sync 2024-09-10T09:36:05.216 INFO:tasks.workunit.client.0.smithi079.stdout:1/516: readlink d5/d24/l81 0 2024-09-10T09:36:05.216 INFO:tasks.workunit.client.0.smithi079.stdout:1/517: fsync d5/df/d11/f16 0 2024-09-10T09:36:05.216 INFO:tasks.workunit.client.0.smithi079.stdout:2/376: creat d4/dc/d13/d61/d65/d77/f78 x:0 0 0 2024-09-10T09:36:05.216 INFO:tasks.workunit.client.0.smithi079.stdout:2/377: dread - d4/dc/d29/d1b/d38/f53 zero size 2024-09-10T09:36:05.217 INFO:tasks.workunit.client.0.smithi079.stdout:7/418: symlink d4/dc/d43/l7b 0 2024-09-10T09:36:05.217 INFO:tasks.workunit.client.0.smithi079.stdout:7/419: write d4/f37 [2168305,38368] 0 2024-09-10T09:36:05.218 INFO:tasks.workunit.client.0.smithi079.stdout:0/458: dread d4/d12/d1a/f51 [0,4194304] 0 2024-09-10T09:36:05.218 INFO:tasks.workunit.client.0.smithi079.stdout:0/459: chown d4/d12/d1a/d29/f37 631476581 1 2024-09-10T09:36:05.218 INFO:tasks.workunit.client.0.smithi079.stdout:4/437: readlink d1/da/d16/l33 0 2024-09-10T09:36:05.219 INFO:tasks.workunit.client.0.smithi079.stdout:5/456: dread d2/d3/d5e/d73/f7a [0,4194304] 0 2024-09-10T09:36:05.219 INFO:tasks.workunit.client.0.smithi079.stdout:5/457: readlink d2/d3/l33 0 2024-09-10T09:36:05.219 INFO:tasks.workunit.client.0.smithi079.stdout:5/458: write d2/f26 [3682691,118030] 0 2024-09-10T09:36:05.220 INFO:tasks.workunit.client.0.smithi079.stdout:8/464: dread d11/d2b/f41 [0,4194304] 0 2024-09-10T09:36:05.222 INFO:tasks.workunit.client.0.smithi079.stdout:5/459: getdents d2/d3/d27/d70 0 2024-09-10T09:36:05.223 INFO:tasks.workunit.client.0.smithi079.stdout:9/399: read d3/d7/d70/f71 [1680576,2928] 0 2024-09-10T09:36:05.225 INFO:tasks.workunit.client.0.smithi079.stdout:3/476: dwrite d4/f73 [0,4194304] 0 2024-09-10T09:36:05.225 INFO:tasks.workunit.client.0.smithi079.stdout:3/477: write d4/da/f6c [2004857,27671] 0 2024-09-10T09:36:05.225 INFO:tasks.workunit.client.0.smithi079.stdout:1/518: rename d5/df/d41 to d5/d24/d36/d3a/d3c/da0 0 2024-09-10T09:36:05.229 INFO:tasks.workunit.client.0.smithi079.stdout:4/438: rmdir d1/d38 39 2024-09-10T09:36:05.233 INFO:tasks.workunit.client.0.smithi079.stdout:5/460: unlink d2/d3/f16 0 2024-09-10T09:36:05.233 INFO:tasks.workunit.client.0.smithi079.stdout:5/461: stat d2/d3/l5 0 2024-09-10T09:36:05.237 INFO:tasks.workunit.client.0.smithi079.stdout:9/400: rmdir d3/d7/d26/d73 0 2024-09-10T09:36:05.239 INFO:tasks.workunit.client.0.smithi079.stdout:8/465: symlink d11/l96 0 2024-09-10T09:36:05.243 INFO:tasks.workunit.client.0.smithi079.stdout:3/478: rename d4/da/d17/d2d/d43/d4c/l61 to d4/l8b 0 2024-09-10T09:36:05.243 INFO:tasks.workunit.client.0.smithi079.stdout:3/479: truncate d4/da/d56/f6b 1237710 0 2024-09-10T09:36:05.245 INFO:tasks.workunit.client.0.smithi079.stdout:1/519: mknod d5/d24/d36/d3a/d85/ca1 0 2024-09-10T09:36:05.245 INFO:tasks.workunit.client.0.smithi079.stdout:1/520: creat d5/d24/d36/d3a/d48/fa2 x:0 0 0 2024-09-10T09:36:05.249 INFO:tasks.workunit.client.0.smithi079.stdout:4/439: symlink d1/da/d28/d47/d52/d73/l8b 0 2024-09-10T09:36:05.250 INFO:tasks.workunit.client.0.smithi079.stdout:4/440: creat d1/da/d3b/d5a/f8c x:0 0 0 2024-09-10T09:36:05.250 INFO:tasks.workunit.client.0.smithi079.stdout:2/378: dwrite d4/f2b [4194304,4194304] 0 2024-09-10T09:36:05.250 INFO:tasks.workunit.client.0.smithi079.stdout:2/379: fdatasync d4/dc/d13/f3a 0 2024-09-10T09:36:05.250 INFO:tasks.workunit.client.0.smithi079.stdout:2/380: write d4/fb [551969,87960] 0 2024-09-10T09:36:05.251 INFO:tasks.workunit.client.0.smithi079.stdout:9/401: link d3/d7/f76 d3/d40/f7b 0 2024-09-10T09:36:05.251 INFO:tasks.workunit.client.0.smithi079.stdout:9/402: creat d3/d7/d26/d3d/f7c x:0 0 0 2024-09-10T09:36:05.251 INFO:tasks.workunit.client.0.smithi079.stdout:9/403: chown d3/d7/dc/de/d17/d4c 3426970 1 2024-09-10T09:36:05.251 INFO:tasks.workunit.client.0.smithi079.stdout:9/404: creat d3/d7/dc/d62/f7d x:0 0 0 2024-09-10T09:36:05.252 INFO:tasks.workunit.client.0.smithi079.stdout:3/480: rmdir d4/da 39 2024-09-10T09:36:05.255 INFO:tasks.workunit.client.0.smithi079.stdout:0/460: dwrite d4/d47/f98 [0,4194304] 0 2024-09-10T09:36:05.255 INFO:tasks.workunit.client.0.smithi079.stdout:5/462: dwrite d2/d3/d27/d70/d80/f91 [0,4194304] 0 2024-09-10T09:36:05.255 INFO:tasks.workunit.client.0.smithi079.stdout:5/463: dread - d2/d3/d27/d32/d44/f7c zero size 2024-09-10T09:36:05.256 INFO:tasks.workunit.client.0.smithi079.stdout:8/466: dread d11/d48/f6a [0,4194304] 0 2024-09-10T09:36:05.256 INFO:tasks.workunit.client.0.smithi079.stdout:8/467: write ff [1064825,1623] 0 2024-09-10T09:36:05.256 INFO:tasks.workunit.client.0.smithi079.stdout:7/420: dwrite d4/dc/f4a [0,4194304] 0 2024-09-10T09:36:05.256 INFO:tasks.workunit.client.0.smithi079.stdout:7/421: truncate d4/f42 184862 0 2024-09-10T09:36:05.257 INFO:tasks.workunit.client.0.smithi079.stdout:1/521: rmdir d5/d24/d36/d3a/d85 39 2024-09-10T09:36:05.257 INFO:tasks.workunit.client.0.smithi079.stdout:1/522: creat d5/d24/d36/d3a/d48/fa3 x:0 0 0 2024-09-10T09:36:05.257 INFO:tasks.workunit.client.0.smithi079.stdout:1/523: readlink d5/d24/d36/d3a/d3c/da0/d6a/l6c 0 2024-09-10T09:36:05.258 INFO:tasks.workunit.client.0.smithi079.stdout:4/441: getdents d1/da/d28 0 2024-09-10T09:36:05.267 INFO:tasks.workunit.client.0.smithi079.stdout:2/381: mknod d4/dc/d29/d1b/d38/d39/d31/d52/c79 0 2024-09-10T09:36:05.267 INFO:tasks.workunit.client.0.smithi079.stdout:2/382: fsync d4/dc/f70 0 2024-09-10T09:36:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 -- 172.21.15.79:0/908253782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb90105710 msgr2=0x7fbb90107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 --2- 172.21.15.79:0/908253782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb90105710 0x7fbb90107af0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009910 tx=0x7fbb84009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:05.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 -- 172.21.15.79:0/908253782 shutdown_connections 2024-09-10T09:36:05.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 --2- 172.21.15.79:0/908253782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb90105710 0x7fbb90107af0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 --2- 172.21.15.79:0/908253782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb90069270 0x7fbb901051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 -- 172.21.15.79:0/908253782 >> 172.21.15.79:0/908253782 conn(0x7fbb900fa780 msgr2=0x7fbb900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:05.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 -- 172.21.15.79:0/908253782 shutdown_connections 2024-09-10T09:36:05.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.269+0000 7fbb9558e700 1 -- 172.21.15.79:0/908253782 wait complete. 2024-09-10T09:36:05.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.270+0000 7fbb9558e700 1 Processor -- start 2024-09-10T09:36:05.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.270+0000 7fbb9558e700 1 -- start start 2024-09-10T09:36:05.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.270+0000 7fbb9558e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb90105710 0x7fbb90197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:05.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.270+0000 7fbb9558e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb901982a0 0x7fbb9019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:05.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.270+0000 7fbb9558e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb901987a0 con 0x7fbb901982a0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.270+0000 7fbb9558e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90198910 con 0x7fbb90105710 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb8e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb901982a0 0x7fbb9019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb8e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb901982a0 0x7fbb9019d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49248/0 (socket says 172.21.15.79:49248) 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb8e7fc700 1 -- 172.21.15.79:0/2826413839 learned_addr learned my addr 172.21.15.79:0/2826413839 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb8e7fc700 1 -- 172.21.15.79:0/2826413839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb90105710 msgr2=0x7fbb90197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb8e7fc700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb90105710 0x7fbb90197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb8e7fc700 1 -- 172.21.15.79:0/2826413839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840095f0 con 0x7fbb901982a0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb8e7fc700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb901982a0 0x7fbb9019d310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbb84006010 tx=0x7fbb8400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb77fff700 1 -- 172.21.15.79:0/2826413839 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb8401d070 con 0x7fbb901982a0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9019d850 con 0x7fbb901982a0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb77fff700 1 -- 172.21.15.79:0/2826413839 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb8400f460 con 0x7fbb901982a0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb77fff700 1 -- 172.21.15.79:0/2826413839 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb84021640 con 0x7fbb901982a0 2024-09-10T09:36:05.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.271+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9019dd10 con 0x7fbb901982a0 2024-09-10T09:36:05.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.273+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb90191e70 con 0x7fbb901982a0 2024-09-10T09:36:05.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.273+0000 7fbb77fff700 1 -- 172.21.15.79:0/2826413839 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fbb8400fab0 con 0x7fbb901982a0 2024-09-10T09:36:05.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.274+0000 7fbb77fff700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb7806c680 0x7fbb7806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:05.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.274+0000 7fbb77fff700 1 -- 172.21.15.79:0/2826413839 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fbb8408cd10 con 0x7fbb901982a0 2024-09-10T09:36:05.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.274+0000 7fbb8effd700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb7806c680 0x7fbb7806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:05.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.275+0000 7fbb8effd700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb7806c680 0x7fbb7806eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb90068fa0 tx=0x7fbb80006d20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:05.278 INFO:tasks.workunit.client.0.smithi079.stdout:2/383: write d4/f6 [1793081,104131] 0 2024-09-10T09:36:05.279 INFO:tasks.workunit.client.0.smithi079.stdout:2/384: dread d4/dc/d1c/f54 [0,4194304] 0 2024-09-10T09:36:05.279 INFO:tasks.workunit.client.0.smithi079.stdout:2/385: chown d4/dc/d29/d1b/d38/d39/d31/f67 462 1 2024-09-10T09:36:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.281+0000 7fbb77fff700 1 -- 172.21.15.79:0/2826413839 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fbb8405aed0 con 0x7fbb901982a0 2024-09-10T09:36:05.289 INFO:tasks.workunit.client.0.smithi079.stdout:3/481: dwrite d4/da/d17/d2d/d43/d49/f68 [0,4194304] 0 2024-09-10T09:36:05.289 INFO:tasks.workunit.client.0.smithi079.stdout:1/524: symlink d5/d24/d36/d3a/d85/la4 0 2024-09-10T09:36:05.291 INFO:tasks.workunit.client.0.smithi079.stdout:5/464: link d2/c82 d2/d3/d27/ca0 0 2024-09-10T09:36:05.294 INFO:tasks.workunit.client.0.smithi079.stdout:0/461: getdents d4/d12/d16/d53 0 2024-09-10T09:36:05.294 INFO:tasks.workunit.client.0.smithi079.stdout:3/482: truncate d4/da/f11 3354798 0 2024-09-10T09:36:05.294 INFO:tasks.workunit.client.0.smithi079.stdout:3/483: write d4/da/d18/f47 [1461929,25146] 0 2024-09-10T09:36:05.296 INFO:tasks.workunit.client.0.smithi079.stdout:8/468: dwrite d11/d2b/f76 [0,4194304] 0 2024-09-10T09:36:05.296 INFO:tasks.workunit.client.0.smithi079.stdout:8/469: truncate d11/d2b/d4b/d74/f83 860066 0 2024-09-10T09:36:05.296 INFO:tasks.workunit.client.0.smithi079.stdout:8/470: write d11/d3b/f3d [19814,66378] 0 2024-09-10T09:36:05.296 INFO:tasks.workunit.client.0.smithi079.stdout:8/471: chown d11/d48/c5d 99619662 1 2024-09-10T09:36:05.296 INFO:tasks.workunit.client.0.smithi079.stdout:1/525: unlink d5/d40/d46/f7c 0 2024-09-10T09:36:05.297 INFO:tasks.workunit.client.0.smithi079.stdout:5/465: creat d2/d3/d27/d32/fa1 x:0 0 0 2024-09-10T09:36:05.297 INFO:tasks.workunit.client.0.smithi079.stdout:7/422: dwrite d4/dc/f3a [0,4194304] 0 2024-09-10T09:36:05.297 INFO:tasks.workunit.client.0.smithi079.stdout:4/442: dwrite d1/da/d16/d21/f25 [0,4194304] 0 2024-09-10T09:36:05.298 INFO:tasks.workunit.client.0.smithi079.stdout:4/443: chown d1/d38/f74 28074 1 2024-09-10T09:36:05.298 INFO:tasks.workunit.client.0.smithi079.stdout:0/462: rename d4/d12/d1a/d29/f59 to d4/d12/d1a/d29/d32/f9a 0 2024-09-10T09:36:05.300 INFO:tasks.workunit.client.0.smithi079.stdout:3/484: link d4/da/d17/d2d/d43/d49/c5d d4/d7a/c8c 0 2024-09-10T09:36:05.303 INFO:tasks.workunit.client.0.smithi079.stdout:8/472: symlink d11/d91/l97 0 2024-09-10T09:36:05.303 INFO:tasks.workunit.client.0.smithi079.stdout:8/473: chown d11/d3b/l5e 1389054 1 2024-09-10T09:36:05.303 INFO:tasks.workunit.client.0.smithi079.stdout:8/474: fsync d11/d2b/d4b/d50/f57 0 2024-09-10T09:36:05.304 INFO:tasks.workunit.client.0.smithi079.stdout:1/526: dread d5/df/f1c [0,4194304] 0 2024-09-10T09:36:05.304 INFO:tasks.workunit.client.0.smithi079.stdout:1/527: readlink d5/l67 0 2024-09-10T09:36:05.305 INFO:tasks.workunit.client.0.smithi079.stdout:3/485: dread d4/da/d17/f37 [0,4194304] 0 2024-09-10T09:36:05.305 INFO:tasks.workunit.client.0.smithi079.stdout:5/466: truncate d2/d3/fa 5002201 0 2024-09-10T09:36:05.305 INFO:tasks.workunit.client.0.smithi079.stdout:0/463: write d4/d47/f4c [2904556,66174] 0 2024-09-10T09:36:05.306 INFO:tasks.workunit.client.0.smithi079.stdout:7/423: write d4/df/d19/f2e [3294790,30286] 0 2024-09-10T09:36:05.308 INFO:tasks.workunit.client.0.smithi079.stdout:9/405: rmdir d3/d7/d26 39 2024-09-10T09:36:05.308 INFO:tasks.workunit.client.0.smithi079.stdout:9/406: write d3/d7/d26/f4d [1216992,115132] 0 2024-09-10T09:36:05.308 INFO:tasks.workunit.client.0.smithi079.stdout:9/407: creat d3/d40/f7e x:0 0 0 2024-09-10T09:36:05.309 INFO:tasks.workunit.client.0.smithi079.stdout:4/444: getdents d1 0 2024-09-10T09:36:05.309 INFO:tasks.workunit.client.0.smithi079.stdout:4/445: creat d1/da/d3b/d59/f8d x:0 0 0 2024-09-10T09:36:05.314 INFO:tasks.workunit.client.0.smithi079.stdout:8/475: link d11/d3b/l5a d11/d3b/l98 0 2024-09-10T09:36:05.328 INFO:tasks.workunit.client.0.smithi079.stdout:1/528: symlink d5/d24/d36/d3a/d48/la5 0 2024-09-10T09:36:05.332 INFO:tasks.workunit.client.0.smithi079.stdout:0/464: rename d4/d12/d15/l3c to d4/d12/d1a/d29/d32/d7d/l9b 0 2024-09-10T09:36:05.332 INFO:tasks.workunit.client.0.smithi079.stdout:0/465: write d4/d1d/f3a [1232160,56297] 0 2024-09-10T09:36:05.334 INFO:tasks.workunit.client.0.smithi079.stdout:7/424: truncate d4/df/d3d/f40 1230719 0 2024-09-10T09:36:05.334 INFO:tasks.workunit.client.0.smithi079.stdout:7/425: write d4/d6/f16 [2614427,37066] 0 2024-09-10T09:36:05.335 INFO:tasks.workunit.client.0.smithi079.stdout:3/486: dwrite d4/da/d17/d2d/f76 [4194304,4194304] 0 2024-09-10T09:36:05.337 INFO:tasks.workunit.client.0.smithi079.stdout:4/446: creat d1/da/d16/d21/d32/f8e x:0 0 0 2024-09-10T09:36:05.337 INFO:tasks.workunit.client.0.smithi079.stdout:4/447: readlink d1/da/d3b/l4f 0 2024-09-10T09:36:05.338 INFO:tasks.workunit.client.0.smithi079.stdout:9/408: dwrite d3/d7/f76 [0,4194304] 0 2024-09-10T09:36:05.339 INFO:tasks.workunit.client.0.smithi079.stdout:5/467: dwrite d2/d41/f6b [0,4194304] 0 2024-09-10T09:36:05.339 INFO:tasks.workunit.client.0.smithi079.stdout:5/468: chown d2/d3/d27/ca0 110795 1 2024-09-10T09:36:05.339 INFO:tasks.workunit.client.0.smithi079.stdout:8/476: unlink d11/d3b/f94 0 2024-09-10T09:36:05.341 INFO:tasks.workunit.client.0.smithi079.stdout:1/529: symlink d5/df/d2e/la6 0 2024-09-10T09:36:05.341 INFO:tasks.workunit.client.0.smithi079.stdout:1/530: fsync d5/f9d 0 2024-09-10T09:36:05.341 INFO:tasks.workunit.client.0.smithi079.stdout:1/531: read d5/d24/d36/d3a/d3c/da0/d6a/d88/f92 [3872174,100877] 0 2024-09-10T09:36:05.342 INFO:tasks.workunit.client.0.smithi079.stdout:1/532: dread - d5/d24/d36/d3a/d3c/f9c zero size 2024-09-10T09:36:05.342 INFO:tasks.workunit.client.0.smithi079.stdout:7/426: dread d4/d6/d38/f3f [0,4194304] 0 2024-09-10T09:36:05.343 INFO:tasks.workunit.client.0.smithi079.stdout:0/466: creat d4/d12/d15/f9c x:0 0 0 2024-09-10T09:36:05.345 INFO:tasks.workunit.client.0.smithi079.stdout:3/487: link d4/da/c4e d4/da/d17/d72/c8d 0 2024-09-10T09:36:05.347 INFO:tasks.workunit.client.0.smithi079.stdout:4/448: rename d1/da/c6e to d1/da/d16/d57/c8f 0 2024-09-10T09:36:05.347 INFO:tasks.workunit.client.0.smithi079.stdout:4/449: chown d1/da/c68 88390620 1 2024-09-10T09:36:05.347 INFO:tasks.workunit.client.0.smithi079.stdout:1/533: dread d5/d24/d36/d3a/d3c/f5e [0,4194304] 0 2024-09-10T09:36:05.348 INFO:tasks.workunit.client.0.smithi079.stdout:9/409: mkdir d3/d7f 0 2024-09-10T09:36:05.349 INFO:tasks.workunit.client.0.smithi079.stdout:5/469: chown d2/d3/d27/d70/d88/f9e 89 1 2024-09-10T09:36:05.349 INFO:tasks.workunit.client.0.smithi079.stdout:5/470: truncate d2/d3/d27/d32/d39/f7b 842236 0 2024-09-10T09:36:05.349 INFO:tasks.workunit.client.0.smithi079.stdout:5/471: chown d2/d41/d4d/f5a 3 1 2024-09-10T09:36:05.349 INFO:tasks.workunit.client.0.smithi079.stdout:5/472: dread - d2/d3/f63 zero size 2024-09-10T09:36:05.349 INFO:tasks.workunit.client.0.smithi079.stdout:8/477: fdatasync d11/d2b/f3f 0 2024-09-10T09:36:05.350 INFO:tasks.workunit.client.0.smithi079.stdout:7/427: dread d4/f61 [0,4194304] 0 2024-09-10T09:36:05.350 INFO:tasks.workunit.client.0.smithi079.stdout:7/428: creat d4/d6/d3e/f7c x:0 0 0 2024-09-10T09:36:05.354 INFO:tasks.workunit.client.0.smithi079.stdout:5/473: dread d2/f37 [0,4194304] 0 2024-09-10T09:36:05.357 INFO:tasks.workunit.client.0.smithi079.stdout:4/450: write d1/da/f36 [1565266,103073] 0 2024-09-10T09:36:05.359 INFO:tasks.workunit.client.0.smithi079.stdout:0/467: rename d4/d12/d16/d53/c5e to d4/d12/d21/c9d 0 2024-09-10T09:36:05.359 INFO:tasks.workunit.client.0.smithi079.stdout:0/468: truncate d4/d12/d21/d3f/d88/f8c 559329 0 2024-09-10T09:36:05.360 INFO:tasks.workunit.client.0.smithi079.stdout:1/534: mkdir d5/df/da7 0 2024-09-10T09:36:05.360 INFO:tasks.workunit.client.0.smithi079.stdout:8/478: truncate d11/d2b/f30 4913503 0 2024-09-10T09:36:05.360 INFO:tasks.workunit.client.0.smithi079.stdout:8/479: write d11/d2b/d4b/f62 [946807,40629] 0 2024-09-10T09:36:05.364 INFO:tasks.workunit.client.0.smithi079.stdout:7/429: symlink d4/df/d3d/d75/l7d 0 2024-09-10T09:36:05.365 INFO:tasks.workunit.client.0.smithi079.stdout:3/488: dread d4/da/d17/f21 [0,4194304] 0 2024-09-10T09:36:05.365 INFO:tasks.workunit.client.0.smithi079.stdout:3/489: write d4/da/d17/d38/d42/f53 [2342374,77524] 0 2024-09-10T09:36:05.365 INFO:tasks.workunit.client.0.smithi079.stdout:3/490: fsync d4/da/d18/f47 0 2024-09-10T09:36:05.365 INFO:tasks.workunit.client.0.smithi079.stdout:3/491: readlink d4/da/d17/d2d/d43/d49/l66 0 2024-09-10T09:36:05.370 INFO:tasks.workunit.client.0.smithi079.stdout:9/410: rename d3/d7/f76 to d3/d7/d26/f80 0 2024-09-10T09:36:05.371 INFO:tasks.workunit.client.0.smithi079.stdout:0/469: creat d4/d12/d1a/d6d/d84/f9e x:0 0 0 2024-09-10T09:36:05.372 INFO:tasks.workunit.client.0.smithi079.stdout:0/470: dread - d4/d12/d1a/d29/f74 zero size 2024-09-10T09:36:05.374 INFO:tasks.workunit.client.0.smithi079.stdout:1/535: creat d5/d24/d36/d3a/d3c/d57/fa8 x:0 0 0 2024-09-10T09:36:05.375 INFO:tasks.workunit.client.0.smithi079.stdout:1/536: dread d5/d24/d36/d3a/f4b [0,4194304] 0 2024-09-10T09:36:05.375 INFO:tasks.workunit.client.0.smithi079.stdout:1/537: read d5/df/d11/f2d [3209745,124747] 0 2024-09-10T09:36:05.381 INFO:tasks.workunit.client.0.smithi079.stdout:7/430: dread d4/d6/d38/f67 [0,4194304] 0 2024-09-10T09:36:05.383 INFO:tasks.workunit.client.0.smithi079.stdout:3/492: rename d4/da/d18/l70 to d4/da/d17/d72/l8e 0 2024-09-10T09:36:05.390 INFO:tasks.workunit.client.0.smithi079.stdout:8/480: symlink d11/l99 0 2024-09-10T09:36:05.391 INFO:tasks.workunit.client.0.smithi079.stdout:7/431: creat d4/d6/d4f/d66/f7e x:0 0 0 2024-09-10T09:36:05.393 INFO:tasks.workunit.client.0.smithi079.stdout:3/493: getdents d4/da/d17 0 2024-09-10T09:36:05.395 INFO:tasks.workunit.client.0.smithi079.stdout:8/481: symlink d11/d91/l9a 0 2024-09-10T09:36:05.396 INFO:tasks.workunit.client.0.smithi079.stdout:7/432: rename d4/d6/d3e/f7c to d4/f7f 0 2024-09-10T09:36:05.396 INFO:tasks.workunit.client.0.smithi079.stdout:7/433: fsync d4/f1c 0 2024-09-10T09:36:05.397 INFO:tasks.workunit.client.0.smithi079.stdout:7/434: chown d4/f7f 505322 1 2024-09-10T09:36:05.397 INFO:tasks.workunit.client.0.smithi079.stdout:7/435: write d4/dc/f36 [8525770,55848] 0 2024-09-10T09:36:05.397 INFO:tasks.workunit.client.0.smithi079.stdout:6/517: sync 2024-09-10T09:36:05.397 INFO:tasks.workunit.client.0.smithi079.stdout:5/474: dwrite d2/d3/f38 [0,4194304] 0 2024-09-10T09:36:05.398 INFO:tasks.workunit.client.0.smithi079.stdout:7/436: mknod d4/d6/c80 0 2024-09-10T09:36:05.400 INFO:tasks.workunit.client.0.smithi079.stdout:8/482: mknod d11/d2b/c9b 0 2024-09-10T09:36:05.401 INFO:tasks.workunit.client.0.smithi079.stdout:8/483: fsync d11/f43 0 2024-09-10T09:36:05.402 INFO:tasks.workunit.client.0.smithi079.stdout:5/475: symlink d2/d3/d27/d32/d39/la2 0 2024-09-10T09:36:05.403 INFO:tasks.workunit.client.0.smithi079.stdout:3/494: read d4/f2b [2037004,43682] 0 2024-09-10T09:36:05.404 INFO:tasks.workunit.client.0.smithi079.stdout:7/437: symlink d4/df/d6b/l81 0 2024-09-10T09:36:05.404 INFO:tasks.workunit.client.0.smithi079.stdout:7/438: readlink d4/df/l49 0 2024-09-10T09:36:05.406 INFO:tasks.workunit.client.0.smithi079.stdout:8/484: rename d11/d48/f60 to d11/d2b/d4b/d7e/f9c 0 2024-09-10T09:36:05.407 INFO:tasks.workunit.client.0.smithi079.stdout:7/439: chown d4/df/d19/c1a 762 1 2024-09-10T09:36:05.407 INFO:tasks.workunit.client.0.smithi079.stdout:7/440: read d4/d6/f16 [845147,51516] 0 2024-09-10T09:36:05.408 INFO:tasks.workunit.client.0.smithi079.stdout:7/441: fdatasync d4/d6/f2d 0 2024-09-10T09:36:05.408 INFO:tasks.workunit.client.0.smithi079.stdout:7/442: chown d4/f37 93528202 1 2024-09-10T09:36:05.411 INFO:tasks.workunit.client.0.smithi079.stdout:7/443: rename d4/d6/d38/d55 to d4/df/d3d/d82 0 2024-09-10T09:36:05.417 INFO:tasks.workunit.client.0.smithi079.stdout:4/451: dwrite d1/da/d16/d57/f7d [0,4194304] 0 2024-09-10T09:36:05.417 INFO:tasks.workunit.client.0.smithi079.stdout:3/495: write d4/da/d17/f32 [1638375,96651] 0 2024-09-10T09:36:05.417 INFO:tasks.workunit.client.0.smithi079.stdout:3/496: fdatasync d4/da/d18/f55 0 2024-09-10T09:36:05.417 INFO:tasks.workunit.client.0.smithi079.stdout:3/497: dread - d4/da/d18/f6d zero size 2024-09-10T09:36:05.417 INFO:tasks.workunit.client.0.smithi079.stdout:3/498: read d4/da/d17/f32 [19868,85969] 0 2024-09-10T09:36:05.417 INFO:tasks.workunit.client.0.smithi079.stdout:1/538: dwrite d5/df/d11/f32 [0,4194304] 0 2024-09-10T09:36:05.418 INFO:tasks.workunit.client.0.smithi079.stdout:1/539: fdatasync d5/d24/d36/d3a/f4b 0 2024-09-10T09:36:05.418 INFO:tasks.workunit.client.0.smithi079.stdout:9/411: dwrite d3/d7/dc/de/f46 [0,4194304] 0 2024-09-10T09:36:05.429 INFO:tasks.workunit.client.0.smithi079.stdout:3/499: creat d4/da/d17/d62/f8f x:0 0 0 2024-09-10T09:36:05.430 INFO:tasks.workunit.client.0.smithi079.stdout:3/500: creat d4/da/d17/d38/d42/f90 x:0 0 0 2024-09-10T09:36:05.431 INFO:tasks.workunit.client.0.smithi079.stdout:1/540: symlink d5/df/d2e/la9 0 2024-09-10T09:36:05.431 INFO:tasks.workunit.client.0.smithi079.stdout:1/541: stat d5/df/d11/c27 0 2024-09-10T09:36:05.435 INFO:tasks.workunit.client.0.smithi079.stdout:4/452: dwrite d1/da/d16/f26 [0,4194304] 0 2024-09-10T09:36:05.436 INFO:tasks.workunit.client.0.smithi079.stdout:9/412: link d3/d7/f63 d3/d40/f81 0 2024-09-10T09:36:05.439 INFO:tasks.workunit.client.0.smithi079.stdout:1/542: creat d5/d40/faa x:0 0 0 2024-09-10T09:36:05.439 INFO:tasks.workunit.client.0.smithi079.stdout:1/543: stat d5/d24/f2f 0 2024-09-10T09:36:05.442 INFO:tasks.workunit.client.0.smithi079.stdout:1/544: mkdir d5/d40/dab 0 2024-09-10T09:36:05.442 INFO:tasks.workunit.client.0.smithi079.stdout:1/545: write d5/f9d [1951007,122525] 0 2024-09-10T09:36:05.442 INFO:tasks.workunit.client.0.smithi079.stdout:1/546: dread - d5/d4f/f77 zero size 2024-09-10T09:36:05.442 INFO:tasks.workunit.client.0.smithi079.stdout:1/547: write d5/d40/f42 [754920,4038] 0 2024-09-10T09:36:05.444 INFO:tasks.workunit.client.0.smithi079.stdout:4/453: rmdir d1/da/d16/d57 39 2024-09-10T09:36:05.444 INFO:tasks.workunit.client.0.smithi079.stdout:4/454: fsync d1/f3a 0 2024-09-10T09:36:05.444 INFO:tasks.workunit.client.0.smithi079.stdout:3/501: dwrite d4/da/d17/d38/d42/f90 [0,4194304] 0 2024-09-10T09:36:05.445 INFO:tasks.workunit.client.0.smithi079.stdout:4/455: getdents d1/da 0 2024-09-10T09:36:05.446 INFO:tasks.workunit.client.0.smithi079.stdout:9/413: dread d3/f2b [0,4194304] 0 2024-09-10T09:36:05.447 INFO:tasks.workunit.client.0.smithi079.stdout:2/386: sync 2024-09-10T09:36:05.449 INFO:tasks.workunit.client.0.smithi079.stdout:3/502: unlink d4/da/d17/d38/d42/f90 0 2024-09-10T09:36:05.450 INFO:tasks.workunit.client.0.smithi079.stdout:4/456: mknod d1/d38/c90 0 2024-09-10T09:36:05.455 INFO:tasks.workunit.client.0.smithi079.stdout:1/548: dread d5/d24/f2f [0,4194304] 0 2024-09-10T09:36:05.456 INFO:tasks.workunit.client.0.smithi079.stdout:2/387: dread d4/dc/d29/d1b/d38/d39/d31/f3b [0,4194304] 0 2024-09-10T09:36:05.457 INFO:tasks.workunit.client.0.smithi079.stdout:2/388: creat d4/f7a x:0 0 0 2024-09-10T09:36:05.458 INFO:tasks.workunit.client.0.smithi079.stdout:9/414: dread d3/d7/d26/d3d/f42 [0,4194304] 0 2024-09-10T09:36:05.458 INFO:tasks.workunit.client.0.smithi079.stdout:2/389: getdents d4/dc/d29/d1b/d38/d39 0 2024-09-10T09:36:05.458 INFO:tasks.workunit.client.0.smithi079.stdout:3/503: write d4/f13 [1862584,72379] 0 2024-09-10T09:36:05.460 INFO:tasks.workunit.client.0.smithi079.stdout:4/457: truncate d1/da/d16/f26 2768142 0 2024-09-10T09:36:05.464 INFO:tasks.workunit.client.0.smithi079.stdout:3/504: rmdir d4/da/d17/d62/d80 0 2024-09-10T09:36:05.464 INFO:tasks.workunit.client.0.smithi079.stdout:2/390: getdents d4/dc/d13/d61/d65/d77 0 2024-09-10T09:36:05.465 INFO:tasks.workunit.client.0.smithi079.stdout:2/391: chown d4/la 48421 1 2024-09-10T09:36:05.466 INFO:tasks.workunit.client.0.smithi079.stdout:4/458: rename d1/da/d3b/l4f to d1/d38/l91 0 2024-09-10T09:36:05.469 INFO:tasks.workunit.client.0.smithi079.stdout:2/392: creat d4/dc/d29/d1b/d38/d39/f7b x:0 0 0 2024-09-10T09:36:05.469 INFO:tasks.workunit.client.0.smithi079.stdout:2/393: truncate d4/dc/d13/d61/f72 812877 0 2024-09-10T09:36:05.469 INFO:tasks.workunit.client.0.smithi079.stdout:1/549: dread d5/f19 [0,4194304] 0 2024-09-10T09:36:05.474 INFO:tasks.workunit.client.0.smithi079.stdout:9/415: dread d3/d7/dc/de/f46 [0,4194304] 0 2024-09-10T09:36:05.474 INFO:tasks.workunit.client.0.smithi079.stdout:9/416: creat d3/d7/dc/de/d17/f82 x:0 0 0 2024-09-10T09:36:05.476 INFO:tasks.workunit.client.0.smithi079.stdout:1/550: dread d5/df/d11/f75 [0,4194304] 0 2024-09-10T09:36:05.483 INFO:tasks.workunit.client.0.smithi079.stdout:1/551: write d5/d24/f2f [6990318,74279] 0 2024-09-10T09:36:05.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.518+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb9002cdb0 con 0x7fbb7806c680 2024-09-10T09:36:05.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.528+0000 7fbb77fff700 1 -- 172.21.15.79:0/2826413839 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3504 (secure 0 0 0) 0x7fbb9002cdb0 con 0x7fbb7806c680 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (6m) 2m ago 7m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (8m) 2m ago 8m 7398k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (7m) 2m ago 7m 7348k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (8m) 2m ago 8m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (7m) 2m ago 7m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (6m) 2m ago 7m 83.2M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (2m) 2m ago 2m 11.5M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (2m) 2m ago 2m 14.4M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (2m) 2m ago 2m 19.5M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:36:05.529 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (2m) 2m ago 2m 15.4M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:9283,8765,8443 running (9m) 2m ago 9m 487M - 18.2.0 dc2bc1663786 3bc55a447267 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 starting - - - - 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (9m) 2m ago 9m 45.0M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (6m) 2m ago 6m 35.3M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (8m) 2m ago 8m 14.5M - 1.5.0 0da6a335fe13 2d43514669a8 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (7m) 2m ago 7m 15.3M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (6m) 2m ago 6m 49.1M 3946M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (5m) 2m ago 5m 48.2M 3946M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (5m) 2m ago 5m 46.4M 3946M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (4m) 2m ago 4m 46.0M 1213M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (4m) 2m ago 4m 44.7M 1213M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (4m) 2m ago 4m 46.3M 1213M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:36:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (6m) 2m ago 7m 61.5M - 2.43.0 a07b618ecd1d 960dc8481947 2024-09-10T09:36:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb7806c680 msgr2=0x7fbb7806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb7806c680 0x7fbb7806eb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbb90068fa0 tx=0x7fbb80006d20 comp rx=0 tx=0).stop 2024-09-10T09:36:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb901982a0 msgr2=0x7fbb9019d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb901982a0 0x7fbb9019d310 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbb84006010 tx=0x7fbb8400be20 comp rx=0 tx=0).stop 2024-09-10T09:36:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 shutdown_connections 2024-09-10T09:36:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fbb7806c680 0x7fbb7806eb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb90105710 0x7fbb90197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 --2- 172.21.15.79:0/2826413839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb901982a0 0x7fbb9019d310 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 >> 172.21.15.79:0/2826413839 conn(0x7fbb900fa780 msgr2=0x7fbb900fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 shutdown_connections 2024-09-10T09:36:05.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.530+0000 7fbb9558e700 1 -- 172.21.15.79:0/2826413839 wait complete. 2024-09-10T09:36:05.535 INFO:tasks.workunit.client.0.smithi079.stdout:4/459: truncate d1/da/d3b/d5a/f7c 4180838 0 2024-09-10T09:36:05.537 INFO:tasks.workunit.client.0.smithi079.stdout:9/417: truncate d3/d7/f2a 3642558 0 2024-09-10T09:36:05.538 INFO:tasks.workunit.client.0.smithi079.stdout:9/418: fdatasync d3/d7/dc/d62/f6b 0 2024-09-10T09:36:05.539 INFO:tasks.workunit.client.0.smithi079.stdout:1/552: mkdir d5/d40/dac 0 2024-09-10T09:36:05.539 INFO:tasks.workunit.client.0.smithi079.stdout:1/553: write d5/d4f/f77 [199512,93693] 0 2024-09-10T09:36:05.543 INFO:tasks.workunit.client.0.smithi079.stdout:4/460: truncate d1/f2e 7069404 0 2024-09-10T09:36:05.543 INFO:tasks.workunit.client.0.smithi079.stdout:4/461: fsync d1/da/d3b/d5a/f78 0 2024-09-10T09:36:05.543 INFO:tasks.workunit.client.0.smithi079.stdout:4/462: write d1/da/d28/d47/d52/f79 [1070167,42453] 0 2024-09-10T09:36:05.543 INFO:tasks.workunit.client.0.smithi079.stdout:4/463: chown d1/da/d16/d21/d32/f44 47982 1 2024-09-10T09:36:05.545 INFO:tasks.workunit.client.0.smithi079.stdout:9/419: mkdir d3/d7/d26/d83 0 2024-09-10T09:36:05.545 INFO:tasks.workunit.client.0.smithi079.stdout:9/420: dread - d3/d7/dc/d62/f75 zero size 2024-09-10T09:36:05.546 INFO:tasks.workunit.client.0.smithi079.stdout:9/421: dread d3/d7/dc/de/d17/d2f/d30/f56 [0,4194304] 0 2024-09-10T09:36:05.546 INFO:tasks.workunit.client.0.smithi079.stdout:9/422: chown d3/d7/d26/d3d 582497 1 2024-09-10T09:36:05.546 INFO:tasks.workunit.client.0.smithi079.stdout:9/423: chown d3/d7/f5b 1858 1 2024-09-10T09:36:05.546 INFO:tasks.workunit.client.0.smithi079.stdout:9/424: write d3/d40/f5d [1185696,60968] 0 2024-09-10T09:36:05.547 INFO:tasks.workunit.client.0.smithi079.stdout:1/554: rename d5/d24/d36/d3a/d3c/da0/d6a/d88 to d5/df/d11/d76/dad 0 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:8/485: sync 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:0/471: sync 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:6/518: sync 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:7/444: sync 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:5/476: sync 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:2/394: dread d4/dc/d29/d1b/d38/d39/d31/f46 [0,4194304] 0 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:5/477: write d2/f22 [794185,122817] 0 2024-09-10T09:36:05.548 INFO:tasks.workunit.client.0.smithi079.stdout:6/519: write d4/d8/dd/f91 [332305,130465] 0 2024-09-10T09:36:05.553 INFO:tasks.workunit.client.0.smithi079.stdout:8/486: chown d11/d2b/l63 65 1 2024-09-10T09:36:05.558 INFO:tasks.workunit.client.0.smithi079.stdout:1/555: rmdir d5/d4f/d8a 39 2024-09-10T09:36:05.558 INFO:tasks.workunit.client.0.smithi079.stdout:1/556: dread - d5/d24/d36/d3a/d3c/f78 zero size 2024-09-10T09:36:05.558 INFO:tasks.workunit.client.0.smithi079.stdout:0/472: mknod d4/c9f 0 2024-09-10T09:36:05.559 INFO:tasks.workunit.client.0.smithi079.stdout:1/557: chown d5/d24/d36 315127 1 2024-09-10T09:36:05.559 INFO:tasks.workunit.client.0.smithi079.stdout:1/558: readlink d5/df/d2e/l7b 0 2024-09-10T09:36:05.559 INFO:tasks.workunit.client.0.smithi079.stdout:1/559: fsync d5/d24/d36/d3a/d3c/da0/f65 0 2024-09-10T09:36:05.559 INFO:tasks.workunit.client.0.smithi079.stdout:1/560: truncate d5/df/f52 670541 0 2024-09-10T09:36:05.559 INFO:tasks.workunit.client.0.smithi079.stdout:0/473: creat d4/d12/d39/fa0 x:0 0 0 2024-09-10T09:36:05.559 INFO:tasks.workunit.client.0.smithi079.stdout:0/474: dread - d4/d12/d1a/d6d/d7b/f85 zero size 2024-09-10T09:36:05.560 INFO:tasks.workunit.client.0.smithi079.stdout:2/395: mkdir d4/dc/d13/d61/d65/d7c 0 2024-09-10T09:36:05.560 INFO:tasks.workunit.client.0.smithi079.stdout:2/396: chown d4/dc/d13/d61/d62/d74 12792 1 2024-09-10T09:36:05.564 INFO:tasks.workunit.client.0.smithi079.stdout:9/425: rmdir d3/d7/dc/de/d17/d2f 39 2024-09-10T09:36:05.564 INFO:tasks.workunit.client.0.smithi079.stdout:9/426: readlink d3/d7/d26/l64 0 2024-09-10T09:36:05.565 INFO:tasks.workunit.client.0.smithi079.stdout:0/475: link d4/d12/d39/l94 d4/d12/d1a/d6d/d84/la1 0 2024-09-10T09:36:05.567 INFO:tasks.workunit.client.0.smithi079.stdout:0/476: dread d4/d12/d1a/f51 [0,4194304] 0 2024-09-10T09:36:05.569 INFO:tasks.workunit.client.0.smithi079.stdout:5/478: getdents d2/d3/d5e/d85 0 2024-09-10T09:36:05.575 INFO:tasks.workunit.client.0.smithi079.stdout:9/427: mknod d3/d7/dc/de/d17/d12/c84 0 2024-09-10T09:36:05.578 INFO:tasks.workunit.client.0.smithi079.stdout:9/428: symlink d3/d7/dc/l85 0 2024-09-10T09:36:05.579 INFO:tasks.workunit.client.0.smithi079.stdout:9/429: chown d3/d7/dc/de/d17/d2f/d74 1 1 2024-09-10T09:36:05.579 INFO:tasks.workunit.client.0.smithi079.stdout:1/561: dread d5/d24/d36/d3a/d48/f56 [0,4194304] 0 2024-09-10T09:36:05.581 INFO:tasks.workunit.client.0.smithi079.stdout:6/520: dwrite d4/d8/dc/d12/d29/f62 [4194304,4194304] 0 2024-09-10T09:36:05.581 INFO:tasks.workunit.client.0.smithi079.stdout:6/521: creat d4/d8/dc/d12/faf x:0 0 0 2024-09-10T09:36:05.581 INFO:tasks.workunit.client.0.smithi079.stdout:6/522: chown d4/d8/dc/d93/d4b/c6d 47 1 2024-09-10T09:36:05.581 INFO:tasks.workunit.client.0.smithi079.stdout:8/487: dwrite d11/d2b/f41 [0,4194304] 0 2024-09-10T09:36:05.581 INFO:tasks.workunit.client.0.smithi079.stdout:7/445: dwrite d4/dc/f74 [0,4194304] 0 2024-09-10T09:36:05.581 INFO:tasks.workunit.client.0.smithi079.stdout:7/446: write d4/d6/f16 [922082,8164] 0 2024-09-10T09:36:05.582 INFO:tasks.workunit.client.0.smithi079.stdout:9/430: mknod d3/d7/d26/d69/c86 0 2024-09-10T09:36:05.584 INFO:tasks.workunit.client.0.smithi079.stdout:2/397: read d4/dc/f14 [2452335,73600] 0 2024-09-10T09:36:05.584 INFO:tasks.workunit.client.0.smithi079.stdout:2/398: chown d4/dc/d13/c5e 1418547230 1 2024-09-10T09:36:05.584 INFO:tasks.workunit.client.0.smithi079.stdout:2/399: read - d4/dc/d13/d61/d62/f76 zero size 2024-09-10T09:36:05.584 INFO:tasks.workunit.client.0.smithi079.stdout:2/400: fdatasync d4/dc/d13/d61/d62/f76 0 2024-09-10T09:36:05.584 INFO:tasks.workunit.client.0.smithi079.stdout:2/401: read d4/dc/d13/f27 [626293,7527] 0 2024-09-10T09:36:05.585 INFO:tasks.workunit.client.0.smithi079.stdout:4/464: dwrite d1/da/d16/d57/f7d [0,4194304] 0 2024-09-10T09:36:05.585 INFO:tasks.workunit.client.0.smithi079.stdout:4/465: chown d1/da/d3b/f7f 30 1 2024-09-10T09:36:05.585 INFO:tasks.workunit.client.0.smithi079.stdout:5/479: dread d2/d41/f45 [0,4194304] 0 2024-09-10T09:36:05.586 INFO:tasks.workunit.client.0.smithi079.stdout:5/480: dread - d2/d3/d27/d32/f90 zero size 2024-09-10T09:36:05.587 INFO:tasks.workunit.client.0.smithi079.stdout:6/523: link d4/d8/dc/d3c/la1 d4/d8/dc/d93/d4b/lb0 0 2024-09-10T09:36:05.589 INFO:tasks.workunit.client.0.smithi079.stdout:4/466: dread d1/da/d28/f29 [0,4194304] 0 2024-09-10T09:36:05.596 INFO:tasks.workunit.client.0.smithi079.stdout:7/447: rename d4/f37 to d4/df/d3d/d75/f83 0 2024-09-10T09:36:05.599 INFO:tasks.workunit.client.0.smithi079.stdout:9/431: symlink d3/l87 0 2024-09-10T09:36:05.603 INFO:tasks.workunit.client.0.smithi079.stdout:0/477: dwrite d4/d12/d15/f9c [0,4194304] 0 2024-09-10T09:36:05.607 INFO:tasks.workunit.client.0.smithi079.stdout:5/481: symlink d2/d3/d27/d32/la3 0 2024-09-10T09:36:05.607 INFO:tasks.workunit.client.0.smithi079.stdout:5/482: chown d2/d3/d27/d70/c76 1126807 1 2024-09-10T09:36:05.607 INFO:tasks.workunit.client.0.smithi079.stdout:5/483: fdatasync d2/d3/f6e 0 2024-09-10T09:36:05.608 INFO:tasks.workunit.client.0.smithi079.stdout:6/524: mknod d4/d8/dd/d41/cb1 0 2024-09-10T09:36:05.609 INFO:tasks.workunit.client.0.smithi079.stdout:4/467: symlink d1/da/d16/d21/d32/l92 0 2024-09-10T09:36:05.609 INFO:tasks.workunit.client.0.smithi079.stdout:4/468: dread - d1/da/d3b/d5a/f8c zero size 2024-09-10T09:36:05.610 INFO:tasks.workunit.client.0.smithi079.stdout:2/402: rename d4/dc/d13/f3a to d4/dc/d13/d61/d62/f7d 0 2024-09-10T09:36:05.610 INFO:tasks.workunit.client.0.smithi079.stdout:2/403: write d4/dc/d1c/f28 [2449980,78575] 0 2024-09-10T09:36:05.611 INFO:tasks.workunit.client.0.smithi079.stdout:7/448: stat d4/df/d19/l1e 0 2024-09-10T09:36:05.611 INFO:tasks.workunit.client.0.smithi079.stdout:7/449: chown d4/d6/d3e/f51 5482404 1 2024-09-10T09:36:05.611 INFO:tasks.workunit.client.0.smithi079.stdout:8/488: dwrite d11/f1e [0,4194304] 0 2024-09-10T09:36:05.612 INFO:tasks.workunit.client.0.smithi079.stdout:9/432: symlink d3/d7/l88 0 2024-09-10T09:36:05.612 INFO:tasks.workunit.client.0.smithi079.stdout:9/433: chown d3/d40/f47 987112731 1 2024-09-10T09:36:05.613 INFO:tasks.workunit.client.0.smithi079.stdout:9/434: write d3/d7/dc/de/d17/d2f/d30/f3a [369028,36863] 0 2024-09-10T09:36:05.613 INFO:tasks.workunit.client.0.smithi079.stdout:9/435: creat d3/d7/d5a/f89 x:0 0 0 2024-09-10T09:36:05.613 INFO:tasks.workunit.client.0.smithi079.stdout:9/436: chown d3/c4b 1002935 1 2024-09-10T09:36:05.614 INFO:tasks.workunit.client.0.smithi079.stdout:5/484: read d2/d3/d27/f87 [410151,126942] 0 2024-09-10T09:36:05.616 INFO:tasks.workunit.client.0.smithi079.stdout:6/525: symlink d4/d8/dc/d12/lb2 0 2024-09-10T09:36:05.616 INFO:tasks.workunit.client.0.smithi079.stdout:1/562: dwrite d5/df/d11/d76/dad/f92 [0,4194304] 0 2024-09-10T09:36:05.618 INFO:tasks.workunit.client.0.smithi079.stdout:2/404: mkdir d4/dc/d13/d61/d65/d77/d7e 0 2024-09-10T09:36:05.620 INFO:tasks.workunit.client.0.smithi079.stdout:7/450: rename d4/dc/f4a to d4/df/f84 0 2024-09-10T09:36:05.620 INFO:tasks.workunit.client.0.smithi079.stdout:7/451: stat d4/d6/fa 0 2024-09-10T09:36:05.622 INFO:tasks.workunit.client.0.smithi079.stdout:8/489: read - d11/d2b/f2d zero size 2024-09-10T09:36:05.624 INFO:tasks.workunit.client.0.smithi079.stdout:9/437: dread d3/d7/dc/f37 [0,4194304] 0 2024-09-10T09:36:05.624 INFO:tasks.workunit.client.0.smithi079.stdout:3/505: sync 2024-09-10T09:36:05.624 INFO:tasks.workunit.client.0.smithi079.stdout:6/526: creat d4/d8/dc/d1c/fb3 x:0 0 0 2024-09-10T09:36:05.626 INFO:tasks.workunit.client.0.smithi079.stdout:4/469: dwrite d1/da/f2b [0,4194304] 0 2024-09-10T09:36:05.626 INFO:tasks.workunit.client.0.smithi079.stdout:1/563: link d5/d24/d36/d3a/c8d d5/d24/d36/d3a/d3c/da0/d6a/cae 0 2024-09-10T09:36:05.631 INFO:tasks.workunit.client.0.smithi079.stdout:2/405: mknod d4/dc/d13/d61/d65/d7c/c7f 0 2024-09-10T09:36:05.632 INFO:tasks.workunit.client.0.smithi079.stdout:7/452: getdents d4/d6/d38 0 2024-09-10T09:36:05.634 INFO:tasks.workunit.client.0.smithi079.stdout:8/490: chown d11/d2b/f47 9976 1 2024-09-10T09:36:05.636 INFO:tasks.workunit.client.0.smithi079.stdout:6/527: mknod d4/d8/dc/d12/d9d/cb4 0 2024-09-10T09:36:05.638 INFO:tasks.workunit.client.0.smithi079.stdout:1/564: mknod d5/d4f/d8a/caf 0 2024-09-10T09:36:05.645 INFO:tasks.workunit.client.0.smithi079.stdout:2/406: truncate d4/dc/d29/f16 6141837 0 2024-09-10T09:36:05.645 INFO:tasks.workunit.client.0.smithi079.stdout:8/491: rename d11/l2f to d11/d3b/l9d 0 2024-09-10T09:36:05.645 INFO:tasks.workunit.client.0.smithi079.stdout:8/492: chown d11/d48/l84 119 1 2024-09-10T09:36:05.646 INFO:tasks.workunit.client.0.smithi079.stdout:2/407: fsync d4/dc/d29/d1b/d38/d39/d31/d49/f64 0 2024-09-10T09:36:05.647 INFO:tasks.workunit.client.0.smithi079.stdout:6/528: write d4/d8/dc/d1c/f3f [1376324,103953] 0 2024-09-10T09:36:05.649 INFO:tasks.workunit.client.0.smithi079.stdout:4/470: dwrite d1/da/d3b/d5f/f76 [0,4194304] 0 2024-09-10T09:36:05.655 INFO:tasks.workunit.client.0.smithi079.stdout:1/565: creat d5/d24/d36/d53/fb0 x:0 0 0 2024-09-10T09:36:05.655 INFO:tasks.workunit.client.0.smithi079.stdout:1/566: write d5/d24/d36/d3a/d3c/d57/fa8 [876879,123298] 0 2024-09-10T09:36:05.656 INFO:tasks.workunit.client.0.smithi079.stdout:8/493: rename d11/d2b/d4b/d50/d80 to d11/d2b/d4b/d50/d9e 0 2024-09-10T09:36:05.659 INFO:tasks.workunit.client.0.smithi079.stdout:6/529: mkdir d4/d8/dc/d12/d29/db5 0 2024-09-10T09:36:05.659 INFO:tasks.workunit.client.0.smithi079.stdout:6/530: rename d4/d8/dc to d4/d8/dc/d98/db6 22 2024-09-10T09:36:05.662 INFO:tasks.workunit.client.0.smithi079.stdout:7/453: dwrite d4/df/d3d/d75/f83 [0,4194304] 0 2024-09-10T09:36:05.662 INFO:tasks.workunit.client.0.smithi079.stdout:7/454: creat d4/d6/d3e/f85 x:0 0 0 2024-09-10T09:36:05.662 INFO:tasks.workunit.client.0.smithi079.stdout:7/455: creat d4/d6/d3e/f86 x:0 0 0 2024-09-10T09:36:05.667 INFO:tasks.workunit.client.0.smithi079.stdout:6/531: dread d4/d8/dd/d76/f71 [0,4194304] 0 2024-09-10T09:36:05.669 INFO:tasks.workunit.client.0.smithi079.stdout:9/438: dwrite d3/d7/dc/de/d17/d2f/d30/f23 [4194304,4194304] 0 2024-09-10T09:36:05.671 INFO:tasks.workunit.client.0.smithi079.stdout:3/506: dwrite d4/da/d56/f6b [0,4194304] 0 2024-09-10T09:36:05.673 INFO:tasks.workunit.client.0.smithi079.stdout:4/471: creat d1/da/d28/d47/d52/d83/f93 x:0 0 0 2024-09-10T09:36:05.673 INFO:tasks.workunit.client.0.smithi079.stdout:8/494: creat d11/d48/f9f x:0 0 0 2024-09-10T09:36:05.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/567: dread d5/df/d2e/f39 [4194304,4194304] 0 2024-09-10T09:36:05.676 INFO:tasks.workunit.client.0.smithi079.stdout:9/439: dread d3/f14 [0,4194304] 0 2024-09-10T09:36:05.677 INFO:tasks.workunit.client.0.smithi079.stdout:9/440: chown d3/d7/dc/de/d17/d2f/d30/f45 862890 1 2024-09-10T09:36:05.677 INFO:tasks.workunit.client.0.smithi079.stdout:7/456: truncate d4/dc/f36 7546333 0 2024-09-10T09:36:05.683 INFO:tasks.workunit.client.0.smithi079.stdout:6/532: dread d4/d8/dc/d12/d29/f44 [0,4194304] 0 2024-09-10T09:36:05.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/408: dwrite d4/dc/f14 [0,4194304] 0 2024-09-10T09:36:05.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/409: dread - d4/dc/d13/d61/d65/d77/f78 zero size 2024-09-10T09:36:05.683 INFO:tasks.workunit.client.0.smithi079.stdout:4/472: rename d1/da/d28/d47/d52/l58 to d1/da/d28/l94 0 2024-09-10T09:36:05.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/410: read d4/dc/d13/d61/f72 [261401,87630] 0 2024-09-10T09:36:05.683 INFO:tasks.workunit.client.0.smithi079.stdout:5/485: dwrite d2/d3/d27/f43 [0,4194304] 0 2024-09-10T09:36:05.683 INFO:tasks.workunit.client.0.smithi079.stdout:3/507: write d4/f2a [3515984,64316] 0 2024-09-10T09:36:05.685 INFO:tasks.workunit.client.0.smithi079.stdout:8/495: creat d11/d2b/d4b/d50/d5c/fa0 x:0 0 0 2024-09-10T09:36:05.685 INFO:tasks.workunit.client.0.smithi079.stdout:8/496: fdatasync d11/f2a 0 2024-09-10T09:36:05.686 INFO:tasks.workunit.client.0.smithi079.stdout:3/508: write d4/da/d56/f5e [12229,130714] 0 2024-09-10T09:36:05.687 INFO:tasks.workunit.client.0.smithi079.stdout:9/441: symlink d3/d7/dc/de/d58/l8a 0 2024-09-10T09:36:05.687 INFO:tasks.workunit.client.0.smithi079.stdout:9/442: chown d3/d7/dc/de/d17/f78 303023885 1 2024-09-10T09:36:05.690 INFO:tasks.workunit.client.0.smithi079.stdout:1/568: rename d5/d40/dab to d5/d24/d36/d3a/d85/db1 0 2024-09-10T09:36:05.690 INFO:tasks.workunit.client.0.smithi079.stdout:1/569: read d5/d24/d36/d3a/f3d [1021419,94527] 0 2024-09-10T09:36:05.690 INFO:tasks.workunit.client.0.smithi079.stdout:1/570: chown d5/d40/f42 17366051 1 2024-09-10T09:36:05.694 INFO:tasks.workunit.client.0.smithi079.stdout:9/443: dread d3/d40/f7b [0,4194304] 0 2024-09-10T09:36:05.694 INFO:tasks.workunit.client.0.smithi079.stdout:9/444: readlink d3/d7/dc/de/d58/l67 0 2024-09-10T09:36:05.695 INFO:tasks.workunit.client.0.smithi079.stdout:2/411: symlink d4/dc/d29/d1b/d38/d39/d31/d49/l80 0 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.695+0000 7fc540cd3700 1 -- 172.21.15.79:0/1108914889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 msgr2=0x7fc53c101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.695+0000 7fc540cd3700 1 --2- 172.21.15.79:0/1108914889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c101cd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc530009910 tx=0x7fc530009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.696+0000 7fc540cd3700 1 -- 172.21.15.79:0/1108914889 shutdown_connections 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.696+0000 7fc540cd3700 1 --2- 172.21.15.79:0/1108914889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc53c102210 0x7fc53c0fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.696+0000 7fc540cd3700 1 --2- 172.21.15.79:0/1108914889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c101cd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.696+0000 7fc540cd3700 1 -- 172.21.15.79:0/1108914889 >> 172.21.15.79:0/1108914889 conn(0x7fc53c0f9f10 msgr2=0x7fc53c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.696+0000 7fc540cd3700 1 -- 172.21.15.79:0/1108914889 shutdown_connections 2024-09-10T09:36:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.696+0000 7fc540cd3700 1 -- 172.21.15.79:0/1108914889 wait complete. 2024-09-10T09:36:05.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc540cd3700 1 Processor -- start 2024-09-10T09:36:05.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc540cd3700 1 -- start start 2024-09-10T09:36:05.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc540cd3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:05.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc540cd3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc53c102210 0x7fc53c0ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:05.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc540cd3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0ffb50 con 0x7fc53c1018c0 2024-09-10T09:36:05.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc540cd3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0ffc90 con 0x7fc53c102210 2024-09-10T09:36:05.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc53a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:05.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc53a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c100fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49266/0 (socket says 172.21.15.79:49266) 2024-09-10T09:36:05.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.697+0000 7fc53a59c700 1 -- 172.21.15.79:0/3030614822 learned_addr learned my addr 172.21.15.79:0/3030614822 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:05.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc53a59c700 1 -- 172.21.15.79:0/3030614822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc53c102210 msgr2=0x7fc53c0ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc53a59c700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc53c102210 0x7fc53c0ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc53a59c700 1 -- 172.21.15.79:0/3030614822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300095f0 con 0x7fc53c1018c0 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc53a59c700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c100fc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc530005b40 tx=0x7fc53000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3030614822 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc53001d070 con 0x7fc53c1018c0 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0fff10 con 0x7fc53c1018c0 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3030614822 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc53000f460 con 0x7fc53c1018c0 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.698+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c100400 con 0x7fc53c1018c0 2024-09-10T09:36:05.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.699+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3030614822 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc530021640 con 0x7fc53c1018c0 2024-09-10T09:36:05.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.700+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c108d50 con 0x7fc53c1018c0 2024-09-10T09:36:05.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.700+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3030614822 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7fc530003a60 con 0x7fc53c1018c0 2024-09-10T09:36:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.701+0000 7fc52b7fe700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc52406c680 0x7fc52406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.701+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3030614822 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fc53008cb20 con 0x7fc53c1018c0 2024-09-10T09:36:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.701+0000 7fc539d9b700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc52406c680 0x7fc52406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:05.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.701+0000 7fc539d9b700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc52406c680 0x7fc52406eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc52c005950 tx=0x7fc52c0058e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:05.704 INFO:tasks.workunit.client.0.smithi079.stdout:5/486: mknod d2/d3/ca4 0 2024-09-10T09:36:05.704 INFO:tasks.workunit.client.0.smithi079.stdout:3/509: mknod d4/da/d8a/c91 0 2024-09-10T09:36:05.704 INFO:tasks.workunit.client.0.smithi079.stdout:9/445: mknod d3/d7f/c8b 0 2024-09-10T09:36:05.704 INFO:tasks.workunit.client.0.smithi079.stdout:3/510: write d4/da/d17/d38/d42/f84 [73138,2513] 0 2024-09-10T09:36:05.704 INFO:tasks.workunit.client.0.smithi079.stdout:1/571: mkdir d5/d40/dac/db2 0 2024-09-10T09:36:05.704 INFO:tasks.workunit.client.0.smithi079.stdout:9/446: write d3/d7/dc/de/d17/f21 [5201022,81501] 0 2024-09-10T09:36:05.706 INFO:tasks.workunit.client.0.smithi079.stdout:5/487: mknod d2/d3/d59/ca5 0 2024-09-10T09:36:05.708 INFO:tasks.workunit.client.0.smithi079.stdout:3/511: truncate d4/da/d18/f55 776273 0 2024-09-10T09:36:05.708 INFO:tasks.workunit.client.0.smithi079.stdout:3/512: chown d4/da/d17/d2d/l3d 211 1 2024-09-10T09:36:05.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:05.708+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3030614822 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7fc53005ace0 con 0x7fc53c1018c0 2024-09-10T09:36:05.710 INFO:tasks.workunit.client.0.smithi079.stdout:1/572: mkdir d5/d24/d36/d53/db3 0 2024-09-10T09:36:05.710 INFO:tasks.workunit.client.0.smithi079.stdout:1/573: readlink d5/d24/d36/d79/l7f 0 2024-09-10T09:36:05.713 INFO:tasks.workunit.client.0.smithi079.stdout:5/488: rename d2/l97 to d2/d41/la6 0 2024-09-10T09:36:05.714 INFO:tasks.workunit.client.0.smithi079.stdout:7/457: dwrite d4/f42 [0,4194304] 0 2024-09-10T09:36:05.718 INFO:tasks.workunit.client.0.smithi079.stdout:1/574: rename d5/d24/c35 to d5/df/d2e/cb4 0 2024-09-10T09:36:05.725 INFO:tasks.workunit.client.0.smithi079.stdout:5/489: unlink d2/d3/f38 0 2024-09-10T09:36:05.733 INFO:tasks.workunit.client.0.smithi079.stdout:5/490: write d2/f1d [1585352,66809] 0 2024-09-10T09:36:05.733 INFO:tasks.workunit.client.0.smithi079.stdout:2/412: write d4/f23 [4116220,128199] 0 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/533: dwrite d4/d8/dc/d12/d29/f44 [0,4194304] 0 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/534: stat d4/d8/dd/d76/f59 0 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/535: chown d4/d8/da5 3654335 1 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/536: readlink d4/d8/dc/l78 0 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/537: fsync d4/d8/f83 0 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/538: creat d4/d8/dd/fb7 x:0 0 0 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/539: chown d4/d8/dc/d3c/la6 225513464 1 2024-09-10T09:36:05.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/540: chown d4/d8/dc/d12/d9d 23868970 1 2024-09-10T09:36:05.739 INFO:tasks.workunit.client.0.smithi079.stdout:4/473: dwrite d1/da/f45 [0,4194304] 0 2024-09-10T09:36:05.741 INFO:tasks.workunit.client.0.smithi079.stdout:7/458: symlink d4/l87 0 2024-09-10T09:36:05.745 INFO:tasks.workunit.client.0.smithi079.stdout:5/491: creat d2/d3/d5e/fa7 x:0 0 0 2024-09-10T09:36:05.750 INFO:tasks.workunit.client.0.smithi079.stdout:2/413: dread d4/f6 [0,4194304] 0 2024-09-10T09:36:05.750 INFO:tasks.workunit.client.0.smithi079.stdout:6/541: rename d4/d8/dc/d93/f49 to d4/d8/dc/d93/da0/fb8 0 2024-09-10T09:36:05.750 INFO:tasks.workunit.client.0.smithi079.stdout:6/542: dread - d4/d8/dc/d93/d4b/f80 zero size 2024-09-10T09:36:05.750 INFO:tasks.workunit.client.0.smithi079.stdout:6/543: fsync d4/d8/fae 0 2024-09-10T09:36:05.753 INFO:tasks.workunit.client.0.smithi079.stdout:5/492: symlink d2/d41/d4d/la8 0 2024-09-10T09:36:05.753 INFO:tasks.workunit.client.0.smithi079.stdout:5/493: truncate d2/d3/d27/d32/f75 851455 0 2024-09-10T09:36:05.756 INFO:tasks.workunit.client.0.smithi079.stdout:3/513: dwrite d4/da/d17/f37 [0,4194304] 0 2024-09-10T09:36:05.756 INFO:tasks.workunit.client.0.smithi079.stdout:3/514: creat d4/da/d17/d2d/d43/d4c/f92 x:0 0 0 2024-09-10T09:36:05.763 INFO:tasks.workunit.client.0.smithi079.stdout:3/515: rmdir d4/da/d7c 0 2024-09-10T09:36:05.763 INFO:tasks.workunit.client.0.smithi079.stdout:3/516: fsync d4/da/d56/f5e 0 2024-09-10T09:36:05.763 INFO:tasks.workunit.client.0.smithi079.stdout:3/517: write d4/da/d17/d54/f41 [403604,74826] 0 2024-09-10T09:36:05.765 INFO:tasks.workunit.client.0.smithi079.stdout:3/518: mknod d4/da/d17/d2d/d43/d49/c93 0 2024-09-10T09:36:05.767 INFO:tasks.workunit.client.0.smithi079.stdout:9/447: dwrite d3/f11 [4194304,4194304] 0 2024-09-10T09:36:05.767 INFO:tasks.workunit.client.0.smithi079.stdout:3/519: mknod d4/da/d17/c94 0 2024-09-10T09:36:05.768 INFO:tasks.workunit.client.0.smithi079.stdout:1/575: dwrite d5/f19 [0,4194304] 0 2024-09-10T09:36:05.771 INFO:tasks.workunit.client.0.smithi079.stdout:3/520: link d4/da/d17/d2d/d43/d4c/f92 d4/da/d17/d2d/d43/d4c/f95 0 2024-09-10T09:36:05.771 INFO:tasks.workunit.client.0.smithi079.stdout:3/521: chown d4/da/d17/d2d/d43/d4c/f92 868463 1 2024-09-10T09:36:05.771 INFO:tasks.workunit.client.0.smithi079.stdout:3/522: creat d4/da/d17/d2d/d43/d4c/f96 x:0 0 0 2024-09-10T09:36:05.774 INFO:tasks.workunit.client.0.smithi079.stdout:3/523: write f2 [3620420,33365] 0 2024-09-10T09:36:05.777 INFO:tasks.workunit.client.0.smithi079.stdout:9/448: dread d3/d7/d26/d3d/f42 [0,4194304] 0 2024-09-10T09:36:05.779 INFO:tasks.workunit.client.0.smithi079.stdout:4/474: dwrite d1/da/f3f [0,4194304] 0 2024-09-10T09:36:05.779 INFO:tasks.workunit.client.0.smithi079.stdout:7/459: dwrite d4/df/f77 [0,4194304] 0 2024-09-10T09:36:05.780 INFO:tasks.workunit.client.0.smithi079.stdout:7/460: write d4/f5d [522167,84954] 0 2024-09-10T09:36:05.784 INFO:tasks.workunit.client.0.smithi079.stdout:6/544: dwrite d4/d8/dd/f91 [0,4194304] 0 2024-09-10T09:36:05.790 INFO:tasks.workunit.client.0.smithi079.stdout:1/576: link d5/d4f/f73 d5/d24/d36/d3a/fb5 0 2024-09-10T09:36:05.794 INFO:tasks.workunit.client.0.smithi079.stdout:3/524: rename d4/da/d17/f21 to d4/da/d18/f97 0 2024-09-10T09:36:05.797 INFO:tasks.workunit.client.0.smithi079.stdout:6/545: dread d4/d8/dc/d93/d4b/f4d [0,4194304] 0 2024-09-10T09:36:05.797 INFO:tasks.workunit.client.0.smithi079.stdout:2/414: dwrite d4/dc/d29/d1b/d38/d39/d31/d52/f5a [4194304,4194304] 0 2024-09-10T09:36:05.797 INFO:tasks.workunit.client.0.smithi079.stdout:2/415: write d4/dc/d1c/f28 [1630316,41184] 0 2024-09-10T09:36:05.797 INFO:tasks.workunit.client.0.smithi079.stdout:6/546: creat d4/d8/dd/d76/d46/d88/fb9 x:0 0 0 2024-09-10T09:36:05.798 INFO:tasks.workunit.client.0.smithi079.stdout:9/449: mknod d3/d7/c8c 0 2024-09-10T09:36:05.798 INFO:tasks.workunit.client.0.smithi079.stdout:9/450: write d3/f16 [575498,78827] 0 2024-09-10T09:36:05.799 INFO:tasks.workunit.client.0.smithi079.stdout:9/451: stat d3/d7/dc/de/f46 0 2024-09-10T09:36:05.799 INFO:tasks.workunit.client.0.smithi079.stdout:9/452: truncate d3/d7/dc/de/d17/d2f/f79 443518 0 2024-09-10T09:36:05.799 INFO:tasks.workunit.client.0.smithi079.stdout:9/453: chown d3/d7/c34 1273564 1 2024-09-10T09:36:05.803 INFO:tasks.workunit.client.0.smithi079.stdout:7/461: symlink d4/df/d3d/d82/l88 0 2024-09-10T09:36:05.810 INFO:tasks.workunit.client.0.smithi079.stdout:1/577: unlink d5/c28 0 2024-09-10T09:36:05.813 INFO:tasks.workunit.client.0.smithi079.stdout:3/525: getdents d4/da 0 2024-09-10T09:36:05.817 INFO:tasks.workunit.client.0.smithi079.stdout:6/547: creat d4/d8/dc/d93/fba x:0 0 0 2024-09-10T09:36:05.820 INFO:tasks.workunit.client.0.smithi079.stdout:3/526: symlink d4/da/d56/d7b/l98 0 2024-09-10T09:36:05.820 INFO:tasks.workunit.client.0.smithi079.stdout:0/478: sync 2024-09-10T09:36:05.820 INFO:tasks.workunit.client.0.smithi079.stdout:0/479: chown d4/d12/d16/d53/c8f 80 1 2024-09-10T09:36:05.821 INFO:tasks.workunit.client.0.smithi079.stdout:0/480: stat d4/d12/d21/f54 0 2024-09-10T09:36:05.821 INFO:tasks.workunit.client.0.smithi079.stdout:4/475: rename d1/da/d3b/d59 to d1/da/d28/d95 0 2024-09-10T09:36:05.821 INFO:tasks.workunit.client.0.smithi079.stdout:4/476: fsync d1/da/d3b/d5a/f63 0 2024-09-10T09:36:05.822 INFO:tasks.workunit.client.0.smithi079.stdout:0/481: creat d4/d12/d15/d2b/fa2 x:0 0 0 2024-09-10T09:36:05.823 INFO:tasks.workunit.client.0.smithi079.stdout:2/416: rename d4/dc/d29/d1b/d38/f53 to d4/dc/d13/d61/d65/d77/f81 0 2024-09-10T09:36:05.824 INFO:tasks.workunit.client.0.smithi079.stdout:2/417: write d4/dc/f14 [4333272,130619] 0 2024-09-10T09:36:05.824 INFO:tasks.workunit.client.0.smithi079.stdout:4/477: creat d1/da/d16/d21/f96 x:0 0 0 2024-09-10T09:36:05.824 INFO:tasks.workunit.client.0.smithi079.stdout:4/478: write d1/f3a [1613998,23551] 0 2024-09-10T09:36:05.826 INFO:tasks.workunit.client.0.smithi079.stdout:0/482: symlink d4/d12/d1a/d6d/d84/la3 0 2024-09-10T09:36:05.826 INFO:tasks.workunit.client.0.smithi079.stdout:0/483: fsync d4/d12/d21/f99 0 2024-09-10T09:36:05.826 INFO:tasks.workunit.client.0.smithi079.stdout:0/484: fsync d4/f11 0 2024-09-10T09:36:05.827 INFO:tasks.workunit.client.0.smithi079.stdout:7/462: rename d4/dc/d43/l7b to d4/d6/d38/l89 0 2024-09-10T09:36:05.827 INFO:tasks.workunit.client.0.smithi079.stdout:7/463: stat d4/dc 0 2024-09-10T09:36:05.829 INFO:tasks.workunit.client.0.smithi079.stdout:1/578: rename d5/d24/d36/d3a/d3c/da0/f9b to d5/df/d11/fb6 0 2024-09-10T09:36:05.829 INFO:tasks.workunit.client.0.smithi079.stdout:1/579: chown d5/d40/l8b 167803 1 2024-09-10T09:36:05.830 INFO:tasks.workunit.client.0.smithi079.stdout:7/464: link d4/f1c d4/df/d6b/f8a 0 2024-09-10T09:36:05.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/418: dread d4/dc/d1c/f28 [0,4194304] 0 2024-09-10T09:36:05.831 INFO:tasks.workunit.client.0.smithi079.stdout:3/527: rename d4/da/d17/d2d/d43/d49/c87 to d4/da/d17/c99 0 2024-09-10T09:36:05.831 INFO:tasks.workunit.client.0.smithi079.stdout:3/528: stat d4/da/d17/d2d/d43 0 2024-09-10T09:36:05.832 INFO:tasks.workunit.client.0.smithi079.stdout:8/497: sync 2024-09-10T09:36:05.833 INFO:tasks.workunit.client.0.smithi079.stdout:7/465: rename d4/df/f4c to d4/df/d6b/f8b 0 2024-09-10T09:36:05.835 INFO:tasks.workunit.client.0.smithi079.stdout:8/498: creat d11/d2b/fa1 x:0 0 0 2024-09-10T09:36:05.835 INFO:tasks.workunit.client.0.smithi079.stdout:0/485: dread d4/d12/d21/d3f/d88/f95 [0,4194304] 0 2024-09-10T09:36:05.835 INFO:tasks.workunit.client.0.smithi079.stdout:0/486: getdents d4/d12/d1a/d6d/d7b 0 2024-09-10T09:36:05.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/419: mknod d4/c82 0 2024-09-10T09:36:05.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/420: getdents d4/dc/d13/d61/d62/d74 0 2024-09-10T09:36:05.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/421: creat d4/d5d/f83 x:0 0 0 2024-09-10T09:36:05.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/422: fdatasync d4/dc/d29/d1b/d38/d39/f45 0 2024-09-10T09:36:05.837 INFO:tasks.workunit.client.0.smithi079.stdout:7/466: symlink d4/df/l8c 0 2024-09-10T09:36:05.842 INFO:tasks.workunit.client.0.smithi079.stdout:8/499: mkdir d11/d2b/d4b/d74/da2 0 2024-09-10T09:36:05.843 INFO:tasks.workunit.client.0.smithi079.stdout:0/487: creat d4/d1d/d24/d72/fa4 x:0 0 0 2024-09-10T09:36:05.844 INFO:tasks.workunit.client.0.smithi079.stdout:0/488: write d4/f70 [982706,102127] 0 2024-09-10T09:36:05.844 INFO:tasks.workunit.client.0.smithi079.stdout:0/489: write d4/d12/d1a/f19 [4785275,39452] 0 2024-09-10T09:36:05.846 INFO:tasks.workunit.client.0.smithi079.stdout:1/580: dread d5/fe [0,4194304] 0 2024-09-10T09:36:05.846 INFO:tasks.workunit.client.0.smithi079.stdout:4/479: dwrite d1/da/d28/f29 [0,4194304] 0 2024-09-10T09:36:05.846 INFO:tasks.workunit.client.0.smithi079.stdout:4/480: write d1/da/d16/f24 [96824,110227] 0 2024-09-10T09:36:05.846 INFO:tasks.workunit.client.0.smithi079.stdout:4/481: stat d1/da/f36 0 2024-09-10T09:36:05.847 INFO:tasks.workunit.client.0.smithi079.stdout:4/482: read d1/da/d3b/d5a/f63 [170758,129529] 0 2024-09-10T09:36:05.847 INFO:tasks.workunit.client.0.smithi079.stdout:4/483: dread - d1/da/d3b/d5a/f8c zero size 2024-09-10T09:36:05.849 INFO:tasks.workunit.client.0.smithi079.stdout:4/484: symlink d1/da/d28/d47/d52/d83/l97 0 2024-09-10T09:36:05.849 INFO:tasks.workunit.client.0.smithi079.stdout:2/423: read d4/dc/d29/ff [4482859,70179] 0 2024-09-10T09:36:05.855 INFO:tasks.workunit.client.0.smithi079.stdout:0/490: write d4/fd [1528564,105227] 0 2024-09-10T09:36:05.862 INFO:tasks.workunit.client.0.smithi079.stdout:4/485: write d1/da/d28/f29 [2462579,100445] 0 2024-09-10T09:36:05.944 INFO:tasks.workunit.client.0.smithi079.stdout:7/467: dwrite d4/df/d6b/f8b [0,4194304] 0 2024-09-10T09:36:05.944 INFO:tasks.workunit.client.0.smithi079.stdout:7/468: dread - d4/df/d3d/f41 zero size 2024-09-10T09:36:05.948 INFO:tasks.workunit.client.0.smithi079.stdout:3/529: dwrite d4/da/d17/d72/f75 [0,4194304] 0 2024-09-10T09:36:05.948 INFO:tasks.workunit.client.0.smithi079.stdout:8/500: write d11/d3b/f6f [2491826,102729] 0 2024-09-10T09:36:05.953 INFO:tasks.workunit.client.0.smithi079.stdout:4/486: write d1/da/d3b/d5a/f7c [3249407,19755] 0 2024-09-10T09:36:05.953 INFO:tasks.workunit.client.0.smithi079.stdout:4/487: creat d1/da/d16/d21/d32/f98 x:0 0 0 2024-09-10T09:36:05.956 INFO:tasks.workunit.client.0.smithi079.stdout:4/488: write d1/da/f45 [5153700,113241] 0 2024-09-10T09:36:05.960 INFO:tasks.workunit.client.0.smithi079.stdout:0/491: dwrite d4/d12/d15/f9c [0,4194304] 0 2024-09-10T09:36:05.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:05 smithi079 ceph-mon[27592]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:05.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:05 smithi079 ceph-mon[27592]: pgmap v257: 65 pgs: 65 active+clean; 925 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 96 MiB/s rd, 114 MiB/s wr, 619 op/s 2024-09-10T09:36:05.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:05 smithi079 ceph-mon[27592]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:05.974 INFO:tasks.workunit.client.0.smithi079.stdout:1/581: getdents d5/d40 0 2024-09-10T09:36:05.974 INFO:tasks.workunit.client.0.smithi079.stdout:1/582: chown d5/df/d2e/l7b 938 1 2024-09-10T09:36:05.975 INFO:tasks.workunit.client.0.smithi079.stdout:2/424: creat d4/dc/d1c/d59/f84 x:0 0 0 2024-09-10T09:36:05.976 INFO:tasks.workunit.client.0.smithi079.stdout:2/425: write d4/dc/d29/d1b/d38/d39/d31/f67 [944491,119234] 0 2024-09-10T09:36:05.976 INFO:tasks.workunit.client.0.smithi079.stdout:2/426: write d4/f6 [5030836,11334] 0 2024-09-10T09:36:05.986 INFO:tasks.workunit.client.0.smithi079.stdout:7/469: getdents d4/d6/d38 0 2024-09-10T09:36:05.989 INFO:tasks.workunit.client.0.smithi079.stdout:3/530: truncate d4/da/d17/f1a 1570098 0 2024-09-10T09:36:05.992 INFO:tasks.workunit.client.0.smithi079.stdout:8/501: rename d11/l99 to d11/d3b/la3 0 2024-09-10T09:36:06.000 INFO:tasks.workunit.client.0.smithi079.stdout:4/489: mkdir d1/da/d28/d99 0 2024-09-10T09:36:06.004 INFO:tasks.workunit.client.0.smithi079.stdout:0/492: creat d4/d12/d16/d53/fa5 x:0 0 0 2024-09-10T09:36:06.006 INFO:tasks.workunit.client.0.smithi079.stdout:1/583: link d5/d24/d36/d3a/d3c/f7a d5/d40/dac/fb7 0 2024-09-10T09:36:06.011 INFO:tasks.workunit.client.0.smithi079.stdout:7/470: mknod d4/d6/c8d 0 2024-09-10T09:36:06.011 INFO:tasks.workunit.client.0.smithi079.stdout:7/471: stat d4/d6/d38/l76 0 2024-09-10T09:36:06.013 INFO:tasks.workunit.client.0.smithi079.stdout:3/531: unlink d4/da/f11 0 2024-09-10T09:36:06.013 INFO:tasks.workunit.client.0.smithi079.stdout:3/532: write d4/f2a [3250381,120915] 0 2024-09-10T09:36:06.014 INFO:tasks.workunit.client.0.smithi079.stdout:8/502: link d11/d2b/d4b/d50/d5c/l67 d11/d2b/d4b/d50/d5c/la4 0 2024-09-10T09:36:06.015 INFO:tasks.workunit.client.0.smithi079.stdout:4/490: unlink d1/da/d3b/d5a/f7c 0 2024-09-10T09:36:06.016 INFO:tasks.workunit.client.0.smithi079.stdout:0/493: symlink d4/d47/la6 0 2024-09-10T09:36:06.016 INFO:tasks.workunit.client.0.smithi079.stdout:0/494: truncate d4/d12/d1a/d6d/d84/f9e 387909 0 2024-09-10T09:36:06.017 INFO:tasks.workunit.client.0.smithi079.stdout:0/495: fdatasync d4/f70 0 2024-09-10T09:36:06.017 INFO:tasks.workunit.client.0.smithi079.stdout:1/584: symlink d5/d24/d36/d53/db3/lb8 0 2024-09-10T09:36:06.018 INFO:tasks.workunit.client.0.smithi079.stdout:1/585: write d5/df/f52 [31479,130797] 0 2024-09-10T09:36:06.018 INFO:tasks.workunit.client.0.smithi079.stdout:2/427: mknod d4/c85 0 2024-09-10T09:36:06.020 INFO:tasks.workunit.client.0.smithi079.stdout:7/472: dread d4/df/f84 [0,4194304] 0 2024-09-10T09:36:06.020 INFO:tasks.workunit.client.0.smithi079.stdout:7/473: write d4/d6/fa [1400558,20405] 0 2024-09-10T09:36:06.020 INFO:tasks.workunit.client.0.smithi079.stdout:7/474: truncate d4/d6/d4f/f52 948187 0 2024-09-10T09:36:06.021 INFO:tasks.workunit.client.0.smithi079.stdout:7/475: stat d4/d6/c8d 0 2024-09-10T09:36:06.021 INFO:tasks.workunit.client.0.smithi079.stdout:3/533: link d4/da/d17/l26 d4/l9a 0 2024-09-10T09:36:06.024 INFO:tasks.workunit.client.0.smithi079.stdout:8/503: mknod d11/d2b/d4b/d50/d9e/ca5 0 2024-09-10T09:36:06.027 INFO:tasks.workunit.client.0.smithi079.stdout:4/491: dread d1/da/d3b/d5a/f78 [0,4194304] 0 2024-09-10T09:36:06.027 INFO:tasks.workunit.client.0.smithi079.stdout:7/476: creat d4/df/d6b/f8e x:0 0 0 2024-09-10T09:36:06.027 INFO:tasks.workunit.client.0.smithi079.stdout:4/492: stat d1/da/d16/c1d 0 2024-09-10T09:36:06.027 INFO:tasks.workunit.client.0.smithi079.stdout:1/586: read d5/df/d2e/f39 [7673031,19792] 0 2024-09-10T09:36:06.028 INFO:tasks.workunit.client.0.smithi079.stdout:8/504: creat d11/d2b/d4b/d50/d55/fa6 x:0 0 0 2024-09-10T09:36:06.028 INFO:tasks.workunit.client.0.smithi079.stdout:8/505: readlink d11/d91/l9a 0 2024-09-10T09:36:06.028 INFO:tasks.workunit.client.0.smithi079.stdout:5/494: sync 2024-09-10T09:36:06.028 INFO:tasks.workunit.client.0.smithi079.stdout:5/495: chown d2/d3/d27/d32/d44 31 1 2024-09-10T09:36:06.028 INFO:tasks.workunit.client.0.smithi079.stdout:2/428: dread d4/dc/d29/ff [4194304,4194304] 0 2024-09-10T09:36:06.029 INFO:tasks.workunit.client.0.smithi079.stdout:2/429: write d4/dc/d13/f27 [827819,69405] 0 2024-09-10T09:36:06.030 INFO:tasks.workunit.client.0.smithi079.stdout:6/548: sync 2024-09-10T09:36:06.030 INFO:tasks.workunit.client.0.smithi079.stdout:9/454: sync 2024-09-10T09:36:06.030 INFO:tasks.workunit.client.0.smithi079.stdout:6/549: chown d4/d8/dc/d93/d4b 2 1 2024-09-10T09:36:06.030 INFO:tasks.workunit.client.0.smithi079.stdout:6/550: chown d4/d8/dc/l78 150341933 1 2024-09-10T09:36:06.030 INFO:tasks.workunit.client.0.smithi079.stdout:6/551: chown d4/d8 2 1 2024-09-10T09:36:06.030 INFO:tasks.workunit.client.0.smithi079.stdout:6/552: readlink d4/d8/dc/d93/d4b/l69 0 2024-09-10T09:36:06.034 INFO:tasks.workunit.client.0.smithi079.stdout:2/430: truncate d4/dc/f22 2228772 0 2024-09-10T09:36:06.034 INFO:tasks.workunit.client.0.smithi079.stdout:9/455: creat d3/d7/d26/f8d x:0 0 0 2024-09-10T09:36:06.034 INFO:tasks.workunit.client.0.smithi079.stdout:9/456: write d3/f6f [689758,58826] 0 2024-09-10T09:36:06.039 INFO:tasks.workunit.client.0.smithi079.stdout:9/457: symlink d3/d7/d26/d3d/l8e 0 2024-09-10T09:36:06.039 INFO:tasks.workunit.client.0.smithi079.stdout:9/458: creat d3/d7/d26/f8f x:0 0 0 2024-09-10T09:36:06.042 INFO:tasks.workunit.client.0.smithi079.stdout:8/506: write d11/d2b/d4b/d50/f57 [1110394,115205] 0 2024-09-10T09:36:06.046 INFO:tasks.workunit.client.0.smithi079.stdout:8/507: mkdir d11/d2b/d4b/d7e/da7 0 2024-09-10T09:36:06.048 INFO:tasks.workunit.client.0.smithi079.stdout:0/496: dwrite d4/d12/d16/d53/f6c [0,4194304] 0 2024-09-10T09:36:06.048 INFO:tasks.workunit.client.0.smithi079.stdout:4/493: dwrite d1/da/d3b/d5f/f6d [0,4194304] 0 2024-09-10T09:36:06.054 INFO:tasks.workunit.client.0.smithi079.stdout:6/553: dread d4/d8/dd/d76/d46/f3a [0,4194304] 0 2024-09-10T09:36:06.054 INFO:tasks.workunit.client.0.smithi079.stdout:0/497: truncate d4/d12/d21/d3f/d88/f95 1493872 0 2024-09-10T09:36:06.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.053+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc53c19e050 con 0x7fc53c1018c0 2024-09-10T09:36:06.055 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.054+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3030614822 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fc53005a870 con 0x7fc53c1018c0 2024-09-10T09:36:06.055 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:36:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:36:06.055 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 14 2024-09-10T09:36:06.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:36:06.057 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:36:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc52406c680 msgr2=0x7fc52406eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc52406c680 0x7fc52406eb30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc52c005950 tx=0x7fc52c0058e0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 msgr2=0x7fc53c100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c100fc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc530005b40 tx=0x7fc53000be20 comp rx=0 tx=0).stop 2024-09-10T09:36:06.058 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 shutdown_connections 2024-09-10T09:36:06.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7fc52406c680 0x7fc52406eb30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc53c1018c0 0x7fc53c100fc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 --2- 172.21.15.79:0/3030614822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc53c102210 0x7fc53c0ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 >> 172.21.15.79:0/3030614822 conn(0x7fc53c0f9f10 msgr2=0x7fc53c104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:06.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 shutdown_connections 2024-09-10T09:36:06.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.057+0000 7fc540cd3700 1 -- 172.21.15.79:0/3030614822 wait complete. 2024-09-10T09:36:06.061 INFO:tasks.workunit.client.0.smithi079.stdout:0/498: link d4/d12/d1a/c36 d4/d12/d1a/d29/ca7 0 2024-09-10T09:36:06.067 INFO:tasks.workunit.client.0.smithi079.stdout:6/554: dread d4/d8/dc/d12/d29/f62 [4194304,4194304] 0 2024-09-10T09:36:06.072 INFO:tasks.workunit.client.0.smithi079.stdout:7/477: dread d4/df/d19/f48 [0,4194304] 0 2024-09-10T09:36:06.073 INFO:tasks.workunit.client.0.smithi079.stdout:7/478: creat d4/dc/f8f x:0 0 0 2024-09-10T09:36:06.076 INFO:tasks.workunit.client.0.smithi079.stdout:4/494: write d1/da/d16/d57/f7d [1175428,24031] 0 2024-09-10T09:36:06.076 INFO:tasks.workunit.client.0.smithi079.stdout:4/495: fdatasync d1/da/f3f 0 2024-09-10T09:36:06.077 INFO:tasks.workunit.client.0.smithi079.stdout:4/496: write d1/da/d28/f29 [452445,130628] 0 2024-09-10T09:36:06.077 INFO:tasks.workunit.client.0.smithi079.stdout:4/497: write d1/da/d16/d21/d32/f8e [1010084,48665] 0 2024-09-10T09:36:06.078 INFO:tasks.workunit.client.0.smithi079.stdout:7/479: rename d4/df/d19/c2a to d4/c90 0 2024-09-10T09:36:06.079 INFO:tasks.workunit.client.0.smithi079.stdout:4/498: mknod d1/da/d16/d4d/c9a 0 2024-09-10T09:36:06.087 INFO:tasks.workunit.client.0.smithi079.stdout:6/555: dread d4/d8/dc/d12/d29/f2c [0,4194304] 0 2024-09-10T09:36:06.087 INFO:tasks.workunit.client.0.smithi079.stdout:6/556: truncate d4/f9f 545460 0 2024-09-10T09:36:06.087 INFO:tasks.workunit.client.0.smithi079.stdout:6/557: chown d4/d8/dc/d12/d29/f62 6 1 2024-09-10T09:36:06.088 INFO:tasks.workunit.client.0.smithi079.stdout:4/499: unlink d1/da/l20 0 2024-09-10T09:36:06.089 INFO:tasks.workunit.client.0.smithi079.stdout:3/534: dwrite d4/da/d17/f37 [0,4194304] 0 2024-09-10T09:36:06.091 INFO:tasks.workunit.client.0.smithi079.stdout:3/535: mkdir d4/da/d17/d9b 0 2024-09-10T09:36:06.091 INFO:tasks.workunit.client.0.smithi079.stdout:3/536: creat d4/da/d17/d72/f9c x:0 0 0 2024-09-10T09:36:06.091 INFO:tasks.workunit.client.0.smithi079.stdout:3/537: fsync d4/f2b 0 2024-09-10T09:36:06.091 INFO:tasks.workunit.client.0.smithi079.stdout:3/538: fsync d4/da/d17/d38/d42/f7e 0 2024-09-10T09:36:06.091 INFO:tasks.workunit.client.0.smithi079.stdout:3/539: read - d4/da/d17/d2d/d43/f7d zero size 2024-09-10T09:36:06.092 INFO:tasks.workunit.client.0.smithi079.stdout:3/540: write d4/f4d [577185,6956] 0 2024-09-10T09:36:06.093 INFO:tasks.workunit.client.0.smithi079.stdout:3/541: getdents d4/da/d18 0 2024-09-10T09:36:06.093 INFO:tasks.workunit.client.0.smithi079.stdout:3/542: chown d4/da/d17/d2d/d43/d49/f6f 1800143161 1 2024-09-10T09:36:06.093 INFO:tasks.workunit.client.0.smithi079.stdout:3/543: stat d4/da/d17/d2d/f76 0 2024-09-10T09:36:06.093 INFO:tasks.workunit.client.0.smithi079.stdout:3/544: creat d4/da/d17/d2d/d43/d4c/f9d x:0 0 0 2024-09-10T09:36:06.094 INFO:tasks.workunit.client.0.smithi079.stdout:1/587: dwrite d5/d24/d36/d3a/d48/fa3 [0,4194304] 0 2024-09-10T09:36:06.094 INFO:tasks.workunit.client.0.smithi079.stdout:1/588: chown d5/d24/d36/d3a/d3c/da0/d6e 180345400 1 2024-09-10T09:36:06.094 INFO:tasks.workunit.client.0.smithi079.stdout:1/589: fsync d5/df/f34 0 2024-09-10T09:36:06.094 INFO:tasks.workunit.client.0.smithi079.stdout:1/590: read d5/d24/d36/d3a/d3c/f64 [671888,126088] 0 2024-09-10T09:36:06.094 INFO:tasks.workunit.client.0.smithi079.stdout:1/591: creat d5/d24/d36/d3a/d3c/d57/fb9 x:0 0 0 2024-09-10T09:36:06.097 INFO:tasks.workunit.client.0.smithi079.stdout:3/545: creat d4/d7a/f9e x:0 0 0 2024-09-10T09:36:06.098 INFO:tasks.workunit.client.0.smithi079.stdout:9/459: dwrite d3/d7/dc/f36 [0,4194304] 0 2024-09-10T09:36:06.101 INFO:tasks.workunit.client.0.smithi079.stdout:1/592: link d5/d40/faa d5/d24/fba 0 2024-09-10T09:36:06.103 INFO:tasks.workunit.client.0.smithi079.stdout:9/460: rename c0 to d3/d7/dc/de/d17/d2f/c90 0 2024-09-10T09:36:06.105 INFO:tasks.workunit.client.0.smithi079.stdout:3/546: getdents d4/da/d17/d2d/d43 0 2024-09-10T09:36:06.105 INFO:tasks.workunit.client.0.smithi079.stdout:3/547: read f2 [6560922,72072] 0 2024-09-10T09:36:06.106 INFO:tasks.workunit.client.0.smithi079.stdout:1/593: creat d5/df/da7/fbb x:0 0 0 2024-09-10T09:36:06.107 INFO:tasks.workunit.client.0.smithi079.stdout:9/461: link d3/d7/dc/de/d58/l67 d3/d7/d70/l91 0 2024-09-10T09:36:06.107 INFO:tasks.workunit.client.0.smithi079.stdout:9/462: fsync d3/d7/dc/de/d17/d2f/d30/f56 0 2024-09-10T09:36:06.108 INFO:tasks.workunit.client.0.smithi079.stdout:4/500: write d1/da/d16/d21/f25 [2403904,119793] 0 2024-09-10T09:36:06.108 INFO:tasks.workunit.client.0.smithi079.stdout:4/501: write d1/da/f7b [826739,62125] 0 2024-09-10T09:36:06.108 INFO:tasks.workunit.client.0.smithi079.stdout:3/548: rename d4/da/d17/c3c to d4/da/d8a/c9f 0 2024-09-10T09:36:06.108 INFO:tasks.workunit.client.0.smithi079.stdout:3/549: creat d4/da/d17/d62/fa0 x:0 0 0 2024-09-10T09:36:06.108 INFO:tasks.workunit.client.0.smithi079.stdout:3/550: write d4/da/d17/d38/d42/f7e [322099,114835] 0 2024-09-10T09:36:06.109 INFO:tasks.workunit.client.0.smithi079.stdout:3/551: dread d4/da/d17/d2d/d43/f74 [0,4194304] 0 2024-09-10T09:36:06.109 INFO:tasks.workunit.client.0.smithi079.stdout:3/552: read f2 [2851754,32944] 0 2024-09-10T09:36:06.109 INFO:tasks.workunit.client.0.smithi079.stdout:8/508: dwrite d11/f1d [0,4194304] 0 2024-09-10T09:36:06.109 INFO:tasks.workunit.client.0.smithi079.stdout:2/431: dwrite d4/f6 [4194304,4194304] 0 2024-09-10T09:36:06.109 INFO:tasks.workunit.client.0.smithi079.stdout:0/499: dwrite d4/d12/d21/f2c [0,4194304] 0 2024-09-10T09:36:06.109 INFO:tasks.workunit.client.0.smithi079.stdout:0/500: write d4/d12/d16/d53/f6c [5108111,34510] 0 2024-09-10T09:36:06.110 INFO:tasks.workunit.client.0.smithi079.stdout:4/502: mkdir d1/d9b 0 2024-09-10T09:36:06.110 INFO:tasks.workunit.client.0.smithi079.stdout:4/503: fdatasync d1/f2e 0 2024-09-10T09:36:06.111 INFO:tasks.workunit.client.0.smithi079.stdout:7/480: dwrite d4/dc/f32 [0,4194304] 0 2024-09-10T09:36:06.111 INFO:tasks.workunit.client.0.smithi079.stdout:7/481: stat d4/dc/d43/c5b 0 2024-09-10T09:36:06.114 INFO:tasks.workunit.client.0.smithi079.stdout:9/463: getdents d3/d7/dc/de/d17 0 2024-09-10T09:36:06.114 INFO:tasks.workunit.client.0.smithi079.stdout:9/464: fdatasync d3/d7/dc/de/d17/d2f/d30/f56 0 2024-09-10T09:36:06.114 INFO:tasks.workunit.client.0.smithi079.stdout:6/558: dwrite d4/d8/fa [0,4194304] 0 2024-09-10T09:36:06.115 INFO:tasks.workunit.client.0.smithi079.stdout:6/559: fdatasync d4/d8/dc/fe 0 2024-09-10T09:36:06.119 INFO:tasks.workunit.client.0.smithi079.stdout:1/594: dread d5/df/d2e/f39 [0,4194304] 0 2024-09-10T09:36:06.119 INFO:tasks.workunit.client.0.smithi079.stdout:1/595: readlink d5/df/d11/l1f 0 2024-09-10T09:36:06.120 INFO:tasks.workunit.client.0.smithi079.stdout:1/596: chown d5/d24/f2f 14636 1 2024-09-10T09:36:06.120 INFO:tasks.workunit.client.0.smithi079.stdout:8/509: mkdir d11/d2b/d4b/da8 0 2024-09-10T09:36:06.121 INFO:tasks.workunit.client.0.smithi079.stdout:0/501: creat d4/d12/d15/d69/fa8 x:0 0 0 2024-09-10T09:36:06.123 INFO:tasks.workunit.client.0.smithi079.stdout:4/504: symlink d1/da/d3b/l9c 0 2024-09-10T09:36:06.123 INFO:tasks.workunit.client.0.smithi079.stdout:2/432: read d4/dc/f14 [3901987,120567] 0 2024-09-10T09:36:06.132 INFO:tasks.workunit.client.0.smithi079.stdout:7/482: rename d4/d6/c71 to d4/df/d3d/d75/c91 0 2024-09-10T09:36:06.132 INFO:tasks.workunit.client.0.smithi079.stdout:7/483: write d4/d6/d3e/f7a [667374,61810] 0 2024-09-10T09:36:06.132 INFO:tasks.workunit.client.0.smithi079.stdout:7/484: write d4/df/f68 [625650,70875] 0 2024-09-10T09:36:06.132 INFO:tasks.workunit.client.0.smithi079.stdout:7/485: chown d4/dc/c3c 1634624524 1 2024-09-10T09:36:06.132 INFO:tasks.workunit.client.0.smithi079.stdout:7/486: creat d4/dc/f92 x:0 0 0 2024-09-10T09:36:06.132 INFO:tasks.workunit.client.0.smithi079.stdout:3/553: getdents d4/da/d56 0 2024-09-10T09:36:06.135 INFO:tasks.workunit.client.0.smithi079.stdout:9/465: creat d3/d7/dc/de/d17/d6e/f92 x:0 0 0 2024-09-10T09:36:06.138 INFO:tasks.workunit.client.0.smithi079.stdout:6/560: truncate d4/d8/dd/d41/f56 2882087 0 2024-09-10T09:36:06.138 INFO:tasks.workunit.client.0.smithi079.stdout:6/561: fsync d4/d8/dc/d12/d29/f31 0 2024-09-10T09:36:06.139 INFO:tasks.workunit.client.0.smithi079.stdout:6/562: fdatasync d4/d8/dd/d41/d51/f5b 0 2024-09-10T09:36:06.141 INFO:tasks.workunit.client.0.smithi079.stdout:8/510: mknod d11/d2b/d4b/d50/ca9 0 2024-09-10T09:36:06.141 INFO:tasks.workunit.client.0.smithi079.stdout:9/466: dread d3/f2b [0,4194304] 0 2024-09-10T09:36:06.141 INFO:tasks.workunit.client.0.smithi079.stdout:4/505: getdents d1/da/d28/d95 0 2024-09-10T09:36:06.145 INFO:tasks.workunit.client.0.smithi079.stdout:2/433: dwrite d4/dc/d1c/f34 [0,4194304] 0 2024-09-10T09:36:06.145 INFO:tasks.workunit.client.0.smithi079.stdout:2/434: read d4/dc/d13/f27 [392437,106338] 0 2024-09-10T09:36:06.147 INFO:tasks.workunit.client.0.smithi079.stdout:6/563: write d4/d8/dd/d41/f54 [2745763,90718] 0 2024-09-10T09:36:06.149 INFO:tasks.workunit.client.0.smithi079.stdout:1/597: rename d5/df/d2e/f83 to d5/d24/d36/d53/db3/fbc 0 2024-09-10T09:36:06.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/487: symlink d4/l93 0 2024-09-10T09:36:06.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/488: write d4/f61 [5049871,13561] 0 2024-09-10T09:36:06.151 INFO:tasks.workunit.client.0.smithi079.stdout:3/554: unlink d4/da/c27 0 2024-09-10T09:36:06.153 INFO:tasks.workunit.client.0.smithi079.stdout:9/467: unlink d3/d7/d26/d3d/f7c 0 2024-09-10T09:36:06.153 INFO:tasks.workunit.client.0.smithi079.stdout:9/468: fsync d3/d40/f4e 0 2024-09-10T09:36:06.154 INFO:tasks.workunit.client.0.smithi079.stdout:4/506: symlink d1/da/d28/d99/l9d 0 2024-09-10T09:36:06.154 INFO:tasks.workunit.client.0.smithi079.stdout:4/507: fsync d1/da/f7b 0 2024-09-10T09:36:06.164 INFO:tasks.workunit.client.0.smithi079.stdout:6/564: creat d4/d8/dc/d12/d9d/fbb x:0 0 0 2024-09-10T09:36:06.167 INFO:tasks.workunit.client.0.smithi079.stdout:8/511: rename d11/d48/l84 to d11/d2b/d4b/d74/da2/laa 0 2024-09-10T09:36:06.167 INFO:tasks.workunit.client.0.smithi079.stdout:1/598: dwrite d5/df/d11/fb6 [0,4194304] 0 2024-09-10T09:36:06.171 INFO:tasks.workunit.client.0.smithi079.stdout:7/489: creat d4/df/d3d/d82/f94 x:0 0 0 2024-09-10T09:36:06.172 INFO:tasks.workunit.client.0.smithi079.stdout:3/555: unlink d4/da/d17/c51 0 2024-09-10T09:36:06.179 INFO:tasks.workunit.client.0.smithi079.stdout:1/599: truncate d5/d24/d36/d53/db3/fbc 649460 0 2024-09-10T09:36:06.183 INFO:tasks.workunit.client.0.smithi079.stdout:4/508: dwrite d1/da/d16/f26 [0,4194304] 0 2024-09-10T09:36:06.184 INFO:tasks.workunit.client.0.smithi079.stdout:2/435: rename d4/dc/d29 to d4/dc/d1c/d86 0 2024-09-10T09:36:06.187 INFO:tasks.workunit.client.0.smithi079.stdout:1/600: creat d5/d4f/d95/fbd x:0 0 0 2024-09-10T09:36:06.187 INFO:tasks.workunit.client.0.smithi079.stdout:1/601: readlink d5/df/d11/l30 0 2024-09-10T09:36:06.189 INFO:tasks.workunit.client.0.smithi079.stdout:7/490: getdents d4/d6/d4f 0 2024-09-10T09:36:06.192 INFO:tasks.workunit.client.0.smithi079.stdout:2/436: rmdir d4/dc/d1c/d86/d1b/d38/d39/d31/d52 39 2024-09-10T09:36:06.194 INFO:tasks.workunit.client.0.smithi079.stdout:1/602: symlink d5/d4f/d8a/lbe 0 2024-09-10T09:36:06.195 INFO:tasks.workunit.client.0.smithi079.stdout:2/437: truncate d4/dc/d1c/d59/f4a 305972 0 2024-09-10T09:36:06.195 INFO:tasks.workunit.client.0.smithi079.stdout:2/438: dread - d4/f7a zero size 2024-09-10T09:36:06.204 INFO:tasks.workunit.client.0.smithi079.stdout:8/512: dwrite d11/d2b/d4b/f6b [0,4194304] 0 2024-09-10T09:36:06.204 INFO:tasks.workunit.client.0.smithi079.stdout:8/513: fdatasync d11/f12 0 2024-09-10T09:36:06.204 INFO:tasks.workunit.client.0.smithi079.stdout:1/603: write d5/d24/d36/d3a/fb5 [2973582,115823] 0 2024-09-10T09:36:06.204 INFO:tasks.workunit.client.0.smithi079.stdout:6/565: dwrite d4/d8/dc/d12/d70/f84 [0,4194304] 0 2024-09-10T09:36:06.207 INFO:tasks.workunit.client.0.smithi079.stdout:4/509: read d1/da/d16/f26 [3251149,130769] 0 2024-09-10T09:36:06.208 INFO:tasks.workunit.client.0.smithi079.stdout:3/556: dwrite d4/da/d18/f48 [0,4194304] 0 2024-09-10T09:36:06.208 INFO:tasks.workunit.client.0.smithi079.stdout:3/557: chown d4/da/d17/d38/d42/f84 101211 1 2024-09-10T09:36:06.208 INFO:tasks.workunit.client.0.smithi079.stdout:8/514: mknod d11/d2b/d4b/d74/cab 0 2024-09-10T09:36:06.208 INFO:tasks.workunit.client.0.smithi079.stdout:8/515: chown d11/c59 45 1 2024-09-10T09:36:06.208 INFO:tasks.workunit.client.0.smithi079.stdout:8/516: write d11/d2b/d4b/d74/f7a [214235,33117] 0 2024-09-10T09:36:06.209 INFO:tasks.workunit.client.0.smithi079.stdout:1/604: creat d5/d40/dac/db2/fbf x:0 0 0 2024-09-10T09:36:06.210 INFO:tasks.workunit.client.0.smithi079.stdout:1/605: chown d5/df/f34 11853 1 2024-09-10T09:36:06.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.211+0000 7f01840a2700 1 -- 172.21.15.79:0/1641118550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c100350 msgr2=0x7f017c1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:06.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.211+0000 7f01840a2700 1 --2- 172.21.15.79:0/1641118550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c100350 0x7f017c1007a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f016c009910 tx=0x7f016c009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:06.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.211+0000 7f01840a2700 1 -- 172.21.15.79:0/1641118550 shutdown_connections 2024-09-10T09:36:06.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.211+0000 7f01840a2700 1 --2- 172.21.15.79:0/1641118550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c100350 0x7f017c1007a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.211+0000 7f01840a2700 1 --2- 172.21.15.79:0/1641118550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f017c0ff150 0x7f017c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.211+0000 7f01840a2700 1 -- 172.21.15.79:0/1641118550 >> 172.21.15.79:0/1641118550 conn(0x7f017c0fa700 msgr2=0x7f017c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:06.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.211+0000 7f01840a2700 1 -- 172.21.15.79:0/1641118550 shutdown_connections 2024-09-10T09:36:06.213 INFO:tasks.workunit.client.0.smithi079.stdout:6/566: creat d4/d8/dc/d12/d29/db5/fbc x:0 0 0 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.212+0000 7f01840a2700 1 -- 172.21.15.79:0/1641118550 wait complete. 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.212+0000 7f01840a2700 1 Processor -- start 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.212+0000 7f01840a2700 1 -- start start 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f01840a2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c0ff150 0x7f017c1030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f01840a2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f017c100350 0x7f017c101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f01840a2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c101c70 con 0x7f017c0ff150 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f01840a2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c101db0 con 0x7f017c100350 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f0181e3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c0ff150 0x7f017c1030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f0181e3e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c0ff150 0x7f017c1030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49296/0 (socket says 172.21.15.79:49296) 2024-09-10T09:36:06.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f0181e3e700 1 -- 172.21.15.79:0/3004149052 learned_addr learned my addr 172.21.15.79:0/3004149052 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f018163d700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f017c100350 0x7f017c101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f0181e3e700 1 -- 172.21.15.79:0/3004149052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f017c100350 msgr2=0x7f017c101730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f0181e3e700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f017c100350 0x7f017c101730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f0181e3e700 1 -- 172.21.15.79:0/3004149052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0095f0 con 0x7f017c0ff150 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.213+0000 7f0181e3e700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c0ff150 0x7f017c1030e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f017800d900 tx=0x7f017800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.214+0000 7f0172ffd700 1 -- 172.21.15.79:0/3004149052 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01780041f0 con 0x7f017c0ff150 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.214+0000 7f0172ffd700 1 -- 172.21.15.79:0/3004149052 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0178004350 con 0x7f017c0ff150 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.214+0000 7f0172ffd700 1 -- 172.21.15.79:0/3004149052 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0178003d20 con 0x7f017c0ff150 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.214+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c102090 con 0x7f017c0ff150 2024-09-10T09:36:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.214+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c19db00 con 0x7f017c0ff150 2024-09-10T09:36:06.217 INFO:tasks.workunit.client.0.smithi079.stdout:4/510: write d1/da/f2b [202687,36712] 0 2024-09-10T09:36:06.217 INFO:tasks.workunit.client.0.smithi079.stdout:7/491: dwrite d4/df/d3d/f41 [0,4194304] 0 2024-09-10T09:36:06.217 INFO:tasks.workunit.client.0.smithi079.stdout:4/511: creat d1/da/d16/d21/f9e x:0 0 0 2024-09-10T09:36:06.217 INFO:tasks.workunit.client.0.smithi079.stdout:7/492: write d4/d6/d38/f54 [98782,83823] 0 2024-09-10T09:36:06.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.215+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c107ca0 con 0x7f017c0ff150 2024-09-10T09:36:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.215+0000 7f0172ffd700 1 -- 172.21.15.79:0/3004149052 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) v1 ==== 89914+0+0 (secure 0 0 0) 0x7f0178010460 con 0x7f017c0ff150 2024-09-10T09:36:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.216+0000 7f0172ffd700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f016806c680 0x7f016806eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:06.218 INFO:tasks.workunit.client.0.smithi079.stdout:3/558: rename d4/da/d56/f6b to d4/da/d17/d2d/fa1 0 2024-09-10T09:36:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.216+0000 7f0172ffd700 1 -- 172.21.15.79:0/3004149052 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f017808b6d0 con 0x7f017c0ff150 2024-09-10T09:36:06.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.216+0000 7f018163d700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f016806c680 0x7f016806eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.216+0000 7f018163d700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f016806c680 0x7f016806eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f016c006010 tx=0x7f016c00b540 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:06.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:05 smithi135 ceph-mon[33411]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:06.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:05 smithi135 ceph-mon[33411]: pgmap v257: 65 pgs: 65 active+clean; 925 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 96 MiB/s rd, 114 MiB/s wr, 619 op/s 2024-09-10T09:36:06.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:05 smithi135 ceph-mon[33411]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:06.219 INFO:tasks.workunit.client.0.smithi079.stdout:1/606: truncate d5/d24/d36/d3a/d3c/d57/fa8 643191 0 2024-09-10T09:36:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.221+0000 7f0172ffd700 1 -- 172.21.15.79:0/3004149052 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+177933 (secure 0 0 0) 0x7f01780598b0 con 0x7f017c0ff150 2024-09-10T09:36:06.222 INFO:tasks.workunit.client.0.smithi079.stdout:6/567: mknod d4/d8/dd/d76/d46/d88/cbd 0 2024-09-10T09:36:06.225 INFO:tasks.workunit.client.0.smithi079.stdout:8/517: dread d11/d2b/f4c [0,4194304] 0 2024-09-10T09:36:06.231 INFO:tasks.workunit.client.0.smithi079.stdout:4/512: creat d1/da/d16/d4d/f9f x:0 0 0 2024-09-10T09:36:06.234 INFO:tasks.workunit.client.0.smithi079.stdout:7/493: rename d4/df/d3d/d75/c91 to d4/d6/d4f/c95 0 2024-09-10T09:36:06.236 INFO:tasks.workunit.client.0.smithi079.stdout:3/559: creat d4/da/d17/fa2 x:0 0 0 2024-09-10T09:36:06.237 INFO:tasks.workunit.client.0.smithi079.stdout:1/607: unlink d5/d40/l8b 0 2024-09-10T09:36:06.239 INFO:tasks.workunit.client.0.smithi079.stdout:8/518: truncate d11/d3b/f64 37513 0 2024-09-10T09:36:06.241 INFO:tasks.workunit.client.0.smithi079.stdout:4/513: link d1/da/d28/d47/d52/l86 d1/da/d28/d99/la0 0 2024-09-10T09:36:06.241 INFO:tasks.workunit.client.0.smithi079.stdout:4/514: dread - d1/da/d16/d21/f9e zero size 2024-09-10T09:36:06.243 INFO:tasks.workunit.client.0.smithi079.stdout:3/560: creat d4/da/d17/d9b/fa3 x:0 0 0 2024-09-10T09:36:06.244 INFO:tasks.workunit.client.0.smithi079.stdout:3/561: creat d4/da/d17/fa4 x:0 0 0 2024-09-10T09:36:06.244 INFO:tasks.workunit.client.0.smithi079.stdout:3/562: readlink d4/da/l6e 0 2024-09-10T09:36:06.244 INFO:tasks.workunit.client.0.smithi079.stdout:6/568: dwrite d4/d8/dd/f1b [0,4194304] 0 2024-09-10T09:36:06.244 INFO:tasks.workunit.client.0.smithi079.stdout:3/563: read d4/da/d17/d38/d42/f7e [98351,43653] 0 2024-09-10T09:36:06.245 INFO:tasks.workunit.client.0.smithi079.stdout:1/608: creat d5/d9e/fc0 x:0 0 0 2024-09-10T09:36:06.246 INFO:tasks.workunit.client.0.smithi079.stdout:8/519: chown d11/d2b/c42 399941 1 2024-09-10T09:36:06.246 INFO:tasks.workunit.client.0.smithi079.stdout:8/520: truncate d11/f2a 1226471 0 2024-09-10T09:36:06.249 INFO:tasks.workunit.client.0.smithi079.stdout:7/494: rmdir d4/dc 39 2024-09-10T09:36:06.249 INFO:tasks.workunit.client.0.smithi079.stdout:7/495: dread - d4/df/d3d/d82/f94 zero size 2024-09-10T09:36:06.252 INFO:tasks.workunit.client.0.smithi079.stdout:3/564: creat d4/da/fa5 x:0 0 0 2024-09-10T09:36:06.253 INFO:tasks.workunit.client.0.smithi079.stdout:1/609: creat d5/d40/fc1 x:0 0 0 2024-09-10T09:36:06.253 INFO:tasks.workunit.client.0.smithi079.stdout:1/610: stat d5/df/da7 0 2024-09-10T09:36:06.256 INFO:tasks.workunit.client.0.smithi079.stdout:3/565: dread d4/da/f57 [0,4194304] 0 2024-09-10T09:36:06.257 INFO:tasks.workunit.client.0.smithi079.stdout:3/566: write d4/da/f6c [2628238,48408] 0 2024-09-10T09:36:06.258 INFO:tasks.workunit.client.0.smithi079.stdout:3/567: dread d4/da/d17/d38/d42/f84 [0,4194304] 0 2024-09-10T09:36:06.258 INFO:tasks.workunit.client.0.smithi079.stdout:3/568: creat d4/d7a/fa6 x:0 0 0 2024-09-10T09:36:06.259 INFO:tasks.workunit.client.0.smithi079.stdout:3/569: truncate d4/da/d56/f5e 1095105 0 2024-09-10T09:36:06.259 INFO:tasks.workunit.client.0.smithi079.stdout:3/570: write d4/da/d17/d9b/fa3 [586506,52336] 0 2024-09-10T09:36:06.259 INFO:tasks.workunit.client.0.smithi079.stdout:3/571: creat d4/da/d17/d2d/d43/d49/fa7 x:0 0 0 2024-09-10T09:36:06.259 INFO:tasks.workunit.client.0.smithi079.stdout:3/572: stat d4/da/d17/d38/d42/f7e 0 2024-09-10T09:36:06.260 INFO:tasks.workunit.client.0.smithi079.stdout:7/496: mknod d4/dc/d43/c96 0 2024-09-10T09:36:06.260 INFO:tasks.workunit.client.0.smithi079.stdout:7/497: fsync d4/f61 0 2024-09-10T09:36:06.260 INFO:tasks.workunit.client.0.smithi079.stdout:7/498: dread - d4/d6/d3e/f85 zero size 2024-09-10T09:36:06.260 INFO:tasks.workunit.client.0.smithi079.stdout:1/611: creat d5/df/d11/d76/dad/fc2 x:0 0 0 2024-09-10T09:36:06.265 INFO:tasks.workunit.client.0.smithi079.stdout:3/573: getdents d4 0 2024-09-10T09:36:06.267 INFO:tasks.workunit.client.0.smithi079.stdout:1/612: creat d5/fc3 x:0 0 0 2024-09-10T09:36:06.269 INFO:tasks.workunit.client.0.smithi079.stdout:7/499: getdents d4/df/d3d 0 2024-09-10T09:36:06.270 INFO:tasks.workunit.client.0.smithi079.stdout:7/500: dread - d4/df/d6b/f8e zero size 2024-09-10T09:36:06.270 INFO:tasks.workunit.client.0.smithi079.stdout:8/521: dwrite d11/f1d [0,4194304] 0 2024-09-10T09:36:06.270 INFO:tasks.workunit.client.0.smithi079.stdout:8/522: chown d11/d48/c54 9404 1 2024-09-10T09:36:06.270 INFO:tasks.workunit.client.0.smithi079.stdout:8/523: chown d11/d2b/d4b/d50/d9e 25902 1 2024-09-10T09:36:06.270 INFO:tasks.workunit.client.0.smithi079.stdout:1/613: creat d5/d24/d36/d3a/d85/fc4 x:0 0 0 2024-09-10T09:36:06.273 INFO:tasks.workunit.client.0.smithi079.stdout:8/524: mkdir d11/d2b/d4b/d7e/da7/dac 0 2024-09-10T09:36:06.273 INFO:tasks.workunit.client.0.smithi079.stdout:8/525: write d11/d2b/d4b/d74/f7c [5022604,33555] 0 2024-09-10T09:36:06.273 INFO:tasks.workunit.client.0.smithi079.stdout:8/526: truncate d11/d2b/d4b/d74/f83 1433039 0 2024-09-10T09:36:06.274 INFO:tasks.workunit.client.0.smithi079.stdout:1/614: mkdir d5/d24/d36/d3a/d3c/da0/d6e/dc5 0 2024-09-10T09:36:06.278 INFO:tasks.workunit.client.0.smithi079.stdout:4/515: rename d1/da/d28/d47/d52 to d1/da/d28/d47/da1 0 2024-09-10T09:36:06.279 INFO:tasks.workunit.client.0.smithi079.stdout:8/527: unlink d11/d2b/d4b/d74/da2/laa 0 2024-09-10T09:36:06.280 INFO:tasks.workunit.client.0.smithi079.stdout:1/615: mkdir d5/df/dc6 0 2024-09-10T09:36:06.284 INFO:tasks.workunit.client.0.smithi079.stdout:1/616: creat d5/d24/d36/d3a/d3c/da0/fc7 x:0 0 0 2024-09-10T09:36:06.285 INFO:tasks.workunit.client.0.smithi079.stdout:4/516: getdents d1/da 0 2024-09-10T09:36:06.286 INFO:tasks.workunit.client.0.smithi079.stdout:8/528: link d11/d2b/f41 d11/d2b/fad 0 2024-09-10T09:36:06.286 INFO:tasks.workunit.client.0.smithi079.stdout:8/529: chown d11/d91/l9a 255763537 1 2024-09-10T09:36:06.289 INFO:tasks.workunit.client.0.smithi079.stdout:4/517: truncate d1/da/d28/f29 1904720 0 2024-09-10T09:36:06.289 INFO:tasks.workunit.client.0.smithi079.stdout:4/518: write d1/da/d28/d95/f8d [487006,68507] 0 2024-09-10T09:36:06.290 INFO:tasks.workunit.client.0.smithi079.stdout:7/501: dwrite d4/dc/f17 [0,4194304] 0 2024-09-10T09:36:06.291 INFO:tasks.workunit.client.0.smithi079.stdout:4/519: creat d1/da/d28/fa2 x:0 0 0 2024-09-10T09:36:06.292 INFO:tasks.workunit.client.0.smithi079.stdout:4/520: chown d1/f7 1 1 2024-09-10T09:36:06.292 INFO:tasks.workunit.client.0.smithi079.stdout:4/521: fsync d1/da/d16/f1f 0 2024-09-10T09:36:06.293 INFO:tasks.workunit.client.0.smithi079.stdout:5/496: sync 2024-09-10T09:36:06.293 INFO:tasks.workunit.client.0.smithi079.stdout:5/497: fdatasync d2/d3/d5e/d61/f6c 0 2024-09-10T09:36:06.296 INFO:tasks.workunit.client.0.smithi079.stdout:7/502: unlink d4/df/c1b 0 2024-09-10T09:36:06.299 INFO:tasks.workunit.client.0.smithi079.stdout:5/498: link d2/d3/d5e/d61/f6c d2/d3/d5e/d61/d71/fa9 0 2024-09-10T09:36:06.341 INFO:tasks.workunit.client.0.smithi079.stdout:1/617: dwrite d5/d24/d36/d3a/d3c/f9c [0,4194304] 0 2024-09-10T09:36:06.346 INFO:tasks.workunit.client.0.smithi079.stdout:1/618: dread d5/d4f/f73 [0,4194304] 0 2024-09-10T09:36:06.347 INFO:tasks.workunit.client.0.smithi079.stdout:1/619: chown d5/df/d2e/c7e 0 1 2024-09-10T09:36:06.352 INFO:tasks.workunit.client.0.smithi079.stdout:5/499: write d2/d3/d5e/d73/f7a [2587929,106343] 0 2024-09-10T09:36:06.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.454+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 --> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f017c19e0b0 con 0x7f016806c680 2024-09-10T09:36:06.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.456+0000 7f0172ffd700 1 -- 172.21.15.79:0/3004149052 <== mgr.14213 v2:172.21.15.79:6800/2 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f017c19e0b0 con 0x7f016806c680 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [], 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "", 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:36:06.457 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:36:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f016806c680 msgr2=0x7f016806eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f016806c680 0x7f016806eb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f016c006010 tx=0x7f016c00b540 comp rx=0 tx=0).stop 2024-09-10T09:36:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c0ff150 msgr2=0x7f017c1030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c0ff150 0x7f017c1030e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f017800d900 tx=0x7f017800dc10 comp rx=0 tx=0).stop 2024-09-10T09:36:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 shutdown_connections 2024-09-10T09:36:06.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:6800/2,v1:172.21.15.79:6801/2] conn(0x7f016806c680 0x7f016806eb30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017c0ff150 0x7f017c1030e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 --2- 172.21.15.79:0/3004149052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f017c100350 0x7f017c101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 >> 172.21.15.79:0/3004149052 conn(0x7f017c0fa700 msgr2=0x7f017c068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 shutdown_connections 2024-09-10T09:36:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:06.458+0000 7f01840a2700 1 -- 172.21.15.79:0/3004149052 wait complete. 2024-09-10T09:36:06.538 INFO:tasks.workunit.client.0.smithi079.stdout:5/500: creat d2/d3/d27/faa x:0 0 0 2024-09-10T09:36:06.542 INFO:tasks.workunit.client.0.smithi079.stdout:5/501: rename d2/d3/d27/d32/f75 to d2/fab 0 2024-09-10T09:36:06.542 INFO:tasks.workunit.client.0.smithi079.stdout:5/502: truncate d2/d3/f83 281877 0 2024-09-10T09:36:06.544 INFO:tasks.workunit.client.0.smithi079.stdout:5/503: symlink d2/d3/d27/d32/d44/lac 0 2024-09-10T09:36:06.544 INFO:tasks.workunit.client.0.smithi079.stdout:5/504: chown d2/d41/c64 460691277 1 2024-09-10T09:36:06.544 INFO:tasks.workunit.client.0.smithi079.stdout:5/505: chown d2/d3/f28 17701 1 2024-09-10T09:36:06.544 INFO:tasks.workunit.client.0.smithi079.stdout:5/506: chown d2/d3/d27/d32/f9d 4947685 1 2024-09-10T09:36:06.544 INFO:tasks.workunit.client.0.smithi079.stdout:5/507: truncate d2/d3/d27/faa 394134 0 2024-09-10T09:36:06.544 INFO:tasks.workunit.client.0.smithi079.stdout:5/508: creat d2/d3/d27/d70/d80/fad x:0 0 0 2024-09-10T09:36:06.544 INFO:tasks.workunit.client.0.smithi079.stdout:5/509: chown d2/f31 996 1 2024-09-10T09:36:06.548 INFO:tasks.workunit.client.0.smithi079.stdout:4/522: dwrite d1/f2a [4194304,4194304] 0 2024-09-10T09:36:06.549 INFO:tasks.workunit.client.0.smithi079.stdout:7/503: dwrite d4/d6/d38/f67 [0,4194304] 0 2024-09-10T09:36:06.549 INFO:tasks.workunit.client.0.smithi079.stdout:1/620: dwrite d5/d24/d36/d3a/d3c/f5e [0,4194304] 0 2024-09-10T09:36:06.551 INFO:tasks.workunit.client.0.smithi079.stdout:4/523: rename d1/f7 to d1/da/d16/d88/fa3 0 2024-09-10T09:36:06.562 INFO:tasks.workunit.client.0.smithi079.stdout:7/504: creat d4/df/d3d/d75/f97 x:0 0 0 2024-09-10T09:36:06.564 INFO:tasks.workunit.client.0.smithi079.stdout:7/505: chown d4/df/d19/l44 0 1 2024-09-10T09:36:06.564 INFO:tasks.workunit.client.0.smithi079.stdout:7/506: chown d4/dc/f73 166178821 1 2024-09-10T09:36:06.564 INFO:tasks.workunit.client.0.smithi079.stdout:7/507: creat d4/df/d3d/d75/f98 x:0 0 0 2024-09-10T09:36:06.567 INFO:tasks.workunit.client.0.smithi079.stdout:4/524: dwrite d1/da/d3b/d5f/f76 [0,4194304] 0 2024-09-10T09:36:06.570 INFO:tasks.workunit.client.0.smithi079.stdout:5/510: dwrite d2/d3/d27/f87 [0,4194304] 0 2024-09-10T09:36:06.570 INFO:tasks.workunit.client.0.smithi079.stdout:1/621: truncate d5/d24/d36/d3a/d3c/f9c 1370939 0 2024-09-10T09:36:06.572 INFO:tasks.workunit.client.0.smithi079.stdout:4/525: mknod d1/da/d16/d88/ca4 0 2024-09-10T09:36:06.576 INFO:tasks.workunit.client.0.smithi079.stdout:5/511: creat d2/d3/d5e/d61/fae x:0 0 0 2024-09-10T09:36:06.578 INFO:tasks.workunit.client.0.smithi079.stdout:4/526: mkdir d1/d38/da5 0 2024-09-10T09:36:06.581 INFO:tasks.workunit.client.0.smithi079.stdout:1/622: getdents d5/d24/d36/d3a/d48 0 2024-09-10T09:36:06.582 INFO:tasks.workunit.client.0.smithi079.stdout:7/508: dwrite d4/df/d6b/f8a [4194304,4194304] 0 2024-09-10T09:36:06.583 INFO:tasks.workunit.client.0.smithi079.stdout:1/623: symlink d5/d24/d36/d3a/d3c/d57/d8c/lc8 0 2024-09-10T09:36:06.584 INFO:tasks.workunit.client.0.smithi079.stdout:4/527: read d1/da/d3b/d5a/f78 [3290959,69189] 0 2024-09-10T09:36:06.590 INFO:tasks.workunit.client.0.smithi079.stdout:7/509: creat d4/d6/f99 x:0 0 0 2024-09-10T09:36:06.590 INFO:tasks.workunit.client.0.smithi079.stdout:7/510: write d4/df/d3d/d82/f5c [104739,63713] 0 2024-09-10T09:36:06.591 INFO:tasks.workunit.client.0.smithi079.stdout:0/502: sync 2024-09-10T09:36:06.592 INFO:tasks.workunit.client.0.smithi079.stdout:4/528: creat d1/da/d28/d47/da1/d83/fa6 x:0 0 0 2024-09-10T09:36:06.592 INFO:tasks.workunit.client.0.smithi079.stdout:4/529: dread - d1/da/d16/d4d/f9f zero size 2024-09-10T09:36:06.595 INFO:tasks.workunit.client.0.smithi079.stdout:4/530: symlink d1/da/d28/d47/da1/d83/la7 0 2024-09-10T09:36:06.597 INFO:tasks.workunit.client.0.smithi079.stdout:0/503: getdents d4/d12/d39 0 2024-09-10T09:36:06.600 INFO:tasks.workunit.client.0.smithi079.stdout:5/512: dwrite d2/d3/d27/d32/d44/f7c [0,4194304] 0 2024-09-10T09:36:06.601 INFO:tasks.workunit.client.0.smithi079.stdout:0/504: creat d4/d1d/d24/fa9 x:0 0 0 2024-09-10T09:36:06.601 INFO:tasks.workunit.client.0.smithi079.stdout:0/505: chown d4/d12/d15/d2b/c34 211 1 2024-09-10T09:36:06.605 INFO:tasks.workunit.client.0.smithi079.stdout:1/624: dread d5/d24/d36/d3a/d48/fa3 [0,4194304] 0 2024-09-10T09:36:06.605 INFO:tasks.workunit.client.0.smithi079.stdout:5/513: symlink d2/d3/d5e/d61/laf 0 2024-09-10T09:36:06.605 INFO:tasks.workunit.client.0.smithi079.stdout:5/514: fsync d2/d3/fe 0 2024-09-10T09:36:06.605 INFO:tasks.workunit.client.0.smithi079.stdout:5/515: creat d2/d3/d5e/d61/fb0 x:0 0 0 2024-09-10T09:36:06.606 INFO:tasks.workunit.client.0.smithi079.stdout:0/506: mkdir d4/d12/d15/d6b/daa 0 2024-09-10T09:36:06.608 INFO:tasks.workunit.client.0.smithi079.stdout:1/625: mkdir d5/d9e/dc9 0 2024-09-10T09:36:06.608 INFO:tasks.workunit.client.0.smithi079.stdout:9/469: sync 2024-09-10T09:36:06.608 INFO:tasks.workunit.client.0.smithi079.stdout:2/439: sync 2024-09-10T09:36:06.608 INFO:tasks.workunit.client.0.smithi079.stdout:3/574: sync 2024-09-10T09:36:06.609 INFO:tasks.workunit.client.0.smithi079.stdout:8/530: sync 2024-09-10T09:36:06.609 INFO:tasks.workunit.client.0.smithi079.stdout:6/569: sync 2024-09-10T09:36:06.609 INFO:tasks.workunit.client.0.smithi079.stdout:4/531: dread d1/f2e [0,4194304] 0 2024-09-10T09:36:06.611 INFO:tasks.workunit.client.0.smithi079.stdout:5/516: chown d2/d3/d27/f69 240 1 2024-09-10T09:36:06.612 INFO:tasks.workunit.client.0.smithi079.stdout:1/626: creat d5/df/dc6/fca x:0 0 0 2024-09-10T09:36:06.614 INFO:tasks.workunit.client.0.smithi079.stdout:2/440: mkdir d4/dc/d1c/d86/d1b/d38/d87 0 2024-09-10T09:36:06.615 INFO:tasks.workunit.client.0.smithi079.stdout:6/570: dread d4/d8/dc/d93/d4b/f4c [0,4194304] 0 2024-09-10T09:36:06.615 INFO:tasks.workunit.client.0.smithi079.stdout:6/571: readlink d4/d8/dc/d12/d29/l68 0 2024-09-10T09:36:06.616 INFO:tasks.workunit.client.0.smithi079.stdout:8/531: creat d11/d2b/d4b/d50/d55/d87/fae x:0 0 0 2024-09-10T09:36:06.619 INFO:tasks.workunit.client.0.smithi079.stdout:4/532: symlink d1/da/d28/d47/da1/d83/la8 0 2024-09-10T09:36:06.621 INFO:tasks.workunit.client.0.smithi079.stdout:5/517: mknod d2/d3/d27/d32/d39/cb1 0 2024-09-10T09:36:06.623 INFO:tasks.workunit.client.0.smithi079.stdout:1/627: truncate d5/d24/d36/d3a/d3c/d57/fa8 493506 0 2024-09-10T09:36:06.623 INFO:tasks.workunit.client.0.smithi079.stdout:1/628: dread - d5/d24/d36/d3a/d3c/f78 zero size 2024-09-10T09:36:06.623 INFO:tasks.workunit.client.0.smithi079.stdout:1/629: stat d5/d24/d36/d3a/d3c/da0/d6e/dc5 0 2024-09-10T09:36:06.626 INFO:tasks.workunit.client.0.smithi079.stdout:5/518: rmdir d2/d3/d59 39 2024-09-10T09:36:06.626 INFO:tasks.workunit.client.0.smithi079.stdout:5/519: readlink d2/d3/l33 0 2024-09-10T09:36:06.627 INFO:tasks.workunit.client.0.smithi079.stdout:8/532: getdents d11/d2b/d4b 0 2024-09-10T09:36:06.627 INFO:tasks.workunit.client.0.smithi079.stdout:2/441: dread d4/dc/d1c/f34 [0,4194304] 0 2024-09-10T09:36:06.627 INFO:tasks.workunit.client.0.smithi079.stdout:6/572: write d4/d8/dc/d1c/f81 [958526,13373] 0 2024-09-10T09:36:06.628 INFO:tasks.workunit.client.0.smithi079.stdout:5/520: creat d2/d3/d59/fb2 x:0 0 0 2024-09-10T09:36:06.631 INFO:tasks.workunit.client.0.smithi079.stdout:5/521: unlink d2/c2d 0 2024-09-10T09:36:06.631 INFO:tasks.workunit.client.0.smithi079.stdout:4/533: dread d1/da/fb [4194304,4194304] 0 2024-09-10T09:36:06.631 INFO:tasks.workunit.client.0.smithi079.stdout:4/534: chown d1/da/d28/d99/la0 129613 1 2024-09-10T09:36:06.631 INFO:tasks.workunit.client.0.smithi079.stdout:5/522: creat d2/d3/fb3 x:0 0 0 2024-09-10T09:36:06.631 INFO:tasks.workunit.client.0.smithi079.stdout:5/523: dread - d2/d3/d5e/d61/fb0 zero size 2024-09-10T09:36:06.633 INFO:tasks.workunit.client.0.smithi079.stdout:4/535: symlink d1/la9 0 2024-09-10T09:36:06.633 INFO:tasks.workunit.client.0.smithi079.stdout:4/536: write d1/da/d16/d57/f7d [3046596,7388] 0 2024-09-10T09:36:06.634 INFO:tasks.workunit.client.0.smithi079.stdout:6/573: dread d4/d8/dc/d3c/f99 [0,4194304] 0 2024-09-10T09:36:06.636 INFO:tasks.workunit.client.0.smithi079.stdout:5/524: mkdir d2/d3/d27/d32/d44/db4 0 2024-09-10T09:36:06.637 INFO:tasks.workunit.client.0.smithi079.stdout:7/511: dwrite d4/df/d3d/f56 [4194304,4194304] 0 2024-09-10T09:36:06.639 INFO:tasks.workunit.client.0.smithi079.stdout:6/574: rename d4/d8/dc/d12/d29/f44 to d4/d8/dc/fbe 0 2024-09-10T09:36:06.639 INFO:tasks.workunit.client.0.smithi079.stdout:2/442: dread d4/fb [0,4194304] 0 2024-09-10T09:36:06.641 INFO:tasks.workunit.client.0.smithi079.stdout:7/512: mkdir d4/df/d6b/d9a 0 2024-09-10T09:36:06.641 INFO:tasks.workunit.client.0.smithi079.stdout:7/513: chown d4/df/d3d/d82/f5c 24 1 2024-09-10T09:36:06.642 INFO:tasks.workunit.client.0.smithi079.stdout:6/575: mkdir d4/d8/dd/d76/d46/d88/dbf 0 2024-09-10T09:36:06.642 INFO:tasks.workunit.client.0.smithi079.stdout:6/576: truncate d4/d8/dc/d93/fad 4727078 0 2024-09-10T09:36:06.642 INFO:tasks.workunit.client.0.smithi079.stdout:6/577: dread - d4/d8/dc/d12/f89 zero size 2024-09-10T09:36:06.643 INFO:tasks.workunit.client.0.smithi079.stdout:6/578: readlink d4/d8/l60 0 2024-09-10T09:36:06.643 INFO:tasks.workunit.client.0.smithi079.stdout:6/579: write d4/d8/f83 [81923,8522] 0 2024-09-10T09:36:06.643 INFO:tasks.workunit.client.0.smithi079.stdout:6/580: dread - d4/d8/dc/d12/d29/db5/fbc zero size 2024-09-10T09:36:06.643 INFO:tasks.workunit.client.0.smithi079.stdout:3/575: dwrite d4/da/d17/f37 [4194304,4194304] 0 2024-09-10T09:36:06.643 INFO:tasks.workunit.client.0.smithi079.stdout:3/576: stat d4/da/d17/d72/f75 0 2024-09-10T09:36:06.644 INFO:tasks.workunit.client.0.smithi079.stdout:1/630: read d5/f15 [3707140,23230] 0 2024-09-10T09:36:06.644 INFO:tasks.workunit.client.0.smithi079.stdout:9/470: dwrite d3/d40/f81 [4194304,4194304] 0 2024-09-10T09:36:06.644 INFO:tasks.workunit.client.0.smithi079.stdout:9/471: chown d3/d7/d26/c5f 23 1 2024-09-10T09:36:06.644 INFO:tasks.workunit.client.0.smithi079.stdout:1/631: creat d5/df/d2e/fcb x:0 0 0 2024-09-10T09:36:06.644 INFO:tasks.workunit.client.0.smithi079.stdout:9/472: write d3/f14 [394619,14943] 0 2024-09-10T09:36:06.644 INFO:tasks.workunit.client.0.smithi079.stdout:9/473: write d3/d7/dc/de/d17/d6e/f92 [365812,15021] 0 2024-09-10T09:36:06.644 INFO:tasks.workunit.client.0.smithi079.stdout:2/443: link d4/dc/d1c/d86/d1b/d38/d39/l6e d4/dc/d13/d61/d65/d77/l88 0 2024-09-10T09:36:06.646 INFO:tasks.workunit.client.0.smithi079.stdout:7/514: creat d4/dc/d43/f9b x:0 0 0 2024-09-10T09:36:06.646 INFO:tasks.workunit.client.0.smithi079.stdout:7/515: fsync d4/df/d3d/f56 0 2024-09-10T09:36:06.646 INFO:tasks.workunit.client.0.smithi079.stdout:5/525: read d2/d3/d27/f69 [5013351,17544] 0 2024-09-10T09:36:06.648 INFO:tasks.workunit.client.0.smithi079.stdout:3/577: symlink d4/da/d17/d2d/d78/d79/la8 0 2024-09-10T09:36:06.653 INFO:tasks.workunit.client.0.smithi079.stdout:1/632: truncate d5/d24/d36/d53/db3/fbc 588647 0 2024-09-10T09:36:06.657 INFO:tasks.workunit.client.0.smithi079.stdout:4/537: dwrite d1/da/f3f [0,4194304] 0 2024-09-10T09:36:06.657 INFO:tasks.workunit.client.0.smithi079.stdout:4/538: fdatasync d1/da/fb 0 2024-09-10T09:36:06.657 INFO:tasks.workunit.client.0.smithi079.stdout:4/539: fsync d1/da/d16/f27 0 2024-09-10T09:36:06.657 INFO:tasks.workunit.client.0.smithi079.stdout:7/516: mkdir d4/df/d6b/d9a/d9c 0 2024-09-10T09:36:06.659 INFO:tasks.workunit.client.0.smithi079.stdout:6/581: mknod d4/d8/dc/d1c/cc0 0 2024-09-10T09:36:06.659 INFO:tasks.workunit.client.0.smithi079.stdout:6/582: truncate d4/d8/dc/d12/d9d/fbb 858146 0 2024-09-10T09:36:06.660 INFO:tasks.workunit.client.0.smithi079.stdout:4/540: dread d1/da/fb [4194304,4194304] 0 2024-09-10T09:36:06.660 INFO:tasks.workunit.client.0.smithi079.stdout:4/541: write d1/da/d16/f27 [2508901,79890] 0 2024-09-10T09:36:06.661 INFO:tasks.workunit.client.0.smithi079.stdout:5/526: unlink d2/d3/d27/d32/d39/cb1 0 2024-09-10T09:36:06.662 INFO:tasks.workunit.client.0.smithi079.stdout:3/578: rename f2 to d4/fa9 0 2024-09-10T09:36:06.663 INFO:tasks.workunit.client.0.smithi079.stdout:1/633: truncate d5/d4f/f96 2810598 0 2024-09-10T09:36:06.663 INFO:tasks.workunit.client.0.smithi079.stdout:8/533: dwrite d11/f17 [4194304,4194304] 0 2024-09-10T09:36:06.666 INFO:tasks.workunit.client.0.smithi079.stdout:6/583: symlink d4/d8/dd/d41/lc1 0 2024-09-10T09:36:06.666 INFO:tasks.workunit.client.0.smithi079.stdout:6/584: chown d4/d8/dd/d76/d46/d88/cbd 18 1 2024-09-10T09:36:06.666 INFO:tasks.workunit.client.0.smithi079.stdout:6/585: chown d4/c6b 5218741 1 2024-09-10T09:36:06.668 INFO:tasks.workunit.client.0.smithi079.stdout:5/527: creat d2/d3/d5e/d61/d71/fb5 x:0 0 0 2024-09-10T09:36:06.668 INFO:tasks.workunit.client.0.smithi079.stdout:4/542: dread d1/da/f2b [0,4194304] 0 2024-09-10T09:36:06.670 INFO:tasks.workunit.client.0.smithi079.stdout:2/444: dwrite d4/dc/d1c/d86/f3f [0,4194304] 0 2024-09-10T09:36:06.670 INFO:tasks.workunit.client.0.smithi079.stdout:2/445: chown d4/dc/d1c/f28 189538 1 2024-09-10T09:36:06.670 INFO:tasks.workunit.client.0.smithi079.stdout:9/474: dwrite d3/d7/dc/de/d17/f21 [0,4194304] 0 2024-09-10T09:36:06.671 INFO:tasks.workunit.client.0.smithi079.stdout:7/517: rename d4/df/d6b/f8a to d4/df/d3d/d75/f9d 0 2024-09-10T09:36:06.671 INFO:tasks.workunit.client.0.smithi079.stdout:7/518: fsync d4/d6/f99 0 2024-09-10T09:36:06.675 INFO:tasks.workunit.client.0.smithi079.stdout:1/634: link d5/d24/d36/d3a/d3c/f54 d5/d24/d36/d3a/d3c/da0/d6a/fcc 0 2024-09-10T09:36:06.678 INFO:tasks.workunit.client.0.smithi079.stdout:4/543: stat d1/da/d16/l84 0 2024-09-10T09:36:06.678 INFO:tasks.workunit.client.0.smithi079.stdout:4/544: getdents d1/da/d28/d95 0 2024-09-10T09:36:06.679 INFO:tasks.workunit.client.0.smithi079.stdout:8/534: write d11/d2b/f75 [1905399,112319] 0 2024-09-10T09:36:06.679 INFO:tasks.workunit.client.0.smithi079.stdout:8/535: read d11/f2a [650182,87734] 0 2024-09-10T09:36:06.679 INFO:tasks.workunit.client.0.smithi079.stdout:8/536: read - d11/d2b/d4b/d50/d5c/f71 zero size 2024-09-10T09:36:06.689 INFO:tasks.workunit.client.0.smithi079.stdout:9/475: symlink d3/d7/dc/de/d17/d2f/l93 0 2024-09-10T09:36:06.692 INFO:tasks.workunit.client.0.smithi079.stdout:7/519: rename d4/df/d19/f48 to d4/df/d3d/f9e 0 2024-09-10T09:36:06.692 INFO:tasks.workunit.client.0.smithi079.stdout:7/520: creat d4/df/f9f x:0 0 0 2024-09-10T09:36:06.692 INFO:tasks.workunit.client.0.smithi079.stdout:7/521: write d4/dc/f6d [934050,30098] 0 2024-09-10T09:36:06.693 INFO:tasks.workunit.client.0.smithi079.stdout:3/579: getdents d4/da/d17/d72 0 2024-09-10T09:36:06.693 INFO:tasks.workunit.client.0.smithi079.stdout:3/580: truncate d4/da/d17/d72/f9c 524007 0 2024-09-10T09:36:06.695 INFO:tasks.workunit.client.0.smithi079.stdout:1/635: rmdir d5/df 39 2024-09-10T09:36:06.695 INFO:tasks.workunit.client.0.smithi079.stdout:1/636: write d5/d24/d36/d3a/d3c/d57/fa8 [821519,37845] 0 2024-09-10T09:36:06.695 INFO:tasks.workunit.client.0.smithi079.stdout:1/637: write d5/d4f/f73 [7390608,29168] 0 2024-09-10T09:36:06.697 INFO:tasks.workunit.client.0.smithi079.stdout:4/545: creat d1/da/d16/d88/faa x:0 0 0 2024-09-10T09:36:06.699 INFO:tasks.workunit.client.0.smithi079.stdout:6/586: dwrite d4/d8/dc/d12/d29/f2c [0,4194304] 0 2024-09-10T09:36:06.699 INFO:tasks.workunit.client.0.smithi079.stdout:5/528: dwrite d2/d3/d27/d32/f90 [0,4194304] 0 2024-09-10T09:36:06.700 INFO:tasks.workunit.client.0.smithi079.stdout:2/446: symlink d4/dc/d1c/d86/d1b/l89 0 2024-09-10T09:36:06.700 INFO:tasks.workunit.client.0.smithi079.stdout:9/476: write d3/d7/dc/de/d17/f1f [209839,100342] 0 2024-09-10T09:36:06.700 INFO:tasks.workunit.client.0.smithi079.stdout:2/447: write d4/dc/d1c/d86/d1b/d38/d39/f7b [229134,57702] 0 2024-09-10T09:36:06.702 INFO:tasks.workunit.client.0.smithi079.stdout:2/448: dread d4/f18 [0,4194304] 0 2024-09-10T09:36:06.703 INFO:tasks.workunit.client.0.smithi079.stdout:6/587: dread d4/d8/dc/d12/d29/f31 [0,4194304] 0 2024-09-10T09:36:06.705 INFO:tasks.workunit.client.0.smithi079.stdout:8/537: rename d11/d3b/f64 to d11/d2b/d4b/d50/d55/d87/faf 0 2024-09-10T09:36:06.709 INFO:tasks.workunit.client.0.smithi079.stdout:3/581: link d4/f4d d4/da/d17/d2d/d43/faa 0 2024-09-10T09:36:06.711 INFO:tasks.workunit.client.0.smithi079.stdout:1/638: mknod d5/d24/d36/d53/ccd 0 2024-09-10T09:36:06.712 INFO:tasks.workunit.client.0.smithi079.stdout:1/639: dread d5/d24/d36/d3a/f4b [0,4194304] 0 2024-09-10T09:36:06.712 INFO:tasks.workunit.client.0.smithi079.stdout:1/640: write d5/df/f34 [4799522,127447] 0 2024-09-10T09:36:06.712 INFO:tasks.workunit.client.0.smithi079.stdout:1/641: write d5/d24/d36/d3a/f3d [4906825,94110] 0 2024-09-10T09:36:06.713 INFO:tasks.workunit.client.0.smithi079.stdout:4/546: symlink d1/da/d3b/d5f/lab 0 2024-09-10T09:36:06.713 INFO:tasks.workunit.client.0.smithi079.stdout:4/547: chown d1/d38/c90 3 1 2024-09-10T09:36:06.718 INFO:tasks.workunit.client.0.smithi079.stdout:5/529: mkdir d2/d3/d27/d32/db6 0 2024-09-10T09:36:06.720 INFO:tasks.workunit.client.0.smithi079.stdout:9/477: unlink d3/d7/dc/de/d17/d2f/c72 0 2024-09-10T09:36:06.720 INFO:tasks.workunit.client.0.smithi079.stdout:9/478: readlink d3/d7/l88 0 2024-09-10T09:36:06.720 INFO:tasks.workunit.client.0.smithi079.stdout:9/479: chown d3/d7/d26/d83 4014390 1 2024-09-10T09:36:06.721 INFO:tasks.workunit.client.0.smithi079.stdout:2/449: unlink l2 0 2024-09-10T09:36:06.723 INFO:tasks.workunit.client.0.smithi079.stdout:6/588: read d4/d8/dc/d1c/f32 [5197103,7832] 0 2024-09-10T09:36:06.723 INFO:tasks.workunit.client.0.smithi079.stdout:6/589: readlink d4/d8/dc/d12/d29/l68 0 2024-09-10T09:36:06.726 INFO:tasks.workunit.client.0.smithi079.stdout:7/522: rename d4/df/d3d/d82/l5e to d4/d6/d4f/d66/la0 0 2024-09-10T09:36:06.726 INFO:tasks.workunit.client.0.smithi079.stdout:7/523: readlink d4/dc/l30 0 2024-09-10T09:36:06.729 INFO:tasks.workunit.client.0.smithi079.stdout:8/538: creat d11/d2b/d4b/fb0 x:0 0 0 2024-09-10T09:36:06.730 INFO:tasks.workunit.client.0.smithi079.stdout:8/539: creat d11/d2b/d4b/fb1 x:0 0 0 2024-09-10T09:36:06.730 INFO:tasks.workunit.client.0.smithi079.stdout:8/540: dread - d11/d2b/fa1 zero size 2024-09-10T09:36:06.730 INFO:tasks.workunit.client.0.smithi079.stdout:8/541: fdatasync d11/d2b/d4b/f77 0 2024-09-10T09:36:06.731 INFO:tasks.workunit.client.0.smithi079.stdout:3/582: mkdir d4/da/d17/d2d/d78/d79/dab 0 2024-09-10T09:36:06.731 INFO:tasks.workunit.client.0.smithi079.stdout:3/583: fdatasync d4/da/d17/d2d/d43/d4c/f96 0 2024-09-10T09:36:06.731 INFO:tasks.workunit.client.0.smithi079.stdout:3/584: write d4/da/d18/f6d [413839,9174] 0 2024-09-10T09:36:06.732 INFO:tasks.workunit.client.0.smithi079.stdout:3/585: write d4/da/d17/d2d/d43/f74 [168979,75079] 0 2024-09-10T09:36:06.732 INFO:tasks.workunit.client.0.smithi079.stdout:3/586: write d4/f29 [993887,123585] 0 2024-09-10T09:36:06.737 INFO:tasks.workunit.client.0.smithi079.stdout:1/642: mkdir d5/d24/d36/d53/dce 0 2024-09-10T09:36:06.737 INFO:tasks.workunit.client.0.smithi079.stdout:1/643: readlink d5/d24/d36/d3a/d3c/l80 0 2024-09-10T09:36:06.746 INFO:tasks.workunit.client.0.smithi079.stdout:5/530: dwrite d2/d3/d27/faa [0,4194304] 0 2024-09-10T09:36:06.749 INFO:tasks.workunit.client.0.smithi079.stdout:6/590: dwrite d4/d8/dc/f66 [0,4194304] 0 2024-09-10T09:36:06.762 INFO:tasks.workunit.client.0.smithi079.stdout:2/450: symlink d4/dc/d1c/l8a 0 2024-09-10T09:36:06.763 INFO:tasks.workunit.client.0.smithi079.stdout:7/524: truncate d4/f1c 1585998 0 2024-09-10T09:36:06.764 INFO:tasks.workunit.client.0.smithi079.stdout:2/451: dread d4/fb [0,4194304] 0 2024-09-10T09:36:06.765 INFO:tasks.workunit.client.0.smithi079.stdout:2/452: write d4/dc/d1c/d59/f4a [272243,107909] 0 2024-09-10T09:36:06.766 INFO:tasks.workunit.client.0.smithi079.stdout:8/542: mkdir d11/d2b/d4b/d7e/db2 0 2024-09-10T09:36:06.768 INFO:tasks.workunit.client.0.smithi079.stdout:3/587: mknod d4/da/d17/d9b/cac 0 2024-09-10T09:36:06.768 INFO:tasks.workunit.client.0.smithi079.stdout:2/453: dread d4/fb [0,4194304] 0 2024-09-10T09:36:06.769 INFO:tasks.workunit.client.0.smithi079.stdout:2/454: stat d4/dc/d13/f15 0 2024-09-10T09:36:06.769 INFO:tasks.workunit.client.0.smithi079.stdout:2/455: dread - d4/dc/d13/d61/d65/d77/f81 zero size 2024-09-10T09:36:06.769 INFO:tasks.workunit.client.0.smithi079.stdout:6/591: dwrite d4/d8/dd/fb7 [0,4194304] 0 2024-09-10T09:36:06.770 INFO:tasks.workunit.client.0.smithi079.stdout:1/644: rename d5/df/d11/c5f to d5/df/d11/d76/dad/ccf 0 2024-09-10T09:36:06.771 INFO:tasks.workunit.client.0.smithi079.stdout:4/548: getdents d1/da/d16 0 2024-09-10T09:36:06.776 INFO:tasks.workunit.client.0.smithi079.stdout:5/531: unlink d2/d3/d27/d70/d80/f91 0 2024-09-10T09:36:06.776 INFO:tasks.workunit.client.0.smithi079.stdout:5/532: fdatasync d2/d3/f83 0 2024-09-10T09:36:06.779 INFO:tasks.workunit.client.0.smithi079.stdout:6/592: dread d4/d8/dd/d41/d51/f5c [0,4194304] 0 2024-09-10T09:36:06.780 INFO:tasks.workunit.client.0.smithi079.stdout:7/525: symlink d4/d6/d4f/la1 0 2024-09-10T09:36:06.781 INFO:tasks.workunit.client.0.smithi079.stdout:1/645: dread d5/df/d2e/f39 [4194304,4194304] 0 2024-09-10T09:36:06.781 INFO:tasks.workunit.client.0.smithi079.stdout:9/480: truncate d3/d7/dc/de/d17/d6e/f92 338958 0 2024-09-10T09:36:06.783 INFO:tasks.workunit.client.0.smithi079.stdout:3/588: read d4/da/d17/f52 [454952,65191] 0 2024-09-10T09:36:06.783 INFO:tasks.workunit.client.0.smithi079.stdout:3/589: truncate d4/da/d17/d62/f8f 529251 0 2024-09-10T09:36:06.783 INFO:tasks.workunit.client.0.smithi079.stdout:3/590: fsync d4/da/d17/d2d/d43/d4c/f92 0 2024-09-10T09:36:06.785 INFO:tasks.workunit.client.0.smithi079.stdout:4/549: link d1/da/d16/d57/f7d d1/d38/da5/fac 0 2024-09-10T09:36:06.787 INFO:tasks.workunit.client.0.smithi079.stdout:5/533: mknod d2/d3/d5e/d61/d71/cb7 0 2024-09-10T09:36:06.789 INFO:tasks.workunit.client.0.smithi079.stdout:4/550: dread d1/f3a [0,4194304] 0 2024-09-10T09:36:06.791 INFO:tasks.workunit.client.0.smithi079.stdout:1/646: dread d5/d4f/f77 [0,4194304] 0 2024-09-10T09:36:06.794 INFO:tasks.workunit.client.0.smithi079.stdout:7/526: creat d4/d6/d38/fa2 x:0 0 0 2024-09-10T09:36:06.794 INFO:tasks.workunit.client.0.smithi079.stdout:3/591: mknod d4/da/d18/cad 0 2024-09-10T09:36:06.794 INFO:tasks.workunit.client.0.smithi079.stdout:3/592: readlink d4/da/d17/d38/d42/l71 0 2024-09-10T09:36:06.796 INFO:tasks.workunit.client.0.smithi079.stdout:0/507: sync 2024-09-10T09:36:06.796 INFO:tasks.workunit.client.0.smithi079.stdout:0/508: creat d4/d12/d16/d53/fab x:0 0 0 2024-09-10T09:36:06.799 INFO:tasks.workunit.client.0.smithi079.stdout:1/647: dread d5/d4f/f96 [0,4194304] 0 2024-09-10T09:36:06.803 INFO:tasks.workunit.client.0.smithi079.stdout:8/543: dwrite d11/f32 [0,4194304] 0 2024-09-10T09:36:06.803 INFO:tasks.workunit.client.0.smithi079.stdout:2/456: dwrite d4/dc/d1c/d86/f16 [4194304,4194304] 0 2024-09-10T09:36:06.806 INFO:tasks.workunit.client.0.smithi079.stdout:5/534: creat d2/d3/d27/d70/d80/d94/fb8 x:0 0 0 2024-09-10T09:36:06.806 INFO:tasks.workunit.client.0.smithi079.stdout:5/535: fsync d2/d41/f51 0 2024-09-10T09:36:06.806 INFO:tasks.workunit.client.0.smithi079.stdout:5/536: creat d2/d3/d5e/d61/d71/fb9 x:0 0 0 2024-09-10T09:36:06.822 INFO:tasks.workunit.client.0.smithi079.stdout:2/457: symlink d4/dc/d1c/d86/d1b/d38/d39/d31/l8b 0 2024-09-10T09:36:06.824 INFO:tasks.workunit.client.0.smithi079.stdout:7/527: dread d4/dc/f32 [0,4194304] 0 2024-09-10T09:36:06.824 INFO:tasks.workunit.client.0.smithi079.stdout:7/528: dread - d4/df/d3d/d82/f94 zero size 2024-09-10T09:36:06.824 INFO:tasks.workunit.client.0.smithi079.stdout:7/529: fdatasync d4/dc/f92 0 2024-09-10T09:36:06.827 INFO:tasks.workunit.client.0.smithi079.stdout:2/458: mknod d4/dc/d1c/c8c 0 2024-09-10T09:36:06.828 INFO:tasks.workunit.client.0.smithi079.stdout:7/530: symlink d4/dc/la3 0 2024-09-10T09:36:06.828 INFO:tasks.workunit.client.0.smithi079.stdout:7/531: fdatasync d4/df/d3d/f41 0 2024-09-10T09:36:06.829 INFO:tasks.workunit.client.0.smithi079.stdout:1/648: rename d5/d24/d36/d3a/d3c to d5/df/dd0 0 2024-09-10T09:36:06.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/459: mkdir d4/dc/d13/d61/d65/d77/d8d 0 2024-09-10T09:36:06.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/460: creat d4/d5d/f8e x:0 0 0 2024-09-10T09:36:06.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/461: chown d4/dc/d1c/d86/d1b/d38/d39/d31/f46 58163 1 2024-09-10T09:36:06.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/462: fdatasync d4/dc/d13/f27 0 2024-09-10T09:36:06.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/463: chown d4/f18 1 1 2024-09-10T09:36:06.835 INFO:tasks.workunit.client.0.smithi079.stdout:2/464: mkdir d4/d8f 0 2024-09-10T09:36:06.837 INFO:tasks.workunit.client.0.smithi079.stdout:6/593: dwrite d4/d8/dd/d41/f45 [0,4194304] 0 2024-09-10T09:36:06.841 INFO:tasks.workunit.client.0.smithi079.stdout:1/649: write d5/d24/d36/d3a/d48/f51 [715734,99884] 0 2024-09-10T09:36:06.841 INFO:tasks.workunit.client.0.smithi079.stdout:1/650: stat d5/d4f/f96 0 2024-09-10T09:36:06.850 INFO:tasks.workunit.client.0.smithi079.stdout:9/481: dwrite d3/d7/f2a [0,4194304] 0 2024-09-10T09:36:06.851 INFO:tasks.workunit.client.0.smithi079.stdout:6/594: read d4/d8/d74/f96 [798487,128169] 0 2024-09-10T09:36:06.851 INFO:tasks.workunit.client.0.smithi079.stdout:6/595: stat d4/d8/dc/d12/d70 0 2024-09-10T09:36:06.853 INFO:tasks.workunit.client.0.smithi079.stdout:9/482: getdents d3 0 2024-09-10T09:36:06.853 INFO:tasks.workunit.client.0.smithi079.stdout:9/483: readlink d3/d7/dc/de/l15 0 2024-09-10T09:36:06.854 INFO:tasks.workunit.client.0.smithi079.stdout:3/593: dwrite d4/da/d17/d2d/d43/faa [0,4194304] 0 2024-09-10T09:36:06.854 INFO:tasks.workunit.client.0.smithi079.stdout:0/509: dwrite d4/d47/f4c [0,4194304] 0 2024-09-10T09:36:06.854 INFO:tasks.workunit.client.0.smithi079.stdout:4/551: dwrite d1/da/d3b/d5a/f8c [0,4194304] 0 2024-09-10T09:36:06.854 INFO:tasks.workunit.client.0.smithi079.stdout:4/552: fdatasync d1/da/d16/d21/d32/f98 0 2024-09-10T09:36:06.854 INFO:tasks.workunit.client.0.smithi079.stdout:0/510: truncate d4/d12/d1a/d6d/d84/f9e 1361255 0 2024-09-10T09:36:06.854 INFO:tasks.workunit.client.0.smithi079.stdout:0/511: fdatasync d4/f10 0 2024-09-10T09:36:06.854 INFO:tasks.workunit.client.0.smithi079.stdout:4/553: write d1/da/d16/f26 [3397085,55112] 0 2024-09-10T09:36:06.856 INFO:tasks.workunit.client.0.smithi079.stdout:6/596: truncate d4/d8/dc/fbe 3177340 0 2024-09-10T09:36:06.856 INFO:tasks.workunit.client.0.smithi079.stdout:6/597: stat d4/d8/dc/d1c/f81 0 2024-09-10T09:36:06.857 INFO:tasks.workunit.client.0.smithi079.stdout:9/484: symlink d3/d7/dc/de/d17/d4c/l94 0 2024-09-10T09:36:06.857 INFO:tasks.workunit.client.0.smithi079.stdout:9/485: creat d3/d7/dc/f95 x:0 0 0 2024-09-10T09:36:06.858 INFO:tasks.workunit.client.0.smithi079.stdout:8/544: dwrite d11/f2a [0,4194304] 0 2024-09-10T09:36:06.859 INFO:tasks.workunit.client.0.smithi079.stdout:9/486: write d3/d40/f5d [281409,116642] 0 2024-09-10T09:36:06.859 INFO:tasks.workunit.client.0.smithi079.stdout:9/487: chown d3/d7/dc/de/l1e 10951319 1 2024-09-10T09:36:06.863 INFO:tasks.workunit.client.0.smithi079.stdout:0/512: mkdir d4/d12/d15/d2b/dac 0 2024-09-10T09:36:06.863 INFO:tasks.workunit.client.0.smithi079.stdout:0/513: creat d4/d1d/fad x:0 0 0 2024-09-10T09:36:06.864 INFO:tasks.workunit.client.0.smithi079.stdout:4/554: mkdir d1/da/dad 0 2024-09-10T09:36:06.864 INFO:tasks.workunit.client.0.smithi079.stdout:4/555: chown d1/da/d28/l55 3473 1 2024-09-10T09:36:06.864 INFO:tasks.workunit.client.0.smithi079.stdout:4/556: creat d1/da/d3b/d5f/fae x:0 0 0 2024-09-10T09:36:06.864 INFO:tasks.workunit.client.0.smithi079.stdout:4/557: write d1/d38/da5/fac [1780662,63135] 0 2024-09-10T09:36:06.866 INFO:tasks.workunit.client.0.smithi079.stdout:6/598: link d4/d8/f83 d4/d8/dc/d93/da0/fc2 0 2024-09-10T09:36:06.870 INFO:tasks.workunit.client.0.smithi079.stdout:2/465: dwrite d4/dc/d1c/d86/d1b/d38/d39/d31/d52/f5a [0,4194304] 0 2024-09-10T09:36:06.870 INFO:tasks.workunit.client.0.smithi079.stdout:7/532: dwrite d4/dc/f36 [0,4194304] 0 2024-09-10T09:36:06.873 INFO:tasks.workunit.client.0.smithi079.stdout:9/488: mknod d3/d7/d26/c96 0 2024-09-10T09:36:06.877 INFO:tasks.workunit.client.0.smithi079.stdout:0/514: rmdir d4/d12/d15/d6b 39 2024-09-10T09:36:06.877 INFO:tasks.workunit.client.0.smithi079.stdout:0/515: truncate d4/d12/f96 373555 0 2024-09-10T09:36:06.877 INFO:tasks.workunit.client.0.smithi079.stdout:5/537: getdents d2/d3/d5e/d61/d71 0 2024-09-10T09:36:06.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/466: dread d4/dc/d13/d61/d62/f7d [0,4194304] 0 2024-09-10T09:36:06.952 INFO:tasks.workunit.client.0.smithi079.stdout:1/651: dwrite d5/d4f/d95/fbd [0,4194304] 0 2024-09-10T09:36:06.952 INFO:tasks.workunit.client.0.smithi079.stdout:1/652: readlink d5/df/l10 0 2024-09-10T09:36:06.954 INFO:tasks.workunit.client.0.smithi079.stdout:4/558: creat d1/da/d28/d99/faf x:0 0 0 2024-09-10T09:36:06.954 INFO:tasks.workunit.client.0.smithi079.stdout:4/559: read d1/da/d28/f29 [1473246,59556] 0 2024-09-10T09:36:06.954 INFO:tasks.workunit.client.0.smithi079.stdout:4/560: write d1/da/d3b/d5a/f78 [3751219,43074] 0 2024-09-10T09:36:06.956 INFO:tasks.workunit.client.0.smithi079.stdout:6/599: link d4/d8/dd/d41/cb1 d4/d8/dc/d93/da0/cc3 0 2024-09-10T09:36:06.957 INFO:tasks.workunit.client.0.smithi079.stdout:7/533: creat d4/df/d6b/d9a/d9c/fa4 x:0 0 0 2024-09-10T09:36:06.957 INFO:tasks.workunit.client.0.smithi079.stdout:7/534: write d4/f5d [993349,125922] 0 2024-09-10T09:36:06.958 INFO:tasks.workunit.client.0.smithi079.stdout:8/545: getdents d11/d2b/d4b/d50/d55/d87 0 2024-09-10T09:36:06.961 INFO:tasks.workunit.client.0.smithi079.stdout:0/516: creat d4/d12/d16/d53/d6a/fae x:0 0 0 2024-09-10T09:36:06.964 INFO:tasks.workunit.client.0.smithi079.stdout:3/594: dwrite d4/f2b [0,4194304] 0 2024-09-10T09:36:06.965 INFO:tasks.workunit.client.0.smithi079.stdout:3/595: dread - d4/da/d17/d2d/d43/f7d zero size 2024-09-10T09:36:06.965 INFO:tasks.workunit.client.0.smithi079.stdout:3/596: dread - d4/da/d17/d2d/d43/f7d zero size 2024-09-10T09:36:06.965 INFO:tasks.workunit.client.0.smithi079.stdout:3/597: truncate d4/da/d17/d2d/d43/f7d 802273 0 2024-09-10T09:36:06.965 INFO:tasks.workunit.client.0.smithi079.stdout:2/467: write d4/dc/d1c/d86/d1b/d38/d39/d31/d52/f5a [902683,115548] 0 2024-09-10T09:36:06.966 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:06 smithi135 ceph-mon[33411]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:06.966 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:06 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/3030614822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:36:06.969 INFO:tasks.workunit.client.0.smithi079.stdout:4/561: link d1/da/d16/d21/f25 d1/da/d28/d99/fb0 0 2024-09-10T09:36:06.969 INFO:tasks.workunit.client.0.smithi079.stdout:7/535: dread d4/df/d3d/f41 [0,4194304] 0 2024-09-10T09:36:06.970 INFO:tasks.workunit.client.0.smithi079.stdout:7/536: dread - d4/df/d3d/f79 zero size 2024-09-10T09:36:06.970 INFO:tasks.workunit.client.0.smithi079.stdout:6/600: mkdir d4/d8/dc/d93/dc4 0 2024-09-10T09:36:06.974 INFO:tasks.workunit.client.0.smithi079.stdout:8/546: creat d11/d2b/d4b/d50/d55/d87/fb3 x:0 0 0 2024-09-10T09:36:06.974 INFO:tasks.workunit.client.0.smithi079.stdout:1/653: dwrite d5/d24/d36/d3a/d48/f99 [0,4194304] 0 2024-09-10T09:36:06.975 INFO:tasks.workunit.client.0.smithi079.stdout:5/538: dwrite d2/f22 [0,4194304] 0 2024-09-10T09:36:06.975 INFO:tasks.workunit.client.0.smithi079.stdout:0/517: symlink d4/d12/d21/laf 0 2024-09-10T09:36:06.980 INFO:tasks.workunit.client.0.smithi079.stdout:3/598: dread d4/da/d17/d72/f75 [0,4194304] 0 2024-09-10T09:36:06.981 INFO:tasks.workunit.client.0.smithi079.stdout:2/468: symlink d4/d8f/l90 0 2024-09-10T09:36:06.984 INFO:tasks.workunit.client.0.smithi079.stdout:4/562: truncate d1/da/d16/d88/fa3 1285286 0 2024-09-10T09:36:06.984 INFO:tasks.workunit.client.0.smithi079.stdout:4/563: fsync d1/da/d3b/d5f/f62 0 2024-09-10T09:36:06.994 INFO:tasks.workunit.client.0.smithi079.stdout:5/539: truncate d2/d3/d27/f69 1450735 0 2024-09-10T09:36:06.994 INFO:tasks.workunit.client.0.smithi079.stdout:5/540: fdatasync d2/f26 0 2024-09-10T09:36:06.994 INFO:tasks.workunit.client.0.smithi079.stdout:7/537: dwrite d4/df/f84 [4194304,4194304] 0 2024-09-10T09:36:06.995 INFO:tasks.workunit.client.0.smithi079.stdout:0/518: creat d4/d12/d16/fb0 x:0 0 0 2024-09-10T09:36:06.996 INFO:tasks.workunit.client.0.smithi079.stdout:6/601: dwrite d4/d8/fae [0,4194304] 0 2024-09-10T09:36:06.996 INFO:tasks.workunit.client.0.smithi079.stdout:6/602: fdatasync d4/d8/dc/d12/faf 0 2024-09-10T09:36:06.996 INFO:tasks.workunit.client.0.smithi079.stdout:6/603: write d4/d8/dc/d1c/f87 [929745,89025] 0 2024-09-10T09:36:07.004 INFO:tasks.workunit.client.0.smithi079.stdout:3/599: creat d4/da/d17/d2d/fae x:0 0 0 2024-09-10T09:36:07.004 INFO:tasks.workunit.client.0.smithi079.stdout:3/600: fsync d4/da/d17/f1a 0 2024-09-10T09:36:07.006 INFO:tasks.workunit.client.0.smithi079.stdout:8/547: link d11/d3b/l5a d11/d2b/d4b/d50/d55/d87/lb4 0 2024-09-10T09:36:07.006 INFO:tasks.workunit.client.0.smithi079.stdout:8/548: fsync d11/f2a 0 2024-09-10T09:36:07.008 INFO:tasks.workunit.client.0.smithi079.stdout:5/541: creat d2/d41/d4d/fba x:0 0 0 2024-09-10T09:36:07.014 INFO:tasks.workunit.client.0.smithi079.stdout:7/538: unlink d4/df/d19/f2e 0 2024-09-10T09:36:07.015 INFO:tasks.workunit.client.0.smithi079.stdout:0/519: mknod d4/d12/d16/d53/d79/cb1 0 2024-09-10T09:36:07.016 INFO:tasks.workunit.client.0.smithi079.stdout:0/520: creat d4/d12/d15/d2b/fb2 x:0 0 0 2024-09-10T09:36:07.024 INFO:tasks.workunit.client.0.smithi079.stdout:3/601: truncate d4/da/d17/d2d/fa1 624661 0 2024-09-10T09:36:07.027 INFO:tasks.workunit.client.0.smithi079.stdout:1/654: rename d5/df/da7 to d5/df/dd0/da0/d6e/dc5/dd1 0 2024-09-10T09:36:07.027 INFO:tasks.workunit.client.0.smithi079.stdout:2/469: rename d4/dc/d1c/d86/d1b/d38/d39/d31 to d4/dc/d1c/d86/d1b/d38/d39/d31/d49/d91 22 2024-09-10T09:36:07.027 INFO:tasks.workunit.client.0.smithi079.stdout:2/470: chown d4/dc/d1c/d86/d1b/d38/d39/d31/d49/l4f 46817 1 2024-09-10T09:36:07.028 INFO:tasks.workunit.client.0.smithi079.stdout:8/549: dwrite d11/d48/f9f [0,4194304] 0 2024-09-10T09:36:07.028 INFO:tasks.workunit.client.0.smithi079.stdout:8/550: chown d11/d2b/d4b/d50/d9e/ca5 1357572949 1 2024-09-10T09:36:07.028 INFO:tasks.workunit.client.0.smithi079.stdout:8/551: truncate d11/d2b/d4b/f56 754203 0 2024-09-10T09:36:07.028 INFO:tasks.workunit.client.0.smithi079.stdout:8/552: truncate d11/d2b/d4b/d50/d5c/f6e 38986 0 2024-09-10T09:36:07.032 INFO:tasks.workunit.client.0.smithi079.stdout:0/521: truncate d4/f5 2079785 0 2024-09-10T09:36:07.035 INFO:tasks.workunit.client.0.smithi079.stdout:6/604: getdents d4/d8/dc/d12/d70 0 2024-09-10T09:36:07.035 INFO:tasks.workunit.client.0.smithi079.stdout:6/605: chown d4/d8/dc/d12/d29/l36 92 1 2024-09-10T09:36:07.035 INFO:tasks.workunit.client.0.smithi079.stdout:1/655: symlink d5/df/d2e/ld2 0 2024-09-10T09:36:07.039 INFO:tasks.workunit.client.0.smithi079.stdout:8/553: creat d11/d2b/d4b/da8/fb5 x:0 0 0 2024-09-10T09:36:07.040 INFO:tasks.workunit.client.0.smithi079.stdout:0/522: mkdir d4/d12/d21/d3f/db3 0 2024-09-10T09:36:07.042 INFO:tasks.workunit.client.0.smithi079.stdout:1/656: creat d5/df/d11/fd3 x:0 0 0 2024-09-10T09:36:07.042 INFO:tasks.workunit.client.0.smithi079.stdout:6/606: read d4/d8/dc/d93/fad [4686077,124737] 0 2024-09-10T09:36:07.042 INFO:tasks.workunit.client.0.smithi079.stdout:5/542: write d2/d3/d27/f2c [1056385,93842] 0 2024-09-10T09:36:07.044 INFO:tasks.workunit.client.0.smithi079.stdout:3/602: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:07.044 INFO:tasks.workunit.client.0.smithi079.stdout:7/539: dwrite d4/d6/d3e/f7a [0,4194304] 0 2024-09-10T09:36:07.044 INFO:tasks.workunit.client.0.smithi079.stdout:8/554: unlink d11/d2b/d4b/da8/fb5 0 2024-09-10T09:36:07.045 INFO:tasks.workunit.client.0.smithi079.stdout:8/555: creat d11/d48/fb6 x:0 0 0 2024-09-10T09:36:07.046 INFO:tasks.workunit.client.0.smithi079.stdout:0/523: creat d4/d12/d15/d6b/daa/fb4 x:0 0 0 2024-09-10T09:36:07.061 INFO:tasks.workunit.client.0.smithi079.stdout:8/556: mkdir d11/d2b/d4b/d7e/db2/db7 0 2024-09-10T09:36:07.062 INFO:tasks.workunit.client.0.smithi079.stdout:1/657: dwrite d5/df/dd0/f7d [0,4194304] 0 2024-09-10T09:36:07.062 INFO:tasks.workunit.client.0.smithi079.stdout:1/658: readlink d5/d4f/d8a/lbe 0 2024-09-10T09:36:07.062 INFO:tasks.workunit.client.0.smithi079.stdout:0/524: rmdir d4/d12/d21/d3f/d80 39 2024-09-10T09:36:07.063 INFO:tasks.workunit.client.0.smithi079.stdout:5/543: mknod d2/d3/d27/d32/d44/cbb 0 2024-09-10T09:36:07.067 INFO:tasks.workunit.client.0.smithi079.stdout:1/659: mkdir d5/df/dd0/da0/d6a/dd4 0 2024-09-10T09:36:07.067 INFO:tasks.workunit.client.0.smithi079.stdout:1/660: stat d5/df/dd0/l90 0 2024-09-10T09:36:07.067 INFO:tasks.workunit.client.0.smithi079.stdout:1/661: chown d5/f22 63426198 1 2024-09-10T09:36:07.067 INFO:tasks.workunit.client.0.smithi079.stdout:1/662: getdents d5/df/dd0/da0/d6a/dd4 0 2024-09-10T09:36:07.068 INFO:tasks.workunit.client.0.smithi079.stdout:0/525: mkdir d4/d12/d21/d3f/db3/db5 0 2024-09-10T09:36:07.068 INFO:tasks.workunit.client.0.smithi079.stdout:6/607: dwrite d4/d8/dc/d12/d9d/fbb [0,4194304] 0 2024-09-10T09:36:07.071 INFO:tasks.workunit.client.0.smithi079.stdout:3/603: rename d4/d7a to d4/da/d18/daf 0 2024-09-10T09:36:07.073 INFO:tasks.workunit.client.0.smithi079.stdout:1/663: mknod d5/df/dd0/da0/d6a/cd5 0 2024-09-10T09:36:07.073 INFO:tasks.workunit.client.0.smithi079.stdout:1/664: fdatasync d5/d24/d36/d53/f61 0 2024-09-10T09:36:07.074 INFO:tasks.workunit.client.0.smithi079.stdout:0/526: symlink d4/d12/d21/lb6 0 2024-09-10T09:36:07.076 INFO:tasks.workunit.client.0.smithi079.stdout:6/608: rmdir d4/d8/dd/d41/d51 39 2024-09-10T09:36:07.077 INFO:tasks.workunit.client.0.smithi079.stdout:8/557: dread d11/d2b/d4b/f6b [0,4194304] 0 2024-09-10T09:36:07.077 INFO:tasks.workunit.client.0.smithi079.stdout:8/558: write d11/d48/f8f [206634,95106] 0 2024-09-10T09:36:07.077 INFO:tasks.workunit.client.0.smithi079.stdout:5/544: rmdir d2/d3/d27/d70/d88 39 2024-09-10T09:36:07.079 INFO:tasks.workunit.client.0.smithi079.stdout:3/604: creat d4/da/d56/d7b/fb0 x:0 0 0 2024-09-10T09:36:07.081 INFO:tasks.workunit.client.0.smithi079.stdout:1/665: mknod d5/df/dd0/d57/cd6 0 2024-09-10T09:36:07.081 INFO:tasks.workunit.client.0.smithi079.stdout:1/666: stat d5/df/dd0/d57/fa8 0 2024-09-10T09:36:07.083 INFO:tasks.workunit.client.0.smithi079.stdout:5/545: link d2/f3b d2/d3/d5e/d61/d71/fbc 0 2024-09-10T09:36:07.084 INFO:tasks.workunit.client.0.smithi079.stdout:1/667: creat d5/d24/d36/d3a/fd7 x:0 0 0 2024-09-10T09:36:07.087 INFO:tasks.workunit.client.0.smithi079.stdout:1/668: rename d5/lb to d5/df/dd0/da0/d6e/dc5/ld8 0 2024-09-10T09:36:07.087 INFO:tasks.workunit.client.0.smithi079.stdout:1/669: fsync d5/d24/d36/f9a 0 2024-09-10T09:36:07.089 INFO:tasks.workunit.client.0.smithi079.stdout:1/670: mkdir d5/d40/dd9 0 2024-09-10T09:36:07.091 INFO:tasks.workunit.client.0.smithi079.stdout:6/609: read d4/d8/fae [1926059,12043] 0 2024-09-10T09:36:07.091 INFO:tasks.workunit.client.0.smithi079.stdout:6/610: readlink d4/d8/dd/d41/d51/l6c 0 2024-09-10T09:36:07.092 INFO:tasks.workunit.client.0.smithi079.stdout:5/546: read d2/d3/d5e/d85/f8e [164638,11326] 0 2024-09-10T09:36:07.093 INFO:tasks.workunit.client.0.smithi079.stdout:1/671: symlink d5/df/dd0/da0/d6e/dc5/lda 0 2024-09-10T09:36:07.097 INFO:tasks.workunit.client.0.smithi079.stdout:6/611: rename d4/d8/d74/f96 to d4/d8/dc/d93/da0/fc5 0 2024-09-10T09:36:07.098 INFO:tasks.workunit.client.0.smithi079.stdout:9/489: sync 2024-09-10T09:36:07.099 INFO:tasks.workunit.client.0.smithi079.stdout:5/547: symlink d2/d3/lbd 0 2024-09-10T09:36:07.100 INFO:tasks.workunit.client.0.smithi079.stdout:1/672: mkdir d5/df/dd0/da0/ddb 0 2024-09-10T09:36:07.101 INFO:tasks.workunit.client.0.smithi079.stdout:6/612: mknod d4/d8/da5/cc6 0 2024-09-10T09:36:07.104 INFO:tasks.workunit.client.0.smithi079.stdout:9/490: symlink d3/d7/dc/de/l97 0 2024-09-10T09:36:07.104 INFO:tasks.workunit.client.0.smithi079.stdout:9/491: fsync d3/d7/dc/de/d17/d2f/d30/f23 0 2024-09-10T09:36:07.106 INFO:tasks.workunit.client.0.smithi079.stdout:1/673: link d5/df/dd0/f64 d5/df/fdc 0 2024-09-10T09:36:07.108 INFO:tasks.workunit.client.0.smithi079.stdout:6/613: mkdir d4/d8/dd/d41/d51/dc7 0 2024-09-10T09:36:07.108 INFO:tasks.workunit.client.0.smithi079.stdout:0/527: dwrite d4/f11 [4194304,4194304] 0 2024-09-10T09:36:07.110 INFO:tasks.workunit.client.0.smithi079.stdout:1/674: link d5/d24/d36/d3a/d85/fc4 d5/df/dd0/d57/d8c/fdd 0 2024-09-10T09:36:07.111 INFO:tasks.workunit.client.0.smithi079.stdout:0/528: dread f0 [0,4194304] 0 2024-09-10T09:36:07.111 INFO:tasks.workunit.client.0.smithi079.stdout:0/529: fsync d4/d12/d1a/f19 0 2024-09-10T09:36:07.112 INFO:tasks.workunit.client.0.smithi079.stdout:6/614: mknod d4/d8/dc/d12/d29/db5/cc8 0 2024-09-10T09:36:07.114 INFO:tasks.workunit.client.0.smithi079.stdout:1/675: unlink d5/df/dd0/da0/l60 0 2024-09-10T09:36:07.119 INFO:tasks.workunit.client.0.smithi079.stdout:3/605: dwrite d4/da/d17/f3f [0,4194304] 0 2024-09-10T09:36:07.119 INFO:tasks.workunit.client.0.smithi079.stdout:1/676: creat d5/df/dd0/da0/d6e/dc5/dd1/fde x:0 0 0 2024-09-10T09:36:07.119 INFO:tasks.workunit.client.0.smithi079.stdout:1/677: readlink d5/d24/d36/d79/l84 0 2024-09-10T09:36:07.119 INFO:tasks.workunit.client.0.smithi079.stdout:6/615: write d4/d8/dc/d93/da0/fb8 [2189545,59298] 0 2024-09-10T09:36:07.119 INFO:tasks.workunit.client.0.smithi079.stdout:1/678: dread - d5/df/dc6/fca zero size 2024-09-10T09:36:07.122 INFO:tasks.workunit.client.0.smithi079.stdout:3/606: mkdir d4/da/d17/d9b/db1 0 2024-09-10T09:36:07.124 INFO:tasks.workunit.client.0.smithi079.stdout:1/679: rename d5/df/l10 to d5/df/dd0/da0/d6e/dc5/dd1/ldf 0 2024-09-10T09:36:07.126 INFO:tasks.workunit.client.0.smithi079.stdout:6/616: symlink d4/d8/dc/d12/d29/lc9 0 2024-09-10T09:36:07.126 INFO:tasks.workunit.client.0.smithi079.stdout:6/617: creat d4/d8/dd/d41/fca x:0 0 0 2024-09-10T09:36:07.126 INFO:tasks.workunit.client.0.smithi079.stdout:6/618: dread - d4/d8/dd/d76/d46/d88/fb9 zero size 2024-09-10T09:36:07.126 INFO:tasks.workunit.client.0.smithi079.stdout:6/619: write d4/d8/dc/d1c/f1a [4940067,23127] 0 2024-09-10T09:36:07.127 INFO:tasks.workunit.client.0.smithi079.stdout:3/607: mknod d4/da/d17/d9b/db1/cb2 0 2024-09-10T09:36:07.128 INFO:tasks.workunit.client.0.smithi079.stdout:1/680: symlink d5/d40/le0 0 2024-09-10T09:36:07.128 INFO:tasks.workunit.client.0.smithi079.stdout:1/681: stat d5/df/dd0/d57 0 2024-09-10T09:36:07.129 INFO:tasks.workunit.client.0.smithi079.stdout:1/682: truncate d5/d24/d36/d3a/fd7 1047780 0 2024-09-10T09:36:07.132 INFO:tasks.workunit.client.0.smithi079.stdout:0/530: write d4/d12/d16/d53/f64 [1345985,91723] 0 2024-09-10T09:36:07.134 INFO:tasks.workunit.client.0.smithi079.stdout:5/548: dwrite d2/d3/d27/f2c [0,4194304] 0 2024-09-10T09:36:07.134 INFO:tasks.workunit.client.0.smithi079.stdout:1/683: mknod d5/d24/d36/d3a/d48/ce1 0 2024-09-10T09:36:07.137 INFO:tasks.workunit.client.0.smithi079.stdout:0/531: link d4/d12/d21/d3f/c42 d4/d12/d1a/d6d/cb7 0 2024-09-10T09:36:07.140 INFO:tasks.workunit.client.0.smithi079.stdout:5/549: mknod d2/d3/d27/d70/d80/cbe 0 2024-09-10T09:36:07.141 INFO:tasks.workunit.client.0.smithi079.stdout:9/492: dwrite d3/d7/dc/de/d17/d6e/f92 [0,4194304] 0 2024-09-10T09:36:07.141 INFO:tasks.workunit.client.0.smithi079.stdout:3/608: dread d4/da/f6c [0,4194304] 0 2024-09-10T09:36:07.141 INFO:tasks.workunit.client.0.smithi079.stdout:9/493: read - d3/d7/dc/f41 zero size 2024-09-10T09:36:07.141 INFO:tasks.workunit.client.0.smithi079.stdout:9/494: write d3/d7/dc/f95 [765628,86431] 0 2024-09-10T09:36:07.142 INFO:tasks.workunit.client.0.smithi079.stdout:1/684: link d5/d24/l2a d5/d4f/le2 0 2024-09-10T09:36:07.146 INFO:tasks.workunit.client.0.smithi079.stdout:6/620: dwrite d4/d8/dc/d98/fa2 [0,4194304] 0 2024-09-10T09:36:07.152 INFO:tasks.workunit.client.0.smithi079.stdout:3/609: creat d4/da/d17/d2d/d43/fb3 x:0 0 0 2024-09-10T09:36:07.152 INFO:tasks.workunit.client.0.smithi079.stdout:3/610: dread - d4/da/d18/daf/fa6 zero size 2024-09-10T09:36:07.152 INFO:tasks.workunit.client.0.smithi079.stdout:3/611: chown d4/da/d18/l36 13032927 1 2024-09-10T09:36:07.156 INFO:tasks.workunit.client.0.smithi079.stdout:0/532: rmdir d4/d12/d8b 39 2024-09-10T09:36:07.158 INFO:tasks.workunit.client.0.smithi079.stdout:5/550: getdents d2/d3/d27/d70/d80/d94 0 2024-09-10T09:36:07.158 INFO:tasks.workunit.client.0.smithi079.stdout:5/551: dread - d2/d3/fb3 zero size 2024-09-10T09:36:07.163 INFO:tasks.workunit.client.0.smithi079.stdout:6/621: readlink d4/d8/dc/d1c/l52 0 2024-09-10T09:36:07.164 INFO:tasks.workunit.client.0.smithi079.stdout:3/612: symlink d4/da/d17/d72/lb4 0 2024-09-10T09:36:07.164 INFO:tasks.workunit.client.0.smithi079.stdout:3/613: chown d4 12 1 2024-09-10T09:36:07.164 INFO:tasks.workunit.client.0.smithi079.stdout:3/614: readlink d4/da/d56/d7b/l98 0 2024-09-10T09:36:07.166 INFO:tasks.workunit.client.0.smithi079.stdout:9/495: rmdir d3/d40 39 2024-09-10T09:36:07.172 INFO:tasks.workunit.client.0.smithi079.stdout:6/622: dread d4/d8/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:07.181 INFO:tasks.workunit.client.0.smithi079.stdout:1/685: rename d5/d24/d36/d3a/d48 to d5/d24/d36/d53/db3/de3 0 2024-09-10T09:36:07.181 INFO:tasks.workunit.client.0.smithi079.stdout:1/686: truncate d5/df/d11/fd3 268330 0 2024-09-10T09:36:07.181 INFO:tasks.workunit.client.0.smithi079.stdout:3/615: dwrite d4/da/d17/d2d/d43/d4c/f60 [0,4194304] 0 2024-09-10T09:36:07.181 INFO:tasks.workunit.client.0.smithi079.stdout:5/552: dread d2/d3/d27/d32/d44/f7c [0,4194304] 0 2024-09-10T09:36:07.183 INFO:tasks.workunit.client.0.smithi079.stdout:9/496: mkdir d3/d7/dc/de/d17/d2f/d98 0 2024-09-10T09:36:07.188 INFO:tasks.workunit.client.0.smithi079.stdout:4/564: sync 2024-09-10T09:36:07.189 INFO:tasks.workunit.client.0.smithi079.stdout:0/533: rmdir d4/d12 39 2024-09-10T09:36:07.190 INFO:tasks.workunit.client.0.smithi079.stdout:6/623: symlink d4/d8/dc/lcb 0 2024-09-10T09:36:07.193 INFO:tasks.workunit.client.0.smithi079.stdout:6/624: write d4/d8/f5d [24760,54243] 0 2024-09-10T09:36:07.193 INFO:tasks.workunit.client.0.smithi079.stdout:6/625: chown d4/d8/dc/f66 46 1 2024-09-10T09:36:07.193 INFO:tasks.workunit.client.0.smithi079.stdout:6/626: fdatasync d4/d8/dc/d12/d29/db5/fbc 0 2024-09-10T09:36:07.193 INFO:tasks.workunit.client.0.smithi079.stdout:6/627: write d4/d8/dd/d76/d46/f3a [511729,107526] 0 2024-09-10T09:36:07.194 INFO:tasks.workunit.client.0.smithi079.stdout:1/687: rename d5/fc3 to d5/df/dd0/da0/ddb/fe4 0 2024-09-10T09:36:07.195 INFO:tasks.workunit.client.0.smithi079.stdout:2/471: sync 2024-09-10T09:36:07.196 INFO:tasks.workunit.client.0.smithi079.stdout:7/540: sync 2024-09-10T09:36:07.197 INFO:tasks.workunit.client.0.smithi079.stdout:6/628: dread d4/d8/dc/d93/da0/fc5 [0,4194304] 0 2024-09-10T09:36:07.197 INFO:tasks.workunit.client.0.smithi079.stdout:6/629: readlink d4/d8/dc/lcb 0 2024-09-10T09:36:07.197 INFO:tasks.workunit.client.0.smithi079.stdout:6/630: fsync d4/d8/dc/f6f 0 2024-09-10T09:36:07.197 INFO:tasks.workunit.client.0.smithi079.stdout:6/631: dread - d4/d8/dc/d93/fba zero size 2024-09-10T09:36:07.197 INFO:tasks.workunit.client.0.smithi079.stdout:1/688: write d5/d24/d36/d3a/fd7 [223002,66440] 0 2024-09-10T09:36:07.197 INFO:tasks.workunit.client.0.smithi079.stdout:1/689: fdatasync d5/df/dd0/f78 0 2024-09-10T09:36:07.200 INFO:tasks.workunit.client.0.smithi079.stdout:8/559: sync 2024-09-10T09:36:07.203 INFO:tasks.workunit.client.0.smithi079.stdout:0/534: write d4/d12/d21/f2c [2728183,41078] 0 2024-09-10T09:36:07.203 INFO:tasks.workunit.client.0.smithi079.stdout:2/472: mkdir d4/dc/d13/d61/d62/d92 0 2024-09-10T09:36:07.205 INFO:tasks.workunit.client.0.smithi079.stdout:2/473: write d4/dc/d1c/d59/f51 [390466,41473] 0 2024-09-10T09:36:07.205 INFO:tasks.workunit.client.0.smithi079.stdout:2/474: fdatasync d4/dc/d1c/d86/d1b/d38/d39/d31/f3b 0 2024-09-10T09:36:07.205 INFO:tasks.workunit.client.0.smithi079.stdout:9/497: getdents d3/d7/d26/d3d 0 2024-09-10T09:36:07.209 INFO:tasks.workunit.client.0.smithi079.stdout:7/541: rmdir d4/d6/d38 39 2024-09-10T09:36:07.209 INFO:tasks.workunit.client.0.smithi079.stdout:8/560: mkdir d11/d2b/d4b/d50/d55/db8 0 2024-09-10T09:36:07.209 INFO:tasks.workunit.client.0.smithi079.stdout:7/542: readlink d4/d6/d38/l89 0 2024-09-10T09:36:07.209 INFO:tasks.workunit.client.0.smithi079.stdout:8/561: chown d11/d48/c7d 28 1 2024-09-10T09:36:07.209 INFO:tasks.workunit.client.0.smithi079.stdout:8/562: creat d11/d2b/d4b/da8/fb9 x:0 0 0 2024-09-10T09:36:07.209 INFO:tasks.workunit.client.0.smithi079.stdout:8/563: dread - d11/d2b/d4b/da8/fb9 zero size 2024-09-10T09:36:07.210 INFO:tasks.workunit.client.0.smithi079.stdout:6/632: getdents d4/d8/dd/d76/d46/d88 0 2024-09-10T09:36:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:06 smithi079 ceph-mon[27592]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:06 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/3030614822' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:36:07.213 INFO:tasks.workunit.client.0.smithi079.stdout:9/498: rename d3/d7/dc/c59 to d3/d7/dc/de/d17/d12/c99 0 2024-09-10T09:36:07.217 INFO:tasks.workunit.client.0.smithi079.stdout:5/553: dwrite d2/d3/fb [4194304,4194304] 0 2024-09-10T09:36:07.217 INFO:tasks.workunit.client.0.smithi079.stdout:5/554: stat d2 0 2024-09-10T09:36:07.217 INFO:tasks.workunit.client.0.smithi079.stdout:5/555: write d2/d3/f28 [4274042,9621] 0 2024-09-10T09:36:07.218 INFO:tasks.workunit.client.0.smithi079.stdout:8/564: creat d11/d2b/d4b/d74/da2/fba x:0 0 0 2024-09-10T09:36:07.218 INFO:tasks.workunit.client.0.smithi079.stdout:6/633: truncate d4/d8/dd/d41/d51/f5c 2180761 0 2024-09-10T09:36:07.218 INFO:tasks.workunit.client.0.smithi079.stdout:6/634: chown d4/d8/c9 137851 1 2024-09-10T09:36:07.218 INFO:tasks.workunit.client.0.smithi079.stdout:8/565: write d11/d2b/d4b/f77 [699684,6146] 0 2024-09-10T09:36:07.222 INFO:tasks.workunit.client.0.smithi079.stdout:9/499: link d3/d7/dc/f36 d3/d7/d26/d69/f9a 0 2024-09-10T09:36:07.224 INFO:tasks.workunit.client.0.smithi079.stdout:7/543: write d4/df/d3d/f40 [857804,53279] 0 2024-09-10T09:36:07.225 INFO:tasks.workunit.client.0.smithi079.stdout:9/500: dread d3/d40/f47 [0,4194304] 0 2024-09-10T09:36:07.225 INFO:tasks.workunit.client.0.smithi079.stdout:9/501: chown d3 598800 1 2024-09-10T09:36:07.225 INFO:tasks.workunit.client.0.smithi079.stdout:3/616: dwrite d4/da/d17/d2d/d43/d4c/f92 [0,4194304] 0 2024-09-10T09:36:07.226 INFO:tasks.workunit.client.0.smithi079.stdout:6/635: rename d4/d8/dc/d1c/f81 to d4/d8/dc/d12/d29/fcc 0 2024-09-10T09:36:07.228 INFO:tasks.workunit.client.0.smithi079.stdout:2/475: dwrite d4/dc/d1c/d86/d1b/d38/d39/f7b [0,4194304] 0 2024-09-10T09:36:07.231 INFO:tasks.workunit.client.0.smithi079.stdout:1/690: dwrite d5/d24/fba [0,4194304] 0 2024-09-10T09:36:07.233 INFO:tasks.workunit.client.0.smithi079.stdout:9/502: mknod d3/d7/dc/de/d58/c9b 0 2024-09-10T09:36:07.234 INFO:tasks.workunit.client.0.smithi079.stdout:3/617: mkdir d4/da/d18/db5 0 2024-09-10T09:36:07.237 INFO:tasks.workunit.client.0.smithi079.stdout:7/544: dread d4/df/f77 [0,4194304] 0 2024-09-10T09:36:07.237 INFO:tasks.workunit.client.0.smithi079.stdout:7/545: chown d4/d6/d38/l58 208659264 1 2024-09-10T09:36:07.240 INFO:tasks.workunit.client.0.smithi079.stdout:1/691: mknod d5/df/d11/d76/dad/ce5 0 2024-09-10T09:36:07.240 INFO:tasks.workunit.client.0.smithi079.stdout:1/692: fdatasync d5/df/f52 0 2024-09-10T09:36:07.240 INFO:tasks.workunit.client.0.smithi079.stdout:1/693: fsync d5/df/dd0/f7d 0 2024-09-10T09:36:07.240 INFO:tasks.workunit.client.0.smithi079.stdout:1/694: stat d5/d24/d36/d3a/d85/l8f 0 2024-09-10T09:36:07.241 INFO:tasks.workunit.client.0.smithi079.stdout:1/695: stat d5/df/l37 0 2024-09-10T09:36:07.241 INFO:tasks.workunit.client.0.smithi079.stdout:9/503: rename d3/d40/f4e to d3/d7/dc/de/d17/d2f/d30/f9c 0 2024-09-10T09:36:07.241 INFO:tasks.workunit.client.0.smithi079.stdout:4/565: dwrite d1/da/d28/d47/da1/d83/f93 [0,4194304] 0 2024-09-10T09:36:07.242 INFO:tasks.workunit.client.0.smithi079.stdout:4/566: chown d1/da/d3b/d5a/l5d 190798968 1 2024-09-10T09:36:07.249 INFO:tasks.workunit.client.0.smithi079.stdout:7/546: write d4/df/d3d/f64 [3786793,40034] 0 2024-09-10T09:36:07.249 INFO:tasks.workunit.client.0.smithi079.stdout:7/547: creat d4/dc/d43/fa5 x:0 0 0 2024-09-10T09:36:07.249 INFO:tasks.workunit.client.0.smithi079.stdout:7/548: readlink d4/dc/l1f 0 2024-09-10T09:36:07.250 INFO:tasks.workunit.client.0.smithi079.stdout:4/567: rename d1/da/d16/c1d to d1/da/d16/d4d/cb1 0 2024-09-10T09:36:07.250 INFO:tasks.workunit.client.0.smithi079.stdout:4/568: write d1/da/d3b/d5f/f62 [1713436,37653] 0 2024-09-10T09:36:07.252 INFO:tasks.workunit.client.0.smithi079.stdout:5/556: dwrite d2/d3/d27/d32/f4f [0,4194304] 0 2024-09-10T09:36:07.252 INFO:tasks.workunit.client.0.smithi079.stdout:5/557: fdatasync d2/d3/d5e/d85/f89 0 2024-09-10T09:36:07.254 INFO:tasks.workunit.client.0.smithi079.stdout:7/549: unlink d4/df/l47 0 2024-09-10T09:36:07.258 INFO:tasks.workunit.client.0.smithi079.stdout:4/569: dread d1/da/f3f [0,4194304] 0 2024-09-10T09:36:07.263 INFO:tasks.workunit.client.0.smithi079.stdout:8/566: dwrite d11/d48/f66 [0,4194304] 0 2024-09-10T09:36:07.266 INFO:tasks.workunit.client.0.smithi079.stdout:4/570: rename d1/da/d28/d47/c50 to d1/da/d16/d57/cb2 0 2024-09-10T09:36:07.269 INFO:tasks.workunit.client.0.smithi079.stdout:8/567: creat d11/d2b/fbb x:0 0 0 2024-09-10T09:36:07.271 INFO:tasks.workunit.client.0.smithi079.stdout:1/696: dread d5/d24/f2f [0,4194304] 0 2024-09-10T09:36:07.271 INFO:tasks.workunit.client.0.smithi079.stdout:4/571: mkdir d1/da/d3b/db3 0 2024-09-10T09:36:07.271 INFO:tasks.workunit.client.0.smithi079.stdout:4/572: write d1/da/d16/f27 [2315746,12428] 0 2024-09-10T09:36:07.275 INFO:tasks.workunit.client.0.smithi079.stdout:8/568: mknod d11/d2b/d4b/d50/d5c/cbc 0 2024-09-10T09:36:07.275 INFO:tasks.workunit.client.0.smithi079.stdout:8/569: chown d11/f16 543296 1 2024-09-10T09:36:07.277 INFO:tasks.workunit.client.0.smithi079.stdout:1/697: rename d5/df/dd0/da0/ddb to d5/df/dc6/de6 0 2024-09-10T09:36:07.278 INFO:tasks.workunit.client.0.smithi079.stdout:5/558: write d2/d3/d27/f87 [726392,7672] 0 2024-09-10T09:36:07.278 INFO:tasks.workunit.client.0.smithi079.stdout:5/559: chown d2/c40 7907 1 2024-09-10T09:36:07.278 INFO:tasks.workunit.client.0.smithi079.stdout:4/573: mkdir d1/d9b/db4 0 2024-09-10T09:36:07.281 INFO:tasks.workunit.client.0.smithi079.stdout:8/570: mkdir d11/dbd 0 2024-09-10T09:36:07.282 INFO:tasks.workunit.client.0.smithi079.stdout:5/560: getdents d2/d3 0 2024-09-10T09:36:07.283 INFO:tasks.workunit.client.0.smithi079.stdout:8/571: truncate d11/d2b/d4b/d50/f57 4088276 0 2024-09-10T09:36:07.284 INFO:tasks.workunit.client.0.smithi079.stdout:8/572: rmdir d11/d2b/d4b/d50 39 2024-09-10T09:36:07.286 INFO:tasks.workunit.client.0.smithi079.stdout:1/698: dread d5/d24/d36/d53/db3/de3/f99 [0,4194304] 0 2024-09-10T09:36:07.287 INFO:tasks.workunit.client.0.smithi079.stdout:7/550: dwrite d4/df/f77 [0,4194304] 0 2024-09-10T09:36:07.287 INFO:tasks.workunit.client.0.smithi079.stdout:7/551: write d4/df/d6b/f8e [1009720,58355] 0 2024-09-10T09:36:07.288 INFO:tasks.workunit.client.0.smithi079.stdout:1/699: creat d5/d9e/dc9/fe7 x:0 0 0 2024-09-10T09:36:07.288 INFO:tasks.workunit.client.0.smithi079.stdout:3/618: dwrite d4/da/d17/d2d/d43/d49/f6f [0,4194304] 0 2024-09-10T09:36:07.288 INFO:tasks.workunit.client.0.smithi079.stdout:3/619: write d4/da/d17/fa2 [617373,32964] 0 2024-09-10T09:36:07.289 INFO:tasks.workunit.client.0.smithi079.stdout:2/476: dwrite d4/dc/d1c/d86/f16 [0,4194304] 0 2024-09-10T09:36:07.289 INFO:tasks.workunit.client.0.smithi079.stdout:9/504: dwrite d3/d40/f81 [4194304,4194304] 0 2024-09-10T09:36:07.289 INFO:tasks.workunit.client.0.smithi079.stdout:9/505: chown d3/d7 95541633 1 2024-09-10T09:36:07.289 INFO:tasks.workunit.client.0.smithi079.stdout:2/477: chown d4/dc/d1c/d86/d1b/d38/d39/d31/l44 72960 1 2024-09-10T09:36:07.292 INFO:tasks.workunit.client.0.smithi079.stdout:1/700: mkdir d5/d40/d46/de8 0 2024-09-10T09:36:07.297 INFO:tasks.workunit.client.0.smithi079.stdout:3/620: mknod d4/da/d56/d7b/cb6 0 2024-09-10T09:36:07.300 INFO:tasks.workunit.client.0.smithi079.stdout:9/506: symlink d3/d7/d26/l9d 0 2024-09-10T09:36:07.303 INFO:tasks.workunit.client.0.smithi079.stdout:7/552: dread d4/f1c [0,4194304] 0 2024-09-10T09:36:07.303 INFO:tasks.workunit.client.0.smithi079.stdout:7/553: chown d4/l62 138465552 1 2024-09-10T09:36:07.304 INFO:tasks.workunit.client.0.smithi079.stdout:3/621: mkdir d4/da/d17/d38/db7 0 2024-09-10T09:36:07.304 INFO:tasks.workunit.client.0.smithi079.stdout:3/622: fdatasync d4/da/d17/f52 0 2024-09-10T09:36:07.306 INFO:tasks.workunit.client.0.smithi079.stdout:9/507: mkdir d3/d7/dc/de/d58/d9e 0 2024-09-10T09:36:07.308 INFO:tasks.workunit.client.0.smithi079.stdout:2/478: rename d4/dc/d13 to d4/dc/d1c/d86/d93 0 2024-09-10T09:36:07.311 INFO:tasks.workunit.client.0.smithi079.stdout:7/554: rename d4/dc/l1f to d4/dc/d43/la6 0 2024-09-10T09:36:07.311 INFO:tasks.workunit.client.0.smithi079.stdout:7/555: write d4/f7f [368084,48928] 0 2024-09-10T09:36:07.311 INFO:tasks.workunit.client.0.smithi079.stdout:5/561: dwrite d2/d3/d5e/d61/fb0 [0,4194304] 0 2024-09-10T09:36:07.311 INFO:tasks.workunit.client.0.smithi079.stdout:5/562: write d2/d3/f79 [564295,90999] 0 2024-09-10T09:36:07.317 INFO:tasks.workunit.client.0.smithi079.stdout:8/573: dwrite d11/d48/f8f [0,4194304] 0 2024-09-10T09:36:07.318 INFO:tasks.workunit.client.0.smithi079.stdout:8/574: dread d11/d2b/d4b/d74/f83 [0,4194304] 0 2024-09-10T09:36:07.319 INFO:tasks.workunit.client.0.smithi079.stdout:5/563: mknod d2/d3/d27/d70/cbf 0 2024-09-10T09:36:07.321 INFO:tasks.workunit.client.0.smithi079.stdout:4/574: getdents d1/d9b 0 2024-09-10T09:36:07.322 INFO:tasks.workunit.client.0.smithi079.stdout:7/556: dread d4/df/d3d/f56 [0,4194304] 0 2024-09-10T09:36:07.327 INFO:tasks.workunit.client.0.smithi079.stdout:8/575: write d11/d48/f6a [2997835,5059] 0 2024-09-10T09:36:07.327 INFO:tasks.workunit.client.0.smithi079.stdout:3/623: dwrite d4/f73 [4194304,4194304] 0 2024-09-10T09:36:07.327 INFO:tasks.workunit.client.0.smithi079.stdout:4/575: unlink d1/da/f3f 0 2024-09-10T09:36:07.327 INFO:tasks.workunit.client.0.smithi079.stdout:4/576: chown d1/da/d16/d57/f7d 113894 1 2024-09-10T09:36:07.327 INFO:tasks.workunit.client.0.smithi079.stdout:4/577: creat d1/da/d28/fb5 x:0 0 0 2024-09-10T09:36:07.328 INFO:tasks.workunit.client.0.smithi079.stdout:5/564: link d2/f26 d2/d3/d27/fc0 0 2024-09-10T09:36:07.337 INFO:tasks.workunit.client.0.smithi079.stdout:3/624: mkdir d4/da/d67/db8 0 2024-09-10T09:36:07.337 INFO:tasks.workunit.client.0.smithi079.stdout:3/625: creat d4/da/d17/d2d/d43/fb9 x:0 0 0 2024-09-10T09:36:07.338 INFO:tasks.workunit.client.0.smithi079.stdout:2/479: rmdir d4/dc 39 2024-09-10T09:36:07.341 INFO:tasks.workunit.client.0.smithi079.stdout:4/578: link d1/l5 d1/da/lb6 0 2024-09-10T09:36:07.341 INFO:tasks.workunit.client.0.smithi079.stdout:4/579: chown d1/da/d28/d47/da1/d83/fa6 34 1 2024-09-10T09:36:07.342 INFO:tasks.workunit.client.0.smithi079.stdout:8/576: getdents d11/d48 0 2024-09-10T09:36:07.343 INFO:tasks.workunit.client.0.smithi079.stdout:8/577: truncate d11/d2b/d4b/d50/d55/f53 4628709 0 2024-09-10T09:36:07.343 INFO:tasks.workunit.client.0.smithi079.stdout:4/580: dread d1/da/d16/f24 [0,4194304] 0 2024-09-10T09:36:07.345 INFO:tasks.workunit.client.0.smithi079.stdout:3/626: creat d4/da/d17/d2d/d78/fba x:0 0 0 2024-09-10T09:36:07.345 INFO:tasks.workunit.client.0.smithi079.stdout:3/627: chown d4/da/d17/d2d/fa1 2089538 1 2024-09-10T09:36:07.347 INFO:tasks.workunit.client.0.smithi079.stdout:5/565: symlink d2/d3/d27/d32/d44/db4/lc1 0 2024-09-10T09:36:07.347 INFO:tasks.workunit.client.0.smithi079.stdout:5/566: truncate d2/f58 401292 0 2024-09-10T09:36:07.349 INFO:tasks.workunit.client.0.smithi079.stdout:4/581: rename d1/da/d3b/d5a/f8c to d1/da/d16/d4d/fb7 0 2024-09-10T09:36:07.350 INFO:tasks.workunit.client.0.smithi079.stdout:2/480: mknod d4/dc/c94 0 2024-09-10T09:36:07.350 INFO:tasks.workunit.client.0.smithi079.stdout:2/481: write d4/dc/d1c/f28 [225935,96231] 0 2024-09-10T09:36:07.352 INFO:tasks.workunit.client.0.smithi079.stdout:5/567: read - d2/d3/d27/d32/d44/f66 zero size 2024-09-10T09:36:07.355 INFO:tasks.workunit.client.0.smithi079.stdout:5/568: dread d2/d3/f99 [0,4194304] 0 2024-09-10T09:36:07.355 INFO:tasks.workunit.client.0.smithi079.stdout:5/569: readlink d2/d3/lc 0 2024-09-10T09:36:07.355 INFO:tasks.workunit.client.0.smithi079.stdout:5/570: truncate d2/d3/d27/f43 4708697 0 2024-09-10T09:36:07.355 INFO:tasks.workunit.client.0.smithi079.stdout:5/571: read - d2/d3/d27/d32/f72 zero size 2024-09-10T09:36:07.355 INFO:tasks.workunit.client.0.smithi079.stdout:5/572: write d2/d3/d27/d32/f90 [5023470,31230] 0 2024-09-10T09:36:07.355 INFO:tasks.workunit.client.0.smithi079.stdout:3/628: rename d4/da/d17/d2d/d78/fba to d4/da/fbb 0 2024-09-10T09:36:07.356 INFO:tasks.workunit.client.0.smithi079.stdout:4/582: symlink d1/da/d3b/d5f/lb8 0 2024-09-10T09:36:07.356 INFO:tasks.workunit.client.0.smithi079.stdout:4/583: write d1/da/d16/d21/f9e [21008,10476] 0 2024-09-10T09:36:07.358 INFO:tasks.workunit.client.0.smithi079.stdout:3/629: creat d4/da/d18/fbc x:0 0 0 2024-09-10T09:36:07.360 INFO:tasks.workunit.client.0.smithi079.stdout:3/630: write d4/da/d17/d2d/d43/f7d [243124,84418] 0 2024-09-10T09:36:07.360 INFO:tasks.workunit.client.0.smithi079.stdout:3/631: creat d4/da/d17/d2d/d78/fbd x:0 0 0 2024-09-10T09:36:07.361 INFO:tasks.workunit.client.0.smithi079.stdout:8/578: dwrite d11/d2b/d4b/d50/d55/fa6 [0,4194304] 0 2024-09-10T09:36:07.361 INFO:tasks.workunit.client.0.smithi079.stdout:2/482: write d4/dc/d1c/f34 [1444852,29597] 0 2024-09-10T09:36:07.521 INFO:tasks.workunit.client.0.smithi079.stdout:8/579: truncate d11/f20 4558083 0 2024-09-10T09:36:07.522 INFO:tasks.workunit.client.0.smithi079.stdout:2/483: link d4/c26 d4/dc/d1c/d86/d93/d61/d65/d77/d7e/c95 0 2024-09-10T09:36:07.523 INFO:tasks.workunit.client.0.smithi079.stdout:2/484: dread - d4/dc/d1c/d86/d93/d61/d65/d77/f78 zero size 2024-09-10T09:36:07.523 INFO:tasks.workunit.client.0.smithi079.stdout:2/485: chown d4/dc/l11 56985 1 2024-09-10T09:36:07.523 INFO:tasks.workunit.client.0.smithi079.stdout:8/580: creat d11/d2b/d4b/d7e/db2/fbe x:0 0 0 2024-09-10T09:36:07.525 INFO:tasks.workunit.client.0.smithi079.stdout:5/573: dwrite d2/d3/f83 [0,4194304] 0 2024-09-10T09:36:07.526 INFO:tasks.workunit.client.0.smithi079.stdout:2/486: symlink d4/dc/d1c/d86/d93/d61/l96 0 2024-09-10T09:36:07.527 INFO:tasks.workunit.client.0.smithi079.stdout:3/632: dwrite d4/f4d [0,4194304] 0 2024-09-10T09:36:07.527 INFO:tasks.workunit.client.0.smithi079.stdout:3/633: write d4/da/d17/d72/f9c [736359,17046] 0 2024-09-10T09:36:07.527 INFO:tasks.workunit.client.0.smithi079.stdout:3/634: chown d4/da/d17/d2d/d43/fb9 1890466639 1 2024-09-10T09:36:07.527 INFO:tasks.workunit.client.0.smithi079.stdout:8/581: mknod d11/d2b/d4b/d50/d5c/cbf 0 2024-09-10T09:36:07.527 INFO:tasks.workunit.client.0.smithi079.stdout:8/582: fsync d11/d2b/f75 0 2024-09-10T09:36:07.527 INFO:tasks.workunit.client.0.smithi079.stdout:8/583: fdatasync d11/d2b/d4b/d50/f89 0 2024-09-10T09:36:07.530 INFO:tasks.workunit.client.0.smithi079.stdout:5/574: truncate d2/d3/d5e/d73/f7a 1432665 0 2024-09-10T09:36:07.536 INFO:tasks.workunit.client.0.smithi079.stdout:3/635: unlink d4/c3a 0 2024-09-10T09:36:07.537 INFO:tasks.workunit.client.0.smithi079.stdout:5/575: mkdir d2/d3/d27/d32/d39/dc2 0 2024-09-10T09:36:07.537 INFO:tasks.workunit.client.0.smithi079.stdout:5/576: chown d2/d41/c6f 249510628 1 2024-09-10T09:36:07.539 INFO:tasks.workunit.client.0.smithi079.stdout:5/577: creat d2/fc3 x:0 0 0 2024-09-10T09:36:07.539 INFO:tasks.workunit.client.0.smithi079.stdout:5/578: truncate d2/d3/d59/f98 634547 0 2024-09-10T09:36:07.540 INFO:tasks.workunit.client.0.smithi079.stdout:8/584: dread d11/f1e [0,4194304] 0 2024-09-10T09:36:07.540 INFO:tasks.workunit.client.0.smithi079.stdout:8/585: readlink d11/l1c 0 2024-09-10T09:36:07.540 INFO:tasks.workunit.client.0.smithi079.stdout:2/487: rename d4/dc/c1a to d4/dc/c97 0 2024-09-10T09:36:07.541 INFO:tasks.workunit.client.0.smithi079.stdout:5/579: mkdir d2/d3/d27/d32/d39/dc4 0 2024-09-10T09:36:07.542 INFO:tasks.workunit.client.0.smithi079.stdout:8/586: link d11/d2b/d4b/f93 d11/d2b/d4b/d74/da2/fc0 0 2024-09-10T09:36:07.543 INFO:tasks.workunit.client.0.smithi079.stdout:3/636: dread d4/f29 [0,4194304] 0 2024-09-10T09:36:07.544 INFO:tasks.workunit.client.0.smithi079.stdout:2/488: creat d4/dc/d1c/d86/f98 x:0 0 0 2024-09-10T09:36:07.546 INFO:tasks.workunit.client.0.smithi079.stdout:3/637: dread d4/da/d17/d38/d42/f53 [0,4194304] 0 2024-09-10T09:36:07.546 INFO:tasks.workunit.client.0.smithi079.stdout:3/638: stat d4/da/d17/d2d/d43/d4c/f95 0 2024-09-10T09:36:07.548 INFO:tasks.workunit.client.0.smithi079.stdout:5/580: getdents d2/d3/d5e/d61 0 2024-09-10T09:36:07.548 INFO:tasks.workunit.client.0.smithi079.stdout:0/535: sync 2024-09-10T09:36:07.548 INFO:tasks.workunit.client.0.smithi079.stdout:0/536: chown d4/d1d/d24 14 1 2024-09-10T09:36:07.548 INFO:tasks.workunit.client.0.smithi079.stdout:0/537: chown d4/d12/d1a/d6d 2 1 2024-09-10T09:36:07.548 INFO:tasks.workunit.client.0.smithi079.stdout:6/636: sync 2024-09-10T09:36:07.549 INFO:tasks.workunit.client.0.smithi079.stdout:0/538: read d4/d12/d1a/d29/f37 [709737,10526] 0 2024-09-10T09:36:07.553 INFO:tasks.workunit.client.0.smithi079.stdout:3/639: unlink d4/da/d56/d7b/cb6 0 2024-09-10T09:36:07.555 INFO:tasks.workunit.client.0.smithi079.stdout:5/581: mknod d2/d3/d27/d32/d44/db4/cc5 0 2024-09-10T09:36:07.556 INFO:tasks.workunit.client.0.smithi079.stdout:0/539: truncate d4/d12/d15/d2b/f63 34386 0 2024-09-10T09:36:07.557 INFO:tasks.workunit.client.0.smithi079.stdout:5/582: creat d2/d3/d27/fc6 x:0 0 0 2024-09-10T09:36:07.558 INFO:tasks.workunit.client.0.smithi079.stdout:5/583: truncate d2/d3/d59/f7d 631402 0 2024-09-10T09:36:07.559 INFO:tasks.workunit.client.0.smithi079.stdout:2/489: rename d4/dc/d1c/d86/d93 to d4/dc/d1c/d86/d1b/d38/d39/d99 0 2024-09-10T09:36:07.560 INFO:tasks.workunit.client.0.smithi079.stdout:5/584: mknod d2/d41/cc7 0 2024-09-10T09:36:07.561 INFO:tasks.workunit.client.0.smithi079.stdout:0/540: write d4/d12/d1a/d6d/d84/f9e [606315,60675] 0 2024-09-10T09:36:07.561 INFO:tasks.workunit.client.0.smithi079.stdout:8/587: dwrite d11/d2b/fbb [0,4194304] 0 2024-09-10T09:36:07.564 INFO:tasks.workunit.client.0.smithi079.stdout:2/490: unlink d4/c42 0 2024-09-10T09:36:07.564 INFO:tasks.workunit.client.0.smithi079.stdout:2/491: truncate d4/f7a 865541 0 2024-09-10T09:36:07.566 INFO:tasks.workunit.client.0.smithi079.stdout:5/585: link d2/c19 d2/d41/d4d/cc8 0 2024-09-10T09:36:07.566 INFO:tasks.workunit.client.0.smithi079.stdout:7/557: sync 2024-09-10T09:36:07.566 INFO:tasks.workunit.client.0.smithi079.stdout:1/701: sync 2024-09-10T09:36:07.567 INFO:tasks.workunit.client.0.smithi079.stdout:9/508: sync 2024-09-10T09:36:07.567 INFO:tasks.workunit.client.0.smithi079.stdout:7/558: stat d4/dc/d43/f57 0 2024-09-10T09:36:07.567 INFO:tasks.workunit.client.0.smithi079.stdout:1/702: write d5/d24/d36/f9a [70662,27190] 0 2024-09-10T09:36:07.567 INFO:tasks.workunit.client.0.smithi079.stdout:1/703: write d5/df/dd0/da0/d6e/dc5/dd1/fbb [681872,11429] 0 2024-09-10T09:36:07.567 INFO:tasks.workunit.client.0.smithi079.stdout:1/704: chown d5/f15 14083248 1 2024-09-10T09:36:07.572 INFO:tasks.workunit.client.0.smithi079.stdout:6/637: dwrite d4/d8/dc/d1c/f1a [0,4194304] 0 2024-09-10T09:36:07.573 INFO:tasks.workunit.client.0.smithi079.stdout:2/492: unlink d4/dc/d1c/d86/d1b/d38/d39/d31/c4b 0 2024-09-10T09:36:07.573 INFO:tasks.workunit.client.0.smithi079.stdout:2/493: creat d4/d5d/f9a x:0 0 0 2024-09-10T09:36:07.575 INFO:tasks.workunit.client.0.smithi079.stdout:9/509: link d3/d7/f5b d3/d7/f9f 0 2024-09-10T09:36:07.576 INFO:tasks.workunit.client.0.smithi079.stdout:7/559: mkdir d4/d6/d4f/da7 0 2024-09-10T09:36:07.576 INFO:tasks.workunit.client.0.smithi079.stdout:7/560: creat d4/df/d3d/d75/fa8 x:0 0 0 2024-09-10T09:36:07.578 INFO:tasks.workunit.client.0.smithi079.stdout:1/705: link d5/df/dd0/da0/fc7 d5/d24/d36/d79/fe9 0 2024-09-10T09:36:07.580 INFO:tasks.workunit.client.0.smithi079.stdout:2/494: write d4/dc/d1c/d86/d1b/d38/d39/d99/f33 [6299890,6762] 0 2024-09-10T09:36:07.583 INFO:tasks.workunit.client.0.smithi079.stdout:3/640: rename d4/da/d17/d62 to d4/da/d17/d2d/d78/dbe 0 2024-09-10T09:36:07.583 INFO:tasks.workunit.client.0.smithi079.stdout:3/641: truncate d4/da/d17/fa4 1010440 0 2024-09-10T09:36:07.583 INFO:tasks.workunit.client.0.smithi079.stdout:3/642: chown d4/da/d17/d2d/d43/faa 62675 1 2024-09-10T09:36:07.583 INFO:tasks.workunit.client.0.smithi079.stdout:3/643: readlink d4/da/d17/d2d/l3d 0 2024-09-10T09:36:07.586 INFO:tasks.workunit.client.0.smithi079.stdout:4/584: sync 2024-09-10T09:36:07.589 INFO:tasks.workunit.client.0.smithi079.stdout:7/561: dread d4/df/d3d/f56 [4194304,4194304] 0 2024-09-10T09:36:07.589 INFO:tasks.workunit.client.0.smithi079.stdout:7/562: stat d4/df/d19 0 2024-09-10T09:36:07.595 INFO:tasks.workunit.client.0.smithi079.stdout:9/510: creat d3/d7/dc/de/d17/d12/fa0 x:0 0 0 2024-09-10T09:36:07.598 INFO:tasks.workunit.client.0.smithi079.stdout:2/495: read d4/dc/d1c/d86/d1b/d38/d39/f45 [194114,105889] 0 2024-09-10T09:36:07.598 INFO:tasks.workunit.client.0.smithi079.stdout:5/586: dwrite d2/d3/d27/f49 [0,4194304] 0 2024-09-10T09:36:07.599 INFO:tasks.workunit.client.0.smithi079.stdout:7/563: dread d4/f7f [0,4194304] 0 2024-09-10T09:36:07.600 INFO:tasks.workunit.client.0.smithi079.stdout:1/706: truncate d5/df/f55 6364717 0 2024-09-10T09:36:07.600 INFO:tasks.workunit.client.0.smithi079.stdout:1/707: creat d5/fea x:0 0 0 2024-09-10T09:36:07.602 INFO:tasks.workunit.client.0.smithi079.stdout:4/585: mknod d1/da/d16/d88/cb9 0 2024-09-10T09:36:07.604 INFO:tasks.workunit.client.0.smithi079.stdout:3/644: dwrite d4/da/d17/d72/f9c [0,4194304] 0 2024-09-10T09:36:07.604 INFO:tasks.workunit.client.0.smithi079.stdout:3/645: fsync d4/da/d17/f32 0 2024-09-10T09:36:07.604 INFO:tasks.workunit.client.0.smithi079.stdout:9/511: mkdir d3/d7/dc/de/d17/d2f/d98/da1 0 2024-09-10T09:36:07.610 INFO:tasks.workunit.client.0.smithi079.stdout:5/587: dread d2/d41/f74 [0,4194304] 0 2024-09-10T09:36:07.610 INFO:tasks.workunit.client.0.smithi079.stdout:7/564: dread d4/d6/f2d [0,4194304] 0 2024-09-10T09:36:07.611 INFO:tasks.workunit.client.0.smithi079.stdout:8/588: rename d11/d2b/d4b/f69 to d11/fc1 0 2024-09-10T09:36:07.613 INFO:tasks.workunit.client.0.smithi079.stdout:4/586: mknod d1/cba 0 2024-09-10T09:36:07.621 INFO:tasks.workunit.client.0.smithi079.stdout:3/646: mknod d4/da/d17/d2d/cbf 0 2024-09-10T09:36:07.623 INFO:tasks.workunit.client.0.smithi079.stdout:5/588: rmdir d2/d3/d5e/d85 39 2024-09-10T09:36:07.625 INFO:tasks.workunit.client.0.smithi079.stdout:7/565: mkdir d4/d6/da9 0 2024-09-10T09:36:07.627 INFO:tasks.workunit.client.0.smithi079.stdout:2/496: dwrite d4/d5d/f9a [0,4194304] 0 2024-09-10T09:36:07.628 INFO:tasks.workunit.client.0.smithi079.stdout:6/638: rename d4/d8/dc/lcb to d4/d8/dc/d98/lcd 0 2024-09-10T09:36:07.631 INFO:tasks.workunit.client.0.smithi079.stdout:9/512: dwrite d3/d7/dc/de/d17/d2f/d30/f23 [0,4194304] 0 2024-09-10T09:36:07.633 INFO:tasks.workunit.client.0.smithi079.stdout:4/587: unlink d1/l2 0 2024-09-10T09:36:07.633 INFO:tasks.workunit.client.0.smithi079.stdout:3/647: creat d4/da/d17/d9b/db1/fc0 x:0 0 0 2024-09-10T09:36:07.637 INFO:tasks.workunit.client.0.smithi079.stdout:6/639: rename d4/d8/dd/d41/f54 to d4/d8/dc/d93/dc4/fce 0 2024-09-10T09:36:07.637 INFO:tasks.workunit.client.0.smithi079.stdout:6/640: readlink d4/d8/dc/d12/d29/l68 0 2024-09-10T09:36:07.639 INFO:tasks.workunit.client.0.smithi079.stdout:8/589: dwrite d11/f16 [0,4194304] 0 2024-09-10T09:36:07.640 INFO:tasks.workunit.client.0.smithi079.stdout:9/513: unlink d3/d7/l88 0 2024-09-10T09:36:07.640 INFO:tasks.workunit.client.0.smithi079.stdout:9/514: readlink d3/d7/d26/l29 0 2024-09-10T09:36:07.641 INFO:tasks.workunit.client.0.smithi079.stdout:6/641: creat d4/d8/d74/fcf x:0 0 0 2024-09-10T09:36:07.641 INFO:tasks.workunit.client.0.smithi079.stdout:4/588: dread d1/da/d3b/d5a/f78 [0,4194304] 0 2024-09-10T09:36:07.644 INFO:tasks.workunit.client.0.smithi079.stdout:7/566: getdents d4/df/d3d/d75 0 2024-09-10T09:36:07.646 INFO:tasks.workunit.client.0.smithi079.stdout:8/590: rmdir d11/d2b/d4b/d7e/da7/dac 0 2024-09-10T09:36:07.647 INFO:tasks.workunit.client.0.smithi079.stdout:9/515: mkdir d3/d7/d26/d69/da2 0 2024-09-10T09:36:07.649 INFO:tasks.workunit.client.0.smithi079.stdout:6/642: rename d4/d8/f5d to d4/d8/dd/d76/d46/d88/dbf/fd0 0 2024-09-10T09:36:07.650 INFO:tasks.workunit.client.0.smithi079.stdout:4/589: creat d1/da/dad/fbb x:0 0 0 2024-09-10T09:36:07.652 INFO:tasks.workunit.client.0.smithi079.stdout:7/567: symlink d4/laa 0 2024-09-10T09:36:07.652 INFO:tasks.workunit.client.0.smithi079.stdout:6/643: dread d4/d8/dd/f85 [0,4194304] 0 2024-09-10T09:36:07.652 INFO:tasks.workunit.client.0.smithi079.stdout:6/644: dread - d4/d8/dc/d12/d70/faa zero size 2024-09-10T09:36:07.657 INFO:tasks.workunit.client.0.smithi079.stdout:9/516: rename d3/d7/dc/de/d17/f52 to d3/d7/dc/de/d17/d2f/d74/fa3 0 2024-09-10T09:36:07.657 INFO:tasks.workunit.client.0.smithi079.stdout:3/648: dwrite d4/da/f57 [0,4194304] 0 2024-09-10T09:36:07.658 INFO:tasks.workunit.client.0.smithi079.stdout:2/497: dwrite d4/d5d/f9a [0,4194304] 0 2024-09-10T09:36:07.658 INFO:tasks.workunit.client.0.smithi079.stdout:2/498: fsync d4/dc/d1c/d86/ff 0 2024-09-10T09:36:07.659 INFO:tasks.workunit.client.0.smithi079.stdout:6/645: symlink d4/d8/dc/d93/d8a/ld1 0 2024-09-10T09:36:07.663 INFO:tasks.workunit.client.0.smithi079.stdout:4/590: dread d1/da/d16/d21/d32/f44 [0,4194304] 0 2024-09-10T09:36:07.664 INFO:tasks.workunit.client.0.smithi079.stdout:4/591: stat d1/d38 0 2024-09-10T09:36:07.669 INFO:tasks.workunit.client.0.smithi079.stdout:3/649: write d4/da/d17/f1a [3800706,86671] 0 2024-09-10T09:36:07.680 INFO:tasks.workunit.client.0.smithi079.stdout:8/591: rmdir d11 39 2024-09-10T09:36:07.685 INFO:tasks.workunit.client.0.smithi079.stdout:6/646: link d4/d8/dd/d76/d46/d88/dbf/fd0 d4/d8/dc/d93/da0/fd2 0 2024-09-10T09:36:07.685 INFO:tasks.workunit.client.0.smithi079.stdout:6/647: truncate d4/d8/f3b 4970956 0 2024-09-10T09:36:07.687 INFO:tasks.workunit.client.0.smithi079.stdout:4/592: mknod d1/da/d28/cbc 0 2024-09-10T09:36:07.687 INFO:tasks.workunit.client.0.smithi079.stdout:7/568: dwrite d4/df/d3d/f64 [0,4194304] 0 2024-09-10T09:36:07.687 INFO:tasks.workunit.client.0.smithi079.stdout:3/650: mkdir d4/da/d17/dc1 0 2024-09-10T09:36:07.688 INFO:tasks.workunit.client.0.smithi079.stdout:8/592: getdents d11/d2b/d4b/d50/d9e 0 2024-09-10T09:36:07.689 INFO:tasks.workunit.client.0.smithi079.stdout:4/593: mknod d1/da/d16/d21/cbd 0 2024-09-10T09:36:07.689 INFO:tasks.workunit.client.0.smithi079.stdout:8/593: dread d11/d2b/d4b/d50/d5c/f6e [0,4194304] 0 2024-09-10T09:36:07.689 INFO:tasks.workunit.client.0.smithi079.stdout:8/594: write d11/d2b/d4b/d50/d55/d87/fb3 [79235,24178] 0 2024-09-10T09:36:07.689 INFO:tasks.workunit.client.0.smithi079.stdout:7/569: truncate d4/dc/f3a 3225548 0 2024-09-10T09:36:07.690 INFO:tasks.workunit.client.0.smithi079.stdout:4/594: creat d1/da/d3b/fbe x:0 0 0 2024-09-10T09:36:07.691 INFO:tasks.workunit.client.0.smithi079.stdout:9/517: dwrite d3/d7/dc/de/d17/d2f/d30/f56 [0,4194304] 0 2024-09-10T09:36:07.691 INFO:tasks.workunit.client.0.smithi079.stdout:9/518: chown d3/d7/dc/f41 52056315 1 2024-09-10T09:36:07.691 INFO:tasks.workunit.client.0.smithi079.stdout:9/519: chown d3/d7/dc/de/d17/d2f/f5e 25911 1 2024-09-10T09:36:07.692 INFO:tasks.workunit.client.0.smithi079.stdout:2/499: dwrite d4/dc/d1c/d86/d1b/d38/d39/f4c [4194304,4194304] 0 2024-09-10T09:36:07.692 INFO:tasks.workunit.client.0.smithi079.stdout:2/500: creat d4/d5d/f9b x:0 0 0 2024-09-10T09:36:07.692 INFO:tasks.workunit.client.0.smithi079.stdout:8/595: creat d11/d2b/fc2 x:0 0 0 2024-09-10T09:36:07.695 INFO:tasks.workunit.client.0.smithi079.stdout:4/595: mknod d1/da/d3b/cbf 0 2024-09-10T09:36:07.695 INFO:tasks.workunit.client.0.smithi079.stdout:4/596: chown d1/da 111694 1 2024-09-10T09:36:07.695 INFO:tasks.workunit.client.0.smithi079.stdout:4/597: creat d1/da/d16/d21/fc0 x:0 0 0 2024-09-10T09:36:07.699 INFO:tasks.workunit.client.0.smithi079.stdout:9/520: write d3/d7/d5a/f68 [3847941,21942] 0 2024-09-10T09:36:07.699 INFO:tasks.workunit.client.0.smithi079.stdout:9/521: chown d3/d7/dc/de/d17/d2f/f5e 3052 1 2024-09-10T09:36:07.699 INFO:tasks.workunit.client.0.smithi079.stdout:9/522: write d3/d7/d5a/f89 [456967,17192] 0 2024-09-10T09:36:07.699 INFO:tasks.workunit.client.0.smithi079.stdout:9/523: write d3/d40/f7b [4389840,34361] 0 2024-09-10T09:36:07.701 INFO:tasks.workunit.client.0.smithi079.stdout:6/648: dread d4/d8/dc/fe [4194304,4194304] 0 2024-09-10T09:36:07.708 INFO:tasks.workunit.client.0.smithi079.stdout:2/501: link d4/dc/d1c/d86/d1b/d38/d39/d99/l2f d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/l9c 0 2024-09-10T09:36:07.709 INFO:tasks.workunit.client.0.smithi079.stdout:0/541: sync 2024-09-10T09:36:07.709 INFO:tasks.workunit.client.0.smithi079.stdout:0/542: write d4/d12/f96 [702825,118257] 0 2024-09-10T09:36:07.710 INFO:tasks.workunit.client.0.smithi079.stdout:8/596: truncate d11/d48/f6a 2412247 0 2024-09-10T09:36:07.714 INFO:tasks.workunit.client.0.smithi079.stdout:4/598: creat d1/da/d3b/db3/fc1 x:0 0 0 2024-09-10T09:36:07.718 INFO:tasks.workunit.client.0.smithi079.stdout:9/524: rename d3/d7/c8c to d3/ca4 0 2024-09-10T09:36:07.718 INFO:tasks.workunit.client.0.smithi079.stdout:3/651: dwrite d4/da/d17/d2d/fa1 [0,4194304] 0 2024-09-10T09:36:07.718 INFO:tasks.workunit.client.0.smithi079.stdout:7/570: dwrite d4/df/d3d/f41 [0,4194304] 0 2024-09-10T09:36:07.719 INFO:tasks.workunit.client.0.smithi079.stdout:6/649: creat d4/d8/dd/d76/d46/d88/dbf/fd3 x:0 0 0 2024-09-10T09:36:07.721 INFO:tasks.workunit.client.0.smithi079.stdout:2/502: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/l9d 0 2024-09-10T09:36:07.721 INFO:tasks.workunit.client.0.smithi079.stdout:2/503: chown d4/f7a 4754939 1 2024-09-10T09:36:07.721 INFO:tasks.workunit.client.0.smithi079.stdout:2/504: dread - d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f76 zero size 2024-09-10T09:36:07.722 INFO:tasks.workunit.client.0.smithi079.stdout:2/505: write d4/dc/d1c/d86/f98 [864077,25003] 0 2024-09-10T09:36:07.722 INFO:tasks.workunit.client.0.smithi079.stdout:0/543: mknod d4/d12/d8b/cb8 0 2024-09-10T09:36:07.723 INFO:tasks.workunit.client.0.smithi079.stdout:4/599: mknod d1/d9b/db4/cc2 0 2024-09-10T09:36:07.726 INFO:tasks.workunit.client.0.smithi079.stdout:9/525: rename d3/d7/dc/de/d17/f21 to d3/d7/dc/de/d58/d9e/fa5 0 2024-09-10T09:36:07.726 INFO:tasks.workunit.client.0.smithi079.stdout:9/526: write d3/d40/f47 [1391476,93520] 0 2024-09-10T09:36:07.728 INFO:tasks.workunit.client.0.smithi079.stdout:7/571: mkdir d4/dc/d43/dab 0 2024-09-10T09:36:07.728 INFO:tasks.workunit.client.0.smithi079.stdout:7/572: read d4/d6/d38/f54 [139942,2605] 0 2024-09-10T09:36:07.728 INFO:tasks.workunit.client.0.smithi079.stdout:1/708: sync 2024-09-10T09:36:07.729 INFO:tasks.workunit.client.0.smithi079.stdout:5/589: sync 2024-09-10T09:36:07.729 INFO:tasks.workunit.client.0.smithi079.stdout:1/709: chown d5/d24/d36/d53/db3/de3 28077558 1 2024-09-10T09:36:07.729 INFO:tasks.workunit.client.0.smithi079.stdout:6/650: mknod d4/d8/dd/d41/d51/cd4 0 2024-09-10T09:36:07.730 INFO:tasks.workunit.client.0.smithi079.stdout:3/652: write d4/da/d17/d2d/d43/d4c/f92 [1871490,65487] 0 2024-09-10T09:36:07.734 INFO:tasks.workunit.client.0.smithi079.stdout:2/506: creat d4/dc/d1c/d86/d1b/d38/d87/f9e x:0 0 0 2024-09-10T09:36:07.736 INFO:tasks.workunit.client.0.smithi079.stdout:9/527: dread d3/d7/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:07.737 INFO:tasks.workunit.client.0.smithi079.stdout:4/600: creat d1/d9b/db4/fc3 x:0 0 0 2024-09-10T09:36:07.737 INFO:tasks.workunit.client.0.smithi079.stdout:1/710: rmdir d5/d40/dac 39 2024-09-10T09:36:07.739 INFO:tasks.workunit.client.0.smithi079.stdout:5/590: creat d2/d3/fc9 x:0 0 0 2024-09-10T09:36:07.741 INFO:tasks.workunit.client.0.smithi079.stdout:6/651: mkdir d4/d8/dd/d76/dd5 0 2024-09-10T09:36:07.741 INFO:tasks.workunit.client.0.smithi079.stdout:6/652: readlink d4/d8/dc/d12/l22 0 2024-09-10T09:36:07.741 INFO:tasks.workunit.client.0.smithi079.stdout:6/653: write d4/d8/dd/d41/d51/f5b [5062098,19606] 0 2024-09-10T09:36:07.741 INFO:tasks.workunit.client.0.smithi079.stdout:6/654: fsync d4/d8/dc/d93/fad 0 2024-09-10T09:36:07.742 INFO:tasks.workunit.client.0.smithi079.stdout:1/711: dread d5/df/d2e/f49 [0,4194304] 0 2024-09-10T09:36:07.743 INFO:tasks.workunit.client.0.smithi079.stdout:4/601: creat d1/d38/da5/fc4 x:0 0 0 2024-09-10T09:36:07.744 INFO:tasks.workunit.client.0.smithi079.stdout:0/544: dwrite d4/d1d/d24/fa9 [0,4194304] 0 2024-09-10T09:36:07.746 INFO:tasks.workunit.client.0.smithi079.stdout:4/602: creat d1/da/d28/d47/da1/fc5 x:0 0 0 2024-09-10T09:36:07.746 INFO:tasks.workunit.client.0.smithi079.stdout:4/603: fdatasync d1/da/d28/d47/f6f 0 2024-09-10T09:36:07.747 INFO:tasks.workunit.client.0.smithi079.stdout:1/712: getdents d5/d40/dac/db2 0 2024-09-10T09:36:07.747 INFO:tasks.workunit.client.0.smithi079.stdout:1/713: chown d5/d24/d36/d3a/d85 1353 1 2024-09-10T09:36:07.748 INFO:tasks.workunit.client.0.smithi079.stdout:1/714: fdatasync d5/df/dd0/f9c 0 2024-09-10T09:36:07.748 INFO:tasks.workunit.client.0.smithi079.stdout:3/653: fsync d4/da/d17/d2d/d43/d4c/f92 0 2024-09-10T09:36:07.751 INFO:tasks.workunit.client.0.smithi079.stdout:3/654: dread d4/da/d17/d38/d42/f7e [0,4194304] 0 2024-09-10T09:36:07.751 INFO:tasks.workunit.client.0.smithi079.stdout:3/655: creat d4/da/d17/d9b/fc2 x:0 0 0 2024-09-10T09:36:07.751 INFO:tasks.workunit.client.0.smithi079.stdout:3/656: chown d4/da/d8a/c9f 29786097 1 2024-09-10T09:36:07.755 INFO:tasks.workunit.client.0.smithi079.stdout:0/545: unlink d4/d12/d21/c9d 0 2024-09-10T09:36:07.756 INFO:tasks.workunit.client.0.smithi079.stdout:4/604: rename d1/da/d16/d21/c3c to d1/da/d28/d99/cc6 0 2024-09-10T09:36:07.756 INFO:tasks.workunit.client.0.smithi079.stdout:4/605: fdatasync d1/da/d3b/d5f/f62 0 2024-09-10T09:36:07.756 INFO:tasks.workunit.client.0.smithi079.stdout:1/715: creat d5/d24/d36/d79/feb x:0 0 0 2024-09-10T09:36:07.756 INFO:tasks.workunit.client.0.smithi079.stdout:4/606: fdatasync d1/da/d28/f29 0 2024-09-10T09:36:07.756 INFO:tasks.workunit.client.0.smithi079.stdout:1/716: chown d5/d24/f66 1770499603 1 2024-09-10T09:36:07.756 INFO:tasks.workunit.client.0.smithi079.stdout:4/607: truncate d1/f2a 9815143 0 2024-09-10T09:36:07.757 INFO:tasks.workunit.client.0.smithi079.stdout:0/546: creat d4/d12/d16/d53/d6a/fb9 x:0 0 0 2024-09-10T09:36:07.758 INFO:tasks.workunit.client.0.smithi079.stdout:4/608: mknod d1/d9b/db4/cc7 0 2024-09-10T09:36:07.760 INFO:tasks.workunit.client.0.smithi079.stdout:0/547: symlink d4/lba 0 2024-09-10T09:36:07.765 INFO:tasks.workunit.client.0.smithi079.stdout:1/717: dread d5/df/d11/f2b [0,4194304] 0 2024-09-10T09:36:07.767 INFO:tasks.workunit.client.0.smithi079.stdout:1/718: truncate d5/df/dd0/da0/d6a/fcc 41376 0 2024-09-10T09:36:07.771 INFO:tasks.workunit.client.0.smithi079.stdout:4/609: dread d1/da/d3b/d5f/f76 [0,4194304] 0 2024-09-10T09:36:07.773 INFO:tasks.workunit.client.0.smithi079.stdout:0/548: read d4/d1d/d24/fa9 [1413892,33971] 0 2024-09-10T09:36:07.774 INFO:tasks.workunit.client.0.smithi079.stdout:1/719: dread d5/df/dd0/f9c [0,4194304] 0 2024-09-10T09:36:07.775 INFO:tasks.workunit.client.0.smithi079.stdout:4/610: dread d1/da/d3b/d5a/f78 [0,4194304] 0 2024-09-10T09:36:07.775 INFO:tasks.workunit.client.0.smithi079.stdout:0/549: unlink d4/d12/f40 0 2024-09-10T09:36:07.775 INFO:tasks.workunit.client.0.smithi079.stdout:0/550: chown d4/c2e 9299 1 2024-09-10T09:36:07.777 INFO:tasks.workunit.client.0.smithi079.stdout:1/720: mkdir d5/d24/dec 0 2024-09-10T09:36:07.778 INFO:tasks.workunit.client.0.smithi079.stdout:0/551: creat d4/d12/d1a/d6d/fbb x:0 0 0 2024-09-10T09:36:07.778 INFO:tasks.workunit.client.0.smithi079.stdout:1/721: mknod d5/d40/d46/de8/ced 0 2024-09-10T09:36:07.780 INFO:tasks.workunit.client.0.smithi079.stdout:1/722: mknod d5/d4f/d8a/cee 0 2024-09-10T09:36:07.780 INFO:tasks.workunit.client.0.smithi079.stdout:1/723: truncate d5/df/dd0/d57/fb9 30235 0 2024-09-10T09:36:07.781 INFO:tasks.workunit.client.0.smithi079.stdout:1/724: rmdir d5/df/dd0/d57 39 2024-09-10T09:36:07.781 INFO:tasks.workunit.client.0.smithi079.stdout:7/573: dwrite d4/df/d3d/f9e [0,4194304] 0 2024-09-10T09:36:07.782 INFO:tasks.workunit.client.0.smithi079.stdout:7/574: chown d4/d6/d3e/c60 11 1 2024-09-10T09:36:07.782 INFO:tasks.workunit.client.0.smithi079.stdout:7/575: getdents d4/d6/d4f/da7 0 2024-09-10T09:36:07.782 INFO:tasks.workunit.client.0.smithi079.stdout:9/528: dwrite d3/d7/dc/de/d17/d2f/f79 [0,4194304] 0 2024-09-10T09:36:07.783 INFO:tasks.workunit.client.0.smithi079.stdout:9/529: creat d3/d7/d26/fa6 x:0 0 0 2024-09-10T09:36:07.783 INFO:tasks.workunit.client.0.smithi079.stdout:9/530: chown d3/d7/dc/de/d58/c9b 0 1 2024-09-10T09:36:07.784 INFO:tasks.workunit.client.0.smithi079.stdout:9/531: write d3/d7/dc/de/d17/f78 [234965,61164] 0 2024-09-10T09:36:07.784 INFO:tasks.workunit.client.0.smithi079.stdout:3/657: dwrite d4/da/d17/d38/d42/f84 [0,4194304] 0 2024-09-10T09:36:07.784 INFO:tasks.workunit.client.0.smithi079.stdout:6/655: dwrite d4/d8/dd/d76/d46/f3a [0,4194304] 0 2024-09-10T09:36:07.784 INFO:tasks.workunit.client.0.smithi079.stdout:2/507: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/f81 [0,4194304] 0 2024-09-10T09:36:07.785 INFO:tasks.workunit.client.0.smithi079.stdout:3/658: stat d4/da/d17/d9b/fc2 0 2024-09-10T09:36:07.785 INFO:tasks.workunit.client.0.smithi079.stdout:3/659: dread - d4/da/d17/d2d/d43/d4c/f96 zero size 2024-09-10T09:36:07.785 INFO:tasks.workunit.client.0.smithi079.stdout:3/660: creat d4/da/d17/d9b/db1/fc3 x:0 0 0 2024-09-10T09:36:07.790 INFO:tasks.workunit.client.0.smithi079.stdout:4/611: dread d1/da/fb [4194304,4194304] 0 2024-09-10T09:36:07.790 INFO:tasks.workunit.client.0.smithi079.stdout:9/532: mkdir d3/d7/dc/de/da7 0 2024-09-10T09:36:07.797 INFO:tasks.workunit.client.0.smithi079.stdout:2/508: read d4/dc/d1c/d86/f3f [3246371,100071] 0 2024-09-10T09:36:07.797 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:07 smithi135 ceph-mon[33411]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:07.797 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:07 smithi135 ceph-mon[33411]: pgmap v258: 65 pgs: 65 active+clean; 1.3 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 147 MiB/s rd, 177 MiB/s wr, 651 op/s 2024-09-10T09:36:07.853 INFO:tasks.workunit.client.0.smithi079.stdout:0/552: dwrite d4/d12/d8b/f92 [0,4194304] 0 2024-09-10T09:36:07.853 INFO:tasks.workunit.client.0.smithi079.stdout:3/661: dwrite d4/da/d18/daf/fa6 [0,4194304] 0 2024-09-10T09:36:07.853 INFO:tasks.workunit.client.0.smithi079.stdout:3/662: write d4/da/d17/d9b/db1/fc3 [703716,118596] 0 2024-09-10T09:36:07.856 INFO:tasks.workunit.client.0.smithi079.stdout:7/576: dwrite d4/df/d3d/f79 [0,4194304] 0 2024-09-10T09:36:07.857 INFO:tasks.workunit.client.0.smithi079.stdout:0/553: dread d4/d12/d1a/d29/f37 [0,4194304] 0 2024-09-10T09:36:07.858 INFO:tasks.workunit.client.0.smithi079.stdout:4/612: mknod d1/da/cc8 0 2024-09-10T09:36:07.860 INFO:tasks.workunit.client.0.smithi079.stdout:4/613: read d1/da/d16/d21/d32/f8e [231500,128572] 0 2024-09-10T09:36:07.860 INFO:tasks.workunit.client.0.smithi079.stdout:4/614: readlink d1/da/d28/d47/da1/l86 0 2024-09-10T09:36:07.861 INFO:tasks.workunit.client.0.smithi079.stdout:9/533: getdents d3/d7/dc/de/d17/d2f/d74 0 2024-09-10T09:36:07.861 INFO:tasks.workunit.client.0.smithi079.stdout:9/534: fdatasync d3/f16 0 2024-09-10T09:36:07.861 INFO:tasks.workunit.client.0.smithi079.stdout:2/509: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/d9f 0 2024-09-10T09:36:07.862 INFO:tasks.workunit.client.0.smithi079.stdout:2/510: dread d4/f18 [0,4194304] 0 2024-09-10T09:36:07.870 INFO:tasks.workunit.client.0.smithi079.stdout:3/663: truncate d4/da/d17/f1a 1193270 0 2024-09-10T09:36:07.870 INFO:tasks.workunit.client.0.smithi079.stdout:6/656: getdents d4/d8/dd/d76 0 2024-09-10T09:36:07.876 INFO:tasks.workunit.client.0.smithi079.stdout:7/577: creat d4/d6/d4f/fac x:0 0 0 2024-09-10T09:36:07.877 INFO:tasks.workunit.client.0.smithi079.stdout:0/554: rmdir d4/d12/d21/d3f/d80 39 2024-09-10T09:36:07.877 INFO:tasks.workunit.client.0.smithi079.stdout:6/657: dread d4/d8/f3b [0,4194304] 0 2024-09-10T09:36:07.878 INFO:tasks.workunit.client.0.smithi079.stdout:4/615: rename d1/da/d28/d47/da1/d83/la8 to d1/da/d28/d99/lc9 0 2024-09-10T09:36:07.878 INFO:tasks.workunit.client.0.smithi079.stdout:4/616: creat d1/da/d3b/db3/fca x:0 0 0 2024-09-10T09:36:07.879 INFO:tasks.workunit.client.0.smithi079.stdout:9/535: mknod d3/d7/dc/de/d17/d6e/ca8 0 2024-09-10T09:36:07.882 INFO:tasks.workunit.client.0.smithi079.stdout:3/664: link d4/f29 d4/da/d17/d2d/d78/fc4 0 2024-09-10T09:36:07.883 INFO:tasks.workunit.client.0.smithi079.stdout:7/578: mknod d4/d6/d4f/da7/cad 0 2024-09-10T09:36:07.883 INFO:tasks.workunit.client.0.smithi079.stdout:7/579: write d4/dc/f21 [4893271,116403] 0 2024-09-10T09:36:07.883 INFO:tasks.workunit.client.0.smithi079.stdout:0/555: symlink d4/d47/lbc 0 2024-09-10T09:36:07.884 INFO:tasks.workunit.client.0.smithi079.stdout:6/658: truncate d4/d8/dd/fb7 1900018 0 2024-09-10T09:36:07.884 INFO:tasks.workunit.client.0.smithi079.stdout:6/659: creat d4/d8/dc/d3c/fd6 x:0 0 0 2024-09-10T09:36:07.884 INFO:tasks.workunit.client.0.smithi079.stdout:6/660: chown d4/d8/dc/d93/d4b/l69 10 1 2024-09-10T09:36:07.885 INFO:tasks.workunit.client.0.smithi079.stdout:6/661: fdatasync d4/d8/dd/d41/f56 0 2024-09-10T09:36:07.886 INFO:tasks.workunit.client.0.smithi079.stdout:2/511: rename d4/dc/d1c/d86/d1b/d38/d39/d31/l8b to d4/dc/d1c/d86/d1b/d38/d39/d31/d49/la0 0 2024-09-10T09:36:07.888 INFO:tasks.workunit.client.0.smithi079.stdout:1/725: sync 2024-09-10T09:36:07.888 INFO:tasks.workunit.client.0.smithi079.stdout:8/597: sync 2024-09-10T09:36:07.888 INFO:tasks.workunit.client.0.smithi079.stdout:1/726: read d5/f15 [1965250,83229] 0 2024-09-10T09:36:07.889 INFO:tasks.workunit.client.0.smithi079.stdout:4/617: creat d1/da/d16/fcb x:0 0 0 2024-09-10T09:36:07.889 INFO:tasks.workunit.client.0.smithi079.stdout:5/591: sync 2024-09-10T09:36:07.889 INFO:tasks.workunit.client.0.smithi079.stdout:5/592: truncate d2/d3/d5e/fa7 866969 0 2024-09-10T09:36:07.890 INFO:tasks.workunit.client.0.smithi079.stdout:9/536: truncate d3/d40/f47 1165816 0 2024-09-10T09:36:07.891 INFO:tasks.workunit.client.0.smithi079.stdout:3/665: mkdir d4/da/d56/dc5 0 2024-09-10T09:36:07.891 INFO:tasks.workunit.client.0.smithi079.stdout:3/666: chown d4/da/d17/d2d/d43/d49/f68 28507190 1 2024-09-10T09:36:07.895 INFO:tasks.workunit.client.0.smithi079.stdout:6/662: mkdir d4/d8/dc/d93/d8a/dd7 0 2024-09-10T09:36:07.895 INFO:tasks.workunit.client.0.smithi079.stdout:6/663: write d4/d8/dc/d12/f30 [1430559,7952] 0 2024-09-10T09:36:07.895 INFO:tasks.workunit.client.0.smithi079.stdout:0/556: dread d4/d12/d39/f6e [0,4194304] 0 2024-09-10T09:36:07.895 INFO:tasks.workunit.client.0.smithi079.stdout:0/557: write d4/fe [2527418,13847] 0 2024-09-10T09:36:07.895 INFO:tasks.workunit.client.0.smithi079.stdout:8/598: write d11/f2a [2132560,38273] 0 2024-09-10T09:36:07.896 INFO:tasks.workunit.client.0.smithi079.stdout:7/580: rename d4/df/d3d/d82/l88 to d4/df/d6b/d9a/lae 0 2024-09-10T09:36:07.896 INFO:tasks.workunit.client.0.smithi079.stdout:7/581: stat d4/df/d3d/f9e 0 2024-09-10T09:36:07.898 INFO:tasks.workunit.client.0.smithi079.stdout:2/512: unlink d4/dc/d1c/d86/l19 0 2024-09-10T09:36:07.899 INFO:tasks.workunit.client.0.smithi079.stdout:1/727: symlink d5/df/d11/d76/lef 0 2024-09-10T09:36:07.899 INFO:tasks.workunit.client.0.smithi079.stdout:1/728: read d5/d24/f66 [2672866,45800] 0 2024-09-10T09:36:07.899 INFO:tasks.workunit.client.0.smithi079.stdout:1/729: read - d5/df/dc6/de6/fe4 zero size 2024-09-10T09:36:07.899 INFO:tasks.workunit.client.0.smithi079.stdout:1/730: fdatasync d5/f22 0 2024-09-10T09:36:07.900 INFO:tasks.workunit.client.0.smithi079.stdout:1/731: dread - d5/df/dd0/da0/d6e/dc5/dd1/fde zero size 2024-09-10T09:36:07.900 INFO:tasks.workunit.client.0.smithi079.stdout:1/732: stat d5/df/d2e/f39 0 2024-09-10T09:36:07.903 INFO:tasks.workunit.client.0.smithi079.stdout:6/664: dread d4/d8/dc/d93/da0/fb8 [0,4194304] 0 2024-09-10T09:36:07.903 INFO:tasks.workunit.client.0.smithi079.stdout:5/593: link d2/d3/d27/d32/fa1 d2/d3/d27/d32/fca 0 2024-09-10T09:36:07.906 INFO:tasks.workunit.client.0.smithi079.stdout:7/582: write d4/df/d3d/f56 [6783756,111843] 0 2024-09-10T09:36:07.906 INFO:tasks.workunit.client.0.smithi079.stdout:7/583: write d4/df/f9f [639714,32880] 0 2024-09-10T09:36:07.906 INFO:tasks.workunit.client.0.smithi079.stdout:3/667: mknod d4/da/d17/cc6 0 2024-09-10T09:36:07.908 INFO:tasks.workunit.client.0.smithi079.stdout:0/558: rmdir d4 39 2024-09-10T09:36:07.909 INFO:tasks.workunit.client.0.smithi079.stdout:7/584: dread d4/df/d6b/f8e [0,4194304] 0 2024-09-10T09:36:07.910 INFO:tasks.workunit.client.0.smithi079.stdout:8/599: creat d11/d2b/d4b/d50/d55/d87/fc3 x:0 0 0 2024-09-10T09:36:07.913 INFO:tasks.workunit.client.0.smithi079.stdout:9/537: rename d3/d7/dc/de/d17/d2f/d30 to d3/d7/dc/d7a/da9 0 2024-09-10T09:36:07.914 INFO:tasks.workunit.client.0.smithi079.stdout:1/733: mkdir d5/d40/d46/df0 0 2024-09-10T09:36:07.915 INFO:tasks.workunit.client.0.smithi079.stdout:4/618: getdents d1/da/d16/d21 0 2024-09-10T09:36:07.917 INFO:tasks.workunit.client.0.smithi079.stdout:5/594: unlink d2/c13 0 2024-09-10T09:36:07.918 INFO:tasks.workunit.client.0.smithi079.stdout:3/668: truncate d4/da/d18/daf/fa6 2275004 0 2024-09-10T09:36:07.918 INFO:tasks.workunit.client.0.smithi079.stdout:3/669: write d4/da/d17/f32 [3170036,122186] 0 2024-09-10T09:36:07.920 INFO:tasks.workunit.client.0.smithi079.stdout:0/559: mkdir d4/d12/d1a/d29/d32/dbd 0 2024-09-10T09:36:07.921 INFO:tasks.workunit.client.0.smithi079.stdout:2/513: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/f1f [0,4194304] 0 2024-09-10T09:36:07.921 INFO:tasks.workunit.client.0.smithi079.stdout:2/514: creat d4/d5d/fa1 x:0 0 0 2024-09-10T09:36:07.921 INFO:tasks.workunit.client.0.smithi079.stdout:2/515: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d 0 2024-09-10T09:36:07.922 INFO:tasks.workunit.client.0.smithi079.stdout:8/600: link d11/d2b/f3f d11/d48/fc4 0 2024-09-10T09:36:07.926 INFO:tasks.workunit.client.0.smithi079.stdout:6/665: rename l1 to d4/d8/dd/d41/d51/ld8 0 2024-09-10T09:36:07.927 INFO:tasks.workunit.client.0.smithi079.stdout:9/538: write d3/d7/dc/d7a/da9/f9c [2913698,95376] 0 2024-09-10T09:36:07.927 INFO:tasks.workunit.client.0.smithi079.stdout:9/539: creat d3/d7/dc/de/d58/faa x:0 0 0 2024-09-10T09:36:07.928 INFO:tasks.workunit.client.0.smithi079.stdout:1/734: link d5/df/d11/f75 d5/d24/d36/d53/db3/ff1 0 2024-09-10T09:36:07.928 INFO:tasks.workunit.client.0.smithi079.stdout:1/735: fdatasync d5/df/d2e/f49 0 2024-09-10T09:36:07.928 INFO:tasks.workunit.client.0.smithi079.stdout:7/585: dwrite d4/df/f9f [0,4194304] 0 2024-09-10T09:36:07.929 INFO:tasks.workunit.client.0.smithi079.stdout:5/595: mkdir d2/d3/d59/dcb 0 2024-09-10T09:36:07.932 INFO:tasks.workunit.client.0.smithi079.stdout:3/670: creat d4/da/d8a/fc7 x:0 0 0 2024-09-10T09:36:07.932 INFO:tasks.workunit.client.0.smithi079.stdout:0/560: read d4/d12/d39/f48 [3214923,69097] 0 2024-09-10T09:36:07.935 INFO:tasks.workunit.client.0.smithi079.stdout:3/671: dread d4/da/d17/fa2 [0,4194304] 0 2024-09-10T09:36:07.936 INFO:tasks.workunit.client.0.smithi079.stdout:4/619: rename d1/da/d28/d47/l4b to d1/da/d3b/db3/lcc 0 2024-09-10T09:36:07.938 INFO:tasks.workunit.client.0.smithi079.stdout:6/666: mkdir d4/d8/dc/dd9 0 2024-09-10T09:36:07.938 INFO:tasks.workunit.client.0.smithi079.stdout:6/667: truncate d4/d8/dc/d1c/f53 4468578 0 2024-09-10T09:36:07.938 INFO:tasks.workunit.client.0.smithi079.stdout:6/668: chown d4/d8/dc/d12/d9d 1675147135 1 2024-09-10T09:36:07.942 INFO:tasks.workunit.client.0.smithi079.stdout:9/540: link d3/d7/dc/de/d17/l44 d3/d7/dc/de/d58/d9e/lab 0 2024-09-10T09:36:07.942 INFO:tasks.workunit.client.0.smithi079.stdout:6/669: dread d4/d8/dc/d1c/f3f [0,4194304] 0 2024-09-10T09:36:07.943 INFO:tasks.workunit.client.0.smithi079.stdout:3/672: fdatasync d4/da/d17/f32 0 2024-09-10T09:36:07.943 INFO:tasks.workunit.client.0.smithi079.stdout:3/673: write d4/da/d17/d38/d42/f7e [87721,61353] 0 2024-09-10T09:36:07.943 INFO:tasks.workunit.client.0.smithi079.stdout:0/561: mknod d4/d12/d21/d3f/db3/cbe 0 2024-09-10T09:36:07.944 INFO:tasks.workunit.client.0.smithi079.stdout:7/586: dread d4/dc/f36 [4194304,4194304] 0 2024-09-10T09:36:07.945 INFO:tasks.workunit.client.0.smithi079.stdout:8/601: dwrite d11/d2b/f3f [0,4194304] 0 2024-09-10T09:36:07.946 INFO:tasks.workunit.client.0.smithi079.stdout:2/516: rename d4/dc/d1c/d59/f4a to d4/dc/d1c/d86/d1b/d38/d39/d31/fa2 0 2024-09-10T09:36:07.946 INFO:tasks.workunit.client.0.smithi079.stdout:2/517: creat d4/d5d/fa3 x:0 0 0 2024-09-10T09:36:07.946 INFO:tasks.workunit.client.0.smithi079.stdout:2/518: write d4/dc/d1c/d59/f84 [159877,119103] 0 2024-09-10T09:36:07.948 INFO:tasks.workunit.client.0.smithi079.stdout:9/541: mkdir d3/d7/dc/de/da7/dac 0 2024-09-10T09:36:07.948 INFO:tasks.workunit.client.0.smithi079.stdout:9/542: read - d3/d7/dc/d62/f6b zero size 2024-09-10T09:36:07.948 INFO:tasks.workunit.client.0.smithi079.stdout:9/543: read d3/f16 [524056,69052] 0 2024-09-10T09:36:07.948 INFO:tasks.workunit.client.0.smithi079.stdout:2/519: read d4/dc/d1c/d86/d1b/d38/d39/d99/f15 [1039712,50335] 0 2024-09-10T09:36:07.950 INFO:tasks.workunit.client.0.smithi079.stdout:6/670: truncate d4/d8/dd/d41/d51/f5b 673188 0 2024-09-10T09:36:07.950 INFO:tasks.workunit.client.0.smithi079.stdout:4/620: write d1/da/d28/d47/da1/d83/f93 [1784699,81367] 0 2024-09-10T09:36:07.953 INFO:tasks.workunit.client.0.smithi079.stdout:7/587: dread d4/df/d6b/f8b [0,4194304] 0 2024-09-10T09:36:07.953 INFO:tasks.workunit.client.0.smithi079.stdout:4/621: dread d1/da/fb [4194304,4194304] 0 2024-09-10T09:36:07.957 INFO:tasks.workunit.client.0.smithi079.stdout:0/562: unlink d4/d12/d15/d6b/c93 0 2024-09-10T09:36:07.958 INFO:tasks.workunit.client.0.smithi079.stdout:8/602: dread - d11/d2b/f8b zero size 2024-09-10T09:36:07.961 INFO:tasks.workunit.client.0.smithi079.stdout:1/736: rename d5/l67 to d5/df/dd0/da0/d6e/dc5/lf2 0 2024-09-10T09:36:07.964 INFO:tasks.workunit.client.0.smithi079.stdout:9/544: symlink d3/d7/dc/de/d17/d2f/d74/lad 0 2024-09-10T09:36:07.964 INFO:tasks.workunit.client.0.smithi079.stdout:9/545: chown d3/d7/dc/de/d17/d12/fa0 237 1 2024-09-10T09:36:07.966 INFO:tasks.workunit.client.0.smithi079.stdout:6/671: mkdir d4/d8/dc/d93/da0/dda 0 2024-09-10T09:36:07.977 INFO:tasks.workunit.client.0.smithi079.stdout:4/622: mkdir d1/da/d28/d47/da1/dcd 0 2024-09-10T09:36:07.977 INFO:tasks.workunit.client.0.smithi079.stdout:4/623: readlink d1/d38/l7a 0 2024-09-10T09:36:07.977 INFO:tasks.workunit.client.0.smithi079.stdout:4/624: creat d1/d38/da5/fce x:0 0 0 2024-09-10T09:36:07.978 INFO:tasks.workunit.client.0.smithi079.stdout:1/737: write d5/fe [200257,92723] 0 2024-09-10T09:36:07.978 INFO:tasks.workunit.client.0.smithi079.stdout:1/738: stat d5/d24/d36/d3a 0 2024-09-10T09:36:07.979 INFO:tasks.workunit.client.0.smithi079.stdout:1/739: write d5/d40/dac/db2/fbf [2741,14230] 0 2024-09-10T09:36:07.979 INFO:tasks.workunit.client.0.smithi079.stdout:1/740: fdatasync d5/df/dd0/f54 0 2024-09-10T09:36:07.981 INFO:tasks.workunit.client.0.smithi079.stdout:0/563: rmdir d4 39 2024-09-10T09:36:07.985 INFO:tasks.workunit.client.0.smithi079.stdout:3/674: rename d4/da/d17/d72/f9c to d4/fc8 0 2024-09-10T09:36:07.985 INFO:tasks.workunit.client.0.smithi079.stdout:3/675: write d4/da/d18/daf/f9e [788725,96274] 0 2024-09-10T09:36:07.985 INFO:tasks.workunit.client.0.smithi079.stdout:3/676: fsync d4/da/d17/d2d/d78/dbe/f8f 0 2024-09-10T09:36:07.985 INFO:tasks.workunit.client.0.smithi079.stdout:3/677: chown d4/da/c4e 473 1 2024-09-10T09:36:07.986 INFO:tasks.workunit.client.0.smithi079.stdout:3/678: write d4/f29 [3208125,129101] 0 2024-09-10T09:36:07.986 INFO:tasks.workunit.client.0.smithi079.stdout:3/679: truncate d4/da/d17/d2d/d43/d4c/f9d 53996 0 2024-09-10T09:36:07.990 INFO:tasks.workunit.client.0.smithi079.stdout:0/564: creat d4/d12/d15/d69/fbf x:0 0 0 2024-09-10T09:36:07.994 INFO:tasks.workunit.client.0.smithi079.stdout:1/741: mkdir d5/d24/d36/df3 0 2024-09-10T09:36:07.998 INFO:tasks.workunit.client.0.smithi079.stdout:1/742: rename d5/f15 to d5/d9e/dc9/ff4 0 2024-09-10T09:36:07.998 INFO:tasks.workunit.client.0.smithi079.stdout:1/743: fdatasync d5/f9d 0 2024-09-10T09:36:08.002 INFO:tasks.workunit.client.0.smithi079.stdout:1/744: mkdir d5/df/d11/df5 0 2024-09-10T09:36:08.002 INFO:tasks.workunit.client.0.smithi079.stdout:1/745: read d5/d40/dac/db2/fbf [8437,68731] 0 2024-09-10T09:36:08.002 INFO:tasks.workunit.client.0.smithi079.stdout:1/746: chown d5/df/dc6/de6 8 1 2024-09-10T09:36:08.003 INFO:tasks.workunit.client.0.smithi079.stdout:1/747: mkdir d5/d40/d46/de8/df6 0 2024-09-10T09:36:08.004 INFO:tasks.workunit.client.0.smithi079.stdout:8/603: dwrite d11/f17 [0,4194304] 0 2024-09-10T09:36:08.005 INFO:tasks.workunit.client.0.smithi079.stdout:8/604: mknod d11/cc5 0 2024-09-10T09:36:08.006 INFO:tasks.workunit.client.0.smithi079.stdout:8/605: creat d11/d91/fc6 x:0 0 0 2024-09-10T09:36:08.008 INFO:tasks.workunit.client.0.smithi079.stdout:1/748: dread d5/d24/d36/d53/db3/de3/f99 [0,4194304] 0 2024-09-10T09:36:08.008 INFO:tasks.workunit.client.0.smithi079.stdout:1/749: fsync d5/df/d2e/fcb 0 2024-09-10T09:36:08.008 INFO:tasks.workunit.client.0.smithi079.stdout:1/750: truncate d5/d4f/d95/fbd 4208324 0 2024-09-10T09:36:08.011 INFO:tasks.workunit.client.0.smithi079.stdout:1/751: rename d5/df/dd0/da0/d6a/fcc to d5/df/dd0/da0/d6e/ff7 0 2024-09-10T09:36:08.011 INFO:tasks.workunit.client.0.smithi079.stdout:1/752: creat d5/d9e/dc9/ff8 x:0 0 0 2024-09-10T09:36:08.015 INFO:tasks.workunit.client.0.smithi079.stdout:1/753: creat d5/d24/d36/df3/ff9 x:0 0 0 2024-09-10T09:36:08.018 INFO:tasks.workunit.client.0.smithi079.stdout:1/754: creat d5/df/dd0/d57/ffa x:0 0 0 2024-09-10T09:36:08.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/755: unlink d5/df/dd0/da0/f65 0 2024-09-10T09:36:08.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/756: write d5/d24/f66 [4174305,29464] 0 2024-09-10T09:36:08.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/757: fdatasync d5/d24/d36/d3a/fd7 0 2024-09-10T09:36:08.021 INFO:tasks.workunit.client.0.smithi079.stdout:1/758: symlink d5/df/dd0/d57/d8c/lfb 0 2024-09-10T09:36:08.021 INFO:tasks.workunit.client.0.smithi079.stdout:1/759: fdatasync d5/df/d2e/fcb 0 2024-09-10T09:36:08.022 INFO:tasks.workunit.client.0.smithi079.stdout:1/760: mkdir d5/d24/d36/d3a/dfc 0 2024-09-10T09:36:08.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/761: creat d5/d40/dac/db2/ffd x:0 0 0 2024-09-10T09:36:08.024 INFO:tasks.workunit.client.0.smithi079.stdout:1/762: mknod d5/df/dd0/da0/d6e/dc5/dd1/cfe 0 2024-09-10T09:36:08.026 INFO:tasks.workunit.client.0.smithi079.stdout:9/546: dwrite d3/d7/f3b [0,4194304] 0 2024-09-10T09:36:08.027 INFO:tasks.workunit.client.0.smithi079.stdout:9/547: mkdir d3/dae 0 2024-09-10T09:36:08.036 INFO:tasks.workunit.client.0.smithi079.stdout:3/680: dwrite d4/da/d17/d2d/d43/d4c/f9d [0,4194304] 0 2024-09-10T09:36:08.036 INFO:tasks.workunit.client.0.smithi079.stdout:6/672: dwrite d4/d8/dc/f37 [0,4194304] 0 2024-09-10T09:36:08.036 INFO:tasks.workunit.client.0.smithi079.stdout:6/673: chown d4/d8/dc/d12/d29/c63 119 1 2024-09-10T09:36:08.038 INFO:tasks.workunit.client.0.smithi079.stdout:0/565: dwrite d4/d12/d1a/d6d/d7b/f85 [0,4194304] 0 2024-09-10T09:36:08.038 INFO:tasks.workunit.client.0.smithi079.stdout:0/566: chown d4/d12/d21/d3f/c42 1144 1 2024-09-10T09:36:08.038 INFO:tasks.workunit.client.0.smithi079.stdout:0/567: fsync d4/d12/d1a/d6d/fbb 0 2024-09-10T09:36:08.038 INFO:tasks.workunit.client.0.smithi079.stdout:8/606: dwrite d11/d2b/f30 [0,4194304] 0 2024-09-10T09:36:08.038 INFO:tasks.workunit.client.0.smithi079.stdout:8/607: chown d11/f88 918774 1 2024-09-10T09:36:08.041 INFO:tasks.workunit.client.0.smithi079.stdout:3/681: unlink d4/da/d17/d2d/d43/d4c/f92 0 2024-09-10T09:36:08.042 INFO:tasks.workunit.client.0.smithi079.stdout:6/674: creat d4/d8/dd/d76/fdb x:0 0 0 2024-09-10T09:36:08.047 INFO:tasks.workunit.client.0.smithi079.stdout:0/568: mkdir d4/d12/dc0 0 2024-09-10T09:36:08.047 INFO:tasks.workunit.client.0.smithi079.stdout:0/569: creat d4/d47/fc1 x:0 0 0 2024-09-10T09:36:08.053 INFO:tasks.workunit.client.0.smithi079.stdout:3/682: mknod d4/da/d17/d38/d42/cc9 0 2024-09-10T09:36:08.056 INFO:tasks.workunit.client.0.smithi079.stdout:8/608: read d11/f2e [2756423,68876] 0 2024-09-10T09:36:08.057 INFO:tasks.workunit.client.0.smithi079.stdout:9/548: dwrite d3/d7/dc/d62/f7d [0,4194304] 0 2024-09-10T09:36:08.060 INFO:tasks.workunit.client.0.smithi079.stdout:0/570: dread d4/fe [0,4194304] 0 2024-09-10T09:36:08.066 INFO:tasks.workunit.client.0.smithi079.stdout:6/675: dwrite d4/d8/f7d [0,4194304] 0 2024-09-10T09:36:08.071 INFO:tasks.workunit.client.0.smithi079.stdout:0/571: unlink d4/la 0 2024-09-10T09:36:08.075 INFO:tasks.workunit.client.0.smithi079.stdout:6/676: link d4/d8/dd/d41/d51/c5e d4/d8/dc/d93/dc4/cdc 0 2024-09-10T09:36:08.075 INFO:tasks.workunit.client.0.smithi079.stdout:6/677: chown d4/d8/dc/d93/fad 15249 1 2024-09-10T09:36:08.076 INFO:tasks.workunit.client.0.smithi079.stdout:9/549: dwrite d3/d7/d26/f80 [0,4194304] 0 2024-09-10T09:36:08.076 INFO:tasks.workunit.client.0.smithi079.stdout:0/572: symlink d4/d12/d16/d53/d79/lc2 0 2024-09-10T09:36:08.078 INFO:tasks.workunit.client.0.smithi079.stdout:6/678: mkdir d4/d8/dd/d76/dd5/ddd 0 2024-09-10T09:36:08.078 INFO:tasks.workunit.client.0.smithi079.stdout:6/679: write d4/d8/dd/d76/d46/d88/dbf/fd0 [661579,50881] 0 2024-09-10T09:36:08.078 INFO:tasks.workunit.client.0.smithi079.stdout:6/680: readlink d4/d8/dd/lac 0 2024-09-10T09:36:08.082 INFO:tasks.workunit.client.0.smithi079.stdout:9/550: link d3/d7/dc/d62/f75 d3/d7/dc/de/d17/d2f/d98/da1/faf 0 2024-09-10T09:36:08.082 INFO:tasks.workunit.client.0.smithi079.stdout:9/551: read - d3/d7/d26/fa6 zero size 2024-09-10T09:36:08.085 INFO:tasks.workunit.client.0.smithi079.stdout:6/681: rename d4/d8/dc/d93/d4b/f80 to d4/d8/dc/d93/fde 0 2024-09-10T09:36:08.085 INFO:tasks.workunit.client.0.smithi079.stdout:6/682: write d4/d8/dc/d1c/f21 [2004261,94061] 0 2024-09-10T09:36:08.089 INFO:tasks.workunit.client.0.smithi079.stdout:9/552: link d3/d40/f7b d3/d7/dc/de/d17/d12/fb0 0 2024-09-10T09:36:08.089 INFO:tasks.workunit.client.0.smithi079.stdout:0/573: dwrite d4/d47/fc1 [0,4194304] 0 2024-09-10T09:36:08.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/574: getdents d4/d12/d15 0 2024-09-10T09:36:08.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/575: getdents d4/d12/d1a/d6d/d91 0 2024-09-10T09:36:08.107 INFO:tasks.workunit.client.0.smithi079.stdout:5/596: sync 2024-09-10T09:36:08.111 INFO:tasks.workunit.client.0.smithi079.stdout:5/597: getdents d2/d3/d5e 0 2024-09-10T09:36:08.112 INFO:tasks.workunit.client.0.smithi079.stdout:6/683: dwrite d4/d8/dd/d41/f45 [0,4194304] 0 2024-09-10T09:36:08.113 INFO:tasks.workunit.client.0.smithi079.stdout:6/684: mkdir d4/d8/dc/d93/d8a/ddf 0 2024-09-10T09:36:08.113 INFO:tasks.workunit.client.0.smithi079.stdout:6/685: chown d4/d8/dc/d12/d29/fa8 241995586 1 2024-09-10T09:36:08.114 INFO:tasks.workunit.client.0.smithi079.stdout:6/686: mkdir d4/d8/dc/d93/d8a/ddf/de0 0 2024-09-10T09:36:08.115 INFO:tasks.workunit.client.0.smithi079.stdout:9/553: dwrite d3/d7/dc/d7a/da9/f9c [4194304,4194304] 0 2024-09-10T09:36:08.117 INFO:tasks.workunit.client.0.smithi079.stdout:9/554: truncate d3/d40/f47 276877 0 2024-09-10T09:36:08.122 INFO:tasks.workunit.client.0.smithi079.stdout:0/576: dwrite d4/f5 [0,4194304] 0 2024-09-10T09:36:08.122 INFO:tasks.workunit.client.0.smithi079.stdout:0/577: fdatasync d4/d12/d21/f99 0 2024-09-10T09:36:08.122 INFO:tasks.workunit.client.0.smithi079.stdout:0/578: fsync d4/d12/d1a/d29/f37 0 2024-09-10T09:36:08.128 INFO:tasks.workunit.client.0.smithi079.stdout:5/598: write d2/d3/fa [1093918,23431] 0 2024-09-10T09:36:08.130 INFO:tasks.workunit.client.0.smithi079.stdout:6/687: dread d4/d8/dd/d41/f45 [0,4194304] 0 2024-09-10T09:36:08.131 INFO:tasks.workunit.client.0.smithi079.stdout:5/599: mkdir d2/d3/d5e/d85/dcc 0 2024-09-10T09:36:08.131 INFO:tasks.workunit.client.0.smithi079.stdout:5/600: fsync d2/d3/d5e/d73/f8b 0 2024-09-10T09:36:08.134 INFO:tasks.workunit.client.0.smithi079.stdout:5/601: mknod d2/d3/d27/ccd 0 2024-09-10T09:36:08.145 INFO:tasks.workunit.client.0.smithi079.stdout:7/588: sync 2024-09-10T09:36:08.145 INFO:tasks.workunit.client.0.smithi079.stdout:2/520: sync 2024-09-10T09:36:08.145 INFO:tasks.workunit.client.0.smithi079.stdout:7/589: chown d4/df/d6b/c72 0 1 2024-09-10T09:36:08.145 INFO:tasks.workunit.client.0.smithi079.stdout:1/763: sync 2024-09-10T09:36:08.145 INFO:tasks.workunit.client.0.smithi079.stdout:7/590: fsync d4/d6/d38/fa2 0 2024-09-10T09:36:08.146 INFO:tasks.workunit.client.0.smithi079.stdout:2/521: write d4/d5d/f9b [704578,88414] 0 2024-09-10T09:36:08.146 INFO:tasks.workunit.client.0.smithi079.stdout:4/625: sync 2024-09-10T09:36:08.146 INFO:tasks.workunit.client.0.smithi079.stdout:4/626: read - d1/da/d28/d47/da1/d83/fa6 zero size 2024-09-10T09:36:08.146 INFO:tasks.workunit.client.0.smithi079.stdout:1/764: rmdir d5/df/d11/df5 0 2024-09-10T09:36:08.147 INFO:tasks.workunit.client.0.smithi079.stdout:7/591: symlink d4/df/d3d/d75/laf 0 2024-09-10T09:36:08.147 INFO:tasks.workunit.client.0.smithi079.stdout:2/522: rmdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61 39 2024-09-10T09:36:08.149 INFO:tasks.workunit.client.0.smithi079.stdout:4/627: rename d1/da/dad/fbb to d1/d9b/fcf 0 2024-09-10T09:36:08.149 INFO:tasks.workunit.client.0.smithi079.stdout:4/628: readlink d1/da/l85 0 2024-09-10T09:36:08.149 INFO:tasks.workunit.client.0.smithi079.stdout:2/523: creat d4/dc/d1c/d86/d1b/d38/d39/d99/fa4 x:0 0 0 2024-09-10T09:36:08.151 INFO:tasks.workunit.client.0.smithi079.stdout:1/765: rename d5/df/dc6/de6/fe4 to d5/d24/d36/d3a/dfc/fff 0 2024-09-10T09:36:08.152 INFO:tasks.workunit.client.0.smithi079.stdout:4/629: unlink d1/da/d28/d47/c42 0 2024-09-10T09:36:08.152 INFO:tasks.workunit.client.0.smithi079.stdout:4/630: creat d1/da/d28/d47/da1/fd0 x:0 0 0 2024-09-10T09:36:08.153 INFO:tasks.workunit.client.0.smithi079.stdout:1/766: mkdir d5/d24/d36/d3a/d100 0 2024-09-10T09:36:08.156 INFO:tasks.workunit.client.0.smithi079.stdout:4/631: link d1/da/d3b/d5f/fae d1/da/d16/d88/fd1 0 2024-09-10T09:36:08.158 INFO:tasks.workunit.client.0.smithi079.stdout:1/767: mknod d5/d4f/c101 0 2024-09-10T09:36:08.158 INFO:tasks.workunit.client.0.smithi079.stdout:1/768: chown d5 1 1 2024-09-10T09:36:08.158 INFO:tasks.workunit.client.0.smithi079.stdout:1/769: read d5/fe [2185971,116683] 0 2024-09-10T09:36:08.159 INFO:tasks.workunit.client.0.smithi079.stdout:0/579: dwrite d4/d12/d39/f8d [0,4194304] 0 2024-09-10T09:36:08.160 INFO:tasks.workunit.client.0.smithi079.stdout:4/632: creat d1/fd2 x:0 0 0 2024-09-10T09:36:08.161 INFO:tasks.workunit.client.0.smithi079.stdout:9/555: dwrite d3/d7/dc/de/f46 [4194304,4194304] 0 2024-09-10T09:36:08.161 INFO:tasks.workunit.client.0.smithi079.stdout:9/556: readlink d3/d7/d26/l64 0 2024-09-10T09:36:08.161 INFO:tasks.workunit.client.0.smithi079.stdout:7/592: write d4/df/f9f [3953973,92040] 0 2024-09-10T09:36:08.164 INFO:tasks.workunit.client.0.smithi079.stdout:4/633: read d1/da/d16/d88/fa3 [375708,104709] 0 2024-09-10T09:36:08.164 INFO:tasks.workunit.client.0.smithi079.stdout:5/602: dwrite d2/d3/d27/d32/fa1 [0,4194304] 0 2024-09-10T09:36:08.164 INFO:tasks.workunit.client.0.smithi079.stdout:5/603: chown d2/d3/d27/d70/d80/l93 469 1 2024-09-10T09:36:08.165 INFO:tasks.workunit.client.0.smithi079.stdout:5/604: write d2/d3/fc9 [1029376,83849] 0 2024-09-10T09:36:08.165 INFO:tasks.workunit.client.0.smithi079.stdout:5/605: dread - d2/d3/f6e zero size 2024-09-10T09:36:08.165 INFO:tasks.workunit.client.0.smithi079.stdout:0/580: link d4/d12/d16/c62 d4/d12/d1a/d29/d32/dbd/cc3 0 2024-09-10T09:36:08.167 INFO:tasks.workunit.client.0.smithi079.stdout:2/524: getdents d4/dc/d1c/d86/d1b/d38/d39/d99 0 2024-09-10T09:36:08.170 INFO:tasks.workunit.client.0.smithi079.stdout:6/688: dwrite d4/d8/dc/d93/da0/fc2 [0,4194304] 0 2024-09-10T09:36:08.173 INFO:tasks.workunit.client.0.smithi079.stdout:5/606: dread d2/d3/d27/f87 [0,4194304] 0 2024-09-10T09:36:08.173 INFO:tasks.workunit.client.0.smithi079.stdout:5/607: chown d2/d3/d27/d32/d39/f7b 0 1 2024-09-10T09:36:08.177 INFO:tasks.workunit.client.0.smithi079.stdout:9/557: symlink d3/d7/dc/de/d17/d2f/d98/da1/lb1 0 2024-09-10T09:36:08.178 INFO:tasks.workunit.client.0.smithi079.stdout:7/593: truncate d4/d6/d3e/f7a 1791279 0 2024-09-10T09:36:08.178 INFO:tasks.workunit.client.0.smithi079.stdout:7/594: write d4/df/d3d/f40 [2045660,17298] 0 2024-09-10T09:36:08.178 INFO:tasks.workunit.client.0.smithi079.stdout:7/595: truncate d4/dc/f92 1023925 0 2024-09-10T09:36:08.183 INFO:tasks.workunit.client.0.smithi079.stdout:0/581: creat d4/d12/d21/d3f/d80/fc4 x:0 0 0 2024-09-10T09:36:08.184 INFO:tasks.workunit.client.0.smithi079.stdout:6/689: mknod d4/d8/dc/d12/d9d/ce1 0 2024-09-10T09:36:08.185 INFO:tasks.workunit.client.0.smithi079.stdout:5/608: creat d2/d3/d27/d70/d80/d94/fce x:0 0 0 2024-09-10T09:36:08.186 INFO:tasks.workunit.client.0.smithi079.stdout:9/558: mkdir d3/d7/dc/de/d17/db2 0 2024-09-10T09:36:08.186 INFO:tasks.workunit.client.0.smithi079.stdout:9/559: chown d3/d7/dc/de/d17/d6e/ca8 7865 1 2024-09-10T09:36:08.186 INFO:tasks.workunit.client.0.smithi079.stdout:9/560: truncate d3/d7/d26/f80 4510354 0 2024-09-10T09:36:08.186 INFO:tasks.workunit.client.0.smithi079.stdout:9/561: readlink d3/d7/dc/de/d58/l67 0 2024-09-10T09:36:08.187 INFO:tasks.workunit.client.0.smithi079.stdout:9/562: chown d3/d7/dc/de/d17/f78 32 1 2024-09-10T09:36:08.187 INFO:tasks.workunit.client.0.smithi079.stdout:9/563: chown d3/d40 1057053168 1 2024-09-10T09:36:08.187 INFO:tasks.workunit.client.0.smithi079.stdout:0/582: getdents d4/d12/d21/d3f/db3 0 2024-09-10T09:36:08.187 INFO:tasks.workunit.client.0.smithi079.stdout:0/583: chown d4/d1d/l7f 662 1 2024-09-10T09:36:08.187 INFO:tasks.workunit.client.0.smithi079.stdout:6/690: mknod d4/d8/dc/d93/d4b/ce2 0 2024-09-10T09:36:08.187 INFO:tasks.workunit.client.0.smithi079.stdout:6/691: fdatasync d4/d8/dd/d76/d46/f3a 0 2024-09-10T09:36:08.188 INFO:tasks.workunit.client.0.smithi079.stdout:5/609: truncate d2/d3/d27/f87 2610981 0 2024-09-10T09:36:08.188 INFO:tasks.workunit.client.0.smithi079.stdout:5/610: creat d2/d41/d4d/fcf x:0 0 0 2024-09-10T09:36:08.188 INFO:tasks.workunit.client.0.smithi079.stdout:5/611: write d2/d41/d4d/fcf [866860,115359] 0 2024-09-10T09:36:08.188 INFO:tasks.workunit.client.0.smithi079.stdout:5/612: write d2/d3/d5e/fa7 [1587882,100273] 0 2024-09-10T09:36:08.189 INFO:tasks.workunit.client.0.smithi079.stdout:9/564: symlink d3/d7/dc/d7a/lb3 0 2024-09-10T09:36:08.189 INFO:tasks.workunit.client.0.smithi079.stdout:6/692: dread d4/d8/dc/d3c/f99 [0,4194304] 0 2024-09-10T09:36:08.190 INFO:tasks.workunit.client.0.smithi079.stdout:0/584: creat d4/d12/d15/d6b/fc5 x:0 0 0 2024-09-10T09:36:08.190 INFO:tasks.workunit.client.0.smithi079.stdout:4/634: dwrite d1/da/d16/d88/fd1 [0,4194304] 0 2024-09-10T09:36:08.191 INFO:tasks.workunit.client.0.smithi079.stdout:1/770: dwrite d5/fe [0,4194304] 0 2024-09-10T09:36:08.192 INFO:tasks.workunit.client.0.smithi079.stdout:2/525: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/f78 [0,4194304] 0 2024-09-10T09:36:08.192 INFO:tasks.workunit.client.0.smithi079.stdout:1/771: write d5/d40/fc1 [334466,81256] 0 2024-09-10T09:36:08.192 INFO:tasks.workunit.client.0.smithi079.stdout:1/772: fdatasync d5/df/d11/d76/dad/f92 0 2024-09-10T09:36:08.192 INFO:tasks.workunit.client.0.smithi079.stdout:1/773: fdatasync d5/df/d11/f1b 0 2024-09-10T09:36:08.192 INFO:tasks.workunit.client.0.smithi079.stdout:5/613: fdatasync d2/d41/d4d/fcf 0 2024-09-10T09:36:08.193 INFO:tasks.workunit.client.0.smithi079.stdout:6/693: creat d4/d8/dd/d41/d51/fe3 x:0 0 0 2024-09-10T09:36:08.195 INFO:tasks.workunit.client.0.smithi079.stdout:0/585: truncate d4/d12/d21/f43 2867889 0 2024-09-10T09:36:08.195 INFO:tasks.workunit.client.0.smithi079.stdout:0/586: creat d4/d1d/d24/d72/fc6 x:0 0 0 2024-09-10T09:36:08.201 INFO:tasks.workunit.client.0.smithi079.stdout:4/635: dread d1/da/d3b/d5f/fae [0,4194304] 0 2024-09-10T09:36:08.203 INFO:tasks.workunit.client.0.smithi079.stdout:5/614: truncate d2/f22 1530788 0 2024-09-10T09:36:08.205 INFO:tasks.workunit.client.0.smithi079.stdout:1/774: mknod d5/d24/dec/c102 0 2024-09-10T09:36:08.206 INFO:tasks.workunit.client.0.smithi079.stdout:3/683: sync 2024-09-10T09:36:08.206 INFO:tasks.workunit.client.0.smithi079.stdout:3/684: creat d4/da/d8a/fca x:0 0 0 2024-09-10T09:36:08.206 INFO:tasks.workunit.client.0.smithi079.stdout:3/685: write d4/da/d17/d9b/db1/fc3 [1239651,7844] 0 2024-09-10T09:36:08.206 INFO:tasks.workunit.client.0.smithi079.stdout:3/686: stat d4/da/d17/f52 0 2024-09-10T09:36:08.206 INFO:tasks.workunit.client.0.smithi079.stdout:1/775: write d5/df/dd0/f9c [374990,110526] 0 2024-09-10T09:36:08.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:07 smithi079 ceph-mon[27592]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:08.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:07 smithi079 ceph-mon[27592]: pgmap v258: 65 pgs: 65 active+clean; 1.3 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 147 MiB/s rd, 177 MiB/s wr, 651 op/s 2024-09-10T09:36:08.212 INFO:tasks.workunit.client.0.smithi079.stdout:6/694: symlink d4/d8/dc/d93/da0/le4 0 2024-09-10T09:36:08.213 INFO:tasks.workunit.client.0.smithi079.stdout:9/565: dwrite d3/d40/f47 [0,4194304] 0 2024-09-10T09:36:08.217 INFO:tasks.workunit.client.0.smithi079.stdout:0/587: unlink d4/d12/d16/c23 0 2024-09-10T09:36:08.217 INFO:tasks.workunit.client.0.smithi079.stdout:0/588: truncate d4/d12/f96 1691892 0 2024-09-10T09:36:08.217 INFO:tasks.workunit.client.0.smithi079.stdout:0/589: write d4/fe [2409944,118205] 0 2024-09-10T09:36:08.218 INFO:tasks.workunit.client.0.smithi079.stdout:2/526: rename d4/dc/d1c/d86/d1b/d38/d39/d31/d49/l4f to d4/dc/d1c/d86/d1b/la5 0 2024-09-10T09:36:08.224 INFO:tasks.workunit.client.0.smithi079.stdout:6/695: link d4/d8/dc/d93/da0/fb8 d4/d8/dc/d93/fe5 0 2024-09-10T09:36:08.224 INFO:tasks.workunit.client.0.smithi079.stdout:6/696: write d4/d8/dc/f6f [834556,47692] 0 2024-09-10T09:36:08.232 INFO:tasks.workunit.client.0.smithi079.stdout:4/636: rename d1/da/d16/d21/d32/f44 to d1/da/d16/fd3 0 2024-09-10T09:36:08.234 INFO:tasks.workunit.client.0.smithi079.stdout:4/637: mknod d1/da/d28/d47/da1/d83/cd4 0 2024-09-10T09:36:08.235 INFO:tasks.workunit.client.0.smithi079.stdout:4/638: symlink d1/da/d16/ld5 0 2024-09-10T09:36:08.236 INFO:tasks.workunit.client.0.smithi079.stdout:4/639: mknod d1/d9b/cd6 0 2024-09-10T09:36:08.237 INFO:tasks.workunit.client.0.smithi079.stdout:4/640: write d1/da/d28/fa2 [175112,33839] 0 2024-09-10T09:36:08.238 INFO:tasks.workunit.client.0.smithi079.stdout:4/641: unlink d1/d38/c90 0 2024-09-10T09:36:08.240 INFO:tasks.workunit.client.0.smithi079.stdout:4/642: unlink d1/da/d3b/l54 0 2024-09-10T09:36:08.241 INFO:tasks.workunit.client.0.smithi079.stdout:4/643: rename d1/da/d28/d47/da1/d83/la7 to d1/da/d28/d47/da1/d83/ld7 0 2024-09-10T09:36:08.241 INFO:tasks.workunit.client.0.smithi079.stdout:4/644: readlink d1/da/d28/d47/da1/l86 0 2024-09-10T09:36:08.243 INFO:tasks.workunit.client.0.smithi079.stdout:3/687: dwrite d4/da/f57 [0,4194304] 0 2024-09-10T09:36:08.243 INFO:tasks.workunit.client.0.smithi079.stdout:8/609: sync 2024-09-10T09:36:08.247 INFO:tasks.workunit.client.0.smithi079.stdout:3/688: rename d4/da/d56/f5e to d4/da/d17/d2d/d43/d4c/fcb 0 2024-09-10T09:36:08.247 INFO:tasks.workunit.client.0.smithi079.stdout:0/590: dwrite d4/d1d/d24/d72/fc6 [0,4194304] 0 2024-09-10T09:36:08.250 INFO:tasks.workunit.client.0.smithi079.stdout:3/689: link d4/da/d18/daf/c8c d4/da/d17/d54/ccc 0 2024-09-10T09:36:08.253 INFO:tasks.workunit.client.0.smithi079.stdout:2/527: dwrite d4/f7a [0,4194304] 0 2024-09-10T09:36:08.254 INFO:tasks.workunit.client.0.smithi079.stdout:6/697: dwrite d4/f40 [0,4194304] 0 2024-09-10T09:36:08.254 INFO:tasks.workunit.client.0.smithi079.stdout:6/698: write d4/d8/dd/d76/f8f [1786552,122870] 0 2024-09-10T09:36:08.256 INFO:tasks.workunit.client.0.smithi079.stdout:3/690: symlink d4/da/d67/db8/lcd 0 2024-09-10T09:36:08.263 INFO:tasks.workunit.client.0.smithi079.stdout:4/645: dwrite d1/da/d3b/d5a/f78 [0,4194304] 0 2024-09-10T09:36:08.263 INFO:tasks.workunit.client.0.smithi079.stdout:2/528: rename d4/dc/d1c/d59 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6 0 2024-09-10T09:36:08.267 INFO:tasks.workunit.client.0.smithi079.stdout:2/529: dread d4/dc/d1c/d86/d1b/d38/d39/d31/f67 [0,4194304] 0 2024-09-10T09:36:08.267 INFO:tasks.workunit.client.0.smithi079.stdout:2/530: chown d4/dc/d1c 2130 1 2024-09-10T09:36:08.270 INFO:tasks.workunit.client.0.smithi079.stdout:4/646: mknod d1/da/dad/cd8 0 2024-09-10T09:36:08.270 INFO:tasks.workunit.client.0.smithi079.stdout:4/647: chown d1/da/d16/f1f 6 1 2024-09-10T09:36:08.270 INFO:tasks.workunit.client.0.smithi079.stdout:4/648: write d1/da/d3b/db3/fc1 [980397,122797] 0 2024-09-10T09:36:08.272 INFO:tasks.workunit.client.0.smithi079.stdout:2/531: creat d4/dc/fa7 x:0 0 0 2024-09-10T09:36:08.275 INFO:tasks.workunit.client.0.smithi079.stdout:3/691: rmdir d4/da/d17/d38/d42 39 2024-09-10T09:36:08.275 INFO:tasks.workunit.client.0.smithi079.stdout:3/692: chown d4/da/d17/c99 2 1 2024-09-10T09:36:08.275 INFO:tasks.workunit.client.0.smithi079.stdout:3/693: creat d4/da/d56/d7b/fce x:0 0 0 2024-09-10T09:36:08.276 INFO:tasks.workunit.client.0.smithi079.stdout:3/694: fsync d4/da/d18/f48 0 2024-09-10T09:36:08.276 INFO:tasks.workunit.client.0.smithi079.stdout:3/695: truncate d4/da/d17/d2d/d43/fb9 367175 0 2024-09-10T09:36:08.276 INFO:tasks.workunit.client.0.smithi079.stdout:0/591: dwrite d4/d12/d16/fb0 [0,4194304] 0 2024-09-10T09:36:08.276 INFO:tasks.workunit.client.0.smithi079.stdout:0/592: chown d4/d47/f4c 1764677892 1 2024-09-10T09:36:08.276 INFO:tasks.workunit.client.0.smithi079.stdout:3/696: dread d4/da/d17/fa4 [0,4194304] 0 2024-09-10T09:36:08.277 INFO:tasks.workunit.client.0.smithi079.stdout:2/532: truncate d4/dc/d1c/d86/f3f 1903057 0 2024-09-10T09:36:08.279 INFO:tasks.workunit.client.0.smithi079.stdout:8/610: write d11/d2b/d4b/f56 [1583581,6113] 0 2024-09-10T09:36:08.279 INFO:tasks.workunit.client.0.smithi079.stdout:4/649: read d1/da/fb [773663,23328] 0 2024-09-10T09:36:08.280 INFO:tasks.workunit.client.0.smithi079.stdout:6/699: dwrite d4/d8/dc/d12/d29/db5/fbc [0,4194304] 0 2024-09-10T09:36:08.280 INFO:tasks.workunit.client.0.smithi079.stdout:6/700: read d4/d8/dc/d12/d29/f8b [944807,118364] 0 2024-09-10T09:36:08.281 INFO:tasks.workunit.client.0.smithi079.stdout:6/701: fsync d4/d8/dc/d1c/f1d 0 2024-09-10T09:36:08.281 INFO:tasks.workunit.client.0.smithi079.stdout:3/697: mkdir d4/da/d67/dcf 0 2024-09-10T09:36:08.281 INFO:tasks.workunit.client.0.smithi079.stdout:3/698: creat d4/da/d17/d9b/fd0 x:0 0 0 2024-09-10T09:36:08.281 INFO:tasks.workunit.client.0.smithi079.stdout:3/699: truncate d4/da/d17/d54/f41 868078 0 2024-09-10T09:36:08.282 INFO:tasks.workunit.client.0.smithi079.stdout:0/593: read d4/f5 [1096566,21506] 0 2024-09-10T09:36:08.282 INFO:tasks.workunit.client.0.smithi079.stdout:0/594: truncate d4/d12/d21/f43 3575356 0 2024-09-10T09:36:08.282 INFO:tasks.workunit.client.0.smithi079.stdout:2/533: symlink d4/dc/d1c/d86/d1b/d38/d39/la8 0 2024-09-10T09:36:08.283 INFO:tasks.workunit.client.0.smithi079.stdout:8/611: symlink d11/d2b/d4b/d7e/db2/lc7 0 2024-09-10T09:36:08.284 INFO:tasks.workunit.client.0.smithi079.stdout:4/650: mknod d1/da/d28/d47/da1/d73/cd9 0 2024-09-10T09:36:08.284 INFO:tasks.workunit.client.0.smithi079.stdout:4/651: dread - d1/d38/f74 zero size 2024-09-10T09:36:08.290 INFO:tasks.workunit.client.0.smithi079.stdout:2/534: fsync d4/dc/fa7 0 2024-09-10T09:36:08.290 INFO:tasks.workunit.client.0.smithi079.stdout:2/535: fsync d4/dc/d1c/d86/ff 0 2024-09-10T09:36:08.290 INFO:tasks.workunit.client.0.smithi079.stdout:2/536: truncate d4/dc/d1c/f54 466923 0 2024-09-10T09:36:08.291 INFO:tasks.workunit.client.0.smithi079.stdout:4/652: dread d1/da/d3b/d5a/f78 [0,4194304] 0 2024-09-10T09:36:08.291 INFO:tasks.workunit.client.0.smithi079.stdout:4/653: read - d1/d38/f74 zero size 2024-09-10T09:36:08.291 INFO:tasks.workunit.client.0.smithi079.stdout:6/702: truncate d4/d8/dc/d93/d4b/f4d 2269909 0 2024-09-10T09:36:08.293 INFO:tasks.workunit.client.0.smithi079.stdout:3/700: mkdir d4/da/d56/d7b/dd1 0 2024-09-10T09:36:08.293 INFO:tasks.workunit.client.0.smithi079.stdout:3/701: chown d4/da/d18/f55 21 1 2024-09-10T09:36:08.294 INFO:tasks.workunit.client.0.smithi079.stdout:0/595: mkdir d4/d12/d21/d3f/d88/dc7 0 2024-09-10T09:36:08.296 INFO:tasks.workunit.client.0.smithi079.stdout:8/612: truncate d11/d2b/d4b/d74/f7c 2014524 0 2024-09-10T09:36:08.296 INFO:tasks.workunit.client.0.smithi079.stdout:2/537: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/fa9 x:0 0 0 2024-09-10T09:36:08.298 INFO:tasks.workunit.client.0.smithi079.stdout:4/654: creat d1/da/d28/d47/da1/dcd/fda x:0 0 0 2024-09-10T09:36:08.298 INFO:tasks.workunit.client.0.smithi079.stdout:4/655: write d1/da/d3b/d5a/f63 [277968,61057] 0 2024-09-10T09:36:08.298 INFO:tasks.workunit.client.0.smithi079.stdout:4/656: write d1/da/f45 [4341237,32368] 0 2024-09-10T09:36:08.298 INFO:tasks.workunit.client.0.smithi079.stdout:4/657: readlink d1/da/d16/ld5 0 2024-09-10T09:36:08.298 INFO:tasks.workunit.client.0.smithi079.stdout:6/703: mknod d4/d8/dc/d3c/ce6 0 2024-09-10T09:36:08.299 INFO:tasks.workunit.client.0.smithi079.stdout:3/702: fdatasync d4/da/d17/d2d/d43/d4c/f95 0 2024-09-10T09:36:08.300 INFO:tasks.workunit.client.0.smithi079.stdout:0/596: rmdir d4/d12/d1a/d6d/d84 39 2024-09-10T09:36:08.300 INFO:tasks.workunit.client.0.smithi079.stdout:0/597: chown d4/d12/d1a/d29/d32 610770299 1 2024-09-10T09:36:08.300 INFO:tasks.workunit.client.0.smithi079.stdout:8/613: readlink d11/d2b/l58 0 2024-09-10T09:36:08.301 INFO:tasks.workunit.client.0.smithi079.stdout:2/538: truncate d4/f23 7073081 0 2024-09-10T09:36:08.303 INFO:tasks.workunit.client.0.smithi079.stdout:4/658: rename d1/da/d16/d21/d32/f64 to d1/d38/fdb 0 2024-09-10T09:36:08.303 INFO:tasks.workunit.client.0.smithi079.stdout:4/659: chown d1/da/d28 4 1 2024-09-10T09:36:08.304 INFO:tasks.workunit.client.0.smithi079.stdout:3/703: symlink d4/da/ld2 0 2024-09-10T09:36:08.305 INFO:tasks.workunit.client.0.smithi079.stdout:6/704: write d4/d8/dd/d41/f56 [388134,88659] 0 2024-09-10T09:36:08.305 INFO:tasks.workunit.client.0.smithi079.stdout:0/598: mkdir d4/d12/dc0/dc8 0 2024-09-10T09:36:08.307 INFO:tasks.workunit.client.0.smithi079.stdout:2/539: creat d4/dc/faa x:0 0 0 2024-09-10T09:36:08.308 INFO:tasks.workunit.client.0.smithi079.stdout:3/704: rename d4/da/d67/db8/lcd to d4/da/d17/d9b/ld3 0 2024-09-10T09:36:08.311 INFO:tasks.workunit.client.0.smithi079.stdout:8/614: link d11/d3b/f3d d11/fc8 0 2024-09-10T09:36:08.316 INFO:tasks.workunit.client.0.smithi079.stdout:2/540: symlink d4/d8f/lab 0 2024-09-10T09:36:08.316 INFO:tasks.workunit.client.0.smithi079.stdout:2/541: creat d4/d5d/fac x:0 0 0 2024-09-10T09:36:08.316 INFO:tasks.workunit.client.0.smithi079.stdout:3/705: mkdir d4/da/d17/dc1/dd4 0 2024-09-10T09:36:08.320 INFO:tasks.workunit.client.0.smithi079.stdout:0/599: dread d4/f11 [0,4194304] 0 2024-09-10T09:36:08.321 INFO:tasks.workunit.client.0.smithi079.stdout:2/542: creat d4/d8f/fad x:0 0 0 2024-09-10T09:36:08.322 INFO:tasks.workunit.client.0.smithi079.stdout:7/596: sync 2024-09-10T09:36:08.322 INFO:tasks.workunit.client.0.smithi079.stdout:7/597: write d4/df/d3d/f56 [6983953,128744] 0 2024-09-10T09:36:08.322 INFO:tasks.workunit.client.0.smithi079.stdout:7/598: truncate d4/df/d3d/d82/f5c 1159676 0 2024-09-10T09:36:08.322 INFO:tasks.workunit.client.0.smithi079.stdout:3/706: rename d4/fa9 to d4/da/d17/d72/fd5 0 2024-09-10T09:36:08.325 INFO:tasks.workunit.client.0.smithi079.stdout:8/615: mknod d11/d2b/cc9 0 2024-09-10T09:36:08.325 INFO:tasks.workunit.client.0.smithi079.stdout:8/616: chown d11/d2b/d4b/d74/f7c 93 1 2024-09-10T09:36:08.325 INFO:tasks.workunit.client.0.smithi079.stdout:8/617: write d11/d2b/d4b/fb0 [210127,64122] 0 2024-09-10T09:36:08.326 INFO:tasks.workunit.client.0.smithi079.stdout:0/600: mknod d4/d12/d1a/d6d/d7b/cc9 0 2024-09-10T09:36:08.328 INFO:tasks.workunit.client.0.smithi079.stdout:0/601: rename d4/d12/d1a/d29 to d4/d12/d8b/dca 0 2024-09-10T09:36:08.330 INFO:tasks.workunit.client.0.smithi079.stdout:2/543: rmdir d4/dc/d1c/d86/d1b/d38/d87 39 2024-09-10T09:36:08.330 INFO:tasks.workunit.client.0.smithi079.stdout:2/544: stat d4/d8f/lab 0 2024-09-10T09:36:08.334 INFO:tasks.workunit.client.0.smithi079.stdout:0/602: symlink d4/d12/d15/d2b/lcb 0 2024-09-10T09:36:08.334 INFO:tasks.workunit.client.0.smithi079.stdout:6/705: dwrite d4/d8/dd/f2e [0,4194304] 0 2024-09-10T09:36:08.335 INFO:tasks.workunit.client.0.smithi079.stdout:8/618: dread d11/d2b/f76 [0,4194304] 0 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:8/619: readlink d11/d91/l97 0 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:8/620: write d11/d2b/d4b/d50/d5c/f71 [916526,5701] 0 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:8/621: chown d11/d2b/d4b/d74/da2 72921824 1 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:8/622: write d11/d2b/d4b/f77 [1044002,130469] 0 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:0/603: dread d4/d12/d21/d3f/d88/f8c [0,4194304] 0 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:0/604: readlink d4/d12/d16/l1b 0 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:0/605: dread - d4/d12/d15/d69/fbf zero size 2024-09-10T09:36:08.336 INFO:tasks.workunit.client.0.smithi079.stdout:0/606: truncate d4/d12/d15/d6b/daa/fb4 693646 0 2024-09-10T09:36:08.337 INFO:tasks.workunit.client.0.smithi079.stdout:2/545: rename d4/dc/d1c/d86/d1b/d38/d39/f45 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/fae 0 2024-09-10T09:36:08.340 INFO:tasks.workunit.client.0.smithi079.stdout:3/707: dread d4/da/d17/d2d/fa1 [0,4194304] 0 2024-09-10T09:36:08.340 INFO:tasks.workunit.client.0.smithi079.stdout:4/660: dwrite d1/da/d16/d21/f96 [0,4194304] 0 2024-09-10T09:36:08.341 INFO:tasks.workunit.client.0.smithi079.stdout:6/706: truncate d4/d8/f3b 4923249 0 2024-09-10T09:36:08.342 INFO:tasks.workunit.client.0.smithi079.stdout:8/623: mkdir d11/d2b/d4b/d50/d9e/dca 0 2024-09-10T09:36:08.342 INFO:tasks.workunit.client.0.smithi079.stdout:8/624: truncate d11/d2b/d4b/d74/f83 1735905 0 2024-09-10T09:36:08.343 INFO:tasks.workunit.client.0.smithi079.stdout:0/607: unlink d4/d12/d15/c4f 0 2024-09-10T09:36:08.344 INFO:tasks.workunit.client.0.smithi079.stdout:7/599: dwrite d4/df/d3d/f41 [4194304,4194304] 0 2024-09-10T09:36:08.344 INFO:tasks.workunit.client.0.smithi079.stdout:7/600: creat d4/d6/d4f/d66/fb0 x:0 0 0 2024-09-10T09:36:08.344 INFO:tasks.workunit.client.0.smithi079.stdout:7/601: creat d4/d6/d3e/fb1 x:0 0 0 2024-09-10T09:36:08.345 INFO:tasks.workunit.client.0.smithi079.stdout:2/546: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65 0 2024-09-10T09:36:08.347 INFO:tasks.workunit.client.0.smithi079.stdout:3/708: rename d4/fc8 to d4/da/d67/db8/fd6 0 2024-09-10T09:36:08.365 INFO:tasks.workunit.client.0.smithi079.stdout:4/661: symlink d1/da/d3b/ldc 0 2024-09-10T09:36:08.368 INFO:tasks.workunit.client.0.smithi079.stdout:8/625: link d11/d2b/f75 d11/d3b/fcb 0 2024-09-10T09:36:08.369 INFO:tasks.workunit.client.0.smithi079.stdout:0/608: mknod d4/d12/d1a/d6d/d84/ccc 0 2024-09-10T09:36:08.369 INFO:tasks.workunit.client.0.smithi079.stdout:0/609: chown d4/d12/d15/d6b 64609304 1 2024-09-10T09:36:08.375 INFO:tasks.workunit.client.0.smithi079.stdout:8/626: write d11/f12 [1804735,98720] 0 2024-09-10T09:36:08.375 INFO:tasks.workunit.client.0.smithi079.stdout:8/627: chown d11/d3b/fcb 15996323 1 2024-09-10T09:36:08.376 INFO:tasks.workunit.client.0.smithi079.stdout:2/547: unlink d4/dc/fa7 0 2024-09-10T09:36:08.378 INFO:tasks.workunit.client.0.smithi079.stdout:6/707: dwrite d4/d8/dc/d93/fe5 [0,4194304] 0 2024-09-10T09:36:08.378 INFO:tasks.workunit.client.0.smithi079.stdout:6/708: truncate d4/d8/dc/d93/da0/fc5 4786885 0 2024-09-10T09:36:08.378 INFO:tasks.workunit.client.0.smithi079.stdout:3/709: mkdir d4/da/d8a/dd7 0 2024-09-10T09:36:08.378 INFO:tasks.workunit.client.0.smithi079.stdout:3/710: read d4/da/d18/f47 [431785,128850] 0 2024-09-10T09:36:08.378 INFO:tasks.workunit.client.0.smithi079.stdout:3/711: fsync d4/da/d17/d2d/d43/faa 0 2024-09-10T09:36:08.378 INFO:tasks.workunit.client.0.smithi079.stdout:2/548: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/f51 [0,4194304] 0 2024-09-10T09:36:08.378 INFO:tasks.workunit.client.0.smithi079.stdout:2/549: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/fa9 0 2024-09-10T09:36:08.380 INFO:tasks.workunit.client.0.smithi079.stdout:7/602: dwrite d4/d6/d3e/f85 [0,4194304] 0 2024-09-10T09:36:08.380 INFO:tasks.workunit.client.0.smithi079.stdout:7/603: chown d4/d6/d4f/da7 1 1 2024-09-10T09:36:08.380 INFO:tasks.workunit.client.0.smithi079.stdout:7/604: readlink d4/df/l2f 0 2024-09-10T09:36:08.381 INFO:tasks.workunit.client.0.smithi079.stdout:8/628: unlink d11/d2b/f8b 0 2024-09-10T09:36:08.382 INFO:tasks.workunit.client.0.smithi079.stdout:3/712: creat d4/da/d56/dc5/fd8 x:0 0 0 2024-09-10T09:36:08.383 INFO:tasks.workunit.client.0.smithi079.stdout:0/610: dread d4/d1d/d24/d72/fc6 [0,4194304] 0 2024-09-10T09:36:08.384 INFO:tasks.workunit.client.0.smithi079.stdout:2/550: creat d4/dc/d1c/faf x:0 0 0 2024-09-10T09:36:08.384 INFO:tasks.workunit.client.0.smithi079.stdout:2/551: truncate d4/d8f/fad 790712 0 2024-09-10T09:36:08.384 INFO:tasks.workunit.client.0.smithi079.stdout:7/605: write d4/df/d3d/f40 [1975881,625] 0 2024-09-10T09:36:08.384 INFO:tasks.workunit.client.0.smithi079.stdout:4/662: dwrite d1/da/d28/d95/f8d [0,4194304] 0 2024-09-10T09:36:08.387 INFO:tasks.workunit.client.0.smithi079.stdout:6/709: mknod d4/d8/dc/d1c/ce7 0 2024-09-10T09:36:08.387 INFO:tasks.workunit.client.0.smithi079.stdout:5/615: sync 2024-09-10T09:36:08.389 INFO:tasks.workunit.client.0.smithi079.stdout:0/611: mkdir d4/d12/d15/d2b/dcd 0 2024-09-10T09:36:08.389 INFO:tasks.workunit.client.0.smithi079.stdout:9/566: sync 2024-09-10T09:36:08.389 INFO:tasks.workunit.client.0.smithi079.stdout:1/776: sync 2024-09-10T09:36:08.389 INFO:tasks.workunit.client.0.smithi079.stdout:9/567: chown d3/d7/d26/c5f 0 1 2024-09-10T09:36:08.389 INFO:tasks.workunit.client.0.smithi079.stdout:1/777: truncate d5/df/dd0/d57/fa8 1541820 0 2024-09-10T09:36:08.390 INFO:tasks.workunit.client.0.smithi079.stdout:1/778: write d5/d24/d36/d79/f9f [738421,42281] 0 2024-09-10T09:36:08.390 INFO:tasks.workunit.client.0.smithi079.stdout:4/663: write d1/da/d16/fd3 [1054263,101963] 0 2024-09-10T09:36:08.390 INFO:tasks.workunit.client.0.smithi079.stdout:4/664: fdatasync d1/d9b/db4/fc3 0 2024-09-10T09:36:08.390 INFO:tasks.workunit.client.0.smithi079.stdout:4/665: dread - d1/da/d16/fcb zero size 2024-09-10T09:36:08.390 INFO:tasks.workunit.client.0.smithi079.stdout:4/666: write d1/da/d16/d21/f96 [4233530,114848] 0 2024-09-10T09:36:08.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/552: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/db0 0 2024-09-10T09:36:08.393 INFO:tasks.workunit.client.0.smithi079.stdout:4/667: read d1/da/d16/d88/fd1 [641097,92371] 0 2024-09-10T09:36:08.394 INFO:tasks.workunit.client.0.smithi079.stdout:6/710: creat d4/d8/dc/d93/d8a/ddf/fe8 x:0 0 0 2024-09-10T09:36:08.399 INFO:tasks.workunit.client.0.smithi079.stdout:3/713: dread d4/da/d17/d2d/f34 [4194304,4194304] 0 2024-09-10T09:36:08.399 INFO:tasks.workunit.client.0.smithi079.stdout:6/711: dread d4/d8/dc/d12/f73 [0,4194304] 0 2024-09-10T09:36:08.399 INFO:tasks.workunit.client.0.smithi079.stdout:5/616: unlink d2/d3/d27/d32/f72 0 2024-09-10T09:36:08.399 INFO:tasks.workunit.client.0.smithi079.stdout:5/617: truncate d2/d3/f79 1026820 0 2024-09-10T09:36:08.399 INFO:tasks.workunit.client.0.smithi079.stdout:5/618: write d2/d41/f45 [1371452,10465] 0 2024-09-10T09:36:08.399 INFO:tasks.workunit.client.0.smithi079.stdout:2/553: dread d4/dc/d1c/d86/d1b/d38/d39/d31/f3b [0,4194304] 0 2024-09-10T09:36:08.399 INFO:tasks.workunit.client.0.smithi079.stdout:2/554: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6 298092346 1 2024-09-10T09:36:08.400 INFO:tasks.workunit.client.0.smithi079.stdout:0/612: mkdir d4/d12/d21/d3f/db3/dce 0 2024-09-10T09:36:08.400 INFO:tasks.workunit.client.0.smithi079.stdout:0/613: stat d4/d12/d8b/dca/f74 0 2024-09-10T09:36:08.403 INFO:tasks.workunit.client.0.smithi079.stdout:7/606: write d4/d6/d3e/f85 [2158393,21552] 0 2024-09-10T09:36:08.404 INFO:tasks.workunit.client.0.smithi079.stdout:4/668: symlink d1/da/dad/ldd 0 2024-09-10T09:36:08.408 INFO:tasks.workunit.client.0.smithi079.stdout:3/714: rmdir d4/da/d17/d38/db7 0 2024-09-10T09:36:08.408 INFO:tasks.workunit.client.0.smithi079.stdout:6/712: symlink d4/d8/dd/le9 0 2024-09-10T09:36:08.408 INFO:tasks.workunit.client.0.smithi079.stdout:6/713: chown d4/d8/dd/d41/lc1 1 1 2024-09-10T09:36:08.408 INFO:tasks.workunit.client.0.smithi079.stdout:6/714: fsync d4/d8/dd/d41/d51/f5c 0 2024-09-10T09:36:08.408 INFO:tasks.workunit.client.0.smithi079.stdout:6/715: fdatasync d4/d8/dc/d12/d29/f31 0 2024-09-10T09:36:08.409 INFO:tasks.workunit.client.0.smithi079.stdout:2/555: rename d4/dc/d1c/d86/d1b/d38/d39/l60 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/lb1 0 2024-09-10T09:36:08.410 INFO:tasks.workunit.client.0.smithi079.stdout:8/629: dwrite d11/f2a [0,4194304] 0 2024-09-10T09:36:08.568 INFO:tasks.workunit.client.0.smithi079.stdout:9/568: dwrite d3/d7/d26/f4d [0,4194304] 0 2024-09-10T09:36:08.572 INFO:tasks.workunit.client.0.smithi079.stdout:0/614: creat d4/d12/d21/fcf x:0 0 0 2024-09-10T09:36:08.572 INFO:tasks.workunit.client.0.smithi079.stdout:0/615: chown d4/d12/d1a/d6d/d84 27 1 2024-09-10T09:36:08.576 INFO:tasks.workunit.client.0.smithi079.stdout:3/715: mknod d4/da/d18/db5/cd9 0 2024-09-10T09:36:08.576 INFO:tasks.workunit.client.0.smithi079.stdout:4/669: dread d1/da/d28/d99/fb0 [0,4194304] 0 2024-09-10T09:36:08.577 INFO:tasks.workunit.client.0.smithi079.stdout:6/716: readlink d4/d8/dc/d1c/l42 0 2024-09-10T09:36:08.577 INFO:tasks.workunit.client.0.smithi079.stdout:3/716: read d4/da/f6c [2462573,16648] 0 2024-09-10T09:36:08.577 INFO:tasks.workunit.client.0.smithi079.stdout:3/717: chown d4/da/d17/d72/fd5 24105 1 2024-09-10T09:36:08.577 INFO:tasks.workunit.client.0.smithi079.stdout:3/718: readlink d4/da/d18/l36 0 2024-09-10T09:36:08.577 INFO:tasks.workunit.client.0.smithi079.stdout:6/717: write d4/d8/dc/d12/f30 [2361026,31243] 0 2024-09-10T09:36:08.578 INFO:tasks.workunit.client.0.smithi079.stdout:6/718: dread d4/d8/dc/d1c/f87 [0,4194304] 0 2024-09-10T09:36:08.583 INFO:tasks.workunit.client.0.smithi079.stdout:9/569: unlink d3/d7/d26/d69/l6c 0 2024-09-10T09:36:08.591 INFO:tasks.workunit.client.0.smithi079.stdout:4/670: unlink d1/da/d28/d47/da1/d83/ld7 0 2024-09-10T09:36:08.592 INFO:tasks.workunit.client.0.smithi079.stdout:5/619: dwrite d2/d3/f6a [0,4194304] 0 2024-09-10T09:36:08.592 INFO:tasks.workunit.client.0.smithi079.stdout:5/620: readlink d2/d41/l9c 0 2024-09-10T09:36:08.592 INFO:tasks.workunit.client.0.smithi079.stdout:5/621: chown d2/d3/c2f 1 1 2024-09-10T09:36:08.592 INFO:tasks.workunit.client.0.smithi079.stdout:5/622: chown d2/d3/d27/d32/l3c 243233252 1 2024-09-10T09:36:08.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/719: creat d4/da/d56/d7b/dd1/fda x:0 0 0 2024-09-10T09:36:08.593 INFO:tasks.workunit.client.0.smithi079.stdout:4/671: dread d1/da/d16/d21/d32/f8e [0,4194304] 0 2024-09-10T09:36:08.593 INFO:tasks.workunit.client.0.smithi079.stdout:3/720: readlink d4/da/d17/l26 0 2024-09-10T09:36:08.593 INFO:tasks.workunit.client.0.smithi079.stdout:0/616: write d4/d12/d1a/d6d/d7b/f85 [1728249,102390] 0 2024-09-10T09:36:08.594 INFO:tasks.workunit.client.0.smithi079.stdout:7/607: dwrite d4/df/d3d/d75/f97 [0,4194304] 0 2024-09-10T09:36:08.594 INFO:tasks.workunit.client.0.smithi079.stdout:7/608: chown d4/d6/fa 58605 1 2024-09-10T09:36:08.594 INFO:tasks.workunit.client.0.smithi079.stdout:7/609: chown d4/df/d3d/d75 887030 1 2024-09-10T09:36:08.594 INFO:tasks.workunit.client.0.smithi079.stdout:0/617: write d4/d12/d16/d53/d79/f8e [1033197,51403] 0 2024-09-10T09:36:08.594 INFO:tasks.workunit.client.0.smithi079.stdout:0/618: fsync d4/d12/d1a/f51 0 2024-09-10T09:36:08.594 INFO:tasks.workunit.client.0.smithi079.stdout:6/719: symlink d4/d8/dc/d93/d8a/dd7/lea 0 2024-09-10T09:36:08.594 INFO:tasks.workunit.client.0.smithi079.stdout:6/720: stat d4/d8/dd/d41/f45 0 2024-09-10T09:36:08.595 INFO:tasks.workunit.client.0.smithi079.stdout:6/721: readlink d4/d8/dc/d12/d29/l4a 0 2024-09-10T09:36:08.595 INFO:tasks.workunit.client.0.smithi079.stdout:9/570: mkdir d3/d7/dc/de/d17/d2f/d74/db4 0 2024-09-10T09:36:08.595 INFO:tasks.workunit.client.0.smithi079.stdout:1/779: write d5/df/f55 [204617,96835] 0 2024-09-10T09:36:08.600 INFO:tasks.workunit.client.0.smithi079.stdout:5/623: unlink d2/d3/d5e/d61/d71/cb7 0 2024-09-10T09:36:08.607 INFO:tasks.workunit.client.0.smithi079.stdout:3/721: dread d4/da/d17/f3f [0,4194304] 0 2024-09-10T09:36:08.618 INFO:tasks.workunit.client.0.smithi079.stdout:9/571: write d3/f11 [3796683,33131] 0 2024-09-10T09:36:08.625 INFO:tasks.workunit.client.0.smithi079.stdout:7/610: mkdir d4/df/d6b/d9a/db2 0 2024-09-10T09:36:08.626 INFO:tasks.workunit.client.0.smithi079.stdout:7/611: chown d4/d6/d4f 55652 1 2024-09-10T09:36:08.626 INFO:tasks.workunit.client.0.smithi079.stdout:1/780: symlink d5/d24/d36/df3/l103 0 2024-09-10T09:36:08.627 INFO:tasks.workunit.client.0.smithi079.stdout:6/722: write d4/d8/dc/f66 [1285978,96610] 0 2024-09-10T09:36:08.630 INFO:tasks.workunit.client.0.smithi079.stdout:8/630: dwrite d11/d2b/d4b/f77 [0,4194304] 0 2024-09-10T09:36:08.633 INFO:tasks.workunit.client.0.smithi079.stdout:4/672: rmdir d1/da/d28 39 2024-09-10T09:36:08.635 INFO:tasks.workunit.client.0.smithi079.stdout:3/722: link d4/da/d18/daf/fa6 d4/da/d56/d7b/fdb 0 2024-09-10T09:36:08.635 INFO:tasks.workunit.client.0.smithi079.stdout:3/723: creat d4/da/d56/dc5/fdc x:0 0 0 2024-09-10T09:36:08.636 INFO:tasks.workunit.client.0.smithi079.stdout:3/724: chown d4/da/d56/d7b 8979 1 2024-09-10T09:36:08.636 INFO:tasks.workunit.client.0.smithi079.stdout:9/572: write d3/d7/dc/de/d17/d12/fb0 [3327553,15833] 0 2024-09-10T09:36:08.639 INFO:tasks.workunit.client.0.smithi079.stdout:0/619: dwrite d4/d12/d21/f43 [0,4194304] 0 2024-09-10T09:36:08.639 INFO:tasks.workunit.client.0.smithi079.stdout:7/612: unlink d4/df/d3d/d75/f98 0 2024-09-10T09:36:08.639 INFO:tasks.workunit.client.0.smithi079.stdout:5/624: dwrite d2/d3/d27/f69 [0,4194304] 0 2024-09-10T09:36:08.640 INFO:tasks.workunit.client.0.smithi079.stdout:1/781: mknod d5/d24/d36/d3a/d85/c104 0 2024-09-10T09:36:08.641 INFO:tasks.workunit.client.0.smithi079.stdout:6/723: rename d4/d8/d74/ca3 to d4/d8/dc/ceb 0 2024-09-10T09:36:08.647 INFO:tasks.workunit.client.0.smithi079.stdout:9/573: rmdir d3/d7/d70 39 2024-09-10T09:36:08.647 INFO:tasks.workunit.client.0.smithi079.stdout:9/574: fdatasync d3/d40/f5d 0 2024-09-10T09:36:08.648 INFO:tasks.workunit.client.0.smithi079.stdout:4/673: dwrite d1/f2a [8388608,4194304] 0 2024-09-10T09:36:08.648 INFO:tasks.workunit.client.0.smithi079.stdout:0/620: truncate d4/d12/d1a/f51 623345 0 2024-09-10T09:36:08.650 INFO:tasks.workunit.client.0.smithi079.stdout:7/613: mkdir d4/d6/d3e/db3 0 2024-09-10T09:36:08.650 INFO:tasks.workunit.client.0.smithi079.stdout:7/614: truncate d4/dc/d43/f57 1106430 0 2024-09-10T09:36:08.656 INFO:tasks.workunit.client.0.smithi079.stdout:5/625: creat d2/d3/d27/fd0 x:0 0 0 2024-09-10T09:36:08.658 INFO:tasks.workunit.client.0.smithi079.stdout:3/725: rename d4/da/d17/d54/ccc to d4/da/d17/cdd 0 2024-09-10T09:36:08.658 INFO:tasks.workunit.client.0.smithi079.stdout:3/726: fdatasync d4/da/d17/f37 0 2024-09-10T09:36:08.658 INFO:tasks.workunit.client.0.smithi079.stdout:3/727: creat d4/da/d56/d7b/fde x:0 0 0 2024-09-10T09:36:08.658 INFO:tasks.workunit.client.0.smithi079.stdout:3/728: write d4/da/fa5 [997577,119392] 0 2024-09-10T09:36:08.660 INFO:tasks.workunit.client.0.smithi079.stdout:6/724: symlink d4/d8/dc/d93/d8a/dd7/lec 0 2024-09-10T09:36:08.661 INFO:tasks.workunit.client.0.smithi079.stdout:8/631: rmdir d11/d2b/d4b/d50/d55/d87 39 2024-09-10T09:36:08.664 INFO:tasks.workunit.client.0.smithi079.stdout:9/575: symlink d3/d7/dc/de/d17/d6e/lb5 0 2024-09-10T09:36:08.665 INFO:tasks.workunit.client.0.smithi079.stdout:4/674: mkdir d1/d38/da5/dde 0 2024-09-10T09:36:08.665 INFO:tasks.workunit.client.0.smithi079.stdout:4/675: fsync d1/da/d3b/fbe 0 2024-09-10T09:36:08.669 INFO:tasks.workunit.client.0.smithi079.stdout:0/621: creat d4/d12/d1a/fd0 x:0 0 0 2024-09-10T09:36:08.669 INFO:tasks.workunit.client.0.smithi079.stdout:0/622: read d4/fd [271630,75159] 0 2024-09-10T09:36:08.675 INFO:tasks.workunit.client.0.smithi079.stdout:7/615: creat d4/d6/d4f/da7/fb4 x:0 0 0 2024-09-10T09:36:08.675 INFO:tasks.workunit.client.0.smithi079.stdout:7/616: chown d4/dc/f3a 49 1 2024-09-10T09:36:08.675 INFO:tasks.workunit.client.0.smithi079.stdout:5/626: mknod d2/d3/d5e/d73/cd1 0 2024-09-10T09:36:08.675 INFO:tasks.workunit.client.0.smithi079.stdout:2/556: sync 2024-09-10T09:36:08.675 INFO:tasks.workunit.client.0.smithi079.stdout:2/557: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/c6f 63 1 2024-09-10T09:36:08.676 INFO:tasks.workunit.client.0.smithi079.stdout:1/782: rename d5/d40/d46/de8/df6 to d5/d24/d36/d53/dce/d105 0 2024-09-10T09:36:08.677 INFO:tasks.workunit.client.0.smithi079.stdout:8/632: write d11/f88 [3054097,87375] 0 2024-09-10T09:36:08.678 INFO:tasks.workunit.client.0.smithi079.stdout:9/576: mknod d3/d7/dc/de/d17/d12/cb6 0 2024-09-10T09:36:08.681 INFO:tasks.workunit.client.0.smithi079.stdout:7/617: link d4/d6/d3e/f86 d4/d6/da9/fb5 0 2024-09-10T09:36:08.682 INFO:tasks.workunit.client.0.smithi079.stdout:5/627: mknod d2/d3/d5e/d61/cd2 0 2024-09-10T09:36:08.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/558: stat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/lb1 0 2024-09-10T09:36:08.688 INFO:tasks.workunit.client.0.smithi079.stdout:6/725: dwrite d4/d8/dc/d12/d29/f2f [0,4194304] 0 2024-09-10T09:36:08.688 INFO:tasks.workunit.client.0.smithi079.stdout:9/577: mkdir d3/d7/dc/de/db7 0 2024-09-10T09:36:08.688 INFO:tasks.workunit.client.0.smithi079.stdout:4/676: dwrite d1/da/d28/d47/da1/dcd/fda [0,4194304] 0 2024-09-10T09:36:08.689 INFO:tasks.workunit.client.0.smithi079.stdout:7/618: mkdir d4/d6/d4f/d70/db6 0 2024-09-10T09:36:08.690 INFO:tasks.workunit.client.0.smithi079.stdout:1/783: write d5/d24/d36/d53/f61 [2805239,79265] 0 2024-09-10T09:36:08.690 INFO:tasks.workunit.client.0.smithi079.stdout:1/784: creat d5/f106 x:0 0 0 2024-09-10T09:36:08.690 INFO:tasks.workunit.client.0.smithi079.stdout:1/785: dread d5/df/dd0/d57/fb9 [0,4194304] 0 2024-09-10T09:36:08.690 INFO:tasks.workunit.client.0.smithi079.stdout:1/786: fsync d5/df/d11/fd3 0 2024-09-10T09:36:08.690 INFO:tasks.workunit.client.0.smithi079.stdout:5/628: creat d2/d3/d5e/fd3 x:0 0 0 2024-09-10T09:36:08.691 INFO:tasks.workunit.client.0.smithi079.stdout:2/559: creat d4/dc/d1c/d86/d1b/d38/fb2 x:0 0 0 2024-09-10T09:36:08.692 INFO:tasks.workunit.client.0.smithi079.stdout:1/787: write d5/f9d [169505,35817] 0 2024-09-10T09:36:08.692 INFO:tasks.workunit.client.0.smithi079.stdout:1/788: readlink d5/d24/d36/df3/l103 0 2024-09-10T09:36:08.694 INFO:tasks.workunit.client.0.smithi079.stdout:0/623: rename d4/d12/d39/c6f to d4/d12/d1a/d6d/d91/cd1 0 2024-09-10T09:36:08.694 INFO:tasks.workunit.client.0.smithi079.stdout:0/624: fdatasync d4/d12/d1a/f19 0 2024-09-10T09:36:08.694 INFO:tasks.workunit.client.0.smithi079.stdout:0/625: chown d4/d12/d21/d3f/d88 16407 1 2024-09-10T09:36:08.695 INFO:tasks.workunit.client.0.smithi079.stdout:8/633: mkdir d11/dcc 0 2024-09-10T09:36:08.698 INFO:tasks.workunit.client.0.smithi079.stdout:8/634: dread d11/d48/fc4 [0,4194304] 0 2024-09-10T09:36:08.699 INFO:tasks.workunit.client.0.smithi079.stdout:6/726: link d4/d8/dc/d12/d9d/fbb d4/d8/dd/d41/d51/dc7/fed 0 2024-09-10T09:36:08.699 INFO:tasks.workunit.client.0.smithi079.stdout:6/727: stat d4/d8/d74/fcf 0 2024-09-10T09:36:08.701 INFO:tasks.workunit.client.0.smithi079.stdout:9/578: creat d3/d7/d26/d83/fb8 x:0 0 0 2024-09-10T09:36:08.701 INFO:tasks.workunit.client.0.smithi079.stdout:9/579: write d3/d7/dc/de/d17/f82 [363350,101795] 0 2024-09-10T09:36:08.701 INFO:tasks.workunit.client.0.smithi079.stdout:9/580: fdatasync d3/d7/dc/d62/f75 0 2024-09-10T09:36:08.701 INFO:tasks.workunit.client.0.smithi079.stdout:9/581: fdatasync d3/d7/d26/f4d 0 2024-09-10T09:36:08.703 INFO:tasks.workunit.client.0.smithi079.stdout:6/728: write d4/d8/dd/f1b [6883008,63600] 0 2024-09-10T09:36:08.705 INFO:tasks.workunit.client.0.smithi079.stdout:4/677: mknod d1/da/d16/d21/cdf 0 2024-09-10T09:36:08.705 INFO:tasks.workunit.client.0.smithi079.stdout:4/678: fdatasync d1/da/d28/fb5 0 2024-09-10T09:36:08.708 INFO:tasks.workunit.client.0.smithi079.stdout:7/619: creat d4/d6/d38/fb7 x:0 0 0 2024-09-10T09:36:08.709 INFO:tasks.workunit.client.0.smithi079.stdout:7/620: write d4/d6/fa [8286009,20067] 0 2024-09-10T09:36:08.712 INFO:tasks.workunit.client.0.smithi079.stdout:2/560: mknod d4/d8f/cb3 0 2024-09-10T09:36:08.715 INFO:tasks.workunit.client.0.smithi079.stdout:1/789: rename d5/df/d2e/c6d to d5/df/dc6/c107 0 2024-09-10T09:36:08.720 INFO:tasks.workunit.client.0.smithi079.stdout:9/582: creat d3/d7/dc/de/d17/d2f/d98/da1/fb9 x:0 0 0 2024-09-10T09:36:08.723 INFO:tasks.workunit.client.0.smithi079.stdout:7/621: getdents d4/df/d6b/d9a 0 2024-09-10T09:36:08.723 INFO:tasks.workunit.client.0.smithi079.stdout:7/622: chown d4/l23 34 1 2024-09-10T09:36:08.723 INFO:tasks.workunit.client.0.smithi079.stdout:7/623: fdatasync d4/f5d 0 2024-09-10T09:36:08.723 INFO:tasks.workunit.client.0.smithi079.stdout:7/624: fsync d4/dc/f6d 0 2024-09-10T09:36:08.723 INFO:tasks.workunit.client.0.smithi079.stdout:7/625: read - d4/d6/d3e/f86 zero size 2024-09-10T09:36:08.724 INFO:tasks.workunit.client.0.smithi079.stdout:0/626: dwrite d4/d12/d1a/d6d/d7b/f85 [0,4194304] 0 2024-09-10T09:36:08.725 INFO:tasks.workunit.client.0.smithi079.stdout:8/635: dwrite d11/d2b/d4b/f77 [0,4194304] 0 2024-09-10T09:36:08.725 INFO:tasks.workunit.client.0.smithi079.stdout:8/636: fdatasync d11/d48/fc4 0 2024-09-10T09:36:08.725 INFO:tasks.workunit.client.0.smithi079.stdout:2/561: creat d4/dc/fb4 x:0 0 0 2024-09-10T09:36:08.725 INFO:tasks.workunit.client.0.smithi079.stdout:2/562: write d4/f23 [8025381,62144] 0 2024-09-10T09:36:08.725 INFO:tasks.workunit.client.0.smithi079.stdout:2/563: creat d4/d8f/fb5 x:0 0 0 2024-09-10T09:36:08.726 INFO:tasks.workunit.client.0.smithi079.stdout:5/629: dwrite d2/f22 [0,4194304] 0 2024-09-10T09:36:08.726 INFO:tasks.workunit.client.0.smithi079.stdout:5/630: write d2/d3/d27/fc6 [141849,22703] 0 2024-09-10T09:36:08.728 INFO:tasks.workunit.client.0.smithi079.stdout:1/790: mkdir d5/df/dc6/de6/d108 0 2024-09-10T09:36:08.729 INFO:tasks.workunit.client.0.smithi079.stdout:7/626: symlink d4/df/d3d/d75/lb8 0 2024-09-10T09:36:08.731 INFO:tasks.workunit.client.0.smithi079.stdout:0/627: link d4/d12/d15/d69/fa8 d4/d12/d21/d3f/d80/fd2 0 2024-09-10T09:36:08.731 INFO:tasks.workunit.client.0.smithi079.stdout:5/631: dread d2/d3/d5e/fa7 [0,4194304] 0 2024-09-10T09:36:08.735 INFO:tasks.workunit.client.0.smithi079.stdout:8/637: read d11/f2a [4158099,83591] 0 2024-09-10T09:36:08.735 INFO:tasks.workunit.client.0.smithi079.stdout:8/638: fsync d11/d2b/fbb 0 2024-09-10T09:36:08.738 INFO:tasks.workunit.client.0.smithi079.stdout:6/729: dwrite d4/d8/dc/fe [0,4194304] 0 2024-09-10T09:36:08.797 INFO:tasks.workunit.client.0.smithi079.stdout:2/564: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fb6 x:0 0 0 2024-09-10T09:36:08.800 INFO:tasks.workunit.client.0.smithi079.stdout:1/791: creat d5/d40/d46/df0/f109 x:0 0 0 2024-09-10T09:36:08.800 INFO:tasks.workunit.client.0.smithi079.stdout:1/792: creat d5/d40/d46/f10a x:0 0 0 2024-09-10T09:36:08.800 INFO:tasks.workunit.client.0.smithi079.stdout:1/793: chown d5/df/d11/fd3 1 1 2024-09-10T09:36:08.800 INFO:tasks.workunit.client.0.smithi079.stdout:6/730: dwrite d4/d8/dc/d93/da0/fd2 [0,4194304] 0 2024-09-10T09:36:08.802 INFO:tasks.workunit.client.0.smithi079.stdout:0/628: fsync d4/d12/d39/fa0 0 2024-09-10T09:36:08.805 INFO:tasks.workunit.client.0.smithi079.stdout:8/639: creat d11/d2b/d4b/da8/fcd x:0 0 0 2024-09-10T09:36:08.805 INFO:tasks.workunit.client.0.smithi079.stdout:8/640: readlink d11/l8d 0 2024-09-10T09:36:08.805 INFO:tasks.workunit.client.0.smithi079.stdout:8/641: fsync d11/f19 0 2024-09-10T09:36:08.805 INFO:tasks.workunit.client.0.smithi079.stdout:8/642: creat d11/d2b/d4b/da8/fce x:0 0 0 2024-09-10T09:36:08.811 INFO:tasks.workunit.client.0.smithi079.stdout:4/679: rename d1/da/dad to d1/da/d3b/de0 0 2024-09-10T09:36:08.811 INFO:tasks.workunit.client.0.smithi079.stdout:4/680: fsync d1/d38/da5/fce 0 2024-09-10T09:36:08.811 INFO:tasks.workunit.client.0.smithi079.stdout:4/681: chown d1/da/d16/d21/d32/l67 519324998 1 2024-09-10T09:36:08.818 INFO:tasks.workunit.client.0.smithi079.stdout:1/794: truncate d5/df/dd0/f7d 221502 0 2024-09-10T09:36:08.824 INFO:tasks.workunit.client.0.smithi079.stdout:6/731: rmdir d4/d8/dc/d93/d8a/dab 0 2024-09-10T09:36:08.824 INFO:tasks.workunit.client.0.smithi079.stdout:6/732: chown d4/d8/dc/d12/f89 57325 1 2024-09-10T09:36:08.824 INFO:tasks.workunit.client.0.smithi079.stdout:4/682: dread d1/da/d28/d95/f8d [0,4194304] 0 2024-09-10T09:36:08.826 INFO:tasks.workunit.client.0.smithi079.stdout:7/627: mkdir d4/df/d19/db9 0 2024-09-10T09:36:08.826 INFO:tasks.workunit.client.0.smithi079.stdout:7/628: write d4/df/d3d/d75/fa8 [292938,100156] 0 2024-09-10T09:36:08.826 INFO:tasks.workunit.client.0.smithi079.stdout:6/733: dread d4/d8/dc/d1c/f87 [0,4194304] 0 2024-09-10T09:36:08.826 INFO:tasks.workunit.client.0.smithi079.stdout:5/632: getdents d2/d3/d27/d70/d80 0 2024-09-10T09:36:08.826 INFO:tasks.workunit.client.0.smithi079.stdout:6/734: fdatasync d4/d8/dc/d12/d29/fa8 0 2024-09-10T09:36:08.828 INFO:tasks.workunit.client.0.smithi079.stdout:2/565: dwrite d4/d8f/fad [0,4194304] 0 2024-09-10T09:36:08.828 INFO:tasks.workunit.client.0.smithi079.stdout:1/795: creat d5/d24/d36/d3a/d100/f10b x:0 0 0 2024-09-10T09:36:08.829 INFO:tasks.workunit.client.0.smithi079.stdout:6/735: creat d4/d8/dc/fee x:0 0 0 2024-09-10T09:36:08.829 INFO:tasks.workunit.client.0.smithi079.stdout:6/736: readlink d4/d8/dc/d12/l18 0 2024-09-10T09:36:08.829 INFO:tasks.workunit.client.0.smithi079.stdout:5/633: getdents d2/d3/d27/d70 0 2024-09-10T09:36:08.830 INFO:tasks.workunit.client.0.smithi079.stdout:5/634: readlink d2/l1e 0 2024-09-10T09:36:08.831 INFO:tasks.workunit.client.0.smithi079.stdout:0/629: dwrite d4/d12/f96 [0,4194304] 0 2024-09-10T09:36:08.831 INFO:tasks.workunit.client.0.smithi079.stdout:5/635: dread d2/f58 [0,4194304] 0 2024-09-10T09:36:08.831 INFO:tasks.workunit.client.0.smithi079.stdout:8/643: dwrite d11/d2b/f76 [0,4194304] 0 2024-09-10T09:36:08.835 INFO:tasks.workunit.client.0.smithi079.stdout:2/566: rmdir d4/dc/d1c/d86/d1b/d38/d39/d31 39 2024-09-10T09:36:08.839 INFO:tasks.workunit.client.0.smithi079.stdout:1/796: mkdir d5/df/d2e/d10c 0 2024-09-10T09:36:08.842 INFO:tasks.workunit.client.0.smithi079.stdout:6/737: truncate d4/d8/dc/d12/d29/f31 2157203 0 2024-09-10T09:36:08.842 INFO:tasks.workunit.client.0.smithi079.stdout:9/583: sync 2024-09-10T09:36:08.842 INFO:tasks.workunit.client.0.smithi079.stdout:3/729: sync 2024-09-10T09:36:08.842 INFO:tasks.workunit.client.0.smithi079.stdout:9/584: write d3/d7/d26/f80 [1872537,65514] 0 2024-09-10T09:36:08.848 INFO:tasks.workunit.client.0.smithi079.stdout:0/630: getdents d4/d12/d15/d2b 0 2024-09-10T09:36:08.848 INFO:tasks.workunit.client.0.smithi079.stdout:0/631: fsync d4/d12/d15/d69/fbf 0 2024-09-10T09:36:08.848 INFO:tasks.workunit.client.0.smithi079.stdout:0/632: write d4/d12/d21/fcf [1034740,17222] 0 2024-09-10T09:36:08.848 INFO:tasks.workunit.client.0.smithi079.stdout:0/633: chown d4/f70 62311 1 2024-09-10T09:36:08.849 INFO:tasks.workunit.client.0.smithi079.stdout:5/636: symlink d2/d3/d27/d70/d88/ld4 0 2024-09-10T09:36:08.849 INFO:tasks.workunit.client.0.smithi079.stdout:2/567: write d4/dc/d1c/d86/d1b/d38/d39/d31/d52/f5a [4854039,115292] 0 2024-09-10T09:36:08.850 INFO:tasks.workunit.client.0.smithi079.stdout:5/637: read d2/f15 [167727,44091] 0 2024-09-10T09:36:08.850 INFO:tasks.workunit.client.0.smithi079.stdout:1/797: link d5/fe d5/df/dd0/da0/f10d 0 2024-09-10T09:36:08.852 INFO:tasks.workunit.client.0.smithi079.stdout:3/730: mkdir d4/da/d17/ddf 0 2024-09-10T09:36:08.852 INFO:tasks.workunit.client.0.smithi079.stdout:3/731: creat d4/da/d56/dc5/fe0 x:0 0 0 2024-09-10T09:36:08.852 INFO:tasks.workunit.client.0.smithi079.stdout:5/638: read d2/d3/f99 [189913,61177] 0 2024-09-10T09:36:08.853 INFO:tasks.workunit.client.0.smithi079.stdout:3/732: read d4/da/d17/d9b/db1/fc3 [567668,123118] 0 2024-09-10T09:36:08.853 INFO:tasks.workunit.client.0.smithi079.stdout:6/738: mkdir d4/d8/dc/d12/d9d/def 0 2024-09-10T09:36:08.855 INFO:tasks.workunit.client.0.smithi079.stdout:7/629: dwrite d4/dc/f92 [0,4194304] 0 2024-09-10T09:36:08.855 INFO:tasks.workunit.client.0.smithi079.stdout:4/683: dwrite d1/da/d16/f1f [0,4194304] 0 2024-09-10T09:36:08.856 INFO:tasks.workunit.client.0.smithi079.stdout:9/585: creat d3/d7/dc/de/fba x:0 0 0 2024-09-10T09:36:08.856 INFO:tasks.workunit.client.0.smithi079.stdout:9/586: read d3/d7/dc/de/d17/d2f/d74/fa3 [2546639,128117] 0 2024-09-10T09:36:08.857 INFO:tasks.workunit.client.0.smithi079.stdout:0/634: link d4/c9f d4/d12/d16/d53/d79/cd3 0 2024-09-10T09:36:08.861 INFO:tasks.workunit.client.0.smithi079.stdout:6/739: dread d4/d8/dc/d93/da0/fb8 [0,4194304] 0 2024-09-10T09:36:08.861 INFO:tasks.workunit.client.0.smithi079.stdout:8/644: truncate d11/d2b/d4b/d50/d55/d87/faf 5854 0 2024-09-10T09:36:08.862 INFO:tasks.workunit.client.0.smithi079.stdout:8/645: readlink d11/d3b/l98 0 2024-09-10T09:36:08.863 INFO:tasks.workunit.client.0.smithi079.stdout:4/684: write d1/da/d28/d95/f8d [2178176,77397] 0 2024-09-10T09:36:08.863 INFO:tasks.workunit.client.0.smithi079.stdout:2/568: truncate d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/f51 76741 0 2024-09-10T09:36:08.864 INFO:tasks.workunit.client.0.smithi079.stdout:5/639: rename d2/f3d to d2/fd5 0 2024-09-10T09:36:08.865 INFO:tasks.workunit.client.0.smithi079.stdout:3/733: symlink d4/da/d56/le1 0 2024-09-10T09:36:08.866 INFO:tasks.workunit.client.0.smithi079.stdout:7/630: write d4/df/f77 [330922,46016] 0 2024-09-10T09:36:08.866 INFO:tasks.workunit.client.0.smithi079.stdout:7/631: dread - d4/d6/f99 zero size 2024-09-10T09:36:08.868 INFO:tasks.workunit.client.0.smithi079.stdout:9/587: creat d3/d7/dc/de/d17/d2f/d98/fbb x:0 0 0 2024-09-10T09:36:08.869 INFO:tasks.workunit.client.0.smithi079.stdout:0/635: symlink d4/d12/d16/d53/d6a/ld4 0 2024-09-10T09:36:08.869 INFO:tasks.workunit.client.0.smithi079.stdout:0/636: fdatasync d4/d1d/d24/fa9 0 2024-09-10T09:36:08.870 INFO:tasks.workunit.client.0.smithi079.stdout:2/569: dread d4/fb [0,4194304] 0 2024-09-10T09:36:08.870 INFO:tasks.workunit.client.0.smithi079.stdout:2/570: chown d4/dc/d1c/d86/ff 1436 1 2024-09-10T09:36:08.876 INFO:tasks.workunit.client.0.smithi079.stdout:5/640: creat d2/d3/d27/d32/d44/db4/fd6 x:0 0 0 2024-09-10T09:36:08.878 INFO:tasks.workunit.client.0.smithi079.stdout:1/798: dwrite d5/d24/f66 [0,4194304] 0 2024-09-10T09:36:08.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/571: write d4/dc/f70 [1388009,47387] 0 2024-09-10T09:36:08.879 INFO:tasks.workunit.client.0.smithi079.stdout:3/734: mknod d4/da/ce2 0 2024-09-10T09:36:08.883 INFO:tasks.workunit.client.0.smithi079.stdout:7/632: mkdir d4/d6/d4f/d70/dba 0 2024-09-10T09:36:08.884 INFO:tasks.workunit.client.0.smithi079.stdout:7/633: write d4/d6/da9/fb5 [115174,63348] 0 2024-09-10T09:36:08.884 INFO:tasks.workunit.client.0.smithi079.stdout:9/588: mkdir d3/d7/d70/dbc 0 2024-09-10T09:36:08.886 INFO:tasks.workunit.client.0.smithi079.stdout:4/685: rmdir d1/da/d16/d88 39 2024-09-10T09:36:08.888 INFO:tasks.workunit.client.0.smithi079.stdout:4/686: read d1/da/d3b/d5f/f62 [1236158,118415] 0 2024-09-10T09:36:08.888 INFO:tasks.workunit.client.0.smithi079.stdout:5/641: symlink d2/d41/d4d/ld7 0 2024-09-10T09:36:08.890 INFO:tasks.workunit.client.0.smithi079.stdout:1/799: link d5/d24/d36/d3a/dfc/fff d5/d40/dd9/f10e 0 2024-09-10T09:36:08.890 INFO:tasks.workunit.client.0.smithi079.stdout:1/800: fsync d5/d40/faa 0 2024-09-10T09:36:08.894 INFO:tasks.workunit.client.0.smithi079.stdout:6/740: dwrite d4/d8/dc/d12/d29/fa8 [0,4194304] 0 2024-09-10T09:36:08.895 INFO:tasks.workunit.client.0.smithi079.stdout:8/646: dwrite d11/d91/fc6 [0,4194304] 0 2024-09-10T09:36:08.896 INFO:tasks.workunit.client.0.smithi079.stdout:7/634: symlink d4/lbb 0 2024-09-10T09:36:08.898 INFO:tasks.workunit.client.0.smithi079.stdout:4/687: creat d1/da/d16/d88/fe1 x:0 0 0 2024-09-10T09:36:08.900 INFO:tasks.workunit.client.0.smithi079.stdout:0/637: dread d4/d12/d39/f46 [0,4194304] 0 2024-09-10T09:36:08.904 INFO:tasks.workunit.client.0.smithi079.stdout:3/735: dread d4/da/d17/d2d/d43/d4c/f60 [0,4194304] 0 2024-09-10T09:36:08.904 INFO:tasks.workunit.client.0.smithi079.stdout:3/736: write d4/f12 [3749232,117102] 0 2024-09-10T09:36:08.904 INFO:tasks.workunit.client.0.smithi079.stdout:8/647: creat d11/d2b/d4b/d50/d55/db8/fcf x:0 0 0 2024-09-10T09:36:08.907 INFO:tasks.workunit.client.0.smithi079.stdout:4/688: rename d1/da/d3b/f7f to d1/da/d16/d4d/fe2 0 2024-09-10T09:36:08.907 INFO:tasks.workunit.client.0.smithi079.stdout:4/689: stat d1/da/d16/d21/f25 0 2024-09-10T09:36:08.912 INFO:tasks.workunit.client.0.smithi079.stdout:0/638: read d4/d12/d1a/fb [3359200,59629] 0 2024-09-10T09:36:08.912 INFO:tasks.workunit.client.0.smithi079.stdout:0/639: chown d4/d12/d1a/d6d/d7b/cc9 0 1 2024-09-10T09:36:08.912 INFO:tasks.workunit.client.0.smithi079.stdout:0/640: getdents d4/d12/d21/d3f/db3/dce 0 2024-09-10T09:36:08.912 INFO:tasks.workunit.client.0.smithi079.stdout:3/737: symlink d4/da/d17/d38/le3 0 2024-09-10T09:36:08.912 INFO:tasks.workunit.client.0.smithi079.stdout:3/738: chown d4/da/d17/d2d/fa1 12922 1 2024-09-10T09:36:08.913 INFO:tasks.workunit.client.0.smithi079.stdout:8/648: mkdir d11/d2b/d4b/d50/d9e/dca/dd0 0 2024-09-10T09:36:08.913 INFO:tasks.workunit.client.0.smithi079.stdout:8/649: chown d11/d2b/fad 2504217 1 2024-09-10T09:36:08.913 INFO:tasks.workunit.client.0.smithi079.stdout:6/741: dread d4/d8/dc/d98/fa2 [0,4194304] 0 2024-09-10T09:36:08.914 INFO:tasks.workunit.client.0.smithi079.stdout:2/572: dwrite d4/dc/d1c/d86/f3f [0,4194304] 0 2024-09-10T09:36:08.915 INFO:tasks.workunit.client.0.smithi079.stdout:7/635: dread d4/dc/f17 [0,4194304] 0 2024-09-10T09:36:08.915 INFO:tasks.workunit.client.0.smithi079.stdout:7/636: stat d4/df/f77 0 2024-09-10T09:36:08.915 INFO:tasks.workunit.client.0.smithi079.stdout:1/801: dwrite d5/d24/d36/d53/db3/fbc [0,4194304] 0 2024-09-10T09:36:08.915 INFO:tasks.workunit.client.0.smithi079.stdout:9/589: dwrite d3/f16 [0,4194304] 0 2024-09-10T09:36:08.915 INFO:tasks.workunit.client.0.smithi079.stdout:8/650: truncate d11/f88 502382 0 2024-09-10T09:36:08.920 INFO:tasks.workunit.client.0.smithi079.stdout:0/641: write d4/d1d/d24/d72/fc6 [2585552,55994] 0 2024-09-10T09:36:08.923 INFO:tasks.workunit.client.0.smithi079.stdout:2/573: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f7d [0,4194304] 0 2024-09-10T09:36:08.923 INFO:tasks.workunit.client.0.smithi079.stdout:2/574: write d4/dc/d1c/d86/d1b/d38/d39/f4c [8929997,81409] 0 2024-09-10T09:36:08.926 INFO:tasks.workunit.client.0.smithi079.stdout:5/642: rmdir d2 39 2024-09-10T09:36:08.932 INFO:tasks.workunit.client.0.smithi079.stdout:5/643: dread d2/f26 [0,4194304] 0 2024-09-10T09:36:08.932 INFO:tasks.workunit.client.0.smithi079.stdout:5/644: dread - d2/d3/d27/fd0 zero size 2024-09-10T09:36:08.932 INFO:tasks.workunit.client.0.smithi079.stdout:5/645: fdatasync d2/d3/d5e/d61/f6c 0 2024-09-10T09:36:08.932 INFO:tasks.workunit.client.0.smithi079.stdout:5/646: chown d2/d41/f74 733186347 1 2024-09-10T09:36:08.938 INFO:tasks.workunit.client.0.smithi079.stdout:1/802: symlink d5/d40/d46/l10f 0 2024-09-10T09:36:08.943 INFO:tasks.workunit.client.0.smithi079.stdout:9/590: unlink d3/d40/f5d 0 2024-09-10T09:36:08.946 INFO:tasks.workunit.client.0.smithi079.stdout:8/651: mknod d11/d3b/cd1 0 2024-09-10T09:36:08.946 INFO:tasks.workunit.client.0.smithi079.stdout:8/652: fsync d11/d2b/d4b/d50/d55/d87/fc3 0 2024-09-10T09:36:08.952 INFO:tasks.workunit.client.0.smithi079.stdout:0/642: creat d4/fd5 x:0 0 0 2024-09-10T09:36:08.952 INFO:tasks.workunit.client.0.smithi079.stdout:0/643: write d4/d12/d1a/f82 [743749,15170] 0 2024-09-10T09:36:08.952 INFO:tasks.workunit.client.0.smithi079.stdout:0/644: stat d4/d1d/d24/d72/fa4 0 2024-09-10T09:36:08.954 INFO:tasks.workunit.client.0.smithi079.stdout:4/690: rmdir d1/da 39 2024-09-10T09:36:08.961 INFO:tasks.workunit.client.0.smithi079.stdout:3/739: dwrite d4/da/d17/d2d/f76 [0,4194304] 0 2024-09-10T09:36:08.961 INFO:tasks.workunit.client.0.smithi079.stdout:3/740: truncate d4/da/d17/d38/d42/f53 4744500 0 2024-09-10T09:36:08.963 INFO:tasks.workunit.client.0.smithi079.stdout:8/653: write d11/d48/f7b [3797030,128402] 0 2024-09-10T09:36:08.971 INFO:tasks.workunit.client.0.smithi079.stdout:2/575: dwrite d4/dc/d1c/d86/d1b/d38/d39/d31/f46 [4194304,4194304] 0 2024-09-10T09:36:08.971 INFO:tasks.workunit.client.0.smithi079.stdout:4/691: link d1/da/d16/c43 d1/da/d3b/d5a/ce3 0 2024-09-10T09:36:08.971 INFO:tasks.workunit.client.0.smithi079.stdout:4/692: read d1/da/d16/f27 [3972146,121238] 0 2024-09-10T09:36:08.972 INFO:tasks.workunit.client.0.smithi079.stdout:6/742: rename d4/d8/dc/d93/d8a/ddf to d4/d8/dd/d76/d46/df0 0 2024-09-10T09:36:08.972 INFO:tasks.workunit.client.0.smithi079.stdout:6/743: fsync d4/d8/dd/fb7 0 2024-09-10T09:36:08.974 INFO:tasks.workunit.client.0.smithi079.stdout:4/693: dread d1/da/d3b/d5f/fae [0,4194304] 0 2024-09-10T09:36:08.974 INFO:tasks.workunit.client.0.smithi079.stdout:3/741: creat d4/da/d17/d54/fe4 x:0 0 0 2024-09-10T09:36:08.976 INFO:tasks.workunit.client.0.smithi079.stdout:8/654: mknod d11/d2b/d4b/d7e/cd2 0 2024-09-10T09:36:08.977 INFO:tasks.workunit.client.0.smithi079.stdout:1/803: getdents d5/df/dd0/da0 0 2024-09-10T09:36:08.978 INFO:tasks.workunit.client.0.smithi079.stdout:2/576: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/db7 0 2024-09-10T09:36:08.979 INFO:tasks.workunit.client.0.smithi079.stdout:4/694: creat d1/da/d16/d21/d32/fe4 x:0 0 0 2024-09-10T09:36:08.982 INFO:tasks.workunit.client.0.smithi079.stdout:1/804: mknod d5/df/dd0/da0/d6e/dc5/c110 0 2024-09-10T09:36:08.982 INFO:tasks.workunit.client.0.smithi079.stdout:1/805: fsync d5/f9d 0 2024-09-10T09:36:08.982 INFO:tasks.workunit.client.0.smithi079.stdout:9/591: dwrite d3/d7/f2a [4194304,4194304] 0 2024-09-10T09:36:08.982 INFO:tasks.workunit.client.0.smithi079.stdout:5/647: dwrite d2/d3/d27/f2c [0,4194304] 0 2024-09-10T09:36:08.983 INFO:tasks.workunit.client.0.smithi079.stdout:0/645: dwrite d4/d12/d15/d6b/fc5 [0,4194304] 0 2024-09-10T09:36:08.983 INFO:tasks.workunit.client.0.smithi079.stdout:2/577: creat d4/dc/d1c/d86/d1b/d38/d87/fb8 x:0 0 0 2024-09-10T09:36:08.984 INFO:tasks.workunit.client.0.smithi079.stdout:6/744: write d4/d8/dd/d41/d51/dc7/fed [1694811,65506] 0 2024-09-10T09:36:08.985 INFO:tasks.workunit.client.0.smithi079.stdout:8/655: unlink d11/d2b/l38 0 2024-09-10T09:36:08.988 INFO:tasks.workunit.client.0.smithi079.stdout:9/592: creat d3/d7/dc/de/db7/fbd x:0 0 0 2024-09-10T09:36:08.988 INFO:tasks.workunit.client.0.smithi079.stdout:9/593: read d3/d7/d26/f80 [3681778,106416] 0 2024-09-10T09:36:08.990 INFO:tasks.workunit.client.0.smithi079.stdout:2/578: unlink d4/f18 0 2024-09-10T09:36:08.995 INFO:tasks.workunit.client.0.smithi079.stdout:6/745: getdents d4/d8/dc/d98 0 2024-09-10T09:36:09.000 INFO:tasks.workunit.client.0.smithi079.stdout:5/648: dread d2/d3/d27/f69 [0,4194304] 0 2024-09-10T09:36:09.001 INFO:tasks.workunit.client.0.smithi079.stdout:9/594: creat d3/d7/dc/de/d17/d2f/d74/db4/fbe x:0 0 0 2024-09-10T09:36:09.001 INFO:tasks.workunit.client.0.smithi079.stdout:9/595: creat d3/d7/dc/de/d17/d2f/d98/fbf x:0 0 0 2024-09-10T09:36:09.003 INFO:tasks.workunit.client.0.smithi079.stdout:3/742: dwrite d4/da/d17/d38/d42/f7e [0,4194304] 0 2024-09-10T09:36:09.003 INFO:tasks.workunit.client.0.smithi079.stdout:3/743: write d4/da/d17/d2d/d78/fbd [174062,76809] 0 2024-09-10T09:36:09.003 INFO:tasks.workunit.client.0.smithi079.stdout:6/746: getdents d4/d8 0 2024-09-10T09:36:09.003 INFO:tasks.workunit.client.0.smithi079.stdout:2/579: symlink d4/dc/d1c/d86/d1b/d38/lb9 0 2024-09-10T09:36:09.004 INFO:tasks.workunit.client.0.smithi079.stdout:2/580: stat d4/fb 0 2024-09-10T09:36:09.005 INFO:tasks.workunit.client.0.smithi079.stdout:0/646: write d4/d12/d15/f9c [3645217,93423] 0 2024-09-10T09:36:09.007 INFO:tasks.workunit.client.0.smithi079.stdout:1/806: rename d5/df/d11/d76/dad to d5/df/d2e/d10c/d111 0 2024-09-10T09:36:09.007 INFO:tasks.workunit.client.0.smithi079.stdout:8/656: dwrite d11/d2b/fc2 [0,4194304] 0 2024-09-10T09:36:09.007 INFO:tasks.workunit.client.0.smithi079.stdout:8/657: dread - d11/d2b/d4b/da8/fce zero size 2024-09-10T09:36:09.007 INFO:tasks.workunit.client.0.smithi079.stdout:8/658: truncate d11/d2b/d4b/d50/d5c/f6e 924656 0 2024-09-10T09:36:09.007 INFO:tasks.workunit.client.0.smithi079.stdout:8/659: chown d11/d2b/d4b 254410070 1 2024-09-10T09:36:09.009 INFO:tasks.workunit.client.0.smithi079.stdout:6/747: write d4/d8/dc/d98/fa2 [1297866,64087] 0 2024-09-10T09:36:09.020 INFO:tasks.workunit.client.0.smithi079.stdout:1/807: rename d5/l23 to d5/d40/dd9/l112 0 2024-09-10T09:36:09.022 INFO:tasks.workunit.client.0.smithi079.stdout:8/660: truncate d11/d48/f7b 3196424 0 2024-09-10T09:36:09.022 INFO:tasks.workunit.client.0.smithi079.stdout:8/661: chown d11/d2b/d4b/d50/d55/db8/fcf 5 1 2024-09-10T09:36:09.022 INFO:tasks.workunit.client.0.smithi079.stdout:8/662: creat d11/d2b/d4b/d50/d55/db8/fd3 x:0 0 0 2024-09-10T09:36:09.022 INFO:tasks.workunit.client.0.smithi079.stdout:8/663: stat d11/cc5 0 2024-09-10T09:36:09.024 INFO:tasks.workunit.client.0.smithi079.stdout:6/748: truncate d4/d8/dc/d93/d4b/f4c 207821 0 2024-09-10T09:36:09.025 INFO:tasks.workunit.client.0.smithi079.stdout:5/649: rename d2/d41/d4d/c56 to d2/d3/d27/d70/d80/cd8 0 2024-09-10T09:36:09.027 INFO:tasks.workunit.client.0.smithi079.stdout:8/664: mknod d11/dbd/cd4 0 2024-09-10T09:36:09.028 INFO:tasks.workunit.client.0.smithi079.stdout:6/749: mkdir d4/d8/dc/d93/dc4/df1 0 2024-09-10T09:36:09.030 INFO:tasks.workunit.client.0.smithi079.stdout:3/744: rename d4/da/l6e to d4/da/d17/d9b/db1/le5 0 2024-09-10T09:36:09.031 INFO:tasks.workunit.client.0.smithi079.stdout:9/596: dwrite d3/d7/dc/f41 [0,4194304] 0 2024-09-10T09:36:09.031 INFO:tasks.workunit.client.0.smithi079.stdout:5/650: creat d2/d3/d5e/fd9 x:0 0 0 2024-09-10T09:36:09.031 INFO:tasks.workunit.client.0.smithi079.stdout:0/647: dwrite d4/d12/d15/d6b/daa/fb4 [0,4194304] 0 2024-09-10T09:36:09.031 INFO:tasks.workunit.client.0.smithi079.stdout:0/648: creat d4/d12/d15/d6b/fd6 x:0 0 0 2024-09-10T09:36:09.032 INFO:tasks.workunit.client.0.smithi079.stdout:9/597: dread d3/d7/d5a/f89 [0,4194304] 0 2024-09-10T09:36:09.033 INFO:tasks.workunit.client.0.smithi079.stdout:8/665: rmdir d11/dcc 0 2024-09-10T09:36:09.034 INFO:tasks.workunit.client.0.smithi079.stdout:6/750: creat d4/d8/dc/dd9/ff2 x:0 0 0 2024-09-10T09:36:09.034 INFO:tasks.workunit.client.0.smithi079.stdout:6/751: chown d4/d8/dc/d12/d70/f84 1546154 1 2024-09-10T09:36:09.044 INFO:tasks.workunit.client.0.smithi079.stdout:5/651: symlink d2/d3/d27/d70/lda 0 2024-09-10T09:36:09.044 INFO:tasks.workunit.client.0.smithi079.stdout:5/652: chown d2/d3/d5e/d61/fb0 942994 1 2024-09-10T09:36:09.044 INFO:tasks.workunit.client.0.smithi079.stdout:6/752: dread d4/d8/f3b [0,4194304] 0 2024-09-10T09:36:09.044 INFO:tasks.workunit.client.0.smithi079.stdout:0/649: dread d4/d12/f14 [0,4194304] 0 2024-09-10T09:36:09.045 INFO:tasks.workunit.client.0.smithi079.stdout:0/650: creat d4/d1d/d24/d72/fd7 x:0 0 0 2024-09-10T09:36:09.046 INFO:tasks.workunit.client.0.smithi079.stdout:9/598: mkdir d3/d40/dc0 0 2024-09-10T09:36:09.047 INFO:tasks.workunit.client.0.smithi079.stdout:8/666: creat d11/d48/fd5 x:0 0 0 2024-09-10T09:36:09.050 INFO:tasks.workunit.client.0.smithi079.stdout:3/745: getdents d4/da/d18 0 2024-09-10T09:36:09.052 INFO:tasks.workunit.client.0.smithi079.stdout:5/653: creat d2/d3/d27/d32/d44/db4/fdb x:0 0 0 2024-09-10T09:36:09.052 INFO:tasks.workunit.client.0.smithi079.stdout:6/753: dread d4/d8/dc/d1c/f21 [0,4194304] 0 2024-09-10T09:36:09.054 INFO:tasks.workunit.client.0.smithi079.stdout:0/651: creat d4/d12/d8b/dca/d32/dbd/fd8 x:0 0 0 2024-09-10T09:36:09.055 INFO:tasks.workunit.client.0.smithi079.stdout:9/599: mknod d3/dae/cc1 0 2024-09-10T09:36:09.055 INFO:tasks.workunit.client.0.smithi079.stdout:3/746: getdents d4/da/d17/d2d/d78/d79 0 2024-09-10T09:36:09.057 INFO:tasks.workunit.client.0.smithi079.stdout:5/654: creat d2/d41/d4d/fdc x:0 0 0 2024-09-10T09:36:09.057 INFO:tasks.workunit.client.0.smithi079.stdout:8/667: dread d11/d48/f8f [0,4194304] 0 2024-09-10T09:36:09.057 INFO:tasks.workunit.client.0.smithi079.stdout:6/754: truncate d4/d8/dc/d12/d29/db5/fbc 783496 0 2024-09-10T09:36:09.058 INFO:tasks.workunit.client.0.smithi079.stdout:0/652: creat d4/d12/d15/d2b/fd9 x:0 0 0 2024-09-10T09:36:09.059 INFO:tasks.workunit.client.0.smithi079.stdout:0/653: chown d4/d1d/d24/d72/fc6 12746 1 2024-09-10T09:36:09.059 INFO:tasks.workunit.client.0.smithi079.stdout:9/600: rename d3/d7/dc/d62/f6b to d3/d7/dc/de/da7/fc2 0 2024-09-10T09:36:09.061 INFO:tasks.workunit.client.0.smithi079.stdout:3/747: link d4/da/d18/daf/fa6 d4/da/d17/ddf/fe6 0 2024-09-10T09:36:09.061 INFO:tasks.workunit.client.0.smithi079.stdout:3/748: truncate d4/da/d18/fbc 909343 0 2024-09-10T09:36:09.062 INFO:tasks.workunit.client.0.smithi079.stdout:5/655: mknod d2/d3/d59/cdd 0 2024-09-10T09:36:09.063 INFO:tasks.workunit.client.0.smithi079.stdout:6/755: mknod d4/d8/dd/d76/d46/df0/de0/cf3 0 2024-09-10T09:36:09.064 INFO:tasks.workunit.client.0.smithi079.stdout:0/654: symlink d4/d12/d1a/d6d/d7b/lda 0 2024-09-10T09:36:09.064 INFO:tasks.workunit.client.0.smithi079.stdout:0/655: stat d4/d47/l4e 0 2024-09-10T09:36:09.066 INFO:tasks.workunit.client.0.smithi079.stdout:8/668: rename d11/d2b/d4b/d74/f7c to d11/d2b/d4b/d50/d9e/dca/fd6 0 2024-09-10T09:36:09.066 INFO:tasks.workunit.client.0.smithi079.stdout:8/669: write d11/d2b/d4b/d74/f86 [870862,708] 0 2024-09-10T09:36:09.068 INFO:tasks.workunit.client.0.smithi079.stdout:3/749: mkdir d4/da/d17/d2d/d43/de7 0 2024-09-10T09:36:09.068 INFO:tasks.workunit.client.0.smithi079.stdout:5/656: dread - d2/d3/d27/d32/d44/f4c zero size 2024-09-10T09:36:09.069 INFO:tasks.workunit.client.0.smithi079.stdout:5/657: fsync d2/d3/d5e/d61/d71/fbc 0 2024-09-10T09:36:09.070 INFO:tasks.workunit.client.0.smithi079.stdout:6/756: creat d4/d8/dc/d12/d9d/def/ff4 x:0 0 0 2024-09-10T09:36:09.070 INFO:tasks.workunit.client.0.smithi079.stdout:6/757: write d4/d8/dd/d76/d46/d88/fb9 [686839,46121] 0 2024-09-10T09:36:09.072 INFO:tasks.workunit.client.0.smithi079.stdout:3/750: symlink d4/da/d17/le8 0 2024-09-10T09:36:09.074 INFO:tasks.workunit.client.0.smithi079.stdout:7/637: sync 2024-09-10T09:36:09.075 INFO:tasks.workunit.client.0.smithi079.stdout:3/751: rename d4/da/d56/dc5/fdc to d4/da/d17/d9b/fe9 0 2024-09-10T09:36:09.076 INFO:tasks.workunit.client.0.smithi079.stdout:7/638: mknod d4/df/d3d/d75/cbc 0 2024-09-10T09:36:09.077 INFO:tasks.workunit.client.0.smithi079.stdout:3/752: creat d4/da/d67/db8/fea x:0 0 0 2024-09-10T09:36:09.077 INFO:tasks.workunit.client.0.smithi079.stdout:3/753: write d4/da/d17/d2d/d43/fb3 [225858,63782] 0 2024-09-10T09:36:09.078 INFO:tasks.workunit.client.0.smithi079.stdout:8/670: dread d11/f19 [0,4194304] 0 2024-09-10T09:36:09.084 INFO:tasks.workunit.client.0.smithi079.stdout:5/658: dread d2/d3/fb [0,4194304] 0 2024-09-10T09:36:09.088 INFO:tasks.workunit.client.0.smithi079.stdout:8/671: unlink d11/d3b/cd1 0 2024-09-10T09:36:09.090 INFO:tasks.workunit.client.0.smithi079.stdout:3/754: dread d4/da/d18/f6d [0,4194304] 0 2024-09-10T09:36:09.092 INFO:tasks.workunit.client.0.smithi079.stdout:8/672: symlink d11/d2b/d4b/d74/da2/ld7 0 2024-09-10T09:36:09.093 INFO:tasks.workunit.client.0.smithi079.stdout:5/659: mkdir d2/d3/d27/dde 0 2024-09-10T09:36:09.093 INFO:tasks.workunit.client.0.smithi079.stdout:5/660: readlink d2/l1e 0 2024-09-10T09:36:09.097 INFO:tasks.workunit.client.0.smithi079.stdout:8/673: mkdir d11/dd8 0 2024-09-10T09:36:09.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/656: dwrite d4/d12/d1a/d6d/fbb [0,4194304] 0 2024-09-10T09:36:09.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/657: fsync d4/d12/d15/d6b/daa/fb4 0 2024-09-10T09:36:09.099 INFO:tasks.workunit.client.0.smithi079.stdout:0/658: chown d4/d1d 114492 1 2024-09-10T09:36:09.099 INFO:tasks.workunit.client.0.smithi079.stdout:8/674: creat d11/dbd/fd9 x:0 0 0 2024-09-10T09:36:09.099 INFO:tasks.workunit.client.0.smithi079.stdout:8/675: write d11/f88 [1063685,62635] 0 2024-09-10T09:36:09.103 INFO:tasks.workunit.client.0.smithi079.stdout:0/659: link d4/d12/d21/lb6 d4/d12/d21/d3f/db3/ldb 0 2024-09-10T09:36:09.104 INFO:tasks.workunit.client.0.smithi079.stdout:0/660: creat d4/d47/fdc x:0 0 0 2024-09-10T09:36:09.106 INFO:tasks.workunit.client.0.smithi079.stdout:8/676: mkdir d11/d3b/dda 0 2024-09-10T09:36:09.106 INFO:tasks.workunit.client.0.smithi079.stdout:8/677: chown d11/d3b/l8c 21822670 1 2024-09-10T09:36:09.107 INFO:tasks.workunit.client.0.smithi079.stdout:3/755: write d4/da/d18/f48 [276427,21277] 0 2024-09-10T09:36:09.109 INFO:tasks.workunit.client.0.smithi079.stdout:0/661: symlink d4/d12/d16/ldd 0 2024-09-10T09:36:09.109 INFO:tasks.workunit.client.0.smithi079.stdout:0/662: fsync d4/f10 0 2024-09-10T09:36:09.112 INFO:tasks.workunit.client.0.smithi079.stdout:3/756: mkdir d4/da/d17/d2d/d43/de7/deb 0 2024-09-10T09:36:09.112 INFO:tasks.workunit.client.0.smithi079.stdout:3/757: write d4/da/d17/d72/fd5 [3166146,42419] 0 2024-09-10T09:36:09.112 INFO:tasks.workunit.client.0.smithi079.stdout:5/661: write d2/d3/d27/faa [921037,27409] 0 2024-09-10T09:36:09.112 INFO:tasks.workunit.client.0.smithi079.stdout:3/758: write d4/da/d17/d9b/fc2 [50673,110290] 0 2024-09-10T09:36:09.112 INFO:tasks.workunit.client.0.smithi079.stdout:3/759: fdatasync d4/da/d18/f6d 0 2024-09-10T09:36:09.113 INFO:tasks.workunit.client.0.smithi079.stdout:0/663: mkdir d4/d12/dde 0 2024-09-10T09:36:09.117 INFO:tasks.workunit.client.0.smithi079.stdout:6/758: dwrite d4/d8/dd/d76/d46/df0/fe8 [0,4194304] 0 2024-09-10T09:36:09.117 INFO:tasks.workunit.client.0.smithi079.stdout:6/759: fdatasync d4/d8/fa 0 2024-09-10T09:36:09.117 INFO:tasks.workunit.client.0.smithi079.stdout:7/639: dwrite d4/dc/f73 [0,4194304] 0 2024-09-10T09:36:09.117 INFO:tasks.workunit.client.0.smithi079.stdout:7/640: write d4/d6/d4f/fac [188048,44466] 0 2024-09-10T09:36:09.117 INFO:tasks.workunit.client.0.smithi079.stdout:7/641: chown d4/df/d3d/f9e 1040620631 1 2024-09-10T09:36:09.118 INFO:tasks.workunit.client.0.smithi079.stdout:3/760: mknod d4/da/d56/d7b/dd1/cec 0 2024-09-10T09:36:09.119 INFO:tasks.workunit.client.0.smithi079.stdout:6/760: dread d4/d8/dd/f85 [0,4194304] 0 2024-09-10T09:36:09.119 INFO:tasks.workunit.client.0.smithi079.stdout:6/761: fsync d4/d8/dd/d41/d51/f5b 0 2024-09-10T09:36:09.123 INFO:tasks.workunit.client.0.smithi079.stdout:8/678: dread d11/d48/f9f [0,4194304] 0 2024-09-10T09:36:09.123 INFO:tasks.workunit.client.0.smithi079.stdout:8/679: write d11/d2b/fa1 [451482,29743] 0 2024-09-10T09:36:09.124 INFO:tasks.workunit.client.0.smithi079.stdout:8/680: write d11/d2b/f40 [4391494,11055] 0 2024-09-10T09:36:09.124 INFO:tasks.workunit.client.0.smithi079.stdout:6/762: dread d4/d8/dd/d41/d51/f5b [0,4194304] 0 2024-09-10T09:36:09.126 INFO:tasks.workunit.client.0.smithi079.stdout:6/763: dread d4/d8/dc/d1c/f87 [0,4194304] 0 2024-09-10T09:36:09.126 INFO:tasks.workunit.client.0.smithi079.stdout:6/764: creat d4/d8/dc/d12/d29/db5/ff5 x:0 0 0 2024-09-10T09:36:09.126 INFO:tasks.workunit.client.0.smithi079.stdout:6/765: stat d4/d8/dd/d41/d51/dc7/fed 0 2024-09-10T09:36:09.127 INFO:tasks.workunit.client.0.smithi079.stdout:7/642: link d4/dc/d43/f57 d4/d6/d4f/d70/fbd 0 2024-09-10T09:36:09.128 INFO:tasks.workunit.client.0.smithi079.stdout:3/761: truncate d4/da/d17/d2d/d43/f7d 612895 0 2024-09-10T09:36:09.128 INFO:tasks.workunit.client.0.smithi079.stdout:3/762: chown d4/da/d67/db8/fd6 107541 1 2024-09-10T09:36:09.129 INFO:tasks.workunit.client.0.smithi079.stdout:5/662: dwrite d2/f3a [0,4194304] 0 2024-09-10T09:36:09.129 INFO:tasks.workunit.client.0.smithi079.stdout:5/663: dread - d2/d3/d5e/fd3 zero size 2024-09-10T09:36:09.130 INFO:tasks.workunit.client.0.smithi079.stdout:8/681: truncate d11/d48/f6a 2233863 0 2024-09-10T09:36:09.132 INFO:tasks.workunit.client.0.smithi079.stdout:6/766: creat d4/d8/dd/d76/dd5/ff6 x:0 0 0 2024-09-10T09:36:09.133 INFO:tasks.workunit.client.0.smithi079.stdout:3/763: mknod d4/da/d17/d2d/d78/d79/ced 0 2024-09-10T09:36:09.138 INFO:tasks.workunit.client.0.smithi079.stdout:8/682: rename d11/d2b/f30 to d11/d2b/d4b/d50/d55/db8/fdb 0 2024-09-10T09:36:09.139 INFO:tasks.workunit.client.0.smithi079.stdout:7/643: write d4/df/d3d/f64 [3594469,88240] 0 2024-09-10T09:36:09.139 INFO:tasks.workunit.client.0.smithi079.stdout:6/767: mkdir d4/d8/dd/d76/d46/d88/df7 0 2024-09-10T09:36:09.140 INFO:tasks.workunit.client.0.smithi079.stdout:3/764: mknod d4/da/d56/dc5/cee 0 2024-09-10T09:36:09.141 INFO:tasks.workunit.client.0.smithi079.stdout:8/683: mkdir d11/dbd/ddc 0 2024-09-10T09:36:09.142 INFO:tasks.workunit.client.0.smithi079.stdout:4/695: sync 2024-09-10T09:36:09.142 INFO:tasks.workunit.client.0.smithi079.stdout:4/696: getdents d1/da/d28/d95 0 2024-09-10T09:36:09.143 INFO:tasks.workunit.client.0.smithi079.stdout:7/644: rmdir d4/d6/d4f/d70 39 2024-09-10T09:36:09.144 INFO:tasks.workunit.client.0.smithi079.stdout:6/768: symlink d4/d8/dc/d93/lf8 0 2024-09-10T09:36:09.144 INFO:tasks.workunit.client.0.smithi079.stdout:8/684: symlink d11/d2b/d4b/d7e/da7/ldd 0 2024-09-10T09:36:09.146 INFO:tasks.workunit.client.0.smithi079.stdout:4/697: dread d1/f3a [0,4194304] 0 2024-09-10T09:36:09.148 INFO:tasks.workunit.client.0.smithi079.stdout:4/698: rename d1/c18 to d1/da/d16/ce5 0 2024-09-10T09:36:09.149 INFO:tasks.workunit.client.0.smithi079.stdout:3/765: dread d4/da/d17/d38/d42/f84 [0,4194304] 0 2024-09-10T09:36:09.149 INFO:tasks.workunit.client.0.smithi079.stdout:4/699: creat d1/da/d28/d47/fe6 x:0 0 0 2024-09-10T09:36:09.150 INFO:tasks.workunit.client.0.smithi079.stdout:3/766: rmdir d4/da/d17/d38 39 2024-09-10T09:36:09.150 INFO:tasks.workunit.client.0.smithi079.stdout:3/767: write d4/da/d17/d2d/d43/f7d [1162438,47996] 0 2024-09-10T09:36:09.150 INFO:tasks.workunit.client.0.smithi079.stdout:3/768: chown d4/da/d18/daf 61237836 1 2024-09-10T09:36:09.152 INFO:tasks.workunit.client.0.smithi079.stdout:7/645: dread d4/dc/f36 [0,4194304] 0 2024-09-10T09:36:09.154 INFO:tasks.workunit.client.0.smithi079.stdout:7/646: dread d4/dc/f6d [0,4194304] 0 2024-09-10T09:36:09.155 INFO:tasks.workunit.client.0.smithi079.stdout:4/700: creat d1/da/d28/fe7 x:0 0 0 2024-09-10T09:36:09.158 INFO:tasks.workunit.client.0.smithi079.stdout:3/769: symlink d4/da/d17/d2d/d43/d49/lef 0 2024-09-10T09:36:09.159 INFO:tasks.workunit.client.0.smithi079.stdout:4/701: symlink d1/da/d16/d4d/le8 0 2024-09-10T09:36:09.160 INFO:tasks.workunit.client.0.smithi079.stdout:3/770: mknod d4/da/d17/dc1/cf0 0 2024-09-10T09:36:09.161 INFO:tasks.workunit.client.0.smithi079.stdout:2/581: sync 2024-09-10T09:36:09.161 INFO:tasks.workunit.client.0.smithi079.stdout:1/808: sync 2024-09-10T09:36:09.163 INFO:tasks.workunit.client.0.smithi079.stdout:1/809: unlink d5/df/dd0/d57/cd6 0 2024-09-10T09:36:09.165 INFO:tasks.workunit.client.0.smithi079.stdout:2/582: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62 0 2024-09-10T09:36:09.168 INFO:tasks.workunit.client.0.smithi079.stdout:5/664: dwrite d2/d3/d27/f2c [0,4194304] 0 2024-09-10T09:36:09.169 INFO:tasks.workunit.client.0.smithi079.stdout:6/769: dwrite d4/d8/dd/d76/f71 [0,4194304] 0 2024-09-10T09:36:09.170 INFO:tasks.workunit.client.0.smithi079.stdout:2/583: link d4/dc/d1c/c8c d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/cba 0 2024-09-10T09:36:09.170 INFO:tasks.workunit.client.0.smithi079.stdout:2/584: dread - d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f64 zero size 2024-09-10T09:36:09.170 INFO:tasks.workunit.client.0.smithi079.stdout:1/810: dread d5/df/d11/f2b [0,4194304] 0 2024-09-10T09:36:09.177 INFO:tasks.workunit.client.0.smithi079.stdout:5/665: rename d2/f1b to d2/d3/d27/d32/d39/dc2/fdf 0 2024-09-10T09:36:09.177 INFO:tasks.workunit.client.0.smithi079.stdout:1/811: dread d5/d4f/d95/fbd [0,4194304] 0 2024-09-10T09:36:09.179 INFO:tasks.workunit.client.0.smithi079.stdout:6/770: mknod d4/d8/dc/d93/dc4/cf9 0 2024-09-10T09:36:09.181 INFO:tasks.workunit.client.0.smithi079.stdout:2/585: rename d4/dc/d1c/d86/d1b/d38/d39/d99/c5e to d4/dc/d1c/d86/d1b/d38/d39/cbb 0 2024-09-10T09:36:09.182 INFO:tasks.workunit.client.0.smithi079.stdout:5/666: creat d2/d3/d27/d32/db6/fe0 x:0 0 0 2024-09-10T09:36:09.183 INFO:tasks.workunit.client.0.smithi079.stdout:5/667: chown d2/d3/d27/d32/d44/db4 1 1 2024-09-10T09:36:09.183 INFO:tasks.workunit.client.0.smithi079.stdout:1/812: mknod d5/df/dd0/da0/c113 0 2024-09-10T09:36:09.184 INFO:tasks.workunit.client.0.smithi079.stdout:6/771: creat d4/d8/dc/d93/da0/ffa x:0 0 0 2024-09-10T09:36:09.186 INFO:tasks.workunit.client.0.smithi079.stdout:2/586: rename d4/dc/d1c/d86/d1b/d38/d39/d31/l37 to d4/d8f/lbc 0 2024-09-10T09:36:09.187 INFO:tasks.workunit.client.0.smithi079.stdout:5/668: creat d2/d3/d27/d32/d44/fe1 x:0 0 0 2024-09-10T09:36:09.187 INFO:tasks.workunit.client.0.smithi079.stdout:5/669: chown d2/d3/d27/d70/d88/ld4 439 1 2024-09-10T09:36:09.188 INFO:tasks.workunit.client.0.smithi079.stdout:1/813: creat d5/d24/d36/d53/db3/f114 x:0 0 0 2024-09-10T09:36:09.190 INFO:tasks.workunit.client.0.smithi079.stdout:6/772: creat d4/d8/dc/d93/dc4/ffb x:0 0 0 2024-09-10T09:36:09.190 INFO:tasks.workunit.client.0.smithi079.stdout:6/773: dread - d4/d8/dd/d76/d46/d88/dbf/fd3 zero size 2024-09-10T09:36:09.190 INFO:tasks.workunit.client.0.smithi079.stdout:6/774: write d4/d8/dc/d12/f89 [503727,8837] 0 2024-09-10T09:36:09.192 INFO:tasks.workunit.client.0.smithi079.stdout:4/702: dwrite d1/da/d16/d4d/f9f [0,4194304] 0 2024-09-10T09:36:09.192 INFO:tasks.workunit.client.0.smithi079.stdout:3/771: dwrite d4/da/d17/d54/fe4 [0,4194304] 0 2024-09-10T09:36:09.192 INFO:tasks.workunit.client.0.smithi079.stdout:3/772: fsync d4/da/d17/d2d/d43/d49/f6f 0 2024-09-10T09:36:09.192 INFO:tasks.workunit.client.0.smithi079.stdout:3/773: truncate d4/da/d56/d7b/dd1/fda 58593 0 2024-09-10T09:36:09.192 INFO:tasks.workunit.client.0.smithi079.stdout:3/774: fdatasync d4/da/d18/fbc 0 2024-09-10T09:36:09.192 INFO:tasks.workunit.client.0.smithi079.stdout:5/670: truncate d2/d3/d5e/d61/fb0 3348783 0 2024-09-10T09:36:09.192 INFO:tasks.workunit.client.0.smithi079.stdout:3/775: read d4/da/d17/d2d/d43/f74 [143325,129029] 0 2024-09-10T09:36:09.194 INFO:tasks.workunit.client.0.smithi079.stdout:6/775: mknod d4/d8/dc/d12/d29/db5/cfc 0 2024-09-10T09:36:09.194 INFO:tasks.workunit.client.0.smithi079.stdout:6/776: truncate d4/d8/dc/d93/da0/ffa 101850 0 2024-09-10T09:36:09.194 INFO:tasks.workunit.client.0.smithi079.stdout:6/777: fdatasync d4/d8/dd/d41/f75 0 2024-09-10T09:36:09.196 INFO:tasks.workunit.client.0.smithi079.stdout:2/587: rename d4/dc/fb4 to d4/fbd 0 2024-09-10T09:36:09.196 INFO:tasks.workunit.client.0.smithi079.stdout:2/588: readlink d4/la 0 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:4/703: mkdir d1/da/d28/d47/da1/dcd/de9 0 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:4/704: write d1/da/d3b/fbe [369935,118961] 0 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:4/705: dread - d1/da/d16/d88/faa zero size 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:4/706: chown d1/da/f2b 31486 1 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:4/707: chown d1/da/d16/d57/f7d 0 1 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:1/814: getdents d5/d24/d36/df3 0 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:5/671: dread d2/f1d [0,4194304] 0 2024-09-10T09:36:09.200 INFO:tasks.workunit.client.0.smithi079.stdout:5/672: chown d2/d3/fa 13927999 1 2024-09-10T09:36:09.201 INFO:tasks.workunit.client.0.smithi079.stdout:6/778: mknod d4/d8/dd/d76/cfd 0 2024-09-10T09:36:09.202 INFO:tasks.workunit.client.0.smithi079.stdout:4/708: symlink d1/da/d16/d57/lea 0 2024-09-10T09:36:09.202 INFO:tasks.workunit.client.0.smithi079.stdout:3/776: dread d4/da/d17/f30 [0,4194304] 0 2024-09-10T09:36:09.202 INFO:tasks.workunit.client.0.smithi079.stdout:3/777: creat d4/da/d67/db8/ff1 x:0 0 0 2024-09-10T09:36:09.202 INFO:tasks.workunit.client.0.smithi079.stdout:3/778: creat d4/da/d17/d9b/ff2 x:0 0 0 2024-09-10T09:36:09.203 INFO:tasks.workunit.client.0.smithi079.stdout:1/815: mkdir d5/d24/d36/d53/dce/d105/d115 0 2024-09-10T09:36:09.205 INFO:tasks.workunit.client.0.smithi079.stdout:1/816: creat d5/d24/d36/d53/db3/de3/f116 x:0 0 0 2024-09-10T09:36:09.207 INFO:tasks.workunit.client.0.smithi079.stdout:2/589: write d4/dc/d1c/d86/d1b/d38/d39/d31/f46 [956680,117593] 0 2024-09-10T09:36:09.207 INFO:tasks.workunit.client.0.smithi079.stdout:2/590: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/d9f 0 2024-09-10T09:36:09.208 INFO:tasks.workunit.client.0.smithi079.stdout:1/817: mkdir d5/d24/d36/d53/dce/d105/d117 0 2024-09-10T09:36:09.211 INFO:tasks.workunit.client.0.smithi079.stdout:1/818: link d5/df/dd0/da0/d6a/cae d5/df/dd0/da0/d6a/c118 0 2024-09-10T09:36:09.211 INFO:tasks.workunit.client.0.smithi079.stdout:6/779: read d4/d8/dc/d12/d29/f62 [338999,49566] 0 2024-09-10T09:36:09.211 INFO:tasks.workunit.client.0.smithi079.stdout:6/780: chown d4/d8/dd/d41/d51/fe3 1 1 2024-09-10T09:36:09.211 INFO:tasks.workunit.client.0.smithi079.stdout:6/781: write d4/d8/dc/d3c/f99 [882590,115943] 0 2024-09-10T09:36:09.211 INFO:tasks.workunit.client.0.smithi079.stdout:6/782: write d4/d8/dc/d1c/fb3 [420040,65789] 0 2024-09-10T09:36:09.212 INFO:tasks.workunit.client.0.smithi079.stdout:6/783: getdents d4/d8/dd/d76/d46/d88 0 2024-09-10T09:36:09.212 INFO:tasks.workunit.client.0.smithi079.stdout:6/784: dread - d4/d8/dc/d93/dc4/ffb zero size 2024-09-10T09:36:09.213 INFO:tasks.workunit.client.0.smithi079.stdout:2/591: dread d4/dc/d1c/f28 [0,4194304] 0 2024-09-10T09:36:09.215 INFO:tasks.workunit.client.0.smithi079.stdout:2/592: unlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/f51 0 2024-09-10T09:36:09.215 INFO:tasks.workunit.client.0.smithi079.stdout:2/593: write d4/dc/d1c/d86/f16 [4935589,93086] 0 2024-09-10T09:36:09.215 INFO:tasks.workunit.client.0.smithi079.stdout:2/594: creat d4/dc/d1c/d86/d1b/d38/d87/fbe x:0 0 0 2024-09-10T09:36:09.221 INFO:tasks.workunit.client.0.smithi079.stdout:4/709: dwrite d1/da/d28/f29 [0,4194304] 0 2024-09-10T09:36:09.226 INFO:tasks.workunit.client.0.smithi079.stdout:1/819: dread d5/fe [0,4194304] 0 2024-09-10T09:36:09.230 INFO:tasks.workunit.client.0.smithi079.stdout:4/710: link d1/da/d3b/l9c d1/da/d3b/de0/leb 0 2024-09-10T09:36:09.236 INFO:tasks.workunit.client.0.smithi079.stdout:4/711: rmdir d1/da/d28/d47/da1/d83 39 2024-09-10T09:36:09.238 INFO:tasks.workunit.client.0.smithi079.stdout:4/712: unlink d1/da/d16/ce5 0 2024-09-10T09:36:09.254 INFO:tasks.workunit.client.0.smithi079.stdout:6/785: dwrite d4/d8/dc/fe [0,4194304] 0 2024-09-10T09:36:09.255 INFO:tasks.workunit.client.0.smithi079.stdout:6/786: symlink d4/d8/dd/d76/d46/d88/lfe 0 2024-09-10T09:36:09.265 INFO:tasks.workunit.client.0.smithi079.stdout:2/595: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/f15 [0,4194304] 0 2024-09-10T09:36:09.265 INFO:tasks.workunit.client.0.smithi079.stdout:4/713: dwrite d1/da/d28/d99/faf [0,4194304] 0 2024-09-10T09:36:09.265 INFO:tasks.workunit.client.0.smithi079.stdout:1/820: dwrite d5/d40/dd9/f10e [0,4194304] 0 2024-09-10T09:36:09.271 INFO:tasks.workunit.client.0.smithi079.stdout:2/596: rename d4/dc/d1c/d86/d1b/d38/c5c to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/cbf 0 2024-09-10T09:36:09.271 INFO:tasks.workunit.client.0.smithi079.stdout:2/597: write d4/dc/d1c/d86/ff [3979242,73074] 0 2024-09-10T09:36:09.271 INFO:tasks.workunit.client.0.smithi079.stdout:2/598: creat d4/d8f/fc0 x:0 0 0 2024-09-10T09:36:09.275 INFO:tasks.workunit.client.0.smithi079.stdout:6/787: dwrite d4/d8/dd/d76/d46/f3a [0,4194304] 0 2024-09-10T09:36:09.278 INFO:tasks.workunit.client.0.smithi079.stdout:4/714: dread d1/da/d28/d47/da1/dcd/fda [0,4194304] 0 2024-09-10T09:36:09.282 INFO:tasks.workunit.client.0.smithi079.stdout:9/601: sync 2024-09-10T09:36:09.288 INFO:tasks.workunit.client.0.smithi079.stdout:1/821: dwrite d5/df/d11/f16 [0,4194304] 0 2024-09-10T09:36:09.292 INFO:tasks.workunit.client.0.smithi079.stdout:9/602: write d3/d7/f5b [2576,72866] 0 2024-09-10T09:36:09.292 INFO:tasks.workunit.client.0.smithi079.stdout:9/603: fdatasync d3/d40/f81 0 2024-09-10T09:36:09.292 INFO:tasks.workunit.client.0.smithi079.stdout:9/604: readlink d3/d7/dc/de/d58/l67 0 2024-09-10T09:36:09.292 INFO:tasks.workunit.client.0.smithi079.stdout:1/822: mknod d5/d24/d36/d53/dce/d105/d115/c119 0 2024-09-10T09:36:09.292 INFO:tasks.workunit.client.0.smithi079.stdout:9/605: symlink d3/d7f/lc3 0 2024-09-10T09:36:09.293 INFO:tasks.workunit.client.0.smithi079.stdout:0/664: sync 2024-09-10T09:36:09.294 INFO:tasks.workunit.client.0.smithi079.stdout:9/606: symlink d3/d7/d26/d83/lc4 0 2024-09-10T09:36:09.294 INFO:tasks.workunit.client.0.smithi079.stdout:9/607: chown d3/d7/dc/d7a/da9/f45 43078273 1 2024-09-10T09:36:09.294 INFO:tasks.workunit.client.0.smithi079.stdout:9/608: chown d3/d7/dc/de/d58/d9e/fa5 194 1 2024-09-10T09:36:09.294 INFO:tasks.workunit.client.0.smithi079.stdout:9/609: write d3/d7/f9f [1035414,5561] 0 2024-09-10T09:36:09.295 INFO:tasks.workunit.client.0.smithi079.stdout:0/665: unlink d4/d12/c31 0 2024-09-10T09:36:09.295 INFO:tasks.workunit.client.0.smithi079.stdout:0/666: chown d4/d12/d1a/d6d/l7e 8590 1 2024-09-10T09:36:09.296 INFO:tasks.workunit.client.0.smithi079.stdout:9/610: unlink d3/d7/dc/de/d17/d2f/d98/da1/lb1 0 2024-09-10T09:36:09.296 INFO:tasks.workunit.client.0.smithi079.stdout:9/611: chown d3/d7/dc/de/d17/l44 233 1 2024-09-10T09:36:09.296 INFO:tasks.workunit.client.0.smithi079.stdout:9/612: creat d3/d7/dc/de/d17/d12/fc5 x:0 0 0 2024-09-10T09:36:09.296 INFO:tasks.workunit.client.0.smithi079.stdout:9/613: write d3/d7/dc/f41 [4963065,82892] 0 2024-09-10T09:36:09.296 INFO:tasks.workunit.client.0.smithi079.stdout:9/614: write d3/d7/dc/de/d17/d2f/d98/fbf [211009,56276] 0 2024-09-10T09:36:09.297 INFO:tasks.workunit.client.0.smithi079.stdout:9/615: symlink d3/d7/dc/de/d17/d2f/d74/db4/lc6 0 2024-09-10T09:36:09.298 INFO:tasks.workunit.client.0.smithi079.stdout:9/616: symlink d3/dae/lc7 0 2024-09-10T09:36:09.298 INFO:tasks.workunit.client.0.smithi079.stdout:0/667: dread d4/d12/d15/d2b/f63 [0,4194304] 0 2024-09-10T09:36:09.299 INFO:tasks.workunit.client.0.smithi079.stdout:0/668: fsync d4/d1d/d24/fa9 0 2024-09-10T09:36:09.301 INFO:tasks.workunit.client.0.smithi079.stdout:0/669: unlink d4/d12/d21/d3f/d80/fd2 0 2024-09-10T09:36:09.301 INFO:tasks.workunit.client.0.smithi079.stdout:0/670: write d4/d47/fdc [508387,2883] 0 2024-09-10T09:36:09.305 INFO:tasks.workunit.client.0.smithi079.stdout:2/599: dwrite d4/d8f/fc0 [0,4194304] 0 2024-09-10T09:36:09.305 INFO:tasks.workunit.client.0.smithi079.stdout:6/788: dwrite d4/d8/dc/d12/d70/faa [0,4194304] 0 2024-09-10T09:36:09.306 INFO:tasks.workunit.client.0.smithi079.stdout:1/823: dread d5/f22 [0,4194304] 0 2024-09-10T09:36:09.311 INFO:tasks.workunit.client.0.smithi079.stdout:6/789: creat d4/d8/dc/d98/fff x:0 0 0 2024-09-10T09:36:09.317 INFO:tasks.workunit.client.0.smithi079.stdout:6/790: truncate d4/d8/dd/d76/d46/d88/fb9 238422 0 2024-09-10T09:36:09.320 INFO:tasks.workunit.client.0.smithi079.stdout:6/791: creat d4/d8/dd/d76/d46/df0/f100 x:0 0 0 2024-09-10T09:36:09.322 INFO:tasks.workunit.client.0.smithi079.stdout:0/671: dread d4/f10 [0,4194304] 0 2024-09-10T09:36:09.322 INFO:tasks.workunit.client.0.smithi079.stdout:6/792: truncate d4/d8/dc/d12/d29/f62 3217459 0 2024-09-10T09:36:09.322 INFO:tasks.workunit.client.0.smithi079.stdout:1/824: write d5/d24/d36/d3a/dfc/fff [2753071,28154] 0 2024-09-10T09:36:09.323 INFO:tasks.workunit.client.0.smithi079.stdout:0/672: truncate d4/d12/d16/d53/f6c 3704135 0 2024-09-10T09:36:09.323 INFO:tasks.workunit.client.0.smithi079.stdout:0/673: write d4/d12/d8b/dca/d32/f9a [795180,125838] 0 2024-09-10T09:36:09.324 INFO:tasks.workunit.client.0.smithi079.stdout:6/793: mkdir d4/d8/d74/d101 0 2024-09-10T09:36:09.325 INFO:tasks.workunit.client.0.smithi079.stdout:9/617: dwrite d3/f16 [0,4194304] 0 2024-09-10T09:36:09.326 INFO:tasks.workunit.client.0.smithi079.stdout:2/600: dwrite d4/dc/d1c/f28 [0,4194304] 0 2024-09-10T09:36:09.326 INFO:tasks.workunit.client.0.smithi079.stdout:0/674: mkdir d4/d12/dc0/ddf 0 2024-09-10T09:36:09.327 INFO:tasks.workunit.client.0.smithi079.stdout:0/675: read d4/d12/d1a/f82 [335315,54704] 0 2024-09-10T09:36:09.327 INFO:tasks.workunit.client.0.smithi079.stdout:1/825: dread d5/df/f52 [0,4194304] 0 2024-09-10T09:36:09.332 INFO:tasks.workunit.client.0.smithi079.stdout:2/601: mkdir d4/dc/d1c/dc1 0 2024-09-10T09:36:09.332 INFO:tasks.workunit.client.0.smithi079.stdout:2/602: fsync d4/dc/d1c/d86/d1b/d38/d39/f7b 0 2024-09-10T09:36:09.332 INFO:tasks.workunit.client.0.smithi079.stdout:2/603: chown d4/dc/d1c/d86/d1b/l89 102636743 1 2024-09-10T09:36:09.334 INFO:tasks.workunit.client.0.smithi079.stdout:0/676: symlink d4/d12/le0 0 2024-09-10T09:36:09.345 INFO:tasks.workunit.client.0.smithi079.stdout:2/604: rmdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65 39 2024-09-10T09:36:09.347 INFO:tasks.workunit.client.0.smithi079.stdout:1/826: rmdir d5/df/dd0/da0/d6a/dd4 0 2024-09-10T09:36:09.347 INFO:tasks.workunit.client.0.smithi079.stdout:1/827: dread - d5/df/dc6/fca zero size 2024-09-10T09:36:09.347 INFO:tasks.workunit.client.0.smithi079.stdout:1/828: chown d5/d24/d36/d3a/c89 331 1 2024-09-10T09:36:09.349 INFO:tasks.workunit.client.0.smithi079.stdout:3/779: sync 2024-09-10T09:36:09.349 INFO:tasks.workunit.client.0.smithi079.stdout:3/780: fsync d4/da/d17/d54/f41 0 2024-09-10T09:36:09.349 INFO:tasks.workunit.client.0.smithi079.stdout:8/685: sync 2024-09-10T09:36:09.349 INFO:tasks.workunit.client.0.smithi079.stdout:7/647: sync 2024-09-10T09:36:09.349 INFO:tasks.workunit.client.0.smithi079.stdout:7/648: creat d4/df/d3d/d82/fbe x:0 0 0 2024-09-10T09:36:09.349 INFO:tasks.workunit.client.0.smithi079.stdout:5/673: sync 2024-09-10T09:36:09.350 INFO:tasks.workunit.client.0.smithi079.stdout:2/605: rmdir d4/dc/d1c/dc1 0 2024-09-10T09:36:09.351 INFO:tasks.workunit.client.0.smithi079.stdout:8/686: rename d11/d2b/f41 to d11/dbd/fde 0 2024-09-10T09:36:09.354 INFO:tasks.workunit.client.0.smithi079.stdout:5/674: symlink d2/d3/d59/le2 0 2024-09-10T09:36:09.357 INFO:tasks.workunit.client.0.smithi079.stdout:8/687: creat d11/dbd/ddc/fdf x:0 0 0 2024-09-10T09:36:09.359 INFO:tasks.workunit.client.0.smithi079.stdout:6/794: dwrite d4/d8/dc/d3c/fd6 [0,4194304] 0 2024-09-10T09:36:09.362 INFO:tasks.workunit.client.0.smithi079.stdout:9/618: dwrite d3/d7/dc/de/d17/d2f/d74/db4/fbe [0,4194304] 0 2024-09-10T09:36:09.363 INFO:tasks.workunit.client.0.smithi079.stdout:6/795: symlink d4/d8/dd/d76/l102 0 2024-09-10T09:36:09.365 INFO:tasks.workunit.client.0.smithi079.stdout:5/675: rename d2/d41 to d2/d3/d27/d32/de3 0 2024-09-10T09:36:09.367 INFO:tasks.workunit.client.0.smithi079.stdout:6/796: symlink d4/d8/dc/d93/dc4/df1/l103 0 2024-09-10T09:36:09.368 INFO:tasks.workunit.client.0.smithi079.stdout:5/676: rmdir d2/d3/d27/d70/d80 39 2024-09-10T09:36:09.370 INFO:tasks.workunit.client.0.smithi079.stdout:5/677: mkdir d2/d3/d27/d70/de4 0 2024-09-10T09:36:09.372 INFO:tasks.workunit.client.0.smithi079.stdout:0/677: dwrite d4/d12/f14 [0,4194304] 0 2024-09-10T09:36:09.372 INFO:tasks.workunit.client.0.smithi079.stdout:0/678: chown d4/d12/d8b/dca/d32/dbd/cc3 355174234 1 2024-09-10T09:36:09.372 INFO:tasks.workunit.client.0.smithi079.stdout:0/679: rename d4 to d4/d1d/d24/d72/de1 22 2024-09-10T09:36:09.372 INFO:tasks.workunit.client.0.smithi079.stdout:8/688: dread d11/d2b/d4b/d50/d5c/f95 [0,4194304] 0 2024-09-10T09:36:09.373 INFO:tasks.workunit.client.0.smithi079.stdout:0/680: dread d4/d12/d21/d3f/d88/f8c [0,4194304] 0 2024-09-10T09:36:09.373 INFO:tasks.workunit.client.0.smithi079.stdout:5/678: mknod d2/d3/d27/d32/de3/ce5 0 2024-09-10T09:36:09.373 INFO:tasks.workunit.client.0.smithi079.stdout:5/679: truncate d2/d3/d5e/d61/f6c 297711 0 2024-09-10T09:36:09.374 INFO:tasks.workunit.client.0.smithi079.stdout:5/680: read d2/d3/d5e/d61/d71/fa9 [69601,51304] 0 2024-09-10T09:36:09.374 INFO:tasks.workunit.client.0.smithi079.stdout:5/681: write d2/d3/d5e/fd3 [346280,75040] 0 2024-09-10T09:36:09.375 INFO:tasks.workunit.client.0.smithi079.stdout:8/689: chown d11/d2b/c2c 1 1 2024-09-10T09:36:09.375 INFO:tasks.workunit.client.0.smithi079.stdout:6/797: dread d4/d8/dc/f6f [0,4194304] 0 2024-09-10T09:36:09.375 INFO:tasks.workunit.client.0.smithi079.stdout:0/681: symlink d4/d12/d21/d3f/d80/le2 0 2024-09-10T09:36:09.376 INFO:tasks.workunit.client.0.smithi079.stdout:0/682: write d4/d12/d21/fcf [1214863,23411] 0 2024-09-10T09:36:09.376 INFO:tasks.workunit.client.0.smithi079.stdout:5/682: mknod d2/d3/d5e/ce6 0 2024-09-10T09:36:09.376 INFO:tasks.workunit.client.0.smithi079.stdout:5/683: chown d2/d3/d27/f69 353 1 2024-09-10T09:36:09.377 INFO:tasks.workunit.client.0.smithi079.stdout:6/798: truncate d4/d8/dd/d76/f8f 1321155 0 2024-09-10T09:36:09.377 INFO:tasks.workunit.client.0.smithi079.stdout:6/799: stat d4/d8/dc/d93/dc4/df1 0 2024-09-10T09:36:09.378 INFO:tasks.workunit.client.0.smithi079.stdout:5/684: mknod d2/d3/d27/d32/d39/dc2/ce7 0 2024-09-10T09:36:09.381 INFO:tasks.workunit.client.0.smithi079.stdout:6/800: link d4/d8/dd/d76/d46/df0/f100 d4/d8/dd/d41/d51/dc7/f104 0 2024-09-10T09:36:09.381 INFO:tasks.workunit.client.0.smithi079.stdout:6/801: chown d4/d8/dc/d93/d8a/dd7/lec 187135 1 2024-09-10T09:36:09.381 INFO:tasks.workunit.client.0.smithi079.stdout:5/685: creat d2/d3/d27/d32/d39/fe8 x:0 0 0 2024-09-10T09:36:09.394 INFO:tasks.workunit.client.0.smithi079.stdout:8/690: write d11/f32 [2882029,55480] 0 2024-09-10T09:36:09.400 INFO:tasks.workunit.client.0.smithi079.stdout:8/691: dread d11/d48/f8f [0,4194304] 0 2024-09-10T09:36:09.401 INFO:tasks.workunit.client.0.smithi079.stdout:8/692: read d11/f31 [404970,93139] 0 2024-09-10T09:36:09.406 INFO:tasks.workunit.client.0.smithi079.stdout:1/829: dwrite d5/df/d2e/f39 [0,4194304] 0 2024-09-10T09:36:09.406 INFO:tasks.workunit.client.0.smithi079.stdout:6/802: dwrite d4/d8/dc/d12/faf [0,4194304] 0 2024-09-10T09:36:09.408 INFO:tasks.workunit.client.0.smithi079.stdout:1/830: truncate d5/d24/d36/df3/ff9 450377 0 2024-09-10T09:36:09.408 INFO:tasks.workunit.client.0.smithi079.stdout:6/803: readlink d4/d8/dc/d93/dc4/df1/l103 0 2024-09-10T09:36:09.408 INFO:tasks.workunit.client.0.smithi079.stdout:6/804: chown d4/d8/dd/d76/d46/d88/lfe 0 1 2024-09-10T09:36:09.409 INFO:tasks.workunit.client.0.smithi079.stdout:3/781: dwrite d4/da/d18/f47 [0,4194304] 0 2024-09-10T09:36:09.409 INFO:tasks.workunit.client.0.smithi079.stdout:2/606: dwrite d4/d5d/fa1 [0,4194304] 0 2024-09-10T09:36:09.409 INFO:tasks.workunit.client.0.smithi079.stdout:7/649: dwrite d4/f61 [0,4194304] 0 2024-09-10T09:36:09.409 INFO:tasks.workunit.client.0.smithi079.stdout:9/619: dwrite d3/d7/dc/d7a/da9/f9c [4194304,4194304] 0 2024-09-10T09:36:09.409 INFO:tasks.workunit.client.0.smithi079.stdout:9/620: readlink d3/d7/dc/de/d17/d2f/l93 0 2024-09-10T09:36:09.420 INFO:tasks.workunit.client.0.smithi079.stdout:6/805: dread d4/d8/dd/d41/f56 [0,4194304] 0 2024-09-10T09:36:09.420 INFO:tasks.workunit.client.0.smithi079.stdout:6/806: write d4/d8/dd/d76/f59 [2989395,21915] 0 2024-09-10T09:36:09.420 INFO:tasks.workunit.client.0.smithi079.stdout:6/807: creat d4/d8/dd/d41/d51/f105 x:0 0 0 2024-09-10T09:36:09.423 INFO:tasks.workunit.client.0.smithi079.stdout:9/621: dread d3/d7/d26/f4d [0,4194304] 0 2024-09-10T09:36:09.431 INFO:tasks.workunit.client.0.smithi079.stdout:2/607: dwrite d4/f7a [4194304,4194304] 0 2024-09-10T09:36:09.432 INFO:tasks.workunit.client.0.smithi079.stdout:8/693: dwrite d11/d2b/d4b/d50/d55/d87/fb3 [0,4194304] 0 2024-09-10T09:36:09.432 INFO:tasks.workunit.client.0.smithi079.stdout:8/694: fdatasync d11/d3b/fcb 0 2024-09-10T09:36:09.435 INFO:tasks.workunit.client.0.smithi079.stdout:9/622: dread d3/d7/f63 [0,4194304] 0 2024-09-10T09:36:09.436 INFO:tasks.workunit.client.0.smithi079.stdout:4/715: sync 2024-09-10T09:36:09.436 INFO:tasks.workunit.client.0.smithi079.stdout:4/716: stat d1/d38/fdb 0 2024-09-10T09:36:09.437 INFO:tasks.workunit.client.0.smithi079.stdout:4/717: chown d1/da/d3b/d5f/f76 1 1 2024-09-10T09:36:09.439 INFO:tasks.workunit.client.0.smithi079.stdout:5/686: rmdir d2/d3/d5e 39 2024-09-10T09:36:09.450 INFO:tasks.workunit.client.0.smithi079.stdout:5/687: dread d2/d3/f83 [0,4194304] 0 2024-09-10T09:36:09.461 INFO:tasks.workunit.client.0.smithi079.stdout:7/650: symlink d4/df/d19/db9/lbf 0 2024-09-10T09:36:09.464 INFO:tasks.workunit.client.0.smithi079.stdout:5/688: dwrite d2/d3/d27/d32/d44/fe1 [0,4194304] 0 2024-09-10T09:36:09.481 INFO:tasks.workunit.client.0.smithi079.stdout:5/689: dwrite d2/f3a [0,4194304] 0 2024-09-10T09:36:09.488 INFO:tasks.workunit.client.0.smithi079.stdout:6/808: creat d4/d8/dc/d1c/f106 x:0 0 0 2024-09-10T09:36:09.492 INFO:tasks.workunit.client.0.smithi079.stdout:8/695: mknod d11/dd8/ce0 0 2024-09-10T09:36:09.493 INFO:tasks.workunit.client.0.smithi079.stdout:9/623: creat d3/d7/dc/de/da7/fc8 x:0 0 0 2024-09-10T09:36:09.495 INFO:tasks.workunit.client.0.smithi079.stdout:4/718: mknod d1/d9b/db4/cec 0 2024-09-10T09:36:09.497 INFO:tasks.workunit.client.0.smithi079.stdout:6/809: dread d4/d8/f20 [0,4194304] 0 2024-09-10T09:36:09.497 INFO:tasks.workunit.client.0.smithi079.stdout:6/810: chown d4/d8/dc/d1c/f3f 78671 1 2024-09-10T09:36:09.498 INFO:tasks.workunit.client.0.smithi079.stdout:4/719: dread d1/da/d3b/fbe [0,4194304] 0 2024-09-10T09:36:09.498 INFO:tasks.workunit.client.0.smithi079.stdout:4/720: chown d1/l2f 669782636 1 2024-09-10T09:36:09.503 INFO:tasks.workunit.client.0.smithi079.stdout:5/690: mknod d2/d3/d27/d70/ce9 0 2024-09-10T09:36:09.507 INFO:tasks.workunit.client.0.smithi079.stdout:7/651: getdents d4/d6/d4f/d66 0 2024-09-10T09:36:09.508 INFO:tasks.workunit.client.0.smithi079.stdout:4/721: dread d1/d38/fdb [0,4194304] 0 2024-09-10T09:36:09.508 INFO:tasks.workunit.client.0.smithi079.stdout:4/722: fsync d1/da/d16/d88/faa 0 2024-09-10T09:36:09.510 INFO:tasks.workunit.client.0.smithi079.stdout:5/691: unlink d2/d3/d27/d32/d44/db4/fd6 0 2024-09-10T09:36:09.510 INFO:tasks.workunit.client.0.smithi079.stdout:5/692: dread - d2/d3/d59/fb2 zero size 2024-09-10T09:36:09.511 INFO:tasks.workunit.client.0.smithi079.stdout:7/652: creat d4/d6/da9/fc0 x:0 0 0 2024-09-10T09:36:09.513 INFO:tasks.workunit.client.0.smithi079.stdout:5/693: mknod d2/cea 0 2024-09-10T09:36:09.523 INFO:tasks.workunit.client.0.smithi079.stdout:7/653: dread d4/f5 [0,4194304] 0 2024-09-10T09:36:09.524 INFO:tasks.workunit.client.0.smithi079.stdout:6/811: dwrite d4/d8/dd/d76/d46/f3a [0,4194304] 0 2024-09-10T09:36:09.524 INFO:tasks.workunit.client.0.smithi079.stdout:6/812: read - d4/d8/dc/d12/d9d/def/ff4 zero size 2024-09-10T09:36:09.524 INFO:tasks.workunit.client.0.smithi079.stdout:6/813: write d4/d8/dc/d12/d29/db5/ff5 [539853,127849] 0 2024-09-10T09:36:09.524 INFO:tasks.workunit.client.0.smithi079.stdout:4/723: dwrite d1/da/d28/d47/da1/dcd/fda [0,4194304] 0 2024-09-10T09:36:09.526 INFO:tasks.workunit.client.0.smithi079.stdout:4/724: dread d1/da/d28/fa2 [0,4194304] 0 2024-09-10T09:36:09.526 INFO:tasks.workunit.client.0.smithi079.stdout:4/725: write d1/da/d28/d95/f8d [1043417,98792] 0 2024-09-10T09:36:09.527 INFO:tasks.workunit.client.0.smithi079.stdout:6/814: mknod d4/d8/dd/d76/d46/df0/c107 0 2024-09-10T09:36:09.528 INFO:tasks.workunit.client.0.smithi079.stdout:2/608: rename d4/d5d/f68 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/fc2 0 2024-09-10T09:36:09.534 INFO:tasks.workunit.client.0.smithi079.stdout:7/654: dread d4/d6/d38/f63 [0,4194304] 0 2024-09-10T09:36:09.535 INFO:tasks.workunit.client.0.smithi079.stdout:9/624: unlink d3/d7/dc/de/d17/d2f/c90 0 2024-09-10T09:36:09.538 INFO:tasks.workunit.client.0.smithi079.stdout:9/625: mknod d3/d7/d26/d69/cc9 0 2024-09-10T09:36:09.538 INFO:tasks.workunit.client.0.smithi079.stdout:9/626: write d3/f2b [4800868,73240] 0 2024-09-10T09:36:09.540 INFO:tasks.workunit.client.0.smithi079.stdout:2/609: dread d4/f6 [0,4194304] 0 2024-09-10T09:36:09.540 INFO:tasks.workunit.client.0.smithi079.stdout:2/610: truncate d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f64 808285 0 2024-09-10T09:36:09.541 INFO:tasks.workunit.client.0.smithi079.stdout:9/627: symlink d3/d7/d70/lca 0 2024-09-10T09:36:09.541 INFO:tasks.workunit.client.0.smithi079.stdout:9/628: creat d3/d7/dc/de/db7/fcb x:0 0 0 2024-09-10T09:36:09.544 INFO:tasks.workunit.client.0.smithi079.stdout:9/629: mknod d3/d7/d5a/ccc 0 2024-09-10T09:36:09.544 INFO:tasks.workunit.client.0.smithi079.stdout:9/630: chown d3/d7/dc/l85 43 1 2024-09-10T09:36:09.546 INFO:tasks.workunit.client.0.smithi079.stdout:4/726: dwrite d1/da/d28/d47/da1/fc5 [0,4194304] 0 2024-09-10T09:36:09.546 INFO:tasks.workunit.client.0.smithi079.stdout:4/727: write d1/da/f36 [3043730,13329] 0 2024-09-10T09:36:09.546 INFO:tasks.workunit.client.0.smithi079.stdout:4/728: truncate d1/d38/f81 1406260 0 2024-09-10T09:36:09.546 INFO:tasks.workunit.client.0.smithi079.stdout:4/729: write d1/da/d28/d99/fb0 [3976055,85255] 0 2024-09-10T09:36:09.546 INFO:tasks.workunit.client.0.smithi079.stdout:4/730: chown d1/da/d3b/d5f/f76 2813245 1 2024-09-10T09:36:09.554 INFO:tasks.workunit.client.0.smithi079.stdout:5/694: mknod d2/d3/d27/d32/ceb 0 2024-09-10T09:36:09.556 INFO:tasks.workunit.client.0.smithi079.stdout:5/695: unlink d2/d3/d27/d32/de3/f74 0 2024-09-10T09:36:09.558 INFO:tasks.workunit.client.0.smithi079.stdout:1/831: unlink d5/d24/d36/l5d 0 2024-09-10T09:36:09.558 INFO:tasks.workunit.client.0.smithi079.stdout:7/655: dwrite d4/dc/f73 [0,4194304] 0 2024-09-10T09:36:09.561 INFO:tasks.workunit.client.0.smithi079.stdout:2/611: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/fa9 [0,4194304] 0 2024-09-10T09:36:09.561 INFO:tasks.workunit.client.0.smithi079.stdout:2/612: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62 0 2024-09-10T09:36:09.563 INFO:tasks.workunit.client.0.smithi079.stdout:5/696: write d2/d3/d27/f69 [1882636,45787] 0 2024-09-10T09:36:09.563 INFO:tasks.workunit.client.0.smithi079.stdout:5/697: stat d2/d3/fa 0 2024-09-10T09:36:09.564 INFO:tasks.workunit.client.0.smithi079.stdout:8/696: rename d11/d2b/fbb to d11/d2b/d4b/d7e/db2/db7/fe1 0 2024-09-10T09:36:09.564 INFO:tasks.workunit.client.0.smithi079.stdout:8/697: stat d11/d2b/d4b/d74/f86 0 2024-09-10T09:36:09.565 INFO:tasks.workunit.client.0.smithi079.stdout:5/698: truncate d2/f20 1009220 0 2024-09-10T09:36:09.565 INFO:tasks.workunit.client.0.smithi079.stdout:7/656: dread d4/d6/d38/f63 [0,4194304] 0 2024-09-10T09:36:09.565 INFO:tasks.workunit.client.0.smithi079.stdout:7/657: dread - d4/d6/d4f/d66/fb0 zero size 2024-09-10T09:36:09.566 INFO:tasks.workunit.client.0.smithi079.stdout:1/832: dread d5/f9d [0,4194304] 0 2024-09-10T09:36:09.567 INFO:tasks.workunit.client.0.smithi079.stdout:1/833: write d5/df/d11/fd3 [1263950,36594] 0 2024-09-10T09:36:09.569 INFO:tasks.workunit.client.0.smithi079.stdout:8/698: unlink d11/f12 0 2024-09-10T09:36:09.570 INFO:tasks.workunit.client.0.smithi079.stdout:8/699: dread d11/d2b/d4b/d74/f83 [0,4194304] 0 2024-09-10T09:36:09.572 INFO:tasks.workunit.client.0.smithi079.stdout:5/699: truncate d2/d3/f83 760988 0 2024-09-10T09:36:09.573 INFO:tasks.workunit.client.0.smithi079.stdout:7/658: mkdir d4/d6/d38/dc1 0 2024-09-10T09:36:09.573 INFO:tasks.workunit.client.0.smithi079.stdout:4/731: dwrite d1/da/f36 [0,4194304] 0 2024-09-10T09:36:09.573 INFO:tasks.workunit.client.0.smithi079.stdout:7/659: write d4/df/d3d/d75/fa8 [1000557,42911] 0 2024-09-10T09:36:09.576 INFO:tasks.workunit.client.0.smithi079.stdout:5/700: mknod d2/d3/d59/cec 0 2024-09-10T09:36:09.576 INFO:tasks.workunit.client.0.smithi079.stdout:7/660: dread d4/df/d3d/d75/f9d [0,4194304] 0 2024-09-10T09:36:09.577 INFO:tasks.workunit.client.0.smithi079.stdout:4/732: rmdir d1/da 39 2024-09-10T09:36:09.578 INFO:tasks.workunit.client.0.smithi079.stdout:7/661: dread d4/df/d6b/f8e [0,4194304] 0 2024-09-10T09:36:09.579 INFO:tasks.workunit.client.0.smithi079.stdout:7/662: dread d4/d6/d4f/f52 [0,4194304] 0 2024-09-10T09:36:09.579 INFO:tasks.workunit.client.0.smithi079.stdout:7/663: dread - d4/df/f6e zero size 2024-09-10T09:36:09.581 INFO:tasks.workunit.client.0.smithi079.stdout:6/815: rename d4/d8/dc/d93/da0 to d4/d8/dd/d76/d46/d88/d108 0 2024-09-10T09:36:09.585 INFO:tasks.workunit.client.0.smithi079.stdout:5/701: link d2/c8 d2/d3/d27/d32/d39/ced 0 2024-09-10T09:36:09.585 INFO:tasks.workunit.client.0.smithi079.stdout:5/702: fsync d2/f24 0 2024-09-10T09:36:09.585 INFO:tasks.workunit.client.0.smithi079.stdout:5/703: chown d2/d3/d27/d32/la3 12 1 2024-09-10T09:36:09.585 INFO:tasks.workunit.client.0.smithi079.stdout:5/704: chown d2/f20 1841347691 1 2024-09-10T09:36:09.587 INFO:tasks.workunit.client.0.smithi079.stdout:7/664: unlink d4/df/d3d/f40 0 2024-09-10T09:36:09.590 INFO:tasks.workunit.client.0.smithi079.stdout:6/816: mknod d4/d8/dc/d3c/c109 0 2024-09-10T09:36:09.590 INFO:tasks.workunit.client.0.smithi079.stdout:6/817: truncate d4/d8/dc/d93/fad 4983528 0 2024-09-10T09:36:09.598 INFO:tasks.workunit.client.0.smithi079.stdout:9/631: rename d3/d7/d26/d69/f9a to d3/d7/fcd 0 2024-09-10T09:36:09.599 INFO:tasks.workunit.client.0.smithi079.stdout:3/782: sync 2024-09-10T09:36:09.599 INFO:tasks.workunit.client.0.smithi079.stdout:0/683: sync 2024-09-10T09:36:09.603 INFO:tasks.workunit.client.0.smithi079.stdout:5/705: unlink d2/d3/d5e/d61/d71/fa9 0 2024-09-10T09:36:09.604 INFO:tasks.workunit.client.0.smithi079.stdout:7/665: symlink d4/d6/d4f/d66/lc2 0 2024-09-10T09:36:09.604 INFO:tasks.workunit.client.0.smithi079.stdout:7/666: write d4/dc/f8f [331324,5586] 0 2024-09-10T09:36:09.606 INFO:tasks.workunit.client.0.smithi079.stdout:6/818: mknod d4/d8/dd/d76/c10a 0 2024-09-10T09:36:09.609 INFO:tasks.workunit.client.0.smithi079.stdout:2/613: rename d4/f2b to d4/d8f/fc3 0 2024-09-10T09:36:09.610 INFO:tasks.workunit.client.0.smithi079.stdout:2/614: read d4/dc/d1c/f54 [228608,69507] 0 2024-09-10T09:36:09.610 INFO:tasks.workunit.client.0.smithi079.stdout:9/632: creat d3/d7/dc/de/da7/fce x:0 0 0 2024-09-10T09:36:09.613 INFO:tasks.workunit.client.0.smithi079.stdout:7/667: creat d4/d6/d38/dc1/fc3 x:0 0 0 2024-09-10T09:36:09.616 INFO:tasks.workunit.client.0.smithi079.stdout:1/834: rename d5/d24/d36/d53/dce/d105 to d5/d24/d36/d3a/d85/db1/d11a 0 2024-09-10T09:36:09.616 INFO:tasks.workunit.client.0.smithi079.stdout:1/835: fsync d5/d40/f42 0 2024-09-10T09:36:09.616 INFO:tasks.workunit.client.0.smithi079.stdout:1/836: write d5/d24/d36/d79/fe9 [960320,35702] 0 2024-09-10T09:36:09.617 INFO:tasks.workunit.client.0.smithi079.stdout:2/615: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/fc4 x:0 0 0 2024-09-10T09:36:09.619 INFO:tasks.workunit.client.0.smithi079.stdout:0/684: dwrite d4/d12/d21/f43 [0,4194304] 0 2024-09-10T09:36:09.619 INFO:tasks.workunit.client.0.smithi079.stdout:0/685: chown d4/d12/d21/d3f/c42 80139630 1 2024-09-10T09:36:09.619 INFO:tasks.workunit.client.0.smithi079.stdout:0/686: chown d4/d12/d1a/c57 435864 1 2024-09-10T09:36:09.622 INFO:tasks.workunit.client.0.smithi079.stdout:8/700: rename d11/d3b/l98 to d11/dbd/ddc/le2 0 2024-09-10T09:36:09.625 INFO:tasks.workunit.client.0.smithi079.stdout:7/668: write d4/f42 [912372,15120] 0 2024-09-10T09:36:09.625 INFO:tasks.workunit.client.0.smithi079.stdout:7/669: read d4/df/d3d/f56 [4339473,121399] 0 2024-09-10T09:36:09.625 INFO:tasks.workunit.client.0.smithi079.stdout:7/670: truncate d4/d6/d4f/fac 650230 0 2024-09-10T09:36:09.634 INFO:tasks.workunit.client.0.smithi079.stdout:5/706: rename d2/d3/d5e/d61/d71/fb5 to d2/d3/d5e/d61/fee 0 2024-09-10T09:36:09.634 INFO:tasks.workunit.client.0.smithi079.stdout:7/671: dread d4/dc/f21 [0,4194304] 0 2024-09-10T09:36:09.635 INFO:tasks.workunit.client.0.smithi079.stdout:7/672: stat d4/dc/d43/f57 0 2024-09-10T09:36:09.635 INFO:tasks.workunit.client.0.smithi079.stdout:7/673: readlink d4/d6/d38/l89 0 2024-09-10T09:36:09.635 INFO:tasks.workunit.client.0.smithi079.stdout:7/674: stat d4/dc/d43 0 2024-09-10T09:36:09.635 INFO:tasks.workunit.client.0.smithi079.stdout:5/707: write d2/f26 [3466971,92911] 0 2024-09-10T09:36:09.636 INFO:tasks.workunit.client.0.smithi079.stdout:8/701: creat d11/d3b/fe3 x:0 0 0 2024-09-10T09:36:09.636 INFO:tasks.workunit.client.0.smithi079.stdout:8/702: truncate d11/d2b/d4b/da8/fb9 763902 0 2024-09-10T09:36:09.636 INFO:tasks.workunit.client.0.smithi079.stdout:2/616: mknod d4/dc/d1c/d86/cc5 0 2024-09-10T09:36:09.636 INFO:tasks.workunit.client.0.smithi079.stdout:2/617: fdatasync d4/dc/d1c/d86/d1b/d38/d39/d99/f27 0 2024-09-10T09:36:09.636 INFO:tasks.workunit.client.0.smithi079.stdout:2/618: write d4/dc/d1c/f54 [495145,64504] 0 2024-09-10T09:36:09.637 INFO:tasks.workunit.client.0.smithi079.stdout:8/703: dread d11/d2b/d4b/d74/f83 [0,4194304] 0 2024-09-10T09:36:09.641 INFO:tasks.workunit.client.0.smithi079.stdout:6/819: rename d4/d8/dd/d76/d46/df0/de0 to d4/d8/dd/d76/d46/d88/d108/d10b 0 2024-09-10T09:36:09.645 INFO:tasks.workunit.client.0.smithi079.stdout:7/675: dread d4/df/d3d/f41 [0,4194304] 0 2024-09-10T09:36:09.650 INFO:tasks.workunit.client.0.smithi079.stdout:6/820: symlink d4/d8/l10c 0 2024-09-10T09:36:09.650 INFO:tasks.workunit.client.0.smithi079.stdout:6/821: chown d4/d8/dc/d93/d4b/l69 5538029 1 2024-09-10T09:36:09.653 INFO:tasks.workunit.client.0.smithi079.stdout:9/633: rename d3/d7/dc/de/d58/d9e to d3/d7/dc/de/d17/dcf 0 2024-09-10T09:36:09.653 INFO:tasks.workunit.client.0.smithi079.stdout:9/634: chown d3/c19 1 1 2024-09-10T09:36:09.655 INFO:tasks.workunit.client.0.smithi079.stdout:7/676: mknod d4/d6/d3e/db3/cc4 0 2024-09-10T09:36:09.656 INFO:tasks.workunit.client.0.smithi079.stdout:6/822: getdents d4/d8/dd/d76/d46/d88/d108/d10b 0 2024-09-10T09:36:09.659 INFO:tasks.workunit.client.0.smithi079.stdout:7/677: symlink d4/d6/d3e/db3/lc5 0 2024-09-10T09:36:09.661 INFO:tasks.workunit.client.0.smithi079.stdout:6/823: symlink d4/d8/dd/l10d 0 2024-09-10T09:36:09.661 INFO:tasks.workunit.client.0.smithi079.stdout:6/824: stat d4/d8/dd/d76/d46/d88 0 2024-09-10T09:36:09.661 INFO:tasks.workunit.client.0.smithi079.stdout:6/825: truncate d4/d8/dd/d76/d46/df0/fe8 4218017 0 2024-09-10T09:36:09.662 INFO:tasks.workunit.client.0.smithi079.stdout:5/708: dwrite d2/d3/d27/d32/d44/f4c [0,4194304] 0 2024-09-10T09:36:09.662 INFO:tasks.workunit.client.0.smithi079.stdout:1/837: rename d5/df/dd0/da0/d6e/dc5 to d5/d11b 0 2024-09-10T09:36:09.665 INFO:tasks.workunit.client.0.smithi079.stdout:7/678: symlink d4/df/d3d/lc6 0 2024-09-10T09:36:09.667 INFO:tasks.workunit.client.0.smithi079.stdout:6/826: dread d4/d8/dc/d12/f30 [0,4194304] 0 2024-09-10T09:36:09.668 INFO:tasks.workunit.client.0.smithi079.stdout:6/827: dread d4/d8/dd/d76/d46/d88/d108/ffa [0,4194304] 0 2024-09-10T09:36:09.670 INFO:tasks.workunit.client.0.smithi079.stdout:6/828: symlink d4/d8/dc/d98/l10e 0 2024-09-10T09:36:09.673 INFO:tasks.workunit.client.0.smithi079.stdout:0/687: rename d4/d12/d15/d2b to d4/d12/d16/de3 0 2024-09-10T09:36:09.674 INFO:tasks.workunit.client.0.smithi079.stdout:0/688: readlink d4/d12/l3b 0 2024-09-10T09:36:09.677 INFO:tasks.workunit.client.0.smithi079.stdout:1/838: rename d5/d40/f42 to d5/d24/d36/d79/f11c 0 2024-09-10T09:36:09.678 INFO:tasks.workunit.client.0.smithi079.stdout:5/709: dread d2/d3/d27/d32/f90 [0,4194304] 0 2024-09-10T09:36:09.678 INFO:tasks.workunit.client.0.smithi079.stdout:2/619: dwrite d4/dc/d1c/f34 [0,4194304] 0 2024-09-10T09:36:09.679 INFO:tasks.workunit.client.0.smithi079.stdout:7/679: rename d4/dc/d43/f9b to d4/df/fc7 0 2024-09-10T09:36:09.679 INFO:tasks.workunit.client.0.smithi079.stdout:6/829: dread d4/d8/dc/d93/dc4/fce [0,4194304] 0 2024-09-10T09:36:09.681 INFO:tasks.workunit.client.0.smithi079.stdout:2/620: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/fc2 [0,4194304] 0 2024-09-10T09:36:09.681 INFO:tasks.workunit.client.0.smithi079.stdout:6/830: symlink d4/d8/d74/d101/l10f 0 2024-09-10T09:36:09.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/621: rmdir d4 39 2024-09-10T09:36:09.684 INFO:tasks.workunit.client.0.smithi079.stdout:5/710: dread d2/d3/d5e/d73/f7a [0,4194304] 0 2024-09-10T09:36:09.686 INFO:tasks.workunit.client.0.smithi079.stdout:6/831: rename d4/d8/dc/d12/d29/db5/fbc to d4/d8/dc/d12/f110 0 2024-09-10T09:36:09.689 INFO:tasks.workunit.client.0.smithi079.stdout:9/635: dwrite d3/d7/fcd [0,4194304] 0 2024-09-10T09:36:09.691 INFO:tasks.workunit.client.0.smithi079.stdout:1/839: dread d5/d40/faa [0,4194304] 0 2024-09-10T09:36:09.691 INFO:tasks.workunit.client.0.smithi079.stdout:1/840: chown d5/df/f1c 14 1 2024-09-10T09:36:09.692 INFO:tasks.workunit.client.0.smithi079.stdout:9/636: chown d3/d7/d26/c96 111 1 2024-09-10T09:36:09.692 INFO:tasks.workunit.client.0.smithi079.stdout:1/841: write d5/df/d2e/d10c/d111/fc2 [479909,84470] 0 2024-09-10T09:36:09.693 INFO:tasks.workunit.client.0.smithi079.stdout:7/680: dread d4/dc/f17 [4194304,4194304] 0 2024-09-10T09:36:09.693 INFO:tasks.workunit.client.0.smithi079.stdout:9/637: mkdir d3/d7/dc/de/d17/dcf/dd0 0 2024-09-10T09:36:09.697 INFO:tasks.workunit.client.0.smithi079.stdout:1/842: mknod d5/d40/dd9/c11d 0 2024-09-10T09:36:09.699 INFO:tasks.workunit.client.0.smithi079.stdout:7/681: creat d4/df/d6b/d9a/db2/fc8 x:0 0 0 2024-09-10T09:36:09.700 INFO:tasks.workunit.client.0.smithi079.stdout:9/638: mknod d3/d7/d26/d69/cd1 0 2024-09-10T09:36:09.701 INFO:tasks.workunit.client.0.smithi079.stdout:0/689: dwrite d4/d12/d15/d6b/fc5 [0,4194304] 0 2024-09-10T09:36:09.702 INFO:tasks.workunit.client.0.smithi079.stdout:1/843: rename d5/d4f/f96 to d5/df/dd0/da0/f11e 0 2024-09-10T09:36:09.704 INFO:tasks.workunit.client.0.smithi079.stdout:7/682: creat d4/d6/d4f/d70/fc9 x:0 0 0 2024-09-10T09:36:09.708 INFO:tasks.workunit.client.0.smithi079.stdout:0/690: creat d4/d12/d8b/dca/d32/fe4 x:0 0 0 2024-09-10T09:36:09.709 INFO:tasks.workunit.client.0.smithi079.stdout:1/844: mknod d5/d40/d46/c11f 0 2024-09-10T09:36:09.711 INFO:tasks.workunit.client.0.smithi079.stdout:0/691: creat d4/d12/d8b/fe5 x:0 0 0 2024-09-10T09:36:09.712 INFO:tasks.workunit.client.0.smithi079.stdout:6/832: getdents d4/d8/d74/d101 0 2024-09-10T09:36:09.715 INFO:tasks.workunit.client.0.smithi079.stdout:0/692: mknod d4/d1d/ce6 0 2024-09-10T09:36:09.718 INFO:tasks.workunit.client.0.smithi079.stdout:2/622: dwrite d4/dc/d1c/d86/d1b/d38/d87/fbe [0,4194304] 0 2024-09-10T09:36:09.718 INFO:tasks.workunit.client.0.smithi079.stdout:2/623: write d4/dc/f22 [373814,13493] 0 2024-09-10T09:36:09.719 INFO:tasks.workunit.client.0.smithi079.stdout:6/833: link d4/d8/dd/d76/d46/d88/d108/fd2 d4/d8/dc/f111 0 2024-09-10T09:36:09.719 INFO:tasks.workunit.client.0.smithi079.stdout:5/711: dwrite d2/d3/d59/f98 [0,4194304] 0 2024-09-10T09:36:09.720 INFO:tasks.workunit.client.0.smithi079.stdout:0/693: truncate d4/d12/d15/d69/fa8 723762 0 2024-09-10T09:36:09.722 INFO:tasks.workunit.client.0.smithi079.stdout:2/624: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/lc6 0 2024-09-10T09:36:09.723 INFO:tasks.workunit.client.0.smithi079.stdout:6/834: symlink d4/l112 0 2024-09-10T09:36:09.725 INFO:tasks.workunit.client.0.smithi079.stdout:2/625: write d4/f6 [1937761,56728] 0 2024-09-10T09:36:09.728 INFO:tasks.workunit.client.0.smithi079.stdout:5/712: mkdir d2/d3/def 0 2024-09-10T09:36:09.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/694: truncate d4/d1d/d24/d72/fc6 3016336 0 2024-09-10T09:36:09.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/695: chown d4/d12/d1a/d6d/d84/la3 0 1 2024-09-10T09:36:09.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/696: write d4/d12/d16/de3/f63 [265809,118592] 0 2024-09-10T09:36:09.728 INFO:tasks.workunit.client.0.smithi079.stdout:0/697: creat d4/d12/d8b/dca/d32/fe7 x:0 0 0 2024-09-10T09:36:09.731 INFO:tasks.workunit.client.0.smithi079.stdout:6/835: mkdir d4/d8/dc/d93/d4b/d113 0 2024-09-10T09:36:09.737 INFO:tasks.workunit.client.0.smithi079.stdout:0/698: creat d4/d12/d16/d53/fe8 x:0 0 0 2024-09-10T09:36:09.741 INFO:tasks.workunit.client.0.smithi079.stdout:9/639: dwrite d3/d7/dc/de/d17/d12/fa0 [0,4194304] 0 2024-09-10T09:36:09.741 INFO:tasks.workunit.client.0.smithi079.stdout:7/683: dwrite d4/df/f68 [0,4194304] 0 2024-09-10T09:36:09.743 INFO:tasks.workunit.client.0.smithi079.stdout:6/836: link d4/l57 d4/d8/dc/d98/l114 0 2024-09-10T09:36:09.743 INFO:tasks.workunit.client.0.smithi079.stdout:1/845: dwrite d5/df/f55 [4194304,4194304] 0 2024-09-10T09:36:09.745 INFO:tasks.workunit.client.0.smithi079.stdout:0/699: dread d4/fd [0,4194304] 0 2024-09-10T09:36:09.752 INFO:tasks.workunit.client.0.smithi079.stdout:6/837: truncate d4/d8/dc/d93/fe5 1838938 0 2024-09-10T09:36:09.755 INFO:tasks.workunit.client.0.smithi079.stdout:2/626: dwrite d4/dc/f6d [0,4194304] 0 2024-09-10T09:36:09.755 INFO:tasks.workunit.client.0.smithi079.stdout:2/627: readlink l1 0 2024-09-10T09:36:09.756 INFO:tasks.workunit.client.0.smithi079.stdout:1/846: creat d5/df/d11/d76/f120 x:0 0 0 2024-09-10T09:36:09.756 INFO:tasks.workunit.client.0.smithi079.stdout:1/847: read - d5/fea zero size 2024-09-10T09:36:09.756 INFO:tasks.workunit.client.0.smithi079.stdout:5/713: dwrite d2/d3/d5e/fa7 [0,4194304] 0 2024-09-10T09:36:09.756 INFO:tasks.workunit.client.0.smithi079.stdout:5/714: fdatasync d2/f24 0 2024-09-10T09:36:09.757 INFO:tasks.workunit.client.0.smithi079.stdout:0/700: unlink d4/d1d/d24/c77 0 2024-09-10T09:36:09.757 INFO:tasks.workunit.client.0.smithi079.stdout:9/640: dread d3/d7/dc/de/d17/d12/fa0 [0,4194304] 0 2024-09-10T09:36:09.757 INFO:tasks.workunit.client.0.smithi079.stdout:9/641: chown d3/d7/d26/d3d/f42 0 1 2024-09-10T09:36:09.758 INFO:tasks.workunit.client.0.smithi079.stdout:9/642: read - d3/d7/d26/d83/fb8 zero size 2024-09-10T09:36:09.767 INFO:tasks.workunit.client.0.smithi079.stdout:6/838: getdents d4/d8/dd/d41/d51/dc7 0 2024-09-10T09:36:09.770 INFO:tasks.workunit.client.0.smithi079.stdout:1/848: write d5/df/dd0/da0/f10d [2067114,101663] 0 2024-09-10T09:36:09.770 INFO:tasks.workunit.client.0.smithi079.stdout:1/849: creat d5/d4f/d95/f121 x:0 0 0 2024-09-10T09:36:09.772 INFO:tasks.workunit.client.0.smithi079.stdout:5/715: creat d2/d3/d27/d32/d39/dc4/ff0 x:0 0 0 2024-09-10T09:36:09.772 INFO:tasks.workunit.client.0.smithi079.stdout:7/684: rename d4/df/d6b/d9a/db2 to d4/d6/d4f/d70/db6/dca 0 2024-09-10T09:36:09.775 INFO:tasks.workunit.client.0.smithi079.stdout:1/850: getdents d5/d24/d36/d3a/d85/db1/d11a 0 2024-09-10T09:36:09.776 INFO:tasks.workunit.client.0.smithi079.stdout:0/701: rename d4/d12/d1a/c36 to d4/d12/d21/d3f/ce9 0 2024-09-10T09:36:09.776 INFO:tasks.workunit.client.0.smithi079.stdout:0/702: dread - d4/d12/d16/de3/fa2 zero size 2024-09-10T09:36:09.778 INFO:tasks.workunit.client.0.smithi079.stdout:7/685: write d4/df/d3d/d75/f9d [1544816,35713] 0 2024-09-10T09:36:09.778 INFO:tasks.workunit.client.0.smithi079.stdout:7/686: chown d4/df/d3d/d82/f6f 31 1 2024-09-10T09:36:09.780 INFO:tasks.workunit.client.0.smithi079.stdout:2/628: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/fc4 [0,4194304] 0 2024-09-10T09:36:09.791 INFO:tasks.workunit.client.0.smithi079.stdout:1/851: link d5/d11b/dd1/fbb d5/d40/dac/f122 0 2024-09-10T09:36:09.792 INFO:tasks.workunit.client.0.smithi079.stdout:1/852: stat d5/df/d2e/d10c/d111/f92 0 2024-09-10T09:36:09.793 INFO:tasks.workunit.client.0.smithi079.stdout:9/643: rename d3/d7/dc/d7a/da9/f56 to d3/d7/dc/de/da7/dac/fd2 0 2024-09-10T09:36:09.793 INFO:tasks.workunit.client.0.smithi079.stdout:9/644: chown d3/d7/dc/de/d58/l8a 2 1 2024-09-10T09:36:09.793 INFO:tasks.workunit.client.0.smithi079.stdout:9/645: stat d3/d7/dc/de/d17/f82 0 2024-09-10T09:36:09.793 INFO:tasks.workunit.client.0.smithi079.stdout:2/629: read d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/fa9 [555157,97340] 0 2024-09-10T09:36:09.794 INFO:tasks.workunit.client.0.smithi079.stdout:0/703: unlink d4/d12/d21/d3f/d88/f95 0 2024-09-10T09:36:09.794 INFO:tasks.workunit.client.0.smithi079.stdout:0/704: fdatasync d4/fd5 0 2024-09-10T09:36:09.796 INFO:tasks.workunit.client.0.smithi079.stdout:6/839: dwrite d4/d8/dc/d93/dc4/fce [0,4194304] 0 2024-09-10T09:36:09.797 INFO:tasks.workunit.client.0.smithi079.stdout:9/646: symlink d3/d7/d26/d3d/ld3 0 2024-09-10T09:36:09.798 INFO:tasks.workunit.client.0.smithi079.stdout:2/630: creat d4/dc/fc7 x:0 0 0 2024-09-10T09:36:09.798 INFO:tasks.workunit.client.0.smithi079.stdout:6/840: write d4/d8/dc/d12/f73 [316928,92072] 0 2024-09-10T09:36:09.799 INFO:tasks.workunit.client.0.smithi079.stdout:0/705: symlink d4/d12/d16/lea 0 2024-09-10T09:36:09.799 INFO:tasks.workunit.client.0.smithi079.stdout:0/706: readlink d4/d12/d1a/d6d/l76 0 2024-09-10T09:36:09.799 INFO:tasks.workunit.client.0.smithi079.stdout:5/716: dwrite d2/d3/f28 [0,4194304] 0 2024-09-10T09:36:09.800 INFO:tasks.workunit.client.0.smithi079.stdout:9/647: mkdir d3/d7/dc/d7a/da9/dd4 0 2024-09-10T09:36:09.802 INFO:tasks.workunit.client.0.smithi079.stdout:7/687: dwrite d4/d6/d4f/f52 [0,4194304] 0 2024-09-10T09:36:09.802 INFO:tasks.workunit.client.0.smithi079.stdout:7/688: creat d4/d6/d4f/da7/fcb x:0 0 0 2024-09-10T09:36:09.802 INFO:tasks.workunit.client.0.smithi079.stdout:7/689: chown d4/d6 609 1 2024-09-10T09:36:09.802 INFO:tasks.workunit.client.0.smithi079.stdout:2/631: mknod d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/cc8 0 2024-09-10T09:36:09.803 INFO:tasks.workunit.client.0.smithi079.stdout:6/841: unlink d4/d8/dd/d76/d46/f3a 0 2024-09-10T09:36:09.807 INFO:tasks.workunit.client.0.smithi079.stdout:7/690: creat d4/df/d19/db9/fcc x:0 0 0 2024-09-10T09:36:09.808 INFO:tasks.workunit.client.0.smithi079.stdout:6/842: mknod d4/d8/dd/d76/d46/c115 0 2024-09-10T09:36:09.808 INFO:tasks.workunit.client.0.smithi079.stdout:9/648: getdents d3/d7/d26/d69 0 2024-09-10T09:36:09.809 INFO:tasks.workunit.client.0.smithi079.stdout:7/691: truncate d4/df/d3d/d82/f5c 3209 0 2024-09-10T09:36:09.809 INFO:tasks.workunit.client.0.smithi079.stdout:7/692: stat d4/d6/da9/fc0 0 2024-09-10T09:36:09.810 INFO:tasks.workunit.client.0.smithi079.stdout:6/843: link d4/d8/dd/d41/d51/f105 d4/d8/dc/d93/dc4/f116 0 2024-09-10T09:36:09.810 INFO:tasks.workunit.client.0.smithi079.stdout:6/844: dread - d4/d8/dc/d93/dc4/f116 zero size 2024-09-10T09:36:09.811 INFO:tasks.workunit.client.0.smithi079.stdout:9/649: creat d3/d7/d5a/fd5 x:0 0 0 2024-09-10T09:36:09.811 INFO:tasks.workunit.client.0.smithi079.stdout:1/853: dwrite d5/d24/d36/d3a/f4b [0,4194304] 0 2024-09-10T09:36:09.812 INFO:tasks.workunit.client.0.smithi079.stdout:7/693: creat d4/d6/d4f/d70/dba/fcd x:0 0 0 2024-09-10T09:36:09.812 INFO:tasks.workunit.client.0.smithi079.stdout:5/717: write d2/d3/f6a [1082618,67408] 0 2024-09-10T09:36:09.812 INFO:tasks.workunit.client.0.smithi079.stdout:5/718: dread - d2/d3/d27/d70/d88/f9e zero size 2024-09-10T09:36:09.813 INFO:tasks.workunit.client.0.smithi079.stdout:5/719: fdatasync d2/d3/d27/d32/db6/fe0 0 2024-09-10T09:36:09.813 INFO:tasks.workunit.client.0.smithi079.stdout:9/650: fsync d3/d7/f9f 0 2024-09-10T09:36:09.815 INFO:tasks.workunit.client.0.smithi079.stdout:1/854: rename d5/d40/dd9/c11d to d5/df/dd0/da0/d6a/c123 0 2024-09-10T09:36:09.816 INFO:tasks.workunit.client.0.smithi079.stdout:2/632: dread d4/dc/d1c/d86/d1b/d38/d39/f7b [0,4194304] 0 2024-09-10T09:36:09.816 INFO:tasks.workunit.client.0.smithi079.stdout:0/707: getdents d4/d12/d1a 0 2024-09-10T09:36:09.818 INFO:tasks.workunit.client.0.smithi079.stdout:5/720: creat d2/d3/d27/d32/d44/ff1 x:0 0 0 2024-09-10T09:36:09.818 INFO:tasks.workunit.client.0.smithi079.stdout:5/721: fdatasync d2/d3/d27/d32/db6/fe0 0 2024-09-10T09:36:09.819 INFO:tasks.workunit.client.0.smithi079.stdout:9/651: rmdir d3/d7f 39 2024-09-10T09:36:09.819 INFO:tasks.workunit.client.0.smithi079.stdout:9/652: dread - d3/d7/dc/de/db7/fcb zero size 2024-09-10T09:36:09.820 INFO:tasks.workunit.client.0.smithi079.stdout:9/653: creat d3/d7/d26/d83/fd6 x:0 0 0 2024-09-10T09:36:09.820 INFO:tasks.workunit.client.0.smithi079.stdout:9/654: getdents d3/d7/d26/d69 0 2024-09-10T09:36:09.825 INFO:tasks.workunit.client.0.smithi079.stdout:1/855: rename d5/df/dd0/da0/c113 to d5/d24/d36/d3a/d85/c124 0 2024-09-10T09:36:09.825 INFO:tasks.workunit.client.0.smithi079.stdout:1/856: chown d5/df/dd0/d57 68144526 1 2024-09-10T09:36:09.826 INFO:tasks.workunit.client.0.smithi079.stdout:2/633: creat d4/dc/d1c/d86/d1b/d38/d39/d31/d52/fc9 x:0 0 0 2024-09-10T09:36:09.826 INFO:tasks.workunit.client.0.smithi079.stdout:2/634: fsync d4/dc/f22 0 2024-09-10T09:36:09.826 INFO:tasks.workunit.client.0.smithi079.stdout:2/635: chown d4/d5d/f83 66237627 1 2024-09-10T09:36:09.828 INFO:tasks.workunit.client.0.smithi079.stdout:5/722: mkdir d2/d3/d27/d70/d88/df2 0 2024-09-10T09:36:09.832 INFO:tasks.workunit.client.0.smithi079.stdout:9/655: mkdir d3/d7/d26/d83/dd7 0 2024-09-10T09:36:09.834 INFO:tasks.workunit.client.0.smithi079.stdout:2/636: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca 0 2024-09-10T09:36:09.838 INFO:tasks.workunit.client.0.smithi079.stdout:2/637: symlink d4/dc/d1c/d86/d1b/d38/d87/lcb 0 2024-09-10T09:36:09.840 INFO:tasks.workunit.client.0.smithi079.stdout:9/656: truncate d3/d7/f3b 1901861 0 2024-09-10T09:36:09.840 INFO:tasks.workunit.client.0.smithi079.stdout:9/657: readlink d3/d7/dc/de/d17/l44 0 2024-09-10T09:36:09.843 INFO:tasks.workunit.client.0.smithi079.stdout:2/638: rename d4/dc/d1c/d86/d1b/d38/d39/l6e to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/lcc 0 2024-09-10T09:36:09.843 INFO:tasks.workunit.client.0.smithi079.stdout:2/639: write d4/dc/d1c/d86/f3f [451569,46243] 0 2024-09-10T09:36:09.844 INFO:tasks.workunit.client.0.smithi079.stdout:9/658: symlink d3/d40/ld8 0 2024-09-10T09:36:09.846 INFO:tasks.workunit.client.0.smithi079.stdout:2/640: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fcd x:0 0 0 2024-09-10T09:36:09.847 INFO:tasks.workunit.client.0.smithi079.stdout:9/659: symlink d3/d7/dc/de/d17/d2f/d98/ld9 0 2024-09-10T09:36:09.847 INFO:tasks.workunit.client.0.smithi079.stdout:9/660: write d3/d7/fcd [4551440,25060] 0 2024-09-10T09:36:09.848 INFO:tasks.workunit.client.0.smithi079.stdout:9/661: creat d3/d7/dc/d7a/da9/fda x:0 0 0 2024-09-10T09:36:09.849 INFO:tasks.workunit.client.0.smithi079.stdout:9/662: link d3/d7/dc/f37 d3/d7/dc/d62/fdb 0 2024-09-10T09:36:09.851 INFO:tasks.workunit.client.0.smithi079.stdout:8/704: sync 2024-09-10T09:36:09.851 INFO:tasks.workunit.client.0.smithi079.stdout:4/733: sync 2024-09-10T09:36:09.852 INFO:tasks.workunit.client.0.smithi079.stdout:3/783: sync 2024-09-10T09:36:09.852 INFO:tasks.workunit.client.0.smithi079.stdout:9/663: creat d3/d7/d70/dbc/fdc x:0 0 0 2024-09-10T09:36:09.855 INFO:tasks.workunit.client.0.smithi079.stdout:4/734: unlink d1/da/d16/d88/cb9 0 2024-09-10T09:36:09.855 INFO:tasks.workunit.client.0.smithi079.stdout:4/735: fsync d1/da/d16/fd3 0 2024-09-10T09:36:09.856 INFO:tasks.workunit.client.0.smithi079.stdout:8/705: mkdir d11/d2b/d4b/d50/d55/db8/de4 0 2024-09-10T09:36:09.856 INFO:tasks.workunit.client.0.smithi079.stdout:8/706: chown d11/d2b/d4b/d74/f7a 18495 1 2024-09-10T09:36:09.856 INFO:tasks.workunit.client.0.smithi079.stdout:8/707: rename d11/d2b/d4b/d50/d9e/dca to d11/d2b/d4b/d50/d9e/dca/dd0/de5 22 2024-09-10T09:36:09.857 INFO:tasks.workunit.client.0.smithi079.stdout:8/708: truncate d11/d2b/d4b/f93 773550 0 2024-09-10T09:36:09.857 INFO:tasks.workunit.client.0.smithi079.stdout:6/845: dwrite d4/d8/dc/d93/fad [0,4194304] 0 2024-09-10T09:36:09.857 INFO:tasks.workunit.client.0.smithi079.stdout:6/846: chown d4/d8 135430 1 2024-09-10T09:36:09.858 INFO:tasks.workunit.client.0.smithi079.stdout:6/847: creat d4/d8/dc/f117 x:0 0 0 2024-09-10T09:36:09.858 INFO:tasks.workunit.client.0.smithi079.stdout:7/694: dwrite d4/df/d3d/d75/fa8 [0,4194304] 0 2024-09-10T09:36:09.858 INFO:tasks.workunit.client.0.smithi079.stdout:8/709: write d11/d2b/d4b/f56 [609999,29690] 0 2024-09-10T09:36:09.858 INFO:tasks.workunit.client.0.smithi079.stdout:9/664: link d3/c8 d3/d7/dc/d62/cdd 0 2024-09-10T09:36:09.858 INFO:tasks.workunit.client.0.smithi079.stdout:9/665: readlink d3/d7/dc/de/d17/d6e/lb5 0 2024-09-10T09:36:09.859 INFO:tasks.workunit.client.0.smithi079.stdout:1/857: dwrite d5/df/dd0/da0/f11e [0,4194304] 0 2024-09-10T09:36:09.863 INFO:tasks.workunit.client.0.smithi079.stdout:2/641: write d4/dc/d1c/d86/d1b/d38/d39/d99/f33 [2597723,54355] 0 2024-09-10T09:36:09.863 INFO:tasks.workunit.client.0.smithi079.stdout:5/723: dwrite d2/d3/d27/d32/d39/f5c [0,4194304] 0 2024-09-10T09:36:09.863 INFO:tasks.workunit.client.0.smithi079.stdout:6/848: stat d4/d8/dc/d12/d29/l4a 0 2024-09-10T09:36:09.872 INFO:tasks.workunit.client.0.smithi079.stdout:8/710: mkdir d11/d2b/d4b/d74/da2/de6 0 2024-09-10T09:36:09.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/642: write d4/dc/d1c/d86/d1b/d38/d39/d99/f15 [4008531,62112] 0 2024-09-10T09:36:09.879 INFO:tasks.workunit.client.0.smithi079.stdout:6/849: symlink d4/d8/dd/d76/d46/d88/df7/l118 0 2024-09-10T09:36:09.879 INFO:tasks.workunit.client.0.smithi079.stdout:4/736: dwrite d1/da/d28/d47/fe6 [0,4194304] 0 2024-09-10T09:36:09.879 INFO:tasks.workunit.client.0.smithi079.stdout:4/737: chown d1/da/d16/d88/ca4 0 1 2024-09-10T09:36:09.880 INFO:tasks.workunit.client.0.smithi079.stdout:7/695: rmdir d4/df/d3d/d75 39 2024-09-10T09:36:09.883 INFO:tasks.workunit.client.0.smithi079.stdout:9/666: truncate d3/d7/f63 558610 0 2024-09-10T09:36:09.884 INFO:tasks.workunit.client.0.smithi079.stdout:2/643: link d4/d5d/fa3 d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fce 0 2024-09-10T09:36:09.887 INFO:tasks.workunit.client.0.smithi079.stdout:4/738: truncate d1/f3a 262237 0 2024-09-10T09:36:09.889 INFO:tasks.workunit.client.0.smithi079.stdout:1/858: dwrite d5/d24/d36/d53/db3/de3/f51 [0,4194304] 0 2024-09-10T09:36:09.889 INFO:tasks.workunit.client.0.smithi079.stdout:4/739: dread d1/da/d16/d21/d32/f8e [0,4194304] 0 2024-09-10T09:36:09.890 INFO:tasks.workunit.client.0.smithi079.stdout:7/696: unlink d4/df/d3d/f64 0 2024-09-10T09:36:09.891 INFO:tasks.workunit.client.0.smithi079.stdout:9/667: truncate d3/d7/dc/de/d17/f1f 1267616 0 2024-09-10T09:36:09.893 INFO:tasks.workunit.client.0.smithi079.stdout:6/850: dread d4/d8/dd/d76/d46/d88/d108/fd2 [0,4194304] 0 2024-09-10T09:36:09.893 INFO:tasks.workunit.client.0.smithi079.stdout:6/851: dread - d4/d8/dc/dd9/ff2 zero size 2024-09-10T09:36:09.894 INFO:tasks.workunit.client.0.smithi079.stdout:2/644: unlink d4/d8f/l90 0 2024-09-10T09:36:09.895 INFO:tasks.workunit.client.0.smithi079.stdout:4/740: rename d1/da/d28/d99/lc9 to d1/da/d16/d4d/led 0 2024-09-10T09:36:09.895 INFO:tasks.workunit.client.0.smithi079.stdout:4/741: write d1/da/d3b/d5f/f62 [789676,16254] 0 2024-09-10T09:36:09.896 INFO:tasks.workunit.client.0.smithi079.stdout:5/724: dwrite d2/d3/d27/d32/d44/ff1 [0,4194304] 0 2024-09-10T09:36:09.897 INFO:tasks.workunit.client.0.smithi079.stdout:8/711: dread d11/d2b/fc2 [0,4194304] 0 2024-09-10T09:36:09.897 INFO:tasks.workunit.client.0.smithi079.stdout:8/712: chown d11/d2b/d4b/d7e/db2/db7/fe1 4692 1 2024-09-10T09:36:09.897 INFO:tasks.workunit.client.0.smithi079.stdout:8/713: fsync d11/f19 0 2024-09-10T09:36:09.897 INFO:tasks.workunit.client.0.smithi079.stdout:7/697: symlink d4/df/d19/db9/lce 0 2024-09-10T09:36:09.899 INFO:tasks.workunit.client.0.smithi079.stdout:9/668: rmdir d3 39 2024-09-10T09:36:09.899 INFO:tasks.workunit.client.0.smithi079.stdout:9/669: write d3/d7/dc/d7a/da9/fda [217991,29614] 0 2024-09-10T09:36:09.902 INFO:tasks.workunit.client.0.smithi079.stdout:1/859: write d5/df/f55 [8386878,10410] 0 2024-09-10T09:36:09.904 INFO:tasks.workunit.client.0.smithi079.stdout:5/725: symlink d2/d3/d27/d70/d80/lf3 0 2024-09-10T09:36:09.905 INFO:tasks.workunit.client.0.smithi079.stdout:1/860: dread d5/df/f52 [0,4194304] 0 2024-09-10T09:36:09.905 INFO:tasks.workunit.client.0.smithi079.stdout:1/861: creat d5/d24/d36/d53/f125 x:0 0 0 2024-09-10T09:36:09.905 INFO:tasks.workunit.client.0.smithi079.stdout:1/862: fsync d5/d24/d36/d79/f9f 0 2024-09-10T09:36:09.905 INFO:tasks.workunit.client.0.smithi079.stdout:1/863: creat d5/d40/d46/f126 x:0 0 0 2024-09-10T09:36:09.908 INFO:tasks.workunit.client.0.smithi079.stdout:2/645: rename d4/dc/d1c/d86/d1b/d38/d39/d99/d61/f72 to d4/dc/fcf 0 2024-09-10T09:36:09.910 INFO:tasks.workunit.client.0.smithi079.stdout:9/670: mknod d3/d7/dc/de/d17/d2f/d74/cde 0 2024-09-10T09:36:09.912 INFO:tasks.workunit.client.0.smithi079.stdout:5/726: symlink d2/d3/d27/d32/d39/dc4/lf4 0 2024-09-10T09:36:09.912 INFO:tasks.workunit.client.0.smithi079.stdout:5/727: stat d2/d3/ca4 0 2024-09-10T09:36:09.917 INFO:tasks.workunit.client.0.smithi079.stdout:1/864: write d5/f19 [3094748,38532] 0 2024-09-10T09:36:09.918 INFO:tasks.workunit.client.0.smithi079.stdout:1/865: chown d5/d24/d36/f9a 65 1 2024-09-10T09:36:09.922 INFO:tasks.workunit.client.0.smithi079.stdout:5/728: symlink d2/d3/d59/dcb/lf5 0 2024-09-10T09:36:09.922 INFO:tasks.workunit.client.0.smithi079.stdout:5/729: chown d2/d3/d27/d32/d44/f7c 218 1 2024-09-10T09:36:09.923 INFO:tasks.workunit.client.0.smithi079.stdout:1/866: mkdir d5/df/d11/d127 0 2024-09-10T09:36:09.924 INFO:tasks.workunit.client.0.smithi079.stdout:1/867: creat d5/d4f/d95/f128 x:0 0 0 2024-09-10T09:36:09.926 INFO:tasks.workunit.client.0.smithi079.stdout:8/714: rename d11/d2b/d4b/fb1 to d11/fe7 0 2024-09-10T09:36:09.928 INFO:tasks.workunit.client.0.smithi079.stdout:5/730: truncate d2/d3/d59/f98 1443547 0 2024-09-10T09:36:09.932 INFO:tasks.workunit.client.0.smithi079.stdout:5/731: dread d2/d3/d27/d32/de3/d4d/fcf [0,4194304] 0 2024-09-10T09:36:09.933 INFO:tasks.workunit.client.0.smithi079.stdout:7/698: rename d4/df/f77 to d4/df/d3d/d75/fcf 0 2024-09-10T09:36:09.933 INFO:tasks.workunit.client.0.smithi079.stdout:4/742: dwrite d1/da/d16/d4d/f9f [4194304,4194304] 0 2024-09-10T09:36:09.933 INFO:tasks.workunit.client.0.smithi079.stdout:4/743: creat d1/d38/da5/fee x:0 0 0 2024-09-10T09:36:09.933 INFO:tasks.workunit.client.0.smithi079.stdout:4/744: read - d1/d38/da5/fc4 zero size 2024-09-10T09:36:09.934 INFO:tasks.workunit.client.0.smithi079.stdout:6/852: dwrite d4/d8/dc/d1c/f21 [0,4194304] 0 2024-09-10T09:36:09.934 INFO:tasks.workunit.client.0.smithi079.stdout:6/853: write d4/f9f [1578965,106373] 0 2024-09-10T09:36:09.934 INFO:tasks.workunit.client.0.smithi079.stdout:6/854: write d4/d8/dc/d98/fff [178967,108196] 0 2024-09-10T09:36:09.934 INFO:tasks.workunit.client.0.smithi079.stdout:6/855: chown d4/d8/c9 51 1 2024-09-10T09:36:09.934 INFO:tasks.workunit.client.0.smithi079.stdout:9/671: dwrite d3/d7/dc/de/d17/d2f/f5e [0,4194304] 0 2024-09-10T09:36:09.936 INFO:tasks.workunit.client.0.smithi079.stdout:8/715: truncate d11/d2b/d4b/d50/d55/f65 1893732 0 2024-09-10T09:36:09.936 INFO:tasks.workunit.client.0.smithi079.stdout:8/716: write d11/f88 [1187055,108361] 0 2024-09-10T09:36:09.936 INFO:tasks.workunit.client.0.smithi079.stdout:8/717: chown d11/fe7 93336249 1 2024-09-10T09:36:09.936 INFO:tasks.workunit.client.0.smithi079.stdout:8/718: chown d11/dbd/ddc 113330353 1 2024-09-10T09:36:09.937 INFO:tasks.workunit.client.0.smithi079.stdout:5/732: unlink d2/d3/lbd 0 2024-09-10T09:36:09.938 INFO:tasks.workunit.client.0.smithi079.stdout:5/733: fsync d2/f20 0 2024-09-10T09:36:09.938 INFO:tasks.workunit.client.0.smithi079.stdout:5/734: fdatasync d2/f3a 0 2024-09-10T09:36:09.939 INFO:tasks.workunit.client.0.smithi079.stdout:1/868: write d5/f22 [2208160,108783] 0 2024-09-10T09:36:09.939 INFO:tasks.workunit.client.0.smithi079.stdout:1/869: stat d5/d24/f66 0 2024-09-10T09:36:09.939 INFO:tasks.workunit.client.0.smithi079.stdout:7/699: link d4/df/d3d/d82/c5a d4/d6/d4f/d70/dba/cd0 0 2024-09-10T09:36:09.939 INFO:tasks.workunit.client.0.smithi079.stdout:7/700: chown d4/c31 219 1 2024-09-10T09:36:09.940 INFO:tasks.workunit.client.0.smithi079.stdout:2/646: getdents d4/dc 0 2024-09-10T09:36:09.942 INFO:tasks.workunit.client.0.smithi079.stdout:4/745: rename d1/da/d3b/d5f/lab to d1/da/d3b/db3/lef 0 2024-09-10T09:36:09.944 INFO:tasks.workunit.client.0.smithi079.stdout:6/856: creat d4/d8/dd/f119 x:0 0 0 2024-09-10T09:36:09.947 INFO:tasks.workunit.client.0.smithi079.stdout:9/672: mkdir d3/d7/d26/d69/ddf 0 2024-09-10T09:36:09.947 INFO:tasks.workunit.client.0.smithi079.stdout:9/673: dread - d3/d7/dc/de/d58/faa zero size 2024-09-10T09:36:09.950 INFO:tasks.workunit.client.0.smithi079.stdout:8/719: truncate d11/f31 162275 0 2024-09-10T09:36:09.950 INFO:tasks.workunit.client.0.smithi079.stdout:8/720: fdatasync d11/f31 0 2024-09-10T09:36:09.959 INFO:tasks.workunit.client.0.smithi079.stdout:5/735: link d2/c11 d2/d3/d27/d70/d88/cf6 0 2024-09-10T09:36:09.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:09 smithi079 ceph-mon[27592]: pgmap v259: 65 pgs: 65 active+clean; 1.3 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 138 MiB/s rd, 164 MiB/s wr, 478 op/s 2024-09-10T09:36:09.961 INFO:tasks.workunit.client.0.smithi079.stdout:1/870: unlink d5/df/d2e/f49 0 2024-09-10T09:36:09.963 INFO:tasks.workunit.client.0.smithi079.stdout:7/701: symlink d4/ld1 0 2024-09-10T09:36:09.963 INFO:tasks.workunit.client.0.smithi079.stdout:7/702: fsync d4/dc/f92 0 2024-09-10T09:36:09.965 INFO:tasks.workunit.client.0.smithi079.stdout:2/647: link d4/f66 d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd0 0 2024-09-10T09:36:09.966 INFO:tasks.workunit.client.0.smithi079.stdout:6/857: truncate d4/d8/dc/d12/faf 254324 0 2024-09-10T09:36:09.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:09 smithi135 ceph-mon[33411]: pgmap v259: 65 pgs: 65 active+clean; 1.3 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 138 MiB/s rd, 164 MiB/s wr, 478 op/s 2024-09-10T09:36:09.969 INFO:tasks.workunit.client.0.smithi079.stdout:9/674: unlink d3/d7/dc/d7a/lb3 0 2024-09-10T09:36:09.971 INFO:tasks.workunit.client.0.smithi079.stdout:1/871: getdents d5/df/dc6/de6 0 2024-09-10T09:36:09.971 INFO:tasks.workunit.client.0.smithi079.stdout:7/703: write d4/df/d3d/f41 [2897563,130410] 0 2024-09-10T09:36:09.972 INFO:tasks.workunit.client.0.smithi079.stdout:1/872: write d5/df/dd0/da0/fc7 [840320,91959] 0 2024-09-10T09:36:09.972 INFO:tasks.workunit.client.0.smithi079.stdout:1/873: readlink d5/d11b/lf2 0 2024-09-10T09:36:09.973 INFO:tasks.workunit.client.0.smithi079.stdout:2/648: rename d4/c7 to d4/dc/cd1 0 2024-09-10T09:36:09.973 INFO:tasks.workunit.client.0.smithi079.stdout:5/736: write d2/d3/d27/d32/d44/f7c [543916,34664] 0 2024-09-10T09:36:09.974 INFO:tasks.workunit.client.0.smithi079.stdout:6/858: link d4/d8/dd/d76/d46/d88/d108/le4 d4/d8/dc/dd9/l11a 0 2024-09-10T09:36:09.974 INFO:tasks.workunit.client.0.smithi079.stdout:8/721: dread d11/d2b/f47 [0,4194304] 0 2024-09-10T09:36:09.975 INFO:tasks.workunit.client.0.smithi079.stdout:9/675: creat d3/d7/dc/de/d17/d2f/d74/fe0 x:0 0 0 2024-09-10T09:36:09.975 INFO:tasks.workunit.client.0.smithi079.stdout:9/676: dread - d3/d7/dc/de/db7/fcb zero size 2024-09-10T09:36:09.976 INFO:tasks.workunit.client.0.smithi079.stdout:1/874: mknod d5/d40/d46/de8/c129 0 2024-09-10T09:36:09.976 INFO:tasks.workunit.client.0.smithi079.stdout:1/875: dread - d5/d24/d36/d53/f125 zero size 2024-09-10T09:36:09.976 INFO:tasks.workunit.client.0.smithi079.stdout:1/876: fdatasync d5/d40/d46/f126 0 2024-09-10T09:36:09.978 INFO:tasks.workunit.client.0.smithi079.stdout:7/704: write d4/d6/d38/f63 [1483868,51704] 0 2024-09-10T09:36:09.978 INFO:tasks.workunit.client.0.smithi079.stdout:2/649: unlink d4/dc/d1c/d86/d1b/d38/d39/d99/f75 0 2024-09-10T09:36:09.978 INFO:tasks.workunit.client.0.smithi079.stdout:1/877: dread d5/d11b/dd1/fbb [0,4194304] 0 2024-09-10T09:36:09.987 INFO:tasks.workunit.client.0.smithi079.stdout:6/859: dread d4/d8/f3b [0,4194304] 0 2024-09-10T09:36:09.987 INFO:tasks.workunit.client.0.smithi079.stdout:6/860: chown d4/d8/dc/ceb 8152 1 2024-09-10T09:36:09.987 INFO:tasks.workunit.client.0.smithi079.stdout:7/705: creat d4/d6/d4f/d70/db6/fd2 x:0 0 0 2024-09-10T09:36:09.989 INFO:tasks.workunit.client.0.smithi079.stdout:2/650: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fd2 x:0 0 0 2024-09-10T09:36:09.994 INFO:tasks.workunit.client.0.smithi079.stdout:6/861: mknod d4/d8/dc/d12/d29/c11b 0 2024-09-10T09:36:09.994 INFO:tasks.workunit.client.0.smithi079.stdout:6/862: dread - d4/d8/dd/d41/d51/dc7/f104 zero size 2024-09-10T09:36:09.995 INFO:tasks.workunit.client.0.smithi079.stdout:7/706: rename d4/d6/d4f/d66/f7e to d4/dc/d43/dab/fd3 0 2024-09-10T09:36:10.000 INFO:tasks.workunit.client.0.smithi079.stdout:2/651: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd3 x:0 0 0 2024-09-10T09:36:10.000 INFO:tasks.workunit.client.0.smithi079.stdout:2/652: creat d4/dc/d1c/d86/d1b/d38/d39/d31/d52/fd4 x:0 0 0 2024-09-10T09:36:10.000 INFO:tasks.workunit.client.0.smithi079.stdout:2/653: readlink d4/dc/d1c/d86/d1b/d38/d39/l48 0 2024-09-10T09:36:10.003 INFO:tasks.workunit.client.0.smithi079.stdout:7/707: creat d4/d6/d3e/db3/fd4 x:0 0 0 2024-09-10T09:36:10.003 INFO:tasks.workunit.client.0.smithi079.stdout:6/863: write d4/d8/dd/fb7 [1271365,6547] 0 2024-09-10T09:36:10.003 INFO:tasks.workunit.client.0.smithi079.stdout:6/864: read - d4/d8/d74/fcf zero size 2024-09-10T09:36:10.004 INFO:tasks.workunit.client.0.smithi079.stdout:0/708: sync 2024-09-10T09:36:10.005 INFO:tasks.workunit.client.0.smithi079.stdout:2/654: mknod d4/dc/d1c/d86/d1b/d38/d39/d31/cd5 0 2024-09-10T09:36:10.005 INFO:tasks.workunit.client.0.smithi079.stdout:2/655: truncate d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f76 454897 0 2024-09-10T09:36:10.005 INFO:tasks.workunit.client.0.smithi079.stdout:2/656: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd6 x:0 0 0 2024-09-10T09:36:10.005 INFO:tasks.workunit.client.0.smithi079.stdout:2/657: write d4/dc/faa [558137,30949] 0 2024-09-10T09:36:10.006 INFO:tasks.workunit.client.0.smithi079.stdout:7/708: link d4/df/d3d/d75/fcf d4/fd5 0 2024-09-10T09:36:10.008 INFO:tasks.workunit.client.0.smithi079.stdout:9/677: dwrite d3/d7/f3b [0,4194304] 0 2024-09-10T09:36:10.008 INFO:tasks.workunit.client.0.smithi079.stdout:9/678: read - d3/d7/dc/de/d17/d2f/d98/da1/fb9 zero size 2024-09-10T09:36:10.008 INFO:tasks.workunit.client.0.smithi079.stdout:5/737: dwrite d2/d3/f79 [0,4194304] 0 2024-09-10T09:36:10.008 INFO:tasks.workunit.client.0.smithi079.stdout:6/865: truncate d4/d8/f7d 2743928 0 2024-09-10T09:36:10.008 INFO:tasks.workunit.client.0.smithi079.stdout:8/722: dwrite d11/d2b/f39 [0,4194304] 0 2024-09-10T09:36:10.009 INFO:tasks.workunit.client.0.smithi079.stdout:0/709: truncate d4/d47/f4c 4081339 0 2024-09-10T09:36:10.011 INFO:tasks.workunit.client.0.smithi079.stdout:2/658: rename d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/f81 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd7 0 2024-09-10T09:36:10.013 INFO:tasks.workunit.client.0.smithi079.stdout:7/709: truncate d4/df/d3d/d75/f9d 1276130 0 2024-09-10T09:36:10.013 INFO:tasks.workunit.client.0.smithi079.stdout:7/710: dread - d4/d6/d38/fb7 zero size 2024-09-10T09:36:10.013 INFO:tasks.workunit.client.0.smithi079.stdout:2/659: dread d4/dc/d1c/d86/f98 [0,4194304] 0 2024-09-10T09:36:10.014 INFO:tasks.workunit.client.0.smithi079.stdout:9/679: link d3/d7/dc/de/l97 d3/d7/dc/de/d17/d2f/d98/le1 0 2024-09-10T09:36:10.016 INFO:tasks.workunit.client.0.smithi079.stdout:7/711: dread d4/d6/d38/f54 [0,4194304] 0 2024-09-10T09:36:10.017 INFO:tasks.workunit.client.0.smithi079.stdout:5/738: mknod d2/d3/d27/d32/db6/cf7 0 2024-09-10T09:36:10.017 INFO:tasks.workunit.client.0.smithi079.stdout:5/739: creat d2/d3/d27/d32/d39/dc4/ff8 x:0 0 0 2024-09-10T09:36:10.021 INFO:tasks.workunit.client.0.smithi079.stdout:8/723: symlink d11/d2b/d4b/d50/d55/db8/le8 0 2024-09-10T09:36:10.021 INFO:tasks.workunit.client.0.smithi079.stdout:8/724: chown l10 10429 1 2024-09-10T09:36:10.021 INFO:tasks.workunit.client.0.smithi079.stdout:8/725: dread - d11/d3b/fe3 zero size 2024-09-10T09:36:10.022 INFO:tasks.workunit.client.0.smithi079.stdout:8/726: chown d11/d3b 4869658 1 2024-09-10T09:36:10.023 INFO:tasks.workunit.client.0.smithi079.stdout:0/710: truncate d4/d12/d39/f46 172435 0 2024-09-10T09:36:10.024 INFO:tasks.workunit.client.0.smithi079.stdout:0/711: fsync d4/d12/d8b/f92 0 2024-09-10T09:36:10.024 INFO:tasks.workunit.client.0.smithi079.stdout:0/712: chown d4/d12/d21/laf 28155 1 2024-09-10T09:36:10.024 INFO:tasks.workunit.client.0.smithi079.stdout:0/713: creat d4/feb x:0 0 0 2024-09-10T09:36:10.025 INFO:tasks.workunit.client.0.smithi079.stdout:9/680: rename d3/c8 to d3/d7/d26/d69/da2/ce2 0 2024-09-10T09:36:10.030 INFO:tasks.workunit.client.0.smithi079.stdout:7/712: rename d4/laa to d4/d6/d3e/ld6 0 2024-09-10T09:36:10.031 INFO:tasks.workunit.client.0.smithi079.stdout:7/713: dread - d4/df/d19/db9/fcc zero size 2024-09-10T09:36:10.033 INFO:tasks.workunit.client.0.smithi079.stdout:9/681: mkdir d3/d7/dc/de/da7/de3 0 2024-09-10T09:36:10.035 INFO:tasks.workunit.client.0.smithi079.stdout:5/740: symlink d2/d3/d27/d32/d44/lf9 0 2024-09-10T09:36:10.035 INFO:tasks.workunit.client.0.smithi079.stdout:5/741: write d2/d3/d27/f69 [2913137,111345] 0 2024-09-10T09:36:10.035 INFO:tasks.workunit.client.0.smithi079.stdout:5/742: write d2/d3/f63 [723600,56234] 0 2024-09-10T09:36:10.035 INFO:tasks.workunit.client.0.smithi079.stdout:5/743: fdatasync d2/d3/d27/d32/d39/f7b 0 2024-09-10T09:36:10.036 INFO:tasks.workunit.client.0.smithi079.stdout:7/714: getdents d4/dc 0 2024-09-10T09:36:10.044 INFO:tasks.workunit.client.0.smithi079.stdout:7/715: dread d4/dc/f8f [0,4194304] 0 2024-09-10T09:36:10.044 INFO:tasks.workunit.client.0.smithi079.stdout:7/716: read - d4/d6/d4f/da7/fcb zero size 2024-09-10T09:36:10.044 INFO:tasks.workunit.client.0.smithi079.stdout:7/717: read - d4/df/d3d/d82/fbe zero size 2024-09-10T09:36:10.044 INFO:tasks.workunit.client.0.smithi079.stdout:7/718: creat d4/df/d6b/d9a/d9c/fd7 x:0 0 0 2024-09-10T09:36:10.047 INFO:tasks.workunit.client.0.smithi079.stdout:7/719: symlink d4/df/d6b/d9a/d9c/ld8 0 2024-09-10T09:36:10.049 INFO:tasks.workunit.client.0.smithi079.stdout:7/720: unlink d4/f7f 0 2024-09-10T09:36:10.049 INFO:tasks.workunit.client.0.smithi079.stdout:7/721: fdatasync d4/d6/d4f/d66/fb0 0 2024-09-10T09:36:10.054 INFO:tasks.workunit.client.0.smithi079.stdout:5/744: dwrite d2/f31 [0,4194304] 0 2024-09-10T09:36:10.068 INFO:tasks.workunit.client.0.smithi079.stdout:6/866: dread d4/d8/dd/d76/d46/d88/d108/fc2 [0,4194304] 0 2024-09-10T09:36:10.070 INFO:tasks.workunit.client.0.smithi079.stdout:6/867: mkdir d4/d8/d74/d101/d11c 0 2024-09-10T09:36:10.070 INFO:tasks.workunit.client.0.smithi079.stdout:6/868: write d4/d8/dd/d76/d46/d88/fb9 [799281,33787] 0 2024-09-10T09:36:10.089 INFO:tasks.workunit.client.0.smithi079.stdout:6/869: write d4/d8/dc/d12/d70/f84 [3963605,88923] 0 2024-09-10T09:36:10.090 INFO:tasks.workunit.client.0.smithi079.stdout:6/870: write d4/d8/dd/d76/d46/d88/fb9 [57301,64327] 0 2024-09-10T09:36:10.091 INFO:tasks.workunit.client.0.smithi079.stdout:6/871: creat d4/d8/d74/d101/f11d x:0 0 0 2024-09-10T09:36:10.092 INFO:tasks.workunit.client.0.smithi079.stdout:8/727: dwrite d11/d2b/d4b/d7e/db2/fbe [0,4194304] 0 2024-09-10T09:36:10.094 INFO:tasks.workunit.client.0.smithi079.stdout:0/714: dwrite d4/fd [0,4194304] 0 2024-09-10T09:36:10.094 INFO:tasks.workunit.client.0.smithi079.stdout:0/715: dread - d4/d1d/d24/d72/fd7 zero size 2024-09-10T09:36:10.094 INFO:tasks.workunit.client.0.smithi079.stdout:0/716: truncate d4/d12/d21/fcf 1703000 0 2024-09-10T09:36:10.094 INFO:tasks.workunit.client.0.smithi079.stdout:7/722: dwrite d4/d6/f16 [0,4194304] 0 2024-09-10T09:36:10.095 INFO:tasks.workunit.client.0.smithi079.stdout:8/728: creat d11/d2b/d4b/d50/d5c/fe9 x:0 0 0 2024-09-10T09:36:10.097 INFO:tasks.workunit.client.0.smithi079.stdout:0/717: rename d4/d12/d1a/d6d/d7b/cc9 to d4/d12/d16/de3/dac/cec 0 2024-09-10T09:36:10.097 INFO:tasks.workunit.client.0.smithi079.stdout:6/872: dread d4/d8/dd/d76/f71 [0,4194304] 0 2024-09-10T09:36:10.097 INFO:tasks.workunit.client.0.smithi079.stdout:5/745: dwrite d2/d3/d5e/d61/d71/fbc [0,4194304] 0 2024-09-10T09:36:10.097 INFO:tasks.workunit.client.0.smithi079.stdout:9/682: dwrite d3/d7/dc/f95 [0,4194304] 0 2024-09-10T09:36:10.097 INFO:tasks.workunit.client.0.smithi079.stdout:0/718: write d4/d12/d15/d69/fa8 [59116,93537] 0 2024-09-10T09:36:10.098 INFO:tasks.workunit.client.0.smithi079.stdout:0/719: fsync d4/fd 0 2024-09-10T09:36:10.098 INFO:tasks.workunit.client.0.smithi079.stdout:7/723: mkdir d4/d6/d38/dd9 0 2024-09-10T09:36:10.099 INFO:tasks.workunit.client.0.smithi079.stdout:8/729: symlink d11/d2b/d4b/d50/d55/db8/lea 0 2024-09-10T09:36:10.099 INFO:tasks.workunit.client.0.smithi079.stdout:8/730: fsync d11/fc1 0 2024-09-10T09:36:10.109 INFO:tasks.workunit.client.0.smithi079.stdout:0/720: creat d4/d12/d21/d3f/d88/fed x:0 0 0 2024-09-10T09:36:10.109 INFO:tasks.workunit.client.0.smithi079.stdout:9/683: write d3/f16 [3562939,126434] 0 2024-09-10T09:36:10.109 INFO:tasks.workunit.client.0.smithi079.stdout:7/724: unlink d4/d6/d3e/db3/fd4 0 2024-09-10T09:36:10.110 INFO:tasks.workunit.client.0.smithi079.stdout:7/725: fdatasync d4/dc/f73 0 2024-09-10T09:36:10.110 INFO:tasks.workunit.client.0.smithi079.stdout:8/731: write d11/d2b/f3f [655521,55794] 0 2024-09-10T09:36:10.110 INFO:tasks.workunit.client.0.smithi079.stdout:8/732: readlink d11/l34 0 2024-09-10T09:36:10.110 INFO:tasks.workunit.client.0.smithi079.stdout:8/733: chown d11/d2b/f3f 10004 1 2024-09-10T09:36:10.110 INFO:tasks.workunit.client.0.smithi079.stdout:8/734: fdatasync d11/d2b/d4b/d50/d55/f78 0 2024-09-10T09:36:10.111 INFO:tasks.workunit.client.0.smithi079.stdout:5/746: mkdir d2/d3/d27/d32/d44/dfa 0 2024-09-10T09:36:10.111 INFO:tasks.workunit.client.0.smithi079.stdout:5/747: creat d2/d3/d27/d32/db6/ffb x:0 0 0 2024-09-10T09:36:10.111 INFO:tasks.workunit.client.0.smithi079.stdout:6/873: dwrite d4/d8/dc/d12/d29/fcc [0,4194304] 0 2024-09-10T09:36:10.112 INFO:tasks.workunit.client.0.smithi079.stdout:9/684: rename d3/d7/d26/d83/dd7 to d3/d7/d26/d69/ddf/de4 0 2024-09-10T09:36:10.113 INFO:tasks.workunit.client.0.smithi079.stdout:0/721: symlink d4/d12/d21/d3f/db3/lee 0 2024-09-10T09:36:10.114 INFO:tasks.workunit.client.0.smithi079.stdout:7/726: unlink d4/df/d3d/f56 0 2024-09-10T09:36:10.116 INFO:tasks.workunit.client.0.smithi079.stdout:8/735: mkdir d11/d3b/deb 0 2024-09-10T09:36:10.118 INFO:tasks.workunit.client.0.smithi079.stdout:5/748: creat d2/d3/d27/d32/d39/dc2/ffc x:0 0 0 2024-09-10T09:36:10.122 INFO:tasks.workunit.client.0.smithi079.stdout:6/874: creat d4/d8/dd/d76/d46/d88/df7/f11e x:0 0 0 2024-09-10T09:36:10.124 INFO:tasks.workunit.client.0.smithi079.stdout:0/722: symlink d4/d12/dc0/ddf/lef 0 2024-09-10T09:36:10.125 INFO:tasks.workunit.client.0.smithi079.stdout:0/723: write d4/f5 [1553036,4293] 0 2024-09-10T09:36:10.125 INFO:tasks.workunit.client.0.smithi079.stdout:9/685: write d3/d7/d26/f4d [3028535,103879] 0 2024-09-10T09:36:10.125 INFO:tasks.workunit.client.0.smithi079.stdout:0/724: chown d4/d12/d15/d6b/daa/fb4 3 1 2024-09-10T09:36:10.125 INFO:tasks.workunit.client.0.smithi079.stdout:8/736: creat d11/d2b/d4b/fec x:0 0 0 2024-09-10T09:36:10.125 INFO:tasks.workunit.client.0.smithi079.stdout:8/737: read d11/d2b/d4b/d50/d9e/dca/fd6 [1445891,93393] 0 2024-09-10T09:36:10.126 INFO:tasks.workunit.client.0.smithi079.stdout:8/738: readlink d11/d3b/l8c 0 2024-09-10T09:36:10.126 INFO:tasks.workunit.client.0.smithi079.stdout:7/727: dread d4/d6/d38/f3f [0,4194304] 0 2024-09-10T09:36:10.126 INFO:tasks.workunit.client.0.smithi079.stdout:7/728: chown d4/d6/f16 416760037 1 2024-09-10T09:36:10.127 INFO:tasks.workunit.client.0.smithi079.stdout:6/875: link d4/d8/da5/cc6 d4/d8/dd/d76/dd5/ddd/c11f 0 2024-09-10T09:36:10.129 INFO:tasks.workunit.client.0.smithi079.stdout:9/686: link d3/d7/dc/de/d17/d12/fc5 d3/d7f/fe5 0 2024-09-10T09:36:10.130 INFO:tasks.workunit.client.0.smithi079.stdout:0/725: symlink d4/d12/lf0 0 2024-09-10T09:36:10.130 INFO:tasks.workunit.client.0.smithi079.stdout:8/739: truncate d11/f1d 3000537 0 2024-09-10T09:36:10.132 INFO:tasks.workunit.client.0.smithi079.stdout:0/726: creat d4/d12/dc0/ddf/ff1 x:0 0 0 2024-09-10T09:36:10.134 INFO:tasks.workunit.client.0.smithi079.stdout:3/784: sync 2024-09-10T09:36:10.138 INFO:tasks.workunit.client.0.smithi079.stdout:3/785: truncate d4/da/d17/d2d/f76 2174455 0 2024-09-10T09:36:10.138 INFO:tasks.workunit.client.0.smithi079.stdout:6/876: dread d4/d8/dc/d12/d29/f47 [0,4194304] 0 2024-09-10T09:36:10.141 INFO:tasks.workunit.client.0.smithi079.stdout:3/786: creat d4/da/d18/db5/ff3 x:0 0 0 2024-09-10T09:36:10.145 INFO:tasks.workunit.client.0.smithi079.stdout:3/787: mknod d4/da/d17/d2d/d43/d4c/cf4 0 2024-09-10T09:36:10.149 INFO:tasks.workunit.client.0.smithi079.stdout:7/729: dwrite d4/d6/d38/f63 [0,4194304] 0 2024-09-10T09:36:10.150 INFO:tasks.workunit.client.0.smithi079.stdout:3/788: dread d4/da/d17/ddf/fe6 [0,4194304] 0 2024-09-10T09:36:10.150 INFO:tasks.workunit.client.0.smithi079.stdout:3/789: readlink d4/da/d17/d2d/d43/d49/l66 0 2024-09-10T09:36:10.150 INFO:tasks.workunit.client.0.smithi079.stdout:3/790: fsync d4/da/d18/f97 0 2024-09-10T09:36:10.151 INFO:tasks.workunit.client.0.smithi079.stdout:3/791: write d4/da/d17/d9b/fc2 [5202,83392] 0 2024-09-10T09:36:10.153 INFO:tasks.workunit.client.0.smithi079.stdout:8/740: write d11/d2b/d4b/f93 [1300870,53936] 0 2024-09-10T09:36:10.156 INFO:tasks.workunit.client.0.smithi079.stdout:0/727: dwrite d4/d12/d1a/d6d/d84/f9e [0,4194304] 0 2024-09-10T09:36:10.156 INFO:tasks.workunit.client.0.smithi079.stdout:0/728: creat d4/d1d/d24/ff2 x:0 0 0 2024-09-10T09:36:10.156 INFO:tasks.workunit.client.0.smithi079.stdout:0/729: chown d4/d12/d8b/dca/d32/dbd/fd8 320 1 2024-09-10T09:36:10.156 INFO:tasks.workunit.client.0.smithi079.stdout:8/741: unlink d11/d48/f66 0 2024-09-10T09:36:10.163 INFO:tasks.workunit.client.0.smithi079.stdout:0/730: getdents d4/d12/d21/d3f/db3 0 2024-09-10T09:36:10.163 INFO:tasks.workunit.client.0.smithi079.stdout:0/731: truncate d4/d12/d8b/dca/d32/dbd/fd8 448911 0 2024-09-10T09:36:10.163 INFO:tasks.workunit.client.0.smithi079.stdout:0/732: truncate d4/d12/d21/fcf 2550114 0 2024-09-10T09:36:10.166 INFO:tasks.workunit.client.0.smithi079.stdout:0/733: link d4/d12/d21/d3f/d80/fc4 d4/d12/d1a/d6d/d84/ff3 0 2024-09-10T09:36:10.166 INFO:tasks.workunit.client.0.smithi079.stdout:0/734: dread - d4/fd5 zero size 2024-09-10T09:36:10.166 INFO:tasks.workunit.client.0.smithi079.stdout:0/735: write d4/d12/dc0/ddf/ff1 [719354,21614] 0 2024-09-10T09:36:10.167 INFO:tasks.workunit.client.0.smithi079.stdout:0/736: fdatasync d4/d1d/d24/ff2 0 2024-09-10T09:36:10.167 INFO:tasks.workunit.client.0.smithi079.stdout:0/737: write d4/d12/d8b/dca/d32/fe7 [64657,28323] 0 2024-09-10T09:36:10.167 INFO:tasks.workunit.client.0.smithi079.stdout:0/738: read - d4/d12/d16/d53/d6a/fae zero size 2024-09-10T09:36:10.167 INFO:tasks.workunit.client.0.smithi079.stdout:0/739: getdents d4/d12/d16/de3 0 2024-09-10T09:36:10.168 INFO:tasks.workunit.client.0.smithi079.stdout:0/740: truncate d4/d12/d21/d3f/f66 535396 0 2024-09-10T09:36:10.168 INFO:tasks.workunit.client.0.smithi079.stdout:0/741: unlink l3 0 2024-09-10T09:36:10.176 INFO:tasks.workunit.client.0.smithi079.stdout:6/877: dwrite d4/d8/f83 [0,4194304] 0 2024-09-10T09:36:10.176 INFO:tasks.workunit.client.0.smithi079.stdout:3/792: dwrite d4/da/d17/d9b/db1/fc0 [0,4194304] 0 2024-09-10T09:36:10.179 INFO:tasks.workunit.client.0.smithi079.stdout:6/878: unlink d4/l57 0 2024-09-10T09:36:10.179 INFO:tasks.workunit.client.0.smithi079.stdout:6/879: fdatasync d4/d8/dd/d76/d46/d88/d108/fc5 0 2024-09-10T09:36:10.179 INFO:tasks.workunit.client.0.smithi079.stdout:6/880: chown d4/d8/dc/d93/d4b/c6d 1372658 1 2024-09-10T09:36:10.180 INFO:tasks.workunit.client.0.smithi079.stdout:3/793: rmdir d4/da/d17/d2d/d43/de7 39 2024-09-10T09:36:10.181 INFO:tasks.workunit.client.0.smithi079.stdout:6/881: symlink d4/d8/dd/d76/l120 0 2024-09-10T09:36:10.182 INFO:tasks.workunit.client.0.smithi079.stdout:3/794: getdents d4/da/d67/db8 0 2024-09-10T09:36:10.182 INFO:tasks.workunit.client.0.smithi079.stdout:3/795: write d4/da/d17/d72/f75 [4229910,20003] 0 2024-09-10T09:36:10.184 INFO:tasks.workunit.client.0.smithi079.stdout:1/878: sync 2024-09-10T09:36:10.184 INFO:tasks.workunit.client.0.smithi079.stdout:1/879: write d5/df/d2e/d10c/d111/f94 [763780,32845] 0 2024-09-10T09:36:10.184 INFO:tasks.workunit.client.0.smithi079.stdout:1/880: getdents d5/d24/d36/d3a/d85/db1/d11a 0 2024-09-10T09:36:10.184 INFO:tasks.workunit.client.0.smithi079.stdout:4/746: sync 2024-09-10T09:36:10.185 INFO:tasks.workunit.client.0.smithi079.stdout:0/742: dwrite d4/d12/d16/d53/fa5 [0,4194304] 0 2024-09-10T09:36:10.185 INFO:tasks.workunit.client.0.smithi079.stdout:0/743: write d4/d1d/fad [783465,106268] 0 2024-09-10T09:36:10.191 INFO:tasks.workunit.client.0.smithi079.stdout:3/796: link d4/da/d17/d2d/d43/d49/lef d4/da/d17/d2d/d43/lf5 0 2024-09-10T09:36:10.192 INFO:tasks.workunit.client.0.smithi079.stdout:1/881: truncate d5/d24/d36/d79/f9f 156946 0 2024-09-10T09:36:10.192 INFO:tasks.workunit.client.0.smithi079.stdout:1/882: chown d5/d4f/d95 510 1 2024-09-10T09:36:10.195 INFO:tasks.workunit.client.0.smithi079.stdout:0/744: mknod d4/d12/d21/d3f/db3/dce/cf4 0 2024-09-10T09:36:10.195 INFO:tasks.workunit.client.0.smithi079.stdout:0/745: readlink d4/d12/d16/ldd 0 2024-09-10T09:36:10.195 INFO:tasks.workunit.client.0.smithi079.stdout:0/746: truncate d4/d12/d8b/dca/d32/fe7 428441 0 2024-09-10T09:36:10.201 INFO:tasks.workunit.client.0.smithi079.stdout:4/747: dwrite d1/f2a [4194304,4194304] 0 2024-09-10T09:36:10.203 INFO:tasks.workunit.client.0.smithi079.stdout:1/883: symlink d5/d24/d36/d3a/d85/db1/l12a 0 2024-09-10T09:36:10.203 INFO:tasks.workunit.client.0.smithi079.stdout:1/884: chown d5/df/d11/c27 231434 1 2024-09-10T09:36:10.203 INFO:tasks.workunit.client.0.smithi079.stdout:0/747: symlink d4/d12/d16/d53/d6a/lf5 0 2024-09-10T09:36:10.204 INFO:tasks.workunit.client.0.smithi079.stdout:0/748: creat d4/d12/d15/d69/ff6 x:0 0 0 2024-09-10T09:36:10.207 INFO:tasks.workunit.client.0.smithi079.stdout:1/885: rename d5/d24/d36/d53/fb0 to d5/d24/d36/d3a/dfc/f12b 0 2024-09-10T09:36:10.209 INFO:tasks.workunit.client.0.smithi079.stdout:0/749: mkdir d4/d12/d15/df7 0 2024-09-10T09:36:10.210 INFO:tasks.workunit.client.0.smithi079.stdout:3/797: dwrite d4/da/d17/d54/f41 [0,4194304] 0 2024-09-10T09:36:10.210 INFO:tasks.workunit.client.0.smithi079.stdout:3/798: fsync d4/da/d17/d9b/fa3 0 2024-09-10T09:36:10.211 INFO:tasks.workunit.client.0.smithi079.stdout:1/886: mknod d5/df/dc6/c12c 0 2024-09-10T09:36:10.211 INFO:tasks.workunit.client.0.smithi079.stdout:0/750: symlink d4/lf8 0 2024-09-10T09:36:10.211 INFO:tasks.workunit.client.0.smithi079.stdout:0/751: dread - d4/d12/d1a/d6d/d84/ff3 zero size 2024-09-10T09:36:10.216 INFO:tasks.workunit.client.0.smithi079.stdout:1/887: unlink d5/d24/d36/d3a/d85/c124 0 2024-09-10T09:36:10.216 INFO:tasks.workunit.client.0.smithi079.stdout:1/888: fdatasync d5/d40/dac/db2/ffd 0 2024-09-10T09:36:10.227 INFO:tasks.workunit.client.0.smithi079.stdout:3/799: write d4/da/d17/f37 [1461656,62412] 0 2024-09-10T09:36:10.227 INFO:tasks.workunit.client.0.smithi079.stdout:3/800: chown d4/da/d17/d38/d42/c89 788 1 2024-09-10T09:36:10.243 INFO:tasks.workunit.client.0.smithi079.stdout:3/801: write d4/da/d17/d9b/db1/fc0 [95997,130182] 0 2024-09-10T09:36:10.243 INFO:tasks.workunit.client.0.smithi079.stdout:3/802: readlink d4/da/ld2 0 2024-09-10T09:36:10.244 INFO:tasks.workunit.client.0.smithi079.stdout:1/889: dwrite d5/fe [0,4194304] 0 2024-09-10T09:36:10.244 INFO:tasks.workunit.client.0.smithi079.stdout:0/752: dwrite d4/d12/d16/d53/fa5 [0,4194304] 0 2024-09-10T09:36:10.244 INFO:tasks.workunit.client.0.smithi079.stdout:1/890: write d5/df/dd0/da0/f10d [4904280,62330] 0 2024-09-10T09:36:10.245 INFO:tasks.workunit.client.0.smithi079.stdout:1/891: chown d5/d24/d36/df3/l103 4954384 1 2024-09-10T09:36:10.245 INFO:tasks.workunit.client.0.smithi079.stdout:3/803: mknod d4/da/d17/d2d/cf6 0 2024-09-10T09:36:10.246 INFO:tasks.workunit.client.0.smithi079.stdout:0/753: dread d4/d12/d1a/f82 [0,4194304] 0 2024-09-10T09:36:10.249 INFO:tasks.workunit.client.0.smithi079.stdout:1/892: rename d5/df/d2e/f39 to d5/d24/d36/d3a/d85/db1/d11a/d117/f12d 0 2024-09-10T09:36:10.249 INFO:tasks.workunit.client.0.smithi079.stdout:1/893: write d5/df/dd0/f72 [2851543,94179] 0 2024-09-10T09:36:10.249 INFO:tasks.workunit.client.0.smithi079.stdout:0/754: mknod d4/d12/d16/de3/dcd/cf9 0 2024-09-10T09:36:10.249 INFO:tasks.workunit.client.0.smithi079.stdout:0/755: stat d4/d12/dde 0 2024-09-10T09:36:10.250 INFO:tasks.workunit.client.0.smithi079.stdout:0/756: chown d4/d12/d21/d3f/db3/db5 1236246 1 2024-09-10T09:36:10.252 INFO:tasks.workunit.client.0.smithi079.stdout:3/804: dread d4/da/f6c [0,4194304] 0 2024-09-10T09:36:10.252 INFO:tasks.workunit.client.0.smithi079.stdout:3/805: fdatasync d4/da/d8a/fca 0 2024-09-10T09:36:10.252 INFO:tasks.workunit.client.0.smithi079.stdout:3/806: read d4/f13 [2510506,46473] 0 2024-09-10T09:36:10.253 INFO:tasks.workunit.client.0.smithi079.stdout:3/807: creat d4/da/d17/d72/ff7 x:0 0 0 2024-09-10T09:36:10.254 INFO:tasks.workunit.client.0.smithi079.stdout:3/808: write d4/da/d17/fa4 [908925,31627] 0 2024-09-10T09:36:10.256 INFO:tasks.workunit.client.0.smithi079.stdout:0/757: dread d4/fd [0,4194304] 0 2024-09-10T09:36:10.256 INFO:tasks.workunit.client.0.smithi079.stdout:0/758: stat d4/d12/d16/d53/f64 0 2024-09-10T09:36:10.258 INFO:tasks.workunit.client.0.smithi079.stdout:0/759: rmdir d4/d12/d16/de3/dcd 39 2024-09-10T09:36:10.259 INFO:tasks.workunit.client.0.smithi079.stdout:0/760: symlink d4/d12/d15/d69/lfa 0 2024-09-10T09:36:10.259 INFO:tasks.workunit.client.0.smithi079.stdout:0/761: write d4/f11 [3839215,55758] 0 2024-09-10T09:36:10.260 INFO:tasks.workunit.client.0.smithi079.stdout:0/762: readlink d4/d12/d15/d69/lfa 0 2024-09-10T09:36:10.261 INFO:tasks.workunit.client.0.smithi079.stdout:1/894: dread d5/d24/d36/d53/f61 [0,4194304] 0 2024-09-10T09:36:10.262 INFO:tasks.workunit.client.0.smithi079.stdout:1/895: mknod d5/d40/dd9/c12e 0 2024-09-10T09:36:10.262 INFO:tasks.workunit.client.0.smithi079.stdout:3/809: write d4/da/d17/d38/d42/f84 [2415768,111402] 0 2024-09-10T09:36:10.264 INFO:tasks.workunit.client.0.smithi079.stdout:1/896: creat d5/d4f/d8a/f12f x:0 0 0 2024-09-10T09:36:10.265 INFO:tasks.workunit.client.0.smithi079.stdout:3/810: rmdir d4/da/d17/d38 39 2024-09-10T09:36:10.267 INFO:tasks.workunit.client.0.smithi079.stdout:1/897: link d5/df/dc6/fca d5/d24/d36/d53/db3/de3/f130 0 2024-09-10T09:36:10.268 INFO:tasks.workunit.client.0.smithi079.stdout:1/898: creat d5/df/dd0/f131 x:0 0 0 2024-09-10T09:36:10.276 INFO:tasks.workunit.client.0.smithi079.stdout:2/660: sync 2024-09-10T09:36:10.284 INFO:tasks.workunit.client.0.smithi079.stdout:1/899: dread d5/d24/d36/d53/db3/de3/f56 [0,4194304] 0 2024-09-10T09:36:10.284 INFO:tasks.workunit.client.0.smithi079.stdout:1/900: chown l3 64717 1 2024-09-10T09:36:10.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/763: dwrite f0 [0,4194304] 0 2024-09-10T09:36:10.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/764: truncate d4/d1d/d24/ff2 324533 0 2024-09-10T09:36:10.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/765: chown d4/d12/d21/d3f/c42 203 1 2024-09-10T09:36:10.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/766: write d4/feb [182277,64026] 0 2024-09-10T09:36:10.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/767: fdatasync d4/d12/f14 0 2024-09-10T09:36:10.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/768: dread - d4/d12/d8b/dca/f74 zero size 2024-09-10T09:36:10.287 INFO:tasks.workunit.client.0.smithi079.stdout:1/901: dread d5/df/dd0/da0/fc7 [0,4194304] 0 2024-09-10T09:36:10.289 INFO:tasks.workunit.client.0.smithi079.stdout:1/902: rename d5/d11b/lf2 to d5/d24/d36/d53/db3/l132 0 2024-09-10T09:36:10.289 INFO:tasks.workunit.client.0.smithi079.stdout:1/903: readlink d5/df/d11/l1f 0 2024-09-10T09:36:10.289 INFO:tasks.workunit.client.0.smithi079.stdout:1/904: chown d5/d11b/dd1 447466 1 2024-09-10T09:36:10.289 INFO:tasks.workunit.client.0.smithi079.stdout:1/905: chown d5/df/d11/l30 58664 1 2024-09-10T09:36:10.298 INFO:tasks.workunit.client.0.smithi079.stdout:3/811: dwrite d4/f2a [0,4194304] 0 2024-09-10T09:36:10.299 INFO:tasks.workunit.client.0.smithi079.stdout:2/661: dwrite d4/f23 [4194304,4194304] 0 2024-09-10T09:36:10.303 INFO:tasks.workunit.client.0.smithi079.stdout:2/662: mknod d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/cd8 0 2024-09-10T09:36:10.304 INFO:tasks.workunit.client.0.smithi079.stdout:0/769: write d4/d12/f14 [120864,75815] 0 2024-09-10T09:36:10.304 INFO:tasks.workunit.client.0.smithi079.stdout:2/663: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/fd9 x:0 0 0 2024-09-10T09:36:10.304 INFO:tasks.workunit.client.0.smithi079.stdout:0/770: write d4/d12/d15/d69/fa8 [383274,77430] 0 2024-09-10T09:36:10.305 INFO:tasks.workunit.client.0.smithi079.stdout:2/664: read - d4/d5d/fa3 zero size 2024-09-10T09:36:10.305 INFO:tasks.workunit.client.0.smithi079.stdout:0/771: symlink d4/lfb 0 2024-09-10T09:36:10.308 INFO:tasks.workunit.client.0.smithi079.stdout:1/906: dwrite d5/d9e/dc9/fe7 [0,4194304] 0 2024-09-10T09:36:10.309 INFO:tasks.workunit.client.0.smithi079.stdout:1/907: chown d5/df/dd0/da0/d6a/c118 8534379 1 2024-09-10T09:36:10.309 INFO:tasks.workunit.client.0.smithi079.stdout:1/908: dread - d5/d4f/d95/f121 zero size 2024-09-10T09:36:10.309 INFO:tasks.workunit.client.0.smithi079.stdout:1/909: chown d5/d9e 36093 1 2024-09-10T09:36:10.309 INFO:tasks.workunit.client.0.smithi079.stdout:2/665: rename d4/d5d/fac to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fda 0 2024-09-10T09:36:10.311 INFO:tasks.workunit.client.0.smithi079.stdout:0/772: creat d4/d12/d1a/d6d/ffc x:0 0 0 2024-09-10T09:36:10.313 INFO:tasks.workunit.client.0.smithi079.stdout:9/687: sync 2024-09-10T09:36:10.314 INFO:tasks.workunit.client.0.smithi079.stdout:1/910: mknod d5/d24/d36/d3a/d85/db1/d11a/d115/c133 0 2024-09-10T09:36:10.314 INFO:tasks.workunit.client.0.smithi079.stdout:5/749: sync 2024-09-10T09:36:10.314 INFO:tasks.workunit.client.0.smithi079.stdout:5/750: fsync d2/f37 0 2024-09-10T09:36:10.314 INFO:tasks.workunit.client.0.smithi079.stdout:5/751: fdatasync d2/d3/d27/f2c 0 2024-09-10T09:36:10.315 INFO:tasks.workunit.client.0.smithi079.stdout:2/666: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/ldb 0 2024-09-10T09:36:10.316 INFO:tasks.workunit.client.0.smithi079.stdout:1/911: read d5/df/dd0/f7d [25791,32266] 0 2024-09-10T09:36:10.316 INFO:tasks.workunit.client.0.smithi079.stdout:0/773: rename d4/d12/d1a/d6d/cb7 to d4/d12/d15/d6b/cfd 0 2024-09-10T09:36:10.317 INFO:tasks.workunit.client.0.smithi079.stdout:2/667: truncate d4/dc/f6d 523992 0 2024-09-10T09:36:10.317 INFO:tasks.workunit.client.0.smithi079.stdout:2/668: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/fdc x:0 0 0 2024-09-10T09:36:10.318 INFO:tasks.workunit.client.0.smithi079.stdout:1/912: unlink d5/df/d11/f2d 0 2024-09-10T09:36:10.318 INFO:tasks.workunit.client.0.smithi079.stdout:0/774: rename d4/lfb to d4/d12/d16/d53/d6a/lfe 0 2024-09-10T09:36:10.320 INFO:tasks.workunit.client.0.smithi079.stdout:2/669: creat d4/dc/d1c/d86/d1b/d38/d39/fdd x:0 0 0 2024-09-10T09:36:10.320 INFO:tasks.workunit.client.0.smithi079.stdout:2/670: chown d4/d8f/lab 12466289 1 2024-09-10T09:36:10.321 INFO:tasks.workunit.client.0.smithi079.stdout:1/913: link d5/d24/d36/d79/f11c d5/d40/d46/de8/f134 0 2024-09-10T09:36:10.322 INFO:tasks.workunit.client.0.smithi079.stdout:0/775: truncate d4/d12/d21/f43 3231168 0 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:2/671: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde 0 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:2/672: readlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/lb1 0 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:2/673: dread - d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fd2 zero size 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:2/674: creat d4/d5d/fdf x:0 0 0 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:2/675: dread - d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fd2 zero size 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:5/752: dread d2/d3/d27/d32/de3/f6b [0,4194304] 0 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:5/753: read - d2/d3/d27/d32/d39/fe8 zero size 2024-09-10T09:36:10.325 INFO:tasks.workunit.client.0.smithi079.stdout:9/688: write d3/d7/dc/de/f46 [7801404,79836] 0 2024-09-10T09:36:10.326 INFO:tasks.workunit.client.0.smithi079.stdout:0/776: mknod d4/d12/d8b/dca/d32/dbd/cff 0 2024-09-10T09:36:10.326 INFO:tasks.workunit.client.0.smithi079.stdout:0/777: creat d4/d12/d16/d53/f100 x:0 0 0 2024-09-10T09:36:10.327 INFO:tasks.workunit.client.0.smithi079.stdout:9/689: symlink d3/d7/dc/de/d17/dcf/le6 0 2024-09-10T09:36:10.327 INFO:tasks.workunit.client.0.smithi079.stdout:9/690: chown d3/d7/dc/d7a/da9/dd4 17 1 2024-09-10T09:36:10.329 INFO:tasks.workunit.client.0.smithi079.stdout:3/812: dwrite d4/da/d56/dc5/fd8 [0,4194304] 0 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:3/813: symlink d4/da/d17/ddf/lf8 0 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:3/814: write d4/da/fa5 [1716235,93786] 0 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:1/914: dread d5/d24/d36/d3a/fb5 [4194304,4194304] 0 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:6/882: sync 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:4/748: sync 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:7/730: sync 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:8/742: sync 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:6/883: stat d4/d8/dc/d93/d4b/ce2 0 2024-09-10T09:36:10.334 INFO:tasks.workunit.client.0.smithi079.stdout:4/749: chown d1/da/d16/d88/fd1 2358476 1 2024-09-10T09:36:10.335 INFO:tasks.workunit.client.0.smithi079.stdout:6/884: creat d4/d8/dc/d12/d9d/def/f121 x:0 0 0 2024-09-10T09:36:10.335 INFO:tasks.workunit.client.0.smithi079.stdout:6/885: write d4/d8/fae [3497771,97770] 0 2024-09-10T09:36:10.335 INFO:tasks.workunit.client.0.smithi079.stdout:6/886: fdatasync d4/d8/dd/d76/f8f 0 2024-09-10T09:36:10.335 INFO:tasks.workunit.client.0.smithi079.stdout:6/887: fsync d4/d8/dd/d76/f8f 0 2024-09-10T09:36:10.344 INFO:tasks.workunit.client.0.smithi079.stdout:3/815: mkdir d4/da/d17/d38/d42/df9 0 2024-09-10T09:36:10.344 INFO:tasks.workunit.client.0.smithi079.stdout:3/816: stat d4/f73 0 2024-09-10T09:36:10.348 INFO:tasks.workunit.client.0.smithi079.stdout:1/915: symlink d5/d40/l135 0 2024-09-10T09:36:10.349 INFO:tasks.workunit.client.0.smithi079.stdout:1/916: readlink d5/df/d2e/la6 0 2024-09-10T09:36:10.349 INFO:tasks.workunit.client.0.smithi079.stdout:1/917: fdatasync d5/d24/d36/d53/db3/de3/f116 0 2024-09-10T09:36:10.349 INFO:tasks.workunit.client.0.smithi079.stdout:1/918: write d5/d9e/fc0 [462338,42122] 0 2024-09-10T09:36:10.351 INFO:tasks.workunit.client.0.smithi079.stdout:8/743: write d11/d2b/fa1 [1352729,104659] 0 2024-09-10T09:36:10.351 INFO:tasks.workunit.client.0.smithi079.stdout:8/744: dread - d11/d2b/d4b/d50/d55/db8/fcf zero size 2024-09-10T09:36:10.351 INFO:tasks.workunit.client.0.smithi079.stdout:8/745: read d11/d2b/d4b/f56 [484031,93918] 0 2024-09-10T09:36:10.354 INFO:tasks.workunit.client.0.smithi079.stdout:4/750: mknod d1/cf0 0 2024-09-10T09:36:10.354 INFO:tasks.workunit.client.0.smithi079.stdout:4/751: chown d1/da/d28/d95/c7e 5516 1 2024-09-10T09:36:10.360 INFO:tasks.workunit.client.0.smithi079.stdout:6/888: link d4/d8/dd/l10d d4/d8/dd/d76/d46/d88/d108/d10b/l122 0 2024-09-10T09:36:10.360 INFO:tasks.workunit.client.0.smithi079.stdout:6/889: chown d4/d8/da5 3720583 1 2024-09-10T09:36:10.360 INFO:tasks.workunit.client.0.smithi079.stdout:6/890: chown d4/d8/dc/d12/d29/c7c 199762 1 2024-09-10T09:36:10.361 INFO:tasks.workunit.client.0.smithi079.stdout:9/691: write d3/d7/f2a [243401,56827] 0 2024-09-10T09:36:10.361 INFO:tasks.workunit.client.0.smithi079.stdout:9/692: read - d3/d7/dc/d62/f75 zero size 2024-09-10T09:36:10.366 INFO:tasks.workunit.client.0.smithi079.stdout:0/778: dwrite d4/d12/d16/de3/fb2 [0,4194304] 0 2024-09-10T09:36:10.366 INFO:tasks.workunit.client.0.smithi079.stdout:0/779: dread - d4/d12/d39/fa0 zero size 2024-09-10T09:36:10.366 INFO:tasks.workunit.client.0.smithi079.stdout:8/746: rename d11/d2b/f39 to d11/d2b/d4b/d50/d9e/fed 0 2024-09-10T09:36:10.366 INFO:tasks.workunit.client.0.smithi079.stdout:8/747: fdatasync d11/d48/fd5 0 2024-09-10T09:36:10.367 INFO:tasks.workunit.client.0.smithi079.stdout:4/752: mkdir d1/d9b/db4/df1 0 2024-09-10T09:36:10.367 INFO:tasks.workunit.client.0.smithi079.stdout:4/753: truncate d1/f2e 7649822 0 2024-09-10T09:36:10.368 INFO:tasks.workunit.client.0.smithi079.stdout:5/754: dwrite d2/d3/d27/faa [4194304,4194304] 0 2024-09-10T09:36:10.369 INFO:tasks.workunit.client.0.smithi079.stdout:7/731: dwrite d4/df/d3d/d82/fbe [0,4194304] 0 2024-09-10T09:36:10.369 INFO:tasks.workunit.client.0.smithi079.stdout:9/693: truncate d3/d7/d26/f80 628995 0 2024-09-10T09:36:10.369 INFO:tasks.workunit.client.0.smithi079.stdout:9/694: write d3/d7/dc/de/db7/fbd [235780,53037] 0 2024-09-10T09:36:10.370 INFO:tasks.workunit.client.0.smithi079.stdout:2/676: dwrite d4/d5d/fa1 [0,4194304] 0 2024-09-10T09:36:10.372 INFO:tasks.workunit.client.0.smithi079.stdout:0/780: symlink d4/l101 0 2024-09-10T09:36:10.372 INFO:tasks.workunit.client.0.smithi079.stdout:8/748: rmdir d11/dd8 39 2024-09-10T09:36:10.373 INFO:tasks.workunit.client.0.smithi079.stdout:4/754: getdents d1/da/d28/d47/da1 0 2024-09-10T09:36:10.373 INFO:tasks.workunit.client.0.smithi079.stdout:4/755: write d1/da/d16/d88/fe1 [963826,19327] 0 2024-09-10T09:36:10.373 INFO:tasks.workunit.client.0.smithi079.stdout:4/756: stat d1/da/d3b/d5a 0 2024-09-10T09:36:10.374 INFO:tasks.workunit.client.0.smithi079.stdout:8/749: write d11/d2b/d4b/d74/da2/fc0 [802616,120326] 0 2024-09-10T09:36:10.374 INFO:tasks.workunit.client.0.smithi079.stdout:5/755: rmdir d2/d3/def 0 2024-09-10T09:36:10.374 INFO:tasks.workunit.client.0.smithi079.stdout:5/756: chown d2/d3/f84 7312 1 2024-09-10T09:36:10.375 INFO:tasks.workunit.client.0.smithi079.stdout:6/891: getdents d4/d8/dd/d76/d46/df0 0 2024-09-10T09:36:10.377 INFO:tasks.workunit.client.0.smithi079.stdout:7/732: getdents d4/d6/d38 0 2024-09-10T09:36:10.377 INFO:tasks.workunit.client.0.smithi079.stdout:7/733: creat d4/d6/d4f/d70/fda x:0 0 0 2024-09-10T09:36:10.378 INFO:tasks.workunit.client.0.smithi079.stdout:9/695: getdents d3/d7/d26 0 2024-09-10T09:36:10.379 INFO:tasks.workunit.client.0.smithi079.stdout:4/757: mknod d1/da/d16/d57/cf2 0 2024-09-10T09:36:10.380 INFO:tasks.workunit.client.0.smithi079.stdout:2/677: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/fa9 [0,4194304] 0 2024-09-10T09:36:10.380 INFO:tasks.workunit.client.0.smithi079.stdout:8/750: fsync d11/d2b/f4e 0 2024-09-10T09:36:10.380 INFO:tasks.workunit.client.0.smithi079.stdout:8/751: chown d11/d2b/d4b/d7e/db2/db7 54859 1 2024-09-10T09:36:10.381 INFO:tasks.workunit.client.0.smithi079.stdout:5/757: mkdir d2/d3/d27/dde/dfd 0 2024-09-10T09:36:10.381 INFO:tasks.workunit.client.0.smithi079.stdout:5/758: truncate d2/d3/d27/d32/f9d 751646 0 2024-09-10T09:36:10.383 INFO:tasks.workunit.client.0.smithi079.stdout:6/892: link d4/d8/dc/d12/faf d4/d8/d74/f123 0 2024-09-10T09:36:10.383 INFO:tasks.workunit.client.0.smithi079.stdout:6/893: chown d4/d8/dc/d93 181280723 1 2024-09-10T09:36:10.383 INFO:tasks.workunit.client.0.smithi079.stdout:6/894: dread - d4/d8/dd/d76/fdb zero size 2024-09-10T09:36:10.383 INFO:tasks.workunit.client.0.smithi079.stdout:6/895: write d4/d8/dc/d1c/f3f [984980,116995] 0 2024-09-10T09:36:10.383 INFO:tasks.workunit.client.0.smithi079.stdout:6/896: fsync d4/d8/dd/d41/d51/dc7/fed 0 2024-09-10T09:36:10.384 INFO:tasks.workunit.client.0.smithi079.stdout:7/734: mkdir d4/d6/d4f/d70/ddb 0 2024-09-10T09:36:10.385 INFO:tasks.workunit.client.0.smithi079.stdout:0/781: rmdir d4/d47 39 2024-09-10T09:36:10.385 INFO:tasks.workunit.client.0.smithi079.stdout:3/817: dwrite d4/da/d17/d2d/fa1 [0,4194304] 0 2024-09-10T09:36:10.387 INFO:tasks.workunit.client.0.smithi079.stdout:4/758: getdents d1/da/d28/d47/da1/d73 0 2024-09-10T09:36:10.387 INFO:tasks.workunit.client.0.smithi079.stdout:4/759: chown d1/da/d28/d47/l70 417 1 2024-09-10T09:36:10.387 INFO:tasks.workunit.client.0.smithi079.stdout:4/760: chown d1/da/fb 21402856 1 2024-09-10T09:36:10.388 INFO:tasks.workunit.client.0.smithi079.stdout:4/761: write d1/da/d16/f27 [2780675,19260] 0 2024-09-10T09:36:10.388 INFO:tasks.workunit.client.0.smithi079.stdout:4/762: write d1/da/d16/f24 [1191237,44530] 0 2024-09-10T09:36:10.389 INFO:tasks.workunit.client.0.smithi079.stdout:2/678: truncate d4/d5d/f9a 3479065 0 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/679: chown d4/dc/d1c/d86/d1b/c32 84022 1 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/680: write d4/dc/fcf [605951,51644] 0 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/681: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/f27 0 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/682: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/d61/fae 0 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/683: chown d4/dc/d1c/d86/d1b/d38/d39/d99/f1f 863243307 1 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/684: chown d4/f6 41009541 1 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/685: truncate d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f76 499960 0 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:2/686: dread - d4/dc/fc7 zero size 2024-09-10T09:36:10.390 INFO:tasks.workunit.client.0.smithi079.stdout:7/735: rename d4/d6/d38/fa2 to d4/d6/d4f/d70/ddb/fdc 0 2024-09-10T09:36:10.391 INFO:tasks.workunit.client.0.smithi079.stdout:7/736: creat d4/df/d3d/d82/fdd x:0 0 0 2024-09-10T09:36:10.391 INFO:tasks.workunit.client.0.smithi079.stdout:7/737: dread - d4/df/d3d/d82/f6f zero size 2024-09-10T09:36:10.391 INFO:tasks.workunit.client.0.smithi079.stdout:0/782: mkdir d4/d12/d16/de3/d102 0 2024-09-10T09:36:10.391 INFO:tasks.workunit.client.0.smithi079.stdout:8/752: dread d11/d2b/d4b/d50/d55/fa6 [0,4194304] 0 2024-09-10T09:36:10.392 INFO:tasks.workunit.client.0.smithi079.stdout:8/753: write d11/dbd/ddc/fdf [603171,69561] 0 2024-09-10T09:36:10.392 INFO:tasks.workunit.client.0.smithi079.stdout:1/919: dwrite d5/d24/d36/d3a/d100/f10b [0,4194304] 0 2024-09-10T09:36:10.392 INFO:tasks.workunit.client.0.smithi079.stdout:1/920: chown d5/df/f1c 615 1 2024-09-10T09:36:10.394 INFO:tasks.workunit.client.0.smithi079.stdout:3/818: mknod d4/da/d8a/dd7/cfa 0 2024-09-10T09:36:10.394 INFO:tasks.workunit.client.0.smithi079.stdout:2/687: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/le0 0 2024-09-10T09:36:10.397 INFO:tasks.workunit.client.0.smithi079.stdout:7/738: mkdir d4/df/d6b/d9a/dde 0 2024-09-10T09:36:10.398 INFO:tasks.workunit.client.0.smithi079.stdout:0/783: link d4/d12/d8b/fe5 d4/d12/d16/de3/dac/f103 0 2024-09-10T09:36:10.398 INFO:tasks.workunit.client.0.smithi079.stdout:9/696: read d3/d7/dc/f41 [1983815,107311] 0 2024-09-10T09:36:10.403 INFO:tasks.workunit.client.0.smithi079.stdout:1/921: truncate d5/df/dd0/da0/fc7 674386 0 2024-09-10T09:36:10.406 INFO:tasks.workunit.client.0.smithi079.stdout:2/688: getdents d4/dc/d1c/d86/d1b 0 2024-09-10T09:36:10.406 INFO:tasks.workunit.client.0.smithi079.stdout:2/689: stat d4/dc/d1c/d86/d1b/d38/d39/d99/d61 0 2024-09-10T09:36:10.408 INFO:tasks.workunit.client.0.smithi079.stdout:0/784: creat d4/d12/d21/d3f/f104 x:0 0 0 2024-09-10T09:36:10.412 INFO:tasks.workunit.client.0.smithi079.stdout:0/785: dread d4/d12/d8b/dca/d32/f9a [0,4194304] 0 2024-09-10T09:36:10.413 INFO:tasks.workunit.client.0.smithi079.stdout:8/754: getdents d11/dbd 0 2024-09-10T09:36:10.415 INFO:tasks.workunit.client.0.smithi079.stdout:1/922: mkdir d5/df/dc6/de6/d136 0 2024-09-10T09:36:10.415 INFO:tasks.workunit.client.0.smithi079.stdout:5/759: dwrite d2/fd5 [0,4194304] 0 2024-09-10T09:36:10.415 INFO:tasks.workunit.client.0.smithi079.stdout:5/760: chown d2/d3/d27/d32/de3/c6f 13 1 2024-09-10T09:36:10.416 INFO:tasks.workunit.client.0.smithi079.stdout:0/786: symlink d4/d12/d21/l105 0 2024-09-10T09:36:10.419 INFO:tasks.workunit.client.0.smithi079.stdout:5/761: creat d2/d3/ffe x:0 0 0 2024-09-10T09:36:10.419 INFO:tasks.workunit.client.0.smithi079.stdout:5/762: dread - d2/d3/d5e/d73/f8b zero size 2024-09-10T09:36:10.420 INFO:tasks.workunit.client.0.smithi079.stdout:1/923: getdents d5/df/dd0 0 2024-09-10T09:36:10.421 INFO:tasks.workunit.client.0.smithi079.stdout:1/924: creat d5/df/d11/d76/f137 x:0 0 0 2024-09-10T09:36:10.421 INFO:tasks.workunit.client.0.smithi079.stdout:1/925: fsync d5/f22 0 2024-09-10T09:36:10.421 INFO:tasks.workunit.client.0.smithi079.stdout:2/690: read d4/d8f/fc0 [3111026,543] 0 2024-09-10T09:36:10.421 INFO:tasks.workunit.client.0.smithi079.stdout:5/763: getdents d2/d3/d5e 0 2024-09-10T09:36:10.422 INFO:tasks.workunit.client.0.smithi079.stdout:6/897: dwrite d4/d8/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:10.423 INFO:tasks.workunit.client.0.smithi079.stdout:9/697: truncate d3/d40/f7b 1435341 0 2024-09-10T09:36:10.427 INFO:tasks.workunit.client.0.smithi079.stdout:2/691: rename d4/d8f/fc0 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/fe1 0 2024-09-10T09:36:10.429 INFO:tasks.workunit.client.0.smithi079.stdout:5/764: readlink d2/d3/d27/l95 0 2024-09-10T09:36:10.429 INFO:tasks.workunit.client.0.smithi079.stdout:5/765: fdatasync d2/d3/d5e/fd3 0 2024-09-10T09:36:10.429 INFO:tasks.workunit.client.0.smithi079.stdout:4/763: dwrite d1/da/d16/fcb [0,4194304] 0 2024-09-10T09:36:10.429 INFO:tasks.workunit.client.0.smithi079.stdout:4/764: chown d1/da/d16/d21/f25 10 1 2024-09-10T09:36:10.437 INFO:tasks.workunit.client.0.smithi079.stdout:6/898: dread d4/d8/dd/d76/f59 [0,4194304] 0 2024-09-10T09:36:10.438 INFO:tasks.workunit.client.0.smithi079.stdout:6/899: creat d4/d8/dc/d12/d29/f124 x:0 0 0 2024-09-10T09:36:10.438 INFO:tasks.workunit.client.0.smithi079.stdout:6/900: fdatasync d4/d8/dd/d76/d46/df0/fe8 0 2024-09-10T09:36:10.438 INFO:tasks.workunit.client.0.smithi079.stdout:9/698: creat d3/d7/d26/d69/ddf/fe7 x:0 0 0 2024-09-10T09:36:10.441 INFO:tasks.workunit.client.0.smithi079.stdout:3/819: dwrite d4/da/d17/d2d/d78/fbd [0,4194304] 0 2024-09-10T09:36:10.441 INFO:tasks.workunit.client.0.smithi079.stdout:3/820: readlink d4/da/d17/d38/d42/l71 0 2024-09-10T09:36:10.441 INFO:tasks.workunit.client.0.smithi079.stdout:7/739: dwrite d4/df/d3d/f9e [0,4194304] 0 2024-09-10T09:36:10.442 INFO:tasks.workunit.client.0.smithi079.stdout:7/740: fsync d4/d6/d4f/d70/dba/fcd 0 2024-09-10T09:36:10.442 INFO:tasks.workunit.client.0.smithi079.stdout:5/766: write d2/d3/f79 [837405,111582] 0 2024-09-10T09:36:10.443 INFO:tasks.workunit.client.0.smithi079.stdout:5/767: write d2/d3/d27/f2c [4985663,114823] 0 2024-09-10T09:36:10.445 INFO:tasks.workunit.client.0.smithi079.stdout:6/901: symlink d4/d8/dd/d76/d46/d88/d108/l125 0 2024-09-10T09:36:10.449 INFO:tasks.workunit.client.0.smithi079.stdout:9/699: rmdir d3/d7/dc/de/da7/de3 0 2024-09-10T09:36:10.452 INFO:tasks.workunit.client.0.smithi079.stdout:0/787: dwrite d4/d47/f4c [4194304,4194304] 0 2024-09-10T09:36:10.452 INFO:tasks.workunit.client.0.smithi079.stdout:3/821: dread d4/f2a [0,4194304] 0 2024-09-10T09:36:10.453 INFO:tasks.workunit.client.0.smithi079.stdout:8/755: dwrite fe [0,4194304] 0 2024-09-10T09:36:10.457 INFO:tasks.workunit.client.0.smithi079.stdout:6/902: write d4/d8/dc/d1c/f1a [2287691,123906] 0 2024-09-10T09:36:10.457 INFO:tasks.workunit.client.0.smithi079.stdout:5/768: rmdir d2/d3/d27/d70/de4 0 2024-09-10T09:36:10.457 INFO:tasks.workunit.client.0.smithi079.stdout:5/769: dread - d2/d3/d27/d32/d44/db4/fdb zero size 2024-09-10T09:36:10.457 INFO:tasks.workunit.client.0.smithi079.stdout:7/741: dread d4/d6/d4f/f52 [0,4194304] 0 2024-09-10T09:36:10.463 INFO:tasks.workunit.client.0.smithi079.stdout:9/700: write d3/d7/dc/d62/fdb [7448051,47647] 0 2024-09-10T09:36:10.463 INFO:tasks.workunit.client.0.smithi079.stdout:9/701: chown d3/d7/dc/de/d17/l44 2637686 1 2024-09-10T09:36:10.463 INFO:tasks.workunit.client.0.smithi079.stdout:4/765: dwrite d1/da/d16/f26 [0,4194304] 0 2024-09-10T09:36:10.464 INFO:tasks.workunit.client.0.smithi079.stdout:0/788: mkdir d4/d12/d16/de3/dac/d106 0 2024-09-10T09:36:10.465 INFO:tasks.workunit.client.0.smithi079.stdout:0/789: write d4/f10 [4595173,69020] 0 2024-09-10T09:36:10.465 INFO:tasks.workunit.client.0.smithi079.stdout:0/790: write d4/d12/d16/de3/fd9 [153263,78856] 0 2024-09-10T09:36:10.467 INFO:tasks.workunit.client.0.smithi079.stdout:1/926: dwrite d5/f9d [0,4194304] 0 2024-09-10T09:36:10.469 INFO:tasks.workunit.client.0.smithi079.stdout:9/702: dread d3/d7/f9f [0,4194304] 0 2024-09-10T09:36:10.483 INFO:tasks.workunit.client.0.smithi079.stdout:4/766: link d1/da/d28/d47/da1/d73/l8b d1/da/d28/d47/da1/d83/lf3 0 2024-09-10T09:36:10.492 INFO:tasks.workunit.client.0.smithi079.stdout:3/822: rename d4/da/ce2 to d4/da/d17/d2d/d43/d4c/cfb 0 2024-09-10T09:36:10.493 INFO:tasks.workunit.client.0.smithi079.stdout:8/756: dwrite d11/d2b/d4b/d50/d55/fa6 [0,4194304] 0 2024-09-10T09:36:10.495 INFO:tasks.workunit.client.0.smithi079.stdout:4/767: link d1/da/d28/d47/da1/fc5 d1/da/d16/d57/ff4 0 2024-09-10T09:36:10.495 INFO:tasks.workunit.client.0.smithi079.stdout:4/768: fsync d1/d38/da5/fac 0 2024-09-10T09:36:10.495 INFO:tasks.workunit.client.0.smithi079.stdout:4/769: creat d1/d38/da5/ff5 x:0 0 0 2024-09-10T09:36:10.495 INFO:tasks.workunit.client.0.smithi079.stdout:4/770: read d1/da/d16/f27 [4547491,24529] 0 2024-09-10T09:36:10.495 INFO:tasks.workunit.client.0.smithi079.stdout:4/771: write d1/da/d16/d21/d32/fe4 [467587,89402] 0 2024-09-10T09:36:10.496 INFO:tasks.workunit.client.0.smithi079.stdout:9/703: rename d3/d7/dc/de/l4a to d3/d7/dc/d7a/da9/le8 0 2024-09-10T09:36:10.498 INFO:tasks.workunit.client.0.smithi079.stdout:3/823: mknod d4/da/d17/d2d/d43/d49/cfc 0 2024-09-10T09:36:10.501 INFO:tasks.workunit.client.0.smithi079.stdout:1/927: dwrite d5/df/dd0/d57/d8c/fdd [0,4194304] 0 2024-09-10T09:36:10.502 INFO:tasks.workunit.client.0.smithi079.stdout:1/928: chown d5/d24/d36/d53/db3/de3 1906 1 2024-09-10T09:36:10.503 INFO:tasks.workunit.client.0.smithi079.stdout:6/903: dwrite d4/d8/dd/d76/d46/d88/d108/fc2 [4194304,4194304] 0 2024-09-10T09:36:10.503 INFO:tasks.workunit.client.0.smithi079.stdout:6/904: creat d4/d8/d74/d101/f126 x:0 0 0 2024-09-10T09:36:10.503 INFO:tasks.workunit.client.0.smithi079.stdout:6/905: chown d4/d8/dd/d76/d46/d88/d108/fb8 10878 1 2024-09-10T09:36:10.503 INFO:tasks.workunit.client.0.smithi079.stdout:6/906: readlink d4/d8/dc/d12/d29/l36 0 2024-09-10T09:36:10.503 INFO:tasks.workunit.client.0.smithi079.stdout:6/907: creat d4/d8/dc/d12/d9d/def/f127 x:0 0 0 2024-09-10T09:36:10.503 INFO:tasks.workunit.client.0.smithi079.stdout:3/824: truncate d4/da/d18/f97 7312371 0 2024-09-10T09:36:10.503 INFO:tasks.workunit.client.0.smithi079.stdout:3/825: stat d4/da/d18/f97 0 2024-09-10T09:36:10.504 INFO:tasks.workunit.client.0.smithi079.stdout:8/757: rmdir d11/d2b/d4b/d50/d5c 39 2024-09-10T09:36:10.504 INFO:tasks.workunit.client.0.smithi079.stdout:6/908: write d4/d8/dc/d12/d29/db5/ff5 [460820,23542] 0 2024-09-10T09:36:10.508 INFO:tasks.workunit.client.0.smithi079.stdout:1/929: dread d5/df/dd0/f64 [0,4194304] 0 2024-09-10T09:36:10.509 INFO:tasks.workunit.client.0.smithi079.stdout:3/826: creat d4/da/d67/db8/ffd x:0 0 0 2024-09-10T09:36:10.510 INFO:tasks.workunit.client.0.smithi079.stdout:8/758: symlink d11/d2b/d4b/d7e/lee 0 2024-09-10T09:36:10.511 INFO:tasks.workunit.client.0.smithi079.stdout:6/909: mknod d4/d8/dc/dd9/c128 0 2024-09-10T09:36:10.511 INFO:tasks.workunit.client.0.smithi079.stdout:6/910: write d4/d8/dd/d76/d46/d88/f92 [880382,78977] 0 2024-09-10T09:36:10.512 INFO:tasks.workunit.client.0.smithi079.stdout:3/827: mknod d4/da/d17/d38/cfe 0 2024-09-10T09:36:10.515 INFO:tasks.workunit.client.0.smithi079.stdout:0/791: dwrite f0 [0,4194304] 0 2024-09-10T09:36:10.515 INFO:tasks.workunit.client.0.smithi079.stdout:8/759: mkdir d11/d2b/d4b/d50/d55/d87/def 0 2024-09-10T09:36:10.516 INFO:tasks.workunit.client.0.smithi079.stdout:0/792: symlink d4/d12/d15/l107 0 2024-09-10T09:36:10.524 INFO:tasks.workunit.client.0.smithi079.stdout:8/760: read d11/d2b/d4b/d50/d55/f65 [309910,44989] 0 2024-09-10T09:36:10.524 INFO:tasks.workunit.client.0.smithi079.stdout:0/793: rename d4/d12/dc0/ddf/lef to d4/d12/d8b/dca/d32/dbd/l108 0 2024-09-10T09:36:10.524 INFO:tasks.workunit.client.0.smithi079.stdout:0/794: fdatasync d4/d47/f4c 0 2024-09-10T09:36:10.524 INFO:tasks.workunit.client.0.smithi079.stdout:0/795: write d4/d12/d16/d53/d6a/fae [433041,127823] 0 2024-09-10T09:36:10.524 INFO:tasks.workunit.client.0.smithi079.stdout:0/796: creat d4/d12/dde/f109 x:0 0 0 2024-09-10T09:36:10.525 INFO:tasks.workunit.client.0.smithi079.stdout:9/704: truncate d3/d7/dc/d62/fdb 5719611 0 2024-09-10T09:36:10.526 INFO:tasks.workunit.client.0.smithi079.stdout:8/761: getdents d11/d2b/d4b 0 2024-09-10T09:36:10.529 INFO:tasks.workunit.client.0.smithi079.stdout:4/772: dwrite d1/da/d16/fcb [4194304,4194304] 0 2024-09-10T09:36:10.533 INFO:tasks.workunit.client.0.smithi079.stdout:4/773: mkdir d1/da/d16/d4d/df6 0 2024-09-10T09:36:10.533 INFO:tasks.workunit.client.0.smithi079.stdout:4/774: fsync d1/d9b/db4/fc3 0 2024-09-10T09:36:10.533 INFO:tasks.workunit.client.0.smithi079.stdout:4/775: write d1/da/d16/d21/f25 [3495613,258] 0 2024-09-10T09:36:10.535 INFO:tasks.workunit.client.0.smithi079.stdout:4/776: unlink d1/da/d16/d21/d32/l67 0 2024-09-10T09:36:10.536 INFO:tasks.workunit.client.0.smithi079.stdout:9/705: write d3/d7/dc/d7a/da9/f45 [1027026,113995] 0 2024-09-10T09:36:10.537 INFO:tasks.workunit.client.0.smithi079.stdout:6/911: dwrite d4/d8/dc/d93/fe5 [0,4194304] 0 2024-09-10T09:36:10.537 INFO:tasks.workunit.client.0.smithi079.stdout:4/777: creat d1/da/d16/d88/ff7 x:0 0 0 2024-09-10T09:36:10.538 INFO:tasks.workunit.client.0.smithi079.stdout:1/930: dwrite d5/d40/dac/db2/ffd [0,4194304] 0 2024-09-10T09:36:10.539 INFO:tasks.workunit.client.0.smithi079.stdout:4/778: mknod d1/d38/da5/cf8 0 2024-09-10T09:36:10.541 INFO:tasks.workunit.client.0.smithi079.stdout:1/931: rmdir d5/df/dc6/de6 39 2024-09-10T09:36:10.541 INFO:tasks.workunit.client.0.smithi079.stdout:1/932: creat d5/d24/d36/d3a/d100/f138 x:0 0 0 2024-09-10T09:36:10.541 INFO:tasks.workunit.client.0.smithi079.stdout:1/933: readlink d5/d40/l86 0 2024-09-10T09:36:10.542 INFO:tasks.workunit.client.0.smithi079.stdout:4/779: creat d1/da/d28/d47/da1/dcd/ff9 x:0 0 0 2024-09-10T09:36:10.543 INFO:tasks.workunit.client.0.smithi079.stdout:3/828: dwrite d4/da/d17/d2d/d43/d4c/f96 [0,4194304] 0 2024-09-10T09:36:10.549 INFO:tasks.workunit.client.0.smithi079.stdout:1/934: mkdir d5/d40/dd9/d139 0 2024-09-10T09:36:10.554 INFO:tasks.workunit.client.0.smithi079.stdout:4/780: dread d1/da/d28/d95/f8d [0,4194304] 0 2024-09-10T09:36:10.555 INFO:tasks.workunit.client.0.smithi079.stdout:4/781: write d1/d38/da5/fac [1415130,97125] 0 2024-09-10T09:36:10.558 INFO:tasks.workunit.client.0.smithi079.stdout:4/782: symlink d1/da/d28/d47/da1/d83/lfa 0 2024-09-10T09:36:10.559 INFO:tasks.workunit.client.0.smithi079.stdout:4/783: fdatasync d1/da/d16/d88/fe1 0 2024-09-10T09:36:10.559 INFO:tasks.workunit.client.0.smithi079.stdout:4/784: dread - d1/da/d16/d21/fc0 zero size 2024-09-10T09:36:10.561 INFO:tasks.workunit.client.0.smithi079.stdout:4/785: creat d1/da/d16/ffb x:0 0 0 2024-09-10T09:36:10.561 INFO:tasks.workunit.client.0.smithi079.stdout:4/786: stat d1/da/d28/d47/da1/f79 0 2024-09-10T09:36:10.561 INFO:tasks.workunit.client.0.smithi079.stdout:4/787: chown d1/d9b/db4/cc7 70861772 1 2024-09-10T09:36:10.561 INFO:tasks.workunit.client.0.smithi079.stdout:4/788: write d1/da/d16/d21/d32/f8e [1142470,66217] 0 2024-09-10T09:36:10.564 INFO:tasks.workunit.client.0.smithi079.stdout:1/935: write d5/df/d11/f16 [1317704,89365] 0 2024-09-10T09:36:10.565 INFO:tasks.workunit.client.0.smithi079.stdout:1/936: mknod d5/d24/d36/d53/dce/c13a 0 2024-09-10T09:36:10.566 INFO:tasks.workunit.client.0.smithi079.stdout:1/937: stat d5/df/dd0/da0/c43 0 2024-09-10T09:36:10.567 INFO:tasks.workunit.client.0.smithi079.stdout:4/789: dread d1/da/d28/d95/f8d [0,4194304] 0 2024-09-10T09:36:10.567 INFO:tasks.workunit.client.0.smithi079.stdout:1/938: link d5/d40/d46/de8/f134 d5/d24/d36/d3a/f13b 0 2024-09-10T09:36:10.574 INFO:tasks.workunit.client.0.smithi079.stdout:0/797: dwrite d4/d12/d16/de3/fd9 [0,4194304] 0 2024-09-10T09:36:10.574 INFO:tasks.workunit.client.0.smithi079.stdout:0/798: stat d4/d12/d21/d3f/d88/fed 0 2024-09-10T09:36:10.574 INFO:tasks.workunit.client.0.smithi079.stdout:0/799: creat d4/d12/d8b/f10a x:0 0 0 2024-09-10T09:36:10.574 INFO:tasks.workunit.client.0.smithi079.stdout:3/829: dwrite d4/da/d17/d2d/d43/d4c/f96 [0,4194304] 0 2024-09-10T09:36:10.574 INFO:tasks.workunit.client.0.smithi079.stdout:6/912: dwrite d4/d8/fae [0,4194304] 0 2024-09-10T09:36:10.578 INFO:tasks.workunit.client.0.smithi079.stdout:1/939: write d5/d24/d36/d53/db3/fbc [634867,67762] 0 2024-09-10T09:36:10.578 INFO:tasks.workunit.client.0.smithi079.stdout:0/800: symlink d4/d12/d16/d53/d79/l10b 0 2024-09-10T09:36:10.578 INFO:tasks.workunit.client.0.smithi079.stdout:0/801: fsync d4/d12/d21/f2c 0 2024-09-10T09:36:10.578 INFO:tasks.workunit.client.0.smithi079.stdout:0/802: creat d4/d12/d8b/dca/d32/f10c x:0 0 0 2024-09-10T09:36:10.578 INFO:tasks.workunit.client.0.smithi079.stdout:0/803: readlink d4/d12/d15/l52 0 2024-09-10T09:36:10.579 INFO:tasks.workunit.client.0.smithi079.stdout:0/804: fsync d4/d12/d1a/f51 0 2024-09-10T09:36:10.579 INFO:tasks.workunit.client.0.smithi079.stdout:6/913: rename d4/l7b to d4/d8/dc/d93/l129 0 2024-09-10T09:36:10.581 INFO:tasks.workunit.client.0.smithi079.stdout:1/940: symlink d5/d24/d36/d3a/dfc/l13c 0 2024-09-10T09:36:10.585 INFO:tasks.workunit.client.0.smithi079.stdout:6/914: mkdir d4/d8/d12a 0 2024-09-10T09:36:10.585 INFO:tasks.workunit.client.0.smithi079.stdout:3/830: dread d4/da/d17/d72/fd5 [4194304,4194304] 0 2024-09-10T09:36:10.585 INFO:tasks.workunit.client.0.smithi079.stdout:3/831: readlink d4/da/l14 0 2024-09-10T09:36:10.585 INFO:tasks.workunit.client.0.smithi079.stdout:3/832: chown d4/da/d67 9288 1 2024-09-10T09:36:10.585 INFO:tasks.workunit.client.0.smithi079.stdout:3/833: dread - d4/da/d56/d7b/fb0 zero size 2024-09-10T09:36:10.586 INFO:tasks.workunit.client.0.smithi079.stdout:2/692: sync 2024-09-10T09:36:10.586 INFO:tasks.workunit.client.0.smithi079.stdout:2/693: fsync d4/dc/d1c/f34 0 2024-09-10T09:36:10.586 INFO:tasks.workunit.client.0.smithi079.stdout:2/694: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fe2 x:0 0 0 2024-09-10T09:36:10.590 INFO:tasks.workunit.client.0.smithi079.stdout:3/834: read d4/da/d17/ddf/fe6 [1547406,15477] 0 2024-09-10T09:36:10.590 INFO:tasks.workunit.client.0.smithi079.stdout:4/790: dwrite d1/da/d16/d4d/fe2 [0,4194304] 0 2024-09-10T09:36:10.594 INFO:tasks.workunit.client.0.smithi079.stdout:6/915: symlink d4/d8/dc/dd9/l12b 0 2024-09-10T09:36:10.596 INFO:tasks.workunit.client.0.smithi079.stdout:1/941: rmdir d5/d4f/d8a 39 2024-09-10T09:36:10.599 INFO:tasks.workunit.client.0.smithi079.stdout:2/695: link d4/dc/c3e d4/d5d/ce3 0 2024-09-10T09:36:10.601 INFO:tasks.workunit.client.0.smithi079.stdout:3/835: mknod d4/da/d17/d9b/cff 0 2024-09-10T09:36:10.603 INFO:tasks.workunit.client.0.smithi079.stdout:0/805: rmdir d4/d12 39 2024-09-10T09:36:10.605 INFO:tasks.workunit.client.0.smithi079.stdout:4/791: mknod d1/da/d16/d21/cfc 0 2024-09-10T09:36:10.606 INFO:tasks.workunit.client.0.smithi079.stdout:1/942: mknod d5/d24/d36/d53/dce/c13d 0 2024-09-10T09:36:10.607 INFO:tasks.workunit.client.0.smithi079.stdout:2/696: unlink l1 0 2024-09-10T09:36:10.608 INFO:tasks.workunit.client.0.smithi079.stdout:2/697: read - d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fd2 zero size 2024-09-10T09:36:10.608 INFO:tasks.workunit.client.0.smithi079.stdout:3/836: creat d4/da/d17/d38/f100 x:0 0 0 2024-09-10T09:36:10.611 INFO:tasks.workunit.client.0.smithi079.stdout:0/806: creat d4/d12/d16/de3/dac/f10d x:0 0 0 2024-09-10T09:36:10.611 INFO:tasks.workunit.client.0.smithi079.stdout:0/807: write d4/d12/d16/fb0 [4328243,35161] 0 2024-09-10T09:36:10.611 INFO:tasks.workunit.client.0.smithi079.stdout:0/808: fdatasync d4/d12/d1a/f19 0 2024-09-10T09:36:10.611 INFO:tasks.workunit.client.0.smithi079.stdout:0/809: chown d4/d12/d21/fcf 2624 1 2024-09-10T09:36:10.611 INFO:tasks.workunit.client.0.smithi079.stdout:4/792: mknod d1/da/d28/d47/da1/cfd 0 2024-09-10T09:36:10.612 INFO:tasks.workunit.client.0.smithi079.stdout:1/943: link d5/df/d2e/d10c/d111/fc2 d5/d24/d36/d3a/dfc/f13e 0 2024-09-10T09:36:10.613 INFO:tasks.workunit.client.0.smithi079.stdout:6/916: dwrite d4/d8/dd/d76/d46/d88/d108/fd2 [0,4194304] 0 2024-09-10T09:36:10.613 INFO:tasks.workunit.client.0.smithi079.stdout:6/917: fdatasync d4/d8/f83 0 2024-09-10T09:36:10.613 INFO:tasks.workunit.client.0.smithi079.stdout:6/918: chown d4/d8/dd/d76/d46/d88/d108/fb8 13719 1 2024-09-10T09:36:10.613 INFO:tasks.workunit.client.0.smithi079.stdout:6/919: chown d4/d8/dc/d12/c7a 1931 1 2024-09-10T09:36:10.614 INFO:tasks.workunit.client.0.smithi079.stdout:2/698: rename d4/d8f/lab to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/le4 0 2024-09-10T09:36:10.615 INFO:tasks.workunit.client.0.smithi079.stdout:3/837: link d4/da/d17/d2d/d43/d49/c5d d4/da/d17/d2d/d43/de7/c101 0 2024-09-10T09:36:10.615 INFO:tasks.workunit.client.0.smithi079.stdout:3/838: chown d4/da/d17/d9b/db1/fc3 26 1 2024-09-10T09:36:10.616 INFO:tasks.workunit.client.0.smithi079.stdout:0/810: mknod d4/d12/d8b/dca/d32/d7d/c10e 0 2024-09-10T09:36:10.617 INFO:tasks.workunit.client.0.smithi079.stdout:0/811: chown d4/d12/d8b/dca/d32 210443 1 2024-09-10T09:36:10.617 INFO:tasks.workunit.client.0.smithi079.stdout:0/812: truncate d4/d12/d16/d53/fa5 4394439 0 2024-09-10T09:36:10.617 INFO:tasks.workunit.client.0.smithi079.stdout:0/813: fdatasync d4/d12/d16/d53/f6c 0 2024-09-10T09:36:10.617 INFO:tasks.workunit.client.0.smithi079.stdout:0/814: chown d4/d12/d15 0 1 2024-09-10T09:36:10.617 INFO:tasks.workunit.client.0.smithi079.stdout:0/815: chown d4/d12/d16/c5a 7471 1 2024-09-10T09:36:10.617 INFO:tasks.workunit.client.0.smithi079.stdout:4/793: mkdir d1/da/d28/d47/da1/d83/dfe 0 2024-09-10T09:36:10.619 INFO:tasks.workunit.client.0.smithi079.stdout:6/920: mknod d4/d8/dd/d76/d46/df0/c12c 0 2024-09-10T09:36:10.620 INFO:tasks.workunit.client.0.smithi079.stdout:3/839: truncate d4/da/d17/d54/f41 138674 0 2024-09-10T09:36:10.620 INFO:tasks.workunit.client.0.smithi079.stdout:3/840: fdatasync d4/da/d67/db8/ffd 0 2024-09-10T09:36:10.620 INFO:tasks.workunit.client.0.smithi079.stdout:0/816: mknod d4/d12/d16/de3/d102/c10f 0 2024-09-10T09:36:10.621 INFO:tasks.workunit.client.0.smithi079.stdout:4/794: link d1/da/c1b d1/d38/cff 0 2024-09-10T09:36:10.622 INFO:tasks.workunit.client.0.smithi079.stdout:6/921: symlink d4/d8/dd/d41/d51/l12d 0 2024-09-10T09:36:10.623 INFO:tasks.workunit.client.0.smithi079.stdout:2/699: getdents d4/d5d 0 2024-09-10T09:36:10.624 INFO:tasks.workunit.client.0.smithi079.stdout:3/841: mkdir d4/da/d17/d2d/d78/d79/dab/d102 0 2024-09-10T09:36:10.625 INFO:tasks.workunit.client.0.smithi079.stdout:0/817: creat d4/d12/dc0/ddf/f110 x:0 0 0 2024-09-10T09:36:10.628 INFO:tasks.workunit.client.0.smithi079.stdout:6/922: rename d4/d8/dc/d93/d8a/dd7 to d4/d8/dd/d76/dd5/d12e 0 2024-09-10T09:36:10.630 INFO:tasks.workunit.client.0.smithi079.stdout:2/700: write d4/d5d/fa1 [303298,48188] 0 2024-09-10T09:36:10.633 INFO:tasks.workunit.client.0.smithi079.stdout:3/842: symlink d4/da/d8a/l103 0 2024-09-10T09:36:10.636 INFO:tasks.workunit.client.0.smithi079.stdout:0/818: creat d4/d12/d21/d3f/d88/dc7/f111 x:0 0 0 2024-09-10T09:36:10.636 INFO:tasks.workunit.client.0.smithi079.stdout:0/819: write d4/d12/d8b/dca/d32/fe4 [727326,19726] 0 2024-09-10T09:36:10.640 INFO:tasks.workunit.client.0.smithi079.stdout:2/701: link d4/dc/d1c/d86/d1b/d38/d39/d31/d52/fd4 d4/dc/d1c/d86/d1b/d38/d39/d31/d49/fe5 0 2024-09-10T09:36:10.641 INFO:tasks.workunit.client.0.smithi079.stdout:3/843: mkdir d4/da/d17/d2d/d78/dbe/d104 0 2024-09-10T09:36:10.642 INFO:tasks.workunit.client.0.smithi079.stdout:0/820: symlink d4/d12/d16/d53/d79/l112 0 2024-09-10T09:36:10.644 INFO:tasks.workunit.client.0.smithi079.stdout:2/702: truncate d4/d8f/fc3 2388069 0 2024-09-10T09:36:10.644 INFO:tasks.workunit.client.0.smithi079.stdout:2/703: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fe6 x:0 0 0 2024-09-10T09:36:10.645 INFO:tasks.workunit.client.0.smithi079.stdout:7/742: sync 2024-09-10T09:36:10.645 INFO:tasks.workunit.client.0.smithi079.stdout:5/770: sync 2024-09-10T09:36:10.645 INFO:tasks.workunit.client.0.smithi079.stdout:5/771: dread - d2/d3/d27/d32/de3/d4d/fdc zero size 2024-09-10T09:36:10.645 INFO:tasks.workunit.client.0.smithi079.stdout:5/772: fdatasync d2/d3/d27/d70/d80/fad 0 2024-09-10T09:36:10.646 INFO:tasks.workunit.client.0.smithi079.stdout:2/704: link d4/dc/d1c/d86/f3f d4/dc/d1c/d86/d1b/d38/d87/fe7 0 2024-09-10T09:36:10.646 INFO:tasks.workunit.client.0.smithi079.stdout:2/705: readlink d4/dc/d1c/d86/d1b/l89 0 2024-09-10T09:36:10.648 INFO:tasks.workunit.client.0.smithi079.stdout:5/773: mkdir d2/d3/d27/d70/d80/d94/dff 0 2024-09-10T09:36:10.651 INFO:tasks.workunit.client.0.smithi079.stdout:2/706: creat d4/dc/fe8 x:0 0 0 2024-09-10T09:36:10.651 INFO:tasks.workunit.client.0.smithi079.stdout:2/707: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fe9 x:0 0 0 2024-09-10T09:36:10.652 INFO:tasks.workunit.client.0.smithi079.stdout:4/795: dwrite d1/da/d28/d47/da1/fd0 [0,4194304] 0 2024-09-10T09:36:10.652 INFO:tasks.workunit.client.0.smithi079.stdout:4/796: chown d1/d9b/db4/fc3 0 1 2024-09-10T09:36:10.653 INFO:tasks.workunit.client.0.smithi079.stdout:4/797: write d1/da/f7b [513719,121471] 0 2024-09-10T09:36:10.654 INFO:tasks.workunit.client.0.smithi079.stdout:4/798: write d1/d9b/db4/fc3 [520232,105811] 0 2024-09-10T09:36:10.654 INFO:tasks.workunit.client.0.smithi079.stdout:7/743: write d4/d6/d38/f63 [467044,123898] 0 2024-09-10T09:36:10.657 INFO:tasks.workunit.client.0.smithi079.stdout:7/744: rename d4/d6/d38/l58 to d4/d6/d4f/d66/ldf 0 2024-09-10T09:36:10.664 INFO:tasks.workunit.client.0.smithi079.stdout:2/708: write d4/f66 [1720985,121623] 0 2024-09-10T09:36:10.666 INFO:tasks.workunit.client.0.smithi079.stdout:5/774: write d2/d3/d27/f43 [3481088,129797] 0 2024-09-10T09:36:10.667 INFO:tasks.workunit.client.0.smithi079.stdout:4/799: write d1/da/d28/d47/da1/dcd/fda [1696277,40161] 0 2024-09-10T09:36:10.667 INFO:tasks.workunit.client.0.smithi079.stdout:4/800: fsync d1/da/d16/d4d/fe2 0 2024-09-10T09:36:10.667 INFO:tasks.workunit.client.0.smithi079.stdout:6/923: dwrite d4/d8/dc/d12/d29/f47 [0,4194304] 0 2024-09-10T09:36:10.668 INFO:tasks.workunit.client.0.smithi079.stdout:2/709: rename d4/dc/f22 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/fea 0 2024-09-10T09:36:10.668 INFO:tasks.workunit.client.0.smithi079.stdout:2/710: read d4/dc/f14 [2596578,25251] 0 2024-09-10T09:36:10.668 INFO:tasks.workunit.client.0.smithi079.stdout:2/711: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fda [798005,5202] 0 2024-09-10T09:36:10.668 INFO:tasks.workunit.client.0.smithi079.stdout:2/712: write d4/dc/fc7 [841926,41497] 0 2024-09-10T09:36:10.668 INFO:tasks.workunit.client.0.smithi079.stdout:3/844: dwrite d4/da/d56/d7b/fce [0,4194304] 0 2024-09-10T09:36:10.672 INFO:tasks.workunit.client.0.smithi079.stdout:2/713: dread d4/dc/d1c/d86/f98 [0,4194304] 0 2024-09-10T09:36:10.673 INFO:tasks.workunit.client.0.smithi079.stdout:3/845: link d4/da/d17/d38/f100 d4/da/d8a/f105 0 2024-09-10T09:36:10.673 INFO:tasks.workunit.client.0.smithi079.stdout:3/846: getdents d4/da/d17/d2d/d78/d79/dab/d102 0 2024-09-10T09:36:10.673 INFO:tasks.workunit.client.0.smithi079.stdout:3/847: write d4/da/d17/d9b/db1/fc3 [549379,20135] 0 2024-09-10T09:36:10.676 INFO:tasks.workunit.client.0.smithi079.stdout:3/848: rename d4/da/d18/c22 to d4/da/d17/d2d/d78/d79/dab/c106 0 2024-09-10T09:36:10.677 INFO:tasks.workunit.client.0.smithi079.stdout:4/801: dread d1/da/d28/f29 [0,4194304] 0 2024-09-10T09:36:10.677 INFO:tasks.workunit.client.0.smithi079.stdout:4/802: chown d1/la9 3905 1 2024-09-10T09:36:10.682 INFO:tasks.workunit.client.0.smithi079.stdout:4/803: rename d1/da/d3b/db3/fca to d1/da/d16/d57/f100 0 2024-09-10T09:36:10.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/714: read d4/dc/d1c/f28 [1423132,126993] 0 2024-09-10T09:36:10.683 INFO:tasks.workunit.client.0.smithi079.stdout:2/715: readlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/lcc 0 2024-09-10T09:36:10.684 INFO:tasks.workunit.client.0.smithi079.stdout:3/849: mkdir d4/da/d17/d2d/d43/d4c/d107 0 2024-09-10T09:36:10.685 INFO:tasks.workunit.client.0.smithi079.stdout:7/745: dwrite d4/d6/d4f/d70/db6/fd2 [0,4194304] 0 2024-09-10T09:36:10.685 INFO:tasks.workunit.client.0.smithi079.stdout:7/746: write d4/d6/d3e/f85 [1983432,63196] 0 2024-09-10T09:36:10.685 INFO:tasks.workunit.client.0.smithi079.stdout:7/747: creat d4/d6/d38/dc1/fe0 x:0 0 0 2024-09-10T09:36:10.685 INFO:tasks.workunit.client.0.smithi079.stdout:7/748: chown d4/dc/l30 6515876 1 2024-09-10T09:36:10.686 INFO:tasks.workunit.client.0.smithi079.stdout:4/804: unlink d1/da/d3b/d5a/l6c 0 2024-09-10T09:36:10.687 INFO:tasks.workunit.client.0.smithi079.stdout:4/805: fsync d1/da/d3b/d5a/f78 0 2024-09-10T09:36:10.688 INFO:tasks.workunit.client.0.smithi079.stdout:2/716: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/d9f/leb 0 2024-09-10T09:36:10.690 INFO:tasks.workunit.client.0.smithi079.stdout:3/850: mknod d4/da/d17/d2d/d43/de7/deb/c108 0 2024-09-10T09:36:10.694 INFO:tasks.workunit.client.0.smithi079.stdout:3/851: rmdir d4/da/d17/d2d/d43/de7 39 2024-09-10T09:36:10.695 INFO:tasks.workunit.client.0.smithi079.stdout:3/852: read d4/da/fa5 [119002,31199] 0 2024-09-10T09:36:10.696 INFO:tasks.workunit.client.0.smithi079.stdout:3/853: creat d4/da/d17/ddf/f109 x:0 0 0 2024-09-10T09:36:10.696 INFO:tasks.workunit.client.0.smithi079.stdout:5/775: dwrite d2/d3/d5e/d61/fee [0,4194304] 0 2024-09-10T09:36:10.697 INFO:tasks.workunit.client.0.smithi079.stdout:5/776: read d2/d3/d27/d32/de3/d4d/f5a [241035,65200] 0 2024-09-10T09:36:10.704 INFO:tasks.workunit.client.0.smithi079.stdout:5/777: symlink d2/d3/d5e/d73/l100 0 2024-09-10T09:36:10.705 INFO:tasks.workunit.client.0.smithi079.stdout:4/806: write d1/da/d16/d4d/f9f [3758191,69425] 0 2024-09-10T09:36:10.705 INFO:tasks.workunit.client.0.smithi079.stdout:6/924: dwrite d4/d8/dc/d93/fad [0,4194304] 0 2024-09-10T09:36:10.705 INFO:tasks.workunit.client.0.smithi079.stdout:4/807: stat d1/da/d28 0 2024-09-10T09:36:10.705 INFO:tasks.workunit.client.0.smithi079.stdout:4/808: chown d1/da/d16/d4d/fb7 675854324 1 2024-09-10T09:36:10.705 INFO:tasks.workunit.client.0.smithi079.stdout:4/809: readlink d1/da/d16/d21/d32/l92 0 2024-09-10T09:36:10.712 INFO:tasks.workunit.client.0.smithi079.stdout:3/854: write d4/da/d56/d7b/fce [2915916,53689] 0 2024-09-10T09:36:10.719 INFO:tasks.workunit.client.0.smithi079.stdout:2/717: dwrite d4/dc/d1c/d86/d1b/d38/d39/f4c [4194304,4194304] 0 2024-09-10T09:36:10.719 INFO:tasks.workunit.client.0.smithi079.stdout:2/718: readlink d4/dc/d1c/d86/d1b/d38/d39/d99/l41 0 2024-09-10T09:36:10.730 INFO:tasks.workunit.client.0.smithi079.stdout:6/925: mkdir d4/d8/dd/d76/d46/d12f 0 2024-09-10T09:36:10.730 INFO:tasks.workunit.client.0.smithi079.stdout:6/926: fdatasync d4/d8/dc/d93/d4b/f4c 0 2024-09-10T09:36:10.730 INFO:tasks.workunit.client.0.smithi079.stdout:6/927: fsync d4/d8/dd/d41/f56 0 2024-09-10T09:36:10.730 INFO:tasks.workunit.client.0.smithi079.stdout:6/928: readlink d4/d8/dd/d41/l61 0 2024-09-10T09:36:10.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/929: dread d4/d8/dc/d3c/f99 [0,4194304] 0 2024-09-10T09:36:10.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/930: getdents d4/d8/dc/d12/d70 0 2024-09-10T09:36:10.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/931: fsync d4/d8/dc/d1c/f1d 0 2024-09-10T09:36:10.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/932: chown d4/d8/dc/d1c/f53 277039574 1 2024-09-10T09:36:10.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/933: creat d4/d8/dd/f130 x:0 0 0 2024-09-10T09:36:10.736 INFO:tasks.workunit.client.0.smithi079.stdout:6/934: chown d4/d8/dd/d76/d46/d88/cbd 128147828 1 2024-09-10T09:36:10.738 INFO:tasks.workunit.client.0.smithi079.stdout:5/778: rmdir d2/d3/d27/d32/d39/dc4 39 2024-09-10T09:36:10.738 INFO:tasks.workunit.client.0.smithi079.stdout:5/779: write d2/d3/f83 [471846,77448] 0 2024-09-10T09:36:10.739 INFO:tasks.workunit.client.0.smithi079.stdout:4/810: dwrite d1/da/d16/d21/f9e [0,4194304] 0 2024-09-10T09:36:10.740 INFO:tasks.workunit.client.0.smithi079.stdout:4/811: chown d1/da/d3b/d5f/c69 2 1 2024-09-10T09:36:10.740 INFO:tasks.workunit.client.0.smithi079.stdout:4/812: fsync d1/da/f7b 0 2024-09-10T09:36:10.740 INFO:tasks.workunit.client.0.smithi079.stdout:2/719: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fe9 [0,4194304] 0 2024-09-10T09:36:10.740 INFO:tasks.workunit.client.0.smithi079.stdout:2/720: write d4/dc/d1c/d86/d1b/d38/d39/d99/fa4 [634861,56242] 0 2024-09-10T09:36:10.740 INFO:tasks.workunit.client.0.smithi079.stdout:2/721: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fec x:0 0 0 2024-09-10T09:36:10.740 INFO:tasks.workunit.client.0.smithi079.stdout:6/935: dread d4/d8/dc/d12/faf [0,4194304] 0 2024-09-10T09:36:10.740 INFO:tasks.workunit.client.0.smithi079.stdout:3/855: rmdir d4/da/d17/d9b/db1 39 2024-09-10T09:36:10.745 INFO:tasks.workunit.client.0.smithi079.stdout:5/780: mkdir d2/d3/d59/d101 0 2024-09-10T09:36:10.749 INFO:tasks.workunit.client.0.smithi079.stdout:4/813: mkdir d1/da/d16/d4d/d101 0 2024-09-10T09:36:10.756 INFO:tasks.workunit.client.0.smithi079.stdout:6/936: creat d4/d8/f131 x:0 0 0 2024-09-10T09:36:10.758 INFO:tasks.workunit.client.0.smithi079.stdout:5/781: symlink d2/d3/d27/d70/d80/d94/dff/l102 0 2024-09-10T09:36:10.759 INFO:tasks.workunit.client.0.smithi079.stdout:5/782: chown d2/d3/f6a 2 1 2024-09-10T09:36:10.759 INFO:tasks.workunit.client.0.smithi079.stdout:5/783: truncate d2/d3/d27/d32/de3/d4d/fcf 1385870 0 2024-09-10T09:36:10.763 INFO:tasks.workunit.client.0.smithi079.stdout:6/937: rmdir d4/d8/dc/d12 39 2024-09-10T09:36:10.765 INFO:tasks.workunit.client.0.smithi079.stdout:5/784: chown d2/d3/d27/d32/d44/l96 30174644 1 2024-09-10T09:36:10.765 INFO:tasks.workunit.client.0.smithi079.stdout:5/785: chown d2/d3/d27/d70/d80/d94/fce 379286 1 2024-09-10T09:36:10.768 INFO:tasks.workunit.client.0.smithi079.stdout:2/722: dwrite d4/dc/fc7 [0,4194304] 0 2024-09-10T09:36:10.768 INFO:tasks.workunit.client.0.smithi079.stdout:4/814: getdents d1/d38 0 2024-09-10T09:36:10.770 INFO:tasks.workunit.client.0.smithi079.stdout:6/938: mkdir d4/d8/dc/d93/dc4/df1/d132 0 2024-09-10T09:36:10.771 INFO:tasks.workunit.client.0.smithi079.stdout:6/939: chown d4/la9 8550223 1 2024-09-10T09:36:10.771 INFO:tasks.workunit.client.0.smithi079.stdout:3/856: dwrite d4/da/f57 [0,4194304] 0 2024-09-10T09:36:10.774 INFO:tasks.workunit.client.0.smithi079.stdout:5/786: getdents d2/d3/d27/d70/d80/d94 0 2024-09-10T09:36:10.782 INFO:tasks.workunit.client.0.smithi079.stdout:4/815: mknod d1/da/d3b/d5f/c102 0 2024-09-10T09:36:10.783 INFO:tasks.workunit.client.0.smithi079.stdout:4/816: fsync d1/da/d16/d88/faa 0 2024-09-10T09:36:10.783 INFO:tasks.workunit.client.0.smithi079.stdout:4/817: creat d1/da/d28/d47/da1/dcd/f103 x:0 0 0 2024-09-10T09:36:10.789 INFO:tasks.workunit.client.0.smithi079.stdout:2/723: dwrite d4/dc/d1c/d86/d1b/d38/d39/d31/f67 [0,4194304] 0 2024-09-10T09:36:10.791 INFO:tasks.workunit.client.0.smithi079.stdout:6/940: rename d4/d8/dc/d12/d29/l55 to d4/d8/dc/d12/d9d/l133 0 2024-09-10T09:36:10.791 INFO:tasks.workunit.client.0.smithi079.stdout:6/941: chown d4/d8/dd/d76/dd5/d12e 55021 1 2024-09-10T09:36:10.795 INFO:tasks.workunit.client.0.smithi079.stdout:5/787: dwrite d2/d3/fc9 [0,4194304] 0 2024-09-10T09:36:10.795 INFO:tasks.workunit.client.0.smithi079.stdout:3/857: creat d4/da/d18/f10a x:0 0 0 2024-09-10T09:36:10.803 INFO:tasks.workunit.client.0.smithi079.stdout:4/818: creat d1/da/d28/d47/f104 x:0 0 0 2024-09-10T09:36:10.811 INFO:tasks.workunit.client.0.smithi079.stdout:2/724: mknod d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde/ced 0 2024-09-10T09:36:10.811 INFO:tasks.workunit.client.0.smithi079.stdout:2/725: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/l9c 108645904 1 2024-09-10T09:36:10.813 INFO:tasks.workunit.client.0.smithi079.stdout:6/942: mknod d4/d8/dc/d93/d4b/c134 0 2024-09-10T09:36:10.813 INFO:tasks.workunit.client.0.smithi079.stdout:6/943: chown d4/d8/dd/d76/dd5/d12e/lea 15220 1 2024-09-10T09:36:10.813 INFO:tasks.workunit.client.0.smithi079.stdout:6/944: chown d4/d8/dc/d1c/f53 0 1 2024-09-10T09:36:10.813 INFO:tasks.workunit.client.0.smithi079.stdout:6/945: truncate d4/d8/dd/d76/d46/d88/d108/fd2 4929196 0 2024-09-10T09:36:10.819 INFO:tasks.workunit.client.0.smithi079.stdout:5/788: symlink d2/d3/d59/dcb/l103 0 2024-09-10T09:36:10.821 INFO:tasks.workunit.client.0.smithi079.stdout:3/858: mkdir d4/da/d18/daf/d10b 0 2024-09-10T09:36:10.823 INFO:tasks.workunit.client.0.smithi079.stdout:5/789: write d2/d3/d27/d32/de3/f6b [3104044,127456] 0 2024-09-10T09:36:10.823 INFO:tasks.workunit.client.0.smithi079.stdout:5/790: stat d2/f3a 0 2024-09-10T09:36:10.823 INFO:tasks.workunit.client.0.smithi079.stdout:5/791: write d2/d3/f6e [806119,58154] 0 2024-09-10T09:36:10.824 INFO:tasks.workunit.client.0.smithi079.stdout:4/819: dwrite d1/da/d28/d47/f6f [0,4194304] 0 2024-09-10T09:36:10.824 INFO:tasks.workunit.client.0.smithi079.stdout:2/726: rmdir d4/d5d 39 2024-09-10T09:36:10.827 INFO:tasks.workunit.client.0.smithi079.stdout:3/859: mkdir d4/da/d17/d2d/d78/dbe/d10c 0 2024-09-10T09:36:10.827 INFO:tasks.workunit.client.0.smithi079.stdout:3/860: chown d4/da/d17/d2d 28 1 2024-09-10T09:36:10.828 INFO:tasks.workunit.client.0.smithi079.stdout:5/792: symlink d2/d3/d27/d70/l104 0 2024-09-10T09:36:10.829 INFO:tasks.workunit.client.0.smithi079.stdout:4/820: unlink d1/da/d16/d88/faa 0 2024-09-10T09:36:10.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/727: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde/dee 0 2024-09-10T09:36:10.831 INFO:tasks.workunit.client.0.smithi079.stdout:2/728: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fda 1710 1 2024-09-10T09:36:10.832 INFO:tasks.workunit.client.0.smithi079.stdout:3/861: mkdir d4/da/d8a/dd7/d10d 0 2024-09-10T09:36:10.834 INFO:tasks.workunit.client.0.smithi079.stdout:4/821: symlink d1/da/l105 0 2024-09-10T09:36:10.834 INFO:tasks.workunit.client.0.smithi079.stdout:4/822: dread - d1/da/d16/d88/ff7 zero size 2024-09-10T09:36:10.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/729: link d4/dc/d1c/d86/d1b/l89 d4/dc/d1c/d86/d1b/d38/d39/lef 0 2024-09-10T09:36:10.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/730: truncate d4/dc/faa 1205513 0 2024-09-10T09:36:10.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/731: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd6 868281007 1 2024-09-10T09:36:10.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/732: creat d4/dc/ff0 x:0 0 0 2024-09-10T09:36:10.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/733: creat d4/dc/ff1 x:0 0 0 2024-09-10T09:36:10.836 INFO:tasks.workunit.client.0.smithi079.stdout:2/734: truncate d4/dc/fc7 5200328 0 2024-09-10T09:36:10.837 INFO:tasks.workunit.client.0.smithi079.stdout:6/946: dwrite d4/d8/dd/f130 [0,4194304] 0 2024-09-10T09:36:10.837 INFO:tasks.workunit.client.0.smithi079.stdout:6/947: write d4/d8/dc/d12/d29/f62 [2477036,44781] 0 2024-09-10T09:36:10.837 INFO:tasks.workunit.client.0.smithi079.stdout:6/948: creat d4/d8/dc/dd9/f135 x:0 0 0 2024-09-10T09:36:10.840 INFO:tasks.workunit.client.0.smithi079.stdout:4/823: rename d1/da/d28/d47/da1/dcd/de9 to d1/da/d28/d47/da1/dcd/d106 0 2024-09-10T09:36:10.841 INFO:tasks.workunit.client.0.smithi079.stdout:5/793: dread d2/d3/d27/d32/de3/f51 [0,4194304] 0 2024-09-10T09:36:10.844 INFO:tasks.workunit.client.0.smithi079.stdout:2/735: truncate d4/dc/d1c/d86/f98 464117 0 2024-09-10T09:36:10.844 INFO:tasks.workunit.client.0.smithi079.stdout:2/736: truncate d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd3 191395 0 2024-09-10T09:36:10.846 INFO:tasks.workunit.client.0.smithi079.stdout:2/737: dread d4/dc/fcf [0,4194304] 0 2024-09-10T09:36:10.862 INFO:tasks.workunit.client.0.smithi079.stdout:4/824: mkdir d1/da/d3b/d107 0 2024-09-10T09:36:10.863 INFO:tasks.workunit.client.0.smithi079.stdout:2/738: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/db0/lf2 0 2024-09-10T09:36:10.864 INFO:tasks.workunit.client.0.smithi079.stdout:2/739: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde/dee 0 2024-09-10T09:36:10.866 INFO:tasks.workunit.client.0.smithi079.stdout:2/740: symlink d4/dc/d1c/d86/d1b/d38/d87/lf3 0 2024-09-10T09:36:10.871 INFO:tasks.workunit.client.0.smithi079.stdout:2/741: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/ff4 x:0 0 0 2024-09-10T09:36:10.871 INFO:tasks.workunit.client.0.smithi079.stdout:2/742: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f76 0 2024-09-10T09:36:10.872 INFO:tasks.workunit.client.0.smithi079.stdout:8/762: sync 2024-09-10T09:36:10.872 INFO:tasks.workunit.client.0.smithi079.stdout:8/763: fsync d11/f45 0 2024-09-10T09:36:10.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/743: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fda [0,4194304] 0 2024-09-10T09:36:10.878 INFO:tasks.workunit.client.0.smithi079.stdout:2/744: dread - d4/dc/d1c/d86/d1b/d38/d87/f9e zero size 2024-09-10T09:36:10.879 INFO:tasks.workunit.client.0.smithi079.stdout:2/745: stat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/cbf 0 2024-09-10T09:36:10.885 INFO:tasks.workunit.client.0.smithi079.stdout:4/825: dwrite d1/da/d16/f26 [0,4194304] 0 2024-09-10T09:36:10.885 INFO:tasks.workunit.client.0.smithi079.stdout:4/826: fsync d1/da/d28/d95/f8d 0 2024-09-10T09:36:10.891 INFO:tasks.workunit.client.0.smithi079.stdout:4/827: dread d1/da/d16/d4d/f9f [0,4194304] 0 2024-09-10T09:36:10.893 INFO:tasks.workunit.client.0.smithi079.stdout:9/706: sync 2024-09-10T09:36:10.893 INFO:tasks.workunit.client.0.smithi079.stdout:2/746: dwrite d4/dc/fc7 [0,4194304] 0 2024-09-10T09:36:10.894 INFO:tasks.workunit.client.0.smithi079.stdout:2/747: dread - d4/dc/d1c/d86/d1b/d38/d39/d31/d52/fd4 zero size 2024-09-10T09:36:10.895 INFO:tasks.workunit.client.0.smithi079.stdout:9/707: creat d3/d40/dc0/fe9 x:0 0 0 2024-09-10T09:36:10.895 INFO:tasks.workunit.client.0.smithi079.stdout:9/708: chown d3/d7/dc/de/d17/d2f/d74/db4/lc6 29280 1 2024-09-10T09:36:10.895 INFO:tasks.workunit.client.0.smithi079.stdout:9/709: dread - d3/d7/dc/de/d17/d2f/d98/da1/fb9 zero size 2024-09-10T09:36:10.897 INFO:tasks.workunit.client.0.smithi079.stdout:3/862: rename d4/da/d17/d2d/d78 to d4/da/d8a/dd7/d10e 0 2024-09-10T09:36:10.897 INFO:tasks.workunit.client.0.smithi079.stdout:3/863: dread - d4/da/d8a/dd7/d10e/dbe/fa0 zero size 2024-09-10T09:36:10.897 INFO:tasks.workunit.client.0.smithi079.stdout:3/864: truncate d4/f40 1394735 0 2024-09-10T09:36:10.900 INFO:tasks.workunit.client.0.smithi079.stdout:2/748: creat d4/dc/d1c/d86/d1b/d38/ff5 x:0 0 0 2024-09-10T09:36:10.902 INFO:tasks.workunit.client.0.smithi079.stdout:9/710: mkdir d3/d7/d26/d69/dea 0 2024-09-10T09:36:10.904 INFO:tasks.workunit.client.0.smithi079.stdout:3/865: dread d4/da/d17/d2d/d43/d4c/f96 [0,4194304] 0 2024-09-10T09:36:10.904 INFO:tasks.workunit.client.0.smithi079.stdout:8/764: rename d11/d2b/d4b/d74/da2/de6 to d11/d2b/d4b/d50/d9e/dca/dd0/df0 0 2024-09-10T09:36:10.907 INFO:tasks.workunit.client.0.smithi079.stdout:2/749: symlink d4/dc/d1c/d86/d1b/d38/d39/lf6 0 2024-09-10T09:36:10.907 INFO:tasks.workunit.client.0.smithi079.stdout:2/750: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/db0 103 1 2024-09-10T09:36:10.907 INFO:tasks.workunit.client.0.smithi079.stdout:2/751: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/db7 1 1 2024-09-10T09:36:10.907 INFO:tasks.workunit.client.0.smithi079.stdout:2/752: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/ff7 x:0 0 0 2024-09-10T09:36:10.907 INFO:tasks.workunit.client.0.smithi079.stdout:2/753: chown d4/dc/fe8 628183 1 2024-09-10T09:36:10.908 INFO:tasks.workunit.client.0.smithi079.stdout:9/711: mknod d3/d7/dc/de/d17/dcf/ceb 0 2024-09-10T09:36:10.914 INFO:tasks.workunit.client.0.smithi079.stdout:3/866: unlink d4/da/d18/f48 0 2024-09-10T09:36:10.920 INFO:tasks.workunit.client.0.smithi079.stdout:9/712: mknod d3/d7/dc/de/db7/cec 0 2024-09-10T09:36:10.920 INFO:tasks.workunit.client.0.smithi079.stdout:9/713: creat d3/d7/dc/de/d17/d2f/d74/db4/fed x:0 0 0 2024-09-10T09:36:10.920 INFO:tasks.workunit.client.0.smithi079.stdout:9/714: dread - d3/d7/dc/de/d17/d2f/d74/fe0 zero size 2024-09-10T09:36:10.922 INFO:tasks.workunit.client.0.smithi079.stdout:2/754: dwrite d4/dc/fe8 [0,4194304] 0 2024-09-10T09:36:10.923 INFO:tasks.workunit.client.0.smithi079.stdout:4/828: rename d1/d9b to d1/da/d3b/d107/d108 0 2024-09-10T09:36:10.925 INFO:tasks.workunit.client.0.smithi079.stdout:8/765: rename d11/l96 to d11/lf1 0 2024-09-10T09:36:10.929 INFO:tasks.workunit.client.0.smithi079.stdout:9/715: link d3/d7/d26/d69/c86 d3/d7/dc/de/d17/d4c/cee 0 2024-09-10T09:36:10.929 INFO:tasks.workunit.client.0.smithi079.stdout:9/716: getdents d3/d7/d26 0 2024-09-10T09:36:10.933 INFO:tasks.workunit.client.0.smithi079.stdout:2/755: mknod d4/dc/d1c/cf8 0 2024-09-10T09:36:10.934 INFO:tasks.workunit.client.0.smithi079.stdout:2/756: truncate d4/dc/ff1 717025 0 2024-09-10T09:36:10.934 INFO:tasks.workunit.client.0.smithi079.stdout:8/766: dread d11/d2b/d4b/d50/d55/fa6 [0,4194304] 0 2024-09-10T09:36:10.935 INFO:tasks.workunit.client.0.smithi079.stdout:9/717: mkdir d3/d7/dc/def 0 2024-09-10T09:36:10.935 INFO:tasks.workunit.client.0.smithi079.stdout:9/718: chown d3/d7/d26/d83/fd6 3 1 2024-09-10T09:36:10.935 INFO:tasks.workunit.client.0.smithi079.stdout:4/829: dwrite d1/da/d16/ffb [0,4194304] 0 2024-09-10T09:36:10.937 INFO:tasks.workunit.client.0.smithi079.stdout:2/757: rename d4/dc/c35 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/cf9 0 2024-09-10T09:36:10.943 INFO:tasks.workunit.client.0.smithi079.stdout:9/719: creat d3/d7f/ff0 x:0 0 0 2024-09-10T09:36:10.943 INFO:tasks.workunit.client.0.smithi079.stdout:9/720: write d3/d7/dc/de/fba [546698,23029] 0 2024-09-10T09:36:10.943 INFO:tasks.workunit.client.0.smithi079.stdout:9/721: fsync d3/d7/d26/f8f 0 2024-09-10T09:36:10.949 INFO:tasks.workunit.client.0.smithi079.stdout:9/722: truncate d3/d7/dc/d7a/da9/f45 1831528 0 2024-09-10T09:36:10.951 INFO:tasks.workunit.client.0.smithi079.stdout:8/767: rename d11/d2b/d4b/d50/d55/db8/de4 to d11/df2 0 2024-09-10T09:36:10.953 INFO:tasks.workunit.client.0.smithi079.stdout:9/723: mkdir d3/d7/dc/de/da7/df1 0 2024-09-10T09:36:10.956 INFO:tasks.workunit.client.0.smithi079.stdout:4/830: rename d1/da/d3b/fbe to d1/da/d28/d47/da1/d83/f109 0 2024-09-10T09:36:10.958 INFO:tasks.workunit.client.0.smithi079.stdout:8/768: creat d11/dbd/ff3 x:0 0 0 2024-09-10T09:36:10.960 INFO:tasks.workunit.client.0.smithi079.stdout:9/724: unlink d3/d7/d26/d69/da2/ce2 0 2024-09-10T09:36:10.960 INFO:tasks.workunit.client.0.smithi079.stdout:9/725: creat d3/d7/dc/de/d17/d6e/ff2 x:0 0 0 2024-09-10T09:36:10.960 INFO:tasks.workunit.client.0.smithi079.stdout:9/726: chown d3/d7/d26/d3d 499 1 2024-09-10T09:36:10.961 INFO:tasks.workunit.client.0.smithi079.stdout:4/831: mkdir d1/da/d28/d99/d10a 0 2024-09-10T09:36:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:10 smithi079 ceph-mon[27592]: Standby manager daemon smithi135.lbhjof restarted 2024-09-10T09:36:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:10 smithi079 ceph-mon[27592]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:36:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:36:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:36:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:36:10.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:36:10.962 INFO:tasks.workunit.client.0.smithi079.stdout:8/769: mkdir d11/df2/df4 0 2024-09-10T09:36:10.963 INFO:tasks.workunit.client.0.smithi079.stdout:8/770: fsync d11/fc8 0 2024-09-10T09:36:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:10 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof restarted 2024-09-10T09:36:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:10 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:36:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:36:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:36:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:36:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:36:10.979 INFO:tasks.workunit.client.0.smithi079.stdout:2/758: getdents d4/dc/d1c/d86/d1b/d38/d39 0 2024-09-10T09:36:10.981 INFO:tasks.workunit.client.0.smithi079.stdout:8/771: dwrite d11/d2b/d4b/d50/d55/db8/fdb [0,4194304] 0 2024-09-10T09:36:10.981 INFO:tasks.workunit.client.0.smithi079.stdout:8/772: read d11/f20 [71564,36823] 0 2024-09-10T09:36:10.982 INFO:tasks.workunit.client.0.smithi079.stdout:2/759: unlink d4/d5d/f9b 0 2024-09-10T09:36:10.983 INFO:tasks.workunit.client.0.smithi079.stdout:2/760: read d4/dc/ff1 [715545,130085] 0 2024-09-10T09:36:10.984 INFO:tasks.workunit.client.0.smithi079.stdout:8/773: truncate d11/d3b/f6f 2272263 0 2024-09-10T09:36:10.984 INFO:tasks.workunit.client.0.smithi079.stdout:8/774: fdatasync d11/d2b/d4b/fb0 0 2024-09-10T09:36:10.987 INFO:tasks.workunit.client.0.smithi079.stdout:8/775: mknod d11/d2b/d4b/d50/cf5 0 2024-09-10T09:36:10.987 INFO:tasks.workunit.client.0.smithi079.stdout:1/944: sync 2024-09-10T09:36:10.987 INFO:tasks.workunit.client.0.smithi079.stdout:0/821: sync 2024-09-10T09:36:10.988 INFO:tasks.workunit.client.0.smithi079.stdout:7/749: sync 2024-09-10T09:36:10.988 INFO:tasks.workunit.client.0.smithi079.stdout:0/822: truncate d4/d12/d15/d6b/fd6 575126 0 2024-09-10T09:36:10.988 INFO:tasks.workunit.client.0.smithi079.stdout:9/727: rmdir d3/d7/dc/de/db7 39 2024-09-10T09:36:10.989 INFO:tasks.workunit.client.0.smithi079.stdout:1/945: dread d5/df/dd0/f7d [0,4194304] 0 2024-09-10T09:36:10.990 INFO:tasks.workunit.client.0.smithi079.stdout:1/946: dread - d5/df/d11/d76/f120 zero size 2024-09-10T09:36:10.990 INFO:tasks.workunit.client.0.smithi079.stdout:2/761: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fe9 [4077440,83294] 0 2024-09-10T09:36:10.993 INFO:tasks.workunit.client.0.smithi079.stdout:9/728: mknod d3/d7/dc/de/d17/dcf/cf3 0 2024-09-10T09:36:10.993 INFO:tasks.workunit.client.0.smithi079.stdout:9/729: dread - d3/d7/dc/de/da7/fce zero size 2024-09-10T09:36:10.998 INFO:tasks.workunit.client.0.smithi079.stdout:1/947: truncate d5/fe 445485 0 2024-09-10T09:36:11.003 INFO:tasks.workunit.client.0.smithi079.stdout:8/776: rename d11/d48/fc4 to d11/ff6 0 2024-09-10T09:36:11.007 INFO:tasks.workunit.client.0.smithi079.stdout:9/730: mknod d3/d7/d26/d69/ddf/de4/cf4 0 2024-09-10T09:36:11.010 INFO:tasks.workunit.client.0.smithi079.stdout:1/948: symlink d5/d11b/dd1/l13f 0 2024-09-10T09:36:11.010 INFO:tasks.workunit.client.0.smithi079.stdout:1/949: fsync d5/d24/d36/d53/db3/fbc 0 2024-09-10T09:36:11.010 INFO:tasks.workunit.client.0.smithi079.stdout:1/950: chown d5/d4f/d8a/f12f 919475 1 2024-09-10T09:36:11.014 INFO:tasks.workunit.client.0.smithi079.stdout:1/951: creat d5/df/d2e/d10c/d111/f140 x:0 0 0 2024-09-10T09:36:11.016 INFO:tasks.workunit.client.0.smithi079.stdout:9/731: getdents d3/d7/dc/de/d17/d2f 0 2024-09-10T09:36:11.017 INFO:tasks.workunit.client.0.smithi079.stdout:8/777: read d11/d2b/d4b/d7e/f9c [2124654,123239] 0 2024-09-10T09:36:11.020 INFO:tasks.workunit.client.0.smithi079.stdout:8/778: symlink d11/d2b/d4b/d50/d5c/lf7 0 2024-09-10T09:36:11.020 INFO:tasks.workunit.client.0.smithi079.stdout:8/779: dread - d11/d48/fd5 zero size 2024-09-10T09:36:11.021 INFO:tasks.workunit.client.0.smithi079.stdout:0/823: dwrite d4/d1d/d24/d72/fd7 [0,4194304] 0 2024-09-10T09:36:11.021 INFO:tasks.workunit.client.0.smithi079.stdout:0/824: dread - d4/d12/d16/d53/f100 zero size 2024-09-10T09:36:11.021 INFO:tasks.workunit.client.0.smithi079.stdout:0/825: truncate d4/d12/d15/d69/fbf 379125 0 2024-09-10T09:36:11.021 INFO:tasks.workunit.client.0.smithi079.stdout:0/826: fsync d4/d12/d21/d3f/d88/f8c 0 2024-09-10T09:36:11.021 INFO:tasks.workunit.client.0.smithi079.stdout:0/827: chown d4/f70 9 1 2024-09-10T09:36:11.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/952: dread d5/d40/dac/fb7 [0,4194304] 0 2024-09-10T09:36:11.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/953: truncate d5/d4f/d95/f128 739434 0 2024-09-10T09:36:11.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/954: write d5/d40/dac/fb7 [5232416,15861] 0 2024-09-10T09:36:11.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/955: truncate d5/d4f/d8a/f12f 580934 0 2024-09-10T09:36:11.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/956: chown d5/df/d11/d76/lef 15004869 1 2024-09-10T09:36:11.023 INFO:tasks.workunit.client.0.smithi079.stdout:1/957: chown d5/fe 33450042 1 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:7/750: dwrite d4/d6/d4f/d70/fda [0,4194304] 0 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:7/751: write d4/d6/da9/fb5 [409244,85934] 0 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:7/752: stat d4/df/d6b/d9a/d9c 0 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:2/762: dwrite d4/dc/d1c/d86/d1b/d38/d87/fbe [0,4194304] 0 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:2/763: creat d4/dc/d1c/ffa x:0 0 0 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:2/764: fsync d4/dc/d1c/faf 0 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:8/780: link d11/d2b/d4b/f93 d11/d2b/d4b/da8/ff8 0 2024-09-10T09:36:11.024 INFO:tasks.workunit.client.0.smithi079.stdout:8/781: chown d11/d2b/d4b/d7e/cd2 289693727 1 2024-09-10T09:36:11.028 INFO:tasks.workunit.client.0.smithi079.stdout:0/828: mkdir d4/d47/d113 0 2024-09-10T09:36:11.031 INFO:tasks.workunit.client.0.smithi079.stdout:9/732: dwrite d3/d7/dc/de/da7/dac/fd2 [0,4194304] 0 2024-09-10T09:36:11.031 INFO:tasks.workunit.client.0.smithi079.stdout:9/733: chown d3/d7/dc/de/da7/df1 851 1 2024-09-10T09:36:11.033 INFO:tasks.workunit.client.0.smithi079.stdout:1/958: unlink d5/l7 0 2024-09-10T09:36:11.038 INFO:tasks.workunit.client.0.smithi079.stdout:7/753: rmdir d4/df/d3d/d75 39 2024-09-10T09:36:11.056 INFO:tasks.workunit.client.0.smithi079.stdout:7/754: dwrite d4/d6/d4f/d70/ddb/fdc [0,4194304] 0 2024-09-10T09:36:11.056 INFO:tasks.workunit.client.0.smithi079.stdout:7/755: truncate d4/d6/d4f/da7/fcb 69755 0 2024-09-10T09:36:11.056 INFO:tasks.workunit.client.0.smithi079.stdout:7/756: fdatasync d4/df/d3d/f65 0 2024-09-10T09:36:11.056 INFO:tasks.workunit.client.0.smithi079.stdout:7/757: creat d4/df/d19/db9/fe1 x:0 0 0 2024-09-10T09:36:11.056 INFO:tasks.workunit.client.0.smithi079.stdout:7/758: truncate d4/d6/d4f/d70/fbd 1828818 0 2024-09-10T09:36:11.056 INFO:tasks.workunit.client.0.smithi079.stdout:7/759: readlink d4/d6/d38/l89 0 2024-09-10T09:36:11.057 INFO:tasks.workunit.client.0.smithi079.stdout:2/765: getdents d4 0 2024-09-10T09:36:11.062 INFO:tasks.workunit.client.0.smithi079.stdout:9/734: creat d3/ff5 x:0 0 0 2024-09-10T09:36:11.065 INFO:tasks.workunit.client.0.smithi079.stdout:9/735: dread d3/f2b [4194304,4194304] 0 2024-09-10T09:36:11.065 INFO:tasks.workunit.client.0.smithi079.stdout:7/760: write d4/dc/f92 [972788,64396] 0 2024-09-10T09:36:11.076 INFO:tasks.workunit.client.0.smithi079.stdout:2/766: rename d4/dc/d1c/d86/d1b/d38/d39/lef to d4/lfb 0 2024-09-10T09:36:11.080 INFO:tasks.workunit.client.0.smithi079.stdout:9/736: mkdir d3/df6 0 2024-09-10T09:36:11.082 INFO:tasks.workunit.client.0.smithi079.stdout:7/761: mknod d4/dc/d43/dab/ce2 0 2024-09-10T09:36:11.082 INFO:tasks.workunit.client.0.smithi079.stdout:7/762: fdatasync d4/df/f9f 0 2024-09-10T09:36:11.083 INFO:tasks.workunit.client.0.smithi079.stdout:2/767: chown d4/dc/d1c/d86/le 8 1 2024-09-10T09:36:11.085 INFO:tasks.workunit.client.0.smithi079.stdout:9/737: link d3/f6f d3/d7/dc/de/da7/dac/ff7 0 2024-09-10T09:36:11.085 INFO:tasks.workunit.client.0.smithi079.stdout:9/738: write d3/f5c [439656,79227] 0 2024-09-10T09:36:11.088 INFO:tasks.workunit.client.0.smithi079.stdout:8/782: getdents d11/d2b/d4b/da8 0 2024-09-10T09:36:11.088 INFO:tasks.workunit.client.0.smithi079.stdout:8/783: chown d11/d2b/d4b/d50/f57 1961056 1 2024-09-10T09:36:11.089 INFO:tasks.workunit.client.0.smithi079.stdout:2/768: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/lfc 0 2024-09-10T09:36:11.094 INFO:tasks.workunit.client.0.smithi079.stdout:7/763: getdents d4/df/d6b 0 2024-09-10T09:36:11.094 INFO:tasks.workunit.client.0.smithi079.stdout:7/764: chown d4/df/d3d/d75/f9d 1 1 2024-09-10T09:36:11.094 INFO:tasks.workunit.client.0.smithi079.stdout:9/739: dread d3/d7/f5b [0,4194304] 0 2024-09-10T09:36:11.095 INFO:tasks.workunit.client.0.smithi079.stdout:8/784: creat d11/d3b/dda/ff9 x:0 0 0 2024-09-10T09:36:11.096 INFO:tasks.workunit.client.0.smithi079.stdout:5/794: sync 2024-09-10T09:36:11.096 INFO:tasks.workunit.client.0.smithi079.stdout:6/949: sync 2024-09-10T09:36:11.097 INFO:tasks.workunit.client.0.smithi079.stdout:7/765: dread d4/d6/d38/f63 [0,4194304] 0 2024-09-10T09:36:11.099 INFO:tasks.workunit.client.0.smithi079.stdout:2/769: creat d4/dc/d1c/d86/d1b/d38/d39/d31/ffd x:0 0 0 2024-09-10T09:36:11.099 INFO:tasks.workunit.client.0.smithi079.stdout:2/770: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/cbf 190586 1 2024-09-10T09:36:11.099 INFO:tasks.workunit.client.0.smithi079.stdout:2/771: read d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd3 [26624,101089] 0 2024-09-10T09:36:11.101 INFO:tasks.workunit.client.0.smithi079.stdout:9/740: rename d3/d7/d26/d69/ddf/de4 to d3/d7/dc/de/da7/df8 0 2024-09-10T09:36:11.103 INFO:tasks.workunit.client.0.smithi079.stdout:8/785: symlink d11/d2b/d4b/d74/lfa 0 2024-09-10T09:36:11.103 INFO:tasks.workunit.client.0.smithi079.stdout:8/786: fsync d11/d2b/d4b/da8/ff8 0 2024-09-10T09:36:11.103 INFO:tasks.workunit.client.0.smithi079.stdout:8/787: write d11/d48/f7b [2155941,102350] 0 2024-09-10T09:36:11.106 INFO:tasks.workunit.client.0.smithi079.stdout:5/795: link d2/d3/f79 d2/d3/d27/d32/d44/dfa/f105 0 2024-09-10T09:36:11.107 INFO:tasks.workunit.client.0.smithi079.stdout:6/950: dread d4/d8/dd/d76/d46/d88/d108/fb8 [0,4194304] 0 2024-09-10T09:36:11.108 INFO:tasks.workunit.client.0.smithi079.stdout:7/766: symlink d4/df/d6b/d9a/le3 0 2024-09-10T09:36:11.108 INFO:tasks.workunit.client.0.smithi079.stdout:7/767: write d4/d6/d4f/d70/db6/dca/fc8 [44103,101423] 0 2024-09-10T09:36:11.111 INFO:tasks.workunit.client.0.smithi079.stdout:9/741: creat d3/d7/dc/de/d17/dcf/dd0/ff9 x:0 0 0 2024-09-10T09:36:11.115 INFO:tasks.workunit.client.0.smithi079.stdout:8/788: creat d11/dd8/ffb x:0 0 0 2024-09-10T09:36:11.117 INFO:tasks.workunit.client.0.smithi079.stdout:2/772: dwrite d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f64 [0,4194304] 0 2024-09-10T09:36:11.117 INFO:tasks.workunit.client.0.smithi079.stdout:2/773: stat d4/dc/fc7 0 2024-09-10T09:36:11.117 INFO:tasks.workunit.client.0.smithi079.stdout:5/796: write d2/d3/fc9 [1463620,17569] 0 2024-09-10T09:36:11.117 INFO:tasks.workunit.client.0.smithi079.stdout:3/867: sync 2024-09-10T09:36:11.118 INFO:tasks.workunit.client.0.smithi079.stdout:6/951: symlink d4/d8/dd/d76/d46/d88/df7/l136 0 2024-09-10T09:36:11.120 INFO:tasks.workunit.client.0.smithi079.stdout:7/768: creat d4/d6/d4f/d70/db6/dca/fe4 x:0 0 0 2024-09-10T09:36:11.120 INFO:tasks.workunit.client.0.smithi079.stdout:8/789: dread d11/d2b/d4b/f93 [0,4194304] 0 2024-09-10T09:36:11.123 INFO:tasks.workunit.client.0.smithi079.stdout:9/742: symlink d3/d7/dc/de/da7/lfa 0 2024-09-10T09:36:11.137 INFO:tasks.workunit.client.0.smithi079.stdout:9/743: mkdir d3/d7/dc/de/d17/dfb 0 2024-09-10T09:36:11.142 INFO:tasks.workunit.client.0.smithi079.stdout:4/832: sync 2024-09-10T09:36:11.144 INFO:tasks.workunit.client.0.smithi079.stdout:2/774: dwrite d4/d5d/fa3 [0,4194304] 0 2024-09-10T09:36:11.144 INFO:tasks.workunit.client.0.smithi079.stdout:2/775: truncate d4/dc/d1c/ffa 239087 0 2024-09-10T09:36:11.145 INFO:tasks.workunit.client.0.smithi079.stdout:2/776: write d4/dc/f14 [1127786,24809] 0 2024-09-10T09:36:11.148 INFO:tasks.workunit.client.0.smithi079.stdout:4/833: mkdir d1/da/d16/d88/d10b 0 2024-09-10T09:36:11.148 INFO:tasks.workunit.client.0.smithi079.stdout:4/834: fdatasync d1/d38/fdb 0 2024-09-10T09:36:11.160 INFO:tasks.workunit.client.0.smithi079.stdout:3/868: dwrite d4/f13 [0,4194304] 0 2024-09-10T09:36:11.161 INFO:tasks.workunit.client.0.smithi079.stdout:7/769: dwrite d4/d6/d4f/d70/db6/dca/fc8 [0,4194304] 0 2024-09-10T09:36:11.161 INFO:tasks.workunit.client.0.smithi079.stdout:5/797: dwrite d2/d3/d27/d32/d44/ff1 [0,4194304] 0 2024-09-10T09:36:11.163 INFO:tasks.workunit.client.0.smithi079.stdout:2/777: rename d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/db0/lf2 to d4/dc/d1c/d86/d1b/d38/lfe 0 2024-09-10T09:36:11.164 INFO:tasks.workunit.client.0.smithi079.stdout:9/744: dwrite d3/d7/d26/f8f [0,4194304] 0 2024-09-10T09:36:11.164 INFO:tasks.workunit.client.0.smithi079.stdout:9/745: stat d3/d7/d26/l29 0 2024-09-10T09:36:11.174 INFO:tasks.workunit.client.0.smithi079.stdout:7/770: dread d4/d6/d4f/d70/db6/dca/fc8 [0,4194304] 0 2024-09-10T09:36:11.176 INFO:tasks.workunit.client.0.smithi079.stdout:3/869: symlink d4/da/d8a/dd7/d10e/dbe/l10f 0 2024-09-10T09:36:11.178 INFO:tasks.workunit.client.0.smithi079.stdout:2/778: write d4/dc/d1c/d86/d1b/d38/d39/d31/f67 [414517,25942] 0 2024-09-10T09:36:11.184 INFO:tasks.workunit.client.0.smithi079.stdout:2/779: dread d4/dc/d1c/d86/d1b/d38/d39/d31/f3b [0,4194304] 0 2024-09-10T09:36:11.187 INFO:tasks.workunit.client.0.smithi079.stdout:4/835: dwrite d1/da/d16/d88/fe1 [0,4194304] 0 2024-09-10T09:36:11.190 INFO:tasks.workunit.client.0.smithi079.stdout:9/746: dwrite d3/d7/dc/de/d17/d2f/f5e [0,4194304] 0 2024-09-10T09:36:11.191 INFO:tasks.workunit.client.0.smithi079.stdout:7/771: dwrite d4/dc/d43/dab/fd3 [0,4194304] 0 2024-09-10T09:36:11.193 INFO:tasks.workunit.client.0.smithi079.stdout:3/870: mknod d4/da/d8a/c110 0 2024-09-10T09:36:11.198 INFO:tasks.workunit.client.0.smithi079.stdout:2/780: rename d4/dc/ff1 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fff 0 2024-09-10T09:36:11.201 INFO:tasks.workunit.client.0.smithi079.stdout:5/798: mknod d2/d3/d27/d32/d44/c106 0 2024-09-10T09:36:11.203 INFO:tasks.workunit.client.0.smithi079.stdout:3/871: write d4/da/d67/db8/fd6 [1508883,42250] 0 2024-09-10T09:36:11.207 INFO:tasks.workunit.client.0.smithi079.stdout:4/836: symlink d1/d38/l10c 0 2024-09-10T09:36:11.208 INFO:tasks.workunit.client.0.smithi079.stdout:2/781: write d4/f23 [7338253,65164] 0 2024-09-10T09:36:11.208 INFO:tasks.workunit.client.0.smithi079.stdout:2/782: chown d4/dc/d1c/c8c 10448 1 2024-09-10T09:36:11.222 INFO:tasks.workunit.client.0.smithi079.stdout:7/772: unlink d4/d6/d4f/d66/la0 0 2024-09-10T09:36:11.224 INFO:tasks.workunit.client.0.smithi079.stdout:4/837: dwrite d1/da/d16/d88/fa3 [0,4194304] 0 2024-09-10T09:36:11.225 INFO:tasks.workunit.client.0.smithi079.stdout:5/799: rename d2/d3/d27/d70/lda to d2/d3/d27/d32/d44/db4/l107 0 2024-09-10T09:36:11.231 INFO:tasks.workunit.client.0.smithi079.stdout:2/783: unlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/le0 0 2024-09-10T09:36:11.232 INFO:tasks.workunit.client.0.smithi079.stdout:2/784: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/d61/ff7 0 2024-09-10T09:36:11.232 INFO:tasks.workunit.client.0.smithi079.stdout:2/785: chown d4/dc/d1c/d86/d1b/d38/d39/d31/d52/fc9 0 1 2024-09-10T09:36:11.235 INFO:tasks.workunit.client.0.smithi079.stdout:9/747: link d3/d7/c34 d3/d40/dc0/cfc 0 2024-09-10T09:36:11.235 INFO:tasks.workunit.client.0.smithi079.stdout:9/748: chown d3/d7/f9f 31677 1 2024-09-10T09:36:11.236 INFO:tasks.workunit.client.0.smithi079.stdout:9/749: creat d3/d7/dc/de/d17/d2f/d74/ffd x:0 0 0 2024-09-10T09:36:11.236 INFO:tasks.workunit.client.0.smithi079.stdout:9/750: chown d3/d7/dc/de/d17/d12/l3c 4 1 2024-09-10T09:36:11.244 INFO:tasks.workunit.client.0.smithi079.stdout:2/786: rename d4/dc/d1c/d86/d1b/d38/d39/d31/d52/fc9 to d4/dc/d1c/f100 0 2024-09-10T09:36:11.249 INFO:tasks.workunit.client.0.smithi079.stdout:0/829: sync 2024-09-10T09:36:11.249 INFO:tasks.workunit.client.0.smithi079.stdout:0/830: read - d4/d12/d21/d3f/d88/fed zero size 2024-09-10T09:36:11.249 INFO:tasks.workunit.client.0.smithi079.stdout:0/831: write d4/d1d/d24/fa9 [2668366,87751] 0 2024-09-10T09:36:11.250 INFO:tasks.workunit.client.0.smithi079.stdout:9/751: link d3/d7/dc/de/f46 d3/d7/dc/de/da7/df1/ffe 0 2024-09-10T09:36:11.253 INFO:tasks.workunit.client.0.smithi079.stdout:5/800: dwrite d2/d3/d27/d32/db6/fe0 [0,4194304] 0 2024-09-10T09:36:11.254 INFO:tasks.workunit.client.0.smithi079.stdout:5/801: write d2/d3/d27/d32/de3/d4d/f57 [557384,80490] 0 2024-09-10T09:36:11.257 INFO:tasks.workunit.client.0.smithi079.stdout:3/872: dwrite d4/da/d17/d2d/d43/d4c/f9d [0,4194304] 0 2024-09-10T09:36:11.257 INFO:tasks.workunit.client.0.smithi079.stdout:0/832: rmdir d4/d12/d16/de3/d102 39 2024-09-10T09:36:11.264 INFO:tasks.workunit.client.0.smithi079.stdout:5/802: symlink d2/d3/d27/d32/de3/d4d/l108 0 2024-09-10T09:36:11.268 INFO:tasks.workunit.client.0.smithi079.stdout:3/873: rename d4/da/d17/dc1/dd4 to d4/da/d17/ddf/d111 0 2024-09-10T09:36:11.268 INFO:tasks.workunit.client.0.smithi079.stdout:3/874: stat d4/da/l14 0 2024-09-10T09:36:11.268 INFO:tasks.workunit.client.0.smithi079.stdout:3/875: write d4/da/d17/d2d/d43/d49/fa7 [827533,112217] 0 2024-09-10T09:36:11.268 INFO:tasks.workunit.client.0.smithi079.stdout:3/876: readlink d4/da/d17/d38/l5c 0 2024-09-10T09:36:11.269 INFO:tasks.workunit.client.0.smithi079.stdout:1/959: sync 2024-09-10T09:36:11.270 INFO:tasks.workunit.client.0.smithi079.stdout:2/787: dwrite d4/d8f/fb5 [0,4194304] 0 2024-09-10T09:36:11.270 INFO:tasks.workunit.client.0.smithi079.stdout:0/833: dread d4/d12/d16/de3/fb2 [0,4194304] 0 2024-09-10T09:36:11.271 INFO:tasks.workunit.client.0.smithi079.stdout:9/752: dwrite d3/d7/dc/de/da7/fc2 [0,4194304] 0 2024-09-10T09:36:11.272 INFO:tasks.workunit.client.0.smithi079.stdout:3/877: rename d4/da/d17/d38/d42/f84 to d4/da/d8a/dd7/d10e/dbe/d104/f112 0 2024-09-10T09:36:11.274 INFO:tasks.workunit.client.0.smithi079.stdout:5/803: dread d2/d3/fe [0,4194304] 0 2024-09-10T09:36:11.281 INFO:tasks.workunit.client.0.smithi079.stdout:6/952: sync 2024-09-10T09:36:11.281 INFO:tasks.workunit.client.0.smithi079.stdout:8/790: sync 2024-09-10T09:36:11.289 INFO:tasks.workunit.client.0.smithi079.stdout:6/953: dread d4/d8/dc/d93/dc4/fce [0,4194304] 0 2024-09-10T09:36:11.291 INFO:tasks.workunit.client.0.smithi079.stdout:9/753: mknod d3/d7/dc/de/db7/cff 0 2024-09-10T09:36:11.294 INFO:tasks.workunit.client.0.smithi079.stdout:3/878: mkdir d4/da/d17/d2d/d43/d113 0 2024-09-10T09:36:11.295 INFO:tasks.workunit.client.0.smithi079.stdout:6/954: dread d4/d8/dc/d12/d29/f62 [0,4194304] 0 2024-09-10T09:36:11.301 INFO:tasks.workunit.client.0.smithi079.stdout:8/791: symlink d11/d3b/dda/lfc 0 2024-09-10T09:36:11.301 INFO:tasks.workunit.client.0.smithi079.stdout:8/792: write d11/f31 [654341,49607] 0 2024-09-10T09:36:11.301 INFO:tasks.workunit.client.0.smithi079.stdout:8/793: dread - d11/d2b/d4b/d50/d5c/fa0 zero size 2024-09-10T09:36:11.301 INFO:tasks.workunit.client.0.smithi079.stdout:8/794: stat d11/d3b/l5e 0 2024-09-10T09:36:11.305 INFO:tasks.workunit.client.0.smithi079.stdout:3/879: creat d4/da/d18/daf/d10b/f114 x:0 0 0 2024-09-10T09:36:11.306 INFO:tasks.workunit.client.0.smithi079.stdout:0/834: dwrite d4/d12/d16/de3/dac/f10d [0,4194304] 0 2024-09-10T09:36:11.306 INFO:tasks.workunit.client.0.smithi079.stdout:0/835: chown d4/d12/d21/d3f/d80/le2 1 1 2024-09-10T09:36:11.306 INFO:tasks.workunit.client.0.smithi079.stdout:0/836: chown d4/d47 12635 1 2024-09-10T09:36:11.306 INFO:tasks.workunit.client.0.smithi079.stdout:0/837: stat d4/d1d/l7f 0 2024-09-10T09:36:11.307 INFO:tasks.workunit.client.0.smithi079.stdout:6/955: creat d4/d8/dd/d76/d46/d88/d108/dda/f137 x:0 0 0 2024-09-10T09:36:11.308 INFO:tasks.workunit.client.0.smithi079.stdout:2/788: dwrite d4/dc/d1c/d86/f98 [0,4194304] 0 2024-09-10T09:36:11.308 INFO:tasks.workunit.client.0.smithi079.stdout:2/789: chown d4/d8f/cb3 33292626 1 2024-09-10T09:36:11.308 INFO:tasks.workunit.client.0.smithi079.stdout:2/790: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f76 [875487,75951] 0 2024-09-10T09:36:11.308 INFO:tasks.workunit.client.0.smithi079.stdout:2/791: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fec 40 1 2024-09-10T09:36:11.309 INFO:tasks.workunit.client.0.smithi079.stdout:2/792: chown d4/dc/d1c/d86/f16 1806403 1 2024-09-10T09:36:11.309 INFO:tasks.workunit.client.0.smithi079.stdout:2/793: write d4/d5d/f8e [211806,4188] 0 2024-09-10T09:36:11.309 INFO:tasks.workunit.client.0.smithi079.stdout:5/804: dwrite d2/d3/d5e/d85/f8e [0,4194304] 0 2024-09-10T09:36:11.309 INFO:tasks.workunit.client.0.smithi079.stdout:8/795: stat d11/d2b/fad 0 2024-09-10T09:36:11.309 INFO:tasks.workunit.client.0.smithi079.stdout:8/796: read - d11/f45 zero size 2024-09-10T09:36:11.311 INFO:tasks.workunit.client.0.smithi079.stdout:3/880: dread d4/da/d17/f30 [0,4194304] 0 2024-09-10T09:36:11.313 INFO:tasks.workunit.client.0.smithi079.stdout:3/881: dread d4/da/d17/d2d/d43/f74 [0,4194304] 0 2024-09-10T09:36:11.316 INFO:tasks.workunit.client.0.smithi079.stdout:0/838: unlink d4/d12/d39/f48 0 2024-09-10T09:36:11.316 INFO:tasks.workunit.client.0.smithi079.stdout:0/839: read - d4/d12/d21/d3f/d80/fc4 zero size 2024-09-10T09:36:11.316 INFO:tasks.workunit.client.0.smithi079.stdout:0/840: fdatasync d4/fe 0 2024-09-10T09:36:11.322 INFO:tasks.workunit.client.0.smithi079.stdout:5/805: write d2/d3/d27/d32/f90 [3243561,94079] 0 2024-09-10T09:36:11.325 INFO:tasks.workunit.client.0.smithi079.stdout:6/956: dread d4/d8/dc/d98/fff [0,4194304] 0 2024-09-10T09:36:11.329 INFO:tasks.workunit.client.0.smithi079.stdout:2/794: creat d4/dc/d1c/d86/d1b/f101 x:0 0 0 2024-09-10T09:36:11.331 INFO:tasks.workunit.client.0.smithi079.stdout:0/841: dread d4/d12/d16/de3/fb2 [0,4194304] 0 2024-09-10T09:36:11.333 INFO:tasks.workunit.client.0.smithi079.stdout:8/797: symlink d11/dbd/lfd 0 2024-09-10T09:36:11.337 INFO:tasks.workunit.client.0.smithi079.stdout:5/806: rmdir d2 39 2024-09-10T09:36:11.341 INFO:tasks.workunit.client.0.smithi079.stdout:6/957: creat d4/d8/dc/d93/d4b/d113/f138 x:0 0 0 2024-09-10T09:36:11.341 INFO:tasks.workunit.client.0.smithi079.stdout:6/958: fsync d4/d8/dc/fee 0 2024-09-10T09:36:11.344 INFO:tasks.workunit.client.0.smithi079.stdout:3/882: dwrite d4/f2b [4194304,4194304] 0 2024-09-10T09:36:11.344 INFO:tasks.workunit.client.0.smithi079.stdout:3/883: creat d4/da/d17/ddf/f115 x:0 0 0 2024-09-10T09:36:11.344 INFO:tasks.workunit.client.0.smithi079.stdout:3/884: write d4/da/d17/d2d/d43/f74 [713882,114298] 0 2024-09-10T09:36:11.344 INFO:tasks.workunit.client.0.smithi079.stdout:3/885: fsync d4/f2a 0 2024-09-10T09:36:11.344 INFO:tasks.workunit.client.0.smithi079.stdout:2/795: creat d4/dc/d1c/d86/d1b/d38/d39/f102 x:0 0 0 2024-09-10T09:36:11.345 INFO:tasks.workunit.client.0.smithi079.stdout:0/842: mkdir d4/d114 0 2024-09-10T09:36:11.346 INFO:tasks.workunit.client.0.smithi079.stdout:5/807: write d2/fd5 [4132696,41233] 0 2024-09-10T09:36:11.346 INFO:tasks.workunit.client.0.smithi079.stdout:5/808: chown d2/d3/d27/faa 133238 1 2024-09-10T09:36:11.348 INFO:tasks.workunit.client.0.smithi079.stdout:8/798: creat d11/d2b/d4b/d50/d9e/dca/dd0/ffe x:0 0 0 2024-09-10T09:36:11.358 INFO:tasks.workunit.client.0.smithi079.stdout:3/886: symlink d4/da/d67/db8/l116 0 2024-09-10T09:36:11.359 INFO:tasks.workunit.client.0.smithi079.stdout:3/887: chown d4/da/d18/db5/cd9 1541366565 1 2024-09-10T09:36:11.359 INFO:tasks.workunit.client.0.smithi079.stdout:3/888: readlink d4/da/d18/l36 0 2024-09-10T09:36:11.359 INFO:tasks.workunit.client.0.smithi079.stdout:3/889: write d4/da/d17/d72/ff7 [336036,60092] 0 2024-09-10T09:36:11.359 INFO:tasks.workunit.client.0.smithi079.stdout:3/890: read - d4/da/d17/d2d/fae zero size 2024-09-10T09:36:11.359 INFO:tasks.workunit.client.0.smithi079.stdout:3/891: write d4/da/d17/d38/d42/f53 [651397,124468] 0 2024-09-10T09:36:11.360 INFO:tasks.workunit.client.0.smithi079.stdout:2/796: mknod d4/dc/d1c/d86/d1b/d38/d39/d31/d49/c103 0 2024-09-10T09:36:11.361 INFO:tasks.workunit.client.0.smithi079.stdout:5/809: truncate d2/d3/d27/f49 3555909 0 2024-09-10T09:36:11.361 INFO:tasks.workunit.client.0.smithi079.stdout:5/810: write d2/d3/d5e/d61/d71/fb9 [230491,56849] 0 2024-09-10T09:36:11.373 INFO:tasks.workunit.client.0.smithi079.stdout:2/797: dread d4/dc/d1c/d86/d1b/d38/d39/f4c [0,4194304] 0 2024-09-10T09:36:11.375 INFO:tasks.workunit.client.0.smithi079.stdout:6/959: dwrite d4/d8/dc/d93/dc4/f116 [0,4194304] 0 2024-09-10T09:36:11.376 INFO:tasks.workunit.client.0.smithi079.stdout:2/798: mkdir d4/dc/d1c/d104 0 2024-09-10T09:36:11.379 INFO:tasks.workunit.client.0.smithi079.stdout:8/799: dwrite d11/d2b/d4b/d74/da2/fba [0,4194304] 0 2024-09-10T09:36:11.379 INFO:tasks.workunit.client.0.smithi079.stdout:8/800: truncate d11/d2b/d4b/d50/d55/d87/fc3 156629 0 2024-09-10T09:36:11.379 INFO:tasks.workunit.client.0.smithi079.stdout:0/843: dwrite d4/d12/d21/d3f/d80/fc4 [0,4194304] 0 2024-09-10T09:36:11.379 INFO:tasks.workunit.client.0.smithi079.stdout:0/844: write d4/fd5 [968415,1292] 0 2024-09-10T09:36:11.388 INFO:tasks.workunit.client.0.smithi079.stdout:0/845: dread d4/d12/f14 [0,4194304] 0 2024-09-10T09:36:11.394 INFO:tasks.workunit.client.0.smithi079.stdout:2/799: creat d4/dc/d1c/d104/f105 x:0 0 0 2024-09-10T09:36:11.394 INFO:tasks.workunit.client.0.smithi079.stdout:2/800: fsync d4/dc/d1c/d86/d1b/d38/d39/d31/fa2 0 2024-09-10T09:36:11.394 INFO:tasks.workunit.client.0.smithi079.stdout:2/801: fdatasync d4/dc/d1c/d86/d1b/d38/d39/d99/f15 0 2024-09-10T09:36:11.394 INFO:tasks.workunit.client.0.smithi079.stdout:2/802: chown d4/dc/d1c/d86/f55 60 1 2024-09-10T09:36:11.394 INFO:tasks.workunit.client.0.smithi079.stdout:2/803: stat d4/dc/d1c/l8a 0 2024-09-10T09:36:11.394 INFO:tasks.workunit.client.0.smithi079.stdout:3/892: dwrite d4/da/d17/f32 [0,4194304] 0 2024-09-10T09:36:11.394 INFO:tasks.workunit.client.0.smithi079.stdout:3/893: chown d4/da/d17/d72/f75 27209259 1 2024-09-10T09:36:11.395 INFO:tasks.workunit.client.0.smithi079.stdout:5/811: dwrite d2/fab [0,4194304] 0 2024-09-10T09:36:11.395 INFO:tasks.workunit.client.0.smithi079.stdout:5/812: write d2/d3/d5e/d73/f8b [416187,18545] 0 2024-09-10T09:36:11.395 INFO:tasks.workunit.client.0.smithi079.stdout:6/960: dwrite d4/d8/dc/d12/d29/fcc [4194304,4194304] 0 2024-09-10T09:36:11.395 INFO:tasks.workunit.client.0.smithi079.stdout:6/961: creat d4/d8/dc/d12/d29/f139 x:0 0 0 2024-09-10T09:36:11.398 INFO:tasks.workunit.client.0.smithi079.stdout:7/773: sync 2024-09-10T09:36:11.398 INFO:tasks.workunit.client.0.smithi079.stdout:4/838: sync 2024-09-10T09:36:11.399 INFO:tasks.workunit.client.0.smithi079.stdout:8/801: creat d11/d2b/d4b/da8/fff x:0 0 0 2024-09-10T09:36:11.414 INFO:tasks.workunit.client.0.smithi079.stdout:0/846: dwrite d4/fd5 [0,4194304] 0 2024-09-10T09:36:11.416 INFO:tasks.workunit.client.0.smithi079.stdout:5/813: dwrite d2/d3/d27/d32/d39/dc4/ff8 [0,4194304] 0 2024-09-10T09:36:11.426 INFO:tasks.workunit.client.0.smithi079.stdout:7/774: truncate d4/d6/fa 6697666 0 2024-09-10T09:36:11.427 INFO:tasks.workunit.client.0.smithi079.stdout:4/839: link d1/da/d3b/d107/d108/db4/cc7 d1/da/d3b/d107/d108/c10d 0 2024-09-10T09:36:11.428 INFO:tasks.workunit.client.0.smithi079.stdout:1/960: sync 2024-09-10T09:36:11.429 INFO:tasks.workunit.client.0.smithi079.stdout:8/802: truncate d11/d2b/d4b/d50/d55/f53 3830566 0 2024-09-10T09:36:11.429 INFO:tasks.workunit.client.0.smithi079.stdout:8/803: fsync d11/d2b/d4b/d50/d5c/f71 0 2024-09-10T09:36:11.429 INFO:tasks.workunit.client.0.smithi079.stdout:8/804: stat d11/d91/fc6 0 2024-09-10T09:36:11.429 INFO:tasks.workunit.client.0.smithi079.stdout:8/805: fdatasync d11/f20 0 2024-09-10T09:36:11.429 INFO:tasks.workunit.client.0.smithi079.stdout:8/806: creat d11/d3b/dda/f100 x:0 0 0 2024-09-10T09:36:11.430 INFO:tasks.workunit.client.0.smithi079.stdout:2/804: getdents d4/dc/d1c/d86/d1b/d38/d39/d31 0 2024-09-10T09:36:11.432 INFO:tasks.workunit.client.0.smithi079.stdout:2/805: dread d4/dc/faa [0,4194304] 0 2024-09-10T09:36:11.434 INFO:tasks.workunit.client.0.smithi079.stdout:8/807: dread d11/f1d [0,4194304] 0 2024-09-10T09:36:11.434 INFO:tasks.workunit.client.0.smithi079.stdout:8/808: dread - d11/d2b/d4b/d50/d55/f78 zero size 2024-09-10T09:36:11.436 INFO:tasks.workunit.client.0.smithi079.stdout:5/814: truncate d2/f3b 486167 0 2024-09-10T09:36:11.436 INFO:tasks.workunit.client.0.smithi079.stdout:5/815: fdatasync d2/d3/d27/f2c 0 2024-09-10T09:36:11.441 INFO:tasks.workunit.client.0.smithi079.stdout:6/962: rmdir d4/d8/dc/d93/d4b/d113 39 2024-09-10T09:36:11.441 INFO:tasks.workunit.client.0.smithi079.stdout:6/963: write d4/d8/dd/d76/d46/d88/dbf/fd0 [5209709,4331] 0 2024-09-10T09:36:11.441 INFO:tasks.workunit.client.0.smithi079.stdout:6/964: dread - d4/d8/dd/d41/d51/fe3 zero size 2024-09-10T09:36:11.441 INFO:tasks.workunit.client.0.smithi079.stdout:6/965: truncate d4/d8/d74/d101/f11d 862238 0 2024-09-10T09:36:11.442 INFO:tasks.workunit.client.0.smithi079.stdout:7/775: symlink d4/d6/d38/dc1/le5 0 2024-09-10T09:36:11.444 INFO:tasks.workunit.client.0.smithi079.stdout:4/840: creat d1/da/d16/d21/d32/f10e x:0 0 0 2024-09-10T09:36:11.446 INFO:tasks.workunit.client.0.smithi079.stdout:1/961: mknod d5/d9e/dc9/c141 0 2024-09-10T09:36:11.447 INFO:tasks.workunit.client.0.smithi079.stdout:1/962: chown d5/d40/l97 45038 1 2024-09-10T09:36:11.447 INFO:tasks.workunit.client.0.smithi079.stdout:1/963: fdatasync d5/d24/d36/d3a/f3d 0 2024-09-10T09:36:11.447 INFO:tasks.workunit.client.0.smithi079.stdout:1/964: fsync d5/df/dc6/fca 0 2024-09-10T09:36:11.452 INFO:tasks.workunit.client.0.smithi079.stdout:3/894: rename d4/da/d67/db8 to d4/da/d8a/dd7/d10e/d79/dab/d117 0 2024-09-10T09:36:11.457 INFO:tasks.workunit.client.0.smithi079.stdout:2/806: link d4/dc/d1c/d86/d1b/d38/lb9 d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/l106 0 2024-09-10T09:36:11.457 INFO:tasks.workunit.client.0.smithi079.stdout:2/807: stat d4/d5d/fdf 0 2024-09-10T09:36:11.460 INFO:tasks.workunit.client.0.smithi079.stdout:3/895: dread d4/da/d17/d2d/d43/f74 [0,4194304] 0 2024-09-10T09:36:11.460 INFO:tasks.workunit.client.0.smithi079.stdout:3/896: fsync d4/da/d17/d2d/d43/d49/f68 0 2024-09-10T09:36:11.460 INFO:tasks.workunit.client.0.smithi079.stdout:8/809: creat d11/d2b/d4b/f101 x:0 0 0 2024-09-10T09:36:11.460 INFO:tasks.workunit.client.0.smithi079.stdout:8/810: chown d11/d2b/d4b/d50/d9e/dca 1 1 2024-09-10T09:36:11.461 INFO:tasks.workunit.client.0.smithi079.stdout:8/811: chown d11/d48/fd5 48 1 2024-09-10T09:36:11.461 INFO:tasks.workunit.client.0.smithi079.stdout:8/812: fsync d11/d3b/f6f 0 2024-09-10T09:36:11.461 INFO:tasks.workunit.client.0.smithi079.stdout:8/813: dread - d11/dbd/fd9 zero size 2024-09-10T09:36:11.463 INFO:tasks.workunit.client.0.smithi079.stdout:5/816: truncate d2/d3/d27/d32/d44/f4c 341266 0 2024-09-10T09:36:11.472 INFO:tasks.workunit.client.0.smithi079.stdout:4/841: rename d1/da/d28/d95/c8a to d1/da/d28/d47/da1/d83/dfe/c10f 0 2024-09-10T09:36:11.474 INFO:tasks.workunit.client.0.smithi079.stdout:2/808: truncate d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f76 122535 0 2024-09-10T09:36:11.477 INFO:tasks.workunit.client.0.smithi079.stdout:8/814: truncate d11/d2b/d4b/d74/da2/fba 2557991 0 2024-09-10T09:36:11.479 INFO:tasks.workunit.client.0.smithi079.stdout:5/817: rmdir d2/d3/d5e/d85/dcc 0 2024-09-10T09:36:11.480 INFO:tasks.workunit.client.0.smithi079.stdout:5/818: truncate d2/d3/f84 749541 0 2024-09-10T09:36:11.480 INFO:tasks.workunit.client.0.smithi079.stdout:7/776: dwrite d4/d6/d3e/f7a [0,4194304] 0 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:1/965: dwrite d5/d40/fc1 [0,4194304] 0 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:1/966: write d5/df/dd0/f7d [513124,75607] 0 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:1/967: chown d5/d24/d36/d3a/d85/db1/d11a/d117/f12d 850672950 1 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:1/968: chown d5/df/dd0/d57 2272843 1 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:1/969: write d5/f19 [341721,74065] 0 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:1/970: chown d5/d24/d36/d53/f61 1 1 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:6/966: mknod d4/d8/dc/d1c/c13a 0 2024-09-10T09:36:11.484 INFO:tasks.workunit.client.0.smithi079.stdout:6/967: stat d4/d8/d74/f123 0 2024-09-10T09:36:11.485 INFO:tasks.workunit.client.0.smithi079.stdout:3/897: dwrite d4/da/d56/d7b/fb0 [0,4194304] 0 2024-09-10T09:36:11.489 INFO:tasks.workunit.client.0.smithi079.stdout:4/842: unlink d1/da/d16/d21/l35 0 2024-09-10T09:36:11.491 INFO:tasks.workunit.client.0.smithi079.stdout:2/809: mknod d4/dc/d1c/d104/c107 0 2024-09-10T09:36:11.494 INFO:tasks.workunit.client.0.smithi079.stdout:8/815: truncate d11/d2b/d4b/d50/d5c/f95 1911278 0 2024-09-10T09:36:11.495 INFO:tasks.workunit.client.0.smithi079.stdout:1/971: dread d5/d9e/dc9/ff4 [0,4194304] 0 2024-09-10T09:36:11.495 INFO:tasks.workunit.client.0.smithi079.stdout:5/819: symlink d2/d3/d5e/l109 0 2024-09-10T09:36:11.500 INFO:tasks.workunit.client.0.smithi079.stdout:9/754: sync 2024-09-10T09:36:11.501 INFO:tasks.workunit.client.0.smithi079.stdout:5/820: dread d2/f31 [0,4194304] 0 2024-09-10T09:36:11.501 INFO:tasks.workunit.client.0.smithi079.stdout:7/777: dwrite d4/dc/f8f [0,4194304] 0 2024-09-10T09:36:11.507 INFO:tasks.workunit.client.0.smithi079.stdout:6/968: mkdir d4/d8/dd/d76/d46/d88/d13b 0 2024-09-10T09:36:11.507 INFO:tasks.workunit.client.0.smithi079.stdout:6/969: stat d4/d8/dd/d76/d46/df0/c12c 0 2024-09-10T09:36:11.507 INFO:tasks.workunit.client.0.smithi079.stdout:3/898: dread d4/da/d17/f3f [0,4194304] 0 2024-09-10T09:36:11.519 INFO:tasks.workunit.client.0.smithi079.stdout:7/778: dwrite d4/dc/d43/dab/fd3 [0,4194304] 0 2024-09-10T09:36:11.524 INFO:tasks.workunit.client.0.smithi079.stdout:4/843: creat d1/da/d3b/de0/f110 x:0 0 0 2024-09-10T09:36:11.527 INFO:tasks.workunit.client.0.smithi079.stdout:2/810: link d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd6 d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/f108 0 2024-09-10T09:36:11.527 INFO:tasks.workunit.client.0.smithi079.stdout:2/811: read d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd0 [1720614,51501] 0 2024-09-10T09:36:11.527 INFO:tasks.workunit.client.0.smithi079.stdout:2/812: read - d4/dc/d1c/f100 zero size 2024-09-10T09:36:11.528 INFO:tasks.workunit.client.0.smithi079.stdout:6/970: dwrite d4/d8/dc/d12/d29/f62 [0,4194304] 0 2024-09-10T09:36:11.532 INFO:tasks.workunit.client.0.smithi079.stdout:8/816: creat d11/d2b/d4b/d74/f102 x:0 0 0 2024-09-10T09:36:11.532 INFO:tasks.workunit.client.0.smithi079.stdout:8/817: write d11/d2b/d4b/da8/fce [804635,31609] 0 2024-09-10T09:36:11.532 INFO:tasks.workunit.client.0.smithi079.stdout:8/818: truncate d11/d3b/dda/ff9 873200 0 2024-09-10T09:36:11.532 INFO:tasks.workunit.client.0.smithi079.stdout:8/819: chown d11/d2b/d4b/d50/d5c/cbc 207125 1 2024-09-10T09:36:11.533 INFO:tasks.workunit.client.0.smithi079.stdout:1/972: creat d5/df/f142 x:0 0 0 2024-09-10T09:36:11.535 INFO:tasks.workunit.client.0.smithi079.stdout:9/755: mkdir d3/d7/dc/de/da7/df1/d100 0 2024-09-10T09:36:11.537 INFO:tasks.workunit.client.0.smithi079.stdout:5/821: symlink d2/d3/d27/d32/db6/l10a 0 2024-09-10T09:36:11.544 INFO:tasks.workunit.client.0.smithi079.stdout:3/899: rmdir d4/da/d8a/dd7/d10e/dbe/d10c 0 2024-09-10T09:36:11.544 INFO:tasks.workunit.client.0.smithi079.stdout:8/820: dread fe [0,4194304] 0 2024-09-10T09:36:11.544 INFO:tasks.workunit.client.0.smithi079.stdout:8/821: readlink d11/dbd/ddc/le2 0 2024-09-10T09:36:11.546 INFO:tasks.workunit.client.0.smithi079.stdout:9/756: dread d3/d7/dc/de/da7/fc2 [0,4194304] 0 2024-09-10T09:36:11.546 INFO:tasks.workunit.client.0.smithi079.stdout:9/757: chown d3/f2b 20776 1 2024-09-10T09:36:11.548 INFO:tasks.workunit.client.0.smithi079.stdout:7/779: mkdir d4/df/d3d/de6 0 2024-09-10T09:36:11.548 INFO:tasks.workunit.client.0.smithi079.stdout:7/780: dread - d4/df/d3d/d82/fdd zero size 2024-09-10T09:36:11.548 INFO:tasks.workunit.client.0.smithi079.stdout:7/781: chown d4/d6/d4f/d70/dba/fcd 2330721 1 2024-09-10T09:36:11.548 INFO:tasks.workunit.client.0.smithi079.stdout:2/813: dwrite d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f64 [0,4194304] 0 2024-09-10T09:36:11.549 INFO:tasks.workunit.client.0.smithi079.stdout:2/814: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/f109 x:0 0 0 2024-09-10T09:36:11.549 INFO:tasks.workunit.client.0.smithi079.stdout:2/815: write d4/dc/d1c/d86/d1b/d38/d87/fe7 [602224,14730] 0 2024-09-10T09:36:11.550 INFO:tasks.workunit.client.0.smithi079.stdout:4/844: symlink d1/da/d28/d95/l111 0 2024-09-10T09:36:11.554 INFO:tasks.workunit.client.0.smithi079.stdout:6/971: mknod d4/d8/dc/d93/d4b/c13c 0 2024-09-10T09:36:11.556 INFO:tasks.workunit.client.0.smithi079.stdout:1/973: truncate d5/d24/d36/d3a/fb5 2542888 0 2024-09-10T09:36:11.557 INFO:tasks.workunit.client.0.smithi079.stdout:1/974: write d5/f22 [3730547,82711] 0 2024-09-10T09:36:11.558 INFO:tasks.workunit.client.0.smithi079.stdout:5/822: getdents d2/d3/d27/d70/d80 0 2024-09-10T09:36:11.558 INFO:tasks.workunit.client.0.smithi079.stdout:5/823: chown d2/d3/d5e/l81 14855037 1 2024-09-10T09:36:11.559 INFO:tasks.workunit.client.0.smithi079.stdout:7/782: write d4/d6/fa [4082253,60255] 0 2024-09-10T09:36:11.559 INFO:tasks.workunit.client.0.smithi079.stdout:7/783: chown d4/df/d3d/d82/f5c 759536 1 2024-09-10T09:36:11.561 INFO:tasks.workunit.client.0.smithi079.stdout:2/816: write d4/dc/fc7 [2481537,111792] 0 2024-09-10T09:36:11.561 INFO:tasks.workunit.client.0.smithi079.stdout:2/817: creat d4/dc/d1c/d86/d1b/d38/f10a x:0 0 0 2024-09-10T09:36:11.562 INFO:tasks.workunit.client.0.smithi079.stdout:3/900: truncate d4/da/d17/d9b/db1/fc0 1099656 0 2024-09-10T09:36:11.563 INFO:tasks.workunit.client.0.smithi079.stdout:3/901: write d4/da/d17/d9b/fc2 [1029356,40772] 0 2024-09-10T09:36:11.563 INFO:tasks.workunit.client.0.smithi079.stdout:0/847: sync 2024-09-10T09:36:11.563 INFO:tasks.workunit.client.0.smithi079.stdout:0/848: chown d4/d1d/fad 3010682 1 2024-09-10T09:36:11.564 INFO:tasks.workunit.client.0.smithi079.stdout:8/822: symlink d11/d3b/deb/l103 0 2024-09-10T09:36:11.564 INFO:tasks.workunit.client.0.smithi079.stdout:8/823: write d11/fe7 [415190,56981] 0 2024-09-10T09:36:11.566 INFO:tasks.workunit.client.0.smithi079.stdout:9/758: unlink d3/dae/lc7 0 2024-09-10T09:36:11.576 INFO:tasks.workunit.client.0.smithi079.stdout:6/972: link d4/d8/dc/f66 d4/d8/dd/d76/d46/d88/f13d 0 2024-09-10T09:36:11.586 INFO:tasks.workunit.client.0.smithi079.stdout:5/824: unlink d2/d3/d27/d32/la3 0 2024-09-10T09:36:11.590 INFO:tasks.workunit.client.0.smithi079.stdout:7/784: mknod d4/d6/d4f/ce7 0 2024-09-10T09:36:11.597 INFO:tasks.workunit.client.0.smithi079.stdout:3/902: rename d4/da/d18/f10a to d4/da/d8a/dd7/d10e/f118 0 2024-09-10T09:36:11.598 INFO:tasks.workunit.client.0.smithi079.stdout:3/903: truncate d4/da/d8a/dd7/d10e/dbe/fa0 419774 0 2024-09-10T09:36:11.600 INFO:tasks.workunit.client.0.smithi079.stdout:1/975: dwrite d5/df/dd0/f7a [4194304,4194304] 0 2024-09-10T09:36:11.600 INFO:tasks.workunit.client.0.smithi079.stdout:1/976: stat d5/df/d11/d76 0 2024-09-10T09:36:11.600 INFO:tasks.workunit.client.0.smithi079.stdout:2/818: dwrite d4/dc/d1c/f34 [0,4194304] 0 2024-09-10T09:36:11.601 INFO:tasks.workunit.client.0.smithi079.stdout:2/819: fsync d4/dc/d1c/d86/d1b/d38/d87/fb8 0 2024-09-10T09:36:11.601 INFO:tasks.workunit.client.0.smithi079.stdout:0/849: dwrite d4/d12/d1a/d6d/d84/f9e [0,4194304] 0 2024-09-10T09:36:11.601 INFO:tasks.workunit.client.0.smithi079.stdout:8/824: mkdir d11/dbd/d104 0 2024-09-10T09:36:11.601 INFO:tasks.workunit.client.0.smithi079.stdout:8/825: creat d11/d3b/f105 x:0 0 0 2024-09-10T09:36:11.603 INFO:tasks.workunit.client.0.smithi079.stdout:9/759: mknod d3/d7/dc/de/d17/d6e/c101 0 2024-09-10T09:36:11.606 INFO:tasks.workunit.client.0.smithi079.stdout:6/973: creat d4/d8/dc/d93/d4b/d113/f13e x:0 0 0 2024-09-10T09:36:11.607 INFO:tasks.workunit.client.0.smithi079.stdout:5/825: creat d2/d3/d27/d32/de3/d4d/f10b x:0 0 0 2024-09-10T09:36:11.608 INFO:tasks.workunit.client.0.smithi079.stdout:2/820: dread d4/dc/d1c/d86/d1b/d38/d87/fe7 [0,4194304] 0 2024-09-10T09:36:11.608 INFO:tasks.workunit.client.0.smithi079.stdout:2/821: truncate d4/dc/d1c/d86/d1b/d38/d39/d31/f46 2761009 0 2024-09-10T09:36:11.610 INFO:tasks.workunit.client.0.smithi079.stdout:7/785: mknod d4/d6/d4f/d70/dba/ce8 0 2024-09-10T09:36:11.622 INFO:tasks.workunit.client.0.smithi079.stdout:0/850: truncate d4/d12/d16/de3/fb2 1560939 0 2024-09-10T09:36:11.623 INFO:tasks.workunit.client.0.smithi079.stdout:6/974: write d4/d8/dd/d76/d46/d88/d108/fc2 [4811980,105726] 0 2024-09-10T09:36:11.624 INFO:tasks.workunit.client.0.smithi079.stdout:6/975: chown d4/d8/dd/d76/d46/d88/d13b 80283 1 2024-09-10T09:36:11.628 INFO:tasks.workunit.client.0.smithi079.stdout:3/904: dwrite d4/da/f57 [0,4194304] 0 2024-09-10T09:36:11.629 INFO:tasks.workunit.client.0.smithi079.stdout:2/822: dread d4/dc/d1c/d86/d1b/d38/d39/f4c [4194304,4194304] 0 2024-09-10T09:36:11.629 INFO:tasks.workunit.client.0.smithi079.stdout:2/823: write d4/d5d/fdf [250887,15132] 0 2024-09-10T09:36:11.630 INFO:tasks.workunit.client.0.smithi079.stdout:8/826: mknod d11/d2b/d4b/d50/c106 0 2024-09-10T09:36:11.632 INFO:tasks.workunit.client.0.smithi079.stdout:9/760: stat d3/ca4 0 2024-09-10T09:36:11.632 INFO:tasks.workunit.client.0.smithi079.stdout:9/761: truncate d3/d7/d70/dbc/fdc 330910 0 2024-09-10T09:36:11.635 INFO:tasks.workunit.client.0.smithi079.stdout:6/976: truncate d4/d8/dc/d93/dc4/f116 2603818 0 2024-09-10T09:36:11.635 INFO:tasks.workunit.client.0.smithi079.stdout:7/786: dread d4/df/d3d/d75/fa8 [0,4194304] 0 2024-09-10T09:36:11.635 INFO:tasks.workunit.client.0.smithi079.stdout:5/826: write d2/d3/d27/d32/d39/dc2/fdf [654772,23734] 0 2024-09-10T09:36:11.635 INFO:tasks.workunit.client.0.smithi079.stdout:6/977: write d4/d8/dc/d1c/f1d [590667,116611] 0 2024-09-10T09:36:11.635 INFO:tasks.workunit.client.0.smithi079.stdout:5/827: stat d2/d3/d27/d32/c9a 0 2024-09-10T09:36:11.636 INFO:tasks.workunit.client.0.smithi079.stdout:7/787: creat d4/d6/d4f/d70/db6/dca/fe9 x:0 0 0 2024-09-10T09:36:11.640 INFO:tasks.workunit.client.0.smithi079.stdout:1/977: dwrite d5/d4f/f73 [0,4194304] 0 2024-09-10T09:36:11.640 INFO:tasks.workunit.client.0.smithi079.stdout:0/851: dread d4/d12/d15/f9c [0,4194304] 0 2024-09-10T09:36:11.640 INFO:tasks.workunit.client.0.smithi079.stdout:0/852: dread - d4/d12/d8b/f10a zero size 2024-09-10T09:36:11.645 INFO:tasks.workunit.client.0.smithi079.stdout:7/788: write d4/df/d3d/d75/f83 [3475274,94577] 0 2024-09-10T09:36:11.646 INFO:tasks.workunit.client.0.smithi079.stdout:9/762: dwrite d3/d40/dc0/fe9 [0,4194304] 0 2024-09-10T09:36:11.646 INFO:tasks.workunit.client.0.smithi079.stdout:9/763: write d3/d7/dc/de/d17/f1f [2017221,88429] 0 2024-09-10T09:36:11.649 INFO:tasks.workunit.client.0.smithi079.stdout:3/905: creat d4/da/d67/f119 x:0 0 0 2024-09-10T09:36:11.649 INFO:tasks.workunit.client.0.smithi079.stdout:3/906: fdatasync d4/da/d17/d72/fd5 0 2024-09-10T09:36:11.651 INFO:tasks.workunit.client.0.smithi079.stdout:2/824: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/d10b 0 2024-09-10T09:36:11.653 INFO:tasks.workunit.client.0.smithi079.stdout:8/827: rename d11/df2/df4 to d11/d2b/d4b/d50/d5c/d107 0 2024-09-10T09:36:11.656 INFO:tasks.workunit.client.0.smithi079.stdout:6/978: creat d4/d8/dc/d93/d8a/f13f x:0 0 0 2024-09-10T09:36:11.659 INFO:tasks.workunit.client.0.smithi079.stdout:6/979: dread d4/d8/dc/d12/d29/f8b [0,4194304] 0 2024-09-10T09:36:11.659 INFO:tasks.workunit.client.0.smithi079.stdout:6/980: chown d4/d8/dd/d76/d46/df0/c12c 23 1 2024-09-10T09:36:11.660 INFO:tasks.workunit.client.0.smithi079.stdout:2/825: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/f78 [0,4194304] 0 2024-09-10T09:36:11.660 INFO:tasks.workunit.client.0.smithi079.stdout:1/978: unlink d5/d11b/dd1/ldf 0 2024-09-10T09:36:11.660 INFO:tasks.workunit.client.0.smithi079.stdout:2/826: creat d4/dc/d1c/d104/f10c x:0 0 0 2024-09-10T09:36:11.661 INFO:tasks.workunit.client.0.smithi079.stdout:2/827: fsync d4/dc/d1c/ffa 0 2024-09-10T09:36:11.661 INFO:tasks.workunit.client.0.smithi079.stdout:0/853: creat d4/d114/f115 x:0 0 0 2024-09-10T09:36:11.670 INFO:tasks.workunit.client.0.smithi079.stdout:3/907: mkdir d4/da/d17/d2d/d43/d113/d11a 0 2024-09-10T09:36:11.674 INFO:tasks.workunit.client.0.smithi079.stdout:7/789: rename d4/l87 to d4/df/d3d/d82/lea 0 2024-09-10T09:36:11.676 INFO:tasks.workunit.client.0.smithi079.stdout:6/981: dwrite d4/d8/dc/dd9/f135 [0,4194304] 0 2024-09-10T09:36:11.676 INFO:tasks.workunit.client.0.smithi079.stdout:3/908: dread d4/f12 [0,4194304] 0 2024-09-10T09:36:11.677 INFO:tasks.workunit.client.0.smithi079.stdout:1/979: mknod d5/d40/dac/db2/c143 0 2024-09-10T09:36:11.679 INFO:tasks.workunit.client.0.smithi079.stdout:0/854: truncate d4/d12/d1a/fb 6037335 0 2024-09-10T09:36:11.682 INFO:tasks.workunit.client.0.smithi079.stdout:4/845: sync 2024-09-10T09:36:11.682 INFO:tasks.workunit.client.0.smithi079.stdout:1/980: dread d5/df/d2e/d10c/d111/fc2 [0,4194304] 0 2024-09-10T09:36:11.683 INFO:tasks.workunit.client.0.smithi079.stdout:9/764: mknod d3/d7/dc/d62/c102 0 2024-09-10T09:36:11.683 INFO:tasks.workunit.client.0.smithi079.stdout:9/765: write d3/ff5 [701317,121068] 0 2024-09-10T09:36:11.683 INFO:tasks.workunit.client.0.smithi079.stdout:9/766: stat d3/d7/dc/de/da7/dac/ff7 0 2024-09-10T09:36:11.693 INFO:tasks.workunit.client.0.smithi079.stdout:3/909: symlink d4/da/d17/d2d/d43/l11b 0 2024-09-10T09:36:11.693 INFO:tasks.workunit.client.0.smithi079.stdout:3/910: getdents d4/da/d17/d38/d42/df9 0 2024-09-10T09:36:11.693 INFO:tasks.workunit.client.0.smithi079.stdout:3/911: fsync d4/da/d18/db5/ff3 0 2024-09-10T09:36:11.695 INFO:tasks.workunit.client.0.smithi079.stdout:9/767: write d3/d7/dc/de/d17/d2f/d74/fa3 [5979019,75481] 0 2024-09-10T09:36:11.695 INFO:tasks.workunit.client.0.smithi079.stdout:9/768: fdatasync d3/d7/dc/de/da7/fc2 0 2024-09-10T09:36:11.695 INFO:tasks.workunit.client.0.smithi079.stdout:9/769: chown d3/d7/dc/de/d17 196277 1 2024-09-10T09:36:11.695 INFO:tasks.workunit.client.0.smithi079.stdout:9/770: truncate d3/d7/dc/f95 4329694 0 2024-09-10T09:36:11.695 INFO:tasks.workunit.client.0.smithi079.stdout:9/771: chown d3/d7f/lc3 10 1 2024-09-10T09:36:11.697 INFO:tasks.workunit.client.0.smithi079.stdout:4/846: link d1/da/d28/d47/da1/cfd d1/da/c112 0 2024-09-10T09:36:11.697 INFO:tasks.workunit.client.0.smithi079.stdout:5/828: write d2/d3/f84 [523246,128251] 0 2024-09-10T09:36:11.699 INFO:tasks.workunit.client.0.smithi079.stdout:1/981: truncate d5/d9e/dc9/ff4 900094 0 2024-09-10T09:36:11.711 INFO:tasks.workunit.client.0.smithi079.stdout:7/790: getdents d4/dc/d43 0 2024-09-10T09:36:11.713 INFO:tasks.workunit.client.0.smithi079.stdout:1/982: dwrite d5/df/d11/fb6 [0,4194304] 0 2024-09-10T09:36:11.714 INFO:tasks.workunit.client.0.smithi079.stdout:1/983: write d5/d24/d36/d3a/d85/db1/d11a/d117/f12d [4913241,3451] 0 2024-09-10T09:36:11.715 INFO:tasks.workunit.client.0.smithi079.stdout:9/772: creat d3/d7/dc/de/da7/df1/f103 x:0 0 0 2024-09-10T09:36:11.717 INFO:tasks.workunit.client.0.smithi079.stdout:4/847: creat d1/da/d16/d4d/df6/f113 x:0 0 0 2024-09-10T09:36:11.719 INFO:tasks.workunit.client.0.smithi079.stdout:5/829: creat d2/d3/d27/d70/f10c x:0 0 0 2024-09-10T09:36:11.723 INFO:tasks.workunit.client.0.smithi079.stdout:8/828: rename d11/d2b/d4b/d50/d55/db8 to d11/d91/d108 0 2024-09-10T09:36:11.723 INFO:tasks.workunit.client.0.smithi079.stdout:4/848: write d1/da/d16/fcb [2146739,3393] 0 2024-09-10T09:36:11.729 INFO:tasks.workunit.client.0.smithi079.stdout:7/791: mknod d4/d6/d3e/ceb 0 2024-09-10T09:36:11.730 INFO:tasks.workunit.client.0.smithi079.stdout:7/792: fsync d4/d6/d4f/d70/db6/dca/fe9 0 2024-09-10T09:36:11.730 INFO:tasks.workunit.client.0.smithi079.stdout:7/793: chown d4/df/d6b/d9a/d9c/fa4 1958 1 2024-09-10T09:36:11.730 INFO:tasks.workunit.client.0.smithi079.stdout:7/794: chown d4/fd5 183 1 2024-09-10T09:36:11.731 INFO:tasks.workunit.client.0.smithi079.stdout:3/912: symlink d4/da/d17/d2d/d43/d4c/l11c 0 2024-09-10T09:36:11.731 INFO:tasks.workunit.client.0.smithi079.stdout:3/913: write d4/da/d17/d2d/d43/f74 [1537502,84244] 0 2024-09-10T09:36:11.733 INFO:tasks.workunit.client.0.smithi079.stdout:9/773: write d3/d7/dc/d62/f75 [823688,106035] 0 2024-09-10T09:36:11.741 INFO:tasks.workunit.client.0.smithi079.stdout:4/849: dwrite d1/da/d28/d47/da1/d83/fa6 [0,4194304] 0 2024-09-10T09:36:11.746 INFO:tasks.workunit.client.0.smithi079.stdout:5/830: creat d2/d3/d27/d70/d80/d94/f10d x:0 0 0 2024-09-10T09:36:11.753 INFO:tasks.workunit.client.0.smithi079.stdout:2/828: rename d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fda to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/f10d 0 2024-09-10T09:36:11.755 INFO:tasks.workunit.client.0.smithi079.stdout:7/795: dwrite d4/df/d6b/d9a/d9c/fa4 [0,4194304] 0 2024-09-10T09:36:11.756 INFO:tasks.workunit.client.0.smithi079.stdout:9/774: dwrite d3/d40/f7b [0,4194304] 0 2024-09-10T09:36:11.759 INFO:tasks.workunit.client.0.smithi079.stdout:3/914: mkdir d4/da/d56/d7b/dd1/d11d 0 2024-09-10T09:36:11.762 INFO:tasks.workunit.client.0.smithi079.stdout:7/796: dread d4/df/d6b/f8e [0,4194304] 0 2024-09-10T09:36:11.764 INFO:tasks.workunit.client.0.smithi079.stdout:4/850: rmdir d1/da/d16/d57 39 2024-09-10T09:36:11.766 INFO:tasks.workunit.client.0.smithi079.stdout:4/851: write d1/da/d3b/db3/fc1 [737226,38176] 0 2024-09-10T09:36:11.768 INFO:tasks.workunit.client.0.smithi079.stdout:5/831: creat d2/d3/d27/dde/dfd/f10e x:0 0 0 2024-09-10T09:36:11.772 INFO:tasks.workunit.client.0.smithi079.stdout:6/982: rename d4/d8/dc/d1c/cc0 to d4/d8/dd/d76/d46/d88/d108/c140 0 2024-09-10T09:36:11.776 INFO:tasks.workunit.client.0.smithi079.stdout:2/829: creat d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f10e x:0 0 0 2024-09-10T09:36:11.779 INFO:tasks.workunit.client.0.smithi079.stdout:8/829: getdents d11/d2b/d4b/d50/d9e/dca/dd0 0 2024-09-10T09:36:11.785 INFO:tasks.workunit.client.0.smithi079.stdout:9/775: mknod d3/d7/dc/de/c104 0 2024-09-10T09:36:11.786 INFO:tasks.workunit.client.0.smithi079.stdout:9/776: creat d3/f105 x:0 0 0 2024-09-10T09:36:11.786 INFO:tasks.workunit.client.0.smithi079.stdout:9/777: chown d3/d7/dc/de/da7/df1/d100 10859 1 2024-09-10T09:36:11.787 INFO:tasks.workunit.client.0.smithi079.stdout:3/915: mkdir d4/da/d8a/dd7/d10e/dbe/d11e 0 2024-09-10T09:36:11.789 INFO:tasks.workunit.client.0.smithi079.stdout:4/852: rmdir d1/da/d28/d95 39 2024-09-10T09:36:11.792 INFO:tasks.workunit.client.0.smithi079.stdout:5/832: link d2/d3/f79 d2/d3/d27/d70/d80/f10f 0 2024-09-10T09:36:11.797 INFO:tasks.workunit.client.0.smithi079.stdout:6/983: dwrite d4/d8/dc/d12/d9d/def/f121 [0,4194304] 0 2024-09-10T09:36:11.797 INFO:tasks.workunit.client.0.smithi079.stdout:6/984: chown d4/d8/dc/d1c/f106 4121753 1 2024-09-10T09:36:11.797 INFO:tasks.workunit.client.0.smithi079.stdout:6/985: creat d4/d8/dd/d41/d51/f141 x:0 0 0 2024-09-10T09:36:11.797 INFO:tasks.workunit.client.0.smithi079.stdout:6/986: write d4/d8/dd/f130 [4641280,76076] 0 2024-09-10T09:36:11.798 INFO:tasks.workunit.client.0.smithi079.stdout:2/830: rename d4/dc/d1c/d86/d1b/d38/d87/fe7 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f10f 0 2024-09-10T09:36:11.799 INFO:tasks.workunit.client.0.smithi079.stdout:7/797: dwrite d4/d6/fa [0,4194304] 0 2024-09-10T09:36:11.800 INFO:tasks.workunit.client.0.smithi079.stdout:8/830: write d11/d2b/fc2 [2114494,6441] 0 2024-09-10T09:36:11.803 INFO:tasks.workunit.client.0.smithi079.stdout:4/853: symlink d1/l114 0 2024-09-10T09:36:11.805 INFO:tasks.workunit.client.0.smithi079.stdout:9/778: dread d3/d7/dc/de/d17/d2f/d98/da1/faf [0,4194304] 0 2024-09-10T09:36:11.812 INFO:tasks.workunit.client.0.smithi079.stdout:5/833: rename d2/d3/d27/d32/d44/c106 to d2/d3/d27/d70/d80/c110 0 2024-09-10T09:36:11.816 INFO:tasks.workunit.client.0.smithi079.stdout:7/798: mknod d4/d6/d3e/db3/cec 0 2024-09-10T09:36:11.816 INFO:tasks.workunit.client.0.smithi079.stdout:7/799: fdatasync d4/d6/da9/fc0 0 2024-09-10T09:36:11.818 INFO:tasks.workunit.client.0.smithi079.stdout:9/779: mknod d3/d7/dc/de/d17/c106 0 2024-09-10T09:36:11.818 INFO:tasks.workunit.client.0.smithi079.stdout:9/780: fdatasync d3/d7/dc/de/da7/dac/fd2 0 2024-09-10T09:36:11.820 INFO:tasks.workunit.client.0.smithi079.stdout:4/854: rename d1/da/d28/d47/fe6 to d1/da/d28/d47/da1/dcd/f115 0 2024-09-10T09:36:11.822 INFO:tasks.workunit.client.0.smithi079.stdout:2/831: truncate d4/dc/d1c/d86/f55 13819 0 2024-09-10T09:36:11.822 INFO:tasks.workunit.client.0.smithi079.stdout:5/834: dread d2/d3/d27/f69 [0,4194304] 0 2024-09-10T09:36:11.822 INFO:tasks.workunit.client.0.smithi079.stdout:2/832: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/fc4 [4780617,70891] 0 2024-09-10T09:36:11.824 INFO:tasks.workunit.client.0.smithi079.stdout:4/855: truncate d1/da/d3b/d5f/f62 1509033 0 2024-09-10T09:36:11.824 INFO:tasks.workunit.client.0.smithi079.stdout:3/916: dwrite d4/da/d56/d7b/fce [0,4194304] 0 2024-09-10T09:36:11.824 INFO:tasks.workunit.client.0.smithi079.stdout:8/831: dwrite d11/d2b/d4b/da8/ff8 [0,4194304] 0 2024-09-10T09:36:11.824 INFO:tasks.workunit.client.0.smithi079.stdout:3/917: stat d4/da/d17/d38/d42 0 2024-09-10T09:36:11.825 INFO:tasks.workunit.client.0.smithi079.stdout:6/987: dwrite d4/d8/dc/d12/f30 [0,4194304] 0 2024-09-10T09:36:11.827 INFO:tasks.workunit.client.0.smithi079.stdout:5/835: symlink d2/d3/d27/d70/d88/df2/l111 0 2024-09-10T09:36:11.830 INFO:tasks.workunit.client.0.smithi079.stdout:6/988: dread d4/d8/dd/d76/f59 [0,4194304] 0 2024-09-10T09:36:11.837 INFO:tasks.workunit.client.0.smithi079.stdout:4/856: rename d1/da/l85 to d1/da/d28/d47/da1/l116 0 2024-09-10T09:36:11.837 INFO:tasks.workunit.client.0.smithi079.stdout:4/857: write d1/d38/da5/fce [130686,15599] 0 2024-09-10T09:36:11.838 INFO:tasks.workunit.client.0.smithi079.stdout:2/833: dwrite d4/d5d/fa1 [0,4194304] 0 2024-09-10T09:36:11.839 INFO:tasks.workunit.client.0.smithi079.stdout:8/832: rmdir d11/d2b/d4b/d50/d5c/d107 0 2024-09-10T09:36:11.849 INFO:tasks.workunit.client.0.smithi079.stdout:5/836: mknod d2/d3/d27/d32/db6/c112 0 2024-09-10T09:36:11.852 INFO:tasks.workunit.client.0.smithi079.stdout:5/837: dread d2/d3/d27/d32/de3/f6b [0,4194304] 0 2024-09-10T09:36:11.852 INFO:tasks.workunit.client.0.smithi079.stdout:4/858: link d1/da/d16/d21/cdf d1/d38/da5/dde/c117 0 2024-09-10T09:36:11.856 INFO:tasks.workunit.client.0.smithi079.stdout:2/834: mknod d4/c110 0 2024-09-10T09:36:11.856 INFO:tasks.workunit.client.0.smithi079.stdout:2/835: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/fe1 [3116611,104289] 0 2024-09-10T09:36:11.857 INFO:tasks.workunit.client.0.smithi079.stdout:2/836: write d4/dc/d1c/d86/d1b/d38/d39/d99/f15 [2540343,15229] 0 2024-09-10T09:36:11.857 INFO:tasks.workunit.client.0.smithi079.stdout:2/837: creat d4/dc/f111 x:0 0 0 2024-09-10T09:36:11.857 INFO:tasks.workunit.client.0.smithi079.stdout:2/838: truncate d4/dc/d1c/f100 532749 0 2024-09-10T09:36:11.862 INFO:tasks.workunit.client.0.smithi079.stdout:8/833: unlink d11/d2b/d4b/d74/f102 0 2024-09-10T09:36:11.867 INFO:tasks.workunit.client.0.smithi079.stdout:9/781: rmdir d3/d7/d26/d69/da2 0 2024-09-10T09:36:11.868 INFO:tasks.workunit.client.0.smithi079.stdout:9/782: fdatasync d3/d7/d70/f71 0 2024-09-10T09:36:11.868 INFO:tasks.workunit.client.0.smithi079.stdout:9/783: dread - d3/d7/dc/de/d17/d12/fc5 zero size 2024-09-10T09:36:11.868 INFO:tasks.workunit.client.0.smithi079.stdout:9/784: chown d3/d7/d70/dbc 208228 1 2024-09-10T09:36:11.876 INFO:tasks.workunit.client.0.smithi079.stdout:8/834: fsync d11/d2b/f40 0 2024-09-10T09:36:11.878 INFO:tasks.workunit.client.0.smithi079.stdout:3/918: rename d4/da/d17/d2d/d43/d4c/c50 to d4/da/d17/d2d/d43/d4c/c11f 0 2024-09-10T09:36:11.881 INFO:tasks.workunit.client.0.smithi079.stdout:8/835: symlink d11/d2b/d4b/d7e/db2/db7/l109 0 2024-09-10T09:36:11.883 INFO:tasks.workunit.client.0.smithi079.stdout:5/838: dwrite d2/d3/fe [0,4194304] 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:5/839: write d2/d3/d27/d32/d44/db4/fdb [115602,70268] 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:5/840: fdatasync d2/d3/d27/d32/db6/fe0 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:5/841: write d2/d3/fa [1186283,97048] 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:2/839: dwrite d4/dc/d1c/d86/d1b/d38/d39/d31/fa2 [0,4194304] 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:2/840: readlink d4/d8f/lbc 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:2/841: fdatasync d4/fbd 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:4/859: dwrite d1/da/d16/d4d/df6/f113 [0,4194304] 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:2/842: write d4/dc/d1c/d86/d1b/d38/f10a [710363,85808] 0 2024-09-10T09:36:11.884 INFO:tasks.workunit.client.0.smithi079.stdout:2/843: chown d4/dc/d1c/d86/d1b/d38/d39/cbb 901553 1 2024-09-10T09:36:11.886 INFO:tasks.workunit.client.0.smithi079.stdout:3/919: creat d4/da/d17/d2d/d43/f120 x:0 0 0 2024-09-10T09:36:11.888 INFO:tasks.workunit.client.0.smithi079.stdout:8/836: unlink d11/d2b/d4b/d7e/db2/db7/fe1 0 2024-09-10T09:36:11.893 INFO:tasks.workunit.client.0.smithi079.stdout:9/785: dwrite d3/d7/d26/f8f [0,4194304] 0 2024-09-10T09:36:11.894 INFO:tasks.workunit.client.0.smithi079.stdout:5/842: dread d2/d3/f6a [0,4194304] 0 2024-09-10T09:36:11.900 INFO:tasks.workunit.client.0.smithi079.stdout:4/860: dread d1/da/d16/d88/fe1 [0,4194304] 0 2024-09-10T09:36:11.911 INFO:tasks.workunit.client.0.smithi079.stdout:2/844: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77 0 2024-09-10T09:36:11.913 INFO:tasks.workunit.client.0.smithi079.stdout:3/920: mkdir d4/da/d17/d2d/d43/d49/d121 0 2024-09-10T09:36:11.915 INFO:tasks.workunit.client.0.smithi079.stdout:8/837: creat d11/d2b/d4b/d50/d55/d87/f10a x:0 0 0 2024-09-10T09:36:11.916 INFO:tasks.workunit.client.0.smithi079.stdout:8/838: dread d11/d2b/d4b/d74/f83 [0,4194304] 0 2024-09-10T09:36:11.917 INFO:tasks.workunit.client.0.smithi079.stdout:5/843: dwrite d2/d3/d27/f2c [0,4194304] 0 2024-09-10T09:36:11.919 INFO:tasks.workunit.client.0.smithi079.stdout:9/786: mkdir d3/d7/dc/de/d17/dcf/d107 0 2024-09-10T09:36:11.921 INFO:tasks.workunit.client.0.smithi079.stdout:4/861: creat d1/d38/f118 x:0 0 0 2024-09-10T09:36:11.923 INFO:tasks.workunit.client.0.smithi079.stdout:2/845: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/d112 0 2024-09-10T09:36:11.924 INFO:tasks.workunit.client.0.smithi079.stdout:0/855: sync 2024-09-10T09:36:11.926 INFO:tasks.workunit.client.0.smithi079.stdout:3/921: creat d4/da/d8a/dd7/d10e/d79/dab/f122 x:0 0 0 2024-09-10T09:36:11.926 INFO:tasks.workunit.client.0.smithi079.stdout:3/922: fdatasync d4/da/d17/d9b/fc2 0 2024-09-10T09:36:11.929 INFO:tasks.workunit.client.0.smithi079.stdout:5/844: creat d2/f113 x:0 0 0 2024-09-10T09:36:11.929 INFO:tasks.workunit.client.0.smithi079.stdout:5/845: write d2/f113 [62642,121900] 0 2024-09-10T09:36:11.930 INFO:tasks.workunit.client.0.smithi079.stdout:2/846: dread d4/f7a [4194304,4194304] 0 2024-09-10T09:36:11.937 INFO:tasks.workunit.client.0.smithi079.stdout:0/856: creat d4/d1d/f116 x:0 0 0 2024-09-10T09:36:11.939 INFO:tasks.workunit.client.0.smithi079.stdout:9/787: getdents d3/d40 0 2024-09-10T09:36:11.941 INFO:tasks.workunit.client.0.smithi079.stdout:2/847: symlink d4/dc/d1c/l113 0 2024-09-10T09:36:11.941 INFO:tasks.workunit.client.0.smithi079.stdout:2/848: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d8d/f114 x:0 0 0 2024-09-10T09:36:11.942 INFO:tasks.workunit.client.0.smithi079.stdout:9/788: stat d3/d7/d26/l64 0 2024-09-10T09:36:11.942 INFO:tasks.workunit.client.0.smithi079.stdout:9/789: creat d3/d40/dc0/f108 x:0 0 0 2024-09-10T09:36:11.943 INFO:tasks.workunit.client.0.smithi079.stdout:9/790: write d3/d7/d70/dbc/fdc [822752,27264] 0 2024-09-10T09:36:11.948 INFO:tasks.workunit.client.0.smithi079.stdout:2/849: rename d4/dc/d1c/d86/d1b/d38/d39/d31/d49/c103 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/c115 0 2024-09-10T09:36:11.948 INFO:tasks.workunit.client.0.smithi079.stdout:2/850: write d4/dc/d1c/faf [208362,103954] 0 2024-09-10T09:36:11.953 INFO:tasks.workunit.client.0.smithi079.stdout:9/791: mknod d3/d7/dc/de/da7/c109 0 2024-09-10T09:36:11.954 INFO:tasks.workunit.client.0.smithi079.stdout:9/792: chown d3/d7/dc/de/d17/d12/fc5 795883605 1 2024-09-10T09:36:11.955 INFO:tasks.workunit.client.0.smithi079.stdout:2/851: mknod d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/db0/c116 0 2024-09-10T09:36:11.958 INFO:tasks.workunit.client.0.smithi079.stdout:9/793: rename d3/ca4 to d3/d7/d26/d3d/c10a 0 2024-09-10T09:36:11.960 INFO:tasks.workunit.client.0.smithi079.stdout:5/846: dwrite d2/f113 [0,4194304] 0 2024-09-10T09:36:11.961 INFO:tasks.workunit.client.0.smithi079.stdout:0/857: dwrite d4/d12/d16/d53/fe8 [0,4194304] 0 2024-09-10T09:36:11.961 INFO:tasks.workunit.client.0.smithi079.stdout:0/858: write d4/f70 [5144974,79545] 0 2024-09-10T09:36:11.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:11 smithi079 ceph-mon[27592]: mgrmap e20: smithi079.mhirny(active, since 7m), standbys: smithi135.lbhjof 2024-09-10T09:36:11.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:11 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:11.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:11 smithi079 ceph-mon[27592]: pgmap v260: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 198 MiB/s rd, 231 MiB/s wr, 592 op/s 2024-09-10T09:36:11.962 INFO:tasks.workunit.client.0.smithi079.stdout:9/794: rename d3/d7/d26/f80 to d3/d7/dc/de/d17/f10b 0 2024-09-10T09:36:11.963 INFO:tasks.workunit.client.0.smithi079.stdout:9/795: stat d3/d7/d26/d3d/f42 0 2024-09-10T09:36:11.966 INFO:tasks.workunit.client.0.smithi079.stdout:5/847: creat d2/d3/d27/d70/d88/f114 x:0 0 0 2024-09-10T09:36:11.966 INFO:tasks.workunit.client.0.smithi079.stdout:5/848: fsync d2/d3/d5e/d85/f89 0 2024-09-10T09:36:11.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:11 smithi135 ceph-mon[33411]: mgrmap e20: smithi079.mhirny(active, since 7m), standbys: smithi135.lbhjof 2024-09-10T09:36:11.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:11 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:11.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:11 smithi135 ceph-mon[33411]: pgmap v260: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 531 GiB / 536 GiB avail; 198 MiB/s rd, 231 MiB/s wr, 592 op/s 2024-09-10T09:36:11.968 INFO:tasks.workunit.client.0.smithi079.stdout:1/984: sync 2024-09-10T09:36:11.972 INFO:tasks.workunit.client.0.smithi079.stdout:9/796: write d3/d7/f3b [3314474,86509] 0 2024-09-10T09:36:11.972 INFO:tasks.workunit.client.0.smithi079.stdout:9/797: read - d3/d7/d26/d83/fb8 zero size 2024-09-10T09:36:11.974 INFO:tasks.workunit.client.0.smithi079.stdout:0/859: creat d4/d12/d21/d3f/d88/f117 x:0 0 0 2024-09-10T09:36:11.975 INFO:tasks.workunit.client.0.smithi079.stdout:7/800: sync 2024-09-10T09:36:11.975 INFO:tasks.workunit.client.0.smithi079.stdout:6/989: sync 2024-09-10T09:36:11.975 INFO:tasks.workunit.client.0.smithi079.stdout:6/990: stat d4/d8/dc/d1c/f53 0 2024-09-10T09:36:11.975 INFO:tasks.workunit.client.0.smithi079.stdout:6/991: creat d4/d8/dc/dd9/f142 x:0 0 0 2024-09-10T09:36:11.975 INFO:tasks.workunit.client.0.smithi079.stdout:7/801: write d4/d6/d38/f63 [4634405,68948] 0 2024-09-10T09:36:11.976 INFO:tasks.workunit.client.0.smithi079.stdout:6/992: write d4/d8/dc/d12/d9d/fbb [4103503,67704] 0 2024-09-10T09:36:11.978 INFO:tasks.workunit.client.0.smithi079.stdout:5/849: getdents d2/d3/d59/dcb 0 2024-09-10T09:36:11.979 INFO:tasks.workunit.client.0.smithi079.stdout:1/985: chown d5/df/d2e/l71 628305 1 2024-09-10T09:36:11.979 INFO:tasks.workunit.client.0.smithi079.stdout:1/986: fsync d5/d24/d36/d3a/d100/f138 0 2024-09-10T09:36:11.981 INFO:tasks.workunit.client.0.smithi079.stdout:0/860: stat d4/c9f 0 2024-09-10T09:36:11.986 INFO:tasks.workunit.client.0.smithi079.stdout:7/802: creat d4/df/d3d/d75/fed x:0 0 0 2024-09-10T09:36:11.986 INFO:tasks.workunit.client.0.smithi079.stdout:7/803: chown d4/d6/d4f 519 1 2024-09-10T09:36:11.989 INFO:tasks.workunit.client.0.smithi079.stdout:6/993: stat d4/d8/dc/d98/fa2 0 2024-09-10T09:36:11.991 INFO:tasks.workunit.client.0.smithi079.stdout:5/850: mknod d2/d3/d59/c115 0 2024-09-10T09:36:11.991 INFO:tasks.workunit.client.0.smithi079.stdout:5/851: fsync d2/d3/d5e/d61/d71/fb9 0 2024-09-10T09:36:11.991 INFO:tasks.workunit.client.0.smithi079.stdout:5/852: fdatasync d2/fc3 0 2024-09-10T09:36:11.991 INFO:tasks.workunit.client.0.smithi079.stdout:5/853: dread - d2/d3/d27/d70/d80/d94/fb8 zero size 2024-09-10T09:36:11.994 INFO:tasks.workunit.client.0.smithi079.stdout:1/987: rename d5/d24/d36/d3a/dfc/fff to d5/df/d2e/d10c/d111/f144 0 2024-09-10T09:36:11.995 INFO:tasks.workunit.client.0.smithi079.stdout:0/861: mkdir d4/d1d/d24/d118 0 2024-09-10T09:36:11.997 INFO:tasks.workunit.client.0.smithi079.stdout:7/804: creat d4/df/d6b/d9a/dde/fee x:0 0 0 2024-09-10T09:36:12.000 INFO:tasks.workunit.client.0.smithi079.stdout:5/854: creat d2/d3/d5e/d85/f116 x:0 0 0 2024-09-10T09:36:12.003 INFO:tasks.workunit.client.0.smithi079.stdout:0/862: rename d4/d47/d113 to d4/d12/dc0/d119 0 2024-09-10T09:36:12.005 INFO:tasks.workunit.client.0.smithi079.stdout:7/805: unlink d4/dc/f32 0 2024-09-10T09:36:12.008 INFO:tasks.workunit.client.0.smithi079.stdout:6/994: rmdir d4/d8/dc/d12/d29 39 2024-09-10T09:36:12.008 INFO:tasks.workunit.client.0.smithi079.stdout:6/995: dread - d4/d8/dd/f119 zero size 2024-09-10T09:36:12.010 INFO:tasks.workunit.client.0.smithi079.stdout:5/855: creat d2/d3/d5e/d61/f117 x:0 0 0 2024-09-10T09:36:12.010 INFO:tasks.workunit.client.0.smithi079.stdout:5/856: write d2/d3/ffe [464342,80900] 0 2024-09-10T09:36:12.011 INFO:tasks.workunit.client.0.smithi079.stdout:0/863: write d4/f11 [6443629,84340] 0 2024-09-10T09:36:12.016 INFO:tasks.workunit.client.0.smithi079.stdout:6/996: truncate d4/d8/dc/d12/f30 2847124 0 2024-09-10T09:36:12.018 INFO:tasks.workunit.client.0.smithi079.stdout:0/864: read d4/d47/fc1 [2966708,97] 0 2024-09-10T09:36:12.018 INFO:tasks.workunit.client.0.smithi079.stdout:0/865: getdents d4/d12/d1a 0 2024-09-10T09:36:12.018 INFO:tasks.workunit.client.0.smithi079.stdout:5/857: truncate d2/d3/d27/d32/de3/d4d/f5a 358961 0 2024-09-10T09:36:12.020 INFO:tasks.workunit.client.0.smithi079.stdout:0/866: dread d4/feb [0,4194304] 0 2024-09-10T09:36:12.021 INFO:tasks.workunit.client.0.smithi079.stdout:6/997: creat d4/d8/dd/d76/d46/df0/f143 x:0 0 0 2024-09-10T09:36:12.028 INFO:tasks.workunit.client.0.smithi079.stdout:0/867: creat d4/d12/d15/d69/f11a x:0 0 0 2024-09-10T09:36:12.028 INFO:tasks.workunit.client.0.smithi079.stdout:0/868: chown d4/d12/d16/c56 69026 1 2024-09-10T09:36:12.028 INFO:tasks.workunit.client.0.smithi079.stdout:0/869: rename d4/d12/d16/de3/dac/d106 to d4/d12/d16/de3/dac/d106/d11b 22 2024-09-10T09:36:12.030 INFO:tasks.workunit.client.0.smithi079.stdout:1/988: getdents d5/d24/d36/d3a/dfc 0 2024-09-10T09:36:12.030 INFO:tasks.workunit.client.0.smithi079.stdout:1/989: stat d5/d40/dac/fb7 0 2024-09-10T09:36:12.031 INFO:tasks.workunit.client.0.smithi079.stdout:6/998: symlink d4/d8/d74/l144 0 2024-09-10T09:36:12.031 INFO:tasks.workunit.client.0.smithi079.stdout:6/999: chown d4/d8/dd/d41/d51/fe3 6 1 2024-09-10T09:36:12.034 INFO:tasks.workunit.client.0.smithi079.stdout:0/870: unlink d4/d12/d21/d3f/d88/f8c 0 2024-09-10T09:36:12.035 INFO:tasks.workunit.client.0.smithi079.stdout:0/871: write d4/d114/f115 [113514,53221] 0 2024-09-10T09:36:12.038 INFO:tasks.workunit.client.0.smithi079.stdout:5/858: dwrite d2/d3/d27/d32/d44/f66 [0,4194304] 0 2024-09-10T09:36:12.040 INFO:tasks.workunit.client.0.smithi079.stdout:0/872: mknod d4/d12/d16/c11c 0 2024-09-10T09:36:12.043 INFO:tasks.workunit.client.0.smithi079.stdout:1/990: dread d5/d24/d36/d53/db3/de3/fa3 [0,4194304] 0 2024-09-10T09:36:12.045 INFO:tasks.workunit.client.0.smithi079.stdout:5/859: mknod d2/d3/d27/d70/c118 0 2024-09-10T09:36:12.045 INFO:tasks.workunit.client.0.smithi079.stdout:5/860: dread - d2/d3/d5e/d61/fae zero size 2024-09-10T09:36:12.046 INFO:tasks.workunit.client.0.smithi079.stdout:5/861: dread - d2/d3/d27/d70/d88/f114 zero size 2024-09-10T09:36:12.048 INFO:tasks.workunit.client.0.smithi079.stdout:0/873: symlink d4/d12/d8b/dca/d32/l11d 0 2024-09-10T09:36:12.048 INFO:tasks.workunit.client.0.smithi079.stdout:0/874: fsync d4/d12/d21/f43 0 2024-09-10T09:36:12.048 INFO:tasks.workunit.client.0.smithi079.stdout:0/875: creat d4/f11e x:0 0 0 2024-09-10T09:36:12.048 INFO:tasks.workunit.client.0.smithi079.stdout:0/876: write d4/f70 [5216769,40797] 0 2024-09-10T09:36:12.049 INFO:tasks.workunit.client.0.smithi079.stdout:0/877: read d4/d1d/fad [489186,102192] 0 2024-09-10T09:36:12.049 INFO:tasks.workunit.client.0.smithi079.stdout:0/878: write d4/d12/d21/d3f/d88/dc7/f111 [839227,45772] 0 2024-09-10T09:36:12.049 INFO:tasks.workunit.client.0.smithi079.stdout:0/879: stat d4/d12/d15/d69/ff6 0 2024-09-10T09:36:12.049 INFO:tasks.workunit.client.0.smithi079.stdout:0/880: readlink d4/d47/l4e 0 2024-09-10T09:36:12.054 INFO:tasks.workunit.client.0.smithi079.stdout:0/881: creat d4/d12/dde/f11f x:0 0 0 2024-09-10T09:36:12.055 INFO:tasks.workunit.client.0.smithi079.stdout:0/882: creat d4/d12/d15/d69/f120 x:0 0 0 2024-09-10T09:36:12.064 INFO:tasks.workunit.client.0.smithi079.stdout:0/883: creat d4/d12/dc0/d119/f121 x:0 0 0 2024-09-10T09:36:12.067 INFO:tasks.workunit.client.0.smithi079.stdout:0/884: mknod d4/d12/d16/d53/c122 0 2024-09-10T09:36:12.067 INFO:tasks.workunit.client.0.smithi079.stdout:0/885: chown d4/d12/d39/fa0 82978615 1 2024-09-10T09:36:12.070 INFO:tasks.workunit.client.0.smithi079.stdout:0/886: truncate d4/d12/d39/f8d 712744 0 2024-09-10T09:36:12.072 INFO:tasks.workunit.client.0.smithi079.stdout:1/991: dwrite d5/d24/d36/d53/db3/de3/f56 [0,4194304] 0 2024-09-10T09:36:12.073 INFO:tasks.workunit.client.0.smithi079.stdout:5/862: dwrite d2/d3/d59/f98 [0,4194304] 0 2024-09-10T09:36:12.075 INFO:tasks.workunit.client.0.smithi079.stdout:0/887: dread d4/d114/f115 [0,4194304] 0 2024-09-10T09:36:12.079 INFO:tasks.workunit.client.0.smithi079.stdout:1/992: dread d5/d24/f2f [4194304,4194304] 0 2024-09-10T09:36:12.089 INFO:tasks.workunit.client.0.smithi079.stdout:5/863: dwrite d2/d3/d5e/d73/f8b [0,4194304] 0 2024-09-10T09:36:12.089 INFO:tasks.workunit.client.0.smithi079.stdout:5/864: chown d2/d3/f6e 203 1 2024-09-10T09:36:12.089 INFO:tasks.workunit.client.0.smithi079.stdout:0/888: mknod d4/d1d/c123 0 2024-09-10T09:36:12.091 INFO:tasks.workunit.client.0.smithi079.stdout:1/993: chown d5/df/d11/f2b 399921 1 2024-09-10T09:36:12.095 INFO:tasks.workunit.client.0.smithi079.stdout:5/865: getdents d2/d3/d27 0 2024-09-10T09:36:12.096 INFO:tasks.workunit.client.0.smithi079.stdout:0/889: unlink d4/d12/d16/d53/fab 0 2024-09-10T09:36:12.098 INFO:tasks.workunit.client.0.smithi079.stdout:5/866: link d2/c77 d2/d3/d27/d32/db6/c119 0 2024-09-10T09:36:12.100 INFO:tasks.workunit.client.0.smithi079.stdout:0/890: unlink d4/d1d/d24/fa9 0 2024-09-10T09:36:12.103 INFO:tasks.workunit.client.0.smithi079.stdout:1/994: dwrite d5/d40/dac/fb7 [0,4194304] 0 2024-09-10T09:36:12.104 INFO:tasks.workunit.client.0.smithi079.stdout:1/995: dread d5/d4f/d8a/f12f [0,4194304] 0 2024-09-10T09:36:12.104 INFO:tasks.workunit.client.0.smithi079.stdout:0/891: unlink d4/d12/d21/d3f/d88/f117 0 2024-09-10T09:36:12.104 INFO:tasks.workunit.client.0.smithi079.stdout:0/892: dread - d4/d12/d8b/dca/d32/f10c zero size 2024-09-10T09:36:12.105 INFO:tasks.workunit.client.0.smithi079.stdout:0/893: write d4/d47/f98 [4252735,20880] 0 2024-09-10T09:36:12.105 INFO:tasks.workunit.client.0.smithi079.stdout:0/894: readlink d4/d12/d16/d53/d79/lc2 0 2024-09-10T09:36:12.114 INFO:tasks.workunit.client.0.smithi079.stdout:5/867: dwrite d2/d3/d27/d70/d80/d94/f10d [0,4194304] 0 2024-09-10T09:36:12.114 INFO:tasks.workunit.client.0.smithi079.stdout:5/868: chown d2/d3/d27/d32/db6/c119 60220 1 2024-09-10T09:36:12.119 INFO:tasks.workunit.client.0.smithi079.stdout:2/852: sync 2024-09-10T09:36:12.119 INFO:tasks.workunit.client.0.smithi079.stdout:4/862: sync 2024-09-10T09:36:12.119 INFO:tasks.workunit.client.0.smithi079.stdout:8/839: sync 2024-09-10T09:36:12.120 INFO:tasks.workunit.client.0.smithi079.stdout:2/853: chown d4/dc/d1c/l8a 419 1 2024-09-10T09:36:12.120 INFO:tasks.workunit.client.0.smithi079.stdout:3/923: sync 2024-09-10T09:36:12.120 INFO:tasks.workunit.client.0.smithi079.stdout:2/854: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/fae 565290810 1 2024-09-10T09:36:12.120 INFO:tasks.workunit.client.0.smithi079.stdout:2/855: write d4/f66 [697247,33851] 0 2024-09-10T09:36:12.122 INFO:tasks.workunit.client.0.smithi079.stdout:0/895: write d4/d12/d16/de3/dac/f10d [3741470,46604] 0 2024-09-10T09:36:12.122 INFO:tasks.workunit.client.0.smithi079.stdout:0/896: read d4/f5 [1030895,77887] 0 2024-09-10T09:36:12.131 INFO:tasks.workunit.client.0.smithi079.stdout:2/856: mkdir d4/dc/d1c/d86/d1b/d38/d39/d117 0 2024-09-10T09:36:12.131 INFO:tasks.workunit.client.0.smithi079.stdout:2/857: fdatasync d4/dc/d1c/d86/d1b/d38/d39/d31/f46 0 2024-09-10T09:36:12.131 INFO:tasks.workunit.client.0.smithi079.stdout:2/858: dread - d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f10e zero size 2024-09-10T09:36:12.131 INFO:tasks.workunit.client.0.smithi079.stdout:9/798: sync 2024-09-10T09:36:12.131 INFO:tasks.workunit.client.0.smithi079.stdout:7/806: sync 2024-09-10T09:36:12.131 INFO:tasks.workunit.client.0.smithi079.stdout:7/807: truncate d4/df/fc7 947001 0 2024-09-10T09:36:12.133 INFO:tasks.workunit.client.0.smithi079.stdout:0/897: write d4/fd [2060712,119116] 0 2024-09-10T09:36:12.133 INFO:tasks.workunit.client.0.smithi079.stdout:0/898: dread - d4/f11e zero size 2024-09-10T09:36:12.137 INFO:tasks.workunit.client.0.smithi079.stdout:8/840: link d11/d2b/f76 d11/d2b/d4b/d7e/db2/f10b 0 2024-09-10T09:36:12.140 INFO:tasks.workunit.client.0.smithi079.stdout:5/869: dwrite d2/d3/d27/d32/de3/d4d/f10b [0,4194304] 0 2024-09-10T09:36:12.140 INFO:tasks.workunit.client.0.smithi079.stdout:2/859: mknod d4/d5d/c118 0 2024-09-10T09:36:12.140 INFO:tasks.workunit.client.0.smithi079.stdout:4/863: dread d1/da/d28/d47/da1/fc5 [0,4194304] 0 2024-09-10T09:36:12.140 INFO:tasks.workunit.client.0.smithi079.stdout:1/996: dwrite d5/fe [0,4194304] 0 2024-09-10T09:36:12.140 INFO:tasks.workunit.client.0.smithi079.stdout:1/997: fsync d5/d24/d36/d53/db3/de3/f130 0 2024-09-10T09:36:12.140 INFO:tasks.workunit.client.0.smithi079.stdout:1/998: chown d5/d24/d36/df3/l103 7362821 1 2024-09-10T09:36:12.143 INFO:tasks.workunit.client.0.smithi079.stdout:7/808: rmdir d4/dc/d43 39 2024-09-10T09:36:12.143 INFO:tasks.workunit.client.0.smithi079.stdout:7/809: creat d4/d6/d4f/d70/db6/dca/fef x:0 0 0 2024-09-10T09:36:12.145 INFO:tasks.workunit.client.0.smithi079.stdout:5/870: write d2/d3/d5e/d73/f8b [5064788,11124] 0 2024-09-10T09:36:12.165 INFO:tasks.workunit.client.0.smithi079.stdout:3/924: dwrite d4/da/d8a/dd7/d10e/d79/dab/d117/ffd [0,4194304] 0 2024-09-10T09:36:12.165 INFO:tasks.workunit.client.0.smithi079.stdout:3/925: read - d4/da/d8a/fc7 zero size 2024-09-10T09:36:12.168 INFO:tasks.workunit.client.0.smithi079.stdout:2/860: rename d4/dc/d1c/d86/f16 to d4/dc/d1c/d86/d1b/d38/f119 0 2024-09-10T09:36:12.169 INFO:tasks.workunit.client.0.smithi079.stdout:9/799: dwrite d3/d7/d26/fa6 [0,4194304] 0 2024-09-10T09:36:12.170 INFO:tasks.workunit.client.0.smithi079.stdout:9/800: chown d3/d7/dc/de/d17/d2f/d98/da1 45089986 1 2024-09-10T09:36:12.170 INFO:tasks.workunit.client.0.smithi079.stdout:9/801: dread - d3/d7/dc/de/d17/d2f/d98/fbb zero size 2024-09-10T09:36:12.172 INFO:tasks.workunit.client.0.smithi079.stdout:2/861: dread d4/dc/d1c/d86/d1b/d38/f10a [0,4194304] 0 2024-09-10T09:36:12.172 INFO:tasks.workunit.client.0.smithi079.stdout:1/999: truncate d5/d24/d36/d53/db3/de3/f51 1348733 0 2024-09-10T09:36:12.182 INFO:tasks.workunit.client.0.smithi079.stdout:5/871: mknod d2/d3/d27/d32/db6/c11a 0 2024-09-10T09:36:12.187 INFO:tasks.workunit.client.0.smithi079.stdout:3/926: mknod d4/da/d8a/dd7/d10e/dbe/d11e/c123 0 2024-09-10T09:36:12.193 INFO:tasks.workunit.client.0.smithi079.stdout:5/872: symlink d2/d3/d27/d70/d80/d94/l11b 0 2024-09-10T09:36:12.193 INFO:tasks.workunit.client.0.smithi079.stdout:5/873: write d2/d3/d27/d32/d39/dc2/ffc [42905,120238] 0 2024-09-10T09:36:12.195 INFO:tasks.workunit.client.0.smithi079.stdout:5/874: mkdir d2/d3/d27/d32/d39/d11c 0 2024-09-10T09:36:12.195 INFO:tasks.workunit.client.0.smithi079.stdout:5/875: getdents d2/d3/d27 0 2024-09-10T09:36:12.197 INFO:tasks.workunit.client.0.smithi079.stdout:5/876: mkdir d2/d3/d27/d32/de3/d4d/d11d 0 2024-09-10T09:36:12.197 INFO:tasks.workunit.client.0.smithi079.stdout:5/877: readlink d2/d3/d27/d70/d88/ld4 0 2024-09-10T09:36:12.205 INFO:tasks.workunit.client.0.smithi079.stdout:8/841: dwrite d11/ff6 [4194304,4194304] 0 2024-09-10T09:36:12.210 INFO:tasks.workunit.client.0.smithi079.stdout:0/899: dwrite d4/d12/d16/de3/dac/f103 [0,4194304] 0 2024-09-10T09:36:12.210 INFO:tasks.workunit.client.0.smithi079.stdout:8/842: truncate d11/d2b/d4b/d50/d55/f53 302676 0 2024-09-10T09:36:12.210 INFO:tasks.workunit.client.0.smithi079.stdout:8/843: creat d11/dbd/f10c x:0 0 0 2024-09-10T09:36:12.210 INFO:tasks.workunit.client.0.smithi079.stdout:7/810: dwrite d4/dc/f3a [0,4194304] 0 2024-09-10T09:36:12.211 INFO:tasks.workunit.client.0.smithi079.stdout:9/802: dwrite d3/f16 [0,4194304] 0 2024-09-10T09:36:12.212 INFO:tasks.workunit.client.0.smithi079.stdout:4/864: dwrite d1/da/d28/d99/fb0 [0,4194304] 0 2024-09-10T09:36:12.212 INFO:tasks.workunit.client.0.smithi079.stdout:5/878: write d2/d3/d5e/fa7 [695583,92836] 0 2024-09-10T09:36:12.212 INFO:tasks.workunit.client.0.smithi079.stdout:5/879: fsync d2/d3/d27/d32/d44/f66 0 2024-09-10T09:36:12.212 INFO:tasks.workunit.client.0.smithi079.stdout:4/865: creat d1/da/d16/d88/f119 x:0 0 0 2024-09-10T09:36:12.212 INFO:tasks.workunit.client.0.smithi079.stdout:3/927: dwrite d4/da/d67/f119 [0,4194304] 0 2024-09-10T09:36:12.217 INFO:tasks.workunit.client.0.smithi079.stdout:0/900: symlink d4/d12/d1a/d6d/d84/l124 0 2024-09-10T09:36:12.218 INFO:tasks.workunit.client.0.smithi079.stdout:4/866: dread d1/d38/fdb [0,4194304] 0 2024-09-10T09:36:12.218 INFO:tasks.workunit.client.0.smithi079.stdout:4/867: chown d1/da/d16/d57/l5b 7065510 1 2024-09-10T09:36:12.221 INFO:tasks.workunit.client.0.smithi079.stdout:8/844: getdents d11/d2b/d4b/d74/da2 0 2024-09-10T09:36:12.222 INFO:tasks.workunit.client.0.smithi079.stdout:7/811: mknod d4/df/d3d/d82/cf0 0 2024-09-10T09:36:12.226 INFO:tasks.workunit.client.0.smithi079.stdout:9/803: mknod d3/d7/dc/de/d17/d2f/d74/c10c 0 2024-09-10T09:36:12.226 INFO:tasks.workunit.client.0.smithi079.stdout:9/804: write d3/d7/d70/dbc/fdc [1550614,102516] 0 2024-09-10T09:36:12.237 INFO:tasks.workunit.client.0.smithi079.stdout:7/812: dwrite d4/d6/d4f/d70/db6/dca/fe4 [0,4194304] 0 2024-09-10T09:36:12.246 INFO:tasks.workunit.client.0.smithi079.stdout:5/880: creat d2/d3/d5e/f11e x:0 0 0 2024-09-10T09:36:12.246 INFO:tasks.workunit.client.0.smithi079.stdout:5/881: read d2/d3/f84 [20806,22389] 0 2024-09-10T09:36:12.252 INFO:tasks.workunit.client.0.smithi079.stdout:3/928: mknod d4/da/d17/c124 0 2024-09-10T09:36:12.252 INFO:tasks.workunit.client.0.smithi079.stdout:7/813: dwrite d4/d6/f16 [0,4194304] 0 2024-09-10T09:36:12.252 INFO:tasks.workunit.client.0.smithi079.stdout:7/814: write d4/df/d3d/d82/f5c [82974,120833] 0 2024-09-10T09:36:12.252 INFO:tasks.workunit.client.0.smithi079.stdout:7/815: write d4/dc/d43/fa5 [825371,83985] 0 2024-09-10T09:36:12.254 INFO:tasks.workunit.client.0.smithi079.stdout:0/901: mknod d4/d12/d15/c125 0 2024-09-10T09:36:12.257 INFO:tasks.workunit.client.0.smithi079.stdout:4/868: unlink d1/da/d28/d47/da1/c72 0 2024-09-10T09:36:12.257 INFO:tasks.workunit.client.0.smithi079.stdout:4/869: chown d1/da/d3b/d5f/l61 5929 1 2024-09-10T09:36:12.257 INFO:tasks.workunit.client.0.smithi079.stdout:5/882: dread d2/d3/d27/d32/de3/f51 [0,4194304] 0 2024-09-10T09:36:12.261 INFO:tasks.workunit.client.0.smithi079.stdout:9/805: creat d3/d7/dc/d7a/da9/dd4/f10d x:0 0 0 2024-09-10T09:36:12.266 INFO:tasks.workunit.client.0.smithi079.stdout:3/929: symlink d4/da/d56/l125 0 2024-09-10T09:36:12.266 INFO:tasks.workunit.client.0.smithi079.stdout:3/930: dread - d4/da/d17/d9b/fd0 zero size 2024-09-10T09:36:12.266 INFO:tasks.workunit.client.0.smithi079.stdout:3/931: read d4/da/d17/f30 [2077679,98412] 0 2024-09-10T09:36:12.267 INFO:tasks.workunit.client.0.smithi079.stdout:3/932: fsync d4/da/d56/d7b/fdb 0 2024-09-10T09:36:12.272 INFO:tasks.workunit.client.0.smithi079.stdout:7/816: mkdir d4/df/d3d/de6/df1 0 2024-09-10T09:36:12.274 INFO:tasks.workunit.client.0.smithi079.stdout:0/902: unlink d4/d1d/f116 0 2024-09-10T09:36:12.274 INFO:tasks.workunit.client.0.smithi079.stdout:7/817: dread d4/df/d6b/f8b [4194304,4194304] 0 2024-09-10T09:36:12.276 INFO:tasks.workunit.client.0.smithi079.stdout:4/870: creat d1/da/d3b/d5a/f11a x:0 0 0 2024-09-10T09:36:12.276 INFO:tasks.workunit.client.0.smithi079.stdout:4/871: write d1/da/d16/d4d/fe2 [5226027,86295] 0 2024-09-10T09:36:12.277 INFO:tasks.workunit.client.0.smithi079.stdout:4/872: fdatasync d1/da/d16/f26 0 2024-09-10T09:36:12.277 INFO:tasks.workunit.client.0.smithi079.stdout:4/873: write d1/da/d16/d21/d32/f98 [338275,69352] 0 2024-09-10T09:36:12.277 INFO:tasks.workunit.client.0.smithi079.stdout:4/874: chown d1/da/d16/f27 5076804 1 2024-09-10T09:36:12.277 INFO:tasks.workunit.client.0.smithi079.stdout:4/875: chown d1/da/d28/d95/f8d 19874086 1 2024-09-10T09:36:12.277 INFO:tasks.workunit.client.0.smithi079.stdout:8/845: mknod d11/d2b/c10d 0 2024-09-10T09:36:12.281 INFO:tasks.workunit.client.0.smithi079.stdout:8/846: dread d11/f1e [0,4194304] 0 2024-09-10T09:36:12.282 INFO:tasks.workunit.client.0.smithi079.stdout:8/847: fsync d11/d2b/d4b/da8/ff8 0 2024-09-10T09:36:12.282 INFO:tasks.workunit.client.0.smithi079.stdout:9/806: mkdir d3/d7/dc/de/da7/dac/d10e 0 2024-09-10T09:36:12.283 INFO:tasks.workunit.client.0.smithi079.stdout:3/933: creat d4/da/d8a/dd7/d10e/dbe/f126 x:0 0 0 2024-09-10T09:36:12.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/903: rename d4/d12/d15/d6b/fd6 to d4/d12/d21/d3f/d80/f126 0 2024-09-10T09:36:12.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/904: chown d4/fd 5393 1 2024-09-10T09:36:12.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/905: write d4/d12/d16/de3/f63 [656632,88400] 0 2024-09-10T09:36:12.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/906: read - d4/d12/d15/d69/ff6 zero size 2024-09-10T09:36:12.286 INFO:tasks.workunit.client.0.smithi079.stdout:0/907: creat d4/d12/d16/de3/dac/f127 x:0 0 0 2024-09-10T09:36:12.288 INFO:tasks.workunit.client.0.smithi079.stdout:7/818: creat d4/d6/d4f/d66/ff2 x:0 0 0 2024-09-10T09:36:12.290 INFO:tasks.workunit.client.0.smithi079.stdout:8/848: dread d11/d2b/fad [0,4194304] 0 2024-09-10T09:36:12.291 INFO:tasks.workunit.client.0.smithi079.stdout:8/849: dread d11/d2b/d4b/da8/fb9 [0,4194304] 0 2024-09-10T09:36:12.291 INFO:tasks.workunit.client.0.smithi079.stdout:4/876: rmdir d1/da/d28/d99 39 2024-09-10T09:36:12.292 INFO:tasks.workunit.client.0.smithi079.stdout:3/934: mknod d4/da/d56/d7b/dd1/d11d/c127 0 2024-09-10T09:36:12.295 INFO:tasks.workunit.client.0.smithi079.stdout:9/807: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:12.295 INFO:tasks.workunit.client.0.smithi079.stdout:9/808: chown d3/d7/dc/de/d17/d4c/cee 30 1 2024-09-10T09:36:12.296 INFO:tasks.workunit.client.0.smithi079.stdout:0/908: mknod d4/d12/c128 0 2024-09-10T09:36:12.299 INFO:tasks.workunit.client.0.smithi079.stdout:7/819: link d4/df/d6b/d9a/le3 d4/d6/lf3 0 2024-09-10T09:36:12.301 INFO:tasks.workunit.client.0.smithi079.stdout:8/850: mknod d11/dd8/c10e 0 2024-09-10T09:36:12.305 INFO:tasks.workunit.client.0.smithi079.stdout:4/877: creat d1/da/d28/d47/da1/d73/f11b x:0 0 0 2024-09-10T09:36:12.311 INFO:tasks.workunit.client.0.smithi079.stdout:3/935: unlink d4/da/d8a/fc7 0 2024-09-10T09:36:12.311 INFO:tasks.workunit.client.0.smithi079.stdout:3/936: write d4/da/d17/f24 [312065,81114] 0 2024-09-10T09:36:12.313 INFO:tasks.workunit.client.0.smithi079.stdout:4/878: dread d1/da/d28/d99/faf [0,4194304] 0 2024-09-10T09:36:12.313 INFO:tasks.workunit.client.0.smithi079.stdout:8/851: dread d11/d2b/f47 [0,4194304] 0 2024-09-10T09:36:12.317 INFO:tasks.workunit.client.0.smithi079.stdout:9/809: symlink d3/d7/dc/d7a/da9/l10f 0 2024-09-10T09:36:12.321 INFO:tasks.workunit.client.0.smithi079.stdout:3/937: rmdir d4/da/d17/d9b/db1 39 2024-09-10T09:36:12.321 INFO:tasks.workunit.client.0.smithi079.stdout:3/938: write d4/da/d18/f6d [1215515,107045] 0 2024-09-10T09:36:12.325 INFO:tasks.workunit.client.0.smithi079.stdout:8/852: creat d11/d2b/d4b/d50/d9e/f10f x:0 0 0 2024-09-10T09:36:12.327 INFO:tasks.workunit.client.0.smithi079.stdout:9/810: creat d3/d7/dc/de/da7/df1/d100/f110 x:0 0 0 2024-09-10T09:36:12.332 INFO:tasks.workunit.client.0.smithi079.stdout:7/820: dwrite d4/df/d3d/d75/fed [0,4194304] 0 2024-09-10T09:36:12.332 INFO:tasks.workunit.client.0.smithi079.stdout:7/821: creat d4/df/d19/db9/ff4 x:0 0 0 2024-09-10T09:36:12.334 INFO:tasks.workunit.client.0.smithi079.stdout:0/909: dwrite d4/fe [0,4194304] 0 2024-09-10T09:36:12.334 INFO:tasks.workunit.client.0.smithi079.stdout:0/910: truncate d4/d12/d16/d53/f100 65205 0 2024-09-10T09:36:12.334 INFO:tasks.workunit.client.0.smithi079.stdout:4/879: dwrite d1/da/d16/d88/f119 [0,4194304] 0 2024-09-10T09:36:12.334 INFO:tasks.workunit.client.0.smithi079.stdout:4/880: fsync d1/da/d16/d88/ff7 0 2024-09-10T09:36:12.334 INFO:tasks.workunit.client.0.smithi079.stdout:4/881: readlink d1/da/d3b/d5f/l61 0 2024-09-10T09:36:12.337 INFO:tasks.workunit.client.0.smithi079.stdout:2/862: sync 2024-09-10T09:36:12.337 INFO:tasks.workunit.client.0.smithi079.stdout:2/863: write d4/dc/d1c/f100 [1387052,42575] 0 2024-09-10T09:36:12.338 INFO:tasks.workunit.client.0.smithi079.stdout:8/853: dread d11/ff6 [4194304,4194304] 0 2024-09-10T09:36:12.338 INFO:tasks.workunit.client.0.smithi079.stdout:8/854: fdatasync d11/f2a 0 2024-09-10T09:36:12.338 INFO:tasks.workunit.client.0.smithi079.stdout:8/855: truncate d11/d48/fd5 144815 0 2024-09-10T09:36:12.342 INFO:tasks.workunit.client.0.smithi079.stdout:0/911: mknod d4/d12/d15/c129 0 2024-09-10T09:36:12.342 INFO:tasks.workunit.client.0.smithi079.stdout:0/912: write d4/f11e [75438,126878] 0 2024-09-10T09:36:12.353 INFO:tasks.workunit.client.0.smithi079.stdout:4/882: creat d1/da/d16/d88/d10b/f11c x:0 0 0 2024-09-10T09:36:12.355 INFO:tasks.workunit.client.0.smithi079.stdout:8/856: getdents d11/d2b/d4b/d50 0 2024-09-10T09:36:12.358 INFO:tasks.workunit.client.0.smithi079.stdout:7/822: symlink d4/df/d19/lf5 0 2024-09-10T09:36:12.358 INFO:tasks.workunit.client.0.smithi079.stdout:7/823: creat d4/df/d3d/d75/ff6 x:0 0 0 2024-09-10T09:36:12.358 INFO:tasks.workunit.client.0.smithi079.stdout:7/824: stat d4/d6/da9 0 2024-09-10T09:36:12.359 INFO:tasks.workunit.client.0.smithi079.stdout:0/913: creat d4/d12/d15/d6b/daa/f12a x:0 0 0 2024-09-10T09:36:12.361 INFO:tasks.workunit.client.0.smithi079.stdout:8/857: mkdir d11/d91/d110 0 2024-09-10T09:36:12.367 INFO:tasks.workunit.client.0.smithi079.stdout:7/825: mknod d4/df/d19/cf7 0 2024-09-10T09:36:12.369 INFO:tasks.workunit.client.0.smithi079.stdout:8/858: dread d11/d2b/d4b/f6b [0,4194304] 0 2024-09-10T09:36:12.370 INFO:tasks.workunit.client.0.smithi079.stdout:7/826: mkdir d4/d6/d38/df8 0 2024-09-10T09:36:12.372 INFO:tasks.workunit.client.0.smithi079.stdout:8/859: unlink ff 0 2024-09-10T09:36:12.372 INFO:tasks.workunit.client.0.smithi079.stdout:8/860: fsync d11/fc8 0 2024-09-10T09:36:12.372 INFO:tasks.workunit.client.0.smithi079.stdout:8/861: fsync d11/d2b/d4b/da8/fff 0 2024-09-10T09:36:12.374 INFO:tasks.workunit.client.0.smithi079.stdout:7/827: unlink d4/dc/c3c 0 2024-09-10T09:36:12.375 INFO:tasks.workunit.client.0.smithi079.stdout:8/862: mkdir d11/d91/d110/d111 0 2024-09-10T09:36:12.375 INFO:tasks.workunit.client.0.smithi079.stdout:8/863: creat d11/d2b/d4b/f112 x:0 0 0 2024-09-10T09:36:12.376 INFO:tasks.workunit.client.0.smithi079.stdout:8/864: dread - d11/d91/d108/fd3 zero size 2024-09-10T09:36:12.377 INFO:tasks.workunit.client.0.smithi079.stdout:7/828: rmdir d4/d6/d38 39 2024-09-10T09:36:12.377 INFO:tasks.workunit.client.0.smithi079.stdout:7/829: truncate d4/d6/d4f/d66/ff2 905230 0 2024-09-10T09:36:12.380 INFO:tasks.workunit.client.0.smithi079.stdout:8/865: rmdir d11/d91/d108 39 2024-09-10T09:36:12.383 INFO:tasks.workunit.client.0.smithi079.stdout:7/830: mkdir d4/d6/d38/dc1/df9 0 2024-09-10T09:36:12.390 INFO:tasks.workunit.client.0.smithi079.stdout:7/831: dread d4/df/d3d/d75/f83 [0,4194304] 0 2024-09-10T09:36:12.393 INFO:tasks.workunit.client.0.smithi079.stdout:7/832: symlink d4/d6/d38/dc1/lfa 0 2024-09-10T09:36:12.395 INFO:tasks.workunit.client.0.smithi079.stdout:7/833: mknod d4/df/d6b/cfb 0 2024-09-10T09:36:12.397 INFO:tasks.workunit.client.0.smithi079.stdout:5/883: sync 2024-09-10T09:36:12.397 INFO:tasks.workunit.client.0.smithi079.stdout:7/834: truncate d4/d6/da9/fb5 435968 0 2024-09-10T09:36:12.398 INFO:tasks.workunit.client.0.smithi079.stdout:8/866: dwrite d11/f16 [0,4194304] 0 2024-09-10T09:36:12.400 INFO:tasks.workunit.client.0.smithi079.stdout:7/835: creat d4/df/ffc x:0 0 0 2024-09-10T09:36:12.400 INFO:tasks.workunit.client.0.smithi079.stdout:7/836: fdatasync d4/df/d3d/d82/f6f 0 2024-09-10T09:36:12.405 INFO:tasks.workunit.client.0.smithi079.stdout:5/884: dread d2/d3/fc9 [0,4194304] 0 2024-09-10T09:36:12.405 INFO:tasks.workunit.client.0.smithi079.stdout:5/885: rename d2 to d2/d3/d27/d11f 22 2024-09-10T09:36:12.409 INFO:tasks.workunit.client.0.smithi079.stdout:7/837: truncate d4/dc/d43/fa5 812660 0 2024-09-10T09:36:12.412 INFO:tasks.workunit.client.0.smithi079.stdout:8/867: getdents d11 0 2024-09-10T09:36:12.419 INFO:tasks.workunit.client.0.smithi079.stdout:5/886: dwrite d2/d3/d27/d32/d44/f4c [0,4194304] 0 2024-09-10T09:36:12.419 INFO:tasks.workunit.client.0.smithi079.stdout:8/868: link d11/d2b/l33 d11/d2b/l113 0 2024-09-10T09:36:12.419 INFO:tasks.workunit.client.0.smithi079.stdout:8/869: stat d11/d48/l8e 0 2024-09-10T09:36:12.425 INFO:tasks.workunit.client.0.smithi079.stdout:5/887: read d2/d3/d27/d32/f6d [3715878,108168] 0 2024-09-10T09:36:12.431 INFO:tasks.workunit.client.0.smithi079.stdout:5/888: creat d2/d3/d27/d32/de3/d4d/d11d/f120 x:0 0 0 2024-09-10T09:36:12.431 INFO:tasks.workunit.client.0.smithi079.stdout:5/889: fdatasync d2/d3/d27/d32/d44/db4/fdb 0 2024-09-10T09:36:12.432 INFO:tasks.workunit.client.0.smithi079.stdout:5/890: mkdir d2/d3/d27/d32/de3/d4d/d11d/d121 0 2024-09-10T09:36:12.435 INFO:tasks.workunit.client.0.smithi079.stdout:5/891: truncate d2/f113 3933733 0 2024-09-10T09:36:12.445 INFO:tasks.workunit.client.0.smithi079.stdout:5/892: dread d2/d3/d27/f2c [0,4194304] 0 2024-09-10T09:36:12.448 INFO:tasks.workunit.client.0.smithi079.stdout:5/893: mkdir d2/d3/d27/d70/d80/d122 0 2024-09-10T09:36:12.453 INFO:tasks.workunit.client.0.smithi079.stdout:5/894: getdents d2/d3/d27/d32/de3/d4d 0 2024-09-10T09:36:12.454 INFO:tasks.workunit.client.0.smithi079.stdout:5/895: stat d2/d3/d27/d32/l48 0 2024-09-10T09:36:12.455 INFO:tasks.workunit.client.0.smithi079.stdout:7/838: dwrite d4/d6/d3e/f86 [0,4194304] 0 2024-09-10T09:36:12.456 INFO:tasks.workunit.client.0.smithi079.stdout:5/896: unlink d2/fab 0 2024-09-10T09:36:12.456 INFO:tasks.workunit.client.0.smithi079.stdout:5/897: readlink d2/d3/d27/d32/l62 0 2024-09-10T09:36:12.462 INFO:tasks.workunit.client.0.smithi079.stdout:3/939: sync 2024-09-10T09:36:12.462 INFO:tasks.workunit.client.0.smithi079.stdout:9/811: sync 2024-09-10T09:36:12.462 INFO:tasks.workunit.client.0.smithi079.stdout:7/839: truncate d4/df/fc7 1888968 0 2024-09-10T09:36:12.462 INFO:tasks.workunit.client.0.smithi079.stdout:7/840: creat d4/df/d6b/d9a/dde/ffd x:0 0 0 2024-09-10T09:36:12.462 INFO:tasks.workunit.client.0.smithi079.stdout:7/841: fdatasync d4/d6/d3e/f51 0 2024-09-10T09:36:12.463 INFO:tasks.workunit.client.0.smithi079.stdout:5/898: creat d2/d3/d27/d32/f123 x:0 0 0 2024-09-10T09:36:12.465 INFO:tasks.workunit.client.0.smithi079.stdout:9/812: unlink d3/d40/dc0/f108 0 2024-09-10T09:36:12.465 INFO:tasks.workunit.client.0.smithi079.stdout:9/813: chown d3/f6f 60 1 2024-09-10T09:36:12.466 INFO:tasks.workunit.client.0.smithi079.stdout:3/940: symlink d4/da/d17/d9b/l128 0 2024-09-10T09:36:12.467 INFO:tasks.workunit.client.0.smithi079.stdout:3/941: write d4/da/d17/d2d/d43/d4c/f95 [3152023,54233] 0 2024-09-10T09:36:12.467 INFO:tasks.workunit.client.0.smithi079.stdout:4/883: sync 2024-09-10T09:36:12.467 INFO:tasks.workunit.client.0.smithi079.stdout:0/914: sync 2024-09-10T09:36:12.467 INFO:tasks.workunit.client.0.smithi079.stdout:2/864: sync 2024-09-10T09:36:12.468 INFO:tasks.workunit.client.0.smithi079.stdout:0/915: fsync d4/f5 0 2024-09-10T09:36:12.468 INFO:tasks.workunit.client.0.smithi079.stdout:2/865: rename d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/d11a 22 2024-09-10T09:36:12.468 INFO:tasks.workunit.client.0.smithi079.stdout:2/866: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/f15 0 2024-09-10T09:36:12.470 INFO:tasks.workunit.client.0.smithi079.stdout:7/842: mkdir d4/d6/d4f/dfe 0 2024-09-10T09:36:12.471 INFO:tasks.workunit.client.0.smithi079.stdout:5/899: mknod d2/d3/d27/d70/d88/df2/c124 0 2024-09-10T09:36:12.473 INFO:tasks.workunit.client.0.smithi079.stdout:9/814: mknod d3/d7/dc/d7a/da9/dd4/c111 0 2024-09-10T09:36:12.473 INFO:tasks.workunit.client.0.smithi079.stdout:9/815: dread - d3/d7/dc/de/d17/d2f/d98/da1/fb9 zero size 2024-09-10T09:36:12.476 INFO:tasks.workunit.client.0.smithi079.stdout:9/816: dread d3/f6f [0,4194304] 0 2024-09-10T09:36:12.477 INFO:tasks.workunit.client.0.smithi079.stdout:3/942: creat d4/da/d17/d2d/d43/d113/d11a/f129 x:0 0 0 2024-09-10T09:36:12.480 INFO:tasks.workunit.client.0.smithi079.stdout:2/867: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/f27 [0,4194304] 0 2024-09-10T09:36:12.480 INFO:tasks.workunit.client.0.smithi079.stdout:2/868: fdatasync d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fce 0 2024-09-10T09:36:12.480 INFO:tasks.workunit.client.0.smithi079.stdout:2/869: fsync d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f10e 0 2024-09-10T09:36:12.481 INFO:tasks.workunit.client.0.smithi079.stdout:7/843: creat d4/d6/d38/dd9/fff x:0 0 0 2024-09-10T09:36:12.481 INFO:tasks.workunit.client.0.smithi079.stdout:7/844: fsync d4/d6/d4f/da7/fcb 0 2024-09-10T09:36:12.481 INFO:tasks.workunit.client.0.smithi079.stdout:7/845: fdatasync d4/df/d3d/d75/fed 0 2024-09-10T09:36:12.483 INFO:tasks.workunit.client.0.smithi079.stdout:5/900: rename d2/d3/d27/d32/d39/fe8 to d2/d3/d27/f125 0 2024-09-10T09:36:12.483 INFO:tasks.workunit.client.0.smithi079.stdout:5/901: chown d2/f24 6325013 1 2024-09-10T09:36:12.483 INFO:tasks.workunit.client.0.smithi079.stdout:5/902: getdents d2/d3/d27/d70/d80/d122 0 2024-09-10T09:36:12.485 INFO:tasks.workunit.client.0.smithi079.stdout:9/817: mkdir d3/d7/dc/d7a/d112 0 2024-09-10T09:36:12.485 INFO:tasks.workunit.client.0.smithi079.stdout:9/818: stat d3/f11 0 2024-09-10T09:36:12.487 INFO:tasks.workunit.client.0.smithi079.stdout:3/943: creat d4/da/d17/d2d/d43/de7/deb/f12a x:0 0 0 2024-09-10T09:36:12.494 INFO:tasks.workunit.client.0.smithi079.stdout:5/903: read d2/d3/d27/d32/d39/f5c [300708,49031] 0 2024-09-10T09:36:12.495 INFO:tasks.workunit.client.0.smithi079.stdout:7/846: unlink d4/f61 0 2024-09-10T09:36:12.495 INFO:tasks.workunit.client.0.smithi079.stdout:7/847: chown d4/d6/d3e/f7a 235092 1 2024-09-10T09:36:12.497 INFO:tasks.workunit.client.0.smithi079.stdout:9/819: mkdir d3/d7/dc/de/d17/d12/d113 0 2024-09-10T09:36:12.499 INFO:tasks.workunit.client.0.smithi079.stdout:3/944: symlink d4/da/d8a/dd7/d10e/d79/dab/d102/l12b 0 2024-09-10T09:36:12.505 INFO:tasks.workunit.client.0.smithi079.stdout:7/848: link d4/d6/f99 d4/d6/d38/dc1/df9/f100 0 2024-09-10T09:36:12.505 INFO:tasks.workunit.client.0.smithi079.stdout:7/849: write d4/df/d6b/f8e [1145936,113467] 0 2024-09-10T09:36:12.505 INFO:tasks.workunit.client.0.smithi079.stdout:7/850: readlink d4/l93 0 2024-09-10T09:36:12.505 INFO:tasks.workunit.client.0.smithi079.stdout:7/851: creat d4/df/d6b/d9a/d9c/f101 x:0 0 0 2024-09-10T09:36:12.505 INFO:tasks.workunit.client.0.smithi079.stdout:7/852: creat d4/d6/d38/dc1/f102 x:0 0 0 2024-09-10T09:36:12.505 INFO:tasks.workunit.client.0.smithi079.stdout:7/853: chown d4/d6/da9 4112443 1 2024-09-10T09:36:12.505 INFO:tasks.workunit.client.0.smithi079.stdout:7/854: chown d4/dc/d43/dab 221653 1 2024-09-10T09:36:12.506 INFO:tasks.workunit.client.0.smithi079.stdout:9/820: mknod d3/d40/dc0/c114 0 2024-09-10T09:36:12.508 INFO:tasks.workunit.client.0.smithi079.stdout:3/945: rename d4/da/d56/l125 to d4/da/d17/d54/l12c 0 2024-09-10T09:36:12.509 INFO:tasks.workunit.client.0.smithi079.stdout:5/904: rmdir d2/d3/d27/d32/d39/dc2 39 2024-09-10T09:36:12.510 INFO:tasks.workunit.client.0.smithi079.stdout:4/884: dwrite d1/da/d28/d47/da1/d83/f109 [0,4194304] 0 2024-09-10T09:36:12.511 INFO:tasks.workunit.client.0.smithi079.stdout:2/870: dwrite d4/dc/d1c/d86/d1b/d38/d87/fbe [0,4194304] 0 2024-09-10T09:36:12.511 INFO:tasks.workunit.client.0.smithi079.stdout:2/871: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fcd 249 1 2024-09-10T09:36:12.518 INFO:tasks.workunit.client.0.smithi079.stdout:9/821: dread d3/d7/dc/de/da7/df1/ffe [4194304,4194304] 0 2024-09-10T09:36:12.518 INFO:tasks.workunit.client.0.smithi079.stdout:3/946: mknod d4/da/d17/d9b/c12d 0 2024-09-10T09:36:12.518 INFO:tasks.workunit.client.0.smithi079.stdout:4/885: dread d1/da/d16/fd3 [4194304,4194304] 0 2024-09-10T09:36:12.521 INFO:tasks.workunit.client.0.smithi079.stdout:5/905: mkdir d2/d3/d27/d70/d80/d126 0 2024-09-10T09:36:12.522 INFO:tasks.workunit.client.0.smithi079.stdout:3/947: write d4/f2a [3051616,42907] 0 2024-09-10T09:36:12.522 INFO:tasks.workunit.client.0.smithi079.stdout:3/948: chown d4/da/d17/d2d/c7f 38009 1 2024-09-10T09:36:12.528 INFO:tasks.workunit.client.0.smithi079.stdout:9/822: dread d3/d7/dc/de/d17/d2f/f79 [0,4194304] 0 2024-09-10T09:36:12.533 INFO:tasks.workunit.client.0.smithi079.stdout:4/886: dread d1/da/d16/d4d/df6/f113 [0,4194304] 0 2024-09-10T09:36:12.533 INFO:tasks.workunit.client.0.smithi079.stdout:4/887: write d1/da/d16/d88/d10b/f11c [16492,99901] 0 2024-09-10T09:36:12.551 INFO:tasks.workunit.client.0.smithi079.stdout:2/872: dwrite d4/dc/d1c/d86/d1b/d38/d87/fbe [4194304,4194304] 0 2024-09-10T09:36:12.554 INFO:tasks.workunit.client.0.smithi079.stdout:2/873: dread d4/dc/d1c/f54 [0,4194304] 0 2024-09-10T09:36:12.557 INFO:tasks.workunit.client.0.smithi079.stdout:2/874: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/f11b x:0 0 0 2024-09-10T09:36:12.557 INFO:tasks.workunit.client.0.smithi079.stdout:2/875: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/f109 [415292,8737] 0 2024-09-10T09:36:12.562 INFO:tasks.workunit.client.0.smithi079.stdout:5/906: dwrite d2/d3/d5e/f11e [0,4194304] 0 2024-09-10T09:36:12.569 INFO:tasks.workunit.client.0.smithi079.stdout:5/907: rename d2/d3/d27/d32/de3/la6 to d2/d3/d5e/d73/l127 0 2024-09-10T09:36:12.569 INFO:tasks.workunit.client.0.smithi079.stdout:5/908: chown d2/d3/d59/c115 1881 1 2024-09-10T09:36:12.572 INFO:tasks.workunit.client.0.smithi079.stdout:3/949: dwrite d4/da/d17/d72/fd5 [0,4194304] 0 2024-09-10T09:36:12.572 INFO:tasks.workunit.client.0.smithi079.stdout:9/823: dwrite d3/d7/d26/f4d [0,4194304] 0 2024-09-10T09:36:12.572 INFO:tasks.workunit.client.0.smithi079.stdout:9/824: write d3/d7f/ff0 [772564,92917] 0 2024-09-10T09:36:12.572 INFO:tasks.workunit.client.0.smithi079.stdout:9/825: creat d3/d7/dc/de/d17/d2f/d74/f115 x:0 0 0 2024-09-10T09:36:12.573 INFO:tasks.workunit.client.0.smithi079.stdout:4/888: dwrite d1/da/d3b/d5a/f11a [0,4194304] 0 2024-09-10T09:36:12.574 INFO:tasks.workunit.client.0.smithi079.stdout:5/909: truncate d2/d3/f99 413429 0 2024-09-10T09:36:12.574 INFO:tasks.workunit.client.0.smithi079.stdout:5/910: chown d2/d3/d5e/d73/f8b 26421721 1 2024-09-10T09:36:12.575 INFO:tasks.workunit.client.0.smithi079.stdout:2/876: dwrite d4/dc/f70 [0,4194304] 0 2024-09-10T09:36:12.575 INFO:tasks.workunit.client.0.smithi079.stdout:2/877: creat d4/dc/d1c/d104/f11c x:0 0 0 2024-09-10T09:36:12.575 INFO:tasks.workunit.client.0.smithi079.stdout:2/878: getdents d4/dc/d1c/d86/d1b/d38/d39/d117 0 2024-09-10T09:36:12.577 INFO:tasks.workunit.client.0.smithi079.stdout:3/950: link d4/da/d17/d9b/fd0 d4/da/d8a/dd7/d10e/d79/dab/f12e 0 2024-09-10T09:36:12.581 INFO:tasks.workunit.client.0.smithi079.stdout:9/826: rename d3/d7f/c8b to d3/d40/c116 0 2024-09-10T09:36:12.581 INFO:tasks.workunit.client.0.smithi079.stdout:9/827: fsync d3/d7/dc/de/d17/d2f/d98/fbb 0 2024-09-10T09:36:12.581 INFO:tasks.workunit.client.0.smithi079.stdout:9/828: readlink d3/d7/dc/de/d17/d6e/lb5 0 2024-09-10T09:36:12.589 INFO:tasks.workunit.client.0.smithi079.stdout:4/889: link d1/da/lb6 d1/da/d28/d47/da1/d83/dfe/l11d 0 2024-09-10T09:36:12.591 INFO:tasks.workunit.client.0.smithi079.stdout:5/911: creat d2/d3/d27/d32/de3/d4d/f128 x:0 0 0 2024-09-10T09:36:12.596 INFO:tasks.workunit.client.0.smithi079.stdout:2/879: mknod d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/c11d 0 2024-09-10T09:36:12.596 INFO:tasks.workunit.client.0.smithi079.stdout:2/880: write d4/f66 [996622,3806] 0 2024-09-10T09:36:12.596 INFO:tasks.workunit.client.0.smithi079.stdout:2/881: truncate d4/dc/d1c/d86/f3f 4529419 0 2024-09-10T09:36:12.598 INFO:tasks.workunit.client.0.smithi079.stdout:3/951: truncate d4/da/d17/d9b/db1/fc0 1095200 0 2024-09-10T09:36:12.603 INFO:tasks.workunit.client.0.smithi079.stdout:5/912: truncate d2/d3/f28 4268165 0 2024-09-10T09:36:12.603 INFO:tasks.workunit.client.0.smithi079.stdout:5/913: fsync d2/d3/d27/d32/db6/ffb 0 2024-09-10T09:36:12.603 INFO:tasks.workunit.client.0.smithi079.stdout:5/914: chown d2/d3/d59/fb2 11305 1 2024-09-10T09:36:12.603 INFO:tasks.workunit.client.0.smithi079.stdout:5/915: read d2/d3/d27/fc6 [157215,15813] 0 2024-09-10T09:36:12.604 INFO:tasks.workunit.client.0.smithi079.stdout:5/916: stat d2/d3/d27/f125 0 2024-09-10T09:36:12.606 INFO:tasks.workunit.client.0.smithi079.stdout:3/952: rename d4/da/d18/f55 to d4/da/d18/daf/f12f 0 2024-09-10T09:36:12.611 INFO:tasks.workunit.client.0.smithi079.stdout:9/829: symlink d3/d7/dc/d62/l117 0 2024-09-10T09:36:12.611 INFO:tasks.workunit.client.0.smithi079.stdout:9/830: chown d3/d7/d26/d3d/f42 31261 1 2024-09-10T09:36:12.619 INFO:tasks.workunit.client.0.smithi079.stdout:3/953: creat d4/da/d17/d2d/d43/d113/f130 x:0 0 0 2024-09-10T09:36:12.621 INFO:tasks.workunit.client.0.smithi079.stdout:9/831: link d3/d7/dc/de/d17/f82 d3/d7/d26/d69/ddf/f118 0 2024-09-10T09:36:12.623 INFO:tasks.workunit.client.0.smithi079.stdout:3/954: mkdir d4/da/d8a/dd7/d10e/d79/dab/d117/d131 0 2024-09-10T09:36:12.631 INFO:tasks.workunit.client.0.smithi079.stdout:8/870: sync 2024-09-10T09:36:12.634 INFO:tasks.workunit.client.0.smithi079.stdout:8/871: truncate d11/d2b/d4b/f93 4186391 0 2024-09-10T09:36:12.636 INFO:tasks.workunit.client.0.smithi079.stdout:3/955: read d4/da/d17/d2d/d43/d4c/f60 [3608806,70411] 0 2024-09-10T09:36:12.640 INFO:tasks.workunit.client.0.smithi079.stdout:8/872: rmdir d11/d2b/d4b/da8 39 2024-09-10T09:36:12.641 INFO:tasks.workunit.client.0.smithi079.stdout:8/873: chown d11/d2b/d4b/da8/fcd 679812505 1 2024-09-10T09:36:12.641 INFO:tasks.workunit.client.0.smithi079.stdout:8/874: stat d11/dd8 0 2024-09-10T09:36:12.641 INFO:tasks.workunit.client.0.smithi079.stdout:0/916: sync 2024-09-10T09:36:12.642 INFO:tasks.workunit.client.0.smithi079.stdout:5/917: dwrite d2/d3/d27/fd0 [0,4194304] 0 2024-09-10T09:36:12.643 INFO:tasks.workunit.client.0.smithi079.stdout:5/918: write d2/d3/d5e/d61/f117 [73787,70642] 0 2024-09-10T09:36:12.643 INFO:tasks.workunit.client.0.smithi079.stdout:9/832: dwrite d3/d7/dc/de/da7/df1/d100/f110 [0,4194304] 0 2024-09-10T09:36:12.643 INFO:tasks.workunit.client.0.smithi079.stdout:4/890: dwrite d1/da/d28/fb5 [0,4194304] 0 2024-09-10T09:36:12.645 INFO:tasks.workunit.client.0.smithi079.stdout:8/875: rename d11/dbd/lfd to d11/dbd/d104/l114 0 2024-09-10T09:36:12.645 INFO:tasks.workunit.client.0.smithi079.stdout:8/876: creat d11/dbd/f115 x:0 0 0 2024-09-10T09:36:12.651 INFO:tasks.workunit.client.0.smithi079.stdout:7/855: sync 2024-09-10T09:36:12.651 INFO:tasks.workunit.client.0.smithi079.stdout:7/856: chown d4/d6/d4f/d70/ddb/fdc 122 1 2024-09-10T09:36:12.652 INFO:tasks.workunit.client.0.smithi079.stdout:3/956: dwrite d4/da/d17/d2d/d43/d4c/f60 [0,4194304] 0 2024-09-10T09:36:12.652 INFO:tasks.workunit.client.0.smithi079.stdout:3/957: readlink d4/da/d56/d7b/l98 0 2024-09-10T09:36:12.652 INFO:tasks.workunit.client.0.smithi079.stdout:3/958: chown d4/da/d17/d2d/d43/d49/cfc 3 1 2024-09-10T09:36:12.659 INFO:tasks.workunit.client.0.smithi079.stdout:4/891: link d1/da/d28/d47/da1/l116 d1/da/d16/d88/l11e 0 2024-09-10T09:36:12.659 INFO:tasks.workunit.client.0.smithi079.stdout:4/892: fdatasync d1/da/d16/d4d/f9f 0 2024-09-10T09:36:12.659 INFO:tasks.workunit.client.0.smithi079.stdout:4/893: read d1/da/d16/d57/f7d [437602,66811] 0 2024-09-10T09:36:12.661 INFO:tasks.workunit.client.0.smithi079.stdout:0/917: rename d4/d12/d15/d6b/daa/f12a to d4/d12/dc0/f12b 0 2024-09-10T09:36:12.664 INFO:tasks.workunit.client.0.smithi079.stdout:8/877: creat d11/df2/f116 x:0 0 0 2024-09-10T09:36:12.664 INFO:tasks.workunit.client.0.smithi079.stdout:8/878: fdatasync d11/dd8/ffb 0 2024-09-10T09:36:12.667 INFO:tasks.workunit.client.0.smithi079.stdout:7/857: mknod d4/d6/d38/dc1/c103 0 2024-09-10T09:36:12.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/919: dwrite d2/d3/fc9 [0,4194304] 0 2024-09-10T09:36:12.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/920: readlink d2/d3/d27/d32/l62 0 2024-09-10T09:36:12.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/921: creat d2/d3/d27/d32/d44/db4/f129 x:0 0 0 2024-09-10T09:36:12.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/922: write d2/d3/d27/d32/db6/ffb [925470,70166] 0 2024-09-10T09:36:12.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/923: write d2/d3/d27/d32/d39/dc4/ff0 [866934,81258] 0 2024-09-10T09:36:12.667 INFO:tasks.workunit.client.0.smithi079.stdout:5/924: read - d2/d3/d27/d32/de3/d4d/f92 zero size 2024-09-10T09:36:12.669 INFO:tasks.workunit.client.0.smithi079.stdout:3/959: dwrite d4/da/d8a/dd7/d10e/d79/dab/d117/fea [0,4194304] 0 2024-09-10T09:36:12.671 INFO:tasks.workunit.client.0.smithi079.stdout:4/894: mknod d1/da/d3b/d107/d108/c11f 0 2024-09-10T09:36:12.673 INFO:tasks.workunit.client.0.smithi079.stdout:0/918: mkdir d4/d12/dc0/dc8/d12c 0 2024-09-10T09:36:12.673 INFO:tasks.workunit.client.0.smithi079.stdout:0/919: truncate d4/d114/f115 1060636 0 2024-09-10T09:36:12.675 INFO:tasks.workunit.client.0.smithi079.stdout:8/879: symlink d11/d91/d110/d111/l117 0 2024-09-10T09:36:12.676 INFO:tasks.workunit.client.0.smithi079.stdout:8/880: write d11/d2b/d4b/d74/f83 [557447,66804] 0 2024-09-10T09:36:12.677 INFO:tasks.workunit.client.0.smithi079.stdout:7/858: dread d4/d6/d3e/f86 [0,4194304] 0 2024-09-10T09:36:12.677 INFO:tasks.workunit.client.0.smithi079.stdout:7/859: truncate d4/d6/d4f/d70/fc9 938209 0 2024-09-10T09:36:12.678 INFO:tasks.workunit.client.0.smithi079.stdout:7/860: readlink d4/df/d3d/d75/lb8 0 2024-09-10T09:36:12.678 INFO:tasks.workunit.client.0.smithi079.stdout:7/861: write d4/d6/d38/fb7 [171100,40741] 0 2024-09-10T09:36:12.678 INFO:tasks.workunit.client.0.smithi079.stdout:7/862: chown d4/d6/d4f/d66 2748827 1 2024-09-10T09:36:12.679 INFO:tasks.workunit.client.0.smithi079.stdout:3/960: dread d4/da/d56/d7b/fce [0,4194304] 0 2024-09-10T09:36:12.680 INFO:tasks.workunit.client.0.smithi079.stdout:5/925: rename d2/d3/d27/d32/d39/dc4/ff8 to d2/d3/d5e/d85/f12a 0 2024-09-10T09:36:12.680 INFO:tasks.workunit.client.0.smithi079.stdout:5/926: chown d2/d3/d5e/d85/f8e 981861129 1 2024-09-10T09:36:12.684 INFO:tasks.workunit.client.0.smithi079.stdout:4/895: mkdir d1/da/d28/d47/da1/d83/d120 0 2024-09-10T09:36:12.687 INFO:tasks.workunit.client.0.smithi079.stdout:8/881: truncate fe 391891 0 2024-09-10T09:36:12.690 INFO:tasks.workunit.client.0.smithi079.stdout:3/961: mkdir d4/da/d8a/dd7/d10e/d79/dab/d117/d132 0 2024-09-10T09:36:12.692 INFO:tasks.workunit.client.0.smithi079.stdout:5/927: creat d2/d3/d5e/d61/d71/f12b x:0 0 0 2024-09-10T09:36:12.692 INFO:tasks.workunit.client.0.smithi079.stdout:5/928: fsync d2/d3/fe 0 2024-09-10T09:36:12.692 INFO:tasks.workunit.client.0.smithi079.stdout:5/929: write d2/d3/d27/d32/db6/ffb [1757759,17362] 0 2024-09-10T09:36:12.693 INFO:tasks.workunit.client.0.smithi079.stdout:4/896: rename d1/da/d3b/de0/cd8 to d1/da/d3b/de0/c121 0 2024-09-10T09:36:12.694 INFO:tasks.workunit.client.0.smithi079.stdout:0/920: truncate d4/d12/d21/d3f/f66 928670 0 2024-09-10T09:36:12.696 INFO:tasks.workunit.client.0.smithi079.stdout:8/882: unlink d11/l79 0 2024-09-10T09:36:12.697 INFO:tasks.workunit.client.0.smithi079.stdout:7/863: rmdir d4/df/d3d/d82 39 2024-09-10T09:36:12.699 INFO:tasks.workunit.client.0.smithi079.stdout:3/962: rmdir d4 39 2024-09-10T09:36:12.703 INFO:tasks.workunit.client.0.smithi079.stdout:4/897: dread d1/da/d3b/d5f/f76 [0,4194304] 0 2024-09-10T09:36:12.710 INFO:tasks.workunit.client.0.smithi079.stdout:3/963: dread d4/da/d17/f30 [4194304,4194304] 0 2024-09-10T09:36:12.710 INFO:tasks.workunit.client.0.smithi079.stdout:3/964: write d4/da/d17/d9b/ff2 [7572,63874] 0 2024-09-10T09:36:12.710 INFO:tasks.workunit.client.0.smithi079.stdout:0/921: dwrite d4/d12/dde/f11f [0,4194304] 0 2024-09-10T09:36:12.712 INFO:tasks.workunit.client.0.smithi079.stdout:5/930: link d2/d3/c8f d2/d3/d27/d70/d88/c12c 0 2024-09-10T09:36:12.712 INFO:tasks.workunit.client.0.smithi079.stdout:0/922: dread d4/d1d/fad [0,4194304] 0 2024-09-10T09:36:12.713 INFO:tasks.workunit.client.0.smithi079.stdout:8/883: rmdir d11/dbd/d104 39 2024-09-10T09:36:12.715 INFO:tasks.workunit.client.0.smithi079.stdout:7/864: mknod d4/df/d3d/d82/c104 0 2024-09-10T09:36:12.718 INFO:tasks.workunit.client.0.smithi079.stdout:4/898: unlink d1/da/d3b/de0/ldd 0 2024-09-10T09:36:12.719 INFO:tasks.workunit.client.0.smithi079.stdout:0/923: write d4/d12/d16/de3/dac/f103 [744864,29725] 0 2024-09-10T09:36:12.719 INFO:tasks.workunit.client.0.smithi079.stdout:0/924: dread - d4/d12/dde/f109 zero size 2024-09-10T09:36:12.719 INFO:tasks.workunit.client.0.smithi079.stdout:0/925: write d4/d12/d16/de3/dac/f127 [4598,62291] 0 2024-09-10T09:36:12.728 INFO:tasks.workunit.client.0.smithi079.stdout:3/965: dwrite d4/da/d17/d9b/fa3 [0,4194304] 0 2024-09-10T09:36:12.729 INFO:tasks.workunit.client.0.smithi079.stdout:3/966: fsync d4/da/d17/d2d/d43/d4c/f96 0 2024-09-10T09:36:12.729 INFO:tasks.workunit.client.0.smithi079.stdout:3/967: stat d4/da/d8a/f105 0 2024-09-10T09:36:12.729 INFO:tasks.workunit.client.0.smithi079.stdout:3/968: rename d4 to d4/da/d8a/dd7/d10e/d79/dab/d117/d132/d133 22 2024-09-10T09:36:12.729 INFO:tasks.workunit.client.0.smithi079.stdout:3/969: readlink d4/da/d8a/dd7/d10e/d79/dab/d117/l116 0 2024-09-10T09:36:12.729 INFO:tasks.workunit.client.0.smithi079.stdout:5/931: getdents d2/d3/d27/dde 0 2024-09-10T09:36:12.729 INFO:tasks.workunit.client.0.smithi079.stdout:0/926: write d4/d12/d1a/d6d/d84/ff3 [1194727,98483] 0 2024-09-10T09:36:12.730 INFO:tasks.workunit.client.0.smithi079.stdout:8/884: mkdir d11/d2b/d4b/d50/d5c/d118 0 2024-09-10T09:36:12.730 INFO:tasks.workunit.client.0.smithi079.stdout:8/885: creat d11/d2b/d4b/d74/f119 x:0 0 0 2024-09-10T09:36:12.730 INFO:tasks.workunit.client.0.smithi079.stdout:8/886: dread - d11/d2b/d4b/da8/fcd zero size 2024-09-10T09:36:12.730 INFO:tasks.workunit.client.0.smithi079.stdout:8/887: dread - d11/dbd/fd9 zero size 2024-09-10T09:36:12.732 INFO:tasks.workunit.client.0.smithi079.stdout:7/865: link d4/df/d6b/c72 d4/dc/d43/dab/c105 0 2024-09-10T09:36:12.735 INFO:tasks.workunit.client.0.smithi079.stdout:4/899: mkdir d1/da/d16/d4d/d122 0 2024-09-10T09:36:12.735 INFO:tasks.workunit.client.0.smithi079.stdout:4/900: write d1/d38/da5/ff5 [31922,2462] 0 2024-09-10T09:36:12.744 INFO:tasks.workunit.client.0.smithi079.stdout:7/866: dread d4/dc/f73 [0,4194304] 0 2024-09-10T09:36:12.746 INFO:tasks.workunit.client.0.smithi079.stdout:3/970: mknod d4/da/c134 0 2024-09-10T09:36:12.747 INFO:tasks.workunit.client.0.smithi079.stdout:5/932: mkdir d2/d3/d27/d32/de3/d12d 0 2024-09-10T09:36:12.747 INFO:tasks.workunit.client.0.smithi079.stdout:5/933: chown d2/d3/d27/d32/d44/f7c 463045357 1 2024-09-10T09:36:12.749 INFO:tasks.workunit.client.0.smithi079.stdout:8/888: dwrite d11/d48/f7b [0,4194304] 0 2024-09-10T09:36:12.752 INFO:tasks.workunit.client.0.smithi079.stdout:0/927: mkdir d4/d12/d21/d3f/db3/dce/d12d 0 2024-09-10T09:36:12.754 INFO:tasks.workunit.client.0.smithi079.stdout:8/889: dread d11/d2b/d4b/f6b [0,4194304] 0 2024-09-10T09:36:12.754 INFO:tasks.workunit.client.0.smithi079.stdout:8/890: dread - d11/d2b/d4b/f101 zero size 2024-09-10T09:36:12.755 INFO:tasks.workunit.client.0.smithi079.stdout:4/901: rename d1/da/d3b/d5f/lb8 to d1/d38/da5/l123 0 2024-09-10T09:36:12.757 INFO:tasks.workunit.client.0.smithi079.stdout:8/891: dread d11/d2b/fa1 [0,4194304] 0 2024-09-10T09:36:12.758 INFO:tasks.workunit.client.0.smithi079.stdout:7/867: getdents d4/df/d6b 0 2024-09-10T09:36:12.758 INFO:tasks.workunit.client.0.smithi079.stdout:7/868: truncate d4/dc/f92 4518021 0 2024-09-10T09:36:12.760 INFO:tasks.workunit.client.0.smithi079.stdout:2/882: sync 2024-09-10T09:36:12.760 INFO:tasks.workunit.client.0.smithi079.stdout:2/883: stat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/f11b 0 2024-09-10T09:36:12.763 INFO:tasks.workunit.client.0.smithi079.stdout:3/971: unlink d4/da/d17/d2d/fa1 0 2024-09-10T09:36:12.763 INFO:tasks.workunit.client.0.smithi079.stdout:3/972: fsync d4/da/d17/d9b/fd0 0 2024-09-10T09:36:12.765 INFO:tasks.workunit.client.0.smithi079.stdout:5/934: mkdir d2/d3/d27/d70/d88/df2/d12e 0 2024-09-10T09:36:12.771 INFO:tasks.workunit.client.0.smithi079.stdout:5/935: dread d2/d3/d27/f2c [0,4194304] 0 2024-09-10T09:36:12.771 INFO:tasks.workunit.client.0.smithi079.stdout:4/902: symlink d1/da/d28/d47/da1/d83/l124 0 2024-09-10T09:36:12.772 INFO:tasks.workunit.client.0.smithi079.stdout:9/833: sync 2024-09-10T09:36:12.772 INFO:tasks.workunit.client.0.smithi079.stdout:8/892: mkdir d11/d2b/d4b/d50/d5c/d118/d11a 0 2024-09-10T09:36:12.774 INFO:tasks.workunit.client.0.smithi079.stdout:3/973: mknod d4/da/d67/dcf/c135 0 2024-09-10T09:36:12.781 INFO:tasks.workunit.client.0.smithi079.stdout:5/936: unlink d2/c8a 0 2024-09-10T09:36:12.784 INFO:tasks.workunit.client.0.smithi079.stdout:4/903: unlink d1/da/d28/d47/da1/d73/f11b 0 2024-09-10T09:36:12.787 INFO:tasks.workunit.client.0.smithi079.stdout:8/893: link d11/f16 d11/d2b/d4b/d7e/f11b 0 2024-09-10T09:36:12.787 INFO:tasks.workunit.client.0.smithi079.stdout:8/894: fdatasync d11/d2b/d4b/da8/fff 0 2024-09-10T09:36:12.787 INFO:tasks.workunit.client.0.smithi079.stdout:8/895: chown d11/d3b/la3 11 1 2024-09-10T09:36:12.787 INFO:tasks.workunit.client.0.smithi079.stdout:8/896: chown d11/d2b/d4b/f93 14 1 2024-09-10T09:36:12.787 INFO:tasks.workunit.client.0.smithi079.stdout:2/884: dwrite d4/f6 [0,4194304] 0 2024-09-10T09:36:12.791 INFO:tasks.workunit.client.0.smithi079.stdout:3/974: dwrite d4/da/d17/f1a [0,4194304] 0 2024-09-10T09:36:12.791 INFO:tasks.workunit.client.0.smithi079.stdout:0/928: rename d4/d12/d16/de3/dac to d4/d12/dde/d12e 0 2024-09-10T09:36:12.792 INFO:tasks.workunit.client.0.smithi079.stdout:0/929: write d4/d1d/d24/d72/fa4 [89538,87000] 0 2024-09-10T09:36:12.795 INFO:tasks.workunit.client.0.smithi079.stdout:5/937: stat d2/d3/d27/d32/d44/db4/l107 0 2024-09-10T09:36:12.796 INFO:tasks.workunit.client.0.smithi079.stdout:4/904: dread - d1/da/d28/fe7 zero size 2024-09-10T09:36:12.796 INFO:tasks.workunit.client.0.smithi079.stdout:4/905: readlink d1/da/d16/d21/l31 0 2024-09-10T09:36:12.797 INFO:tasks.workunit.client.0.smithi079.stdout:4/906: creat d1/d38/f125 x:0 0 0 2024-09-10T09:36:12.799 INFO:tasks.workunit.client.0.smithi079.stdout:2/885: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/d112/l11e 0 2024-09-10T09:36:12.800 INFO:tasks.workunit.client.0.smithi079.stdout:2/886: chown d4/fb 747 1 2024-09-10T09:36:12.804 INFO:tasks.workunit.client.0.smithi079.stdout:9/834: rename d3/d7/d26/l39 to d3/d7/d26/d69/l119 0 2024-09-10T09:36:12.806 INFO:tasks.workunit.client.0.smithi079.stdout:0/930: rmdir d4/d12/d1a/d6d/d91 39 2024-09-10T09:36:12.806 INFO:tasks.workunit.client.0.smithi079.stdout:0/931: chown d4/d12/d8b/dca/d32/dbd/fd8 295927000 1 2024-09-10T09:36:12.812 INFO:tasks.workunit.client.0.smithi079.stdout:8/897: dwrite d11/d2b/d4b/d50/f57 [0,4194304] 0 2024-09-10T09:36:12.813 INFO:tasks.workunit.client.0.smithi079.stdout:8/898: truncate d11/d3b/fe3 292511 0 2024-09-10T09:36:12.813 INFO:tasks.workunit.client.0.smithi079.stdout:3/975: getdents d4/da/d17/d2d 0 2024-09-10T09:36:12.815 INFO:tasks.workunit.client.0.smithi079.stdout:9/835: mknod d3/d7/dc/de/d17/d12/d113/c11a 0 2024-09-10T09:36:12.817 INFO:tasks.workunit.client.0.smithi079.stdout:0/932: mknod d4/d12/dc0/ddf/c12f 0 2024-09-10T09:36:12.817 INFO:tasks.workunit.client.0.smithi079.stdout:0/933: fdatasync d4/d12/d1a/f19 0 2024-09-10T09:36:12.818 INFO:tasks.workunit.client.0.smithi079.stdout:5/938: getdents d2/d3/d27/dde/dfd 0 2024-09-10T09:36:12.818 INFO:tasks.workunit.client.0.smithi079.stdout:5/939: chown d2/d3/d5e/d61/cd2 493 1 2024-09-10T09:36:12.820 INFO:tasks.workunit.client.0.smithi079.stdout:4/907: rename d1/da/f36 to d1/da/d28/d99/f126 0 2024-09-10T09:36:12.820 INFO:tasks.workunit.client.0.smithi079.stdout:4/908: readlink d1/da/l105 0 2024-09-10T09:36:12.821 INFO:tasks.workunit.client.0.smithi079.stdout:2/887: symlink d4/dc/d1c/d86/l11f 0 2024-09-10T09:36:12.825 INFO:tasks.workunit.client.0.smithi079.stdout:8/899: truncate d11/f2e 3445527 0 2024-09-10T09:36:12.825 INFO:tasks.workunit.client.0.smithi079.stdout:8/900: creat d11/dd8/f11c x:0 0 0 2024-09-10T09:36:12.826 INFO:tasks.workunit.client.0.smithi079.stdout:8/901: chown d11/d3b 61 1 2024-09-10T09:36:12.829 INFO:tasks.workunit.client.0.smithi079.stdout:9/836: creat d3/d7/dc/de/d17/d2f/f11b x:0 0 0 2024-09-10T09:36:12.833 INFO:tasks.workunit.client.0.smithi079.stdout:0/934: symlink d4/d12/d21/d3f/d80/l130 0 2024-09-10T09:36:12.836 INFO:tasks.workunit.client.0.smithi079.stdout:5/940: mkdir d2/d3/d27/d32/de3/d12f 0 2024-09-10T09:36:12.836 INFO:tasks.workunit.client.0.smithi079.stdout:5/941: creat d2/d3/f130 x:0 0 0 2024-09-10T09:36:12.837 INFO:tasks.workunit.client.0.smithi079.stdout:5/942: dread d2/f58 [0,4194304] 0 2024-09-10T09:36:12.839 INFO:tasks.workunit.client.0.smithi079.stdout:4/909: truncate d1/da/d16/fd3 2500468 0 2024-09-10T09:36:12.841 INFO:tasks.workunit.client.0.smithi079.stdout:2/888: truncate d4/dc/d1c/d86/d1b/d38/d39/d99/d61/fae 3223101 0 2024-09-10T09:36:12.841 INFO:tasks.workunit.client.0.smithi079.stdout:2/889: readlink d4/dc/d1c/d86/d1b/d38/d39/l47 0 2024-09-10T09:36:12.846 INFO:tasks.workunit.client.0.smithi079.stdout:3/976: rmdir d4/da/d56/d7b 39 2024-09-10T09:36:12.849 INFO:tasks.workunit.client.0.smithi079.stdout:8/902: dwrite d11/f88 [0,4194304] 0 2024-09-10T09:36:12.849 INFO:tasks.workunit.client.0.smithi079.stdout:9/837: read d3/d7/dc/d62/fdb [5488801,115103] 0 2024-09-10T09:36:12.849 INFO:tasks.workunit.client.0.smithi079.stdout:9/838: chown d3/d7/dc/de/d17/d2f/d74/fe0 51 1 2024-09-10T09:36:12.849 INFO:tasks.workunit.client.0.smithi079.stdout:9/839: fdatasync d3/f2b 0 2024-09-10T09:36:12.852 INFO:tasks.workunit.client.0.smithi079.stdout:9/840: dread d3/d7/dc/de/da7/fc2 [0,4194304] 0 2024-09-10T09:36:12.852 INFO:tasks.workunit.client.0.smithi079.stdout:9/841: chown d3/d7/f5b 11478931 1 2024-09-10T09:36:12.853 INFO:tasks.workunit.client.0.smithi079.stdout:2/890: rename d4/lfb to d4/dc/d1c/d86/d1b/d38/d39/d31/l120 0 2024-09-10T09:36:12.854 INFO:tasks.workunit.client.0.smithi079.stdout:3/977: creat d4/da/d8a/dd7/d10e/dbe/d11e/f136 x:0 0 0 2024-09-10T09:36:12.856 INFO:tasks.workunit.client.0.smithi079.stdout:8/903: symlink d11/d2b/d4b/d7e/da7/l11d 0 2024-09-10T09:36:12.857 INFO:tasks.workunit.client.0.smithi079.stdout:2/891: truncate d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f64 400410 0 2024-09-10T09:36:12.859 INFO:tasks.workunit.client.0.smithi079.stdout:8/904: link d11/d2b/d4b/d50/d55/d87/lb4 d11/d2b/d4b/d74/l11e 0 2024-09-10T09:36:12.861 INFO:tasks.workunit.client.0.smithi079.stdout:2/892: unlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fb6 0 2024-09-10T09:36:12.862 INFO:tasks.workunit.client.0.smithi079.stdout:4/910: dwrite d1/da/d3b/d5f/f76 [0,4194304] 0 2024-09-10T09:36:12.862 INFO:tasks.workunit.client.0.smithi079.stdout:4/911: chown d1/da/d16/f26 1722 1 2024-09-10T09:36:12.863 INFO:tasks.workunit.client.0.smithi079.stdout:8/905: mknod d11/d91/d108/c11f 0 2024-09-10T09:36:12.864 INFO:tasks.workunit.client.0.smithi079.stdout:5/943: dwrite d2/d3/d27/d32/de3/f45 [0,4194304] 0 2024-09-10T09:36:12.864 INFO:tasks.workunit.client.0.smithi079.stdout:5/944: chown d2/d3/d59/d101 288487 1 2024-09-10T09:36:12.865 INFO:tasks.workunit.client.0.smithi079.stdout:9/842: dread d3/d7/dc/f41 [0,4194304] 0 2024-09-10T09:36:12.865 INFO:tasks.workunit.client.0.smithi079.stdout:9/843: creat d3/d7/dc/de/d17/d2f/d98/f11c x:0 0 0 2024-09-10T09:36:12.865 INFO:tasks.workunit.client.0.smithi079.stdout:8/906: creat d11/d2b/d4b/d50/d55/d87/def/f120 x:0 0 0 2024-09-10T09:36:12.880 INFO:tasks.workunit.client.0.smithi079.stdout:9/844: rename d3/d7/dc/de/d17/dcf/le6 to d3/d40/l11d 0 2024-09-10T09:36:12.880 INFO:tasks.workunit.client.0.smithi079.stdout:9/845: write d3/d7/d5a/f65 [64902,109144] 0 2024-09-10T09:36:12.880 INFO:tasks.workunit.client.0.smithi079.stdout:9/846: fdatasync d3/d40/f7e 0 2024-09-10T09:36:12.880 INFO:tasks.workunit.client.0.smithi079.stdout:9/847: write d3/d7/dc/de/d17/d2f/d74/db4/fed [725587,115032] 0 2024-09-10T09:36:12.880 INFO:tasks.workunit.client.0.smithi079.stdout:9/848: write d3/d7/dc/de/d17/d2f/d98/fbf [389345,116933] 0 2024-09-10T09:36:12.881 INFO:tasks.workunit.client.0.smithi079.stdout:8/907: mkdir d11/d2b/d4b/d50/d9e/d121 0 2024-09-10T09:36:12.882 INFO:tasks.workunit.client.0.smithi079.stdout:9/849: creat d3/d7/dc/de/d17/dcf/d107/f11e x:0 0 0 2024-09-10T09:36:12.889 INFO:tasks.workunit.client.0.smithi079.stdout:0/935: write d4/d12/d21/d3f/f66 [811174,32797] 0 2024-09-10T09:36:12.889 INFO:tasks.workunit.client.0.smithi079.stdout:2/893: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd3 [0,4194304] 0 2024-09-10T09:36:12.889 INFO:tasks.workunit.client.0.smithi079.stdout:2/894: chown d4/dc/c94 157937 1 2024-09-10T09:36:12.889 INFO:tasks.workunit.client.0.smithi079.stdout:2/895: creat d4/dc/d1c/d86/d1b/d38/d39/d31/d52/f121 x:0 0 0 2024-09-10T09:36:12.889 INFO:tasks.workunit.client.0.smithi079.stdout:2/896: write d4/dc/d1c/d86/d1b/d38/d39/d99/f1f [4730724,73968] 0 2024-09-10T09:36:12.889 INFO:tasks.workunit.client.0.smithi079.stdout:2/897: chown d4/dc/d1c/d86/d1b/c32 227 1 2024-09-10T09:36:12.893 INFO:tasks.workunit.client.0.smithi079.stdout:5/945: dwrite d2/d3/d27/d32/de3/d4d/f128 [0,4194304] 0 2024-09-10T09:36:12.898 INFO:tasks.workunit.client.0.smithi079.stdout:0/936: creat d4/d12/d16/f131 x:0 0 0 2024-09-10T09:36:12.901 INFO:tasks.workunit.client.0.smithi079.stdout:0/937: dread d4/d12/d8b/dca/d32/f9a [0,4194304] 0 2024-09-10T09:36:12.906 INFO:tasks.workunit.client.1.smithi135.stdout:4/195: sync 2024-09-10T09:36:12.906 INFO:tasks.workunit.client.1.smithi135.stdout:8/5: sync 2024-09-10T09:36:12.906 INFO:tasks.workunit.client.1.smithi135.stdout:8/6: fdatasync f0 0 2024-09-10T09:36:12.906 INFO:tasks.workunit.client.1.smithi135.stdout:7/82: sync 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:3/9: sync 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:2/9: sync 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:5/6: sync 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:5/7: truncate - no filename 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:2/10: dread - no filename 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:5/8: dwrite - no filename 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:2/11: dwrite - no filename 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:5/9: dread - no filename 2024-09-10T09:36:12.907 INFO:tasks.workunit.client.1.smithi135.stdout:5/10: dwrite - no filename 2024-09-10T09:36:12.908 INFO:tasks.workunit.client.1.smithi135.stdout:5/11: rmdir - no directory 2024-09-10T09:36:12.908 INFO:tasks.workunit.client.1.smithi135.stdout:5/12: rename - no filename 2024-09-10T09:36:12.908 INFO:tasks.workunit.client.1.smithi135.stdout:3/10: creat f2 x:0 0 0 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.1.smithi135.stdout:1/26: sync 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.1.smithi135.stdout:9/35: sync 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.1.smithi135.stdout:9/36: dread - f9 zero size 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.1.smithi135.stdout:6/106: sync 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.1.smithi135.stdout:0/122: sync 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.0.smithi079.stdout:0/938: creat d4/d1d/d24/d118/f132 x:0 0 0 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.0.smithi079.stdout:7/869: sync 2024-09-10T09:36:12.909 INFO:tasks.workunit.client.0.smithi079.stdout:2/898: mknod d4/dc/d1c/d86/c122 0 2024-09-10T09:36:12.914 INFO:tasks.workunit.client.0.smithi079.stdout:2/899: dread d4/dc/d1c/d86/d1b/d38/d39/d31/d49/f64 [0,4194304] 0 2024-09-10T09:36:12.914 INFO:tasks.workunit.client.0.smithi079.stdout:2/900: chown d4/dc/d1c/d86/d1b/d38/d87/lcb 37409680 1 2024-09-10T09:36:12.917 INFO:tasks.workunit.client.0.smithi079.stdout:8/908: dwrite d11/d2b/d4b/da8/ff8 [0,4194304] 0 2024-09-10T09:36:12.918 INFO:tasks.workunit.client.1.smithi135.stdout:8/7: write f0 [1809138,117064] 0 2024-09-10T09:36:12.918 INFO:tasks.workunit.client.1.smithi135.stdout:8/8: rmdir - no directory 2024-09-10T09:36:12.919 INFO:tasks.workunit.client.0.smithi079.stdout:2/901: mkdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde/d123 0 2024-09-10T09:36:12.919 INFO:tasks.workunit.client.0.smithi079.stdout:2/902: stat d4/dc/c94 0 2024-09-10T09:36:12.920 INFO:tasks.workunit.client.1.smithi135.stdout:2/12: creat f3 x:0 0 0 2024-09-10T09:36:12.921 INFO:tasks.workunit.client.1.smithi135.stdout:2/13: chown f3 5796 1 2024-09-10T09:36:12.921 INFO:tasks.workunit.client.1.smithi135.stdout:2/14: readlink - no filename 2024-09-10T09:36:12.921 INFO:tasks.workunit.client.1.smithi135.stdout:2/15: dread - f3 zero size 2024-09-10T09:36:12.921 INFO:tasks.workunit.client.0.smithi079.stdout:7/870: getdents d4/df 0 2024-09-10T09:36:12.923 INFO:tasks.workunit.client.1.smithi135.stdout:5/13: creat f0 x:0 0 0 2024-09-10T09:36:12.925 INFO:tasks.workunit.client.1.smithi135.stdout:1/27: readlink l1 0 2024-09-10T09:36:12.926 INFO:tasks.workunit.client.0.smithi079.stdout:8/909: link d11/d2b/f4e d11/d3b/f122 0 2024-09-10T09:36:12.927 INFO:tasks.workunit.client.1.smithi135.stdout:9/37: dread - f6 zero size 2024-09-10T09:36:12.928 INFO:tasks.workunit.client.1.smithi135.stdout:9/38: chown c0 119267 1 2024-09-10T09:36:12.928 INFO:tasks.workunit.client.1.smithi135.stdout:9/39: fdatasync f4 0 2024-09-10T09:36:12.928 INFO:tasks.workunit.client.1.smithi135.stdout:9/40: write f9 [500443,100121] 0 2024-09-10T09:36:12.928 INFO:tasks.workunit.client.1.smithi135.stdout:9/41: write f4 [9261209,40232] 0 2024-09-10T09:36:12.928 INFO:tasks.workunit.client.0.smithi079.stdout:3/978: dwrite d4/f40 [0,4194304] 0 2024-09-10T09:36:12.931 INFO:tasks.workunit.client.1.smithi135.stdout:6/107: creat d5/d15/f22 x:0 0 0 2024-09-10T09:36:12.931 INFO:tasks.workunit.client.0.smithi079.stdout:9/850: dwrite d3/d7/dc/de/da7/dac/ff7 [0,4194304] 0 2024-09-10T09:36:12.935 INFO:tasks.workunit.client.1.smithi135.stdout:0/123: truncate f7 1027636 0 2024-09-10T09:36:12.940 INFO:tasks.workunit.client.0.smithi079.stdout:7/871: mkdir d4/d6/d106 0 2024-09-10T09:36:12.941 INFO:tasks.workunit.client.0.smithi079.stdout:5/946: dwrite d2/d3/d27/d32/db6/ffb [0,4194304] 0 2024-09-10T09:36:12.942 INFO:tasks.workunit.client.0.smithi079.stdout:5/947: dread - d2/d3/d27/d32/de3/d4d/fdc zero size 2024-09-10T09:36:12.943 INFO:tasks.workunit.client.1.smithi135.stdout:2/16: dwrite f3 [0,4194304] 0 2024-09-10T09:36:12.943 INFO:tasks.workunit.client.1.smithi135.stdout:8/9: mkdir d1 0 2024-09-10T09:36:12.944 INFO:tasks.workunit.client.1.smithi135.stdout:3/11: dwrite f2 [0,4194304] 0 2024-09-10T09:36:12.945 INFO:tasks.workunit.client.0.smithi079.stdout:0/939: dwrite d4/d12/d15/d69/fa8 [0,4194304] 0 2024-09-10T09:36:12.945 INFO:tasks.workunit.client.0.smithi079.stdout:0/940: fdatasync d4/d12/d21/d3f/d80/f126 0 2024-09-10T09:36:12.945 INFO:tasks.workunit.client.1.smithi135.stdout:5/14: mkdir d1 0 2024-09-10T09:36:12.947 INFO:tasks.workunit.client.0.smithi079.stdout:3/979: creat d4/da/d56/d7b/dd1/d11d/f137 x:0 0 0 2024-09-10T09:36:12.948 INFO:tasks.workunit.client.0.smithi079.stdout:3/980: chown d4/da/d56/d7b/fb0 50 1 2024-09-10T09:36:12.948 INFO:tasks.workunit.client.0.smithi079.stdout:0/941: dread d4/d47/fdc [0,4194304] 0 2024-09-10T09:36:12.948 INFO:tasks.workunit.client.0.smithi079.stdout:0/942: fsync d4/d12/dc0/ddf/f110 0 2024-09-10T09:36:12.949 INFO:tasks.workunit.client.1.smithi135.stdout:9/42: write f4 [806316,84583] 0 2024-09-10T09:36:12.952 INFO:tasks.workunit.client.0.smithi079.stdout:9/851: creat d3/d7/f11f x:0 0 0 2024-09-10T09:36:12.956 INFO:tasks.workunit.client.0.smithi079.stdout:2/903: rmdir d4/dc/d1c/d86/d1b/d38/d39/d31/d49 39 2024-09-10T09:36:12.958 INFO:tasks.workunit.client.1.smithi135.stdout:7/83: write d2/f10 [1099842,54319] 0 2024-09-10T09:36:12.960 INFO:tasks.workunit.client.0.smithi079.stdout:7/872: creat d4/df/f107 x:0 0 0 2024-09-10T09:36:12.962 INFO:tasks.workunit.client.0.smithi079.stdout:7/873: dread d4/d6/d38/f63 [0,4194304] 0 2024-09-10T09:36:12.963 INFO:tasks.workunit.client.0.smithi079.stdout:7/874: dread - d4/df/f107 zero size 2024-09-10T09:36:12.966 INFO:tasks.workunit.client.1.smithi135.stdout:4/196: write d1/f19 [3118130,116759] 0 2024-09-10T09:36:12.978 INFO:tasks.workunit.client.0.smithi079.stdout:8/910: dwrite d11/d2b/d4b/d50/d5c/f95 [0,4194304] 0 2024-09-10T09:36:12.979 INFO:tasks.workunit.client.1.smithi135.stdout:0/124: dwrite d8/dd/d1e/f23 [0,4194304] 0 2024-09-10T09:36:12.979 INFO:tasks.workunit.client.0.smithi079.stdout:0/943: dwrite d4/d12/d1a/f82 [0,4194304] 0 2024-09-10T09:36:12.980 INFO:tasks.workunit.client.1.smithi135.stdout:3/12: rename f0 to f3 0 2024-09-10T09:36:12.980 INFO:tasks.workunit.client.0.smithi079.stdout:5/948: dwrite d2/d3/d5e/d73/f7a [0,4194304] 0 2024-09-10T09:36:12.981 INFO:tasks.workunit.client.0.smithi079.stdout:3/981: mknod d4/da/d8a/dd7/d10e/d79/dab/d117/d132/c138 0 2024-09-10T09:36:12.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/10: symlink d1/l2 0 2024-09-10T09:36:12.984 INFO:tasks.workunit.client.0.smithi079.stdout:7/875: link d4/df/d6b/d9a/le3 d4/d6/d4f/d70/db6/dca/l108 0 2024-09-10T09:36:12.985 INFO:tasks.workunit.client.1.smithi135.stdout:1/28: mknod c5 0 2024-09-10T09:36:12.995 INFO:tasks.workunit.client.0.smithi079.stdout:9/852: dwrite d3/d7/dc/de/da7/df1/f103 [0,4194304] 0 2024-09-10T09:36:12.995 INFO:tasks.workunit.client.0.smithi079.stdout:2/904: dwrite d4/d8f/fc3 [0,4194304] 0 2024-09-10T09:36:12.997 INFO:tasks.workunit.client.0.smithi079.stdout:0/944: rename d4/d12/d15/d69/f11a to d4/d12/d16/de3/f133 0 2024-09-10T09:36:12.998 INFO:tasks.workunit.client.1.smithi135.stdout:2/17: mknod c4 0 2024-09-10T09:36:13.001 INFO:tasks.workunit.client.0.smithi079.stdout:5/949: creat d2/d3/d27/d32/de3/f131 x:0 0 0 2024-09-10T09:36:13.002 INFO:tasks.workunit.client.1.smithi135.stdout:4/197: truncate d1/db/f8 3391496 0 2024-09-10T09:36:13.004 INFO:tasks.workunit.client.0.smithi079.stdout:7/876: symlink d4/df/d6b/l109 0 2024-09-10T09:36:13.006 INFO:tasks.workunit.client.0.smithi079.stdout:7/877: write d4/d6/d38/fb7 [46530,59138] 0 2024-09-10T09:36:13.006 INFO:tasks.workunit.client.0.smithi079.stdout:7/878: chown d4/d6/d38/l76 16140107 1 2024-09-10T09:36:13.006 INFO:tasks.workunit.client.0.smithi079.stdout:7/879: readlink d4/df/l8c 0 2024-09-10T09:36:13.006 INFO:tasks.workunit.client.0.smithi079.stdout:7/880: creat d4/d6/d3e/f10a x:0 0 0 2024-09-10T09:36:13.009 INFO:tasks.workunit.client.1.smithi135.stdout:3/13: mkdir d4 0 2024-09-10T09:36:13.009 INFO:tasks.workunit.client.0.smithi079.stdout:3/982: dwrite d4/da/d17/d72/fd5 [4194304,4194304] 0 2024-09-10T09:36:13.011 INFO:tasks.workunit.client.0.smithi079.stdout:2/905: dread d4/f23 [0,4194304] 0 2024-09-10T09:36:13.011 INFO:tasks.workunit.client.1.smithi135.stdout:1/29: dwrite f3 [0,4194304] 0 2024-09-10T09:36:13.014 INFO:tasks.workunit.client.1.smithi135.stdout:9/43: mknod ca 0 2024-09-10T09:36:13.016 INFO:tasks.workunit.client.1.smithi135.stdout:0/125: dread f7 [0,4194304] 0 2024-09-10T09:36:13.016 INFO:tasks.workunit.client.1.smithi135.stdout:0/126: write d8/dd/d11/f1f [446660,69692] 0 2024-09-10T09:36:13.016 INFO:tasks.workunit.client.1.smithi135.stdout:2/18: truncate f3 477472 0 2024-09-10T09:36:13.021 INFO:tasks.workunit.client.1.smithi135.stdout:0/127: dread d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:13.022 INFO:tasks.workunit.client.0.smithi079.stdout:5/950: dwrite d2/d3/d27/fc6 [0,4194304] 0 2024-09-10T09:36:13.024 INFO:tasks.workunit.client.1.smithi135.stdout:4/198: link d1/db/f8 d1/de/d16/f3f 0 2024-09-10T09:36:13.024 INFO:tasks.workunit.client.1.smithi135.stdout:4/199: stat d1/db/d23 0 2024-09-10T09:36:13.024 INFO:tasks.workunit.client.1.smithi135.stdout:4/200: write d1/d33/f3d [337494,98798] 0 2024-09-10T09:36:13.024 INFO:tasks.workunit.client.1.smithi135.stdout:1/30: creat f6 x:0 0 0 2024-09-10T09:36:13.024 INFO:tasks.workunit.client.1.smithi135.stdout:3/14: dread f2 [0,4194304] 0 2024-09-10T09:36:13.026 INFO:tasks.workunit.client.1.smithi135.stdout:8/11: truncate f0 3636089 0 2024-09-10T09:36:13.027 INFO:tasks.workunit.client.0.smithi079.stdout:8/911: rmdir d11 39 2024-09-10T09:36:13.027 INFO:tasks.workunit.client.0.smithi079.stdout:8/912: stat d11/d48/f6a 0 2024-09-10T09:36:13.031 INFO:tasks.workunit.client.0.smithi079.stdout:5/951: dread d2/f24 [0,4194304] 0 2024-09-10T09:36:13.031 INFO:tasks.workunit.client.0.smithi079.stdout:5/952: chown d2/d3/f79 54419900 1 2024-09-10T09:36:13.033 INFO:tasks.workunit.client.1.smithi135.stdout:7/84: write d2/f8 [7774629,9294] 0 2024-09-10T09:36:13.034 INFO:tasks.workunit.client.1.smithi135.stdout:2/19: fsync f3 0 2024-09-10T09:36:13.034 INFO:tasks.workunit.client.1.smithi135.stdout:2/20: chown f3 6 1 2024-09-10T09:36:13.041 INFO:tasks.workunit.client.1.smithi135.stdout:1/31: write f3 [1171652,69735] 0 2024-09-10T09:36:13.041 INFO:tasks.workunit.client.1.smithi135.stdout:1/32: truncate f4 1447783 0 2024-09-10T09:36:13.044 INFO:tasks.workunit.client.0.smithi079.stdout:9/853: creat d3/d40/f120 x:0 0 0 2024-09-10T09:36:13.044 INFO:tasks.workunit.client.0.smithi079.stdout:9/854: dread - d3/d7/dc/de/d17/d2f/d98/da1/fb9 zero size 2024-09-10T09:36:13.044 INFO:tasks.workunit.client.0.smithi079.stdout:9/855: chown d3/d7/d26/d69/l119 12727 1 2024-09-10T09:36:13.044 INFO:tasks.workunit.client.0.smithi079.stdout:9/856: fsync d3/f11 0 2024-09-10T09:36:13.044 INFO:tasks.workunit.client.1.smithi135.stdout:4/201: dwrite d1/de/d16/f2f [0,4194304] 0 2024-09-10T09:36:13.045 INFO:tasks.workunit.client.1.smithi135.stdout:0/128: symlink d8/dd/d11/l25 0 2024-09-10T09:36:13.045 INFO:tasks.workunit.client.1.smithi135.stdout:0/129: readlink d8/dd/l1b 0 2024-09-10T09:36:13.046 INFO:tasks.workunit.client.0.smithi079.stdout:0/945: link d4/d12/d15/d69/f120 d4/d12/d21/d3f/db3/dce/f134 0 2024-09-10T09:36:13.047 INFO:tasks.workunit.client.1.smithi135.stdout:3/15: mkdir d4/d5 0 2024-09-10T09:36:13.047 INFO:tasks.workunit.client.1.smithi135.stdout:3/16: dread - f1 zero size 2024-09-10T09:36:13.049 INFO:tasks.workunit.client.0.smithi079.stdout:7/881: symlink d4/d6/d38/df8/l10b 0 2024-09-10T09:36:13.050 INFO:tasks.workunit.client.1.smithi135.stdout:1/33: dread f4 [0,4194304] 0 2024-09-10T09:36:13.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/44: getdents . 0 2024-09-10T09:36:13.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/45: getdents . 0 2024-09-10T09:36:13.051 INFO:tasks.workunit.client.1.smithi135.stdout:3/17: dread f2 [0,4194304] 0 2024-09-10T09:36:13.053 INFO:tasks.workunit.client.0.smithi079.stdout:5/953: dwrite d2/f20 [0,4194304] 0 2024-09-10T09:36:13.057 INFO:tasks.workunit.client.1.smithi135.stdout:2/21: truncate f3 99957 0 2024-09-10T09:36:13.070 INFO:tasks.workunit.client.1.smithi135.stdout:4/202: mkdir d1/d33/d40 0 2024-09-10T09:36:13.072 INFO:tasks.workunit.client.0.smithi079.stdout:3/983: link d4/da/d8a/c110 d4/da/d67/c139 0 2024-09-10T09:36:13.074 INFO:tasks.workunit.client.1.smithi135.stdout:0/130: creat d8/f26 x:0 0 0 2024-09-10T09:36:13.074 INFO:tasks.workunit.client.1.smithi135.stdout:0/131: getdents d8/dd/d11/d17 0 2024-09-10T09:36:13.078 INFO:tasks.workunit.client.1.smithi135.stdout:8/12: unlink f0 0 2024-09-10T09:36:13.078 INFO:tasks.workunit.client.1.smithi135.stdout:8/13: stat d1 0 2024-09-10T09:36:13.078 INFO:tasks.workunit.client.1.smithi135.stdout:8/14: truncate - no filename 2024-09-10T09:36:13.078 INFO:tasks.workunit.client.1.smithi135.stdout:8/15: truncate - no filename 2024-09-10T09:36:13.079 INFO:tasks.workunit.client.0.smithi079.stdout:4/912: sync 2024-09-10T09:36:13.079 INFO:tasks.workunit.client.0.smithi079.stdout:4/913: dread - d1/d38/f74 zero size 2024-09-10T09:36:13.079 INFO:tasks.workunit.client.0.smithi079.stdout:4/914: chown d1/da/d16/d4d/d101 34 1 2024-09-10T09:36:13.079 INFO:tasks.workunit.client.0.smithi079.stdout:4/915: creat d1/da/d28/d47/da1/dcd/f127 x:0 0 0 2024-09-10T09:36:13.081 INFO:tasks.workunit.client.1.smithi135.stdout:9/46: unlink c0 0 2024-09-10T09:36:13.083 INFO:tasks.workunit.client.1.smithi135.stdout:3/18: symlink d4/l6 0 2024-09-10T09:36:13.084 INFO:tasks.workunit.client.0.smithi079.stdout:8/913: rmdir d11/dbd/d104 39 2024-09-10T09:36:13.085 INFO:tasks.workunit.client.0.smithi079.stdout:9/857: getdents d3/d7/dc/de/da7/df8 0 2024-09-10T09:36:13.087 INFO:tasks.workunit.client.1.smithi135.stdout:4/203: mknod d1/d33/c41 0 2024-09-10T09:36:13.087 INFO:tasks.workunit.client.1.smithi135.stdout:4/204: creat d1/db/d23/f42 x:0 0 0 2024-09-10T09:36:13.087 INFO:tasks.workunit.client.1.smithi135.stdout:4/205: chown d1/db/d9/c26 46 1 2024-09-10T09:36:13.087 INFO:tasks.workunit.client.0.smithi079.stdout:0/946: symlink d4/d12/d21/d3f/db3/l135 0 2024-09-10T09:36:13.088 INFO:tasks.workunit.client.1.smithi135.stdout:0/132: creat d8/dd/d11/d17/f27 x:0 0 0 2024-09-10T09:36:13.091 INFO:tasks.workunit.client.0.smithi079.stdout:7/882: unlink d4/d6/d4f/d70/fc9 0 2024-09-10T09:36:13.091 INFO:tasks.workunit.client.0.smithi079.stdout:7/883: fsync d4/d6/d4f/fac 0 2024-09-10T09:36:13.093 INFO:tasks.workunit.client.1.smithi135.stdout:9/47: readlink l5 0 2024-09-10T09:36:13.093 INFO:tasks.workunit.client.0.smithi079.stdout:4/916: dread d1/da/d16/d21/f9e [0,4194304] 0 2024-09-10T09:36:13.097 INFO:tasks.workunit.client.1.smithi135.stdout:3/19: mknod d4/c7 0 2024-09-10T09:36:13.100 INFO:tasks.workunit.client.1.smithi135.stdout:2/22: symlink l5 0 2024-09-10T09:36:13.105 INFO:tasks.workunit.client.0.smithi079.stdout:5/954: dwrite d2/d3/d27/d32/d39/f5c [0,4194304] 0 2024-09-10T09:36:13.105 INFO:tasks.workunit.client.0.smithi079.stdout:5/955: stat d2/d3/d27/d70/cbf 0 2024-09-10T09:36:13.105 INFO:tasks.workunit.client.0.smithi079.stdout:5/956: write d2/d3/d59/f7d [1150469,79592] 0 2024-09-10T09:36:13.105 INFO:tasks.workunit.client.0.smithi079.stdout:3/984: dwrite d4/f29 [0,4194304] 0 2024-09-10T09:36:13.107 INFO:tasks.workunit.client.1.smithi135.stdout:1/34: dwrite f4 [0,4194304] 0 2024-09-10T09:36:13.113 INFO:tasks.workunit.client.0.smithi079.stdout:5/957: dread d2/f26 [0,4194304] 0 2024-09-10T09:36:13.113 INFO:tasks.workunit.client.0.smithi079.stdout:5/958: fsync d2/d3/f63 0 2024-09-10T09:36:13.113 INFO:tasks.workunit.client.1.smithi135.stdout:3/20: dread f2 [0,4194304] 0 2024-09-10T09:36:13.116 INFO:tasks.workunit.client.0.smithi079.stdout:8/914: stat d11/d2b/f4c 0 2024-09-10T09:36:13.116 INFO:tasks.workunit.client.0.smithi079.stdout:8/915: fdatasync d11/d2b/f47 0 2024-09-10T09:36:13.116 INFO:tasks.workunit.client.0.smithi079.stdout:8/916: write d11/d2b/d4b/d74/f7a [55923,129228] 0 2024-09-10T09:36:13.116 INFO:tasks.workunit.client.0.smithi079.stdout:8/917: chown d11/d2b/l33 4347 1 2024-09-10T09:36:13.116 INFO:tasks.workunit.client.0.smithi079.stdout:8/918: chown d11/dbd/ddc 7704 1 2024-09-10T09:36:13.117 INFO:tasks.workunit.client.1.smithi135.stdout:4/206: creat d1/db/f43 x:0 0 0 2024-09-10T09:36:13.117 INFO:tasks.workunit.client.1.smithi135.stdout:4/207: creat d1/de/d16/f44 x:0 0 0 2024-09-10T09:36:13.119 INFO:tasks.workunit.client.1.smithi135.stdout:0/133: dwrite d8/f15 [0,4194304] 0 2024-09-10T09:36:13.120 INFO:tasks.workunit.client.0.smithi079.stdout:0/947: stat d4/d12/d16/c65 0 2024-09-10T09:36:13.120 INFO:tasks.workunit.client.0.smithi079.stdout:0/948: fdatasync d4/d12/d16/d53/f64 0 2024-09-10T09:36:13.121 INFO:tasks.workunit.client.0.smithi079.stdout:0/949: dread - d4/d12/d1a/d6d/ffc zero size 2024-09-10T09:36:13.124 INFO:tasks.workunit.client.0.smithi079.stdout:4/917: rmdir d1/da/d3b/d107/d108 39 2024-09-10T09:36:13.124 INFO:tasks.workunit.client.0.smithi079.stdout:4/918: chown d1/l5 418382 1 2024-09-10T09:36:13.124 INFO:tasks.workunit.client.0.smithi079.stdout:7/884: dread d4/d6/d38/fb7 [0,4194304] 0 2024-09-10T09:36:13.124 INFO:tasks.workunit.client.1.smithi135.stdout:7/85: dwrite d2/ff [0,4194304] 0 2024-09-10T09:36:13.126 INFO:tasks.workunit.client.1.smithi135.stdout:9/48: fsync f4 0 2024-09-10T09:36:13.131 INFO:tasks.workunit.client.0.smithi079.stdout:2/906: rmdir d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde/dee 0 2024-09-10T09:36:13.134 INFO:tasks.workunit.client.1.smithi135.stdout:0/134: read f4 [3299661,113710] 0 2024-09-10T09:36:13.134 INFO:tasks.workunit.client.1.smithi135.stdout:0/135: chown d8/f26 17155 1 2024-09-10T09:36:13.144 INFO:tasks.workunit.client.1.smithi135.stdout:1/35: dwrite f6 [0,4194304] 0 2024-09-10T09:36:13.144 INFO:tasks.workunit.client.1.smithi135.stdout:2/23: dwrite f3 [0,4194304] 0 2024-09-10T09:36:13.144 INFO:tasks.workunit.client.0.smithi079.stdout:3/985: dwrite d4/da/d8a/dd7/d10e/fc4 [4194304,4194304] 0 2024-09-10T09:36:13.145 INFO:tasks.workunit.client.0.smithi079.stdout:3/986: read - d4/da/d17/d2d/fae zero size 2024-09-10T09:36:13.145 INFO:tasks.workunit.client.0.smithi079.stdout:3/987: creat d4/da/d17/ddf/f13a x:0 0 0 2024-09-10T09:36:13.145 INFO:tasks.workunit.client.0.smithi079.stdout:5/959: dwrite d2/d3/d5e/d61/d71/fbc [0,4194304] 0 2024-09-10T09:36:13.146 INFO:tasks.workunit.client.0.smithi079.stdout:9/858: rmdir d3/d7/dc/d7a 39 2024-09-10T09:36:13.148 INFO:tasks.workunit.client.0.smithi079.stdout:0/950: symlink d4/d12/d8b/dca/d32/l136 0 2024-09-10T09:36:13.148 INFO:tasks.workunit.client.1.smithi135.stdout:3/21: symlink d4/l8 0 2024-09-10T09:36:13.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/885: creat d4/df/d19/f10c x:0 0 0 2024-09-10T09:36:13.150 INFO:tasks.workunit.client.1.smithi135.stdout:4/208: mknod d1/db/c45 0 2024-09-10T09:36:13.151 INFO:tasks.workunit.client.1.smithi135.stdout:4/209: fdatasync d1/db/f8 0 2024-09-10T09:36:13.151 INFO:tasks.workunit.client.1.smithi135.stdout:4/210: truncate d1/de/d16/f3b 120316 0 2024-09-10T09:36:13.151 INFO:tasks.workunit.client.1.smithi135.stdout:4/211: write d1/de/d16/f44 [199978,8532] 0 2024-09-10T09:36:13.151 INFO:tasks.workunit.client.0.smithi079.stdout:2/907: mknod d4/dc/d1c/d86/d1b/d38/d39/d31/c124 0 2024-09-10T09:36:13.156 INFO:tasks.workunit.client.1.smithi135.stdout:7/86: mkdir d2/d11/d18 0 2024-09-10T09:36:13.161 INFO:tasks.workunit.client.0.smithi079.stdout:3/988: rmdir d4/da/d17/d2d/d43/d4c/d107 0 2024-09-10T09:36:13.161 INFO:tasks.workunit.client.0.smithi079.stdout:2/908: dread d4/dc/d1c/d86/d1b/d38/d39/d99/f1f [0,4194304] 0 2024-09-10T09:36:13.162 INFO:tasks.workunit.client.1.smithi135.stdout:9/49: dread f9 [0,4194304] 0 2024-09-10T09:36:13.164 INFO:tasks.workunit.client.0.smithi079.stdout:5/960: symlink d2/d3/d27/d70/d88/df2/d12e/l132 0 2024-09-10T09:36:13.165 INFO:tasks.workunit.client.0.smithi079.stdout:5/961: chown d2/d3/fa 2562 1 2024-09-10T09:36:13.165 INFO:tasks.workunit.client.0.smithi079.stdout:5/962: read - d2/d3/d27/dde/dfd/f10e zero size 2024-09-10T09:36:13.165 INFO:tasks.workunit.client.0.smithi079.stdout:9/859: symlink d3/d7/dc/d7a/da9/l121 0 2024-09-10T09:36:13.167 INFO:tasks.workunit.client.0.smithi079.stdout:0/951: symlink d4/d12/d16/de3/d102/l137 0 2024-09-10T09:36:13.169 INFO:tasks.workunit.client.1.smithi135.stdout:1/36: unlink l1 0 2024-09-10T09:36:13.169 INFO:tasks.workunit.client.0.smithi079.stdout:2/909: write d4/dc/d1c/d86/d1b/d38/d39/f4c [2262819,67229] 0 2024-09-10T09:36:13.172 INFO:tasks.workunit.client.0.smithi079.stdout:5/963: dread d2/d3/d5e/d85/f12a [0,4194304] 0 2024-09-10T09:36:13.173 INFO:tasks.workunit.client.1.smithi135.stdout:2/24: creat f6 x:0 0 0 2024-09-10T09:36:13.173 INFO:tasks.workunit.client.0.smithi079.stdout:4/919: rmdir d1/da/d16/d88 39 2024-09-10T09:36:13.175 INFO:tasks.workunit.client.1.smithi135.stdout:3/22: creat d4/f9 x:0 0 0 2024-09-10T09:36:13.175 INFO:tasks.workunit.client.1.smithi135.stdout:3/23: stat d4/f9 0 2024-09-10T09:36:13.176 INFO:tasks.workunit.client.0.smithi079.stdout:7/886: symlink d4/d6/d4f/d70/db6/l10d 0 2024-09-10T09:36:13.176 INFO:tasks.workunit.client.0.smithi079.stdout:7/887: readlink d4/df/d19/db9/lbf 0 2024-09-10T09:36:13.180 INFO:tasks.workunit.client.1.smithi135.stdout:0/136: write d8/dd/d18/f1a [1332982,42859] 0 2024-09-10T09:36:13.180 INFO:tasks.workunit.client.0.smithi079.stdout:3/989: creat d4/da/d17/d2d/f13b x:0 0 0 2024-09-10T09:36:13.180 INFO:tasks.workunit.client.0.smithi079.stdout:3/990: chown d4/da/f57 4366153 1 2024-09-10T09:36:13.181 INFO:tasks.workunit.client.1.smithi135.stdout:2/25: read f3 [920670,39948] 0 2024-09-10T09:36:13.181 INFO:tasks.workunit.client.1.smithi135.stdout:4/212: rename d1/de/f1b to d1/db/f46 0 2024-09-10T09:36:13.184 INFO:tasks.workunit.client.0.smithi079.stdout:9/860: rename d3/d40/f7e to d3/d7/dc/de/d17/d12/f122 0 2024-09-10T09:36:13.184 INFO:tasks.workunit.client.0.smithi079.stdout:9/861: write d3/d7/dc/f36 [5282831,107626] 0 2024-09-10T09:36:13.185 INFO:tasks.workunit.client.0.smithi079.stdout:9/862: creat d3/d7/dc/de/d17/dcf/d107/f123 x:0 0 0 2024-09-10T09:36:13.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/87: rmdir d2/d11/d18 0 2024-09-10T09:36:13.190 INFO:tasks.workunit.client.1.smithi135.stdout:0/137: write d8/fb [3789510,101010] 0 2024-09-10T09:36:13.191 INFO:tasks.workunit.client.0.smithi079.stdout:0/952: mkdir d4/d12/d1a/d6d/d91/d138 0 2024-09-10T09:36:13.194 INFO:tasks.workunit.client.0.smithi079.stdout:0/953: dread d4/d12/d39/f8d [0,4194304] 0 2024-09-10T09:36:13.194 INFO:tasks.workunit.client.0.smithi079.stdout:0/954: fdatasync d4/d12/d15/d6b/daa/fb4 0 2024-09-10T09:36:13.197 INFO:tasks.workunit.client.0.smithi079.stdout:2/910: mknod d4/dc/d1c/d86/d1b/d38/d87/c125 0 2024-09-10T09:36:13.198 INFO:tasks.workunit.client.0.smithi079.stdout:5/964: mknod d2/d3/d27/d32/db6/c133 0 2024-09-10T09:36:13.198 INFO:tasks.workunit.client.0.smithi079.stdout:5/965: write d2/d3/d27/d32/de3/d4d/f92 [349626,110723] 0 2024-09-10T09:36:13.205 INFO:tasks.workunit.client.1.smithi135.stdout:4/213: link d1/db/d23/l2a d1/d33/l47 0 2024-09-10T09:36:13.205 INFO:tasks.workunit.client.1.smithi135.stdout:4/214: chown d1/de/f3c 100453 1 2024-09-10T09:36:13.205 INFO:tasks.workunit.client.1.smithi135.stdout:4/215: chown d1/de/d16/f21 143104 1 2024-09-10T09:36:13.206 INFO:tasks.workunit.client.0.smithi079.stdout:3/991: dwrite d4/da/d17/d2d/f76 [0,4194304] 0 2024-09-10T09:36:13.206 INFO:tasks.workunit.client.0.smithi079.stdout:3/992: write d4/da/d17/d2d/d43/d4c/fcb [1302259,28475] 0 2024-09-10T09:36:13.209 INFO:tasks.workunit.client.1.smithi135.stdout:7/88: mknod d2/d3/c19 0 2024-09-10T09:36:13.209 INFO:tasks.workunit.client.1.smithi135.stdout:7/89: write d2/d3/f12 [115403,47719] 0 2024-09-10T09:36:13.213 INFO:tasks.workunit.client.1.smithi135.stdout:0/138: mkdir d8/d1c/d28 0 2024-09-10T09:36:13.213 INFO:tasks.workunit.client.1.smithi135.stdout:0/139: fsync d8/dd/d1e/f23 0 2024-09-10T09:36:13.213 INFO:tasks.workunit.client.1.smithi135.stdout:0/140: fdatasync d8/f15 0 2024-09-10T09:36:13.213 INFO:tasks.workunit.client.0.smithi079.stdout:9/863: mknod d3/d7/dc/de/c124 0 2024-09-10T09:36:13.215 INFO:tasks.workunit.client.1.smithi135.stdout:9/50: mkdir db 0 2024-09-10T09:36:13.215 INFO:tasks.workunit.client.0.smithi079.stdout:0/955: dread f0 [0,4194304] 0 2024-09-10T09:36:13.216 INFO:tasks.workunit.client.0.smithi079.stdout:5/966: truncate d2/d3/d27/d32/d39/f7b 485999 0 2024-09-10T09:36:13.219 INFO:tasks.workunit.client.1.smithi135.stdout:1/37: getdents . 0 2024-09-10T09:36:13.222 INFO:tasks.workunit.client.1.smithi135.stdout:2/26: mkdir d7 0 2024-09-10T09:36:13.222 INFO:tasks.workunit.client.1.smithi135.stdout:2/27: truncate f3 4648486 0 2024-09-10T09:36:13.223 INFO:tasks.workunit.client.1.smithi135.stdout:2/28: readlink l5 0 2024-09-10T09:36:13.226 INFO:tasks.workunit.client.1.smithi135.stdout:4/216: mknod d1/db/d23/d37/c48 0 2024-09-10T09:36:13.226 INFO:tasks.workunit.client.1.smithi135.stdout:4/217: fsync d1/d33/f3d 0 2024-09-10T09:36:13.226 INFO:tasks.workunit.client.1.smithi135.stdout:4/218: chown d1/l1f 900848 1 2024-09-10T09:36:13.227 INFO:tasks.workunit.client.1.smithi135.stdout:7/90: readlink d2/lc 0 2024-09-10T09:36:13.228 INFO:tasks.workunit.client.0.smithi079.stdout:5/967: dread d2/d3/d27/f43 [0,4194304] 0 2024-09-10T09:36:13.229 INFO:tasks.workunit.client.1.smithi135.stdout:9/51: rmdir db 0 2024-09-10T09:36:13.230 INFO:tasks.workunit.client.0.smithi079.stdout:3/993: unlink d4/da/d17/d2d/d43/d4c/c11f 0 2024-09-10T09:36:13.231 INFO:tasks.workunit.client.1.smithi135.stdout:1/38: creat f7 x:0 0 0 2024-09-10T09:36:13.232 INFO:tasks.workunit.client.0.smithi079.stdout:0/956: mkdir d4/d12/dde/d12e/d106/d139 0 2024-09-10T09:36:13.233 INFO:tasks.workunit.client.1.smithi135.stdout:0/141: dwrite d8/dd/d1e/f21 [0,4194304] 0 2024-09-10T09:36:13.233 INFO:tasks.workunit.client.0.smithi079.stdout:4/920: dwrite d1/da/d28/fa2 [0,4194304] 0 2024-09-10T09:36:13.233 INFO:tasks.workunit.client.1.smithi135.stdout:2/29: rmdir d7 0 2024-09-10T09:36:13.233 INFO:tasks.workunit.client.1.smithi135.stdout:2/30: dread - f6 zero size 2024-09-10T09:36:13.237 INFO:tasks.workunit.client.0.smithi079.stdout:7/888: rename d4/d6/d4f/d70/dba to d4/df/d6b/d9a/dde/d10e 0 2024-09-10T09:36:13.237 INFO:tasks.workunit.client.0.smithi079.stdout:2/911: rename d4/dc/d1c/d86/d1b/d38 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde/d123/d126 22 2024-09-10T09:36:13.237 INFO:tasks.workunit.client.1.smithi135.stdout:4/219: mknod d1/d33/d40/c49 0 2024-09-10T09:36:13.238 INFO:tasks.workunit.client.0.smithi079.stdout:5/968: mkdir d2/d3/d27/d32/de3/d4d/d11d/d134 0 2024-09-10T09:36:13.238 INFO:tasks.workunit.client.0.smithi079.stdout:5/969: fdatasync d2/d3/d59/fb2 0 2024-09-10T09:36:13.241 INFO:tasks.workunit.client.0.smithi079.stdout:3/994: mknod d4/da/d17/d2d/d43/de7/c13c 0 2024-09-10T09:36:13.243 INFO:tasks.workunit.client.0.smithi079.stdout:0/957: link d4/feb d4/d12/d8b/dca/f13a 0 2024-09-10T09:36:13.244 INFO:tasks.workunit.client.1.smithi135.stdout:1/39: creat f8 x:0 0 0 2024-09-10T09:36:13.245 INFO:tasks.workunit.client.1.smithi135.stdout:2/31: creat f8 x:0 0 0 2024-09-10T09:36:13.245 INFO:tasks.workunit.client.1.smithi135.stdout:2/32: dread - f6 zero size 2024-09-10T09:36:13.247 INFO:tasks.workunit.client.0.smithi079.stdout:0/958: dread d4/d12/d16/de3/fb2 [0,4194304] 0 2024-09-10T09:36:13.248 INFO:tasks.workunit.client.0.smithi079.stdout:9/864: rename d3/d7/d70/dbc/fdc to d3/d7f/f125 0 2024-09-10T09:36:13.249 INFO:tasks.workunit.client.0.smithi079.stdout:7/889: mknod d4/d6/d4f/d70/db6/c10f 0 2024-09-10T09:36:13.251 INFO:tasks.workunit.client.1.smithi135.stdout:7/91: rename d2/l6 to d2/d15/l1a 0 2024-09-10T09:36:13.258 INFO:tasks.workunit.client.1.smithi135.stdout:4/220: dwrite d1/db/f43 [0,4194304] 0 2024-09-10T09:36:13.261 INFO:tasks.workunit.client.0.smithi079.stdout:2/912: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f127 x:0 0 0 2024-09-10T09:36:13.265 INFO:tasks.workunit.client.0.smithi079.stdout:5/970: creat d2/d3/d27/d32/d44/dfa/f135 x:0 0 0 2024-09-10T09:36:13.265 INFO:tasks.workunit.client.0.smithi079.stdout:5/971: getdents d2/d3/d27/d70/d80/d122 0 2024-09-10T09:36:13.267 INFO:tasks.workunit.client.1.smithi135.stdout:1/40: chown f6 2 1 2024-09-10T09:36:13.268 INFO:tasks.workunit.client.0.smithi079.stdout:7/890: write d4/dc/f8f [4154036,76260] 0 2024-09-10T09:36:13.268 INFO:tasks.workunit.client.0.smithi079.stdout:7/891: fdatasync d4/d6/d4f/d70/db6/fd2 0 2024-09-10T09:36:13.268 INFO:tasks.workunit.client.0.smithi079.stdout:7/892: dread - d4/df/d6b/d9a/d9c/fd7 zero size 2024-09-10T09:36:13.268 INFO:tasks.workunit.client.0.smithi079.stdout:8/919: sync 2024-09-10T09:36:13.270 INFO:tasks.workunit.client.0.smithi079.stdout:3/995: rename d4/da/d67/c139 to d4/da/d17/d54/c13d 0 2024-09-10T09:36:13.272 INFO:tasks.workunit.client.0.smithi079.stdout:2/913: creat d4/f128 x:0 0 0 2024-09-10T09:36:13.275 INFO:tasks.workunit.client.0.smithi079.stdout:7/893: mknod d4/d6/c110 0 2024-09-10T09:36:13.277 INFO:tasks.workunit.client.0.smithi079.stdout:8/920: link d11/d2b/d4b/d74/f119 d11/d2b/d4b/d74/da2/f123 0 2024-09-10T09:36:13.277 INFO:tasks.workunit.client.0.smithi079.stdout:8/921: write d11/d2b/d4b/d50/d5c/f95 [4909798,958] 0 2024-09-10T09:36:13.278 INFO:tasks.workunit.client.1.smithi135.stdout:4/221: mkdir d1/d4a 0 2024-09-10T09:36:13.279 INFO:tasks.workunit.client.0.smithi079.stdout:5/972: dread d2/f22 [0,4194304] 0 2024-09-10T09:36:13.279 INFO:tasks.workunit.client.0.smithi079.stdout:0/959: rename d4/d12/d21/c2d to d4/d12/dc0/ddf/c13b 0 2024-09-10T09:36:13.280 INFO:tasks.workunit.client.0.smithi079.stdout:9/865: dwrite d3/f11 [4194304,4194304] 0 2024-09-10T09:36:13.282 INFO:tasks.workunit.client.1.smithi135.stdout:9/52: rename ca to cc 0 2024-09-10T09:36:13.282 INFO:tasks.workunit.client.1.smithi135.stdout:7/92: dwrite d2/f13 [4194304,4194304] 0 2024-09-10T09:36:13.282 INFO:tasks.workunit.client.1.smithi135.stdout:7/93: write d2/d3/f12 [560018,68999] 0 2024-09-10T09:36:13.284 INFO:tasks.workunit.client.0.smithi079.stdout:3/996: truncate d4/da/d18/f47 1573436 0 2024-09-10T09:36:13.288 INFO:tasks.workunit.client.0.smithi079.stdout:2/914: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/l129 0 2024-09-10T09:36:13.288 INFO:tasks.workunit.client.0.smithi079.stdout:2/915: write d4/dc/d1c/d104/f11c [665492,27575] 0 2024-09-10T09:36:13.289 INFO:tasks.workunit.client.0.smithi079.stdout:2/916: dread - d4/dc/ff0 zero size 2024-09-10T09:36:13.289 INFO:tasks.workunit.client.0.smithi079.stdout:2/917: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/fa9 0 2024-09-10T09:36:13.289 INFO:tasks.workunit.client.1.smithi135.stdout:2/33: mknod c9 0 2024-09-10T09:36:13.294 INFO:tasks.workunit.client.0.smithi079.stdout:5/973: truncate d2/d3/d27/d32/d44/f4c 4171088 0 2024-09-10T09:36:13.294 INFO:tasks.workunit.client.0.smithi079.stdout:5/974: stat d2/d3/d5e/d85 0 2024-09-10T09:36:13.296 INFO:tasks.workunit.client.1.smithi135.stdout:7/94: unlink d2/d3/cd 0 2024-09-10T09:36:13.300 INFO:tasks.workunit.client.0.smithi079.stdout:8/922: rename fe to d11/d91/d110/f124 0 2024-09-10T09:36:13.301 INFO:tasks.workunit.client.1.smithi135.stdout:1/41: mknod c9 0 2024-09-10T09:36:13.302 INFO:tasks.workunit.client.0.smithi079.stdout:0/960: symlink d4/d12/d21/d3f/db3/db5/l13c 0 2024-09-10T09:36:13.304 INFO:tasks.workunit.client.1.smithi135.stdout:9/53: symlink ld 0 2024-09-10T09:36:13.305 INFO:tasks.workunit.client.0.smithi079.stdout:3/997: creat d4/da/d17/ddf/d111/f13e x:0 0 0 2024-09-10T09:36:13.306 INFO:tasks.workunit.client.1.smithi135.stdout:7/95: mkdir d2/d15/d1b 0 2024-09-10T09:36:13.307 INFO:tasks.workunit.client.0.smithi079.stdout:5/975: write d2/d3/fe [2729996,127840] 0 2024-09-10T09:36:13.307 INFO:tasks.workunit.client.0.smithi079.stdout:5/976: chown d2/d3/d27/d70/d80/d94 1633803023 1 2024-09-10T09:36:13.307 INFO:tasks.workunit.client.0.smithi079.stdout:2/918: truncate d4/dc/d1c/d86/d1b/d38/d39/d99/f1f 790213 0 2024-09-10T09:36:13.309 INFO:tasks.workunit.client.1.smithi135.stdout:1/42: truncate f4 4862757 0 2024-09-10T09:36:13.310 INFO:tasks.workunit.client.0.smithi079.stdout:7/894: getdents d4/d6/d4f/d70/db6 0 2024-09-10T09:36:13.312 INFO:tasks.workunit.client.1.smithi135.stdout:4/222: dwrite d1/db/ff [0,4194304] 0 2024-09-10T09:36:13.312 INFO:tasks.workunit.client.1.smithi135.stdout:4/223: readlink d1/d33/l35 0 2024-09-10T09:36:13.313 INFO:tasks.workunit.client.0.smithi079.stdout:9/866: dwrite d3/d40/f81 [0,4194304] 0 2024-09-10T09:36:13.313 INFO:tasks.workunit.client.1.smithi135.stdout:2/34: dwrite f6 [0,4194304] 0 2024-09-10T09:36:13.315 INFO:tasks.workunit.client.0.smithi079.stdout:8/923: rmdir d11/d91/d110 39 2024-09-10T09:36:13.315 INFO:tasks.workunit.client.0.smithi079.stdout:8/924: fsync d11/d2b/fa1 0 2024-09-10T09:36:13.315 INFO:tasks.workunit.client.0.smithi079.stdout:8/925: chown d11/c52 2388261 1 2024-09-10T09:36:13.315 INFO:tasks.workunit.client.0.smithi079.stdout:8/926: chown d11/f45 5336 1 2024-09-10T09:36:13.315 INFO:tasks.workunit.client.0.smithi079.stdout:8/927: truncate d11/d2b/d4b/da8/fce 1198428 0 2024-09-10T09:36:13.315 INFO:tasks.workunit.client.0.smithi079.stdout:8/928: write d11/d48/f6a [1876989,128883] 0 2024-09-10T09:36:13.315 INFO:tasks.workunit.client.0.smithi079.stdout:8/929: truncate d11/d48/fb6 837962 0 2024-09-10T09:36:13.316 INFO:tasks.workunit.client.1.smithi135.stdout:7/96: rename d2/f8 to d2/d15/f1c 0 2024-09-10T09:36:13.318 INFO:tasks.workunit.client.0.smithi079.stdout:0/961: symlink d4/d12/d21/d3f/db3/dce/l13d 0 2024-09-10T09:36:13.319 INFO:tasks.workunit.client.1.smithi135.stdout:4/224: symlink d1/db/l4b 0 2024-09-10T09:36:13.319 INFO:tasks.workunit.client.1.smithi135.stdout:4/225: truncate d1/db/d23/f3e 304305 0 2024-09-10T09:36:13.319 INFO:tasks.workunit.client.1.smithi135.stdout:4/226: readlink d1/de/d16/l1d 0 2024-09-10T09:36:13.320 INFO:tasks.workunit.client.0.smithi079.stdout:3/998: creat d4/da/d18/daf/f13f x:0 0 0 2024-09-10T09:36:13.323 INFO:tasks.workunit.client.0.smithi079.stdout:5/977: creat d2/d3/d59/dcb/f136 x:0 0 0 2024-09-10T09:36:13.327 INFO:tasks.workunit.client.0.smithi079.stdout:2/919: link d4/dc/c94 d4/dc/d1c/c12a 0 2024-09-10T09:36:13.327 INFO:tasks.workunit.client.0.smithi079.stdout:2/920: creat d4/dc/d1c/d86/d1b/d38/f12b x:0 0 0 2024-09-10T09:36:13.327 INFO:tasks.workunit.client.0.smithi079.stdout:2/921: creat d4/f12c x:0 0 0 2024-09-10T09:36:13.327 INFO:tasks.workunit.client.0.smithi079.stdout:2/922: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/f12d x:0 0 0 2024-09-10T09:36:13.328 INFO:tasks.workunit.client.1.smithi135.stdout:9/54: mkdir de 0 2024-09-10T09:36:13.328 INFO:tasks.workunit.client.1.smithi135.stdout:9/55: write f9 [1515320,74265] 0 2024-09-10T09:36:13.332 INFO:tasks.workunit.client.1.smithi135.stdout:7/97: creat d2/d11/d16/f1d x:0 0 0 2024-09-10T09:36:13.334 INFO:tasks.workunit.client.1.smithi135.stdout:4/227: mknod d1/c4c 0 2024-09-10T09:36:13.334 INFO:tasks.workunit.client.1.smithi135.stdout:7/98: dread d2/f10 [0,4194304] 0 2024-09-10T09:36:13.334 INFO:tasks.workunit.client.1.smithi135.stdout:7/99: read d2/f4 [1421343,21227] 0 2024-09-10T09:36:13.336 INFO:tasks.workunit.client.1.smithi135.stdout:2/35: rename l5 to la 0 2024-09-10T09:36:13.338 INFO:tasks.workunit.client.0.smithi079.stdout:9/867: rename d3/d7/dc/d7a/da9/l121 to d3/d7/dc/l126 0 2024-09-10T09:36:13.338 INFO:tasks.workunit.client.0.smithi079.stdout:9/868: creat d3/d7/dc/de/d17/dcf/dd0/f127 x:0 0 0 2024-09-10T09:36:13.339 INFO:tasks.workunit.client.1.smithi135.stdout:9/56: mkdir de/df 0 2024-09-10T09:36:13.341 INFO:tasks.workunit.client.1.smithi135.stdout:4/228: creat d1/d33/d40/f4d x:0 0 0 2024-09-10T09:36:13.343 INFO:tasks.workunit.client.1.smithi135.stdout:2/36: write f6 [1354624,100139] 0 2024-09-10T09:36:13.344 INFO:tasks.workunit.client.1.smithi135.stdout:7/100: creat d2/f1e x:0 0 0 2024-09-10T09:36:13.344 INFO:tasks.workunit.client.1.smithi135.stdout:7/101: read - d2/f1e zero size 2024-09-10T09:36:13.345 INFO:tasks.workunit.client.1.smithi135.stdout:9/57: creat de/df/f10 x:0 0 0 2024-09-10T09:36:13.345 INFO:tasks.workunit.client.1.smithi135.stdout:9/58: creat de/df/f11 x:0 0 0 2024-09-10T09:36:13.347 INFO:tasks.workunit.client.1.smithi135.stdout:4/229: rename d1/db/d9/l2d to d1/db/d9/l4e 0 2024-09-10T09:36:13.347 INFO:tasks.workunit.client.1.smithi135.stdout:4/230: chown d1/de/f13 0 1 2024-09-10T09:36:13.348 INFO:tasks.workunit.client.1.smithi135.stdout:4/231: write d1/f19 [4019630,56731] 0 2024-09-10T09:36:13.349 INFO:tasks.workunit.client.0.smithi079.stdout:4/921: sync 2024-09-10T09:36:13.352 INFO:tasks.workunit.client.0.smithi079.stdout:4/922: dread d1/da/d3b/d5f/f62 [0,4194304] 0 2024-09-10T09:36:13.353 INFO:tasks.workunit.client.0.smithi079.stdout:0/962: symlink d4/d12/d1a/d6d/d91/l13e 0 2024-09-10T09:36:13.355 INFO:tasks.workunit.client.0.smithi079.stdout:5/978: rmdir d2/d3/d27/d70/d80/d94/dff 39 2024-09-10T09:36:13.357 INFO:tasks.workunit.client.0.smithi079.stdout:8/930: write d11/d2b/d4b/d50/d55/d87/faf [83966,7414] 0 2024-09-10T09:36:13.357 INFO:tasks.workunit.client.0.smithi079.stdout:8/931: write d11/d2b/d4b/d50/f89 [2354566,124280] 0 2024-09-10T09:36:13.359 INFO:tasks.workunit.client.0.smithi079.stdout:4/923: dread d1/da/d3b/d5a/f11a [0,4194304] 0 2024-09-10T09:36:13.362 INFO:tasks.workunit.client.1.smithi135.stdout:2/37: mknod cb 0 2024-09-10T09:36:13.364 INFO:tasks.workunit.client.0.smithi079.stdout:2/923: link d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/l129 d4/dc/d1c/d86/d1b/d38/d39/d31/d49/l12e 0 2024-09-10T09:36:13.364 INFO:tasks.workunit.client.0.smithi079.stdout:5/979: write d2/d3/d27/d32/d44/ff1 [455180,127510] 0 2024-09-10T09:36:13.364 INFO:tasks.workunit.client.0.smithi079.stdout:5/980: stat d2/d3/d5e/d61/d71/fb9 0 2024-09-10T09:36:13.365 INFO:tasks.workunit.client.0.smithi079.stdout:5/981: write d2/d3/d27/d32/de3/f6b [2549707,115963] 0 2024-09-10T09:36:13.365 INFO:tasks.workunit.client.0.smithi079.stdout:5/982: readlink d2/d3/d27/d70/d80/d94/dff/l102 0 2024-09-10T09:36:13.365 INFO:tasks.workunit.client.0.smithi079.stdout:5/983: creat d2/d3/d27/d32/d44/dfa/f137 x:0 0 0 2024-09-10T09:36:13.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/102: link d2/f4 d2/f1f 0 2024-09-10T09:36:13.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/103: fdatasync d2/d3/f12 0 2024-09-10T09:36:13.368 INFO:tasks.workunit.client.0.smithi079.stdout:0/963: creat d4/d12/d21/d3f/db3/f13f x:0 0 0 2024-09-10T09:36:13.368 INFO:tasks.workunit.client.0.smithi079.stdout:0/964: creat d4/d1d/f140 x:0 0 0 2024-09-10T09:36:13.370 INFO:tasks.workunit.client.0.smithi079.stdout:8/932: creat d11/d2b/d4b/d50/d5c/f125 x:0 0 0 2024-09-10T09:36:13.372 INFO:tasks.workunit.client.0.smithi079.stdout:2/924: stat d4/dc/d1c/d86/d1b/l89 0 2024-09-10T09:36:13.377 INFO:tasks.workunit.client.0.smithi079.stdout:9/869: rename d3/d7/c54 to d3/df6/c128 0 2024-09-10T09:36:13.379 INFO:tasks.workunit.client.0.smithi079.stdout:0/965: unlink d4/d12/d1a/d6d/d84/l124 0 2024-09-10T09:36:13.380 INFO:tasks.workunit.client.1.smithi135.stdout:2/38: getdents . 0 2024-09-10T09:36:13.380 INFO:tasks.workunit.client.1.smithi135.stdout:2/39: write f6 [3767206,10999] 0 2024-09-10T09:36:13.382 INFO:tasks.workunit.client.0.smithi079.stdout:5/984: dwrite d2/d3/d27/d32/d44/f4c [0,4194304] 0 2024-09-10T09:36:13.384 INFO:tasks.workunit.client.0.smithi079.stdout:4/924: rename d1/da/d3b/de0/leb to d1/da/d28/d47/da1/l128 0 2024-09-10T09:36:13.385 INFO:tasks.workunit.client.0.smithi079.stdout:4/925: write d1/da/d16/d4d/f9f [3622367,117760] 0 2024-09-10T09:36:13.385 INFO:tasks.workunit.client.0.smithi079.stdout:4/926: creat d1/d38/da5/f129 x:0 0 0 2024-09-10T09:36:13.386 INFO:tasks.workunit.client.0.smithi079.stdout:9/870: truncate d3/d40/dc0/fe9 4086037 0 2024-09-10T09:36:13.386 INFO:tasks.workunit.client.0.smithi079.stdout:9/871: chown d3/df6/c128 29 1 2024-09-10T09:36:13.387 INFO:tasks.workunit.client.0.smithi079.stdout:2/925: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/fd7 [2391192,23224] 0 2024-09-10T09:36:13.387 INFO:tasks.workunit.client.0.smithi079.stdout:2/926: write d4/dc/fcf [1782842,19045] 0 2024-09-10T09:36:13.391 INFO:tasks.workunit.client.0.smithi079.stdout:4/927: link d1/d38/da5/l123 d1/da/d16/d4d/l12a 0 2024-09-10T09:36:13.392 INFO:tasks.workunit.client.0.smithi079.stdout:9/872: mknod d3/c129 0 2024-09-10T09:36:13.392 INFO:tasks.workunit.client.0.smithi079.stdout:9/873: write d3/d7/dc/de/d17/dcf/dd0/ff9 [274123,13886] 0 2024-09-10T09:36:13.392 INFO:tasks.workunit.client.0.smithi079.stdout:9/874: getdents d3/d7/dc/de/d17/dfb 0 2024-09-10T09:36:13.393 INFO:tasks.workunit.client.0.smithi079.stdout:2/927: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/fff [0,4194304] 0 2024-09-10T09:36:13.393 INFO:tasks.workunit.client.0.smithi079.stdout:2/928: stat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6 0 2024-09-10T09:36:13.393 INFO:tasks.workunit.client.0.smithi079.stdout:2/929: read d4/dc/d1c/d86/d1b/d38/d39/d99/d61/fae [264640,72865] 0 2024-09-10T09:36:13.399 INFO:tasks.workunit.client.0.smithi079.stdout:4/928: creat d1/da/d16/d88/d10b/f12b x:0 0 0 2024-09-10T09:36:13.399 INFO:tasks.workunit.client.0.smithi079.stdout:9/875: link d3/d7/dc/de/d17/d12/cb6 d3/d7/d26/d69/dea/c12a 0 2024-09-10T09:36:13.399 INFO:tasks.workunit.client.0.smithi079.stdout:4/929: truncate d1/d38/f74 101820 0 2024-09-10T09:36:13.399 INFO:tasks.workunit.client.0.smithi079.stdout:9/876: dread - d3/d7/d5a/fd5 zero size 2024-09-10T09:36:13.399 INFO:tasks.workunit.client.0.smithi079.stdout:2/930: mknod d4/dc/d1c/d86/d1b/d38/d87/c12f 0 2024-09-10T09:36:13.399 INFO:tasks.workunit.client.0.smithi079.stdout:2/931: write d4/dc/d1c/d86/d1b/f101 [836048,36158] 0 2024-09-10T09:36:13.399 INFO:tasks.workunit.client.0.smithi079.stdout:2/932: chown l3 956 1 2024-09-10T09:36:13.400 INFO:tasks.workunit.client.0.smithi079.stdout:2/933: write d4/dc/d1c/d86/d1b/f101 [1283614,10433] 0 2024-09-10T09:36:13.401 INFO:tasks.workunit.client.0.smithi079.stdout:2/934: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/db0/f130 x:0 0 0 2024-09-10T09:36:13.408 INFO:tasks.workunit.client.0.smithi079.stdout:2/935: rmdir d4/dc/d1c/d86/d1b/d38/d39/d117 0 2024-09-10T09:36:13.410 INFO:tasks.workunit.client.0.smithi079.stdout:2/936: link d4/dc/d1c/d86/c122 d4/dc/d1c/d86/d1b/d38/d39/d99/d61/c131 0 2024-09-10T09:36:13.412 INFO:tasks.workunit.client.0.smithi079.stdout:2/937: read d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f7d [404246,2724] 0 2024-09-10T09:36:13.412 INFO:tasks.workunit.client.0.smithi079.stdout:2/938: write d4/dc/d1c/d86/d1b/d38/d39/f102 [547146,59770] 0 2024-09-10T09:36:13.412 INFO:tasks.workunit.client.0.smithi079.stdout:4/930: dread d1/da/d16/d88/f119 [0,4194304] 0 2024-09-10T09:36:13.413 INFO:tasks.workunit.client.0.smithi079.stdout:4/931: rmdir d1/da/d28/d47/da1/d83/dfe 39 2024-09-10T09:36:13.423 INFO:tasks.workunit.client.1.smithi135.stdout:2/40: dwrite f6 [0,4194304] 0 2024-09-10T09:36:13.423 INFO:tasks.workunit.client.1.smithi135.stdout:2/41: readlink la 0 2024-09-10T09:36:13.424 INFO:tasks.workunit.client.1.smithi135.stdout:2/42: mknod cc 0 2024-09-10T09:36:13.425 INFO:tasks.workunit.client.0.smithi079.stdout:0/966: dwrite d4/d12/d15/d69/f120 [0,4194304] 0 2024-09-10T09:36:13.425 INFO:tasks.workunit.client.1.smithi135.stdout:2/43: mknod cd 0 2024-09-10T09:36:13.428 INFO:tasks.workunit.client.0.smithi079.stdout:4/932: write d1/da/f45 [2777344,73777] 0 2024-09-10T09:36:13.428 INFO:tasks.workunit.client.0.smithi079.stdout:5/985: dwrite d2/d3/d27/d32/f123 [0,4194304] 0 2024-09-10T09:36:13.428 INFO:tasks.workunit.client.0.smithi079.stdout:5/986: chown d2/d3/d27/d32/db6/fe0 119668 1 2024-09-10T09:36:13.429 INFO:tasks.workunit.client.0.smithi079.stdout:9/877: dwrite d3/d7/dc/de/d17/d2f/d98/f11c [0,4194304] 0 2024-09-10T09:36:13.430 INFO:tasks.workunit.client.0.smithi079.stdout:2/939: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/fe2 [0,4194304] 0 2024-09-10T09:36:13.430 INFO:tasks.workunit.client.0.smithi079.stdout:2/940: dread - d4/dc/d1c/d86/d1b/d38/f12b zero size 2024-09-10T09:36:13.431 INFO:tasks.workunit.client.0.smithi079.stdout:5/987: symlink d2/d3/d27/d32/de3/d4d/d11d/l138 0 2024-09-10T09:36:13.431 INFO:tasks.workunit.client.1.smithi135.stdout:2/44: dread f3 [0,4194304] 0 2024-09-10T09:36:13.432 INFO:tasks.workunit.client.0.smithi079.stdout:4/933: mkdir d1/d38/d12c 0 2024-09-10T09:36:13.432 INFO:tasks.workunit.client.0.smithi079.stdout:4/934: fsync d1/da/d3b/d5f/f62 0 2024-09-10T09:36:13.437 INFO:tasks.workunit.client.1.smithi135.stdout:2/45: mkdir de 0 2024-09-10T09:36:13.438 INFO:tasks.workunit.client.0.smithi079.stdout:9/878: mkdir d3/d7/dc/d7a/da9/d12b 0 2024-09-10T09:36:13.441 INFO:tasks.workunit.client.0.smithi079.stdout:0/967: dwrite d4/d12/d39/f8d [0,4194304] 0 2024-09-10T09:36:13.441 INFO:tasks.workunit.client.0.smithi079.stdout:0/968: readlink d4/d12/d1a/d6d/d91/l13e 0 2024-09-10T09:36:13.441 INFO:tasks.workunit.client.0.smithi079.stdout:0/969: creat d4/d12/dde/f141 x:0 0 0 2024-09-10T09:36:13.444 INFO:tasks.workunit.client.1.smithi135.stdout:2/46: rmdir de 0 2024-09-10T09:36:13.444 INFO:tasks.workunit.client.1.smithi135.stdout:2/47: fsync f8 0 2024-09-10T09:36:13.444 INFO:tasks.workunit.client.0.smithi079.stdout:0/970: write d4/d12/d15/d69/fbf [83612,78830] 0 2024-09-10T09:36:13.445 INFO:tasks.workunit.client.0.smithi079.stdout:4/935: dread d1/da/d16/d57/ff4 [0,4194304] 0 2024-09-10T09:36:13.445 INFO:tasks.workunit.client.0.smithi079.stdout:0/971: dread d4/d12/d8b/dca/f37 [0,4194304] 0 2024-09-10T09:36:13.446 INFO:tasks.workunit.client.0.smithi079.stdout:2/941: mknod d4/dc/d1c/d86/d1b/c132 0 2024-09-10T09:36:13.446 INFO:tasks.workunit.client.0.smithi079.stdout:2/942: fsync d4/dc/d1c/d86/d1b/d38/d39/d99/f33 0 2024-09-10T09:36:13.446 INFO:tasks.workunit.client.0.smithi079.stdout:2/943: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/f108 [665875,51373] 0 2024-09-10T09:36:13.446 INFO:tasks.workunit.client.0.smithi079.stdout:0/972: write d4/d12/d8b/dca/f13a [126063,102196] 0 2024-09-10T09:36:13.446 INFO:tasks.workunit.client.0.smithi079.stdout:0/973: chown d4/d12/dde/d12e/f103 154616488 1 2024-09-10T09:36:13.446 INFO:tasks.workunit.client.0.smithi079.stdout:0/974: dread - d4/d12/d16/d53/d6a/fb9 zero size 2024-09-10T09:36:13.447 INFO:tasks.workunit.client.0.smithi079.stdout:0/975: write d4/d12/d8b/dca/d32/fe7 [96738,24700] 0 2024-09-10T09:36:13.447 INFO:tasks.workunit.client.0.smithi079.stdout:0/976: creat d4/d12/d15/d69/f142 x:0 0 0 2024-09-10T09:36:13.447 INFO:tasks.workunit.client.0.smithi079.stdout:0/977: fsync d4/d12/d16/d53/d6a/fb9 0 2024-09-10T09:36:13.448 INFO:tasks.workunit.client.1.smithi135.stdout:2/48: mkdir df 0 2024-09-10T09:36:13.448 INFO:tasks.workunit.client.1.smithi135.stdout:2/49: chown la 298 1 2024-09-10T09:36:13.450 INFO:tasks.workunit.client.0.smithi079.stdout:5/988: symlink d2/d3/d27/d32/d44/db4/l139 0 2024-09-10T09:36:13.451 INFO:tasks.workunit.client.0.smithi079.stdout:4/936: write d1/da/d16/fcb [8238317,65747] 0 2024-09-10T09:36:13.452 INFO:tasks.workunit.client.1.smithi135.stdout:2/50: creat df/f10 x:0 0 0 2024-09-10T09:36:13.452 INFO:tasks.workunit.client.1.smithi135.stdout:2/51: chown c9 70075706 1 2024-09-10T09:36:13.454 INFO:tasks.workunit.client.1.smithi135.stdout:2/52: mknod df/c11 0 2024-09-10T09:36:13.457 INFO:tasks.workunit.client.0.smithi079.stdout:9/879: dwrite d3/d7/dc/de/d17/d12/fb0 [4194304,4194304] 0 2024-09-10T09:36:13.461 INFO:tasks.workunit.client.0.smithi079.stdout:5/989: dread d2/d3/f28 [0,4194304] 0 2024-09-10T09:36:13.466 INFO:tasks.workunit.client.0.smithi079.stdout:2/944: rename d4/dc/fcf to d4/dc/d1c/d86/d1b/d38/d39/f133 0 2024-09-10T09:36:13.467 INFO:tasks.workunit.client.0.smithi079.stdout:0/978: mknod d4/d12/d1a/c143 0 2024-09-10T09:36:13.468 INFO:tasks.workunit.client.0.smithi079.stdout:0/979: chown d4/d12/d16/de3 10 1 2024-09-10T09:36:13.469 INFO:tasks.workunit.client.0.smithi079.stdout:4/937: mkdir d1/d38/da5/dde/d12d 0 2024-09-10T09:36:13.469 INFO:tasks.workunit.client.0.smithi079.stdout:4/938: creat d1/da/d3b/d5a/f12e x:0 0 0 2024-09-10T09:36:13.471 INFO:tasks.workunit.client.0.smithi079.stdout:5/990: symlink d2/d3/d5e/d73/l13a 0 2024-09-10T09:36:13.472 INFO:tasks.workunit.client.0.smithi079.stdout:2/945: getdents d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e 0 2024-09-10T09:36:13.473 INFO:tasks.workunit.client.0.smithi079.stdout:0/980: mknod d4/d12/d15/d6b/c144 0 2024-09-10T09:36:13.476 INFO:tasks.workunit.client.0.smithi079.stdout:5/991: creat d2/d3/d27/d70/d88/df2/f13b x:0 0 0 2024-09-10T09:36:13.476 INFO:tasks.workunit.client.0.smithi079.stdout:4/939: write d1/f2e [4711420,123173] 0 2024-09-10T09:36:13.476 INFO:tasks.workunit.client.0.smithi079.stdout:4/940: chown d1/da/d28/d47/da1/l128 185087733 1 2024-09-10T09:36:13.477 INFO:tasks.workunit.client.0.smithi079.stdout:9/880: rename d3/d7/d26/d69 to d3/d7/dc/de/d58/d12c 0 2024-09-10T09:36:13.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/53: dwrite f8 [0,4194304] 0 2024-09-10T09:36:13.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/54: creat df/f12 x:0 0 0 2024-09-10T09:36:13.478 INFO:tasks.workunit.client.0.smithi079.stdout:9/881: dread d3/d7/dc/de/d17/f28 [0,4194304] 0 2024-09-10T09:36:13.478 INFO:tasks.workunit.client.0.smithi079.stdout:9/882: chown d3/d7/d26/d3d 788920 1 2024-09-10T09:36:13.478 INFO:tasks.workunit.client.0.smithi079.stdout:9/883: fdatasync d3/d7/dc/de/d17/d12/fa0 0 2024-09-10T09:36:13.478 INFO:tasks.workunit.client.0.smithi079.stdout:2/946: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/l134 0 2024-09-10T09:36:13.479 INFO:tasks.workunit.client.0.smithi079.stdout:0/981: truncate d4/d12/d21/d3f/f66 659086 0 2024-09-10T09:36:13.480 INFO:tasks.workunit.client.0.smithi079.stdout:5/992: symlink d2/d3/d27/d32/l13c 0 2024-09-10T09:36:13.482 INFO:tasks.workunit.client.0.smithi079.stdout:3/999: sync 2024-09-10T09:36:13.482 INFO:tasks.workunit.client.0.smithi079.stdout:7/895: sync 2024-09-10T09:36:13.482 INFO:tasks.workunit.client.0.smithi079.stdout:8/933: sync 2024-09-10T09:36:13.482 INFO:tasks.workunit.client.0.smithi079.stdout:7/896: chown d4/df/d19/c78 495 1 2024-09-10T09:36:13.486 INFO:tasks.workunit.client.0.smithi079.stdout:9/884: symlink d3/d7/dc/de/d17/l12d 0 2024-09-10T09:36:13.489 INFO:tasks.workunit.client.1.smithi135.stdout:2/55: mkdir df/d13 0 2024-09-10T09:36:13.489 INFO:tasks.workunit.client.1.smithi135.stdout:2/56: chown f8 7248 1 2024-09-10T09:36:13.496 INFO:tasks.workunit.client.0.smithi079.stdout:8/934: write d11/d2b/d4b/d7e/f11b [3211079,39801] 0 2024-09-10T09:36:13.497 INFO:tasks.workunit.client.0.smithi079.stdout:2/947: rename d4/fb to d4/dc/d1c/d86/d1b/d38/d39/f135 0 2024-09-10T09:36:13.497 INFO:tasks.workunit.client.0.smithi079.stdout:7/897: mknod d4/d6/d3e/db3/c111 0 2024-09-10T09:36:13.498 INFO:tasks.workunit.client.0.smithi079.stdout:2/948: read d4/dc/d1c/f54 [414643,108536] 0 2024-09-10T09:36:13.498 INFO:tasks.workunit.client.0.smithi079.stdout:9/885: write d3/d40/f47 [3953208,124823] 0 2024-09-10T09:36:13.498 INFO:tasks.workunit.client.0.smithi079.stdout:2/949: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/c6f 3594161 1 2024-09-10T09:36:13.499 INFO:tasks.workunit.client.1.smithi135.stdout:2/57: symlink df/d13/l14 0 2024-09-10T09:36:13.501 INFO:tasks.workunit.client.0.smithi079.stdout:4/941: mknod d1/da/d28/c12f 0 2024-09-10T09:36:13.501 INFO:tasks.workunit.client.0.smithi079.stdout:4/942: read d1/d38/da5/ff5 [15592,1573] 0 2024-09-10T09:36:13.507 INFO:tasks.workunit.client.0.smithi079.stdout:8/935: mkdir d11/d2b/d4b/d7e/d126 0 2024-09-10T09:36:13.512 INFO:tasks.workunit.client.0.smithi079.stdout:0/982: dwrite d4/d12/d21/d3f/db3/dce/f134 [0,4194304] 0 2024-09-10T09:36:13.517 INFO:tasks.workunit.client.0.smithi079.stdout:5/993: dwrite d2/d3/d5e/fd9 [0,4194304] 0 2024-09-10T09:36:13.518 INFO:tasks.workunit.client.0.smithi079.stdout:5/994: fdatasync d2/f113 0 2024-09-10T09:36:13.518 INFO:tasks.workunit.client.0.smithi079.stdout:2/950: mkdir d4/dc/d1c/d86/d1b/d38/d87/d136 0 2024-09-10T09:36:13.518 INFO:tasks.workunit.client.0.smithi079.stdout:9/886: link d3/d7/dc/de/d17/d2f/f5e d3/d7/dc/de/d17/f12e 0 2024-09-10T09:36:13.518 INFO:tasks.workunit.client.0.smithi079.stdout:8/936: creat d11/d3b/deb/f127 x:0 0 0 2024-09-10T09:36:13.519 INFO:tasks.workunit.client.0.smithi079.stdout:0/983: symlink d4/d12/d1a/d6d/d91/l145 0 2024-09-10T09:36:13.523 INFO:tasks.workunit.client.0.smithi079.stdout:9/887: symlink d3/d7/dc/de/da7/dac/l12f 0 2024-09-10T09:36:13.523 INFO:tasks.workunit.client.0.smithi079.stdout:9/888: readlink d3/d7/d26/d3d/l8e 0 2024-09-10T09:36:13.524 INFO:tasks.workunit.client.0.smithi079.stdout:2/951: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/d9f/f137 x:0 0 0 2024-09-10T09:36:13.524 INFO:tasks.workunit.client.0.smithi079.stdout:2/952: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/f108 1755 1 2024-09-10T09:36:13.525 INFO:tasks.workunit.client.0.smithi079.stdout:2/953: chown d4/dc/f14 0 1 2024-09-10T09:36:13.525 INFO:tasks.workunit.client.0.smithi079.stdout:2/954: dread - d4/f12c zero size 2024-09-10T09:36:13.525 INFO:tasks.workunit.client.0.smithi079.stdout:0/984: rmdir d4/d12/d16/de3/d102 39 2024-09-10T09:36:13.527 INFO:tasks.workunit.client.0.smithi079.stdout:8/937: rename d11/d2b/d4b/d50/cf5 to d11/d2b/d4b/d50/d55/d87/c128 0 2024-09-10T09:36:13.527 INFO:tasks.workunit.client.0.smithi079.stdout:8/938: dread - d11/dbd/ff3 zero size 2024-09-10T09:36:13.529 INFO:tasks.workunit.client.0.smithi079.stdout:2/955: truncate d4/d5d/fa1 2851883 0 2024-09-10T09:36:13.530 INFO:tasks.workunit.client.0.smithi079.stdout:2/956: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/f138 x:0 0 0 2024-09-10T09:36:13.534 INFO:tasks.workunit.client.0.smithi079.stdout:8/939: rename d11/c59 to d11/dbd/d104/c129 0 2024-09-10T09:36:13.534 INFO:tasks.workunit.client.0.smithi079.stdout:8/940: read - d11/dd8/f11c zero size 2024-09-10T09:36:13.536 INFO:tasks.workunit.client.0.smithi079.stdout:8/941: rename d11/d2b/d4b/d74/da2/f123 to d11/d91/d108/f12a 0 2024-09-10T09:36:13.538 INFO:tasks.workunit.client.0.smithi079.stdout:8/942: dread d11/d2b/d4b/da8/fb9 [0,4194304] 0 2024-09-10T09:36:13.538 INFO:tasks.workunit.client.0.smithi079.stdout:8/943: chown d11/d2b/d4b/d50/d55/d87/lb4 28650 1 2024-09-10T09:36:13.543 INFO:tasks.workunit.client.0.smithi079.stdout:7/898: dwrite d4/dc/f8f [0,4194304] 0 2024-09-10T09:36:13.543 INFO:tasks.workunit.client.1.smithi135.stdout:2/58: dwrite f6 [0,4194304] 0 2024-09-10T09:36:13.543 INFO:tasks.workunit.client.1.smithi135.stdout:2/59: chown la 68 1 2024-09-10T09:36:13.543 INFO:tasks.workunit.client.1.smithi135.stdout:2/60: chown f8 65 1 2024-09-10T09:36:13.543 INFO:tasks.workunit.client.1.smithi135.stdout:2/61: write f3 [625006,108383] 0 2024-09-10T09:36:13.545 INFO:tasks.workunit.client.0.smithi079.stdout:8/944: mknod d11/d91/c12b 0 2024-09-10T09:36:13.545 INFO:tasks.workunit.client.0.smithi079.stdout:0/985: write d4/d12/d1a/d6d/d84/f9e [659529,45091] 0 2024-09-10T09:36:13.545 INFO:tasks.workunit.client.0.smithi079.stdout:4/943: dwrite d1/da/d16/d21/d32/f98 [0,4194304] 0 2024-09-10T09:36:13.545 INFO:tasks.workunit.client.0.smithi079.stdout:0/986: fsync d4/d47/f98 0 2024-09-10T09:36:13.545 INFO:tasks.workunit.client.0.smithi079.stdout:4/944: chown d1/da/d28/d99/l9d 10 1 2024-09-10T09:36:13.548 INFO:tasks.workunit.client.0.smithi079.stdout:7/899: symlink d4/d6/d3e/l112 0 2024-09-10T09:36:13.550 INFO:tasks.workunit.client.1.smithi135.stdout:2/62: mkdir df/d15 0 2024-09-10T09:36:13.550 INFO:tasks.workunit.client.1.smithi135.stdout:2/63: creat df/f16 x:0 0 0 2024-09-10T09:36:13.550 INFO:tasks.workunit.client.1.smithi135.stdout:2/64: creat df/f17 x:0 0 0 2024-09-10T09:36:13.554 INFO:tasks.workunit.client.0.smithi079.stdout:8/945: mkdir d11/d2b/d4b/d74/da2/d12c 0 2024-09-10T09:36:13.557 INFO:tasks.workunit.client.0.smithi079.stdout:2/957: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/f27 [0,4194304] 0 2024-09-10T09:36:13.557 INFO:tasks.workunit.client.0.smithi079.stdout:2/958: dread - d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/fd9 zero size 2024-09-10T09:36:13.558 INFO:tasks.workunit.client.0.smithi079.stdout:5/995: dwrite d2/d3/d5e/d61/f6c [0,4194304] 0 2024-09-10T09:36:13.558 INFO:tasks.workunit.client.0.smithi079.stdout:5/996: getdents d2/d3/d27/d32/de3/d12d 0 2024-09-10T09:36:13.562 INFO:tasks.workunit.client.0.smithi079.stdout:8/946: write d11/d2b/d4b/da8/ff8 [4084087,125054] 0 2024-09-10T09:36:13.564 INFO:tasks.workunit.client.1.smithi135.stdout:2/65: mknod df/d13/c18 0 2024-09-10T09:36:13.564 INFO:tasks.workunit.client.1.smithi135.stdout:2/66: chown c9 3337 1 2024-09-10T09:36:13.564 INFO:tasks.workunit.client.1.smithi135.stdout:2/67: write f3 [573468,38607] 0 2024-09-10T09:36:13.566 INFO:tasks.workunit.client.0.smithi079.stdout:4/945: creat d1/da/d28/d47/da1/dcd/d106/f130 x:0 0 0 2024-09-10T09:36:13.568 INFO:tasks.workunit.client.1.smithi135.stdout:2/68: symlink df/d13/l19 0 2024-09-10T09:36:13.568 INFO:tasks.workunit.client.1.smithi135.stdout:2/69: chown df/f10 89902692 1 2024-09-10T09:36:13.570 INFO:tasks.workunit.client.0.smithi079.stdout:4/946: dread d1/da/d3b/d107/d108/db4/fc3 [0,4194304] 0 2024-09-10T09:36:13.573 INFO:tasks.workunit.client.1.smithi135.stdout:2/70: link df/f17 df/d15/f1a 0 2024-09-10T09:36:13.573 INFO:tasks.workunit.client.1.smithi135.stdout:2/71: read f3 [2676128,122059] 0 2024-09-10T09:36:13.577 INFO:tasks.workunit.client.0.smithi079.stdout:0/987: dwrite d4/d1d/f140 [0,4194304] 0 2024-09-10T09:36:13.577 INFO:tasks.workunit.client.0.smithi079.stdout:8/947: write d11/d2b/d4b/d50/d9e/fed [3871809,73207] 0 2024-09-10T09:36:13.577 INFO:tasks.workunit.client.0.smithi079.stdout:7/900: dwrite d4/d6/d4f/d70/db6/dca/fef [0,4194304] 0 2024-09-10T09:36:13.577 INFO:tasks.workunit.client.0.smithi079.stdout:7/901: dread - d4/df/d6b/d9a/dde/d10e/fcd zero size 2024-09-10T09:36:13.583 INFO:tasks.workunit.client.0.smithi079.stdout:2/959: rename d4/dc/d1c/d86/d1b/d38/d87/c125 to d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/c139 0 2024-09-10T09:36:13.586 INFO:tasks.workunit.client.0.smithi079.stdout:5/997: symlink d2/d3/d27/d70/d80/d94/l13d 0 2024-09-10T09:36:13.587 INFO:tasks.workunit.client.0.smithi079.stdout:2/960: dread d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f7d [0,4194304] 0 2024-09-10T09:36:13.588 INFO:tasks.workunit.client.0.smithi079.stdout:4/947: link d1/da/d16/d88/d10b/f12b d1/da/d16/d4d/d122/f131 0 2024-09-10T09:36:13.588 INFO:tasks.workunit.client.0.smithi079.stdout:7/902: dread d4/df/d3d/f41 [0,4194304] 0 2024-09-10T09:36:13.588 INFO:tasks.workunit.client.0.smithi079.stdout:7/903: chown d4/df/d6b/d9a/lae 0 1 2024-09-10T09:36:13.588 INFO:tasks.workunit.client.1.smithi135.stdout:2/72: getdents df 0 2024-09-10T09:36:13.591 INFO:tasks.workunit.client.0.smithi079.stdout:0/988: creat d4/d12/d8b/dca/f146 x:0 0 0 2024-09-10T09:36:13.592 INFO:tasks.workunit.client.0.smithi079.stdout:0/989: write d4/d1d/d24/ff2 [761370,107710] 0 2024-09-10T09:36:13.592 INFO:tasks.workunit.client.0.smithi079.stdout:8/948: mkdir d11/d2b/d4b/d50/d9e/d12d 0 2024-09-10T09:36:13.598 INFO:tasks.workunit.client.0.smithi079.stdout:5/998: symlink d2/d3/d5e/d73/l13e 0 2024-09-10T09:36:13.598 INFO:tasks.workunit.client.0.smithi079.stdout:5/999: getdents d2/d3/d27/d32/d39/d11c 0 2024-09-10T09:36:13.598 INFO:tasks.workunit.client.1.smithi135.stdout:2/73: write f8 [3225951,125697] 0 2024-09-10T09:36:13.600 INFO:tasks.workunit.client.0.smithi079.stdout:2/961: link d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/fd9 d4/dc/d1c/d86/d1b/d38/d39/d99/f13a 0 2024-09-10T09:36:13.600 INFO:tasks.workunit.client.0.smithi079.stdout:2/962: dread - d4/dc/d1c/d86/d1b/d38/d39/d31/d52/fd4 zero size 2024-09-10T09:36:13.600 INFO:tasks.workunit.client.0.smithi079.stdout:2/963: dread - d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/f138 zero size 2024-09-10T09:36:13.600 INFO:tasks.workunit.client.1.smithi135.stdout:2/74: mkdir df/d1b 0 2024-09-10T09:36:13.601 INFO:tasks.workunit.client.0.smithi079.stdout:4/948: dwrite d1/da/d28/d99/f126 [0,4194304] 0 2024-09-10T09:36:13.601 INFO:tasks.workunit.client.0.smithi079.stdout:4/949: readlink d1/da/lb6 0 2024-09-10T09:36:13.602 INFO:tasks.workunit.client.0.smithi079.stdout:7/904: symlink d4/d6/da9/l113 0 2024-09-10T09:36:13.604 INFO:tasks.workunit.client.0.smithi079.stdout:0/990: rename d4/d12/d16/d53/d6a/lfe to d4/d12/d21/d3f/l147 0 2024-09-10T09:36:13.604 INFO:tasks.workunit.client.0.smithi079.stdout:0/991: fsync d4/d12/d1a/fd0 0 2024-09-10T09:36:13.604 INFO:tasks.workunit.client.1.smithi135.stdout:2/75: creat df/d1b/f1c x:0 0 0 2024-09-10T09:36:13.604 INFO:tasks.workunit.client.0.smithi079.stdout:0/992: creat d4/d12/d21/d3f/db3/f148 x:0 0 0 2024-09-10T09:36:13.605 INFO:tasks.workunit.client.0.smithi079.stdout:0/993: dread - d4/d12/d8b/dca/d32/f10c zero size 2024-09-10T09:36:13.606 INFO:tasks.workunit.client.0.smithi079.stdout:0/994: dread d4/d1d/fad [0,4194304] 0 2024-09-10T09:36:13.607 INFO:tasks.workunit.client.0.smithi079.stdout:0/995: fsync d4/f81 0 2024-09-10T09:36:13.607 INFO:tasks.workunit.client.0.smithi079.stdout:8/949: symlink d11/dd8/l12e 0 2024-09-10T09:36:13.607 INFO:tasks.workunit.client.0.smithi079.stdout:8/950: fdatasync d11/d2b/d4b/d7e/db2/f10b 0 2024-09-10T09:36:13.609 INFO:tasks.workunit.client.0.smithi079.stdout:2/964: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/db7/f13b x:0 0 0 2024-09-10T09:36:13.617 INFO:tasks.workunit.client.0.smithi079.stdout:0/996: link d4/d12/d16/de3/fd9 d4/d12/dde/d12e/d106/d139/f149 0 2024-09-10T09:36:13.619 INFO:tasks.workunit.client.0.smithi079.stdout:8/951: dread - d11/d2b/f2d zero size 2024-09-10T09:36:13.622 INFO:tasks.workunit.client.0.smithi079.stdout:2/965: unlink d4/dc/d1c/d86/d1b/d38/d39/la8 0 2024-09-10T09:36:13.625 INFO:tasks.workunit.client.0.smithi079.stdout:8/952: creat d11/d2b/d4b/d50/d9e/dca/dd0/df0/f12f x:0 0 0 2024-09-10T09:36:13.625 INFO:tasks.workunit.client.0.smithi079.stdout:8/953: fdatasync d11/d2b/f2d 0 2024-09-10T09:36:13.625 INFO:tasks.workunit.client.0.smithi079.stdout:8/954: write d11/d2b/d4b/d74/f83 [2427128,92591] 0 2024-09-10T09:36:13.627 INFO:tasks.workunit.client.0.smithi079.stdout:2/966: symlink d4/dc/l13c 0 2024-09-10T09:36:13.627 INFO:tasks.workunit.client.0.smithi079.stdout:9/889: sync 2024-09-10T09:36:13.628 INFO:tasks.workunit.client.0.smithi079.stdout:8/955: mkdir d11/d2b/d4b/d7e/db2/db7/d130 0 2024-09-10T09:36:13.629 INFO:tasks.workunit.client.0.smithi079.stdout:8/956: symlink d11/dbd/l131 0 2024-09-10T09:36:13.629 INFO:tasks.workunit.client.0.smithi079.stdout:8/957: write d11/d2b/d4b/f56 [952008,128201] 0 2024-09-10T09:36:13.629 INFO:tasks.workunit.client.0.smithi079.stdout:9/890: mkdir d3/d7/d130 0 2024-09-10T09:36:13.631 INFO:tasks.workunit.client.0.smithi079.stdout:8/958: unlink d11/d2b/f75 0 2024-09-10T09:36:13.640 INFO:tasks.workunit.client.0.smithi079.stdout:2/967: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/f10f [2683930,6333] 0 2024-09-10T09:36:13.640 INFO:tasks.workunit.client.1.smithi135.stdout:2/76: dwrite df/f17 [0,4194304] 0 2024-09-10T09:36:13.642 INFO:tasks.workunit.client.0.smithi079.stdout:9/891: dread d3/d7/dc/de/d17/f12e [0,4194304] 0 2024-09-10T09:36:13.644 INFO:tasks.workunit.client.0.smithi079.stdout:4/950: dwrite d1/da/d16/d88/fe1 [0,4194304] 0 2024-09-10T09:36:13.644 INFO:tasks.workunit.client.0.smithi079.stdout:4/951: fdatasync d1/da/d16/d57/ff4 0 2024-09-10T09:36:13.644 INFO:tasks.workunit.client.0.smithi079.stdout:4/952: chown d1/da/d3b/d5f/c69 0 1 2024-09-10T09:36:13.644 INFO:tasks.workunit.client.0.smithi079.stdout:4/953: stat d1/da/d16/d21/d32/l92 0 2024-09-10T09:36:13.645 INFO:tasks.workunit.client.0.smithi079.stdout:7/905: dwrite d4/d6/d4f/d70/db6/fd2 [0,4194304] 0 2024-09-10T09:36:13.649 INFO:tasks.workunit.client.0.smithi079.stdout:8/959: dwrite d11/d2b/d4b/d50/d5c/f125 [0,4194304] 0 2024-09-10T09:36:13.649 INFO:tasks.workunit.client.0.smithi079.stdout:8/960: fdatasync d11/d2b/d4b/d7e/f11b 0 2024-09-10T09:36:13.649 INFO:tasks.workunit.client.0.smithi079.stdout:8/961: fsync d11/d3b/f3d 0 2024-09-10T09:36:13.649 INFO:tasks.workunit.client.0.smithi079.stdout:8/962: write d11/d2b/d4b/d50/f89 [3319644,46494] 0 2024-09-10T09:36:13.650 INFO:tasks.workunit.client.0.smithi079.stdout:7/906: creat d4/d6/d38/df8/f114 x:0 0 0 2024-09-10T09:36:13.652 INFO:tasks.workunit.client.0.smithi079.stdout:4/954: link d1/da/d16/c65 d1/da/d28/c132 0 2024-09-10T09:36:13.657 INFO:tasks.workunit.client.0.smithi079.stdout:9/892: write d3/d7/d26/f8f [3325444,16592] 0 2024-09-10T09:36:13.658 INFO:tasks.workunit.client.0.smithi079.stdout:7/907: symlink d4/df/d6b/d9a/dde/d10e/l115 0 2024-09-10T09:36:13.658 INFO:tasks.workunit.client.0.smithi079.stdout:7/908: creat d4/d6/d4f/d66/f116 x:0 0 0 2024-09-10T09:36:13.659 INFO:tasks.workunit.client.1.smithi135.stdout:2/77: dread f8 [0,4194304] 0 2024-09-10T09:36:13.660 INFO:tasks.workunit.client.0.smithi079.stdout:8/963: mkdir d11/d2b/d4b/d50/d55/d87/d132 0 2024-09-10T09:36:13.660 INFO:tasks.workunit.client.0.smithi079.stdout:8/964: fsync d11/d2b/d4b/d50/d5c/f71 0 2024-09-10T09:36:13.660 INFO:tasks.workunit.client.0.smithi079.stdout:8/965: truncate d11/d2b/d4b/d74/f86 1837041 0 2024-09-10T09:36:13.664 INFO:tasks.workunit.client.0.smithi079.stdout:2/968: dwrite d4/d8f/fb5 [0,4194304] 0 2024-09-10T09:36:13.667 INFO:tasks.workunit.client.0.smithi079.stdout:8/966: symlink d11/d2b/d4b/d50/d9e/l133 0 2024-09-10T09:36:13.667 INFO:tasks.workunit.client.0.smithi079.stdout:8/967: write d11/dbd/ff3 [916911,84982] 0 2024-09-10T09:36:13.671 INFO:tasks.workunit.client.1.smithi135.stdout:2/78: dread df/f17 [0,4194304] 0 2024-09-10T09:36:13.676 INFO:tasks.workunit.client.0.smithi079.stdout:7/909: rename d4/d6/d4f/d70/db6 to d4/d6/d38/dc1/df9/d117 0 2024-09-10T09:36:13.678 INFO:tasks.workunit.client.0.smithi079.stdout:4/955: dwrite d1/da/d3b/de0/f110 [0,4194304] 0 2024-09-10T09:36:13.678 INFO:tasks.workunit.client.0.smithi079.stdout:8/968: rename d11/d2b/d4b/d7e/f11b to d11/d91/d110/f134 0 2024-09-10T09:36:13.679 INFO:tasks.workunit.client.0.smithi079.stdout:8/969: fsync d11/d2b/d4b/d74/da2/fba 0 2024-09-10T09:36:13.681 INFO:tasks.workunit.client.0.smithi079.stdout:8/970: getdents d11/d2b/d4b/d50/d5c/d118 0 2024-09-10T09:36:13.682 INFO:tasks.workunit.client.0.smithi079.stdout:8/971: truncate d11/d2b/d4b/d50/d5c/f6e 34473 0 2024-09-10T09:36:13.684 INFO:tasks.workunit.client.0.smithi079.stdout:7/910: write d4/d6/d38/dc1/df9/d117/dca/fc8 [3921173,121057] 0 2024-09-10T09:36:13.685 INFO:tasks.workunit.client.0.smithi079.stdout:8/972: mkdir d11/d3b/deb/d135 0 2024-09-10T09:36:13.688 INFO:tasks.workunit.client.0.smithi079.stdout:9/893: dwrite d3/d7/dc/de/d17/d2f/f11b [0,4194304] 0 2024-09-10T09:36:13.689 INFO:tasks.workunit.client.0.smithi079.stdout:2/969: dwrite d4/d8f/fad [4194304,4194304] 0 2024-09-10T09:36:13.691 INFO:tasks.workunit.client.0.smithi079.stdout:7/911: rename d4/df/d3d/f65 to d4/d6/d38/dc1/f118 0 2024-09-10T09:36:13.692 INFO:tasks.workunit.client.0.smithi079.stdout:8/973: getdents d11/d91/d110/d111 0 2024-09-10T09:36:13.696 INFO:tasks.workunit.client.0.smithi079.stdout:9/894: mkdir d3/d7/dc/de/d17/d4c/d131 0 2024-09-10T09:36:13.696 INFO:tasks.workunit.client.0.smithi079.stdout:9/895: chown d3/df6 489 1 2024-09-10T09:36:13.698 INFO:tasks.workunit.client.0.smithi079.stdout:4/956: dwrite d1/da/d16/f1f [0,4194304] 0 2024-09-10T09:36:13.698 INFO:tasks.workunit.client.0.smithi079.stdout:2/970: getdents d4/dc/d1c/d86/d1b/d38/d39/d31/d49 0 2024-09-10T09:36:13.698 INFO:tasks.workunit.client.0.smithi079.stdout:2/971: fsync d4/dc/d1c/d86/d1b/d38/d39/d31/d52/f5a 0 2024-09-10T09:36:13.701 INFO:tasks.workunit.client.0.smithi079.stdout:9/896: truncate d3/d7/dc/d7a/da9/f23 5476498 0 2024-09-10T09:36:13.701 INFO:tasks.workunit.client.0.smithi079.stdout:9/897: readlink d3/d7/dc/de/d17/dcf/lab 0 2024-09-10T09:36:13.705 INFO:tasks.workunit.client.0.smithi079.stdout:8/974: write d11/d2b/d4b/d50/d55/fa6 [1931966,91788] 0 2024-09-10T09:36:13.708 INFO:tasks.workunit.client.0.smithi079.stdout:4/957: creat d1/da/d16/d88/f133 x:0 0 0 2024-09-10T09:36:13.708 INFO:tasks.workunit.client.0.smithi079.stdout:4/958: fsync d1/da/d28/fe7 0 2024-09-10T09:36:13.710 INFO:tasks.workunit.client.0.smithi079.stdout:9/898: mkdir d3/d7/d130/d132 0 2024-09-10T09:36:13.714 INFO:tasks.workunit.client.0.smithi079.stdout:4/959: creat d1/da/d3b/d107/d108/db4/f134 x:0 0 0 2024-09-10T09:36:13.715 INFO:tasks.workunit.client.0.smithi079.stdout:7/912: dwrite d4/dc/d43/dab/fd3 [0,4194304] 0 2024-09-10T09:36:13.717 INFO:tasks.workunit.client.0.smithi079.stdout:4/960: link d1/l37 d1/da/l135 0 2024-09-10T09:36:13.717 INFO:tasks.workunit.client.0.smithi079.stdout:8/975: dread d11/dbd/fde [0,4194304] 0 2024-09-10T09:36:13.720 INFO:tasks.workunit.client.0.smithi079.stdout:2/972: dwrite d4/dc/d1c/f100 [0,4194304] 0 2024-09-10T09:36:13.720 INFO:tasks.workunit.client.0.smithi079.stdout:2/973: creat d4/dc/d1c/d86/d1b/d38/d39/d31/d52/f13d x:0 0 0 2024-09-10T09:36:13.720 INFO:tasks.workunit.client.0.smithi079.stdout:4/961: dread d1/da/d16/d88/d10b/f11c [0,4194304] 0 2024-09-10T09:36:13.721 INFO:tasks.workunit.client.1.smithi135.stdout:2/79: dwrite f3 [4194304,4194304] 0 2024-09-10T09:36:13.721 INFO:tasks.workunit.client.1.smithi135.stdout:2/80: write df/f16 [262029,75749] 0 2024-09-10T09:36:13.724 INFO:tasks.workunit.client.0.smithi079.stdout:7/913: mknod d4/d6/d38/dc1/df9/d117/dca/c119 0 2024-09-10T09:36:13.725 INFO:tasks.workunit.client.1.smithi135.stdout:2/81: creat df/d13/f1d x:0 0 0 2024-09-10T09:36:13.729 INFO:tasks.workunit.client.1.smithi135.stdout:2/82: fdatasync df/f16 0 2024-09-10T09:36:13.730 INFO:tasks.workunit.client.0.smithi079.stdout:9/899: dwrite d3/d7/dc/de/d17/d2f/d74/fa3 [0,4194304] 0 2024-09-10T09:36:13.730 INFO:tasks.workunit.client.0.smithi079.stdout:9/900: creat d3/f133 x:0 0 0 2024-09-10T09:36:13.731 INFO:tasks.workunit.client.0.smithi079.stdout:8/976: write d11/f88 [4085094,49960] 0 2024-09-10T09:36:13.732 INFO:tasks.workunit.client.0.smithi079.stdout:8/977: fsync d11/d2b/d4b/f93 0 2024-09-10T09:36:13.735 INFO:tasks.workunit.client.0.smithi079.stdout:2/974: mkdir d4/d13e 0 2024-09-10T09:36:13.740 INFO:tasks.workunit.client.0.smithi079.stdout:7/914: link d4/df/d19/db9/ff4 d4/d6/d38/dc1/df9/d117/dca/f11a 0 2024-09-10T09:36:13.742 INFO:tasks.workunit.client.0.smithi079.stdout:0/997: sync 2024-09-10T09:36:13.746 INFO:tasks.workunit.client.0.smithi079.stdout:9/901: creat d3/d7/d70/f134 x:0 0 0 2024-09-10T09:36:13.746 INFO:tasks.workunit.client.0.smithi079.stdout:9/902: fdatasync d3/d7/d26/f4d 0 2024-09-10T09:36:13.749 INFO:tasks.workunit.client.0.smithi079.stdout:8/978: truncate d11/d2b/f3f 7359280 0 2024-09-10T09:36:13.749 INFO:tasks.workunit.client.0.smithi079.stdout:8/979: chown d11/d91/d110/d111/l117 117211625 1 2024-09-10T09:36:13.752 INFO:tasks.workunit.client.0.smithi079.stdout:4/962: rmdir d1/da/d16/d88 39 2024-09-10T09:36:13.753 INFO:tasks.workunit.client.0.smithi079.stdout:7/915: rmdir d4/d6 39 2024-09-10T09:36:13.753 INFO:tasks.workunit.client.0.smithi079.stdout:7/916: chown d4/df/d3d/d82/fdd 475 1 2024-09-10T09:36:13.755 INFO:tasks.workunit.client.0.smithi079.stdout:0/998: getdents d4/d12 0 2024-09-10T09:36:13.756 INFO:tasks.workunit.client.0.smithi079.stdout:9/903: truncate d3/d7/d70/f71 3627194 0 2024-09-10T09:36:13.757 INFO:tasks.workunit.client.0.smithi079.stdout:8/980: creat d11/d91/f136 x:0 0 0 2024-09-10T09:36:13.758 INFO:tasks.workunit.client.0.smithi079.stdout:4/963: creat d1/d38/da5/dde/f136 x:0 0 0 2024-09-10T09:36:13.758 INFO:tasks.workunit.client.0.smithi079.stdout:7/917: dread d4/d6/d38/f54 [0,4194304] 0 2024-09-10T09:36:13.759 INFO:tasks.workunit.client.0.smithi079.stdout:0/999: symlink d4/d12/d15/d6b/l14a 0 2024-09-10T09:36:13.759 INFO:tasks.workunit.client.1.smithi135.stdout:2/83: dwrite df/f17 [0,4194304] 0 2024-09-10T09:36:13.761 INFO:tasks.workunit.client.0.smithi079.stdout:9/904: unlink d3/d7/d70/f134 0 2024-09-10T09:36:13.762 INFO:tasks.workunit.client.0.smithi079.stdout:2/975: dwrite d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/da6/f84 [0,4194304] 0 2024-09-10T09:36:13.762 INFO:tasks.workunit.client.0.smithi079.stdout:2/976: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d77/d7e/dca/f108 [1390895,99042] 0 2024-09-10T09:36:13.762 INFO:tasks.workunit.client.0.smithi079.stdout:8/981: truncate d11/d3b/f122 919170 0 2024-09-10T09:36:13.764 INFO:tasks.workunit.client.0.smithi079.stdout:7/918: mknod d4/df/d3d/d75/c11b 0 2024-09-10T09:36:13.766 INFO:tasks.workunit.client.0.smithi079.stdout:9/905: rename d3/d7/dc/d7a/da9/f45 to d3/d7/d70/dbc/f135 0 2024-09-10T09:36:13.769 INFO:tasks.workunit.client.0.smithi079.stdout:2/977: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/l13f 0 2024-09-10T09:36:13.772 INFO:tasks.workunit.client.1.smithi135.stdout:2/84: dread f3 [4194304,4194304] 0 2024-09-10T09:36:13.776 INFO:tasks.workunit.client.0.smithi079.stdout:4/964: rmdir d1/da/d16 39 2024-09-10T09:36:13.776 INFO:tasks.workunit.client.0.smithi079.stdout:4/965: write d1/da/d3b/d5a/f63 [1115375,127274] 0 2024-09-10T09:36:13.778 INFO:tasks.workunit.client.0.smithi079.stdout:9/906: mknod d3/d7/d26/c136 0 2024-09-10T09:36:13.778 INFO:tasks.workunit.client.0.smithi079.stdout:7/919: write d4/d6/d3e/f7a [3881003,110282] 0 2024-09-10T09:36:13.779 INFO:tasks.workunit.client.0.smithi079.stdout:2/978: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d92/l140 0 2024-09-10T09:36:13.781 INFO:tasks.workunit.client.0.smithi079.stdout:7/920: symlink d4/df/d6b/d9a/dde/d10e/l11c 0 2024-09-10T09:36:13.783 INFO:tasks.workunit.client.0.smithi079.stdout:4/966: dread d1/da/d16/fcb [4194304,4194304] 0 2024-09-10T09:36:13.783 INFO:tasks.workunit.client.0.smithi079.stdout:2/979: link d4/dc/d1c/d86/d1b/d38/d87/f9e d4/dc/d1c/d86/d1b/d38/d39/f141 0 2024-09-10T09:36:13.783 INFO:tasks.workunit.client.0.smithi079.stdout:2/980: chown d4/dc/d1c/d86/d1b/c32 1602896 1 2024-09-10T09:36:13.783 INFO:tasks.workunit.client.0.smithi079.stdout:2/981: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/fea [750794,111843] 0 2024-09-10T09:36:13.783 INFO:tasks.workunit.client.0.smithi079.stdout:8/982: dread d11/d91/fc6 [0,4194304] 0 2024-09-10T09:36:13.784 INFO:tasks.workunit.client.0.smithi079.stdout:7/921: symlink d4/d6/da9/l11d 0 2024-09-10T09:36:13.784 INFO:tasks.workunit.client.0.smithi079.stdout:7/922: fsync d4/d6/d4f/d66/f116 0 2024-09-10T09:36:13.787 INFO:tasks.workunit.client.0.smithi079.stdout:4/967: symlink d1/da/d28/d47/da1/d83/l137 0 2024-09-10T09:36:13.789 INFO:tasks.workunit.client.0.smithi079.stdout:2/982: mknod d4/dc/d1c/c142 0 2024-09-10T09:36:13.789 INFO:tasks.workunit.client.0.smithi079.stdout:2/983: creat d4/f143 x:0 0 0 2024-09-10T09:36:13.789 INFO:tasks.workunit.client.0.smithi079.stdout:7/923: creat d4/d6/f11e x:0 0 0 2024-09-10T09:36:13.792 INFO:tasks.workunit.client.0.smithi079.stdout:4/968: unlink d1/da/d28/d99/la0 0 2024-09-10T09:36:13.792 INFO:tasks.workunit.client.0.smithi079.stdout:4/969: chown d1/da/c1b 70 1 2024-09-10T09:36:13.793 INFO:tasks.workunit.client.0.smithi079.stdout:2/984: rmdir d4/dc/d1c/d86 39 2024-09-10T09:36:13.796 INFO:tasks.workunit.client.0.smithi079.stdout:7/924: rmdir d4/d6/d38/dc1/df9/d117 39 2024-09-10T09:36:13.797 INFO:tasks.workunit.client.0.smithi079.stdout:7/925: truncate d4/d6/d4f/d66/f116 597166 0 2024-09-10T09:36:13.799 INFO:tasks.workunit.client.0.smithi079.stdout:4/970: link d1/da/d28/d47/da1/d83/dfe/l11d d1/d38/d12c/l138 0 2024-09-10T09:36:13.799 INFO:tasks.workunit.client.0.smithi079.stdout:4/971: readlink d1/da/d16/ld5 0 2024-09-10T09:36:13.799 INFO:tasks.workunit.client.0.smithi079.stdout:4/972: write d1/d38/da5/fee [225912,509] 0 2024-09-10T09:36:13.799 INFO:tasks.workunit.client.0.smithi079.stdout:9/907: dwrite d3/d7/d26/d83/fd6 [0,4194304] 0 2024-09-10T09:36:13.800 INFO:tasks.workunit.client.0.smithi079.stdout:2/985: mknod d4/dc/d1c/d86/d1b/d38/d39/d99/c144 0 2024-09-10T09:36:13.802 INFO:tasks.workunit.client.0.smithi079.stdout:7/926: rename d4/d6/d38/dc1/df9/d117/dca/fe4 to d4/d6/d38/f11f 0 2024-09-10T09:36:13.802 INFO:tasks.workunit.client.0.smithi079.stdout:7/927: truncate d4/df/d19/db9/fe1 672014 0 2024-09-10T09:36:13.804 INFO:tasks.workunit.client.0.smithi079.stdout:9/908: mkdir d3/d7/dc/de/db7/d137 0 2024-09-10T09:36:13.805 INFO:tasks.workunit.client.0.smithi079.stdout:2/986: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/db0/l145 0 2024-09-10T09:36:13.808 INFO:tasks.workunit.client.1.smithi135.stdout:2/85: dwrite df/f16 [0,4194304] 0 2024-09-10T09:36:13.808 INFO:tasks.workunit.client.1.smithi135.stdout:2/86: truncate df/f16 4385698 0 2024-09-10T09:36:13.808 INFO:tasks.workunit.client.0.smithi079.stdout:4/973: link d1/da/d28/l39 d1/d38/d12c/l139 0 2024-09-10T09:36:13.808 INFO:tasks.workunit.client.0.smithi079.stdout:4/974: dread - d1/da/d3b/d107/d108/db4/f134 zero size 2024-09-10T09:36:13.810 INFO:tasks.workunit.client.0.smithi079.stdout:8/983: dwrite d11/f31 [0,4194304] 0 2024-09-10T09:36:13.810 INFO:tasks.workunit.client.0.smithi079.stdout:8/984: dread - d11/dbd/f10c zero size 2024-09-10T09:36:13.811 INFO:tasks.workunit.client.0.smithi079.stdout:7/928: dread d4/df/f9f [0,4194304] 0 2024-09-10T09:36:13.814 INFO:tasks.workunit.client.1.smithi135.stdout:2/87: symlink df/d1b/l1e 0 2024-09-10T09:36:13.817 INFO:tasks.workunit.client.0.smithi079.stdout:2/987: rmdir d4/d8f 39 2024-09-10T09:36:13.817 INFO:tasks.workunit.client.0.smithi079.stdout:2/988: truncate d4/dc/d1c/d86/d1b/d38/d39/d31/d52/f121 902925 0 2024-09-10T09:36:13.820 INFO:tasks.workunit.client.1.smithi135.stdout:2/88: link la df/d15/l1f 0 2024-09-10T09:36:13.828 INFO:tasks.workunit.client.0.smithi079.stdout:9/909: dwrite d3/d7/dc/f95 [0,4194304] 0 2024-09-10T09:36:13.828 INFO:tasks.workunit.client.0.smithi079.stdout:9/910: dread - d3/d7/dc/de/d17/d2f/d74/f115 zero size 2024-09-10T09:36:13.829 INFO:tasks.workunit.client.0.smithi079.stdout:2/989: dread d4/d5d/fa3 [0,4194304] 0 2024-09-10T09:36:13.831 INFO:tasks.workunit.client.0.smithi079.stdout:4/975: rename d1/d38/d12c to d1/da/d28/d95/d13a 0 2024-09-10T09:36:13.832 INFO:tasks.workunit.client.0.smithi079.stdout:9/911: symlink d3/d7/d70/dbc/l138 0 2024-09-10T09:36:13.832 INFO:tasks.workunit.client.0.smithi079.stdout:9/912: write d3/d7/d5a/f65 [219205,6618] 0 2024-09-10T09:36:13.832 INFO:tasks.workunit.client.0.smithi079.stdout:9/913: write d3/d7/dc/de/da7/fc8 [841364,105257] 0 2024-09-10T09:36:13.835 INFO:tasks.workunit.client.0.smithi079.stdout:9/914: dread d3/d7/fcd [4194304,4194304] 0 2024-09-10T09:36:13.835 INFO:tasks.workunit.client.0.smithi079.stdout:9/915: getdents d3/d7/dc/def 0 2024-09-10T09:36:13.835 INFO:tasks.workunit.client.0.smithi079.stdout:9/916: readlink d3/d7/dc/de/d17/d2f/d98/ld9 0 2024-09-10T09:36:13.835 INFO:tasks.workunit.client.0.smithi079.stdout:2/990: symlink d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/l146 0 2024-09-10T09:36:13.835 INFO:tasks.workunit.client.0.smithi079.stdout:2/991: creat d4/dc/d1c/f147 x:0 0 0 2024-09-10T09:36:13.835 INFO:tasks.workunit.client.0.smithi079.stdout:2/992: creat d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d62/d74/f148 x:0 0 0 2024-09-10T09:36:13.835 INFO:tasks.workunit.client.0.smithi079.stdout:2/993: chown d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/dde/d123 1349 1 2024-09-10T09:36:13.836 INFO:tasks.workunit.client.0.smithi079.stdout:7/929: dwrite d4/df/d3d/f79 [0,4194304] 0 2024-09-10T09:36:13.836 INFO:tasks.workunit.client.0.smithi079.stdout:7/930: creat d4/df/d6b/d9a/dde/f120 x:0 0 0 2024-09-10T09:36:13.836 INFO:tasks.workunit.client.0.smithi079.stdout:7/931: fsync d4/d6/d4f/d70/fda 0 2024-09-10T09:36:13.836 INFO:tasks.workunit.client.0.smithi079.stdout:7/932: chown d4/df/d3d/d82/cf0 2734 1 2024-09-10T09:36:13.836 INFO:tasks.workunit.client.0.smithi079.stdout:4/976: getdents d1/da/d3b 0 2024-09-10T09:36:13.840 INFO:tasks.workunit.client.1.smithi135.stdout:2/89: getdents df/d15 0 2024-09-10T09:36:13.841 INFO:tasks.workunit.client.0.smithi079.stdout:9/917: mknod d3/d7/dc/de/da7/df1/d100/c139 0 2024-09-10T09:36:13.845 INFO:tasks.workunit.client.1.smithi135.stdout:2/90: getdents df/d1b 0 2024-09-10T09:36:13.845 INFO:tasks.workunit.client.1.smithi135.stdout:2/91: write df/d1b/f1c [531280,13537] 0 2024-09-10T09:36:13.845 INFO:tasks.workunit.client.1.smithi135.stdout:2/92: write df/d13/f1d [378106,106780] 0 2024-09-10T09:36:13.845 INFO:tasks.workunit.client.1.smithi135.stdout:2/93: write df/d1b/f1c [126635,34647] 0 2024-09-10T09:36:13.848 INFO:tasks.workunit.client.0.smithi079.stdout:2/994: dread d4/dc/f70 [0,4194304] 0 2024-09-10T09:36:13.848 INFO:tasks.workunit.client.0.smithi079.stdout:2/995: stat d4/dc/d1c/d86/d1b/c4d 0 2024-09-10T09:36:13.848 INFO:tasks.workunit.client.0.smithi079.stdout:2/996: stat d4/la 0 2024-09-10T09:36:13.851 INFO:tasks.workunit.client.0.smithi079.stdout:8/985: dwrite d11/d3b/deb/f127 [0,4194304] 0 2024-09-10T09:36:13.851 INFO:tasks.workunit.client.0.smithi079.stdout:8/986: read d11/d2b/f4e [422780,63678] 0 2024-09-10T09:36:13.852 INFO:tasks.workunit.client.0.smithi079.stdout:4/977: getdents d1/d38/da5 0 2024-09-10T09:36:13.852 INFO:tasks.workunit.client.0.smithi079.stdout:4/978: write d1/da/d16/d88/d10b/f12b [868717,89660] 0 2024-09-10T09:36:13.852 INFO:tasks.workunit.client.0.smithi079.stdout:4/979: chown d1/da/l105 1665 1 2024-09-10T09:36:13.852 INFO:tasks.workunit.client.0.smithi079.stdout:4/980: creat d1/da/d3b/de0/f13b x:0 0 0 2024-09-10T09:36:13.852 INFO:tasks.workunit.client.0.smithi079.stdout:4/981: chown d1/d38/da5/fee 13 1 2024-09-10T09:36:13.855 INFO:tasks.workunit.client.0.smithi079.stdout:2/997: mknod d4/dc/d1c/d86/d1b/d38/d39/d99/d61/d65/d7c/d112/c149 0 2024-09-10T09:36:13.855 INFO:tasks.workunit.client.0.smithi079.stdout:2/998: write d4/dc/d1c/d86/d1b/d38/d39/d99/d61/ff7 [569437,46634] 0 2024-09-10T09:36:13.859 INFO:tasks.workunit.client.0.smithi079.stdout:9/918: dwrite d3/d7/dc/de/d17/d2f/d98/da1/faf [0,4194304] 0 2024-09-10T09:36:13.861 INFO:tasks.workunit.client.1.smithi135.stdout:2/94: truncate df/f17 2391120 0 2024-09-10T09:36:13.861 INFO:tasks.workunit.client.1.smithi135.stdout:2/95: write df/f12 [580465,75529] 0 2024-09-10T09:36:13.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/96: symlink df/d15/l20 0 2024-09-10T09:36:13.863 INFO:tasks.workunit.client.1.smithi135.stdout:2/97: write df/f12 [1522459,69931] 0 2024-09-10T09:36:13.864 INFO:tasks.workunit.client.0.smithi079.stdout:8/987: creat d11/d2b/d4b/d50/d9e/dca/dd0/f137 x:0 0 0 2024-09-10T09:36:13.866 INFO:tasks.workunit.client.0.smithi079.stdout:4/982: link d1/da/d3b/d107/d108/cd6 d1/da/d3b/de0/c13c 0 2024-09-10T09:36:13.867 INFO:tasks.workunit.client.0.smithi079.stdout:2/999: symlink d4/dc/d1c/d86/d1b/l14a 0 2024-09-10T09:36:13.871 INFO:tasks.workunit.client.0.smithi079.stdout:9/919: rename d3/d7/dc/de/db7/d137 to d3/d7/d5a/d13a 0 2024-09-10T09:36:13.872 INFO:tasks.workunit.client.0.smithi079.stdout:8/988: link d11/d91/d108/lea d11/d2b/d4b/d50/d5c/d118/d11a/l138 0 2024-09-10T09:36:13.872 INFO:tasks.workunit.client.0.smithi079.stdout:8/989: chown d11/dbd/d104 1509220 1 2024-09-10T09:36:13.874 INFO:tasks.workunit.client.0.smithi079.stdout:9/920: mkdir d3/d7/d26/d3d/d13b 0 2024-09-10T09:36:13.881 INFO:tasks.workunit.client.0.smithi079.stdout:4/983: rmdir d1/da/d3b/de0 39 2024-09-10T09:36:13.882 INFO:tasks.workunit.client.0.smithi079.stdout:4/984: rmdir d1/da/d28/d47/da1/d83/dfe 39 2024-09-10T09:36:13.883 INFO:tasks.workunit.client.0.smithi079.stdout:4/985: truncate d1/da/d16/d21/f25 639035 0 2024-09-10T09:36:13.885 INFO:tasks.workunit.client.0.smithi079.stdout:4/986: creat d1/da/d28/d95/f13d x:0 0 0 2024-09-10T09:36:13.887 INFO:tasks.workunit.client.0.smithi079.stdout:4/987: link d1/d38/cff d1/c13e 0 2024-09-10T09:36:13.887 INFO:tasks.workunit.client.0.smithi079.stdout:4/988: creat d1/da/d3b/d107/d108/db4/f13f x:0 0 0 2024-09-10T09:36:13.887 INFO:tasks.workunit.client.0.smithi079.stdout:4/989: chown d1/da/d16/d88/fd1 1348060968 1 2024-09-10T09:36:13.891 INFO:tasks.workunit.client.0.smithi079.stdout:8/990: dwrite d11/d2b/d4b/d50/d9e/dca/dd0/ffe [0,4194304] 0 2024-09-10T09:36:13.892 INFO:tasks.workunit.client.0.smithi079.stdout:9/921: write d3/d7/dc/de/da7/df1/f103 [1763397,102827] 0 2024-09-10T09:36:13.894 INFO:tasks.workunit.client.0.smithi079.stdout:8/991: mkdir d11/d2b/d4b/d50/d9e/dca/dd0/df0/d139 0 2024-09-10T09:36:13.896 INFO:tasks.workunit.client.0.smithi079.stdout:9/922: link d3/d7/d26/l29 d3/d7/dc/de/d17/dcf/d107/l13c 0 2024-09-10T09:36:13.896 INFO:tasks.workunit.client.0.smithi079.stdout:9/923: readlink d3/d7/dc/de/d17/d2f/d74/db4/lc6 0 2024-09-10T09:36:13.897 INFO:tasks.workunit.client.0.smithi079.stdout:8/992: mkdir d11/d2b/d4b/d50/d9e/d12d/d13a 0 2024-09-10T09:36:13.898 INFO:tasks.workunit.client.0.smithi079.stdout:9/924: mknod d3/d7/dc/de/d17/dcf/dd0/c13d 0 2024-09-10T09:36:13.898 INFO:tasks.workunit.client.0.smithi079.stdout:9/925: fsync d3/d7/dc/de/d17/d12/fb0 0 2024-09-10T09:36:13.900 INFO:tasks.workunit.client.0.smithi079.stdout:8/993: rename d11/d2b/d4b/d50/c106 to d11/d2b/d4b/d50/d5c/d118/d11a/c13b 0 2024-09-10T09:36:13.900 INFO:tasks.workunit.client.0.smithi079.stdout:8/994: write d11/d91/d108/fd3 [519304,9112] 0 2024-09-10T09:36:13.901 INFO:tasks.workunit.client.0.smithi079.stdout:9/926: creat d3/d7/dc/d7a/d112/f13e x:0 0 0 2024-09-10T09:36:13.902 INFO:tasks.workunit.client.0.smithi079.stdout:8/995: unlink d11/d2b/c10d 0 2024-09-10T09:36:13.904 INFO:tasks.workunit.client.0.smithi079.stdout:9/927: rename d3/d7/dc/de/da7/dac to d3/d40/dc0/d13f 0 2024-09-10T09:36:13.905 INFO:tasks.workunit.client.0.smithi079.stdout:8/996: rmdir d11/dbd/ddc 39 2024-09-10T09:36:13.905 INFO:tasks.workunit.client.0.smithi079.stdout:4/990: dwrite d1/da/d3b/d5f/fae [0,4194304] 0 2024-09-10T09:36:13.905 INFO:tasks.workunit.client.0.smithi079.stdout:4/991: read - d1/da/d28/d47/da1/dcd/ff9 zero size 2024-09-10T09:36:13.905 INFO:tasks.workunit.client.0.smithi079.stdout:4/992: write d1/da/d3b/d5a/f78 [4385264,48274] 0 2024-09-10T09:36:13.905 INFO:tasks.workunit.client.0.smithi079.stdout:8/997: creat d11/d2b/d4b/d74/f13c x:0 0 0 2024-09-10T09:36:13.907 INFO:tasks.workunit.client.0.smithi079.stdout:9/928: dread d3/d7/d5a/f65 [0,4194304] 0 2024-09-10T09:36:13.907 INFO:tasks.workunit.client.0.smithi079.stdout:9/929: fsync d3/d7/f9f 0 2024-09-10T09:36:13.908 INFO:tasks.workunit.client.0.smithi079.stdout:4/993: fsync d1/da/d28/f29 0 2024-09-10T09:36:13.912 INFO:tasks.workunit.client.0.smithi079.stdout:4/994: dread d1/da/d16/d21/d32/fe4 [0,4194304] 0 2024-09-10T09:36:13.920 INFO:tasks.workunit.client.0.smithi079.stdout:9/930: write d3/d7/dc/f37 [2938774,78089] 0 2024-09-10T09:36:13.922 INFO:tasks.workunit.client.0.smithi079.stdout:4/995: dread d1/da/d28/d47/da1/fd0 [0,4194304] 0 2024-09-10T09:36:13.929 INFO:tasks.workunit.client.0.smithi079.stdout:9/931: write d3/f16 [2846070,129972] 0 2024-09-10T09:36:13.971 INFO:tasks.workunit.client.0.smithi079.stdout:4/996: symlink d1/l140 0 2024-09-10T09:36:13.972 INFO:tasks.workunit.client.0.smithi079.stdout:9/932: rmdir d3/d7/dc/de/d17/d4c 39 2024-09-10T09:36:13.972 INFO:tasks.workunit.client.0.smithi079.stdout:4/997: symlink d1/da/d16/d4d/d122/l141 0 2024-09-10T09:36:13.973 INFO:tasks.workunit.client.0.smithi079.stdout:9/933: rmdir d3/d7/dc/de/d17/d4c 39 2024-09-10T09:36:13.973 INFO:tasks.workunit.client.0.smithi079.stdout:9/934: stat d3/d7/dc/de/d17/d2f/f38 0 2024-09-10T09:36:13.974 INFO:tasks.workunit.client.0.smithi079.stdout:4/998: mknod d1/d38/da5/dde/c142 0 2024-09-10T09:36:13.975 INFO:tasks.workunit.client.0.smithi079.stdout:9/935: symlink d3/d7/dc/de/d58/d12c/ddf/l140 0 2024-09-10T09:36:13.976 INFO:tasks.workunit.client.0.smithi079.stdout:4/999: creat d1/d38/da5/f143 x:0 0 0 2024-09-10T09:36:13.977 INFO:tasks.workunit.client.0.smithi079.stdout:9/936: unlink d3/ff5 0 2024-09-10T09:36:13.996 INFO:tasks.workunit.client.0.smithi079.stdout:9/937: dwrite d3/d7/dc/de/d17/d2f/d98/da1/faf [0,4194304] 0 2024-09-10T09:36:13.996 INFO:tasks.workunit.client.0.smithi079.stdout:9/938: fsync d3/d7/d70/f71 0 2024-09-10T09:36:13.996 INFO:tasks.workunit.client.0.smithi079.stdout:9/939: chown d3/df6/c128 362774 1 2024-09-10T09:36:13.997 INFO:tasks.workunit.client.0.smithi079.stdout:9/940: rename d3/d7/dc/de/d17/d12/d113/c11a to d3/d7/c141 0 2024-09-10T09:36:13.998 INFO:tasks.workunit.client.0.smithi079.stdout:9/941: rename d3/d7/d26/d83/fd6 to d3/df6/f142 0 2024-09-10T09:36:13.999 INFO:tasks.workunit.client.0.smithi079.stdout:9/942: unlink d3/d7/dc/de/d17/dcf/dd0/f127 0 2024-09-10T09:36:14.000 INFO:tasks.workunit.client.0.smithi079.stdout:9/943: symlink d3/d7/dc/d7a/d112/l143 0 2024-09-10T09:36:14.001 INFO:tasks.workunit.client.0.smithi079.stdout:9/944: getdents d3/d7/dc/de 0 2024-09-10T09:36:14.002 INFO:tasks.workunit.client.0.smithi079.stdout:9/945: rename d3/d7/d26/f8f to d3/d7/dc/de/d17/d4c/d131/f144 0 2024-09-10T09:36:14.003 INFO:tasks.workunit.client.0.smithi079.stdout:9/946: mknod d3/d7/dc/de/d17/d4c/c145 0 2024-09-10T09:36:14.005 INFO:tasks.workunit.client.0.smithi079.stdout:9/947: rename d3/d7/dc/d62 to d3/d7/dc/de/d17/dcf/d146 0 2024-09-10T09:36:14.005 INFO:tasks.workunit.client.0.smithi079.stdout:9/948: chown d3/df6/f142 2448 1 2024-09-10T09:36:14.005 INFO:tasks.workunit.client.0.smithi079.stdout:9/949: rmdir d3/d7/dc/de/da7/df8 39 2024-09-10T09:36:14.025 INFO:tasks.workunit.client.0.smithi079.stdout:9/950: dwrite d3/d40/f47 [0,4194304] 0 2024-09-10T09:36:14.026 INFO:tasks.workunit.client.0.smithi079.stdout:9/951: stat d3/d7/dc/de/d17/d12/cb6 0 2024-09-10T09:36:14.036 INFO:tasks.workunit.client.0.smithi079.stdout:9/952: write d3/f2b [1056122,113434] 0 2024-09-10T09:36:14.039 INFO:tasks.workunit.client.0.smithi079.stdout:7/933: sync 2024-09-10T09:36:14.041 INFO:tasks.workunit.client.0.smithi079.stdout:7/934: mkdir d4/df/d3d/de6/df1/d121 0 2024-09-10T09:36:14.043 INFO:tasks.workunit.client.0.smithi079.stdout:7/935: unlink d4/dc/c6a 0 2024-09-10T09:36:14.043 INFO:tasks.workunit.client.0.smithi079.stdout:7/936: read d4/d6/d3e/f85 [1842988,37536] 0 2024-09-10T09:36:14.045 INFO:tasks.workunit.client.0.smithi079.stdout:8/998: sync 2024-09-10T09:36:14.045 INFO:tasks.workunit.client.0.smithi079.stdout:8/999: fsync d11/d2b/d4b/d50/d5c/f95 0 2024-09-10T09:36:14.045 INFO:tasks.workunit.client.0.smithi079.stdout:9/953: dread d3/d7/dc/de/d17/d2f/d74/fa3 [0,4194304] 0 2024-09-10T09:36:14.147 INFO:tasks.workunit.client.0.smithi079.stdout:7/937: sync 2024-09-10T09:36:14.149 INFO:tasks.workunit.client.0.smithi079.stdout:7/938: unlink d4/d6/d38/dc1/df9/d117/dca/fc8 0 2024-09-10T09:36:14.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/939: chown d4/df/d19/c3b 96 1 2024-09-10T09:36:14.150 INFO:tasks.workunit.client.0.smithi079.stdout:7/940: write d4/df/d3d/d75/ff6 [675444,31219] 0 2024-09-10T09:36:14.151 INFO:tasks.workunit.client.0.smithi079.stdout:7/941: symlink d4/dc/l122 0 2024-09-10T09:36:14.152 INFO:tasks.workunit.client.0.smithi079.stdout:7/942: symlink d4/d6/d4f/da7/l123 0 2024-09-10T09:36:14.154 INFO:tasks.workunit.client.0.smithi079.stdout:7/943: creat d4/df/d3d/f124 x:0 0 0 2024-09-10T09:36:14.156 INFO:tasks.workunit.client.0.smithi079.stdout:7/944: creat d4/d6/d4f/f125 x:0 0 0 2024-09-10T09:36:14.157 INFO:tasks.workunit.client.0.smithi079.stdout:7/945: mkdir d4/d6/d38/df8/d126 0 2024-09-10T09:36:14.157 INFO:tasks.workunit.client.0.smithi079.stdout:7/946: fdatasync d4/df/d6b/d9a/d9c/fa4 0 2024-09-10T09:36:14.162 INFO:tasks.workunit.client.0.smithi079.stdout:7/947: dread d4/df/d3d/d82/f5c [0,4194304] 0 2024-09-10T09:36:14.163 INFO:tasks.workunit.client.0.smithi079.stdout:7/948: symlink d4/d6/d38/dc1/df9/l127 0 2024-09-10T09:36:14.165 INFO:tasks.workunit.client.0.smithi079.stdout:7/949: symlink d4/df/d6b/d9a/d9c/l128 0 2024-09-10T09:36:14.165 INFO:tasks.workunit.client.0.smithi079.stdout:7/950: truncate d4/d6/d4f/da7/fcb 845961 0 2024-09-10T09:36:14.165 INFO:tasks.workunit.client.0.smithi079.stdout:7/951: truncate d4/d6/d3e/f7a 4449938 0 2024-09-10T09:36:14.166 INFO:tasks.workunit.client.0.smithi079.stdout:7/952: mkdir d4/d6/d38/d129 0 2024-09-10T09:36:14.166 INFO:tasks.workunit.client.0.smithi079.stdout:7/953: dread - d4/d6/d38/df8/f114 zero size 2024-09-10T09:36:14.181 INFO:tasks.workunit.client.0.smithi079.stdout:7/954: dwrite d4/dc/f36 [4194304,4194304] 0 2024-09-10T09:36:14.182 INFO:tasks.workunit.client.0.smithi079.stdout:7/955: symlink d4/d6/d38/dc1/df9/d117/dca/l12a 0 2024-09-10T09:36:14.184 INFO:tasks.workunit.client.0.smithi079.stdout:7/956: rename d4/df/d3d/f124 to d4/d6/d4f/f12b 0 2024-09-10T09:36:14.193 INFO:tasks.workunit.client.0.smithi079.stdout:7/957: dread d4/d6/d38/dc1/df9/d117/fd2 [0,4194304] 0 2024-09-10T09:36:14.194 INFO:tasks.workunit.client.0.smithi079.stdout:7/958: read - d4/d6/d4f/da7/fb4 zero size 2024-09-10T09:36:14.194 INFO:tasks.workunit.client.0.smithi079.stdout:7/959: write d4/d6/d38/dd9/fff [843839,56782] 0 2024-09-10T09:36:14.196 INFO:tasks.workunit.client.0.smithi079.stdout:7/960: unlink d4/df/d3d/d75/fcf 0 2024-09-10T09:36:14.203 INFO:tasks.workunit.client.0.smithi079.stdout:9/954: sync 2024-09-10T09:36:14.206 INFO:tasks.workunit.client.0.smithi079.stdout:7/961: write d4/d6/d38/dc1/df9/d117/dca/fef [3680234,93996] 0 2024-09-10T09:36:14.209 INFO:tasks.workunit.client.0.smithi079.stdout:9/955: dread d3/d7/dc/de/d17/dcf/d146/fdb [0,4194304] 0 2024-09-10T09:36:14.209 INFO:tasks.workunit.client.0.smithi079.stdout:9/956: write d3/d7/dc/de/d17/d4c/d131/f144 [4158253,102403] 0 2024-09-10T09:36:14.210 INFO:tasks.workunit.client.0.smithi079.stdout:9/957: symlink d3/d7/dc/d7a/l147 0 2024-09-10T09:36:14.210 INFO:tasks.workunit.client.0.smithi079.stdout:9/958: stat d3/d7/dc/de/d17/d2f/d74/c10c 0 2024-09-10T09:36:14.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:13 smithi079 ceph-mon[27592]: pgmap v261: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 219 MiB/s rd, 253 MiB/s wr, 377 op/s 2024-09-10T09:36:14.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:13 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:14.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:13 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:14.211 INFO:tasks.workunit.client.0.smithi079.stdout:9/959: creat d3/d7/dc/de/db7/f148 x:0 0 0 2024-09-10T09:36:14.213 INFO:tasks.workunit.client.0.smithi079.stdout:7/962: dread d4/d6/f16 [0,4194304] 0 2024-09-10T09:36:14.213 INFO:tasks.workunit.client.0.smithi079.stdout:9/960: symlink d3/d7/dc/de/d58/d12c/ddf/l149 0 2024-09-10T09:36:14.214 INFO:tasks.workunit.client.0.smithi079.stdout:7/963: mkdir d4/d6/d38/dc1/df9/d12c 0 2024-09-10T09:36:14.214 INFO:tasks.workunit.client.0.smithi079.stdout:7/964: truncate d4/d6/d38/dc1/df9/d117/dca/fe9 198140 0 2024-09-10T09:36:14.214 INFO:tasks.workunit.client.0.smithi079.stdout:7/965: write d4/d6/d38/f63 [3963068,68792] 0 2024-09-10T09:36:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:13 smithi135 ceph-mon[33411]: pgmap v261: 65 pgs: 65 active+clean; 1.8 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 219 MiB/s rd, 253 MiB/s wr, 377 op/s 2024-09-10T09:36:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:13 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:13 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:14.222 INFO:tasks.workunit.client.0.smithi079.stdout:9/961: dread d3/d7/dc/de/d17/d12/fb0 [4194304,4194304] 0 2024-09-10T09:36:14.225 INFO:tasks.workunit.client.0.smithi079.stdout:9/962: rename d3/d7/dc/de/d17/d2f/f38 to d3/d7/dc/de/d58/d12c/f14a 0 2024-09-10T09:36:14.232 INFO:tasks.workunit.client.0.smithi079.stdout:7/966: dwrite d4/fd5 [0,4194304] 0 2024-09-10T09:36:14.234 INFO:tasks.workunit.client.0.smithi079.stdout:7/967: write d4/dc/f17 [8707912,5359] 0 2024-09-10T09:36:14.236 INFO:tasks.workunit.client.0.smithi079.stdout:7/968: mknod d4/df/d3d/de6/df1/d121/c12d 0 2024-09-10T09:36:14.243 INFO:tasks.workunit.client.0.smithi079.stdout:7/969: write d4/d6/d3e/f86 [330200,56306] 0 2024-09-10T09:36:14.244 INFO:tasks.workunit.client.0.smithi079.stdout:7/970: getdents d4/df/d6b/d9a/dde 0 2024-09-10T09:36:14.245 INFO:tasks.workunit.client.0.smithi079.stdout:7/971: rmdir d4/d6/d38/d129 0 2024-09-10T09:36:14.246 INFO:tasks.workunit.client.0.smithi079.stdout:7/972: creat d4/d6/d106/f12e x:0 0 0 2024-09-10T09:36:14.253 INFO:tasks.workunit.client.0.smithi079.stdout:7/973: read d4/dc/d43/dab/fd3 [1480528,123330] 0 2024-09-10T09:36:14.254 INFO:tasks.workunit.client.0.smithi079.stdout:7/974: dread d4/d6/d3e/f51 [0,4194304] 0 2024-09-10T09:36:14.254 INFO:tasks.workunit.client.0.smithi079.stdout:7/975: write d4/d6/d38/dc1/df9/f100 [665318,105945] 0 2024-09-10T09:36:14.255 INFO:tasks.workunit.client.0.smithi079.stdout:7/976: mkdir d4/d6/d106/d12f 0 2024-09-10T09:36:14.256 INFO:tasks.workunit.client.0.smithi079.stdout:7/977: dread d4/df/d19/db9/fe1 [0,4194304] 0 2024-09-10T09:36:14.277 INFO:tasks.workunit.client.0.smithi079.stdout:7/978: dwrite d4/d6/d38/df8/f114 [0,4194304] 0 2024-09-10T09:36:14.279 INFO:tasks.workunit.client.0.smithi079.stdout:7/979: symlink d4/df/d6b/d9a/d9c/l130 0 2024-09-10T09:36:14.279 INFO:tasks.workunit.client.0.smithi079.stdout:7/980: chown d4/df/d6b/f8e 8469577 1 2024-09-10T09:36:14.285 INFO:tasks.workunit.client.0.smithi079.stdout:9/963: sync 2024-09-10T09:36:14.286 INFO:tasks.workunit.client.0.smithi079.stdout:9/964: mknod d3/d7/dc/d7a/da9/c14b 0 2024-09-10T09:36:14.287 INFO:tasks.workunit.client.0.smithi079.stdout:9/965: fdatasync d3/d7/dc/de/d17/dcf/d146/f7d 0 2024-09-10T09:36:14.287 INFO:tasks.workunit.client.0.smithi079.stdout:9/966: fdatasync d3/d7/dc/de/d17/d2f/d98/fbb 0 2024-09-10T09:36:14.288 INFO:tasks.workunit.client.0.smithi079.stdout:9/967: mknod d3/d7/dc/de/d17/dcf/d146/c14c 0 2024-09-10T09:36:14.289 INFO:tasks.workunit.client.0.smithi079.stdout:9/968: truncate d3/d7/d26/d3d/f42 6440571 0 2024-09-10T09:36:14.289 INFO:tasks.workunit.client.0.smithi079.stdout:9/969: readlink d3/d7/d70/lca 0 2024-09-10T09:36:14.289 INFO:tasks.workunit.client.0.smithi079.stdout:9/970: chown d3/d7/d5a/fd5 746 1 2024-09-10T09:36:14.289 INFO:tasks.workunit.client.0.smithi079.stdout:9/971: dread - d3/d7/dc/de/d17/d2f/d74/ffd zero size 2024-09-10T09:36:14.294 INFO:tasks.workunit.client.0.smithi079.stdout:7/981: dwrite d4/df/d6b/f8b [0,4194304] 0 2024-09-10T09:36:14.294 INFO:tasks.workunit.client.0.smithi079.stdout:7/982: chown d4/dc/d43/dab/c105 183158 1 2024-09-10T09:36:14.296 INFO:tasks.workunit.client.0.smithi079.stdout:7/983: mknod d4/d6/d4f/d66/c131 0 2024-09-10T09:36:14.318 INFO:tasks.workunit.client.0.smithi079.stdout:9/972: dwrite d3/d40/f81 [0,4194304] 0 2024-09-10T09:36:14.318 INFO:tasks.workunit.client.0.smithi079.stdout:9/973: read - d3/d40/f120 zero size 2024-09-10T09:36:14.320 INFO:tasks.workunit.client.0.smithi079.stdout:7/984: dwrite d4/df/d6b/d9a/d9c/fd7 [0,4194304] 0 2024-09-10T09:36:14.324 INFO:tasks.workunit.client.0.smithi079.stdout:7/985: symlink d4/d6/d3e/l132 0 2024-09-10T09:36:14.324 INFO:tasks.workunit.client.0.smithi079.stdout:7/986: symlink d4/d6/d106/l133 0 2024-09-10T09:36:14.325 INFO:tasks.workunit.client.0.smithi079.stdout:9/974: dread d3/f16 [0,4194304] 0 2024-09-10T09:36:14.325 INFO:tasks.workunit.client.0.smithi079.stdout:7/987: mkdir d4/dc/d134 0 2024-09-10T09:36:14.326 INFO:tasks.workunit.client.0.smithi079.stdout:7/988: rmdir d4/df/d6b/d9a/dde 39 2024-09-10T09:36:14.326 INFO:tasks.workunit.client.0.smithi079.stdout:7/989: chown d4/d6/d3e/f86 4013372 1 2024-09-10T09:36:14.326 INFO:tasks.workunit.client.0.smithi079.stdout:7/990: chown d4/f5d 22365698 1 2024-09-10T09:36:14.328 INFO:tasks.workunit.client.0.smithi079.stdout:7/991: mkdir d4/df/d19/d135 0 2024-09-10T09:36:14.329 INFO:tasks.workunit.client.0.smithi079.stdout:7/992: unlink d4/d6/f11e 0 2024-09-10T09:36:14.365 INFO:tasks.workunit.client.0.smithi079.stdout:7/993: dwrite d4/d6/d38/f67 [0,4194304] 0 2024-09-10T09:36:14.366 INFO:tasks.workunit.client.0.smithi079.stdout:7/994: mknod d4/d6/d38/dc1/df9/d12c/c136 0 2024-09-10T09:36:14.366 INFO:tasks.workunit.client.0.smithi079.stdout:7/995: write d4/df/ffc [260425,51208] 0 2024-09-10T09:36:14.367 INFO:tasks.workunit.client.0.smithi079.stdout:7/996: chown d4/df/d19/c78 42219183 1 2024-09-10T09:36:14.370 INFO:tasks.workunit.client.0.smithi079.stdout:9/975: sync 2024-09-10T09:36:14.370 INFO:tasks.workunit.client.0.smithi079.stdout:7/997: dread d4/d6/d38/fb7 [0,4194304] 0 2024-09-10T09:36:14.371 INFO:tasks.workunit.client.0.smithi079.stdout:7/998: mknod d4/d6/d3e/db3/c137 0 2024-09-10T09:36:14.372 INFO:tasks.workunit.client.0.smithi079.stdout:7/999: truncate d4/d6/f16 2267635 0 2024-09-10T09:36:14.373 INFO:tasks.workunit.client.0.smithi079.stdout:9/976: getdents d3 0 2024-09-10T09:36:14.374 INFO:tasks.workunit.client.0.smithi079.stdout:9/977: creat d3/d7/dc/de/d17/db2/f14d x:0 0 0 2024-09-10T09:36:14.374 INFO:tasks.workunit.client.0.smithi079.stdout:9/978: write d3/d7/dc/d7a/da9/fda [687786,128825] 0 2024-09-10T09:36:14.384 INFO:tasks.workunit.client.0.smithi079.stdout:9/979: write d3/f11 [4919631,112684] 0 2024-09-10T09:36:14.384 INFO:tasks.workunit.client.0.smithi079.stdout:9/980: chown d3/d7/dc/de/d17/d6e 26 1 2024-09-10T09:36:14.384 INFO:tasks.workunit.client.0.smithi079.stdout:9/981: write d3/d7/dc/de/d17/dcf/d107/f11e [99396,437] 0 2024-09-10T09:36:14.384 INFO:tasks.workunit.client.0.smithi079.stdout:9/982: stat d3/d7/d5a/f68 0 2024-09-10T09:36:14.384 INFO:tasks.workunit.client.0.smithi079.stdout:9/983: chown d3/d40/dc0 219276 1 2024-09-10T09:36:14.402 INFO:tasks.workunit.client.0.smithi079.stdout:9/984: dwrite d3/d7/dc/d7a/da9/f9c [8388608,4194304] 0 2024-09-10T09:36:14.420 INFO:tasks.workunit.client.0.smithi079.stdout:9/985: symlink d3/d7/dc/l14e 0 2024-09-10T09:36:14.473 INFO:tasks.workunit.client.0.smithi079.stdout:9/986: creat d3/d7/dc/de/d17/d12/f14f x:0 0 0 2024-09-10T09:36:14.473 INFO:tasks.workunit.client.0.smithi079.stdout:9/987: write d3/d7/dc/de/db7/f148 [603955,59716] 0 2024-09-10T09:36:14.474 INFO:tasks.workunit.client.0.smithi079.stdout:9/988: symlink d3/d7/dc/de/da7/df1/d100/l150 0 2024-09-10T09:36:14.493 INFO:tasks.workunit.client.1.smithi135.stdout:6/108: sync 2024-09-10T09:36:14.494 INFO:tasks.workunit.client.1.smithi135.stdout:5/15: sync 2024-09-10T09:36:14.494 INFO:tasks.workunit.client.1.smithi135.stdout:5/16: stat f0 0 2024-09-10T09:36:14.496 INFO:tasks.workunit.client.1.smithi135.stdout:6/109: link d5/d15/l1a d5/dd/l23 0 2024-09-10T09:36:14.515 INFO:tasks.workunit.client.1.smithi135.stdout:5/17: dwrite f0 [0,4194304] 0 2024-09-10T09:36:14.516 INFO:tasks.workunit.client.1.smithi135.stdout:5/18: chown d1 42722106 1 2024-09-10T09:36:14.516 INFO:tasks.workunit.client.1.smithi135.stdout:5/19: getdents d1 0 2024-09-10T09:36:14.516 INFO:tasks.workunit.client.1.smithi135.stdout:6/110: dwrite f4 [4194304,4194304] 0 2024-09-10T09:36:14.522 INFO:tasks.workunit.client.0.smithi079.stdout:9/989: mknod d3/d7/c151 0 2024-09-10T09:36:14.524 INFO:tasks.workunit.client.0.smithi079.stdout:9/990: unlink d3/d7/dc/d7a/da9/fda 0 2024-09-10T09:36:14.524 INFO:tasks.workunit.client.0.smithi079.stdout:9/991: chown d3/d7/d70/f71 5862 1 2024-09-10T09:36:14.528 INFO:tasks.workunit.client.1.smithi135.stdout:5/20: write f0 [491609,19662] 0 2024-09-10T09:36:14.530 INFO:tasks.workunit.client.1.smithi135.stdout:5/21: rmdir d1 0 2024-09-10T09:36:14.535 INFO:tasks.workunit.client.1.smithi135.stdout:6/111: write d5/fc [766412,92811] 0 2024-09-10T09:36:14.535 INFO:tasks.workunit.client.1.smithi135.stdout:6/112: readlink d5/dd/l19 0 2024-09-10T09:36:14.535 INFO:tasks.workunit.client.1.smithi135.stdout:6/113: dread - d5/d12/f21 zero size 2024-09-10T09:36:14.537 INFO:tasks.workunit.client.1.smithi135.stdout:6/114: symlink d5/d12/l24 0 2024-09-10T09:36:14.537 INFO:tasks.workunit.client.1.smithi135.stdout:6/115: creat d5/d15/f25 x:0 0 0 2024-09-10T09:36:14.540 INFO:tasks.workunit.client.1.smithi135.stdout:5/22: truncate f0 1942968 0 2024-09-10T09:36:14.541 INFO:tasks.workunit.client.1.smithi135.stdout:6/116: mknod d5/c26 0 2024-09-10T09:36:14.541 INFO:tasks.workunit.client.1.smithi135.stdout:6/117: write f3 [3154387,32948] 0 2024-09-10T09:36:14.542 INFO:tasks.workunit.client.1.smithi135.stdout:6/118: mkdir d5/d15/d27 0 2024-09-10T09:36:14.543 INFO:tasks.workunit.client.1.smithi135.stdout:6/119: rename d5/f10 to d5/d1e/f28 0 2024-09-10T09:36:14.543 INFO:tasks.workunit.client.1.smithi135.stdout:6/120: chown d5/d1e/f28 25 1 2024-09-10T09:36:14.550 INFO:tasks.workunit.client.0.smithi079.stdout:9/992: dwrite d3/d7/dc/d7a/da9/f9c [0,4194304] 0 2024-09-10T09:36:14.553 INFO:tasks.workunit.client.1.smithi135.stdout:6/121: dread f4 [0,4194304] 0 2024-09-10T09:36:14.553 INFO:tasks.workunit.client.1.smithi135.stdout:6/122: chown d5/dd/c1b 2614703 1 2024-09-10T09:36:14.553 INFO:tasks.workunit.client.1.smithi135.stdout:6/123: mkdir d5/dd/d29 0 2024-09-10T09:36:14.555 INFO:tasks.workunit.client.1.smithi135.stdout:6/124: creat d5/dd/d29/f2a x:0 0 0 2024-09-10T09:36:14.555 INFO:tasks.workunit.client.0.smithi079.stdout:9/993: dread d3/d7f/f125 [0,4194304] 0 2024-09-10T09:36:14.555 INFO:tasks.workunit.client.0.smithi079.stdout:9/994: chown d3/d7/dc/de/d17/d12/f122 83 1 2024-09-10T09:36:14.556 INFO:tasks.workunit.client.1.smithi135.stdout:6/125: link d5/dd/c1b d5/dd/c2b 0 2024-09-10T09:36:14.556 INFO:tasks.workunit.client.1.smithi135.stdout:6/126: stat d5/l9 0 2024-09-10T09:36:14.557 INFO:tasks.workunit.client.0.smithi079.stdout:9/995: symlink d3/d40/dc0/d13f/l152 0 2024-09-10T09:36:14.557 INFO:tasks.workunit.client.0.smithi079.stdout:9/996: truncate d3/d7/f11f 595056 0 2024-09-10T09:36:14.557 INFO:tasks.workunit.client.0.smithi079.stdout:9/997: write d3/d40/dc0/d13f/ff7 [5032244,100985] 0 2024-09-10T09:36:14.557 INFO:tasks.workunit.client.1.smithi135.stdout:6/127: rmdir d5 39 2024-09-10T09:36:14.559 INFO:tasks.workunit.client.0.smithi079.stdout:9/998: mknod d3/d7/dc/de/d17/dcf/c153 0 2024-09-10T09:36:14.561 INFO:tasks.workunit.client.1.smithi135.stdout:5/23: truncate f0 480632 0 2024-09-10T09:36:14.562 INFO:tasks.workunit.client.1.smithi135.stdout:6/128: getdents d5/d12 0 2024-09-10T09:36:14.562 INFO:tasks.workunit.client.1.smithi135.stdout:6/129: read f3 [493592,12071] 0 2024-09-10T09:36:14.563 INFO:tasks.workunit.client.0.smithi079.stdout:9/999: dread d3/d7/dc/de/d17/f10b [4194304,4194304] 0 2024-09-10T09:36:14.565 INFO:tasks.workunit.client.0.smithi079.stderr:+ rm -rf -- ./tmp.f1KFAAp0W9 2024-09-10T09:36:14.575 INFO:tasks.workunit.client.1.smithi135.stdout:8/16: sync 2024-09-10T09:36:14.575 INFO:tasks.workunit.client.1.smithi135.stdout:8/17: chown d1/l2 704493213 1 2024-09-10T09:36:14.576 INFO:tasks.workunit.client.1.smithi135.stdout:8/18: chown d1 780 1 2024-09-10T09:36:14.576 INFO:tasks.workunit.client.1.smithi135.stdout:8/19: fdatasync - no filename 2024-09-10T09:36:14.576 INFO:tasks.workunit.client.1.smithi135.stdout:8/20: dwrite - no filename 2024-09-10T09:36:14.576 INFO:tasks.workunit.client.1.smithi135.stdout:8/21: write - no filename 2024-09-10T09:36:14.576 INFO:tasks.workunit.client.1.smithi135.stdout:8/22: stat d1 0 2024-09-10T09:36:14.577 INFO:tasks.workunit.client.1.smithi135.stdout:8/23: unlink d1/l2 0 2024-09-10T09:36:14.578 INFO:tasks.workunit.client.1.smithi135.stdout:8/24: dread - no filename 2024-09-10T09:36:14.578 INFO:tasks.workunit.client.1.smithi135.stdout:8/25: stat d1 0 2024-09-10T09:36:14.578 INFO:tasks.workunit.client.1.smithi135.stdout:8/26: dread - no filename 2024-09-10T09:36:14.579 INFO:tasks.workunit.client.1.smithi135.stdout:8/27: creat d1/f3 x:0 0 0 2024-09-10T09:36:14.579 INFO:tasks.workunit.client.1.smithi135.stdout:8/28: truncate d1/f3 621621 0 2024-09-10T09:36:14.579 INFO:tasks.workunit.client.1.smithi135.stdout:8/29: write d1/f3 [1584406,79062] 0 2024-09-10T09:36:14.583 INFO:tasks.workunit.client.1.smithi135.stdout:5/24: dwrite f0 [0,4194304] 0 2024-09-10T09:36:14.583 INFO:tasks.workunit.client.1.smithi135.stdout:5/25: creat f2 x:0 0 0 2024-09-10T09:36:14.591 INFO:tasks.workunit.client.1.smithi135.stdout:5/26: dread f0 [0,4194304] 0 2024-09-10T09:36:14.592 INFO:tasks.workunit.client.1.smithi135.stdout:8/30: rmdir d1 39 2024-09-10T09:36:14.594 INFO:tasks.workunit.client.1.smithi135.stdout:5/27: mkdir d3 0 2024-09-10T09:36:14.594 INFO:tasks.workunit.client.1.smithi135.stdout:5/28: write f2 [513339,129259] 0 2024-09-10T09:36:14.596 INFO:tasks.workunit.client.1.smithi135.stdout:8/31: mknod d1/c4 0 2024-09-10T09:36:14.597 INFO:tasks.workunit.client.1.smithi135.stdout:8/32: write d1/f3 [1178144,39220] 0 2024-09-10T09:36:14.598 INFO:tasks.workunit.client.1.smithi135.stdout:8/33: chown d1 46921 1 2024-09-10T09:36:14.599 INFO:tasks.workunit.client.1.smithi135.stdout:5/29: creat d3/f4 x:0 0 0 2024-09-10T09:36:14.599 INFO:tasks.workunit.client.1.smithi135.stdout:8/34: fdatasync d1/f3 0 2024-09-10T09:36:14.599 INFO:tasks.workunit.client.1.smithi135.stdout:5/30: creat d3/f5 x:0 0 0 2024-09-10T09:36:14.599 INFO:tasks.workunit.client.1.smithi135.stdout:5/31: write f2 [1329938,18214] 0 2024-09-10T09:36:14.599 INFO:tasks.workunit.client.1.smithi135.stdout:8/35: write d1/f3 [2708902,99081] 0 2024-09-10T09:36:14.606 INFO:tasks.workunit.client.1.smithi135.stdout:5/32: mknod d3/c6 0 2024-09-10T09:36:14.607 INFO:tasks.workunit.client.1.smithi135.stdout:5/33: creat d3/f7 x:0 0 0 2024-09-10T09:36:14.616 INFO:tasks.workunit.client.1.smithi135.stdout:8/36: dwrite d1/f3 [0,4194304] 0 2024-09-10T09:36:14.622 INFO:tasks.workunit.client.1.smithi135.stdout:8/37: creat d1/f5 x:0 0 0 2024-09-10T09:36:14.623 INFO:tasks.workunit.client.1.smithi135.stdout:8/38: truncate d1/f5 297025 0 2024-09-10T09:36:14.623 INFO:tasks.workunit.client.1.smithi135.stdout:8/39: dread d1/f5 [0,4194304] 0 2024-09-10T09:36:14.625 INFO:tasks.workunit.client.1.smithi135.stdout:5/34: rmdir d3 39 2024-09-10T09:36:14.635 INFO:tasks.workunit.client.1.smithi135.stdout:8/40: dread d1/f3 [0,4194304] 0 2024-09-10T09:36:14.635 INFO:tasks.workunit.client.1.smithi135.stdout:8/41: rename d1 to d1/d6 22 2024-09-10T09:36:14.635 INFO:tasks.workunit.client.1.smithi135.stdout:8/42: chown d1 7796 1 2024-09-10T09:36:14.637 INFO:tasks.workunit.client.1.smithi135.stdout:8/43: link d1/f5 d1/f7 0 2024-09-10T09:36:14.640 INFO:tasks.workunit.client.1.smithi135.stdout:8/44: symlink d1/l8 0 2024-09-10T09:36:14.640 INFO:tasks.workunit.client.1.smithi135.stdout:8/45: rename d1 to d1/d9 22 2024-09-10T09:36:14.640 INFO:tasks.workunit.client.1.smithi135.stdout:8/46: dread d1/f7 [0,4194304] 0 2024-09-10T09:36:14.641 INFO:tasks.workunit.client.1.smithi135.stdout:8/47: readlink d1/l8 0 2024-09-10T09:36:14.644 INFO:tasks.workunit.client.1.smithi135.stdout:5/35: dwrite d3/f4 [0,4194304] 0 2024-09-10T09:36:14.645 INFO:tasks.workunit.client.1.smithi135.stdout:5/36: fsync d3/f4 0 2024-09-10T09:36:14.652 INFO:tasks.workunit.client.1.smithi135.stdout:5/37: creat d3/f8 x:0 0 0 2024-09-10T09:36:14.652 INFO:tasks.workunit.client.1.smithi135.stdout:5/38: dread - d3/f8 zero size 2024-09-10T09:36:14.656 INFO:tasks.workunit.client.1.smithi135.stdout:8/48: dwrite d1/f7 [0,4194304] 0 2024-09-10T09:36:14.657 INFO:tasks.workunit.client.1.smithi135.stdout:8/49: rename d1 to d1/da 22 2024-09-10T09:36:14.673 INFO:tasks.workunit.client.1.smithi135.stdout:8/50: dwrite d1/f3 [0,4194304] 0 2024-09-10T09:36:14.673 INFO:tasks.workunit.client.1.smithi135.stdout:8/51: creat d1/fb x:0 0 0 2024-09-10T09:36:14.682 INFO:tasks.workunit.client.1.smithi135.stdout:8/52: link d1/c4 d1/cc 0 2024-09-10T09:36:14.686 INFO:tasks.workunit.client.1.smithi135.stdout:8/53: write d1/f7 [2363370,76210] 0 2024-09-10T09:36:14.705 INFO:tasks.workunit.client.1.smithi135.stdout:8/54: dwrite d1/f7 [0,4194304] 0 2024-09-10T09:36:14.706 INFO:tasks.workunit.client.1.smithi135.stdout:8/55: link d1/f5 d1/fd 0 2024-09-10T09:36:14.708 INFO:tasks.workunit.client.1.smithi135.stdout:8/56: mknod d1/ce 0 2024-09-10T09:36:14.708 INFO:tasks.workunit.client.1.smithi135.stdout:8/57: chown d1/fd 187770 1 2024-09-10T09:36:14.709 INFO:tasks.workunit.client.1.smithi135.stdout:8/58: readlink d1/l8 0 2024-09-10T09:36:14.710 INFO:tasks.workunit.client.1.smithi135.stdout:8/59: symlink d1/lf 0 2024-09-10T09:36:14.710 INFO:tasks.workunit.client.1.smithi135.stdout:8/60: truncate d1/fb 804155 0 2024-09-10T09:36:14.711 INFO:tasks.workunit.client.1.smithi135.stdout:8/61: symlink d1/l10 0 2024-09-10T09:36:14.712 INFO:tasks.workunit.client.1.smithi135.stdout:8/62: stat d1/c4 0 2024-09-10T09:36:14.713 INFO:tasks.workunit.client.1.smithi135.stdout:8/63: creat d1/f11 x:0 0 0 2024-09-10T09:36:14.713 INFO:tasks.workunit.client.1.smithi135.stdout:8/64: write d1/f11 [714074,63233] 0 2024-09-10T09:36:14.722 INFO:tasks.workunit.client.1.smithi135.stdout:8/65: fsync d1/f7 0 2024-09-10T09:36:14.722 INFO:tasks.workunit.client.1.smithi135.stdout:8/66: readlink d1/l10 0 2024-09-10T09:36:14.724 INFO:tasks.workunit.client.1.smithi135.stdout:8/67: mknod d1/c12 0 2024-09-10T09:36:14.731 INFO:tasks.workunit.client.1.smithi135.stdout:8/68: mkdir d1/d13 0 2024-09-10T09:36:14.731 INFO:tasks.workunit.client.1.smithi135.stdout:8/69: getdents d1/d13 0 2024-09-10T09:36:14.731 INFO:tasks.workunit.client.1.smithi135.stdout:8/70: fdatasync d1/fb 0 2024-09-10T09:36:14.736 INFO:tasks.workunit.client.1.smithi135.stdout:8/71: link d1/f7 d1/f14 0 2024-09-10T09:36:14.756 INFO:tasks.workunit.client.1.smithi135.stdout:1/43: sync 2024-09-10T09:36:14.756 INFO:tasks.workunit.client.1.smithi135.stdout:3/24: sync 2024-09-10T09:36:14.756 INFO:tasks.workunit.client.1.smithi135.stdout:0/142: sync 2024-09-10T09:36:14.762 INFO:tasks.workunit.client.1.smithi135.stdout:8/72: dwrite d1/f7 [4194304,4194304] 0 2024-09-10T09:36:14.762 INFO:tasks.workunit.client.1.smithi135.stdout:8/73: chown d1/f5 441 1 2024-09-10T09:36:14.764 INFO:tasks.workunit.client.1.smithi135.stdout:8/74: dread d1/f11 [0,4194304] 0 2024-09-10T09:36:14.768 INFO:tasks.workunit.client.1.smithi135.stdout:0/143: mknod d8/dd/d11/d17/c29 0 2024-09-10T09:36:14.772 INFO:tasks.workunit.client.1.smithi135.stdout:3/25: dwrite f1 [0,4194304] 0 2024-09-10T09:36:14.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/44: symlink la 0 2024-09-10T09:36:14.777 INFO:tasks.workunit.client.1.smithi135.stdout:1/45: chown f4 1951336395 1 2024-09-10T09:36:14.777 INFO:tasks.workunit.client.1.smithi135.stdout:0/144: link d8/l12 d8/d1c/d28/l2a 0 2024-09-10T09:36:14.783 INFO:tasks.workunit.client.1.smithi135.stdout:3/26: mknod d4/ca 0 2024-09-10T09:36:14.788 INFO:tasks.workunit.client.1.smithi135.stdout:1/46: creat fb x:0 0 0 2024-09-10T09:36:14.788 INFO:tasks.workunit.client.1.smithi135.stdout:1/47: stat f7 0 2024-09-10T09:36:14.788 INFO:tasks.workunit.client.1.smithi135.stdout:1/48: rmdir - no directory 2024-09-10T09:36:14.794 INFO:tasks.workunit.client.1.smithi135.stdout:8/75: truncate d1/f5 4878803 0 2024-09-10T09:36:14.794 INFO:tasks.workunit.client.1.smithi135.stdout:8/76: chown d1/f7 190 1 2024-09-10T09:36:14.795 INFO:tasks.workunit.client.1.smithi135.stdout:3/27: write f1 [1029285,33901] 0 2024-09-10T09:36:14.796 INFO:tasks.workunit.client.1.smithi135.stdout:0/145: dwrite f7 [0,4194304] 0 2024-09-10T09:36:14.797 INFO:tasks.workunit.client.1.smithi135.stdout:0/146: dread d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:14.798 INFO:tasks.workunit.client.1.smithi135.stdout:3/28: mkdir d4/d5/db 0 2024-09-10T09:36:14.801 INFO:tasks.workunit.client.1.smithi135.stdout:0/147: rename d8/dd/d11/d17/f27 to d8/dd/d11/f2b 0 2024-09-10T09:36:14.804 INFO:tasks.workunit.client.1.smithi135.stdout:3/29: mkdir d4/d5/dc 0 2024-09-10T09:36:14.805 INFO:tasks.workunit.client.1.smithi135.stdout:3/30: fsync d4/f9 0 2024-09-10T09:36:14.806 INFO:tasks.workunit.client.1.smithi135.stdout:0/148: unlink d8/f15 0 2024-09-10T09:36:14.807 INFO:tasks.workunit.client.1.smithi135.stdout:8/77: dread d1/f7 [4194304,4194304] 0 2024-09-10T09:36:14.807 INFO:tasks.workunit.client.1.smithi135.stdout:3/31: mkdir d4/d5/db/dd 0 2024-09-10T09:36:14.808 INFO:tasks.workunit.client.1.smithi135.stdout:3/32: readlink d4/l6 0 2024-09-10T09:36:14.812 INFO:tasks.workunit.client.1.smithi135.stdout:0/149: rename d8/d1c/d28 to d8/d1c/d2c 0 2024-09-10T09:36:14.812 INFO:tasks.workunit.client.1.smithi135.stdout:0/150: dread d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:14.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/151: mknod d8/d1c/d2c/c2d 0 2024-09-10T09:36:14.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/152: truncate d8/dd/f13 912246 0 2024-09-10T09:36:14.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/153: chown d8 619272770 1 2024-09-10T09:36:14.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/154: read d8/fb [1477844,11374] 0 2024-09-10T09:36:14.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/155: chown d8/c16 0 1 2024-09-10T09:36:14.817 INFO:tasks.workunit.client.1.smithi135.stdout:3/33: write f2 [1698077,99114] 0 2024-09-10T09:36:14.817 INFO:tasks.workunit.client.1.smithi135.stdout:8/78: dread d1/f14 [0,4194304] 0 2024-09-10T09:36:14.821 INFO:tasks.workunit.client.1.smithi135.stdout:8/79: mkdir d1/d15 0 2024-09-10T09:36:14.823 INFO:tasks.workunit.client.1.smithi135.stdout:8/80: mkdir d1/d15/d16 0 2024-09-10T09:36:14.827 INFO:tasks.workunit.client.1.smithi135.stdout:0/156: dread d8/fc [0,4194304] 0 2024-09-10T09:36:14.830 INFO:tasks.workunit.client.1.smithi135.stdout:0/157: mkdir d8/de/d2e 0 2024-09-10T09:36:14.834 INFO:tasks.workunit.client.1.smithi135.stdout:8/81: getdents d1/d15 0 2024-09-10T09:36:14.834 INFO:tasks.workunit.client.1.smithi135.stdout:8/82: getdents d1/d15/d16 0 2024-09-10T09:36:14.836 INFO:tasks.workunit.client.1.smithi135.stdout:0/158: rmdir d8/d1c 39 2024-09-10T09:36:14.837 INFO:tasks.workunit.client.1.smithi135.stdout:8/83: mknod d1/d15/d16/c17 0 2024-09-10T09:36:14.838 INFO:tasks.workunit.client.1.smithi135.stdout:3/34: dwrite f1 [0,4194304] 0 2024-09-10T09:36:14.838 INFO:tasks.workunit.client.1.smithi135.stdout:3/35: truncate f3 5140250 0 2024-09-10T09:36:14.838 INFO:tasks.workunit.client.1.smithi135.stdout:3/36: truncate f1 5094203 0 2024-09-10T09:36:14.840 INFO:tasks.workunit.client.1.smithi135.stdout:0/159: symlink d8/dd/l2f 0 2024-09-10T09:36:14.840 INFO:tasks.workunit.client.1.smithi135.stdout:0/160: chown d8/dd/l2f 20328 1 2024-09-10T09:36:14.841 INFO:tasks.workunit.client.1.smithi135.stdout:8/84: mknod d1/d15/c18 0 2024-09-10T09:36:14.841 INFO:tasks.workunit.client.1.smithi135.stdout:8/85: write d1/f11 [1046013,88772] 0 2024-09-10T09:36:14.856 INFO:tasks.workunit.client.1.smithi135.stdout:3/37: symlink d4/d5/db/dd/le 0 2024-09-10T09:36:14.857 INFO:tasks.workunit.client.1.smithi135.stdout:8/86: dwrite d1/f14 [0,4194304] 0 2024-09-10T09:36:14.860 INFO:tasks.workunit.client.1.smithi135.stdout:0/161: creat d8/d1c/d2c/f30 x:0 0 0 2024-09-10T09:36:14.874 INFO:tasks.workunit.client.1.smithi135.stdout:0/162: rename d8/dd/d11/l14 to d8/dd/d11/d17/l31 0 2024-09-10T09:36:14.886 INFO:tasks.workunit.client.1.smithi135.stdout:3/38: dwrite f2 [0,4194304] 0 2024-09-10T09:36:14.886 INFO:tasks.workunit.client.1.smithi135.stdout:3/39: fsync f2 0 2024-09-10T09:36:14.886 INFO:tasks.workunit.client.1.smithi135.stdout:3/40: fdatasync d4/f9 0 2024-09-10T09:36:14.886 INFO:tasks.workunit.client.1.smithi135.stdout:3/41: rename d4/d5 to d4/d5/db/dd/df 22 2024-09-10T09:36:14.886 INFO:tasks.workunit.client.1.smithi135.stdout:8/87: dwrite d1/f14 [4194304,4194304] 0 2024-09-10T09:36:14.889 INFO:tasks.workunit.client.1.smithi135.stdout:0/163: write d8/dd/d1e/f21 [4074062,52607] 0 2024-09-10T09:36:14.890 INFO:tasks.workunit.client.1.smithi135.stdout:0/164: chown d8/dd/c24 13483 1 2024-09-10T09:36:14.900 INFO:tasks.workunit.client.1.smithi135.stdout:3/42: write f2 [1129818,66762] 0 2024-09-10T09:36:14.902 INFO:tasks.workunit.client.1.smithi135.stdout:3/43: creat d4/d5/dc/f10 x:0 0 0 2024-09-10T09:36:14.902 INFO:tasks.workunit.client.1.smithi135.stdout:0/165: dread d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:36:14.904 INFO:tasks.workunit.client.1.smithi135.stdout:0/166: symlink d8/dd/d11/l32 0 2024-09-10T09:36:14.904 INFO:tasks.workunit.client.1.smithi135.stdout:8/88: dwrite d1/fb [0,4194304] 0 2024-09-10T09:36:14.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/89: write d1/f11 [653882,87091] 0 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:6/130: sync 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:2/98: sync 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:4/232: sync 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:4/233: write d1/d33/d40/f4d [1029943,54836] 0 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:4/234: chown d1/de/d16/f3b 1931409 1 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/104: sync 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:9/59: sync 2024-09-10T09:36:14.908 INFO:tasks.workunit.client.1.smithi135.stdout:9/60: read - de/df/f11 zero size 2024-09-10T09:36:14.913 INFO:tasks.workunit.client.1.smithi135.stdout:2/99: symlink df/d1b/l21 0 2024-09-10T09:36:14.916 INFO:tasks.workunit.client.1.smithi135.stdout:0/167: dread f4 [0,4194304] 0 2024-09-10T09:36:14.920 INFO:tasks.workunit.client.1.smithi135.stdout:9/61: dread f4 [0,4194304] 0 2024-09-10T09:36:14.921 INFO:tasks.workunit.client.1.smithi135.stdout:4/235: mknod d1/d33/d40/c4f 0 2024-09-10T09:36:14.921 INFO:tasks.workunit.client.1.smithi135.stdout:4/236: stat d1/de/f34 0 2024-09-10T09:36:14.923 INFO:tasks.workunit.client.1.smithi135.stdout:8/90: write d1/fd [96032,82940] 0 2024-09-10T09:36:14.926 INFO:tasks.workunit.client.1.smithi135.stdout:7/105: creat d2/d15/f20 x:0 0 0 2024-09-10T09:36:14.926 INFO:tasks.workunit.client.1.smithi135.stdout:7/106: creat d2/d15/f21 x:0 0 0 2024-09-10T09:36:14.926 INFO:tasks.workunit.client.1.smithi135.stdout:0/168: dread f4 [0,4194304] 0 2024-09-10T09:36:14.927 INFO:tasks.workunit.client.1.smithi135.stdout:2/100: unlink f3 0 2024-09-10T09:36:14.928 INFO:tasks.workunit.client.1.smithi135.stdout:3/44: dwrite f2 [0,4194304] 0 2024-09-10T09:36:14.928 INFO:tasks.workunit.client.1.smithi135.stdout:3/45: truncate f2 4346324 0 2024-09-10T09:36:14.928 INFO:tasks.workunit.client.1.smithi135.stdout:3/46: fsync f3 0 2024-09-10T09:36:14.928 INFO:tasks.workunit.client.1.smithi135.stdout:3/47: stat d4/d5/dc/f10 0 2024-09-10T09:36:14.933 INFO:tasks.workunit.client.1.smithi135.stdout:9/62: truncate f9 602817 0 2024-09-10T09:36:14.933 INFO:tasks.workunit.client.1.smithi135.stdout:9/63: stat f4 0 2024-09-10T09:36:14.933 INFO:tasks.workunit.client.1.smithi135.stdout:9/64: stat f9 0 2024-09-10T09:36:14.934 INFO:tasks.workunit.client.1.smithi135.stdout:9/65: write de/df/f10 [535461,22556] 0 2024-09-10T09:36:14.938 INFO:tasks.workunit.client.1.smithi135.stdout:8/91: creat d1/d15/f19 x:0 0 0 2024-09-10T09:36:14.939 INFO:tasks.workunit.client.1.smithi135.stdout:6/131: dwrite d5/d15/f1c [0,4194304] 0 2024-09-10T09:36:14.941 INFO:tasks.workunit.client.1.smithi135.stdout:2/101: link df/d1b/l21 df/d15/l22 0 2024-09-10T09:36:14.941 INFO:tasks.workunit.client.1.smithi135.stdout:2/102: truncate df/d15/f1a 2620766 0 2024-09-10T09:36:14.941 INFO:tasks.workunit.client.1.smithi135.stdout:9/66: dread f4 [0,4194304] 0 2024-09-10T09:36:14.942 INFO:tasks.workunit.client.1.smithi135.stdout:9/67: write de/df/f10 [380729,100697] 0 2024-09-10T09:36:14.956 INFO:tasks.workunit.client.1.smithi135.stdout:9/68: dread f4 [4194304,4194304] 0 2024-09-10T09:36:14.956 INFO:tasks.workunit.client.1.smithi135.stdout:9/69: write de/df/f10 [1458978,82776] 0 2024-09-10T09:36:14.959 INFO:tasks.workunit.client.1.smithi135.stdout:3/48: dread f3 [0,4194304] 0 2024-09-10T09:36:14.959 INFO:tasks.workunit.client.1.smithi135.stdout:7/107: dwrite d2/d3/fe [0,4194304] 0 2024-09-10T09:36:14.959 INFO:tasks.workunit.client.1.smithi135.stdout:0/169: dwrite d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:36:14.959 INFO:tasks.workunit.client.1.smithi135.stdout:7/108: creat d2/d11/f22 x:0 0 0 2024-09-10T09:36:14.960 INFO:tasks.workunit.client.1.smithi135.stdout:6/132: creat d5/d15/d27/f2c x:0 0 0 2024-09-10T09:36:14.961 INFO:tasks.workunit.client.1.smithi135.stdout:2/103: mkdir df/d1b/d23 0 2024-09-10T09:36:14.961 INFO:tasks.workunit.client.1.smithi135.stdout:2/104: getdents df/d1b/d23 0 2024-09-10T09:36:14.962 INFO:tasks.workunit.client.1.smithi135.stdout:9/70: readlink l5 0 2024-09-10T09:36:14.970 INFO:tasks.workunit.client.1.smithi135.stdout:3/49: mknod d4/d5/db/c11 0 2024-09-10T09:36:14.973 INFO:tasks.workunit.client.1.smithi135.stdout:2/105: creat df/d15/f24 x:0 0 0 2024-09-10T09:36:14.974 INFO:tasks.workunit.client.1.smithi135.stdout:3/50: mknod d4/d5/db/dd/c12 0 2024-09-10T09:36:14.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/51: chown d4 14554654 1 2024-09-10T09:36:14.975 INFO:tasks.workunit.client.1.smithi135.stdout:7/109: rmdir d2/d15 39 2024-09-10T09:36:14.976 INFO:tasks.workunit.client.1.smithi135.stdout:2/106: mknod df/d13/c25 0 2024-09-10T09:36:14.976 INFO:tasks.workunit.client.1.smithi135.stdout:2/107: write f8 [3251172,102314] 0 2024-09-10T09:36:14.976 INFO:tasks.workunit.client.1.smithi135.stdout:5/39: sync 2024-09-10T09:36:14.977 INFO:tasks.workunit.client.1.smithi135.stdout:6/133: dread f3 [0,4194304] 0 2024-09-10T09:36:14.977 INFO:tasks.workunit.client.1.smithi135.stdout:9/71: link c8 de/df/c12 0 2024-09-10T09:36:14.977 INFO:tasks.workunit.client.1.smithi135.stdout:9/72: creat de/df/f13 x:0 0 0 2024-09-10T09:36:14.977 INFO:tasks.workunit.client.1.smithi135.stdout:9/73: fsync f9 0 2024-09-10T09:36:14.977 INFO:tasks.workunit.client.1.smithi135.stdout:9/74: write de/df/f10 [1716722,21755] 0 2024-09-10T09:36:14.978 INFO:tasks.workunit.client.1.smithi135.stdout:3/52: symlink d4/d5/l13 0 2024-09-10T09:36:14.979 INFO:tasks.workunit.client.1.smithi135.stdout:7/110: link d2/d3/c19 d2/d15/c23 0 2024-09-10T09:36:14.979 INFO:tasks.workunit.client.1.smithi135.stdout:0/170: dread d8/fb [0,4194304] 0 2024-09-10T09:36:14.980 INFO:tasks.workunit.client.1.smithi135.stdout:2/108: link df/f12 df/d1b/f26 0 2024-09-10T09:36:14.981 INFO:tasks.workunit.client.1.smithi135.stdout:5/40: unlink d3/f7 0 2024-09-10T09:36:14.983 INFO:tasks.workunit.client.1.smithi135.stdout:4/237: dwrite d1/de/d16/f21 [4194304,4194304] 0 2024-09-10T09:36:14.984 INFO:tasks.workunit.client.1.smithi135.stdout:8/92: dwrite d1/f5 [8388608,4194304] 0 2024-09-10T09:36:14.986 INFO:tasks.workunit.client.1.smithi135.stdout:3/53: unlink d4/d5/l13 0 2024-09-10T09:36:14.986 INFO:tasks.workunit.client.1.smithi135.stdout:3/54: readlink d4/l6 0 2024-09-10T09:36:14.988 INFO:tasks.workunit.client.1.smithi135.stdout:6/134: dread d5/fc [0,4194304] 0 2024-09-10T09:36:14.988 INFO:tasks.workunit.client.1.smithi135.stdout:0/171: mkdir d8/dd/d33 0 2024-09-10T09:36:14.988 INFO:tasks.workunit.client.1.smithi135.stdout:6/135: chown d5/d15/d27 22 1 2024-09-10T09:36:14.988 INFO:tasks.workunit.client.1.smithi135.stdout:6/136: dread - d5/d15/d27/f2c zero size 2024-09-10T09:36:14.989 INFO:tasks.workunit.client.1.smithi135.stdout:2/109: mkdir df/d1b/d27 0 2024-09-10T09:36:14.989 INFO:tasks.workunit.client.1.smithi135.stdout:2/110: chown df/d13/c25 120421 1 2024-09-10T09:36:14.990 INFO:tasks.workunit.client.1.smithi135.stdout:9/75: dread de/df/f10 [0,4194304] 0 2024-09-10T09:36:14.991 INFO:tasks.workunit.client.1.smithi135.stdout:4/238: symlink d1/d33/d40/l50 0 2024-09-10T09:36:14.994 INFO:tasks.workunit.client.1.smithi135.stdout:8/93: creat d1/d15/d16/f1a x:0 0 0 2024-09-10T09:36:14.996 INFO:tasks.workunit.client.1.smithi135.stdout:0/172: fdatasync d8/dd/d1e/f21 0 2024-09-10T09:36:14.997 INFO:tasks.workunit.client.1.smithi135.stdout:0/173: truncate d8/d1c/d2c/f30 451447 0 2024-09-10T09:36:14.997 INFO:tasks.workunit.client.1.smithi135.stdout:0/174: fsync d8/fb 0 2024-09-10T09:36:14.997 INFO:tasks.workunit.client.1.smithi135.stdout:3/55: unlink d4/l8 0 2024-09-10T09:36:15.001 INFO:tasks.workunit.client.1.smithi135.stdout:6/137: unlink d5/c26 0 2024-09-10T09:36:15.005 INFO:tasks.workunit.client.1.smithi135.stdout:2/111: truncate df/d1b/f26 1134864 0 2024-09-10T09:36:15.012 INFO:tasks.workunit.client.1.smithi135.stdout:9/76: unlink de/df/c12 0 2024-09-10T09:36:15.012 INFO:tasks.workunit.client.1.smithi135.stdout:7/111: dwrite d2/d3/fe [0,4194304] 0 2024-09-10T09:36:15.012 INFO:tasks.workunit.client.1.smithi135.stdout:8/94: dread d1/f5 [8388608,4194304] 0 2024-09-10T09:36:15.012 INFO:tasks.workunit.client.1.smithi135.stdout:7/112: fdatasync d2/d15/f21 0 2024-09-10T09:36:15.014 INFO:tasks.workunit.client.1.smithi135.stdout:1/49: sync 2024-09-10T09:36:15.020 INFO:tasks.workunit.client.1.smithi135.stdout:9/77: symlink de/df/l14 0 2024-09-10T09:36:15.020 INFO:tasks.workunit.client.1.smithi135.stdout:9/78: dread - de/df/f13 zero size 2024-09-10T09:36:15.024 INFO:tasks.workunit.client.1.smithi135.stdout:8/95: creat d1/d13/f1b x:0 0 0 2024-09-10T09:36:15.025 INFO:tasks.workunit.client.1.smithi135.stdout:8/96: write d1/f11 [2159246,108388] 0 2024-09-10T09:36:15.025 INFO:tasks.workunit.client.1.smithi135.stdout:0/175: dwrite d8/dd/d1e/f23 [0,4194304] 0 2024-09-10T09:36:15.029 INFO:tasks.workunit.client.1.smithi135.stdout:8/97: unlink d1/f11 0 2024-09-10T09:36:15.029 INFO:tasks.workunit.client.1.smithi135.stdout:3/56: dwrite f2 [0,4194304] 0 2024-09-10T09:36:15.029 INFO:tasks.workunit.client.1.smithi135.stdout:3/57: fsync d4/d5/dc/f10 0 2024-09-10T09:36:15.030 INFO:tasks.workunit.client.1.smithi135.stdout:2/112: rmdir df/d13 39 2024-09-10T09:36:15.030 INFO:tasks.workunit.client.1.smithi135.stdout:5/41: dwrite d3/f8 [0,4194304] 0 2024-09-10T09:36:15.030 INFO:tasks.workunit.client.1.smithi135.stdout:5/42: write d3/f5 [1005342,93519] 0 2024-09-10T09:36:15.030 INFO:tasks.workunit.client.1.smithi135.stdout:5/43: creat d3/f9 x:0 0 0 2024-09-10T09:36:15.036 INFO:tasks.workunit.client.1.smithi135.stdout:1/50: rename f7 to fc 0 2024-09-10T09:36:15.038 INFO:tasks.workunit.client.1.smithi135.stdout:8/98: symlink d1/d15/l1c 0 2024-09-10T09:36:15.038 INFO:tasks.workunit.client.1.smithi135.stdout:8/99: stat d1/d15/l1c 0 2024-09-10T09:36:15.038 INFO:tasks.workunit.client.1.smithi135.stdout:5/44: dread d3/f5 [0,4194304] 0 2024-09-10T09:36:15.039 INFO:tasks.workunit.client.1.smithi135.stdout:3/58: symlink d4/d5/db/l14 0 2024-09-10T09:36:15.039 INFO:tasks.workunit.client.1.smithi135.stdout:3/59: creat d4/f15 x:0 0 0 2024-09-10T09:36:15.040 INFO:tasks.workunit.client.1.smithi135.stdout:3/60: readlink d4/d5/db/dd/le 0 2024-09-10T09:36:15.041 INFO:tasks.workunit.client.1.smithi135.stdout:2/113: unlink df/d13/c25 0 2024-09-10T09:36:15.044 INFO:tasks.workunit.client.1.smithi135.stdout:3/61: read f3 [1989705,60143] 0 2024-09-10T09:36:15.049 INFO:tasks.workunit.client.1.smithi135.stdout:6/138: dwrite d5/d15/f22 [0,4194304] 0 2024-09-10T09:36:15.049 INFO:tasks.workunit.client.1.smithi135.stdout:3/62: dread f3 [0,4194304] 0 2024-09-10T09:36:15.049 INFO:tasks.workunit.client.1.smithi135.stdout:3/63: write d4/f9 [44531,67648] 0 2024-09-10T09:36:15.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/79: dwrite de/df/f13 [0,4194304] 0 2024-09-10T09:36:15.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/80: chown f9 0 1 2024-09-10T09:36:15.050 INFO:tasks.workunit.client.1.smithi135.stdout:7/113: dwrite d2/d15/f21 [0,4194304] 0 2024-09-10T09:36:15.050 INFO:tasks.workunit.client.1.smithi135.stdout:2/114: write df/d15/f1a [1159740,64310] 0 2024-09-10T09:36:15.050 INFO:tasks.workunit.client.1.smithi135.stdout:2/115: chown la 32070 1 2024-09-10T09:36:15.053 INFO:tasks.workunit.client.1.smithi135.stdout:8/100: symlink d1/l1d 0 2024-09-10T09:36:15.054 INFO:tasks.workunit.client.1.smithi135.stdout:3/64: dread f3 [0,4194304] 0 2024-09-10T09:36:15.057 INFO:tasks.workunit.client.1.smithi135.stdout:5/45: rename f0 to d3/fa 0 2024-09-10T09:36:15.071 INFO:tasks.workunit.client.1.smithi135.stdout:6/139: dwrite d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:15.071 INFO:tasks.workunit.client.1.smithi135.stdout:6/140: write d5/d12/f21 [675011,116972] 0 2024-09-10T09:36:15.081 INFO:tasks.workunit.client.1.smithi135.stdout:2/116: creat df/d1b/d23/f28 x:0 0 0 2024-09-10T09:36:15.081 INFO:tasks.workunit.client.1.smithi135.stdout:2/117: chown df/d15/l22 462960407 1 2024-09-10T09:36:15.082 INFO:tasks.workunit.client.1.smithi135.stdout:1/51: getdents . 0 2024-09-10T09:36:15.084 INFO:tasks.workunit.client.1.smithi135.stdout:3/65: dwrite d4/d5/dc/f10 [0,4194304] 0 2024-09-10T09:36:15.084 INFO:tasks.workunit.client.1.smithi135.stdout:8/101: mknod d1/d15/c1e 0 2024-09-10T09:36:15.086 INFO:tasks.workunit.client.1.smithi135.stdout:5/46: unlink d3/c6 0 2024-09-10T09:36:15.087 INFO:tasks.workunit.client.1.smithi135.stdout:5/47: dread d3/f5 [0,4194304] 0 2024-09-10T09:36:15.094 INFO:tasks.workunit.client.1.smithi135.stdout:5/48: write d3/f4 [2033160,100470] 0 2024-09-10T09:36:15.094 INFO:tasks.workunit.client.1.smithi135.stdout:0/176: dwrite d8/dd/f13 [0,4194304] 0 2024-09-10T09:36:15.099 INFO:tasks.workunit.client.1.smithi135.stdout:7/114: rmdir d2 39 2024-09-10T09:36:15.105 INFO:tasks.workunit.client.1.smithi135.stdout:2/118: mknod df/d1b/d23/c29 0 2024-09-10T09:36:15.109 INFO:tasks.workunit.client.1.smithi135.stdout:6/141: write d5/d15/f22 [4169035,106481] 0 2024-09-10T09:36:15.109 INFO:tasks.workunit.client.1.smithi135.stdout:6/142: readlink d5/l9 0 2024-09-10T09:36:15.111 INFO:tasks.workunit.client.1.smithi135.stdout:3/66: mknod d4/d5/db/c16 0 2024-09-10T09:36:15.111 INFO:tasks.workunit.client.1.smithi135.stdout:3/67: chown d4/d5/db 306877 1 2024-09-10T09:36:15.111 INFO:tasks.workunit.client.1.smithi135.stdout:9/81: dwrite f6 [0,4194304] 0 2024-09-10T09:36:15.112 INFO:tasks.workunit.client.1.smithi135.stdout:8/102: mknod d1/c1f 0 2024-09-10T09:36:15.112 INFO:tasks.workunit.client.1.smithi135.stdout:8/103: creat d1/f20 x:0 0 0 2024-09-10T09:36:15.112 INFO:tasks.workunit.client.1.smithi135.stdout:8/104: readlink d1/d15/l1c 0 2024-09-10T09:36:15.112 INFO:tasks.workunit.client.1.smithi135.stdout:3/68: dread f1 [4194304,4194304] 0 2024-09-10T09:36:15.119 INFO:tasks.workunit.client.1.smithi135.stdout:0/177: dwrite f4 [0,4194304] 0 2024-09-10T09:36:15.119 INFO:tasks.workunit.client.1.smithi135.stdout:2/119: symlink df/d13/l2a 0 2024-09-10T09:36:15.120 INFO:tasks.workunit.client.1.smithi135.stdout:7/115: dwrite d2/d11/f22 [0,4194304] 0 2024-09-10T09:36:15.122 INFO:tasks.workunit.client.1.smithi135.stdout:1/52: mknod cd 0 2024-09-10T09:36:15.122 INFO:tasks.workunit.client.1.smithi135.stdout:1/53: fdatasync f4 0 2024-09-10T09:36:15.122 INFO:tasks.workunit.client.1.smithi135.stdout:1/54: chown f6 864296 1 2024-09-10T09:36:15.123 INFO:tasks.workunit.client.1.smithi135.stdout:1/55: dread - fb zero size 2024-09-10T09:36:15.123 INFO:tasks.workunit.client.1.smithi135.stdout:3/69: dread f2 [0,4194304] 0 2024-09-10T09:36:15.128 INFO:tasks.workunit.client.1.smithi135.stdout:7/116: dread d2/f1f [0,4194304] 0 2024-09-10T09:36:15.131 INFO:tasks.workunit.client.1.smithi135.stdout:6/143: mkdir d5/dd/d29/d2d 0 2024-09-10T09:36:15.131 INFO:tasks.workunit.client.1.smithi135.stdout:6/144: creat d5/dd/d29/f2e x:0 0 0 2024-09-10T09:36:15.133 INFO:tasks.workunit.client.1.smithi135.stdout:9/82: creat de/f15 x:0 0 0 2024-09-10T09:36:15.134 INFO:tasks.workunit.client.1.smithi135.stdout:8/105: mknod d1/d15/c21 0 2024-09-10T09:36:15.136 INFO:tasks.workunit.client.1.smithi135.stdout:5/49: rmdir d3 39 2024-09-10T09:36:15.137 INFO:tasks.workunit.client.1.smithi135.stdout:0/178: creat d8/d1c/f34 x:0 0 0 2024-09-10T09:36:15.137 INFO:tasks.workunit.client.1.smithi135.stdout:0/179: truncate d8/dd/d11/f2b 675773 0 2024-09-10T09:36:15.137 INFO:tasks.workunit.client.1.smithi135.stdout:0/180: write d8/d1c/f34 [625101,117945] 0 2024-09-10T09:36:15.144 INFO:tasks.workunit.client.1.smithi135.stdout:3/70: unlink f2 0 2024-09-10T09:36:15.144 INFO:tasks.workunit.client.1.smithi135.stdout:3/71: chown d4 95891921 1 2024-09-10T09:36:15.146 INFO:tasks.workunit.client.1.smithi135.stdout:7/117: rename d2/d11/f14 to d2/d15/f24 0 2024-09-10T09:36:15.149 INFO:tasks.workunit.client.1.smithi135.stdout:6/145: creat d5/d1e/f2f x:0 0 0 2024-09-10T09:36:15.150 INFO:tasks.workunit.client.1.smithi135.stdout:9/83: mknod de/c16 0 2024-09-10T09:36:15.150 INFO:tasks.workunit.client.1.smithi135.stdout:9/84: read f4 [4108331,110712] 0 2024-09-10T09:36:15.152 INFO:tasks.workunit.client.1.smithi135.stdout:9/85: dread f9 [0,4194304] 0 2024-09-10T09:36:15.153 INFO:tasks.workunit.client.1.smithi135.stdout:8/106: symlink d1/d15/d16/l22 0 2024-09-10T09:36:15.154 INFO:tasks.workunit.client.1.smithi135.stdout:2/120: getdents df/d15 0 2024-09-10T09:36:15.154 INFO:tasks.workunit.client.1.smithi135.stdout:2/121: getdents df/d1b/d27 0 2024-09-10T09:36:15.154 INFO:tasks.workunit.client.1.smithi135.stdout:2/122: fdatasync df/d15/f24 0 2024-09-10T09:36:15.159 INFO:tasks.workunit.client.1.smithi135.stdout:1/56: symlink le 0 2024-09-10T09:36:15.160 INFO:tasks.workunit.client.1.smithi135.stdout:3/72: link d4/f15 d4/d5/dc/f17 0 2024-09-10T09:36:15.162 INFO:tasks.workunit.client.1.smithi135.stdout:2/123: dread df/f12 [0,4194304] 0 2024-09-10T09:36:15.163 INFO:tasks.workunit.client.1.smithi135.stdout:6/146: creat d5/d12/f30 x:0 0 0 2024-09-10T09:36:15.164 INFO:tasks.workunit.client.1.smithi135.stdout:5/50: dwrite d3/f4 [0,4194304] 0 2024-09-10T09:36:15.164 INFO:tasks.workunit.client.1.smithi135.stdout:5/51: truncate f2 1536659 0 2024-09-10T09:36:15.164 INFO:tasks.workunit.client.1.smithi135.stdout:3/73: symlink d4/d5/dc/l18 0 2024-09-10T09:36:15.165 INFO:tasks.workunit.client.1.smithi135.stdout:7/118: mkdir d2/d25 0 2024-09-10T09:36:15.166 INFO:tasks.workunit.client.1.smithi135.stdout:9/86: dread de/df/f13 [0,4194304] 0 2024-09-10T09:36:15.166 INFO:tasks.workunit.client.1.smithi135.stdout:0/181: dwrite d8/fb [0,4194304] 0 2024-09-10T09:36:15.166 INFO:tasks.workunit.client.1.smithi135.stdout:0/182: write d8/dd/d11/f1f [459232,31379] 0 2024-09-10T09:36:15.167 INFO:tasks.workunit.client.1.smithi135.stdout:2/124: rmdir df/d1b 39 2024-09-10T09:36:15.167 INFO:tasks.workunit.client.1.smithi135.stdout:2/125: getdents df/d1b/d27 0 2024-09-10T09:36:15.167 INFO:tasks.workunit.client.1.smithi135.stdout:2/126: chown df/d15/l20 56973680 1 2024-09-10T09:36:15.167 INFO:tasks.workunit.client.1.smithi135.stdout:2/127: truncate df/d1b/d23/f28 1042466 0 2024-09-10T09:36:15.171 INFO:tasks.workunit.client.1.smithi135.stdout:5/52: rename d3/f4 to d3/fb 0 2024-09-10T09:36:15.173 INFO:tasks.workunit.client.1.smithi135.stdout:3/74: link f1 d4/d5/dc/f19 0 2024-09-10T09:36:15.173 INFO:tasks.workunit.client.1.smithi135.stdout:3/75: stat d4/f9 0 2024-09-10T09:36:15.173 INFO:tasks.workunit.client.1.smithi135.stdout:3/76: fdatasync d4/f15 0 2024-09-10T09:36:15.173 INFO:tasks.workunit.client.1.smithi135.stdout:3/77: write d4/d5/dc/f10 [5076383,80861] 0 2024-09-10T09:36:15.174 INFO:tasks.workunit.client.1.smithi135.stdout:3/78: readlink d4/d5/db/dd/le 0 2024-09-10T09:36:15.174 INFO:tasks.workunit.client.1.smithi135.stdout:8/107: dwrite d1/f14 [0,4194304] 0 2024-09-10T09:36:15.175 INFO:tasks.workunit.client.1.smithi135.stdout:8/108: creat d1/f23 x:0 0 0 2024-09-10T09:36:15.175 INFO:tasks.workunit.client.1.smithi135.stdout:9/87: read de/df/f13 [3585493,75227] 0 2024-09-10T09:36:15.175 INFO:tasks.workunit.client.1.smithi135.stdout:9/88: chown cc 2897 1 2024-09-10T09:36:15.175 INFO:tasks.workunit.client.1.smithi135.stdout:9/89: creat de/f17 x:0 0 0 2024-09-10T09:36:15.176 INFO:tasks.workunit.client.1.smithi135.stdout:0/183: creat d8/dd/f35 x:0 0 0 2024-09-10T09:36:15.176 INFO:tasks.workunit.client.1.smithi135.stdout:0/184: write d8/f26 [572534,109820] 0 2024-09-10T09:36:15.177 INFO:tasks.workunit.client.1.smithi135.stdout:2/128: dread df/f12 [0,4194304] 0 2024-09-10T09:36:15.177 INFO:tasks.workunit.client.1.smithi135.stdout:3/79: dread d4/f9 [0,4194304] 0 2024-09-10T09:36:15.177 INFO:tasks.workunit.client.1.smithi135.stdout:3/80: chown d4/f15 29480382 1 2024-09-10T09:36:15.177 INFO:tasks.workunit.client.1.smithi135.stdout:6/147: rmdir d5/d15/d27 39 2024-09-10T09:36:15.177 INFO:tasks.workunit.client.1.smithi135.stdout:6/148: chown f4 3 1 2024-09-10T09:36:15.178 INFO:tasks.workunit.client.1.smithi135.stdout:6/149: chown d5/d12/l18 0 1 2024-09-10T09:36:15.180 INFO:tasks.workunit.client.1.smithi135.stdout:5/53: mkdir d3/dc 0 2024-09-10T09:36:15.186 INFO:tasks.workunit.client.1.smithi135.stdout:7/119: mkdir d2/d26 0 2024-09-10T09:36:15.186 INFO:tasks.workunit.client.1.smithi135.stdout:1/57: dwrite fb [0,4194304] 0 2024-09-10T09:36:15.186 INFO:tasks.workunit.client.1.smithi135.stdout:1/58: chown f6 4247 1 2024-09-10T09:36:15.186 INFO:tasks.workunit.client.1.smithi135.stdout:7/120: write d2/f10 [1149122,40016] 0 2024-09-10T09:36:15.186 INFO:tasks.workunit.client.1.smithi135.stdout:7/121: chown d2/d11 113362725 1 2024-09-10T09:36:15.186 INFO:tasks.workunit.client.1.smithi135.stdout:7/122: chown d2/d3 0 1 2024-09-10T09:36:15.186 INFO:tasks.workunit.client.1.smithi135.stdout:7/123: chown d2/d11 0 1 2024-09-10T09:36:15.187 INFO:tasks.workunit.client.1.smithi135.stdout:8/109: dread d1/fd [0,4194304] 0 2024-09-10T09:36:15.187 INFO:tasks.workunit.client.1.smithi135.stdout:8/110: chown d1/d15/l1c 23 1 2024-09-10T09:36:15.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/90: link de/df/f10 de/f18 0 2024-09-10T09:36:15.194 INFO:tasks.workunit.client.1.smithi135.stdout:3/81: link d4/d5/db/l14 d4/d5/db/l1a 0 2024-09-10T09:36:15.195 INFO:tasks.workunit.client.1.smithi135.stdout:6/150: stat d5/d15/l1a 0 2024-09-10T09:36:15.197 INFO:tasks.workunit.client.1.smithi135.stdout:2/129: dwrite df/d15/f1a [0,4194304] 0 2024-09-10T09:36:15.198 INFO:tasks.workunit.client.1.smithi135.stdout:5/54: creat d3/fd x:0 0 0 2024-09-10T09:36:15.198 INFO:tasks.workunit.client.1.smithi135.stdout:2/130: chown df/d15/f24 88021856 1 2024-09-10T09:36:15.198 INFO:tasks.workunit.client.1.smithi135.stdout:2/131: chown df/d15/f1a 3846705 1 2024-09-10T09:36:15.200 INFO:tasks.workunit.client.1.smithi135.stdout:7/124: creat d2/d11/f27 x:0 0 0 2024-09-10T09:36:15.222 INFO:tasks.workunit.client.1.smithi135.stdout:8/111: mkdir d1/d15/d24 0 2024-09-10T09:36:15.222 INFO:tasks.workunit.client.1.smithi135.stdout:8/112: creat d1/f25 x:0 0 0 2024-09-10T09:36:15.222 INFO:tasks.workunit.client.1.smithi135.stdout:8/113: dread - d1/d13/f1b zero size 2024-09-10T09:36:15.223 INFO:tasks.workunit.client.1.smithi135.stdout:9/91: symlink de/df/l19 0 2024-09-10T09:36:15.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/151: creat d5/dd/d29/d2d/f31 x:0 0 0 2024-09-10T09:36:15.229 INFO:tasks.workunit.client.1.smithi135.stdout:8/114: write d1/fd [5279583,118288] 0 2024-09-10T09:36:15.229 INFO:tasks.workunit.client.1.smithi135.stdout:8/115: write d1/f14 [7548881,35538] 0 2024-09-10T09:36:15.231 INFO:tasks.workunit.client.1.smithi135.stdout:5/55: dwrite d3/fb [0,4194304] 0 2024-09-10T09:36:15.235 INFO:tasks.workunit.client.1.smithi135.stdout:1/59: symlink lf 0 2024-09-10T09:36:15.236 INFO:tasks.workunit.client.1.smithi135.stdout:0/185: truncate d8/fb 467318 0 2024-09-10T09:36:15.237 INFO:tasks.workunit.client.1.smithi135.stdout:7/125: creat d2/d11/d16/f28 x:0 0 0 2024-09-10T09:36:15.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/92: mknod de/c1a 0 2024-09-10T09:36:15.241 INFO:tasks.workunit.client.1.smithi135.stdout:6/152: truncate d5/d15/f1c 782202 0 2024-09-10T09:36:15.241 INFO:tasks.workunit.client.1.smithi135.stdout:6/153: readlink d5/dd/l23 0 2024-09-10T09:36:15.244 INFO:tasks.workunit.client.1.smithi135.stdout:8/116: link d1/f23 d1/d15/d16/f26 0 2024-09-10T09:36:15.246 INFO:tasks.workunit.client.1.smithi135.stdout:0/186: fsync d8/fb 0 2024-09-10T09:36:15.247 INFO:tasks.workunit.client.1.smithi135.stdout:5/56: mknod d3/dc/ce 0 2024-09-10T09:36:15.247 INFO:tasks.workunit.client.1.smithi135.stdout:5/57: write d3/fb [4776295,99757] 0 2024-09-10T09:36:15.253 INFO:tasks.workunit.client.1.smithi135.stdout:6/154: getdents d5/dd 0 2024-09-10T09:36:15.254 INFO:tasks.workunit.client.1.smithi135.stdout:6/155: dread - d5/dd/d29/f2a zero size 2024-09-10T09:36:15.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/117: mkdir d1/d27 0 2024-09-10T09:36:15.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/118: readlink d1/d15/d16/l22 0 2024-09-10T09:36:15.257 INFO:tasks.workunit.client.1.smithi135.stdout:1/60: link fc f10 0 2024-09-10T09:36:15.257 INFO:tasks.workunit.client.1.smithi135.stdout:1/61: chown f3 1309 1 2024-09-10T09:36:15.259 INFO:tasks.workunit.client.1.smithi135.stdout:7/126: mknod d2/c29 0 2024-09-10T09:36:15.262 INFO:tasks.workunit.client.1.smithi135.stdout:8/119: symlink d1/d15/d16/l28 0 2024-09-10T09:36:15.264 INFO:tasks.workunit.client.1.smithi135.stdout:1/62: creat f11 x:0 0 0 2024-09-10T09:36:15.264 INFO:tasks.workunit.client.1.smithi135.stdout:1/63: fsync fb 0 2024-09-10T09:36:15.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/93: dwrite de/f15 [0,4194304] 0 2024-09-10T09:36:15.268 INFO:tasks.workunit.client.1.smithi135.stdout:8/120: unlink d1/d15/c18 0 2024-09-10T09:36:15.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/94: read f9 [129115,94400] 0 2024-09-10T09:36:15.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/95: creat de/df/f1b x:0 0 0 2024-09-10T09:36:15.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/96: write de/df/f1b [362825,59690] 0 2024-09-10T09:36:15.278 INFO:tasks.workunit.client.1.smithi135.stdout:7/127: dread d2/d11/f22 [0,4194304] 0 2024-09-10T09:36:15.281 INFO:tasks.workunit.client.1.smithi135.stdout:8/121: rename d1/fb to d1/d15/d16/f29 0 2024-09-10T09:36:15.281 INFO:tasks.workunit.client.1.smithi135.stdout:8/122: creat d1/d15/d16/f2a x:0 0 0 2024-09-10T09:36:15.284 INFO:tasks.workunit.client.1.smithi135.stdout:7/128: rmdir d2/d15/d1b 0 2024-09-10T09:36:15.285 INFO:tasks.workunit.client.1.smithi135.stdout:6/156: dwrite d5/f6 [0,4194304] 0 2024-09-10T09:36:15.285 INFO:tasks.workunit.client.1.smithi135.stdout:6/157: creat d5/dd/d29/d2d/f32 x:0 0 0 2024-09-10T09:36:15.286 INFO:tasks.workunit.client.1.smithi135.stdout:6/158: write d5/d12/f21 [77119,45798] 0 2024-09-10T09:36:15.289 INFO:tasks.workunit.client.1.smithi135.stdout:8/123: rename d1/d15/d16/l28 to d1/d27/l2b 0 2024-09-10T09:36:15.289 INFO:tasks.workunit.client.1.smithi135.stdout:8/124: dread - d1/d13/f1b zero size 2024-09-10T09:36:15.292 INFO:tasks.workunit.client.1.smithi135.stdout:9/97: dwrite de/df/f10 [0,4194304] 0 2024-09-10T09:36:15.292 INFO:tasks.workunit.client.1.smithi135.stdout:7/129: link d2/d11/d16/f28 d2/d25/f2a 0 2024-09-10T09:36:15.293 INFO:tasks.workunit.client.1.smithi135.stdout:7/130: creat d2/d11/d16/f2b x:0 0 0 2024-09-10T09:36:15.294 INFO:tasks.workunit.client.1.smithi135.stdout:6/159: symlink d5/dd/d29/d2d/l33 0 2024-09-10T09:36:15.294 INFO:tasks.workunit.client.1.smithi135.stdout:6/160: fsync d5/f7 0 2024-09-10T09:36:15.296 INFO:tasks.workunit.client.1.smithi135.stdout:8/125: creat d1/d15/d24/f2c x:0 0 0 2024-09-10T09:36:15.300 INFO:tasks.workunit.client.1.smithi135.stdout:9/98: mknod de/c1c 0 2024-09-10T09:36:15.300 INFO:tasks.workunit.client.1.smithi135.stdout:9/99: fsync de/f15 0 2024-09-10T09:36:15.300 INFO:tasks.workunit.client.1.smithi135.stdout:9/100: fsync de/df/f10 0 2024-09-10T09:36:15.302 INFO:tasks.workunit.client.1.smithi135.stdout:7/131: truncate d2/f13 6062317 0 2024-09-10T09:36:15.303 INFO:tasks.workunit.client.1.smithi135.stdout:0/187: dwrite d8/fc [4194304,4194304] 0 2024-09-10T09:36:15.303 INFO:tasks.workunit.client.1.smithi135.stdout:0/188: readlink d8/l12 0 2024-09-10T09:36:15.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/58: dwrite d3/f5 [0,4194304] 0 2024-09-10T09:36:15.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/59: creat d3/ff x:0 0 0 2024-09-10T09:36:15.304 INFO:tasks.workunit.client.1.smithi135.stdout:1/64: dwrite f3 [0,4194304] 0 2024-09-10T09:36:15.305 INFO:tasks.workunit.client.1.smithi135.stdout:1/65: write f10 [1026213,42053] 0 2024-09-10T09:36:15.307 INFO:tasks.workunit.client.1.smithi135.stdout:6/161: rename d5/dd/f20 to d5/dd/d29/f34 0 2024-09-10T09:36:15.307 INFO:tasks.workunit.client.1.smithi135.stdout:6/162: fdatasync f3 0 2024-09-10T09:36:15.310 INFO:tasks.workunit.client.1.smithi135.stdout:9/101: mkdir de/df/d1d 0 2024-09-10T09:36:15.317 INFO:tasks.workunit.client.1.smithi135.stdout:5/60: read d3/fb [3082354,87769] 0 2024-09-10T09:36:15.318 INFO:tasks.workunit.client.1.smithi135.stdout:5/61: fsync d3/f8 0 2024-09-10T09:36:15.318 INFO:tasks.workunit.client.1.smithi135.stdout:5/62: write d3/fd [213241,48733] 0 2024-09-10T09:36:15.318 INFO:tasks.workunit.client.1.smithi135.stdout:5/63: dread - d3/ff zero size 2024-09-10T09:36:15.318 INFO:tasks.workunit.client.1.smithi135.stdout:8/126: dwrite d1/d15/d16/f26 [0,4194304] 0 2024-09-10T09:36:15.318 INFO:tasks.workunit.client.1.smithi135.stdout:8/127: readlink d1/l8 0 2024-09-10T09:36:15.319 INFO:tasks.workunit.client.1.smithi135.stdout:7/132: creat d2/d15/f2c x:0 0 0 2024-09-10T09:36:15.319 INFO:tasks.workunit.client.1.smithi135.stdout:7/133: dread - d2/d25/f2a zero size 2024-09-10T09:36:15.328 INFO:tasks.workunit.client.1.smithi135.stdout:9/102: write de/f18 [444743,81298] 0 2024-09-10T09:36:15.328 INFO:tasks.workunit.client.1.smithi135.stdout:9/103: truncate de/f17 142011 0 2024-09-10T09:36:15.328 INFO:tasks.workunit.client.1.smithi135.stdout:9/104: chown c8 3373 1 2024-09-10T09:36:15.329 INFO:tasks.workunit.client.1.smithi135.stdout:6/163: dwrite d5/f7 [0,4194304] 0 2024-09-10T09:36:15.329 INFO:tasks.workunit.client.1.smithi135.stdout:6/164: chown d5/f17 30459 1 2024-09-10T09:36:15.329 INFO:tasks.workunit.client.1.smithi135.stdout:6/165: read - d5/dd/d29/d2d/f31 zero size 2024-09-10T09:36:15.331 INFO:tasks.workunit.client.1.smithi135.stdout:8/128: write d1/f23 [1089773,44965] 0 2024-09-10T09:36:15.348 INFO:tasks.workunit.client.1.smithi135.stdout:7/134: getdents d2/d3 0 2024-09-10T09:36:15.348 INFO:tasks.workunit.client.1.smithi135.stdout:7/135: creat d2/d15/f2d x:0 0 0 2024-09-10T09:36:15.348 INFO:tasks.workunit.client.1.smithi135.stdout:7/136: truncate d2/d11/d16/f2b 848684 0 2024-09-10T09:36:15.349 INFO:tasks.workunit.client.1.smithi135.stdout:8/129: dwrite d1/d15/d16/f26 [0,4194304] 0 2024-09-10T09:36:15.351 INFO:tasks.workunit.client.1.smithi135.stdout:0/189: rmdir d8/d1c 39 2024-09-10T09:36:15.354 INFO:tasks.workunit.client.1.smithi135.stdout:9/105: mkdir de/df/d1d/d1e 0 2024-09-10T09:36:15.358 INFO:tasks.workunit.client.1.smithi135.stdout:1/66: mknod c12 0 2024-09-10T09:36:15.360 INFO:tasks.workunit.client.1.smithi135.stdout:5/64: rmdir d3 39 2024-09-10T09:36:15.367 INFO:tasks.workunit.client.1.smithi135.stdout:8/130: truncate d1/f14 12041531 0 2024-09-10T09:36:15.368 INFO:tasks.workunit.client.1.smithi135.stdout:9/106: creat de/df/d1d/f1f x:0 0 0 2024-09-10T09:36:15.373 INFO:tasks.workunit.client.1.smithi135.stdout:5/65: creat d3/dc/f10 x:0 0 0 2024-09-10T09:36:15.374 INFO:tasks.workunit.client.1.smithi135.stdout:5/66: chown d3/dc/f10 929407099 1 2024-09-10T09:36:15.374 INFO:tasks.workunit.client.1.smithi135.stdout:5/67: write d3/dc/f10 [189826,124552] 0 2024-09-10T09:36:15.375 INFO:tasks.workunit.client.1.smithi135.stdout:1/67: dwrite f10 [0,4194304] 0 2024-09-10T09:36:15.376 INFO:tasks.workunit.client.1.smithi135.stdout:7/137: rename d2/f13 to d2/f2e 0 2024-09-10T09:36:15.376 INFO:tasks.workunit.client.1.smithi135.stdout:7/138: truncate d2/f1e 127055 0 2024-09-10T09:36:15.376 INFO:tasks.workunit.client.1.smithi135.stdout:7/139: creat d2/d15/f2f x:0 0 0 2024-09-10T09:36:15.378 INFO:tasks.workunit.client.1.smithi135.stdout:6/166: rename d5/d12 to d5/d1e/d35 0 2024-09-10T09:36:15.383 INFO:tasks.workunit.client.1.smithi135.stdout:5/68: truncate d3/f5 3498345 0 2024-09-10T09:36:15.383 INFO:tasks.workunit.client.1.smithi135.stdout:5/69: write d3/dc/f10 [728824,106097] 0 2024-09-10T09:36:15.386 INFO:tasks.workunit.client.1.smithi135.stdout:4/239: sync 2024-09-10T09:36:15.386 INFO:tasks.workunit.client.1.smithi135.stdout:7/140: mkdir d2/d11/d30 0 2024-09-10T09:36:15.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/190: rename f7 to d8/d1c/d2c/f36 0 2024-09-10T09:36:15.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/191: fdatasync d8/dd/f35 0 2024-09-10T09:36:15.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/192: chown d8/fc 426 1 2024-09-10T09:36:15.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/193: fdatasync d8/dd/f10 0 2024-09-10T09:36:15.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/194: fdatasync d8/d1c/d2c/f36 0 2024-09-10T09:36:15.389 INFO:tasks.workunit.client.1.smithi135.stdout:0/195: chown d8/dd/d11/f1f 180542 1 2024-09-10T09:36:15.390 INFO:tasks.workunit.client.1.smithi135.stdout:6/167: symlink d5/d15/d27/l36 0 2024-09-10T09:36:15.391 INFO:tasks.workunit.client.1.smithi135.stdout:5/70: creat d3/f11 x:0 0 0 2024-09-10T09:36:15.394 INFO:tasks.workunit.client.1.smithi135.stdout:7/141: link d2/d15/f2d d2/d11/d30/f31 0 2024-09-10T09:36:15.395 INFO:tasks.workunit.client.1.smithi135.stdout:9/107: dwrite f6 [0,4194304] 0 2024-09-10T09:36:15.395 INFO:tasks.workunit.client.1.smithi135.stdout:9/108: write de/f18 [2444591,58460] 0 2024-09-10T09:36:15.396 INFO:tasks.workunit.client.1.smithi135.stdout:1/68: dwrite f8 [0,4194304] 0 2024-09-10T09:36:15.396 INFO:tasks.workunit.client.1.smithi135.stdout:1/69: write f11 [301857,29270] 0 2024-09-10T09:36:15.396 INFO:tasks.workunit.client.1.smithi135.stdout:8/131: rename d1/d15/d16/f2a to d1/d15/d24/f2d 0 2024-09-10T09:36:15.398 INFO:tasks.workunit.client.1.smithi135.stdout:6/168: symlink d5/dd/d29/d2d/l37 0 2024-09-10T09:36:15.402 INFO:tasks.workunit.client.1.smithi135.stdout:0/196: getdents d8/d1c/d2c 0 2024-09-10T09:36:15.403 INFO:tasks.workunit.client.1.smithi135.stdout:5/71: unlink d3/f11 0 2024-09-10T09:36:15.409 INFO:tasks.workunit.client.1.smithi135.stdout:9/109: link de/c1c de/df/d1d/c20 0 2024-09-10T09:36:15.412 INFO:tasks.workunit.client.1.smithi135.stdout:8/132: dwrite d1/f23 [0,4194304] 0 2024-09-10T09:36:15.413 INFO:tasks.workunit.client.1.smithi135.stdout:7/142: rename d2/lc to d2/d3/l32 0 2024-09-10T09:36:15.415 INFO:tasks.workunit.client.1.smithi135.stdout:6/169: rename d5/dd/d29/f34 to d5/dd/d29/f38 0 2024-09-10T09:36:15.416 INFO:tasks.workunit.client.1.smithi135.stdout:5/72: dread d3/fd [0,4194304] 0 2024-09-10T09:36:15.416 INFO:tasks.workunit.client.1.smithi135.stdout:5/73: creat d3/f12 x:0 0 0 2024-09-10T09:36:15.417 INFO:tasks.workunit.client.1.smithi135.stdout:5/74: readlink - no filename 2024-09-10T09:36:15.417 INFO:tasks.workunit.client.1.smithi135.stdout:9/110: dread de/df/f1b [0,4194304] 0 2024-09-10T09:36:15.419 INFO:tasks.workunit.client.1.smithi135.stdout:0/197: mkdir d8/d1c/d37 0 2024-09-10T09:36:15.422 INFO:tasks.workunit.client.1.smithi135.stdout:1/70: rename lf to l13 0 2024-09-10T09:36:15.424 INFO:tasks.workunit.client.1.smithi135.stdout:8/133: write d1/f23 [59086,79016] 0 2024-09-10T09:36:15.424 INFO:tasks.workunit.client.1.smithi135.stdout:8/134: stat d1/d15/l1c 0 2024-09-10T09:36:15.424 INFO:tasks.workunit.client.1.smithi135.stdout:6/170: mknod d5/d15/c39 0 2024-09-10T09:36:15.429 INFO:tasks.workunit.client.1.smithi135.stdout:5/75: truncate d3/f8 2144964 0 2024-09-10T09:36:15.429 INFO:tasks.workunit.client.1.smithi135.stdout:5/76: chown d3/ff 0 1 2024-09-10T09:36:15.429 INFO:tasks.workunit.client.1.smithi135.stdout:5/77: chown d3/f8 19 1 2024-09-10T09:36:15.430 INFO:tasks.workunit.client.1.smithi135.stdout:5/78: creat d3/dc/f13 x:0 0 0 2024-09-10T09:36:15.431 INFO:tasks.workunit.client.1.smithi135.stdout:4/240: dwrite d1/db/d23/f3e [0,4194304] 0 2024-09-10T09:36:15.433 INFO:tasks.workunit.client.1.smithi135.stdout:9/111: rename f4 to de/f21 0 2024-09-10T09:36:15.433 INFO:tasks.workunit.client.1.smithi135.stdout:9/112: write de/df/f10 [1435795,30473] 0 2024-09-10T09:36:15.437 INFO:tasks.workunit.client.1.smithi135.stdout:7/143: rmdir d2/d11/d16 39 2024-09-10T09:36:15.441 INFO:tasks.workunit.client.1.smithi135.stdout:8/135: dwrite d1/f3 [0,4194304] 0 2024-09-10T09:36:15.448 INFO:tasks.workunit.client.1.smithi135.stdout:0/198: rename d8/d1c/f34 to d8/de/f38 0 2024-09-10T09:36:15.452 INFO:tasks.workunit.client.1.smithi135.stdout:1/71: getdents . 0 2024-09-10T09:36:15.458 INFO:tasks.workunit.client.1.smithi135.stdout:7/144: unlink d2/d3/l7 0 2024-09-10T09:36:15.464 INFO:tasks.workunit.client.1.smithi135.stdout:8/136: link d1/c1f d1/c2e 0 2024-09-10T09:36:15.464 INFO:tasks.workunit.client.1.smithi135.stdout:0/199: dwrite d8/fc [8388608,4194304] 0 2024-09-10T09:36:15.465 INFO:tasks.workunit.client.1.smithi135.stdout:8/137: creat d1/d13/f2f x:0 0 0 2024-09-10T09:36:15.465 INFO:tasks.workunit.client.1.smithi135.stdout:0/200: write d8/f26 [1034181,80394] 0 2024-09-10T09:36:15.465 INFO:tasks.workunit.client.1.smithi135.stdout:5/79: truncate d3/f8 856093 0 2024-09-10T09:36:15.466 INFO:tasks.workunit.client.1.smithi135.stdout:6/171: rename d5/dd/d29/d2d/f32 to d5/d1e/d35/f3a 0 2024-09-10T09:36:15.472 INFO:tasks.workunit.client.1.smithi135.stdout:7/145: dwrite d2/d3/f12 [0,4194304] 0 2024-09-10T09:36:15.473 INFO:tasks.workunit.client.1.smithi135.stdout:7/146: chown d2/d15/l1a 5725 1 2024-09-10T09:36:15.473 INFO:tasks.workunit.client.1.smithi135.stdout:7/147: stat d2/d11 0 2024-09-10T09:36:15.473 INFO:tasks.workunit.client.1.smithi135.stdout:9/113: rmdir de 39 2024-09-10T09:36:15.473 INFO:tasks.workunit.client.1.smithi135.stdout:9/114: stat de/df/f10 0 2024-09-10T09:36:15.475 INFO:tasks.workunit.client.1.smithi135.stdout:1/72: getdents . 0 2024-09-10T09:36:15.476 INFO:tasks.workunit.client.1.smithi135.stdout:1/73: fdatasync fb 0 2024-09-10T09:36:15.476 INFO:tasks.workunit.client.1.smithi135.stdout:7/148: dread d2/f1f [0,4194304] 0 2024-09-10T09:36:15.509 INFO:tasks.workunit.client.1.smithi135.stdout:8/138: symlink d1/d15/l30 0 2024-09-10T09:36:15.509 INFO:tasks.workunit.client.1.smithi135.stdout:8/139: truncate d1/d13/f1b 760174 0 2024-09-10T09:36:15.512 INFO:tasks.workunit.client.1.smithi135.stdout:8/140: dread d1/f7 [8388608,4194304] 0 2024-09-10T09:36:15.515 INFO:tasks.workunit.client.1.smithi135.stdout:8/141: fsync d1/d13/f2f 0 2024-09-10T09:36:15.528 INFO:tasks.workunit.client.1.smithi135.stdout:9/115: creat de/df/d1d/d1e/f22 x:0 0 0 2024-09-10T09:36:15.528 INFO:tasks.workunit.client.1.smithi135.stdout:9/116: chown de/df/d1d/c20 8339275 1 2024-09-10T09:36:15.529 INFO:tasks.workunit.client.1.smithi135.stdout:7/149: symlink d2/d11/d16/l33 0 2024-09-10T09:36:15.529 INFO:tasks.workunit.client.1.smithi135.stdout:7/150: chown d2/d11/c17 7152364 1 2024-09-10T09:36:15.530 INFO:tasks.workunit.client.1.smithi135.stdout:0/201: rmdir d8/dd/d11 39 2024-09-10T09:36:15.530 INFO:tasks.workunit.client.1.smithi135.stdout:0/202: write d8/dd/d1e/f21 [2894153,1911] 0 2024-09-10T09:36:15.530 INFO:tasks.workunit.client.1.smithi135.stdout:0/203: stat d8/dd/l1b 0 2024-09-10T09:36:15.531 INFO:tasks.workunit.client.1.smithi135.stdout:5/80: unlink d3/f8 0 2024-09-10T09:36:15.531 INFO:tasks.workunit.client.1.smithi135.stdout:5/81: creat d3/f14 x:0 0 0 2024-09-10T09:36:15.531 INFO:tasks.workunit.client.1.smithi135.stdout:5/82: fdatasync d3/fd 0 2024-09-10T09:36:15.533 INFO:tasks.workunit.client.1.smithi135.stdout:8/142: mknod d1/d27/c31 0 2024-09-10T09:36:15.533 INFO:tasks.workunit.client.1.smithi135.stdout:9/117: mkdir de/df/d1d/d23 0 2024-09-10T09:36:15.534 INFO:tasks.workunit.client.1.smithi135.stdout:1/74: mknod c14 0 2024-09-10T09:36:15.536 INFO:tasks.workunit.client.1.smithi135.stdout:7/151: rename d2/d11/d30/f31 to d2/d11/d30/f34 0 2024-09-10T09:36:15.537 INFO:tasks.workunit.client.1.smithi135.stdout:0/204: rename d8/l12 to d8/dd/d11/l39 0 2024-09-10T09:36:15.540 INFO:tasks.workunit.client.1.smithi135.stdout:5/83: symlink d3/dc/l15 0 2024-09-10T09:36:15.540 INFO:tasks.workunit.client.1.smithi135.stdout:5/84: write d3/fb [5520895,58163] 0 2024-09-10T09:36:15.542 INFO:tasks.workunit.client.1.smithi135.stdout:8/143: symlink d1/d15/l32 0 2024-09-10T09:36:15.542 INFO:tasks.workunit.client.1.smithi135.stdout:1/75: write f6 [3846825,66352] 0 2024-09-10T09:36:15.542 INFO:tasks.workunit.client.1.smithi135.stdout:1/76: write f11 [454858,70755] 0 2024-09-10T09:36:15.542 INFO:tasks.workunit.client.1.smithi135.stdout:1/77: chown la 1 1 2024-09-10T09:36:15.545 INFO:tasks.workunit.client.1.smithi135.stdout:7/152: creat d2/d11/d30/f35 x:0 0 0 2024-09-10T09:36:15.545 INFO:tasks.workunit.client.1.smithi135.stdout:7/153: getdents d2/d26 0 2024-09-10T09:36:15.547 INFO:tasks.workunit.client.1.smithi135.stdout:0/205: mknod d8/dd/d1e/c3a 0 2024-09-10T09:36:15.554 INFO:tasks.workunit.client.1.smithi135.stdout:5/85: mkdir d3/dc/d16 0 2024-09-10T09:36:15.558 INFO:tasks.workunit.client.1.smithi135.stdout:7/154: dread d2/f2e [0,4194304] 0 2024-09-10T09:36:15.558 INFO:tasks.workunit.client.1.smithi135.stdout:8/144: mkdir d1/d15/d16/d33 0 2024-09-10T09:36:15.562 INFO:tasks.workunit.client.1.smithi135.stdout:9/118: getdents de/df/d1d/d1e 0 2024-09-10T09:36:15.562 INFO:tasks.workunit.client.1.smithi135.stdout:9/119: dread - de/df/d1d/d1e/f22 zero size 2024-09-10T09:36:15.565 INFO:tasks.workunit.client.1.smithi135.stdout:7/155: mkdir d2/d3/d36 0 2024-09-10T09:36:15.567 INFO:tasks.workunit.client.1.smithi135.stdout:8/145: symlink d1/d15/l34 0 2024-09-10T09:36:15.568 INFO:tasks.workunit.client.1.smithi135.stdout:1/78: symlink l15 0 2024-09-10T09:36:15.570 INFO:tasks.workunit.client.1.smithi135.stdout:6/172: dwrite d5/d1e/f28 [0,4194304] 0 2024-09-10T09:36:15.570 INFO:tasks.workunit.client.1.smithi135.stdout:0/206: dwrite d8/dd/d11/f2b [0,4194304] 0 2024-09-10T09:36:15.572 INFO:tasks.workunit.client.1.smithi135.stdout:9/120: rename de/c16 to de/df/c24 0 2024-09-10T09:36:15.575 INFO:tasks.workunit.client.1.smithi135.stdout:5/86: rmdir d3 39 2024-09-10T09:36:15.575 INFO:tasks.workunit.client.1.smithi135.stdout:5/87: dread - d3/dc/f13 zero size 2024-09-10T09:36:15.575 INFO:tasks.workunit.client.1.smithi135.stdout:5/88: write d3/f9 [634487,70509] 0 2024-09-10T09:36:15.581 INFO:tasks.workunit.client.1.smithi135.stdout:0/207: dread d8/d1c/d2c/f36 [0,4194304] 0 2024-09-10T09:36:15.581 INFO:tasks.workunit.client.1.smithi135.stdout:9/121: stat de/df/d1d/c20 0 2024-09-10T09:36:15.581 INFO:tasks.workunit.client.1.smithi135.stdout:9/122: chown cc 99476146 1 2024-09-10T09:36:15.583 INFO:tasks.workunit.client.1.smithi135.stdout:8/146: getdents d1/d15 0 2024-09-10T09:36:15.583 INFO:tasks.workunit.client.1.smithi135.stdout:8/147: write d1/d15/d16/f26 [273989,74162] 0 2024-09-10T09:36:15.583 INFO:tasks.workunit.client.1.smithi135.stdout:8/148: fdatasync d1/f5 0 2024-09-10T09:36:15.587 INFO:tasks.workunit.client.1.smithi135.stdout:5/89: dread d3/fb [0,4194304] 0 2024-09-10T09:36:15.593 INFO:tasks.workunit.client.1.smithi135.stdout:6/173: dread d5/d15/f22 [0,4194304] 0 2024-09-10T09:36:15.593 INFO:tasks.workunit.client.1.smithi135.stdout:6/174: write d5/d1e/d35/f21 [568662,80865] 0 2024-09-10T09:36:15.594 INFO:tasks.workunit.client.1.smithi135.stdout:7/156: dwrite d2/d15/f2c [0,4194304] 0 2024-09-10T09:36:15.598 INFO:tasks.workunit.client.1.smithi135.stdout:9/123: mkdir de/df/d1d/d23/d25 0 2024-09-10T09:36:15.599 INFO:tasks.workunit.client.1.smithi135.stdout:9/124: read de/f21 [2453475,109859] 0 2024-09-10T09:36:15.600 INFO:tasks.workunit.client.1.smithi135.stdout:0/208: rename d8/d1c/d2c/c2d to d8/c3b 0 2024-09-10T09:36:15.606 INFO:tasks.workunit.client.1.smithi135.stdout:6/175: mkdir d5/d1e/d3b 0 2024-09-10T09:36:15.611 INFO:tasks.workunit.client.1.smithi135.stdout:1/79: dwrite f11 [0,4194304] 0 2024-09-10T09:36:15.611 INFO:tasks.workunit.client.1.smithi135.stdout:1/80: readlink la 0 2024-09-10T09:36:15.611 INFO:tasks.workunit.client.1.smithi135.stdout:9/125: creat de/df/d1d/d23/f26 x:0 0 0 2024-09-10T09:36:15.612 INFO:tasks.workunit.client.1.smithi135.stdout:9/126: write de/df/d1d/d23/f26 [624811,48534] 0 2024-09-10T09:36:15.613 INFO:tasks.workunit.client.1.smithi135.stdout:0/209: symlink d8/de/l3c 0 2024-09-10T09:36:15.616 INFO:tasks.workunit.client.1.smithi135.stdout:6/176: mkdir d5/dd/d29/d3c 0 2024-09-10T09:36:15.624 INFO:tasks.workunit.client.1.smithi135.stdout:0/210: stat d8/de/cf 0 2024-09-10T09:36:15.627 INFO:tasks.workunit.client.1.smithi135.stdout:1/81: write f11 [2634225,74828] 0 2024-09-10T09:36:15.627 INFO:tasks.workunit.client.1.smithi135.stdout:8/149: dwrite d1/fd [0,4194304] 0 2024-09-10T09:36:15.627 INFO:tasks.workunit.client.1.smithi135.stdout:8/150: creat d1/d15/d24/f35 x:0 0 0 2024-09-10T09:36:15.627 INFO:tasks.workunit.client.1.smithi135.stdout:0/211: stat d8/c9 0 2024-09-10T09:36:15.632 INFO:tasks.workunit.client.1.smithi135.stdout:5/90: dwrite d3/fb [0,4194304] 0 2024-09-10T09:36:15.632 INFO:tasks.workunit.client.1.smithi135.stdout:1/82: creat f16 x:0 0 0 2024-09-10T09:36:15.636 INFO:tasks.workunit.client.1.smithi135.stdout:5/91: mkdir d3/dc/d17 0 2024-09-10T09:36:15.636 INFO:tasks.workunit.client.1.smithi135.stdout:5/92: fsync d3/dc/f10 0 2024-09-10T09:36:15.636 INFO:tasks.workunit.client.1.smithi135.stdout:5/93: stat d3/dc 0 2024-09-10T09:36:15.638 INFO:tasks.workunit.client.1.smithi135.stdout:1/83: unlink c9 0 2024-09-10T09:36:15.638 INFO:tasks.workunit.client.1.smithi135.stdout:1/84: fdatasync f10 0 2024-09-10T09:36:15.638 INFO:tasks.workunit.client.1.smithi135.stdout:1/85: stat f8 0 2024-09-10T09:36:15.641 INFO:tasks.workunit.client.1.smithi135.stdout:8/151: fsync d1/d15/d24/f35 0 2024-09-10T09:36:15.642 INFO:tasks.workunit.client.1.smithi135.stdout:9/127: dwrite de/df/f11 [0,4194304] 0 2024-09-10T09:36:15.642 INFO:tasks.workunit.client.1.smithi135.stdout:6/177: dwrite d5/d15/d27/f2c [0,4194304] 0 2024-09-10T09:36:15.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/157: dwrite d2/d15/f21 [0,4194304] 0 2024-09-10T09:36:15.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/158: stat d2/d11/d30 0 2024-09-10T09:36:15.644 INFO:tasks.workunit.client.1.smithi135.stdout:5/94: creat d3/f18 x:0 0 0 2024-09-10T09:36:15.644 INFO:tasks.workunit.client.1.smithi135.stdout:5/95: truncate d3/f14 670554 0 2024-09-10T09:36:15.650 INFO:tasks.workunit.client.1.smithi135.stdout:8/152: creat d1/d27/f36 x:0 0 0 2024-09-10T09:36:15.650 INFO:tasks.workunit.client.1.smithi135.stdout:8/153: dread - d1/d15/d24/f2d zero size 2024-09-10T09:36:15.650 INFO:tasks.workunit.client.1.smithi135.stdout:8/154: write d1/d15/d16/f1a [629766,4930] 0 2024-09-10T09:36:15.650 INFO:tasks.workunit.client.1.smithi135.stdout:8/155: dread - d1/d15/d24/f2d zero size 2024-09-10T09:36:15.650 INFO:tasks.workunit.client.1.smithi135.stdout:8/156: chown d1/ce 17414 1 2024-09-10T09:36:15.653 INFO:tasks.workunit.client.1.smithi135.stdout:9/128: link de/df/d1d/d1e/f22 de/df/d1d/d23/f27 0 2024-09-10T09:36:15.653 INFO:tasks.workunit.client.1.smithi135.stdout:9/129: truncate de/f17 903543 0 2024-09-10T09:36:15.657 INFO:tasks.workunit.client.1.smithi135.stdout:1/86: dwrite f3 [4194304,4194304] 0 2024-09-10T09:36:15.657 INFO:tasks.workunit.client.1.smithi135.stdout:1/87: chown c12 4503 1 2024-09-10T09:36:15.657 INFO:tasks.workunit.client.1.smithi135.stdout:1/88: fsync f6 0 2024-09-10T09:36:15.662 INFO:tasks.workunit.client.1.smithi135.stdout:7/159: mknod d2/d11/d30/c37 0 2024-09-10T09:36:15.663 INFO:tasks.workunit.client.1.smithi135.stdout:7/160: fdatasync d2/d15/f2d 0 2024-09-10T09:36:15.663 INFO:tasks.workunit.client.1.smithi135.stdout:8/157: dread d1/f7 [0,4194304] 0 2024-09-10T09:36:15.663 INFO:tasks.workunit.client.1.smithi135.stdout:5/96: creat d3/dc/d16/f19 x:0 0 0 2024-09-10T09:36:15.663 INFO:tasks.workunit.client.1.smithi135.stdout:5/97: fsync d3/dc/f13 0 2024-09-10T09:36:15.664 INFO:tasks.workunit.client.1.smithi135.stdout:9/130: mkdir de/df/d1d/d23/d25/d28 0 2024-09-10T09:36:15.666 INFO:tasks.workunit.client.1.smithi135.stdout:4/241: sync 2024-09-10T09:36:15.666 INFO:tasks.workunit.client.1.smithi135.stdout:3/82: sync 2024-09-10T09:36:15.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/132: sync 2024-09-10T09:36:15.667 INFO:tasks.workunit.client.1.smithi135.stdout:3/83: truncate d4/f9 1126004 0 2024-09-10T09:36:15.667 INFO:tasks.workunit.client.1.smithi135.stdout:8/158: mknod d1/d13/c37 0 2024-09-10T09:36:15.667 INFO:tasks.workunit.client.1.smithi135.stdout:8/159: chown d1/d15/f19 26 1 2024-09-10T09:36:15.669 INFO:tasks.workunit.client.1.smithi135.stdout:5/98: symlink d3/l1a 0 2024-09-10T09:36:15.670 INFO:tasks.workunit.client.1.smithi135.stdout:9/131: rename de/c1c to de/c29 0 2024-09-10T09:36:15.670 INFO:tasks.workunit.client.1.smithi135.stdout:9/132: dread - de/df/d1d/f1f zero size 2024-09-10T09:36:15.672 INFO:tasks.workunit.client.1.smithi135.stdout:1/89: mknod c17 0 2024-09-10T09:36:15.675 INFO:tasks.workunit.client.1.smithi135.stdout:4/242: dread d1/de/f13 [0,4194304] 0 2024-09-10T09:36:15.675 INFO:tasks.workunit.client.1.smithi135.stdout:4/243: fsync d1/db/f43 0 2024-09-10T09:36:15.682 INFO:tasks.workunit.client.1.smithi135.stdout:7/161: getdents d2/d11 0 2024-09-10T09:36:15.683 INFO:tasks.workunit.client.1.smithi135.stdout:4/244: dread d1/de/d16/f3f [0,4194304] 0 2024-09-10T09:36:15.683 INFO:tasks.workunit.client.1.smithi135.stdout:4/245: fsync d1/db/d23/f30 0 2024-09-10T09:36:15.684 INFO:tasks.workunit.client.1.smithi135.stdout:2/133: mkdir df/d13/d2b 0 2024-09-10T09:36:15.685 INFO:tasks.workunit.client.1.smithi135.stdout:3/84: mkdir d4/d5/db/d1b 0 2024-09-10T09:36:15.687 INFO:tasks.workunit.client.1.smithi135.stdout:5/99: symlink d3/l1b 0 2024-09-10T09:36:15.687 INFO:tasks.workunit.client.1.smithi135.stdout:5/100: chown d3/dc/ce 96 1 2024-09-10T09:36:15.687 INFO:tasks.workunit.client.1.smithi135.stdout:5/101: read - d3/f18 zero size 2024-09-10T09:36:15.688 INFO:tasks.workunit.client.1.smithi135.stdout:9/133: mknod de/df/c2a 0 2024-09-10T09:36:15.688 INFO:tasks.workunit.client.1.smithi135.stdout:9/134: fdatasync de/df/f1b 0 2024-09-10T09:36:15.689 INFO:tasks.workunit.client.1.smithi135.stdout:4/246: creat d1/d4a/f51 x:0 0 0 2024-09-10T09:36:15.689 INFO:tasks.workunit.client.1.smithi135.stdout:4/247: stat d1/db/d23/c29 0 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:3/85: symlink d4/d5/l1c 0 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:7/162: dread d2/d15/f21 [0,4194304] 0 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/90: dwrite f8 [0,4194304] 0 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:7/163: write d2/d15/f1c [8939653,126092] 0 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/91: write f11 [2513081,65966] 0 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/92: fsync fb 0 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/93: chown fc 662 1 2024-09-10T09:36:15.694 INFO:tasks.workunit.client.1.smithi135.stdout:7/164: write d2/d11/d30/f34 [231838,106614] 0 2024-09-10T09:36:15.695 INFO:tasks.workunit.client.1.smithi135.stdout:8/160: rmdir d1/d15/d16 39 2024-09-10T09:36:15.696 INFO:tasks.workunit.client.1.smithi135.stdout:2/134: dread df/f17 [0,4194304] 0 2024-09-10T09:36:15.696 INFO:tasks.workunit.client.1.smithi135.stdout:2/135: chown df/d1b/d23/f28 41459693 1 2024-09-10T09:36:15.696 INFO:tasks.workunit.client.1.smithi135.stdout:2/136: truncate df/d15/f24 252758 0 2024-09-10T09:36:15.699 INFO:tasks.workunit.client.1.smithi135.stdout:5/102: creat d3/dc/f1c x:0 0 0 2024-09-10T09:36:15.701 INFO:tasks.workunit.client.1.smithi135.stdout:9/135: rename c8 to de/df/d1d/d23/c2b 0 2024-09-10T09:36:15.705 INFO:tasks.workunit.client.1.smithi135.stdout:4/248: truncate d1/db/d23/f3e 2674143 0 2024-09-10T09:36:15.705 INFO:tasks.workunit.client.1.smithi135.stdout:4/249: chown d1/l12 20 1 2024-09-10T09:36:15.705 INFO:tasks.workunit.client.1.smithi135.stdout:4/250: write d1/d4a/f51 [133930,1218] 0 2024-09-10T09:36:15.709 INFO:tasks.workunit.client.1.smithi135.stdout:3/86: symlink d4/d5/l1d 0 2024-09-10T09:36:15.710 INFO:tasks.workunit.client.1.smithi135.stdout:1/94: creat f18 x:0 0 0 2024-09-10T09:36:15.710 INFO:tasks.workunit.client.1.smithi135.stdout:9/136: read f6 [3483475,25917] 0 2024-09-10T09:36:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:15 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:15 smithi079 ceph-mon[27592]: pgmap v262: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 242 MiB/s rd, 277 MiB/s wr, 412 op/s 2024-09-10T09:36:15.713 INFO:tasks.workunit.client.1.smithi135.stdout:7/165: link d2/d11/d16/f1d d2/d25/f38 0 2024-09-10T09:36:15.716 INFO:tasks.workunit.client.1.smithi135.stdout:8/161: link d1/d13/f1b d1/d15/d16/f38 0 2024-09-10T09:36:15.716 INFO:tasks.workunit.client.1.smithi135.stdout:5/103: dwrite d3/f12 [0,4194304] 0 2024-09-10T09:36:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:15 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:15 smithi135 ceph-mon[33411]: pgmap v262: 65 pgs: 65 active+clean; 2.1 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 242 MiB/s rd, 277 MiB/s wr, 412 op/s 2024-09-10T09:36:15.718 INFO:tasks.workunit.client.1.smithi135.stdout:2/137: mkdir df/d1b/d27/d2c 0 2024-09-10T09:36:15.724 INFO:tasks.workunit.client.1.smithi135.stdout:1/95: truncate f6 3270299 0 2024-09-10T09:36:15.724 INFO:tasks.workunit.client.1.smithi135.stdout:3/87: write f1 [3141805,19019] 0 2024-09-10T09:36:15.724 INFO:tasks.workunit.client.1.smithi135.stdout:3/88: chown d4/d5/db/l14 131490 1 2024-09-10T09:36:15.727 INFO:tasks.workunit.client.1.smithi135.stdout:9/137: rename de/df/c24 to de/df/d1d/d1e/c2c 0 2024-09-10T09:36:15.727 INFO:tasks.workunit.client.1.smithi135.stdout:9/138: write de/df/f10 [476339,51450] 0 2024-09-10T09:36:15.727 INFO:tasks.workunit.client.1.smithi135.stdout:9/139: creat de/df/d1d/d23/f2d x:0 0 0 2024-09-10T09:36:15.728 INFO:tasks.workunit.client.1.smithi135.stdout:7/166: mkdir d2/d15/d39 0 2024-09-10T09:36:15.728 INFO:tasks.workunit.client.1.smithi135.stdout:7/167: stat d2/c29 0 2024-09-10T09:36:15.732 INFO:tasks.workunit.client.1.smithi135.stdout:8/162: dwrite d1/f25 [0,4194304] 0 2024-09-10T09:36:15.732 INFO:tasks.workunit.client.1.smithi135.stdout:8/163: getdents d1/d15/d16/d33 0 2024-09-10T09:36:15.735 INFO:tasks.workunit.client.1.smithi135.stdout:4/251: rmdir d1/d4a 39 2024-09-10T09:36:15.738 INFO:tasks.workunit.client.1.smithi135.stdout:3/89: creat d4/d5/db/d1b/f1e x:0 0 0 2024-09-10T09:36:15.741 INFO:tasks.workunit.client.1.smithi135.stdout:2/138: rename c4 to df/d13/c2d 0 2024-09-10T09:36:15.741 INFO:tasks.workunit.client.1.smithi135.stdout:2/139: chown df/d13/c2d 730 1 2024-09-10T09:36:15.741 INFO:tasks.workunit.client.1.smithi135.stdout:2/140: chown df/d1b/d27/d2c 50 1 2024-09-10T09:36:15.743 INFO:tasks.workunit.client.1.smithi135.stdout:9/140: mknod de/df/c2e 0 2024-09-10T09:36:15.750 INFO:tasks.workunit.client.1.smithi135.stdout:8/164: mkdir d1/d15/d16/d33/d39 0 2024-09-10T09:36:15.753 INFO:tasks.workunit.client.1.smithi135.stdout:5/104: getdents d3/dc 0 2024-09-10T09:36:15.755 INFO:tasks.workunit.client.1.smithi135.stdout:4/252: mknod d1/db/d9/c52 0 2024-09-10T09:36:15.758 INFO:tasks.workunit.client.1.smithi135.stdout:1/96: symlink l19 0 2024-09-10T09:36:15.758 INFO:tasks.workunit.client.1.smithi135.stdout:1/97: rmdir - no directory 2024-09-10T09:36:15.759 INFO:tasks.workunit.client.1.smithi135.stdout:8/165: dread d1/d15/d16/f29 [0,4194304] 0 2024-09-10T09:36:15.760 INFO:tasks.workunit.client.1.smithi135.stdout:8/166: read d1/d15/d16/f1a [332786,1714] 0 2024-09-10T09:36:15.760 INFO:tasks.workunit.client.1.smithi135.stdout:9/141: creat de/df/d1d/d23/d25/d28/f2f x:0 0 0 2024-09-10T09:36:15.760 INFO:tasks.workunit.client.1.smithi135.stdout:9/142: truncate de/df/f1b 551734 0 2024-09-10T09:36:15.761 INFO:tasks.workunit.client.1.smithi135.stdout:9/143: read - de/df/d1d/f1f zero size 2024-09-10T09:36:15.761 INFO:tasks.workunit.client.1.smithi135.stdout:9/144: readlink de/df/l14 0 2024-09-10T09:36:15.761 INFO:tasks.workunit.client.1.smithi135.stdout:7/168: link d2/d11/f22 d2/f3a 0 2024-09-10T09:36:15.762 INFO:tasks.workunit.client.1.smithi135.stdout:5/105: link d3/dc/ce d3/dc/c1d 0 2024-09-10T09:36:15.764 INFO:tasks.workunit.client.1.smithi135.stdout:4/253: mknod d1/de/c53 0 2024-09-10T09:36:15.765 INFO:tasks.workunit.client.1.smithi135.stdout:8/167: symlink d1/d15/d24/l3a 0 2024-09-10T09:36:15.766 INFO:tasks.workunit.client.1.smithi135.stdout:7/169: symlink d2/d25/l3b 0 2024-09-10T09:36:15.769 INFO:tasks.workunit.client.1.smithi135.stdout:5/106: unlink d3/dc/c1d 0 2024-09-10T09:36:15.772 INFO:tasks.workunit.client.1.smithi135.stdout:1/98: mknod c1a 0 2024-09-10T09:36:15.774 INFO:tasks.workunit.client.1.smithi135.stdout:8/168: symlink d1/d15/l3b 0 2024-09-10T09:36:15.774 INFO:tasks.workunit.client.1.smithi135.stdout:8/169: stat d1/f20 0 2024-09-10T09:36:15.775 INFO:tasks.workunit.client.1.smithi135.stdout:8/170: dread d1/d13/f1b [0,4194304] 0 2024-09-10T09:36:15.777 INFO:tasks.workunit.client.1.smithi135.stdout:5/107: mknod d3/c1e 0 2024-09-10T09:36:15.779 INFO:tasks.workunit.client.1.smithi135.stdout:8/171: link d1/l10 d1/d15/d16/d33/l3c 0 2024-09-10T09:36:15.780 INFO:tasks.workunit.client.1.smithi135.stdout:2/141: dwrite df/f17 [0,4194304] 0 2024-09-10T09:36:15.781 INFO:tasks.workunit.client.1.smithi135.stdout:7/170: rename d2/d11/d16/f2b to d2/f3c 0 2024-09-10T09:36:15.781 INFO:tasks.workunit.client.1.smithi135.stdout:7/171: readlink d2/d25/l3b 0 2024-09-10T09:36:15.781 INFO:tasks.workunit.client.1.smithi135.stdout:7/172: creat d2/d15/f3d x:0 0 0 2024-09-10T09:36:15.782 INFO:tasks.workunit.client.1.smithi135.stdout:2/142: dread df/d1b/d23/f28 [0,4194304] 0 2024-09-10T09:36:15.782 INFO:tasks.workunit.client.1.smithi135.stdout:2/143: fsync df/d15/f24 0 2024-09-10T09:36:15.783 INFO:tasks.workunit.client.1.smithi135.stdout:1/99: rename f18 to f1b 0 2024-09-10T09:36:15.785 INFO:tasks.workunit.client.1.smithi135.stdout:8/172: mkdir d1/d27/d3d 0 2024-09-10T09:36:15.785 INFO:tasks.workunit.client.1.smithi135.stdout:8/173: chown d1 54 1 2024-09-10T09:36:15.785 INFO:tasks.workunit.client.1.smithi135.stdout:8/174: fsync d1/d15/d16/f26 0 2024-09-10T09:36:15.787 INFO:tasks.workunit.client.1.smithi135.stdout:7/173: rename d2/d11/d30/c37 to d2/d15/c3e 0 2024-09-10T09:36:15.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/174: chown d2/f2e 58 1 2024-09-10T09:36:15.790 INFO:tasks.workunit.client.1.smithi135.stdout:2/144: creat df/d1b/d27/d2c/f2e x:0 0 0 2024-09-10T09:36:15.790 INFO:tasks.workunit.client.1.smithi135.stdout:2/145: stat df/f16 0 2024-09-10T09:36:15.790 INFO:tasks.workunit.client.1.smithi135.stdout:4/254: dwrite d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:15.790 INFO:tasks.workunit.client.1.smithi135.stdout:4/255: creat d1/db/f54 x:0 0 0 2024-09-10T09:36:15.790 INFO:tasks.workunit.client.1.smithi135.stdout:4/256: chown d1/de/d16/f3f 0 1 2024-09-10T09:36:15.791 INFO:tasks.workunit.client.1.smithi135.stdout:5/108: symlink d3/dc/l1f 0 2024-09-10T09:36:15.791 INFO:tasks.workunit.client.1.smithi135.stdout:5/109: dread - d3/ff zero size 2024-09-10T09:36:15.793 INFO:tasks.workunit.client.1.smithi135.stdout:8/175: mknod d1/d15/d24/c3e 0 2024-09-10T09:36:15.796 INFO:tasks.workunit.client.1.smithi135.stdout:7/175: link d2/d11/d16/f28 d2/d25/f3f 0 2024-09-10T09:36:15.797 INFO:tasks.workunit.client.1.smithi135.stdout:9/145: dwrite f6 [0,4194304] 0 2024-09-10T09:36:15.797 INFO:tasks.workunit.client.1.smithi135.stdout:3/90: dwrite d4/f9 [0,4194304] 0 2024-09-10T09:36:15.801 INFO:tasks.workunit.client.1.smithi135.stdout:4/257: mkdir d1/db/d9/d55 0 2024-09-10T09:36:15.806 INFO:tasks.workunit.client.1.smithi135.stdout:4/258: write d1/de/d16/f3f [3191630,9893] 0 2024-09-10T09:36:15.806 INFO:tasks.workunit.client.1.smithi135.stdout:4/259: write d1/de/f34 [421680,73724] 0 2024-09-10T09:36:15.811 INFO:tasks.workunit.client.1.smithi135.stdout:8/176: dwrite d1/f23 [0,4194304] 0 2024-09-10T09:36:15.811 INFO:tasks.workunit.client.1.smithi135.stdout:8/177: chown d1/d15/l34 42 1 2024-09-10T09:36:15.825 INFO:tasks.workunit.client.1.smithi135.stdout:8/178: dwrite d1/fd [8388608,4194304] 0 2024-09-10T09:36:15.825 INFO:tasks.workunit.client.1.smithi135.stdout:8/179: creat d1/d15/d24/f3f x:0 0 0 2024-09-10T09:36:15.825 INFO:tasks.workunit.client.1.smithi135.stdout:8/180: creat d1/d27/f40 x:0 0 0 2024-09-10T09:36:15.905 INFO:tasks.workunit.client.1.smithi135.stdout:1/100: rename la to l1c 0 2024-09-10T09:36:15.907 INFO:tasks.workunit.client.1.smithi135.stdout:7/176: mknod d2/d26/c40 0 2024-09-10T09:36:15.907 INFO:tasks.workunit.client.1.smithi135.stdout:7/177: truncate d2/d25/f38 441210 0 2024-09-10T09:36:15.954 INFO:tasks.workunit.client.1.smithi135.stdout:9/146: mknod de/df/d1d/d23/d25/c30 0 2024-09-10T09:36:15.954 INFO:tasks.workunit.client.1.smithi135.stdout:9/147: truncate de/df/d1d/d23/f26 1145715 0 2024-09-10T09:36:15.954 INFO:tasks.workunit.client.1.smithi135.stdout:9/148: rename de/df to de/df/d31 22 2024-09-10T09:36:15.954 INFO:tasks.workunit.client.1.smithi135.stdout:9/149: dread - de/df/d1d/d23/f2d zero size 2024-09-10T09:36:15.973 INFO:tasks.workunit.client.1.smithi135.stdout:4/260: creat d1/f56 x:0 0 0 2024-09-10T09:36:15.973 INFO:tasks.workunit.client.1.smithi135.stdout:4/261: dread - d1/db/d9/f38 zero size 2024-09-10T09:36:15.976 INFO:tasks.workunit.client.1.smithi135.stdout:5/110: mknod d3/dc/d16/c20 0 2024-09-10T09:36:15.979 INFO:tasks.workunit.client.1.smithi135.stdout:5/111: dread f2 [0,4194304] 0 2024-09-10T09:36:15.979 INFO:tasks.workunit.client.1.smithi135.stdout:7/178: mkdir d2/d15/d41 0 2024-09-10T09:36:15.986 INFO:tasks.workunit.client.1.smithi135.stdout:8/181: getdents d1/d15 0 2024-09-10T09:36:15.987 INFO:tasks.workunit.client.1.smithi135.stdout:3/91: rmdir d4 39 2024-09-10T09:36:15.993 INFO:tasks.workunit.client.1.smithi135.stdout:7/179: dwrite d2/d15/f3d [0,4194304] 0 2024-09-10T09:36:15.996 INFO:tasks.workunit.client.1.smithi135.stdout:3/92: write d4/d5/dc/f10 [2912221,130106] 0 2024-09-10T09:36:15.996 INFO:tasks.workunit.client.1.smithi135.stdout:3/93: fsync f1 0 2024-09-10T09:36:15.996 INFO:tasks.workunit.client.1.smithi135.stdout:1/101: mkdir d1d 0 2024-09-10T09:36:15.999 INFO:tasks.workunit.client.1.smithi135.stdout:9/150: getdents de/df/d1d/d23 0 2024-09-10T09:36:15.999 INFO:tasks.workunit.client.1.smithi135.stdout:9/151: write de/df/f10 [1176583,98308] 0 2024-09-10T09:36:16.000 INFO:tasks.workunit.client.1.smithi135.stdout:8/182: symlink d1/d15/l41 0 2024-09-10T09:36:16.019 INFO:tasks.workunit.client.1.smithi135.stdout:1/102: creat d1d/f1e x:0 0 0 2024-09-10T09:36:16.025 INFO:tasks.workunit.client.1.smithi135.stdout:1/103: dread f6 [0,4194304] 0 2024-09-10T09:36:16.025 INFO:tasks.workunit.client.1.smithi135.stdout:1/104: fdatasync f3 0 2024-09-10T09:36:16.025 INFO:tasks.workunit.client.1.smithi135.stdout:1/105: write f6 [1123587,101293] 0 2024-09-10T09:36:16.026 INFO:tasks.workunit.client.1.smithi135.stdout:9/152: creat de/df/d1d/d23/d25/f32 x:0 0 0 2024-09-10T09:36:16.026 INFO:tasks.workunit.client.1.smithi135.stdout:9/153: write de/df/d1d/d23/d25/d28/f2f [118336,129387] 0 2024-09-10T09:36:16.031 INFO:tasks.workunit.client.1.smithi135.stdout:4/262: getdents d1/db 0 2024-09-10T09:36:16.036 INFO:tasks.workunit.client.1.smithi135.stdout:4/263: creat d1/de/f57 x:0 0 0 2024-09-10T09:36:16.037 INFO:tasks.workunit.client.1.smithi135.stdout:4/264: symlink d1/l58 0 2024-09-10T09:36:16.042 INFO:tasks.workunit.client.1.smithi135.stdout:1/106: dread fb [0,4194304] 0 2024-09-10T09:36:16.042 INFO:tasks.workunit.client.1.smithi135.stdout:9/154: dread f6 [0,4194304] 0 2024-09-10T09:36:16.046 INFO:tasks.workunit.client.1.smithi135.stdout:1/107: symlink d1d/l1f 0 2024-09-10T09:36:16.046 INFO:tasks.workunit.client.1.smithi135.stdout:1/108: write f6 [3507916,60904] 0 2024-09-10T09:36:16.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/155: symlink de/df/d1d/d23/d25/d28/l33 0 2024-09-10T09:36:16.059 INFO:tasks.workunit.client.1.smithi135.stdout:1/109: dread f10 [0,4194304] 0 2024-09-10T09:36:16.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/110: mkdir d1d/d20 0 2024-09-10T09:36:16.073 INFO:tasks.workunit.client.1.smithi135.stdout:9/156: dwrite de/df/d1d/f1f [0,4194304] 0 2024-09-10T09:36:16.074 INFO:tasks.workunit.client.1.smithi135.stdout:5/112: truncate d3/f14 303659 0 2024-09-10T09:36:16.078 INFO:tasks.workunit.client.1.smithi135.stdout:9/157: creat de/df/d1d/f34 x:0 0 0 2024-09-10T09:36:16.080 INFO:tasks.workunit.client.1.smithi135.stdout:9/158: mknod de/df/d1d/d23/d25/c35 0 2024-09-10T09:36:16.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/111: dwrite f1b [0,4194304] 0 2024-09-10T09:36:16.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/112: truncate d1d/f1e 789079 0 2024-09-10T09:36:16.096 INFO:tasks.workunit.client.1.smithi135.stdout:1/113: write f3 [2528237,54960] 0 2024-09-10T09:36:16.098 INFO:tasks.workunit.client.1.smithi135.stdout:1/114: unlink f8 0 2024-09-10T09:36:16.098 INFO:tasks.workunit.client.1.smithi135.stdout:1/115: creat d1d/f21 x:0 0 0 2024-09-10T09:36:16.103 INFO:tasks.workunit.client.1.smithi135.stdout:9/159: dwrite de/df/d1d/d23/d25/f32 [0,4194304] 0 2024-09-10T09:36:16.105 INFO:tasks.workunit.client.1.smithi135.stdout:1/116: rename fb to d1d/f22 0 2024-09-10T09:36:16.105 INFO:tasks.workunit.client.1.smithi135.stdout:1/117: fdatasync f10 0 2024-09-10T09:36:16.109 INFO:tasks.workunit.client.1.smithi135.stdout:2/146: sync 2024-09-10T09:36:16.109 INFO:tasks.workunit.client.1.smithi135.stdout:0/212: sync 2024-09-10T09:36:16.109 INFO:tasks.workunit.client.1.smithi135.stdout:6/178: sync 2024-09-10T09:36:16.109 INFO:tasks.workunit.client.1.smithi135.stdout:6/179: dread - d5/dd/d29/f2a zero size 2024-09-10T09:36:16.114 INFO:tasks.workunit.client.1.smithi135.stdout:1/118: mknod d1d/d20/c23 0 2024-09-10T09:36:16.117 INFO:tasks.workunit.client.1.smithi135.stdout:2/147: link df/d13/l14 df/d15/l2f 0 2024-09-10T09:36:16.119 INFO:tasks.workunit.client.1.smithi135.stdout:2/148: dread df/d13/f1d [0,4194304] 0 2024-09-10T09:36:16.122 INFO:tasks.workunit.client.1.smithi135.stdout:6/180: rename d5/fc to d5/d15/d27/f3d 0 2024-09-10T09:36:16.122 INFO:tasks.workunit.client.1.smithi135.stdout:6/181: write d5/d15/f22 [3330526,126350] 0 2024-09-10T09:36:16.123 INFO:tasks.workunit.client.1.smithi135.stdout:1/119: mkdir d1d/d20/d24 0 2024-09-10T09:36:16.123 INFO:tasks.workunit.client.1.smithi135.stdout:1/120: fsync fc 0 2024-09-10T09:36:16.126 INFO:tasks.workunit.client.1.smithi135.stdout:9/160: dwrite de/df/d1d/d1e/f22 [0,4194304] 0 2024-09-10T09:36:16.127 INFO:tasks.workunit.client.1.smithi135.stdout:6/182: mknod d5/d1e/d35/c3e 0 2024-09-10T09:36:16.130 INFO:tasks.workunit.client.1.smithi135.stdout:1/121: stat c0 0 2024-09-10T09:36:16.130 INFO:tasks.workunit.client.1.smithi135.stdout:1/122: readlink l15 0 2024-09-10T09:36:16.130 INFO:tasks.workunit.client.1.smithi135.stdout:1/123: chown l13 3437610 1 2024-09-10T09:36:16.133 INFO:tasks.workunit.client.1.smithi135.stdout:2/149: write df/f16 [874825,77798] 0 2024-09-10T09:36:16.138 INFO:tasks.workunit.client.1.smithi135.stdout:1/124: dread f1b [0,4194304] 0 2024-09-10T09:36:16.139 INFO:tasks.workunit.client.1.smithi135.stdout:6/183: rename d5/d15/d27/f2c to d5/d15/d27/f3f 0 2024-09-10T09:36:16.141 INFO:tasks.workunit.client.1.smithi135.stdout:9/161: rmdir de/df/d1d/d23/d25 39 2024-09-10T09:36:16.141 INFO:tasks.workunit.client.1.smithi135.stdout:9/162: chown de/df/f13 5819043 1 2024-09-10T09:36:16.142 INFO:tasks.workunit.client.1.smithi135.stdout:1/125: dread f1b [0,4194304] 0 2024-09-10T09:36:16.142 INFO:tasks.workunit.client.1.smithi135.stdout:1/126: write d1d/f21 [283637,22225] 0 2024-09-10T09:36:16.142 INFO:tasks.workunit.client.1.smithi135.stdout:1/127: creat d1d/f25 x:0 0 0 2024-09-10T09:36:16.143 INFO:tasks.workunit.client.1.smithi135.stdout:6/184: mknod d5/c40 0 2024-09-10T09:36:16.148 INFO:tasks.workunit.client.1.smithi135.stdout:1/128: truncate f3 5911588 0 2024-09-10T09:36:16.153 INFO:tasks.workunit.client.1.smithi135.stdout:1/129: write f1b [1981157,35347] 0 2024-09-10T09:36:16.153 INFO:tasks.workunit.client.1.smithi135.stdout:1/130: rename d1d to d1d/d26 22 2024-09-10T09:36:16.163 INFO:tasks.workunit.client.1.smithi135.stdout:6/185: dwrite d5/d1e/f28 [0,4194304] 0 2024-09-10T09:36:16.165 INFO:tasks.workunit.client.1.smithi135.stdout:6/186: creat d5/d1e/d3b/f41 x:0 0 0 2024-09-10T09:36:16.165 INFO:tasks.workunit.client.1.smithi135.stdout:6/187: readlink d5/dd/d29/d2d/l37 0 2024-09-10T09:36:16.165 INFO:tasks.workunit.client.1.smithi135.stdout:6/188: chown d5/d1e/d35/f3a 11 1 2024-09-10T09:36:16.170 INFO:tasks.workunit.client.1.smithi135.stdout:6/189: rename d5/dd/d29 to d5/d1e/d3b/d42 0 2024-09-10T09:36:16.170 INFO:tasks.workunit.client.1.smithi135.stdout:1/131: dwrite f11 [0,4194304] 0 2024-09-10T09:36:16.177 INFO:tasks.workunit.client.1.smithi135.stdout:1/132: unlink f10 0 2024-09-10T09:36:16.177 INFO:tasks.workunit.client.1.smithi135.stdout:1/133: readlink l13 0 2024-09-10T09:36:16.178 INFO:tasks.workunit.client.1.smithi135.stdout:1/134: write d1d/f21 [998845,41732] 0 2024-09-10T09:36:16.178 INFO:tasks.workunit.client.1.smithi135.stdout:1/135: creat d1d/f27 x:0 0 0 2024-09-10T09:36:16.180 INFO:tasks.workunit.client.1.smithi135.stdout:1/136: unlink d1d/d20/c23 0 2024-09-10T09:36:16.180 INFO:tasks.workunit.client.1.smithi135.stdout:1/137: readlink l19 0 2024-09-10T09:36:16.182 INFO:tasks.workunit.client.1.smithi135.stdout:1/138: mkdir d1d/d28 0 2024-09-10T09:36:16.184 INFO:tasks.workunit.client.1.smithi135.stdout:1/139: link f11 d1d/d20/d24/f29 0 2024-09-10T09:36:16.187 INFO:tasks.workunit.client.1.smithi135.stdout:6/190: dwrite d5/d1e/d3b/d42/f2e [0,4194304] 0 2024-09-10T09:36:16.187 INFO:tasks.workunit.client.1.smithi135.stdout:6/191: chown d5/d1e/d35/f30 759822295 1 2024-09-10T09:36:16.188 INFO:tasks.workunit.client.1.smithi135.stdout:6/192: mknod d5/c43 0 2024-09-10T09:36:16.190 INFO:tasks.workunit.client.1.smithi135.stdout:6/193: mkdir d5/d1e/d3b/d42/d3c/d44 0 2024-09-10T09:36:16.192 INFO:tasks.workunit.client.1.smithi135.stdout:6/194: write d5/d15/f1c [682910,85985] 0 2024-09-10T09:36:16.193 INFO:tasks.workunit.client.1.smithi135.stdout:1/140: dread d1d/d20/d24/f29 [0,4194304] 0 2024-09-10T09:36:16.196 INFO:tasks.workunit.client.1.smithi135.stdout:1/141: rename f16 to d1d/f2a 0 2024-09-10T09:36:16.196 INFO:tasks.workunit.client.1.smithi135.stdout:1/142: readlink le 0 2024-09-10T09:36:16.197 INFO:tasks.workunit.client.1.smithi135.stdout:1/143: write d1d/f25 [508282,89496] 0 2024-09-10T09:36:16.197 INFO:tasks.workunit.client.1.smithi135.stdout:1/144: write f3 [2884061,29508] 0 2024-09-10T09:36:16.197 INFO:tasks.workunit.client.1.smithi135.stdout:1/145: readlink l13 0 2024-09-10T09:36:16.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/146: mkdir d1d/d20/d24/d2b 0 2024-09-10T09:36:16.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/147: chown cd 486 1 2024-09-10T09:36:16.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/148: fsync d1d/f21 0 2024-09-10T09:36:16.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/149: creat d1d/f2c x:0 0 0 2024-09-10T09:36:16.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/150: fdatasync d1d/f2c 0 2024-09-10T09:36:16.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/151: dread d1d/f1e [0,4194304] 0 2024-09-10T09:36:16.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/152: dread - d1d/f2c zero size 2024-09-10T09:36:16.202 INFO:tasks.workunit.client.1.smithi135.stdout:1/153: chown c5 1128 1 2024-09-10T09:36:16.206 INFO:tasks.workunit.client.1.smithi135.stdout:1/154: dread d1d/d20/d24/f29 [0,4194304] 0 2024-09-10T09:36:16.206 INFO:tasks.workunit.client.1.smithi135.stdout:1/155: read d1d/f25 [531362,115193] 0 2024-09-10T09:36:16.210 INFO:tasks.workunit.client.1.smithi135.stdout:1/156: dread fc [0,4194304] 0 2024-09-10T09:36:16.213 INFO:tasks.workunit.client.1.smithi135.stdout:1/157: rename c1a to d1d/c2d 0 2024-09-10T09:36:16.213 INFO:tasks.workunit.client.1.smithi135.stdout:1/158: chown f1b 1204 1 2024-09-10T09:36:16.215 INFO:tasks.workunit.client.1.smithi135.stdout:1/159: unlink c12 0 2024-09-10T09:36:16.217 INFO:tasks.workunit.client.1.smithi135.stdout:1/160: creat d1d/d20/f2e x:0 0 0 2024-09-10T09:36:16.217 INFO:tasks.workunit.client.1.smithi135.stdout:1/161: truncate d1d/f27 175546 0 2024-09-10T09:36:16.235 INFO:tasks.workunit.client.1.smithi135.stdout:1/162: dwrite f1b [0,4194304] 0 2024-09-10T09:36:16.235 INFO:tasks.workunit.client.1.smithi135.stdout:1/163: fsync f4 0 2024-09-10T09:36:16.236 INFO:tasks.workunit.client.1.smithi135.stdout:1/164: unlink c14 0 2024-09-10T09:36:16.238 INFO:tasks.workunit.client.1.smithi135.stdout:1/165: link l1c d1d/d28/l2f 0 2024-09-10T09:36:16.245 INFO:tasks.workunit.client.1.smithi135.stdout:1/166: dread f1b [0,4194304] 0 2024-09-10T09:36:16.245 INFO:tasks.workunit.client.1.smithi135.stdout:1/167: creat d1d/d20/f30 x:0 0 0 2024-09-10T09:36:16.245 INFO:tasks.workunit.client.1.smithi135.stdout:1/168: creat d1d/d20/f31 x:0 0 0 2024-09-10T09:36:16.249 INFO:tasks.workunit.client.1.smithi135.stdout:1/169: creat d1d/d20/d24/d2b/f32 x:0 0 0 2024-09-10T09:36:16.250 INFO:tasks.workunit.client.1.smithi135.stdout:1/170: symlink d1d/d20/d24/d2b/l33 0 2024-09-10T09:36:16.266 INFO:tasks.workunit.client.1.smithi135.stdout:1/171: dwrite d1d/f22 [0,4194304] 0 2024-09-10T09:36:16.269 INFO:tasks.workunit.client.1.smithi135.stdout:1/172: mkdir d1d/d34 0 2024-09-10T09:36:16.272 INFO:tasks.workunit.client.1.smithi135.stdout:1/173: unlink c0 0 2024-09-10T09:36:16.276 INFO:tasks.workunit.client.1.smithi135.stdout:1/174: dread fc [0,4194304] 0 2024-09-10T09:36:16.279 INFO:tasks.workunit.client.1.smithi135.stdout:1/175: rename fc to d1d/d20/f35 0 2024-09-10T09:36:16.279 INFO:tasks.workunit.client.1.smithi135.stdout:1/176: readlink le 0 2024-09-10T09:36:16.279 INFO:tasks.workunit.client.1.smithi135.stdout:1/177: chown d1d/d20/d24/d2b 3276 1 2024-09-10T09:36:16.279 INFO:tasks.workunit.client.1.smithi135.stdout:1/178: creat d1d/d20/d24/d2b/f36 x:0 0 0 2024-09-10T09:36:16.279 INFO:tasks.workunit.client.1.smithi135.stdout:1/179: chown d1d/f22 326877088 1 2024-09-10T09:36:16.280 INFO:tasks.workunit.client.1.smithi135.stdout:1/180: mkdir d1d/d20/d24/d37 0 2024-09-10T09:36:16.650 INFO:tasks.workunit.client.1.smithi135.stdout:3/94: sync 2024-09-10T09:36:16.650 INFO:tasks.workunit.client.1.smithi135.stdout:7/180: sync 2024-09-10T09:36:16.650 INFO:tasks.workunit.client.1.smithi135.stdout:3/95: readlink d4/d5/l1c 0 2024-09-10T09:36:16.652 INFO:tasks.workunit.client.1.smithi135.stdout:7/181: mknod d2/d3/d36/c42 0 2024-09-10T09:36:16.653 INFO:tasks.workunit.client.1.smithi135.stdout:7/182: creat d2/d11/f43 x:0 0 0 2024-09-10T09:36:16.655 INFO:tasks.workunit.client.1.smithi135.stdout:3/96: dread f1 [0,4194304] 0 2024-09-10T09:36:16.655 INFO:tasks.workunit.client.1.smithi135.stdout:3/97: readlink d4/l6 0 2024-09-10T09:36:16.655 INFO:tasks.workunit.client.1.smithi135.stdout:3/98: dread - d4/f15 zero size 2024-09-10T09:36:16.655 INFO:tasks.workunit.client.1.smithi135.stdout:7/183: truncate d2/d11/f22 1206769 0 2024-09-10T09:36:16.656 INFO:tasks.workunit.client.1.smithi135.stdout:3/99: truncate f3 2347656 0 2024-09-10T09:36:16.657 INFO:tasks.workunit.client.1.smithi135.stdout:3/100: mkdir d4/d5/db/d1b/d1f 0 2024-09-10T09:36:16.659 INFO:tasks.workunit.client.1.smithi135.stdout:3/101: mknod d4/d5/db/c20 0 2024-09-10T09:36:16.662 INFO:tasks.workunit.client.1.smithi135.stdout:3/102: symlink d4/d5/db/dd/l21 0 2024-09-10T09:36:16.673 INFO:tasks.workunit.client.1.smithi135.stdout:3/103: getdents d4/d5/db 0 2024-09-10T09:36:16.674 INFO:tasks.workunit.client.1.smithi135.stdout:3/104: rename d4/d5/dc/l18 to d4/d5/db/l22 0 2024-09-10T09:36:16.674 INFO:tasks.workunit.client.1.smithi135.stdout:3/105: chown f3 2142 1 2024-09-10T09:36:16.679 INFO:tasks.workunit.client.1.smithi135.stdout:7/184: dwrite d2/d11/d16/f1d [0,4194304] 0 2024-09-10T09:36:16.679 INFO:tasks.workunit.client.1.smithi135.stdout:7/185: chown d2/d15/f2f 969986 1 2024-09-10T09:36:16.705 INFO:tasks.workunit.client.1.smithi135.stdout:3/106: dwrite d4/f15 [0,4194304] 0 2024-09-10T09:36:16.705 INFO:tasks.workunit.client.1.smithi135.stdout:7/186: dwrite d2/d3/fe [0,4194304] 0 2024-09-10T09:36:16.705 INFO:tasks.workunit.client.1.smithi135.stdout:7/187: read d2/f4 [1058022,30309] 0 2024-09-10T09:36:16.705 INFO:tasks.workunit.client.1.smithi135.stdout:7/188: truncate d2/d11/d16/f28 285583 0 2024-09-10T09:36:16.705 INFO:tasks.workunit.client.1.smithi135.stdout:7/189: chown d2/ff 0 1 2024-09-10T09:36:16.713 INFO:tasks.workunit.client.1.smithi135.stdout:3/107: dread d4/f15 [0,4194304] 0 2024-09-10T09:36:16.746 INFO:tasks.workunit.client.1.smithi135.stdout:7/190: creat d2/d15/d41/f44 x:0 0 0 2024-09-10T09:36:16.747 INFO:tasks.workunit.client.1.smithi135.stdout:3/108: rmdir d4 39 2024-09-10T09:36:16.752 INFO:tasks.workunit.client.1.smithi135.stdout:7/191: symlink d2/d15/d41/l45 0 2024-09-10T09:36:16.752 INFO:tasks.workunit.client.1.smithi135.stdout:3/109: dread d4/f15 [0,4194304] 0 2024-09-10T09:36:16.755 INFO:tasks.workunit.client.1.smithi135.stdout:7/192: mkdir d2/d11/d30/d46 0 2024-09-10T09:36:16.755 INFO:tasks.workunit.client.1.smithi135.stdout:7/193: truncate d2/d11/d30/f35 36994 0 2024-09-10T09:36:16.761 INFO:tasks.workunit.client.1.smithi135.stdout:3/110: dread d4/f9 [0,4194304] 0 2024-09-10T09:36:16.761 INFO:tasks.workunit.client.1.smithi135.stdout:3/111: write f3 [1261254,117739] 0 2024-09-10T09:36:16.765 INFO:tasks.workunit.client.1.smithi135.stdout:3/112: mknod d4/d5/db/c23 0 2024-09-10T09:36:16.768 INFO:tasks.workunit.client.1.smithi135.stdout:3/113: symlink d4/d5/db/dd/l24 0 2024-09-10T09:36:16.768 INFO:tasks.workunit.client.1.smithi135.stdout:3/114: fsync d4/f15 0 2024-09-10T09:36:16.770 INFO:tasks.workunit.client.1.smithi135.stdout:3/115: rename d4/f15 to d4/f25 0 2024-09-10T09:36:16.774 INFO:tasks.workunit.client.1.smithi135.stdout:7/194: dwrite d2/f3a [0,4194304] 0 2024-09-10T09:36:16.775 INFO:tasks.workunit.client.1.smithi135.stdout:3/116: dread d4/f9 [0,4194304] 0 2024-09-10T09:36:16.775 INFO:tasks.workunit.client.1.smithi135.stdout:3/117: read d4/d5/dc/f10 [44870,35870] 0 2024-09-10T09:36:16.782 INFO:tasks.workunit.client.1.smithi135.stdout:3/118: rmdir d4/d5/db 39 2024-09-10T09:36:16.784 INFO:tasks.workunit.client.1.smithi135.stdout:3/119: creat d4/f26 x:0 0 0 2024-09-10T09:36:16.790 INFO:tasks.workunit.client.1.smithi135.stdout:7/195: dwrite d2/d15/f24 [0,4194304] 0 2024-09-10T09:36:16.790 INFO:tasks.workunit.client.1.smithi135.stdout:7/196: fdatasync d2/d11/d30/f35 0 2024-09-10T09:36:16.791 INFO:tasks.workunit.client.1.smithi135.stdout:3/120: read d4/f9 [2018718,6524] 0 2024-09-10T09:36:16.791 INFO:tasks.workunit.client.1.smithi135.stdout:3/121: stat f3 0 2024-09-10T09:36:16.798 INFO:tasks.workunit.client.1.smithi135.stdout:7/197: write d2/d15/f2c [978620,84730] 0 2024-09-10T09:36:16.803 INFO:tasks.workunit.client.1.smithi135.stdout:3/122: rename d4/d5/l1d to d4/d5/db/dd/l27 0 2024-09-10T09:36:16.815 INFO:tasks.workunit.client.1.smithi135.stdout:7/198: unlink d2/d11/d16/f1d 0 2024-09-10T09:36:16.821 INFO:tasks.workunit.client.1.smithi135.stdout:7/199: rmdir d2/d26 39 2024-09-10T09:36:16.821 INFO:tasks.workunit.client.1.smithi135.stdout:7/200: write d2/d25/f3f [615876,66899] 0 2024-09-10T09:36:16.822 INFO:tasks.workunit.client.1.smithi135.stdout:3/123: mknod d4/d5/db/d1b/c28 0 2024-09-10T09:36:16.825 INFO:tasks.workunit.client.1.smithi135.stdout:3/124: mknod d4/d5/db/d1b/c29 0 2024-09-10T09:36:16.825 INFO:tasks.workunit.client.1.smithi135.stdout:3/125: chown d4/d5/db/d1b/d1f 47185 1 2024-09-10T09:36:16.829 INFO:tasks.workunit.client.1.smithi135.stdout:7/201: dread d2/d3/f12 [0,4194304] 0 2024-09-10T09:36:16.844 INFO:tasks.workunit.client.1.smithi135.stdout:8/183: sync 2024-09-10T09:36:16.844 INFO:tasks.workunit.client.1.smithi135.stdout:4/265: sync 2024-09-10T09:36:16.844 INFO:tasks.workunit.client.1.smithi135.stdout:4/266: creat d1/de/f59 x:0 0 0 2024-09-10T09:36:16.847 INFO:tasks.workunit.client.1.smithi135.stdout:7/202: dwrite d2/d11/f43 [0,4194304] 0 2024-09-10T09:36:16.852 INFO:tasks.workunit.client.1.smithi135.stdout:4/267: mknod d1/c5a 0 2024-09-10T09:36:16.855 INFO:tasks.workunit.client.1.smithi135.stdout:7/203: write d2/d15/f3d [830669,66291] 0 2024-09-10T09:36:16.856 INFO:tasks.workunit.client.1.smithi135.stdout:8/184: mknod d1/d15/c42 0 2024-09-10T09:36:16.862 INFO:tasks.workunit.client.1.smithi135.stdout:8/185: creat d1/d15/d16/d33/d39/f43 x:0 0 0 2024-09-10T09:36:16.864 INFO:tasks.workunit.client.1.smithi135.stdout:7/204: write d2/d3/fe [3757211,65053] 0 2024-09-10T09:36:16.864 INFO:tasks.workunit.client.1.smithi135.stdout:8/186: chown d1/d15/c1e 11 1 2024-09-10T09:36:16.868 INFO:tasks.workunit.client.1.smithi135.stdout:8/187: mknod d1/d15/c44 0 2024-09-10T09:36:16.869 INFO:tasks.workunit.client.1.smithi135.stdout:4/268: dwrite d1/de/f57 [0,4194304] 0 2024-09-10T09:36:16.870 INFO:tasks.workunit.client.1.smithi135.stdout:8/188: truncate d1/fd 6005542 0 2024-09-10T09:36:16.873 INFO:tasks.workunit.client.1.smithi135.stdout:8/189: mkdir d1/d15/d16/d33/d45 0 2024-09-10T09:36:16.873 INFO:tasks.workunit.client.1.smithi135.stdout:7/205: dread d2/d15/f21 [0,4194304] 0 2024-09-10T09:36:16.877 INFO:tasks.workunit.client.1.smithi135.stdout:4/269: write d1/db/d23/f3e [25492,31978] 0 2024-09-10T09:36:16.877 INFO:tasks.workunit.client.1.smithi135.stdout:4/270: fdatasync d1/de/d16/f3f 0 2024-09-10T09:36:16.877 INFO:tasks.workunit.client.1.smithi135.stdout:4/271: fdatasync d1/de/f57 0 2024-09-10T09:36:16.877 INFO:tasks.workunit.client.1.smithi135.stdout:8/190: truncate d1/d15/d16/f38 130471 0 2024-09-10T09:36:16.883 INFO:tasks.workunit.client.1.smithi135.stdout:4/272: rename d1/db/f8 to d1/de/d16/f5b 0 2024-09-10T09:36:16.885 INFO:tasks.workunit.client.1.smithi135.stdout:8/191: mknod d1/d15/d16/d33/c46 0 2024-09-10T09:36:16.887 INFO:tasks.workunit.client.1.smithi135.stdout:4/273: mknod d1/d33/d40/c5c 0 2024-09-10T09:36:16.890 INFO:tasks.workunit.client.1.smithi135.stdout:8/192: readlink d1/d15/d24/l3a 0 2024-09-10T09:36:16.899 INFO:tasks.workunit.client.1.smithi135.stdout:7/206: dwrite d2/d15/f2d [0,4194304] 0 2024-09-10T09:36:16.899 INFO:tasks.workunit.client.1.smithi135.stdout:7/207: write d2/d15/f3d [3301508,11056] 0 2024-09-10T09:36:16.912 INFO:tasks.workunit.client.1.smithi135.stdout:7/208: dread d2/f3a [0,4194304] 0 2024-09-10T09:36:16.913 INFO:tasks.workunit.client.1.smithi135.stdout:4/274: dwrite d1/de/d16/f5b [0,4194304] 0 2024-09-10T09:36:16.913 INFO:tasks.workunit.client.1.smithi135.stdout:4/275: chown d1/d33/c39 2511 1 2024-09-10T09:36:16.913 INFO:tasks.workunit.client.1.smithi135.stdout:8/193: dwrite d1/f3 [0,4194304] 0 2024-09-10T09:36:16.913 INFO:tasks.workunit.client.1.smithi135.stdout:8/194: write d1/d15/d16/d33/d39/f43 [571136,100490] 0 2024-09-10T09:36:16.915 INFO:tasks.workunit.client.1.smithi135.stdout:7/209: rename d2/f3c to d2/d15/f47 0 2024-09-10T09:36:16.922 INFO:tasks.workunit.client.1.smithi135.stdout:4/276: read d1/de/d16/f21 [429718,78978] 0 2024-09-10T09:36:16.926 INFO:tasks.workunit.client.1.smithi135.stdout:8/195: mkdir d1/d27/d3d/d47 0 2024-09-10T09:36:16.926 INFO:tasks.workunit.client.1.smithi135.stdout:8/196: write d1/d27/f36 [529723,125771] 0 2024-09-10T09:36:16.927 INFO:tasks.workunit.client.1.smithi135.stdout:4/277: mknod d1/db/d23/c5d 0 2024-09-10T09:36:16.927 INFO:tasks.workunit.client.1.smithi135.stdout:4/278: chown d1/d33/d40/l50 6098 1 2024-09-10T09:36:16.927 INFO:tasks.workunit.client.1.smithi135.stdout:4/279: fdatasync d1/d4a/f51 0 2024-09-10T09:36:16.928 INFO:tasks.workunit.client.1.smithi135.stdout:7/210: dread d2/d15/f24 [0,4194304] 0 2024-09-10T09:36:16.929 INFO:tasks.workunit.client.1.smithi135.stdout:8/197: creat d1/d27/d3d/f48 x:0 0 0 2024-09-10T09:36:16.929 INFO:tasks.workunit.client.1.smithi135.stdout:8/198: write d1/d15/d16/f38 [160914,36173] 0 2024-09-10T09:36:16.929 INFO:tasks.workunit.client.1.smithi135.stdout:4/280: symlink d1/db/d23/l5e 0 2024-09-10T09:36:16.931 INFO:tasks.workunit.client.1.smithi135.stdout:7/211: creat d2/d3/f48 x:0 0 0 2024-09-10T09:36:16.932 INFO:tasks.workunit.client.1.smithi135.stdout:7/212: mkdir d2/d15/d41/d49 0 2024-09-10T09:36:16.935 INFO:tasks.workunit.client.1.smithi135.stdout:8/199: mkdir d1/d15/d49 0 2024-09-10T09:36:16.936 INFO:tasks.workunit.client.1.smithi135.stdout:4/281: getdents d1/db/d9 0 2024-09-10T09:36:16.937 INFO:tasks.workunit.client.1.smithi135.stdout:4/282: chown d1/db/d9/c52 705 1 2024-09-10T09:36:16.937 INFO:tasks.workunit.client.1.smithi135.stdout:4/283: fsync d1/de/d16/f2f 0 2024-09-10T09:36:16.939 INFO:tasks.workunit.client.1.smithi135.stdout:4/284: read d1/de/d16/f3b [66670,95858] 0 2024-09-10T09:36:16.939 INFO:tasks.workunit.client.1.smithi135.stdout:4/285: fsync d1/de/d16/f44 0 2024-09-10T09:36:16.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/213: dread d2/d11/f43 [0,4194304] 0 2024-09-10T09:36:16.945 INFO:tasks.workunit.client.1.smithi135.stdout:8/200: dread d1/f3 [0,4194304] 0 2024-09-10T09:36:16.948 INFO:tasks.workunit.client.1.smithi135.stdout:7/214: dread d2/d15/f2c [0,4194304] 0 2024-09-10T09:36:16.948 INFO:tasks.workunit.client.1.smithi135.stdout:8/201: readlink d1/d15/l30 0 2024-09-10T09:36:16.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/286: dread d1/de/d16/f2f [0,4194304] 0 2024-09-10T09:36:16.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/287: chown d1/db/d9/c2b 136 1 2024-09-10T09:36:16.950 INFO:tasks.workunit.client.1.smithi135.stdout:4/288: write d1/d33/f3d [546195,109612] 0 2024-09-10T09:36:16.951 INFO:tasks.workunit.client.1.smithi135.stdout:4/289: dread d1/de/d16/f3b [0,4194304] 0 2024-09-10T09:36:16.951 INFO:tasks.workunit.client.1.smithi135.stdout:4/290: readlink d1/de/d16/l1d 0 2024-09-10T09:36:16.953 INFO:tasks.workunit.client.1.smithi135.stdout:4/291: truncate d1/db/f43 2881957 0 2024-09-10T09:36:16.955 INFO:tasks.workunit.client.1.smithi135.stdout:8/202: dread d1/f3 [0,4194304] 0 2024-09-10T09:36:16.965 INFO:tasks.workunit.client.1.smithi135.stdout:7/215: write d2/d11/d30/f34 [2380225,106414] 0 2024-09-10T09:36:16.965 INFO:tasks.workunit.client.1.smithi135.stdout:7/216: readlink l0 0 2024-09-10T09:36:16.976 INFO:tasks.workunit.client.1.smithi135.stdout:4/292: dwrite d1/db/d9/f38 [0,4194304] 0 2024-09-10T09:36:16.982 INFO:tasks.workunit.client.1.smithi135.stdout:4/293: dread d1/db/d23/f3e [0,4194304] 0 2024-09-10T09:36:16.990 INFO:tasks.workunit.client.1.smithi135.stdout:8/203: dwrite d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:16.990 INFO:tasks.workunit.client.1.smithi135.stdout:7/217: dwrite d2/d11/d30/f35 [0,4194304] 0 2024-09-10T09:36:16.995 INFO:tasks.workunit.client.1.smithi135.stdout:4/294: write d1/db/ff [2793334,53989] 0 2024-09-10T09:36:16.995 INFO:tasks.workunit.client.1.smithi135.stdout:4/295: fdatasync d1/db/d23/f30 0 2024-09-10T09:36:17.000 INFO:tasks.workunit.client.1.smithi135.stdout:8/204: symlink d1/d27/d3d/l4a 0 2024-09-10T09:36:17.003 INFO:tasks.workunit.client.1.smithi135.stdout:8/205: dread d1/f3 [0,4194304] 0 2024-09-10T09:36:17.003 INFO:tasks.workunit.client.1.smithi135.stdout:7/218: rename d2/d3 to d2/d15/d4a 0 2024-09-10T09:36:17.005 INFO:tasks.workunit.client.1.smithi135.stdout:4/296: dread d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:17.008 INFO:tasks.workunit.client.1.smithi135.stdout:8/206: unlink d1/lf 0 2024-09-10T09:36:17.008 INFO:tasks.workunit.client.1.smithi135.stdout:8/207: chown d1/c4 127 1 2024-09-10T09:36:17.009 INFO:tasks.workunit.client.1.smithi135.stdout:4/297: dread d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:17.011 INFO:tasks.workunit.client.1.smithi135.stdout:7/219: dread d2/d11/f22 [0,4194304] 0 2024-09-10T09:36:17.011 INFO:tasks.workunit.client.1.smithi135.stdout:7/220: dread - d2/d15/f20 zero size 2024-09-10T09:36:17.011 INFO:tasks.workunit.client.1.smithi135.stdout:8/208: unlink d1/d27/c31 0 2024-09-10T09:36:17.011 INFO:tasks.workunit.client.1.smithi135.stdout:8/209: write d1/d15/d24/f35 [515887,16] 0 2024-09-10T09:36:17.011 INFO:tasks.workunit.client.1.smithi135.stdout:8/210: write d1/f23 [4570071,112925] 0 2024-09-10T09:36:17.013 INFO:tasks.workunit.client.1.smithi135.stdout:7/221: mknod d2/d15/d39/c4b 0 2024-09-10T09:36:17.013 INFO:tasks.workunit.client.1.smithi135.stdout:4/298: dread d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:17.014 INFO:tasks.workunit.client.1.smithi135.stdout:8/211: mknod d1/d27/c4b 0 2024-09-10T09:36:17.017 INFO:tasks.workunit.client.1.smithi135.stdout:5/113: sync 2024-09-10T09:36:17.018 INFO:tasks.workunit.client.1.smithi135.stdout:0/213: sync 2024-09-10T09:36:17.020 INFO:tasks.workunit.client.1.smithi135.stdout:4/299: unlink d1/de/c53 0 2024-09-10T09:36:17.020 INFO:tasks.workunit.client.1.smithi135.stdout:4/300: write d1/d4a/f51 [271638,7836] 0 2024-09-10T09:36:17.022 INFO:tasks.workunit.client.1.smithi135.stdout:0/214: dread d8/f26 [0,4194304] 0 2024-09-10T09:36:17.025 INFO:tasks.workunit.client.1.smithi135.stdout:0/215: mkdir d8/dd/d18/d3d 0 2024-09-10T09:36:17.025 INFO:tasks.workunit.client.1.smithi135.stdout:4/301: dread d1/de/f34 [0,4194304] 0 2024-09-10T09:36:17.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/302: readlink d1/d33/d40/l50 0 2024-09-10T09:36:17.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/303: chown d1/d33/c36 4201 1 2024-09-10T09:36:17.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/304: write d1/db/f54 [952337,24201] 0 2024-09-10T09:36:17.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/305: fdatasync d1/de/f3c 0 2024-09-10T09:36:17.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/306: readlink d1/de/d16/l1d 0 2024-09-10T09:36:17.026 INFO:tasks.workunit.client.1.smithi135.stdout:4/307: fdatasync d1/db/d9/f38 0 2024-09-10T09:36:17.027 INFO:tasks.workunit.client.1.smithi135.stdout:0/216: creat d8/d1c/f3e x:0 0 0 2024-09-10T09:36:17.028 INFO:tasks.workunit.client.1.smithi135.stdout:4/308: rename d1/c1e to d1/c5f 0 2024-09-10T09:36:17.042 INFO:tasks.workunit.client.1.smithi135.stdout:8/212: write d1/f5 [2299416,67224] 0 2024-09-10T09:36:17.042 INFO:tasks.workunit.client.1.smithi135.stdout:8/213: readlink d1/d27/l2b 0 2024-09-10T09:36:17.042 INFO:tasks.workunit.client.1.smithi135.stdout:8/214: write d1/d15/d24/f2d [877653,53314] 0 2024-09-10T09:36:17.043 INFO:tasks.workunit.client.1.smithi135.stdout:4/309: dread d1/de/d16/f5b [0,4194304] 0 2024-09-10T09:36:17.044 INFO:tasks.workunit.client.1.smithi135.stdout:8/215: symlink d1/d13/l4c 0 2024-09-10T09:36:17.044 INFO:tasks.workunit.client.1.smithi135.stdout:8/216: truncate d1/f25 5001149 0 2024-09-10T09:36:17.046 INFO:tasks.workunit.client.1.smithi135.stdout:0/217: dread d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:36:17.046 INFO:tasks.workunit.client.1.smithi135.stdout:7/222: dwrite d2/f1f [0,4194304] 0 2024-09-10T09:36:17.047 INFO:tasks.workunit.client.1.smithi135.stdout:4/310: link d1/db/d9/c26 d1/de/c60 0 2024-09-10T09:36:17.047 INFO:tasks.workunit.client.1.smithi135.stdout:0/218: dread d8/d1c/d2c/f30 [0,4194304] 0 2024-09-10T09:36:17.049 INFO:tasks.workunit.client.1.smithi135.stdout:8/217: creat d1/d15/f4d x:0 0 0 2024-09-10T09:36:17.049 INFO:tasks.workunit.client.1.smithi135.stdout:0/219: dread d8/f26 [0,4194304] 0 2024-09-10T09:36:17.050 INFO:tasks.workunit.client.1.smithi135.stdout:7/223: creat d2/d11/d30/d46/f4c x:0 0 0 2024-09-10T09:36:17.052 INFO:tasks.workunit.client.1.smithi135.stdout:0/220: dread d8/dd/d11/f1f [0,4194304] 0 2024-09-10T09:36:17.052 INFO:tasks.workunit.client.1.smithi135.stdout:0/221: stat d8/de/d2e 0 2024-09-10T09:36:17.052 INFO:tasks.workunit.client.1.smithi135.stdout:4/311: truncate d1/de/d16/f21 2006647 0 2024-09-10T09:36:17.052 INFO:tasks.workunit.client.1.smithi135.stdout:5/114: dwrite d3/fd [0,4194304] 0 2024-09-10T09:36:17.052 INFO:tasks.workunit.client.1.smithi135.stdout:0/222: write d8/dd/f35 [22150,111876] 0 2024-09-10T09:36:17.057 INFO:tasks.workunit.client.1.smithi135.stdout:8/218: creat d1/d15/d49/f4e x:0 0 0 2024-09-10T09:36:17.058 INFO:tasks.workunit.client.1.smithi135.stdout:4/312: dread d1/de/d16/f2f [0,4194304] 0 2024-09-10T09:36:17.085 INFO:tasks.workunit.client.1.smithi135.stdout:4/313: dwrite d1/f56 [0,4194304] 0 2024-09-10T09:36:17.086 INFO:tasks.workunit.client.1.smithi135.stdout:8/219: dwrite d1/f7 [0,4194304] 0 2024-09-10T09:36:17.086 INFO:tasks.workunit.client.1.smithi135.stdout:5/115: symlink d3/l21 0 2024-09-10T09:36:17.087 INFO:tasks.workunit.client.1.smithi135.stdout:0/223: symlink d8/de/l3f 0 2024-09-10T09:36:17.087 INFO:tasks.workunit.client.1.smithi135.stdout:0/224: readlink d8/dd/d11/l25 0 2024-09-10T09:36:17.087 INFO:tasks.workunit.client.1.smithi135.stdout:0/225: fdatasync d8/dd/d18/f1a 0 2024-09-10T09:36:17.098 INFO:tasks.workunit.client.1.smithi135.stdout:4/314: mknod d1/db/c61 0 2024-09-10T09:36:17.098 INFO:tasks.workunit.client.1.smithi135.stdout:2/150: sync 2024-09-10T09:36:17.102 INFO:tasks.workunit.client.1.smithi135.stdout:8/220: mknod d1/d15/d16/d33/d45/c4f 0 2024-09-10T09:36:17.102 INFO:tasks.workunit.client.1.smithi135.stdout:8/221: write d1/d15/d24/f35 [770486,90583] 0 2024-09-10T09:36:17.103 INFO:tasks.workunit.client.1.smithi135.stdout:5/116: truncate d3/dc/f10 1533588 0 2024-09-10T09:36:17.107 INFO:tasks.workunit.client.1.smithi135.stdout:4/315: creat d1/db/d9/f62 x:0 0 0 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:4/316: chown d1/de/f13 20503331 1 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:4/317: write d1/d33/d40/f4d [2035283,91890] 0 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:9/163: sync 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:1/181: sync 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:3/126: sync 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:6/195: sync 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:3/127: chown d4/d5/db/c23 171 1 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:3/128: truncate d4/f26 586032 0 2024-09-10T09:36:17.108 INFO:tasks.workunit.client.1.smithi135.stdout:1/182: write d1d/f2c [471019,129877] 0 2024-09-10T09:36:17.109 INFO:tasks.workunit.client.1.smithi135.stdout:2/151: mkdir df/d1b/d30 0 2024-09-10T09:36:17.111 INFO:tasks.workunit.client.1.smithi135.stdout:5/117: dread - d3/dc/f13 zero size 2024-09-10T09:36:17.112 INFO:tasks.workunit.client.1.smithi135.stdout:5/118: truncate d3/ff 627750 0 2024-09-10T09:36:17.113 INFO:tasks.workunit.client.1.smithi135.stdout:0/226: mknod d8/c40 0 2024-09-10T09:36:17.114 INFO:tasks.workunit.client.1.smithi135.stdout:0/227: stat d8/dd/d1e 0 2024-09-10T09:36:17.115 INFO:tasks.workunit.client.1.smithi135.stdout:6/196: mknod d5/d1e/d35/c45 0 2024-09-10T09:36:17.117 INFO:tasks.workunit.client.1.smithi135.stdout:1/183: rename d1d/d28/l2f to d1d/d20/d24/l38 0 2024-09-10T09:36:17.119 INFO:tasks.workunit.client.1.smithi135.stdout:9/164: dread de/f18 [0,4194304] 0 2024-09-10T09:36:17.121 INFO:tasks.workunit.client.1.smithi135.stdout:2/152: rmdir df/d1b/d27 39 2024-09-10T09:36:17.121 INFO:tasks.workunit.client.1.smithi135.stdout:6/197: dread d5/d15/d27/f3d [0,4194304] 0 2024-09-10T09:36:17.122 INFO:tasks.workunit.client.1.smithi135.stdout:4/318: write d1/de/d16/f3b [282688,12627] 0 2024-09-10T09:36:17.122 INFO:tasks.workunit.client.1.smithi135.stdout:4/319: chown d1/de/f59 88002505 1 2024-09-10T09:36:17.123 INFO:tasks.workunit.client.1.smithi135.stdout:5/119: chown d3/dc/l15 70862356 1 2024-09-10T09:36:17.124 INFO:tasks.workunit.client.1.smithi135.stdout:0/228: creat d8/de/f41 x:0 0 0 2024-09-10T09:36:17.129 INFO:tasks.workunit.client.1.smithi135.stdout:1/184: write d1d/d20/d24/f29 [3079459,29061] 0 2024-09-10T09:36:17.130 INFO:tasks.workunit.client.1.smithi135.stdout:8/222: truncate d1/fd 4956837 0 2024-09-10T09:36:17.131 INFO:tasks.workunit.client.1.smithi135.stdout:5/120: write d3/dc/f10 [89356,88631] 0 2024-09-10T09:36:17.131 INFO:tasks.workunit.client.1.smithi135.stdout:5/121: chown d3/l1a 633446533 1 2024-09-10T09:36:17.139 INFO:tasks.workunit.client.1.smithi135.stdout:9/165: mknod de/df/d1d/d1e/c36 0 2024-09-10T09:36:17.139 INFO:tasks.workunit.client.1.smithi135.stdout:2/153: mkdir df/d1b/d31 0 2024-09-10T09:36:17.141 INFO:tasks.workunit.client.1.smithi135.stdout:2/154: dread df/d1b/d23/f28 [0,4194304] 0 2024-09-10T09:36:17.145 INFO:tasks.workunit.client.1.smithi135.stdout:6/198: symlink d5/l46 0 2024-09-10T09:36:17.145 INFO:tasks.workunit.client.1.smithi135.stdout:6/199: chown d5/d15/f22 113889 1 2024-09-10T09:36:17.148 INFO:tasks.workunit.client.1.smithi135.stdout:5/122: dread d3/fd [0,4194304] 0 2024-09-10T09:36:17.151 INFO:tasks.workunit.client.1.smithi135.stdout:0/229: truncate d8/dd/d1e/f23 187556 0 2024-09-10T09:36:17.151 INFO:tasks.workunit.client.1.smithi135.stdout:4/320: dwrite d1/db/f54 [0,4194304] 0 2024-09-10T09:36:17.155 INFO:tasks.workunit.client.1.smithi135.stdout:8/223: dwrite d1/d15/d49/f4e [0,4194304] 0 2024-09-10T09:36:17.155 INFO:tasks.workunit.client.1.smithi135.stdout:8/224: fsync d1/d15/d16/d33/d39/f43 0 2024-09-10T09:36:17.165 INFO:tasks.workunit.client.1.smithi135.stdout:9/166: rename de/df/d1d/d23/d25/d28/f2f to de/df/d1d/d23/d25/d28/f37 0 2024-09-10T09:36:17.168 INFO:tasks.workunit.client.1.smithi135.stdout:6/200: creat d5/d1e/d3b/d42/d3c/f47 x:0 0 0 2024-09-10T09:36:17.172 INFO:tasks.workunit.client.1.smithi135.stdout:0/230: truncate d8/dd/d1e/f23 415527 0 2024-09-10T09:36:17.176 INFO:tasks.workunit.client.1.smithi135.stdout:9/167: read de/df/d1d/f1f [3225889,4938] 0 2024-09-10T09:36:17.177 INFO:tasks.workunit.client.1.smithi135.stdout:8/225: dread - d1/d15/f19 zero size 2024-09-10T09:36:17.179 INFO:tasks.workunit.client.1.smithi135.stdout:8/226: dread d1/d15/d16/f1a [0,4194304] 0 2024-09-10T09:36:17.179 INFO:tasks.workunit.client.1.smithi135.stdout:8/227: write d1/d15/d24/f2c [4772929,17] 0 2024-09-10T09:36:17.182 INFO:tasks.workunit.client.1.smithi135.stdout:8/228: dread d1/d15/d24/f2d [0,4194304] 0 2024-09-10T09:36:17.182 INFO:tasks.workunit.client.1.smithi135.stdout:8/229: stat d1/d15/c1e 0 2024-09-10T09:36:17.182 INFO:tasks.workunit.client.1.smithi135.stdout:5/123: dwrite d3/fb [4194304,4194304] 0 2024-09-10T09:36:17.182 INFO:tasks.workunit.client.1.smithi135.stdout:6/201: dread f4 [4194304,4194304] 0 2024-09-10T09:36:17.182 INFO:tasks.workunit.client.1.smithi135.stdout:1/185: rmdir d1d 39 2024-09-10T09:36:17.183 INFO:tasks.workunit.client.1.smithi135.stdout:2/155: dwrite df/f17 [0,4194304] 0 2024-09-10T09:36:17.184 INFO:tasks.workunit.client.1.smithi135.stdout:4/321: dwrite d1/db/d23/f30 [0,4194304] 0 2024-09-10T09:36:17.189 INFO:tasks.workunit.client.1.smithi135.stdout:0/231: creat d8/dd/d11/d17/f42 x:0 0 0 2024-09-10T09:36:17.190 INFO:tasks.workunit.client.1.smithi135.stdout:6/202: dread d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:17.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/168: mknod de/df/d1d/c38 0 2024-09-10T09:36:17.192 INFO:tasks.workunit.client.1.smithi135.stdout:9/169: chown de/df/d1d/d1e/c2c 4074449 1 2024-09-10T09:36:17.196 INFO:tasks.workunit.client.1.smithi135.stdout:8/230: creat d1/d15/d16/d33/d45/f50 x:0 0 0 2024-09-10T09:36:17.197 INFO:tasks.workunit.client.1.smithi135.stdout:8/231: dread - d1/d15/d24/f3f zero size 2024-09-10T09:36:17.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/186: rename d1d/d20/f35 to d1d/d20/d24/d37/f39 0 2024-09-10T09:36:17.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/187: fdatasync d1d/f27 0 2024-09-10T09:36:17.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/188: stat d1d/d20/d24 0 2024-09-10T09:36:17.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/189: truncate d1d/d20/d24/d2b/f36 877061 0 2024-09-10T09:36:17.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/190: write f11 [3019359,25233] 0 2024-09-10T09:36:17.201 INFO:tasks.workunit.client.1.smithi135.stdout:1/191: fsync f6 0 2024-09-10T09:36:17.202 INFO:tasks.workunit.client.1.smithi135.stdout:2/156: mknod df/d15/c32 0 2024-09-10T09:36:17.205 INFO:tasks.workunit.client.1.smithi135.stdout:0/232: dwrite d8/dd/d11/f1f [0,4194304] 0 2024-09-10T09:36:17.209 INFO:tasks.workunit.client.1.smithi135.stdout:6/203: getdents d5/d1e/d35 0 2024-09-10T09:36:17.213 INFO:tasks.workunit.client.1.smithi135.stdout:9/170: link de/df/d1d/d23/f2d de/df/d1d/d23/d25/d28/f39 0 2024-09-10T09:36:17.215 INFO:tasks.workunit.client.1.smithi135.stdout:9/171: dread de/f17 [0,4194304] 0 2024-09-10T09:36:17.427 INFO:tasks.workunit.client.1.smithi135.stdout:9/172: fdatasync de/df/f10 0 2024-09-10T09:36:17.427 INFO:tasks.workunit.client.1.smithi135.stdout:9/173: creat de/df/d1d/f3a x:0 0 0 2024-09-10T09:36:17.427 INFO:tasks.workunit.client.1.smithi135.stdout:9/174: chown f9 65993590 1 2024-09-10T09:36:17.427 INFO:tasks.workunit.client.1.smithi135.stdout:8/232: truncate d1/f25 939614 0 2024-09-10T09:36:17.438 INFO:tasks.workunit.client.1.smithi135.stdout:5/124: mkdir d3/dc/d17/d22 0 2024-09-10T09:36:17.438 INFO:tasks.workunit.client.1.smithi135.stdout:1/192: creat d1d/d20/d24/d2b/f3a x:0 0 0 2024-09-10T09:36:17.438 INFO:tasks.workunit.client.1.smithi135.stdout:6/204: mknod d5/d15/c48 0 2024-09-10T09:36:17.438 INFO:tasks.workunit.client.1.smithi135.stdout:6/205: truncate d5/d15/f22 5293691 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:9/175: mknod de/df/c3b 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:0/233: dwrite d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:0/234: fdatasync d8/dd/d11/f2b 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:2/157: dwrite df/d1b/f1c [0,4194304] 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:2/158: fsync f6 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:8/233: mknod d1/c51 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:5/125: creat d3/dc/f23 x:0 0 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:5/126: read d3/dc/f10 [1259787,83920] 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:0/235: dread d8/fb [0,4194304] 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:0/236: read d8/dd/f35 [57280,86527] 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:0/237: creat d8/dd/d18/f43 x:0 0 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:0/238: dread f4 [0,4194304] 0 2024-09-10T09:36:17.439 INFO:tasks.workunit.client.1.smithi135.stdout:1/193: symlink d1d/d28/l3b 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:9/176: dread de/df/d1d/d23/d25/f32 [0,4194304] 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:6/206: mkdir d5/d1e/d3b/d49 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:6/207: dread - d5/d1e/f2f zero size 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:6/208: fsync d5/d1e/d3b/d42/f2e 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/234: dread d1/f7 [0,4194304] 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/235: creat d1/d15/d16/d33/d45/f52 x:0 0 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:1/194: dread f11 [0,4194304] 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:1/195: chown d1d/d20/f31 3 1 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:2/159: creat df/d15/f33 x:0 0 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:2/160: chown df 22 1 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:2/161: truncate df/f10 691304 0 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:2/162: chown f8 202 1 2024-09-10T09:36:17.440 INFO:tasks.workunit.client.1.smithi135.stdout:2/163: read df/d1b/d23/f28 [834056,69564] 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/127: mknod d3/dc/d17/c24 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/128: dread d3/fd [0,4194304] 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:0/239: unlink d8/c16 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:9/177: rmdir de/df 39 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:6/209: rename d5/dd/l23 to d5/d1e/l4a 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:8/236: unlink d1/d15/d16/c17 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:1/196: rmdir d1d/d34 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:1/197: truncate d1d/d20/d24/d2b/f3a 811523 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/129: mknod d3/dc/d17/d22/c25 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/130: write d3/fb [9169963,5710] 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:0/240: link d8/de/cf d8/de/d2e/c44 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:6/210: creat d5/d1e/d35/f4b x:0 0 0 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:6/211: chown d5/d15/d27/l36 845 1 2024-09-10T09:36:17.441 INFO:tasks.workunit.client.1.smithi135.stdout:8/237: mknod d1/d27/c53 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:1/198: unlink d1d/d20/d24/d37/f39 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:9/178: dwrite de/df/f10 [0,4194304] 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:9/179: write de/df/d1d/f3a [937478,37878] 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:9/180: chown de/df/d1d/d23/d25/d28/f37 1532637519 1 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:5/131: mkdir d3/d26 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:0/241: symlink d8/dd/d18/d3d/l45 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:0/242: dread d8/fb [0,4194304] 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:6/212: getdents d5/d15/d27 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:6/213: chown d5/d15 121 1 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:0/243: dread d8/de/f38 [0,4194304] 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:8/238: link d1/l1d d1/d15/d16/d33/l54 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:5/132: dwrite d3/f9 [0,4194304] 0 2024-09-10T09:36:17.442 INFO:tasks.workunit.client.1.smithi135.stdout:6/214: dwrite d5/d1e/d35/f21 [0,4194304] 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:6/215: fsync d5/d15/f25 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:0/244: truncate d8/dd/d18/f1a 1658133 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:1/199: getdents d1d/d20/d24/d37 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:1/200: chown d1d/d20/d24/d37 218604 1 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:1/201: fsync f1b 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:9/181: truncate de/df/f10 232367 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:9/182: fdatasync f6 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:5/133: creat d3/dc/f27 x:0 0 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:5/134: fsync d3/fb 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:6/216: mknod d5/d1e/d3b/d49/c4c 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:0/245: creat d8/dd/d11/f46 x:0 0 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:0/246: write d8/d1c/d2c/f30 [527015,49401] 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:8/239: getdents d1/d15 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:8/240: fsync d1/d15/d16/f1a 0 2024-09-10T09:36:17.443 INFO:tasks.workunit.client.1.smithi135.stdout:1/202: mkdir d1d/d20/d3c 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:5/135: symlink d3/dc/d17/l28 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:5/136: dread - d3/f18 zero size 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:8/241: mknod d1/d15/d16/d33/d45/c55 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:1/203: creat d1d/d20/d3c/f3d x:0 0 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:8/242: mknod d1/d15/d49/c56 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:9/183: dwrite de/df/d1d/d23/f2d [0,4194304] 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:9/184: stat de/f18 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:1/204: dread d1d/f1e [0,4194304] 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:9/185: rename de/df/f11 to de/df/d1d/d1e/f3c 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:1/205: symlink d1d/l3e 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:8/243: dread d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:1/206: rmdir d1d/d20/d3c 39 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:1/207: write d1d/f22 [5025591,4358] 0 2024-09-10T09:36:17.444 INFO:tasks.workunit.client.1.smithi135.stdout:8/244: write d1/d15/d49/f4e [3191180,9911] 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:8/245: rename d1/d15/d16/d33/l54 to d1/d15/d16/d33/d45/l57 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:8/246: chown d1 13947 1 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:6/217: dwrite d5/d15/f22 [0,4194304] 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:0/247: dwrite d8/dd/d11/f1f [0,4194304] 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:5/137: dwrite d3/dc/d16/f19 [0,4194304] 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:5/138: chown d3/f12 1 1 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:9/186: dwrite f9 [0,4194304] 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:9/187: stat de/df/d1d/d23/f26 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:8/247: unlink d1/d15/d16/d33/d45/l57 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:8/248: chown d1/d15/c42 491 1 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:9/188: link de/df/d1d/d23/d25/d28/f37 de/df/f3d 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:9/189: truncate de/df/f10 1240605 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:8/249: dread d1/f14 [0,4194304] 0 2024-09-10T09:36:17.445 INFO:tasks.workunit.client.1.smithi135.stdout:0/248: rmdir d8/dd/d11/d17 39 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/139: getdents d3/dc 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:1/208: dwrite d1d/f22 [0,4194304] 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:9/190: creat de/df/f3e x:0 0 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:9/191: truncate de/df/f1b 1136963 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:6/218: dwrite d5/d1e/d35/f30 [0,4194304] 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:0/249: rename d8/dd/l1b to d8/l47 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:0/250: write d8/dd/d1e/f23 [1111944,25894] 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/140: write d3/fa [1857099,77565] 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:6/219: rmdir d5 39 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:0/251: mknod d8/dd/c48 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/141: rename d3/l1a to d3/dc/d17/d22/l29 0 2024-09-10T09:36:17.446 INFO:tasks.workunit.client.1.smithi135.stdout:8/250: dwrite d1/d13/f1b [0,4194304] 0 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:8/251: stat d1/f23 0 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:6/220: mknod d5/d1e/c4d 0 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:0/252: rmdir d8/dd/d18/d3d 39 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:9/192: dwrite de/df/f3d [0,4194304] 0 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:9/193: dread - de/df/d1d/f34 zero size 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:1/209: dwrite f11 [0,4194304] 0 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:1/210: stat d1d/f27 0 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:1/211: write d1d/d20/d24/d2b/f36 [992272,11485] 0 2024-09-10T09:36:17.447 INFO:tasks.workunit.client.1.smithi135.stdout:5/142: unlink d3/dc/d17/d22/c25 0 2024-09-10T09:36:17.448 INFO:tasks.workunit.client.1.smithi135.stdout:0/253: dread d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:17.448 INFO:tasks.workunit.client.1.smithi135.stdout:5/143: read d3/f14 [17570,90240] 0 2024-09-10T09:36:17.448 INFO:tasks.workunit.client.1.smithi135.stdout:5/144: getdents d3/d26 0 2024-09-10T09:36:17.454 INFO:tasks.workunit.client.1.smithi135.stdout:0/254: unlink d8/de/f41 0 2024-09-10T09:36:17.456 INFO:tasks.workunit.client.1.smithi135.stdout:5/145: symlink d3/dc/l2a 0 2024-09-10T09:36:17.456 INFO:tasks.workunit.client.1.smithi135.stdout:5/146: truncate d3/f5 3651243 0 2024-09-10T09:36:17.458 INFO:tasks.workunit.client.1.smithi135.stdout:5/147: truncate d3/dc/f10 324869 0 2024-09-10T09:36:17.464 INFO:tasks.workunit.client.1.smithi135.stdout:5/148: mknod d3/c2b 0 2024-09-10T09:36:17.464 INFO:tasks.workunit.client.1.smithi135.stdout:5/149: chown d3/dc/f13 56612 1 2024-09-10T09:36:17.469 INFO:tasks.workunit.client.1.smithi135.stdout:6/221: dwrite d5/d1e/d3b/d42/f2e [0,4194304] 0 2024-09-10T09:36:17.470 INFO:tasks.workunit.client.1.smithi135.stdout:5/150: dread d3/f9 [0,4194304] 0 2024-09-10T09:36:17.470 INFO:tasks.workunit.client.1.smithi135.stdout:5/151: dread - d3/dc/f27 zero size 2024-09-10T09:36:17.471 INFO:tasks.workunit.client.1.smithi135.stdout:8/252: dwrite d1/d15/d16/f26 [0,4194304] 0 2024-09-10T09:36:17.472 INFO:tasks.workunit.client.1.smithi135.stdout:8/253: fsync d1/fd 0 2024-09-10T09:36:17.472 INFO:tasks.workunit.client.1.smithi135.stdout:8/254: truncate d1/d15/f4d 474327 0 2024-09-10T09:36:17.472 INFO:tasks.workunit.client.1.smithi135.stdout:8/255: chown d1/d13/f2f 49131 1 2024-09-10T09:36:17.472 INFO:tasks.workunit.client.1.smithi135.stdout:6/222: symlink d5/d1e/l4e 0 2024-09-10T09:36:17.472 INFO:tasks.workunit.client.1.smithi135.stdout:8/256: stat d1/d15/l3b 0 2024-09-10T09:36:17.472 INFO:tasks.workunit.client.1.smithi135.stdout:8/257: chown d1/d13/l4c 1688 1 2024-09-10T09:36:17.473 INFO:tasks.workunit.client.1.smithi135.stdout:8/258: chown d1/d15/d16/d33/c46 1 1 2024-09-10T09:36:17.473 INFO:tasks.workunit.client.1.smithi135.stdout:8/259: write d1/d15/d24/f35 [1577334,117321] 0 2024-09-10T09:36:17.473 INFO:tasks.workunit.client.1.smithi135.stdout:1/212: dwrite d1d/d20/f30 [0,4194304] 0 2024-09-10T09:36:17.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/223: symlink d5/d15/l4f 0 2024-09-10T09:36:17.477 INFO:tasks.workunit.client.1.smithi135.stdout:8/260: rename d1/d15/d16/l22 to d1/d13/l58 0 2024-09-10T09:36:17.483 INFO:tasks.workunit.client.1.smithi135.stdout:8/261: dread d1/d15/d16/f1a [0,4194304] 0 2024-09-10T09:36:17.483 INFO:tasks.workunit.client.1.smithi135.stdout:0/255: dwrite d8/dd/d11/d17/f42 [0,4194304] 0 2024-09-10T09:36:17.483 INFO:tasks.workunit.client.1.smithi135.stdout:0/256: creat d8/dd/d1e/f49 x:0 0 0 2024-09-10T09:36:17.487 INFO:tasks.workunit.client.1.smithi135.stdout:1/213: rename f3 to d1d/f3f 0 2024-09-10T09:36:17.488 INFO:tasks.workunit.client.1.smithi135.stdout:6/224: write d5/d15/d27/f3f [310284,122855] 0 2024-09-10T09:36:17.492 INFO:tasks.workunit.client.1.smithi135.stdout:0/257: mkdir d8/dd/d4a 0 2024-09-10T09:36:17.493 INFO:tasks.workunit.client.1.smithi135.stdout:3/129: sync 2024-09-10T09:36:17.493 INFO:tasks.workunit.client.1.smithi135.stdout:3/130: fdatasync d4/f25 0 2024-09-10T09:36:17.493 INFO:tasks.workunit.client.1.smithi135.stdout:3/131: fdatasync f1 0 2024-09-10T09:36:17.495 INFO:tasks.workunit.client.1.smithi135.stdout:1/214: truncate d1d/f2c 438209 0 2024-09-10T09:36:17.495 INFO:tasks.workunit.client.1.smithi135.stdout:7/224: sync 2024-09-10T09:36:17.496 INFO:tasks.workunit.client.1.smithi135.stdout:7/225: truncate d2/d15/f1c 9110229 0 2024-09-10T09:36:17.496 INFO:tasks.workunit.client.1.smithi135.stdout:4/322: sync 2024-09-10T09:36:17.496 INFO:tasks.workunit.client.1.smithi135.stdout:4/323: truncate d1/db/d9/f38 5122381 0 2024-09-10T09:36:17.496 INFO:tasks.workunit.client.1.smithi135.stdout:9/194: dwrite de/df/d1d/d23/d25/d28/f37 [4194304,4194304] 0 2024-09-10T09:36:17.498 INFO:tasks.workunit.client.1.smithi135.stdout:5/152: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:17.499 INFO:tasks.workunit.client.1.smithi135.stdout:6/225: mkdir d5/dd/d50 0 2024-09-10T09:36:17.502 INFO:tasks.workunit.client.1.smithi135.stdout:7/226: creat d2/d15/d4a/f4d x:0 0 0 2024-09-10T09:36:17.505 INFO:tasks.workunit.client.1.smithi135.stdout:9/195: getdents de/df/d1d/d23/d25 0 2024-09-10T09:36:17.505 INFO:tasks.workunit.client.1.smithi135.stdout:9/196: fdatasync de/df/f13 0 2024-09-10T09:36:17.510 INFO:tasks.workunit.client.1.smithi135.stdout:5/153: link d3/dc/f23 d3/dc/d16/f2c 0 2024-09-10T09:36:17.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/164: sync 2024-09-10T09:36:17.511 INFO:tasks.workunit.client.1.smithi135.stdout:4/324: dwrite d1/d33/f3d [0,4194304] 0 2024-09-10T09:36:17.511 INFO:tasks.workunit.client.1.smithi135.stdout:4/325: chown d1/d33/l35 1991 1 2024-09-10T09:36:17.512 INFO:tasks.workunit.client.1.smithi135.stdout:6/226: creat d5/d1e/d3b/d42/d2d/f51 x:0 0 0 2024-09-10T09:36:17.512 INFO:tasks.workunit.client.1.smithi135.stdout:6/227: fdatasync d5/d15/f22 0 2024-09-10T09:36:17.512 INFO:tasks.workunit.client.1.smithi135.stdout:6/228: stat d5/c43 0 2024-09-10T09:36:17.512 INFO:tasks.workunit.client.1.smithi135.stdout:6/229: fdatasync d5/d1e/d3b/d42/d2d/f31 0 2024-09-10T09:36:17.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/197: mkdir de/df/d1d/d1e/d3f 0 2024-09-10T09:36:17.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/198: chown de/df/d1d/d23/d25/c35 3674567 1 2024-09-10T09:36:17.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/199: creat de/df/f40 x:0 0 0 2024-09-10T09:36:17.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/200: chown de/df/d1d/d23/d25/c35 2136817 1 2024-09-10T09:36:17.520 INFO:tasks.workunit.client.1.smithi135.stdout:5/154: mkdir d3/dc/d17/d22/d2d 0 2024-09-10T09:36:17.521 INFO:tasks.workunit.client.1.smithi135.stdout:6/230: write d5/d1e/d3b/d42/f38 [1227544,126135] 0 2024-09-10T09:36:17.523 INFO:tasks.workunit.client.1.smithi135.stdout:2/165: link df/d13/c18 df/d1b/d30/c34 0 2024-09-10T09:36:17.528 INFO:tasks.workunit.client.1.smithi135.stdout:4/326: rmdir d1/db 39 2024-09-10T09:36:17.528 INFO:tasks.workunit.client.1.smithi135.stdout:4/327: creat d1/f63 x:0 0 0 2024-09-10T09:36:17.530 INFO:tasks.workunit.client.1.smithi135.stdout:7/227: rmdir d2/d15/d4a 39 2024-09-10T09:36:17.533 INFO:tasks.workunit.client.1.smithi135.stdout:9/201: dwrite de/df/f40 [0,4194304] 0 2024-09-10T09:36:17.534 INFO:tasks.workunit.client.1.smithi135.stdout:5/155: symlink d3/dc/d16/l2e 0 2024-09-10T09:36:17.534 INFO:tasks.workunit.client.1.smithi135.stdout:5/156: write d3/dc/f10 [1050129,94786] 0 2024-09-10T09:36:17.535 INFO:tasks.workunit.client.1.smithi135.stdout:6/231: creat d5/d15/d27/f52 x:0 0 0 2024-09-10T09:36:17.537 INFO:tasks.workunit.client.1.smithi135.stdout:5/157: fdatasync d3/dc/f10 0 2024-09-10T09:36:17.538 INFO:tasks.workunit.client.1.smithi135.stdout:5/158: dread d3/ff [0,4194304] 0 2024-09-10T09:36:17.545 INFO:tasks.workunit.client.1.smithi135.stdout:2/166: symlink df/d1b/d31/l35 0 2024-09-10T09:36:17.545 INFO:tasks.workunit.client.1.smithi135.stdout:9/202: dread de/df/d1d/d1e/f3c [0,4194304] 0 2024-09-10T09:36:17.546 INFO:tasks.workunit.client.1.smithi135.stdout:9/203: creat de/df/d1d/f41 x:0 0 0 2024-09-10T09:36:17.547 INFO:tasks.workunit.client.1.smithi135.stdout:2/167: dread df/d15/f24 [0,4194304] 0 2024-09-10T09:36:17.549 INFO:tasks.workunit.client.1.smithi135.stdout:9/204: dread de/df/f10 [0,4194304] 0 2024-09-10T09:36:17.554 INFO:tasks.workunit.client.1.smithi135.stdout:4/328: unlink d1/db/d23/d37/c48 0 2024-09-10T09:36:17.554 INFO:tasks.workunit.client.1.smithi135.stdout:4/329: read d1/de/f13 [2099954,23898] 0 2024-09-10T09:36:17.554 INFO:tasks.workunit.client.1.smithi135.stdout:4/330: creat d1/db/d9/f64 x:0 0 0 2024-09-10T09:36:17.555 INFO:tasks.workunit.client.1.smithi135.stdout:9/205: dread de/df/d1d/d23/d25/f32 [0,4194304] 0 2024-09-10T09:36:17.555 INFO:tasks.workunit.client.1.smithi135.stdout:9/206: getdents de/df/d1d/d23/d25 0 2024-09-10T09:36:17.556 INFO:tasks.workunit.client.1.smithi135.stdout:7/228: mkdir d2/d15/d41/d49/d4e 0 2024-09-10T09:36:17.556 INFO:tasks.workunit.client.1.smithi135.stdout:7/229: chown d2/d11/d16/l33 14 1 2024-09-10T09:36:17.567 INFO:tasks.workunit.client.1.smithi135.stdout:5/159: dwrite d3/fd [0,4194304] 0 2024-09-10T09:36:17.567 INFO:tasks.workunit.client.1.smithi135.stdout:5/160: dread - d3/dc/d16/f2c zero size 2024-09-10T09:36:17.567 INFO:tasks.workunit.client.1.smithi135.stdout:5/161: fsync d3/fb 0 2024-09-10T09:36:17.567 INFO:tasks.workunit.client.1.smithi135.stdout:5/162: fdatasync d3/fb 0 2024-09-10T09:36:17.567 INFO:tasks.workunit.client.1.smithi135.stdout:9/207: dread de/df/d1d/d23/f2d [0,4194304] 0 2024-09-10T09:36:17.570 INFO:tasks.workunit.client.1.smithi135.stdout:6/232: dwrite f3 [0,4194304] 0 2024-09-10T09:36:17.570 INFO:tasks.workunit.client.1.smithi135.stdout:6/233: truncate d5/d1e/d3b/d42/d2d/f51 960015 0 2024-09-10T09:36:17.570 INFO:tasks.workunit.client.1.smithi135.stdout:6/234: write d5/d1e/d3b/d42/d2d/f51 [1528422,81119] 0 2024-09-10T09:36:17.572 INFO:tasks.workunit.client.1.smithi135.stdout:7/230: dread d2/d15/f21 [0,4194304] 0 2024-09-10T09:36:17.573 INFO:tasks.workunit.client.1.smithi135.stdout:7/231: creat d2/d11/d30/d46/f4f x:0 0 0 2024-09-10T09:36:17.573 INFO:tasks.workunit.client.1.smithi135.stdout:7/232: read d2/d15/f3d [3311779,128519] 0 2024-09-10T09:36:17.577 INFO:tasks.workunit.client.1.smithi135.stdout:2/168: mkdir df/d1b/d23/d36 0 2024-09-10T09:36:17.577 INFO:tasks.workunit.client.1.smithi135.stdout:6/235: dread d5/d15/f1c [0,4194304] 0 2024-09-10T09:36:17.578 INFO:tasks.workunit.client.1.smithi135.stdout:4/331: dwrite d1/de/f3c [0,4194304] 0 2024-09-10T09:36:17.581 INFO:tasks.workunit.client.1.smithi135.stdout:5/163: link d3/fd d3/dc/d17/d22/f2f 0 2024-09-10T09:36:17.582 INFO:tasks.workunit.client.1.smithi135.stdout:5/164: chown d3/dc/l1f 174182104 1 2024-09-10T09:36:17.586 INFO:tasks.workunit.client.1.smithi135.stdout:2/169: getdents df/d1b/d27 0 2024-09-10T09:36:17.586 INFO:tasks.workunit.client.1.smithi135.stdout:2/170: chown cc 0 1 2024-09-10T09:36:17.589 INFO:tasks.workunit.client.1.smithi135.stdout:4/332: rename d1/c4c to d1/d4a/c65 0 2024-09-10T09:36:17.591 INFO:tasks.workunit.client.1.smithi135.stdout:5/165: rmdir d3/dc/d17/d22/d2d 0 2024-09-10T09:36:17.592 INFO:tasks.workunit.client.1.smithi135.stdout:7/233: symlink d2/d25/l50 0 2024-09-10T09:36:17.596 INFO:tasks.workunit.client.1.smithi135.stdout:7/234: mknod d2/d11/c51 0 2024-09-10T09:36:17.597 INFO:tasks.workunit.client.1.smithi135.stdout:9/208: dwrite de/df/d1d/f3a [0,4194304] 0 2024-09-10T09:36:17.598 INFO:tasks.workunit.client.1.smithi135.stdout:2/171: dread f8 [0,4194304] 0 2024-09-10T09:36:17.599 INFO:tasks.workunit.client.1.smithi135.stdout:7/235: rmdir d2/d15/d41/d49/d4e 0 2024-09-10T09:36:17.602 INFO:tasks.workunit.client.1.smithi135.stdout:5/166: dread d3/f5 [0,4194304] 0 2024-09-10T09:36:17.609 INFO:tasks.workunit.client.1.smithi135.stdout:9/209: rename de/df/d1d/d1e/f3c to de/df/d1d/d23/f42 0 2024-09-10T09:36:17.609 INFO:tasks.workunit.client.1.smithi135.stdout:9/210: creat de/df/d1d/f43 x:0 0 0 2024-09-10T09:36:17.614 INFO:tasks.workunit.client.1.smithi135.stdout:5/167: creat d3/dc/d17/f30 x:0 0 0 2024-09-10T09:36:17.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/236: truncate d5/d1e/f28 3852190 0 2024-09-10T09:36:17.618 INFO:tasks.workunit.client.1.smithi135.stdout:2/172: dwrite f8 [0,4194304] 0 2024-09-10T09:36:17.619 INFO:tasks.workunit.client.1.smithi135.stdout:9/211: symlink de/df/d1d/d1e/d3f/l44 0 2024-09-10T09:36:17.619 INFO:tasks.workunit.client.1.smithi135.stdout:2/173: read df/d15/f24 [140513,105344] 0 2024-09-10T09:36:17.619 INFO:tasks.workunit.client.1.smithi135.stdout:2/174: stat df/d15/c32 0 2024-09-10T09:36:17.622 INFO:tasks.workunit.client.1.smithi135.stdout:5/168: write d3/f14 [1665137,38421] 0 2024-09-10T09:36:17.622 INFO:tasks.workunit.client.1.smithi135.stdout:5/169: dread - d3/dc/d17/f30 zero size 2024-09-10T09:36:17.625 INFO:tasks.workunit.client.1.smithi135.stdout:7/236: rmdir d2/d11/d30 39 2024-09-10T09:36:17.626 INFO:tasks.workunit.client.1.smithi135.stdout:6/237: dread d5/d1e/d35/f30 [0,4194304] 0 2024-09-10T09:36:17.626 INFO:tasks.workunit.client.1.smithi135.stdout:6/238: chown d5/d1e/d3b/d49/c4c 6529 1 2024-09-10T09:36:17.626 INFO:tasks.workunit.client.1.smithi135.stdout:6/239: truncate d5/f7 4269412 0 2024-09-10T09:36:17.626 INFO:tasks.workunit.client.1.smithi135.stdout:6/240: write d5/d15/f1c [484841,118380] 0 2024-09-10T09:36:17.629 INFO:tasks.workunit.client.1.smithi135.stdout:2/175: creat df/d1b/d30/f37 x:0 0 0 2024-09-10T09:36:17.631 INFO:tasks.workunit.client.1.smithi135.stdout:7/237: mkdir d2/d15/d41/d49/d52 0 2024-09-10T09:36:17.632 INFO:tasks.workunit.client.1.smithi135.stdout:6/241: mknod d5/dd/d50/c53 0 2024-09-10T09:36:17.636 INFO:tasks.workunit.client.1.smithi135.stdout:9/212: rename c2 to de/c45 0 2024-09-10T09:36:17.639 INFO:tasks.workunit.client.1.smithi135.stdout:2/176: rmdir df/d13/d2b 0 2024-09-10T09:36:17.639 INFO:tasks.workunit.client.1.smithi135.stdout:2/177: fdatasync df/d1b/d30/f37 0 2024-09-10T09:36:17.639 INFO:tasks.workunit.client.1.smithi135.stdout:2/178: write df/d1b/d27/d2c/f2e [948324,111766] 0 2024-09-10T09:36:17.639 INFO:tasks.workunit.client.1.smithi135.stdout:2/179: write df/d1b/f1c [5204664,129350] 0 2024-09-10T09:36:17.640 INFO:tasks.workunit.client.1.smithi135.stdout:7/238: unlink d2/d15/d4a/f4d 0 2024-09-10T09:36:17.643 INFO:tasks.workunit.client.1.smithi135.stdout:9/213: mkdir de/df/d46 0 2024-09-10T09:36:17.647 INFO:tasks.workunit.client.1.smithi135.stdout:9/214: symlink de/df/d1d/d23/d25/l47 0 2024-09-10T09:36:17.647 INFO:tasks.workunit.client.1.smithi135.stdout:7/239: dread d2/d15/d4a/f12 [0,4194304] 0 2024-09-10T09:36:17.648 INFO:tasks.workunit.client.1.smithi135.stdout:6/242: dwrite d5/d1e/d3b/f41 [0,4194304] 0 2024-09-10T09:36:17.649 INFO:tasks.workunit.client.1.smithi135.stdout:2/180: write f6 [1886730,121069] 0 2024-09-10T09:36:17.650 INFO:tasks.workunit.client.1.smithi135.stdout:9/215: dread de/f18 [0,4194304] 0 2024-09-10T09:36:17.651 INFO:tasks.workunit.client.1.smithi135.stdout:2/181: fsync df/d1b/d27/d2c/f2e 0 2024-09-10T09:36:17.652 INFO:tasks.workunit.client.1.smithi135.stdout:9/216: write de/df/f10 [200059,46743] 0 2024-09-10T09:36:17.654 INFO:tasks.workunit.client.1.smithi135.stdout:6/243: mkdir d5/dd/d50/d54 0 2024-09-10T09:36:17.657 INFO:tasks.workunit.client.1.smithi135.stdout:2/182: creat df/d13/f38 x:0 0 0 2024-09-10T09:36:17.662 INFO:tasks.workunit.client.1.smithi135.stdout:9/217: creat de/df/d1d/d23/d25/f48 x:0 0 0 2024-09-10T09:36:17.662 INFO:tasks.workunit.client.1.smithi135.stdout:9/218: stat de/df/l14 0 2024-09-10T09:36:17.662 INFO:tasks.workunit.client.1.smithi135.stdout:6/244: mkdir d5/d1e/d3b/d42/d2d/d55 0 2024-09-10T09:36:17.664 INFO:tasks.workunit.client.1.smithi135.stdout:2/183: link df/d15/f24 df/d1b/d23/d36/f39 0 2024-09-10T09:36:17.664 INFO:tasks.workunit.client.1.smithi135.stdout:2/184: fsync f8 0 2024-09-10T09:36:17.664 INFO:tasks.workunit.client.1.smithi135.stdout:9/219: creat de/df/d1d/d23/d25/d28/f49 x:0 0 0 2024-09-10T09:36:17.666 INFO:tasks.workunit.client.1.smithi135.stdout:6/245: mkdir d5/d15/d56 0 2024-09-10T09:36:17.672 INFO:tasks.workunit.client.1.smithi135.stdout:2/185: creat df/d1b/d23/d36/f3a x:0 0 0 2024-09-10T09:36:17.673 INFO:tasks.workunit.client.1.smithi135.stdout:6/246: mkdir d5/dd/d50/d57 0 2024-09-10T09:36:17.674 INFO:tasks.workunit.client.1.smithi135.stdout:2/186: creat df/f3b x:0 0 0 2024-09-10T09:36:17.674 INFO:tasks.workunit.client.1.smithi135.stdout:2/187: chown df/d1b/d23/d36 1 1 2024-09-10T09:36:17.675 INFO:tasks.workunit.client.1.smithi135.stdout:6/247: mkdir d5/d58 0 2024-09-10T09:36:17.676 INFO:tasks.workunit.client.1.smithi135.stdout:2/188: creat df/d1b/f3c x:0 0 0 2024-09-10T09:36:17.677 INFO:tasks.workunit.client.1.smithi135.stdout:6/248: creat d5/d1e/d3b/d42/d3c/f59 x:0 0 0 2024-09-10T09:36:17.677 INFO:tasks.workunit.client.1.smithi135.stdout:6/249: fsync d5/d1e/d3b/d42/d2d/f31 0 2024-09-10T09:36:17.679 INFO:tasks.workunit.client.1.smithi135.stdout:2/189: mkdir df/d1b/d27/d3d 0 2024-09-10T09:36:17.679 INFO:tasks.workunit.client.1.smithi135.stdout:2/190: chown c9 6105054 1 2024-09-10T09:36:17.679 INFO:tasks.workunit.client.1.smithi135.stdout:2/191: creat df/d1b/f3e x:0 0 0 2024-09-10T09:36:17.680 INFO:tasks.workunit.client.1.smithi135.stdout:2/192: readlink df/d1b/l21 0 2024-09-10T09:36:17.680 INFO:tasks.workunit.client.1.smithi135.stdout:6/250: getdents d5/d1e/d3b 0 2024-09-10T09:36:17.681 INFO:tasks.workunit.client.1.smithi135.stdout:6/251: mknod d5/dd/d50/d54/c5a 0 2024-09-10T09:36:17.682 INFO:tasks.workunit.client.1.smithi135.stdout:6/252: fdatasync d5/d1e/d35/f21 0 2024-09-10T09:36:17.682 INFO:tasks.workunit.client.1.smithi135.stdout:6/253: chown d5/d1e/d3b/d42/f38 499806 1 2024-09-10T09:36:17.686 INFO:tasks.workunit.client.1.smithi135.stdout:9/220: dwrite de/df/f10 [0,4194304] 0 2024-09-10T09:36:17.688 INFO:tasks.workunit.client.1.smithi135.stdout:6/254: dread d5/d1e/d3b/d42/f38 [0,4194304] 0 2024-09-10T09:36:17.692 INFO:tasks.workunit.client.1.smithi135.stdout:9/221: unlink de/df/d1d/d23/d25/f32 0 2024-09-10T09:36:17.692 INFO:tasks.workunit.client.1.smithi135.stdout:9/222: dread - de/df/d1d/f41 zero size 2024-09-10T09:36:17.693 INFO:tasks.workunit.client.1.smithi135.stdout:9/223: dread - de/df/d1d/d23/d25/d28/f49 zero size 2024-09-10T09:36:17.693 INFO:tasks.workunit.client.1.smithi135.stdout:6/255: rmdir d5/d1e/d3b/d42 39 2024-09-10T09:36:17.695 INFO:tasks.workunit.client.1.smithi135.stdout:6/256: write d5/d15/f22 [4536938,94388] 0 2024-09-10T09:36:17.696 INFO:tasks.workunit.client.1.smithi135.stdout:6/257: truncate d5/d1e/d3b/f41 39222 0 2024-09-10T09:36:17.696 INFO:tasks.workunit.client.1.smithi135.stdout:6/258: chown d5/dd/d50/d54 2773924 1 2024-09-10T09:36:17.697 INFO:tasks.workunit.client.1.smithi135.stdout:2/193: dwrite df/d15/f24 [0,4194304] 0 2024-09-10T09:36:17.698 INFO:tasks.workunit.client.1.smithi135.stdout:6/259: mkdir d5/d1e/d3b/d42/d2d/d55/d5b 0 2024-09-10T09:36:17.698 INFO:tasks.workunit.client.1.smithi135.stdout:6/260: fdatasync d5/d1e/d35/f21 0 2024-09-10T09:36:17.698 INFO:tasks.workunit.client.1.smithi135.stdout:6/261: write d5/d1e/f28 [2248283,13764] 0 2024-09-10T09:36:17.702 INFO:tasks.workunit.client.1.smithi135.stdout:6/262: truncate d5/d1e/d3b/d42/d2d/f51 4716 0 2024-09-10T09:36:17.702 INFO:tasks.workunit.client.1.smithi135.stdout:6/263: creat d5/d15/d27/f5c x:0 0 0 2024-09-10T09:36:17.702 INFO:tasks.workunit.client.1.smithi135.stdout:6/264: dread - d5/d1e/f2f zero size 2024-09-10T09:36:17.702 INFO:tasks.workunit.client.1.smithi135.stdout:6/265: write d5/d1e/d3b/d42/d2d/f31 [610355,813] 0 2024-09-10T09:36:17.716 INFO:tasks.workunit.client.1.smithi135.stdout:2/194: dwrite df/d1b/f1c [0,4194304] 0 2024-09-10T09:36:17.716 INFO:tasks.workunit.client.1.smithi135.stdout:2/195: write df/d13/f38 [226123,63430] 0 2024-09-10T09:36:17.721 INFO:tasks.workunit.client.1.smithi135.stdout:2/196: rename df/d1b/d30/c34 to df/d1b/d27/d3d/c3f 0 2024-09-10T09:36:17.721 INFO:tasks.workunit.client.1.smithi135.stdout:2/197: readlink df/d15/l1f 0 2024-09-10T09:36:17.726 INFO:tasks.workunit.client.1.smithi135.stdout:2/198: mkdir df/d1b/d31/d40 0 2024-09-10T09:36:17.734 INFO:tasks.workunit.client.1.smithi135.stdout:2/199: dread df/d15/f24 [0,4194304] 0 2024-09-10T09:36:17.734 INFO:tasks.workunit.client.1.smithi135.stdout:2/200: chown c9 123358363 1 2024-09-10T09:36:17.750 INFO:tasks.workunit.client.1.smithi135.stdout:2/201: dwrite df/d1b/d23/f28 [0,4194304] 0 2024-09-10T09:36:17.750 INFO:tasks.workunit.client.1.smithi135.stdout:2/202: chown df/d15/c32 3 1 2024-09-10T09:36:17.750 INFO:tasks.workunit.client.1.smithi135.stdout:2/203: truncate df/d13/f38 646822 0 2024-09-10T09:36:17.771 INFO:tasks.workunit.client.1.smithi135.stdout:2/204: dwrite df/d1b/f26 [0,4194304] 0 2024-09-10T09:36:17.785 INFO:tasks.workunit.client.1.smithi135.stdout:2/205: mknod df/d1b/d27/c41 0 2024-09-10T09:36:17.785 INFO:tasks.workunit.client.1.smithi135.stdout:2/206: write df/d1b/d30/f37 [512337,112845] 0 2024-09-10T09:36:17.789 INFO:tasks.workunit.client.1.smithi135.stdout:2/207: dread df/d1b/d27/d2c/f2e [0,4194304] 0 2024-09-10T09:36:17.790 INFO:tasks.workunit.client.1.smithi135.stdout:2/208: dread df/f10 [0,4194304] 0 2024-09-10T09:36:17.792 INFO:tasks.workunit.client.1.smithi135.stdout:2/209: mkdir df/d1b/d23/d42 0 2024-09-10T09:36:17.795 INFO:tasks.workunit.client.1.smithi135.stdout:2/210: rename c9 to df/d15/c43 0 2024-09-10T09:36:17.802 INFO:tasks.workunit.client.1.smithi135.stdout:2/211: dread df/f16 [0,4194304] 0 2024-09-10T09:36:17.803 INFO:tasks.workunit.client.1.smithi135.stdout:2/212: write df/d1b/d23/d36/f3a [171735,49862] 0 2024-09-10T09:36:17.812 INFO:tasks.workunit.client.1.smithi135.stdout:2/213: dread df/f17 [0,4194304] 0 2024-09-10T09:36:17.812 INFO:tasks.workunit.client.1.smithi135.stdout:2/214: chown df/d15/c43 164 1 2024-09-10T09:36:17.813 INFO:tasks.workunit.client.1.smithi135.stdout:2/215: write df/d1b/f1c [6320731,63517] 0 2024-09-10T09:36:17.818 INFO:tasks.workunit.client.1.smithi135.stdout:2/216: unlink df/d13/l19 0 2024-09-10T09:36:17.858 INFO:tasks.workunit.client.1.smithi135.stdout:2/217: rmdir df/d1b/d27/d2c 39 2024-09-10T09:36:17.863 INFO:tasks.workunit.client.1.smithi135.stdout:2/218: getdents df/d1b/d23/d36 0 2024-09-10T09:36:17.904 INFO:tasks.workunit.client.1.smithi135.stdout:2/219: dwrite df/d1b/f1c [0,4194304] 0 2024-09-10T09:36:17.904 INFO:tasks.workunit.client.1.smithi135.stdout:2/220: write df/f3b [365058,99693] 0 2024-09-10T09:36:17.905 INFO:tasks.workunit.client.1.smithi135.stdout:2/221: creat df/d13/f44 x:0 0 0 2024-09-10T09:36:17.905 INFO:tasks.workunit.client.1.smithi135.stdout:2/222: stat df/d1b/d27/c41 0 2024-09-10T09:36:17.909 INFO:tasks.workunit.client.1.smithi135.stdout:2/223: mkdir df/d1b/d27/d45 0 2024-09-10T09:36:17.912 INFO:tasks.workunit.client.1.smithi135.stdout:2/224: unlink df/d15/f1a 0 2024-09-10T09:36:17.912 INFO:tasks.workunit.client.1.smithi135.stdout:2/225: readlink la 0 2024-09-10T09:36:17.913 INFO:tasks.workunit.client.1.smithi135.stdout:2/226: dread df/d13/f1d [0,4194304] 0 2024-09-10T09:36:17.919 INFO:tasks.workunit.client.1.smithi135.stdout:2/227: dread f6 [0,4194304] 0 2024-09-10T09:36:17.921 INFO:tasks.workunit.client.1.smithi135.stdout:2/228: fdatasync df/d1b/d30/f37 0 2024-09-10T09:36:17.923 INFO:tasks.workunit.client.1.smithi135.stdout:2/229: unlink df/d15/c43 0 2024-09-10T09:36:17.924 INFO:tasks.workunit.client.1.smithi135.stdout:2/230: chown df/d13 28955 1 2024-09-10T09:36:17.924 INFO:tasks.workunit.client.1.smithi135.stdout:2/231: write f6 [1535497,126447] 0 2024-09-10T09:36:17.926 INFO:tasks.workunit.client.1.smithi135.stdout:2/232: creat df/d1b/d23/d42/f46 x:0 0 0 2024-09-10T09:36:17.934 INFO:tasks.workunit.client.1.smithi135.stdout:2/233: write df/f12 [727964,24676] 0 2024-09-10T09:36:17.936 INFO:tasks.workunit.client.1.smithi135.stdout:2/234: rename df/d15/l2f to df/d13/l47 0 2024-09-10T09:36:17.955 INFO:tasks.workunit.client.1.smithi135.stdout:2/235: dwrite df/d1b/f26 [0,4194304] 0 2024-09-10T09:36:17.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:17 smithi135 ceph-mon[33411]: pgmap v263: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 240 MiB/s rd, 281 MiB/s wr, 399 op/s 2024-09-10T09:36:18.108 INFO:tasks.workunit.client.1.smithi135.stdout:8/262: sync 2024-09-10T09:36:18.108 INFO:tasks.workunit.client.1.smithi135.stdout:8/263: fsync d1/f25 0 2024-09-10T09:36:18.108 INFO:tasks.workunit.client.1.smithi135.stdout:8/264: fsync d1/d27/d3d/f48 0 2024-09-10T09:36:18.111 INFO:tasks.workunit.client.1.smithi135.stdout:8/265: dread d1/f14 [0,4194304] 0 2024-09-10T09:36:18.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/266: symlink d1/d27/d3d/l59 0 2024-09-10T09:36:18.116 INFO:tasks.workunit.client.1.smithi135.stdout:8/267: link d1/c51 d1/d27/d3d/d47/c5a 0 2024-09-10T09:36:18.119 INFO:tasks.workunit.client.1.smithi135.stdout:8/268: mknod d1/d27/d3d/d47/c5b 0 2024-09-10T09:36:18.122 INFO:tasks.workunit.client.1.smithi135.stdout:8/269: rename d1/d15/d16/d33/d39/f43 to d1/d13/f5c 0 2024-09-10T09:36:18.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:17 smithi079 ceph-mon[27592]: pgmap v263: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 240 MiB/s rd, 281 MiB/s wr, 399 op/s 2024-09-10T09:36:18.271 INFO:tasks.workunit.client.1.smithi135.stdout:3/132: sync 2024-09-10T09:36:18.271 INFO:tasks.workunit.client.1.smithi135.stdout:0/258: sync 2024-09-10T09:36:18.272 INFO:tasks.workunit.client.1.smithi135.stdout:3/133: rename d4/f26 to d4/d5/db/d1b/d1f/f2a 0 2024-09-10T09:36:18.283 INFO:tasks.workunit.client.1.smithi135.stdout:0/259: dread d8/dd/d1e/f21 [0,4194304] 0 2024-09-10T09:36:18.283 INFO:tasks.workunit.client.1.smithi135.stdout:0/260: write d8/fb [571312,53327] 0 2024-09-10T09:36:18.288 INFO:tasks.workunit.client.1.smithi135.stdout:0/261: mkdir d8/d1c/d2c/d4b 0 2024-09-10T09:36:18.288 INFO:tasks.workunit.client.1.smithi135.stdout:0/262: fdatasync d8/dd/f35 0 2024-09-10T09:36:18.288 INFO:tasks.workunit.client.1.smithi135.stdout:0/263: write d8/d1c/f3e [195410,92796] 0 2024-09-10T09:36:18.288 INFO:tasks.workunit.client.1.smithi135.stdout:0/264: creat d8/dd/f4c x:0 0 0 2024-09-10T09:36:18.289 INFO:tasks.workunit.client.1.smithi135.stdout:3/134: dwrite d4/d5/db/d1b/d1f/f2a [0,4194304] 0 2024-09-10T09:36:18.292 INFO:tasks.workunit.client.1.smithi135.stdout:0/265: dread d8/d1c/f3e [0,4194304] 0 2024-09-10T09:36:18.302 INFO:tasks.workunit.client.1.smithi135.stdout:3/135: rename d4/d5/l1c to d4/d5/db/l2b 0 2024-09-10T09:36:18.302 INFO:tasks.workunit.client.1.smithi135.stdout:3/136: read d4/d5/dc/f19 [1489391,53103] 0 2024-09-10T09:36:18.304 INFO:tasks.workunit.client.1.smithi135.stdout:0/266: rename d8/dd/d1e/f21 to d8/de/f4d 0 2024-09-10T09:36:18.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/267: link d8/dd/f13 d8/d1c/d37/f4e 0 2024-09-10T09:36:18.309 INFO:tasks.workunit.client.1.smithi135.stdout:3/137: mknod d4/d5/db/c2c 0 2024-09-10T09:36:18.312 INFO:tasks.workunit.client.1.smithi135.stdout:0/268: write d8/dd/f10 [2466675,20493] 0 2024-09-10T09:36:18.314 INFO:tasks.workunit.client.1.smithi135.stdout:3/138: dread d4/f9 [0,4194304] 0 2024-09-10T09:36:18.314 INFO:tasks.workunit.client.1.smithi135.stdout:3/139: fdatasync d4/d5/dc/f17 0 2024-09-10T09:36:18.314 INFO:tasks.workunit.client.1.smithi135.stdout:3/140: chown d4/d5/db/c23 353 1 2024-09-10T09:36:18.315 INFO:tasks.workunit.client.1.smithi135.stdout:0/269: link d8/c9 d8/de/d2e/c4f 0 2024-09-10T09:36:18.317 INFO:tasks.workunit.client.1.smithi135.stdout:3/141: symlink d4/d5/db/dd/l2d 0 2024-09-10T09:36:18.320 INFO:tasks.workunit.client.1.smithi135.stdout:0/270: mkdir d8/dd/d4a/d50 0 2024-09-10T09:36:18.324 INFO:tasks.workunit.client.1.smithi135.stdout:3/142: rename d4/d5/db/c20 to d4/d5/c2e 0 2024-09-10T09:36:18.324 INFO:tasks.workunit.client.1.smithi135.stdout:3/143: fsync d4/d5/db/d1b/d1f/f2a 0 2024-09-10T09:36:18.327 INFO:tasks.workunit.client.1.smithi135.stdout:0/271: rename d8/dd/l2f to d8/dd/d4a/l51 0 2024-09-10T09:36:18.329 INFO:tasks.workunit.client.1.smithi135.stdout:0/272: mknod d8/dd/d11/c52 0 2024-09-10T09:36:18.331 INFO:tasks.workunit.client.1.smithi135.stdout:3/144: dread d4/d5/dc/f19 [0,4194304] 0 2024-09-10T09:36:18.332 INFO:tasks.workunit.client.1.smithi135.stdout:0/273: mknod d8/d1c/d37/c53 0 2024-09-10T09:36:18.333 INFO:tasks.workunit.client.1.smithi135.stdout:0/274: truncate d8/dd/d11/f2b 2439889 0 2024-09-10T09:36:18.342 INFO:tasks.workunit.client.1.smithi135.stdout:3/145: write d4/d5/db/d1b/d1f/f2a [727091,122495] 0 2024-09-10T09:36:18.344 INFO:tasks.workunit.client.1.smithi135.stdout:3/146: creat d4/d5/db/f2f x:0 0 0 2024-09-10T09:36:18.344 INFO:tasks.workunit.client.1.smithi135.stdout:3/147: chown d4/d5/dc/f17 99742 1 2024-09-10T09:36:18.347 INFO:tasks.workunit.client.1.smithi135.stdout:3/148: truncate d4/d5/dc/f10 1361960 0 2024-09-10T09:36:18.352 INFO:tasks.workunit.client.1.smithi135.stdout:0/275: dwrite d8/dd/d11/f46 [0,4194304] 0 2024-09-10T09:36:18.356 INFO:tasks.workunit.client.1.smithi135.stdout:0/276: truncate d8/d1c/d2c/f36 623279 0 2024-09-10T09:36:18.357 INFO:tasks.workunit.client.1.smithi135.stdout:0/277: chown d8/dd/d11/l32 114 1 2024-09-10T09:36:18.359 INFO:tasks.workunit.client.1.smithi135.stdout:0/278: mkdir d8/dd/d4a/d50/d54 0 2024-09-10T09:36:18.365 INFO:tasks.workunit.client.1.smithi135.stdout:0/279: link d8/de/d2e/c44 d8/dd/d11/c55 0 2024-09-10T09:36:18.367 INFO:tasks.workunit.client.1.smithi135.stdout:0/280: write d8/dd/d18/f1a [64999,46444] 0 2024-09-10T09:36:18.367 INFO:tasks.workunit.client.1.smithi135.stdout:0/281: chown d8/dd/d4a/d50 2 1 2024-09-10T09:36:18.372 INFO:tasks.workunit.client.1.smithi135.stdout:3/149: dwrite d4/f9 [0,4194304] 0 2024-09-10T09:36:18.372 INFO:tasks.workunit.client.1.smithi135.stdout:0/282: write d8/dd/d11/f2b [2827147,31852] 0 2024-09-10T09:36:18.374 INFO:tasks.workunit.client.1.smithi135.stdout:3/150: readlink d4/d5/db/l1a 0 2024-09-10T09:36:18.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/283: symlink d8/dd/d4a/d50/l56 0 2024-09-10T09:36:18.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/284: creat d8/d1c/f57 x:0 0 0 2024-09-10T09:36:18.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/285: chown d8/dd/c48 51486121 1 2024-09-10T09:36:18.377 INFO:tasks.workunit.client.1.smithi135.stdout:0/286: fdatasync d8/dd/f35 0 2024-09-10T09:36:18.378 INFO:tasks.workunit.client.1.smithi135.stdout:3/151: symlink d4/d5/dc/l30 0 2024-09-10T09:36:18.383 INFO:tasks.workunit.client.1.smithi135.stdout:0/287: creat d8/d1c/d37/f58 x:0 0 0 2024-09-10T09:36:18.383 INFO:tasks.workunit.client.1.smithi135.stdout:0/288: creat d8/dd/d11/f59 x:0 0 0 2024-09-10T09:36:18.385 INFO:tasks.workunit.client.1.smithi135.stdout:3/152: symlink d4/d5/db/d1b/l31 0 2024-09-10T09:36:18.385 INFO:tasks.workunit.client.1.smithi135.stdout:3/153: creat d4/f32 x:0 0 0 2024-09-10T09:36:18.385 INFO:tasks.workunit.client.1.smithi135.stdout:3/154: fdatasync d4/d5/dc/f17 0 2024-09-10T09:36:18.392 INFO:tasks.workunit.client.1.smithi135.stdout:0/289: rename d8/de/cf to d8/dd/d1e/c5a 0 2024-09-10T09:36:18.397 INFO:tasks.workunit.client.1.smithi135.stdout:3/155: mknod d4/d5/db/d1b/d1f/c33 0 2024-09-10T09:36:18.400 INFO:tasks.workunit.client.1.smithi135.stdout:0/290: symlink d8/dd/l5b 0 2024-09-10T09:36:18.400 INFO:tasks.workunit.client.1.smithi135.stdout:0/291: chown d8/d1c/d37 3585 1 2024-09-10T09:36:18.400 INFO:tasks.workunit.client.1.smithi135.stdout:0/292: read d8/dd/f10 [2835148,69577] 0 2024-09-10T09:36:18.400 INFO:tasks.workunit.client.1.smithi135.stdout:0/293: chown d8/d1c/d37/c53 72 1 2024-09-10T09:36:18.402 INFO:tasks.workunit.client.1.smithi135.stdout:3/156: rename d4/d5/db/d1b/l31 to d4/d5/db/dd/l34 0 2024-09-10T09:36:18.402 INFO:tasks.workunit.client.1.smithi135.stdout:3/157: write f3 [3245387,19492] 0 2024-09-10T09:36:18.406 INFO:tasks.workunit.client.1.smithi135.stdout:0/294: symlink d8/de/d2e/l5c 0 2024-09-10T09:36:18.406 INFO:tasks.workunit.client.1.smithi135.stdout:0/295: fsync d8/d1c/f3e 0 2024-09-10T09:36:18.413 INFO:tasks.workunit.client.1.smithi135.stdout:0/296: write d8/d1c/d37/f4e [267891,108896] 0 2024-09-10T09:36:18.413 INFO:tasks.workunit.client.1.smithi135.stdout:0/297: creat d8/d1c/d37/f5d x:0 0 0 2024-09-10T09:36:18.413 INFO:tasks.workunit.client.1.smithi135.stdout:0/298: truncate d8/dd/d11/f59 287122 0 2024-09-10T09:36:18.414 INFO:tasks.workunit.client.1.smithi135.stdout:3/158: unlink d4/d5/db/dd/l34 0 2024-09-10T09:36:18.416 INFO:tasks.workunit.client.1.smithi135.stdout:0/299: dread d8/d1c/d2c/f36 [0,4194304] 0 2024-09-10T09:36:18.430 INFO:tasks.workunit.client.1.smithi135.stdout:3/159: dwrite d4/d5/dc/f19 [4194304,4194304] 0 2024-09-10T09:36:18.430 INFO:tasks.workunit.client.1.smithi135.stdout:3/160: symlink d4/d5/db/d1b/d1f/l35 0 2024-09-10T09:36:18.432 INFO:tasks.workunit.client.1.smithi135.stdout:3/161: truncate d4/d5/dc/f17 3665903 0 2024-09-10T09:36:18.450 INFO:tasks.workunit.client.1.smithi135.stdout:3/162: dwrite d4/d5/dc/f19 [8388608,4194304] 0 2024-09-10T09:36:18.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/163: mkdir d4/d5/db/d36 0 2024-09-10T09:36:18.459 INFO:tasks.workunit.client.1.smithi135.stdout:3/164: dread d4/f25 [0,4194304] 0 2024-09-10T09:36:18.459 INFO:tasks.workunit.client.1.smithi135.stdout:3/165: read - d4/d5/db/f2f zero size 2024-09-10T09:36:18.484 INFO:tasks.workunit.client.1.smithi135.stdout:3/166: dwrite d4/d5/dc/f10 [0,4194304] 0 2024-09-10T09:36:18.488 INFO:tasks.workunit.client.1.smithi135.stdout:1/215: sync 2024-09-10T09:36:18.488 INFO:tasks.workunit.client.1.smithi135.stdout:1/216: write d1d/d20/d24/d2b/f3a [347058,84194] 0 2024-09-10T09:36:18.490 INFO:tasks.workunit.client.1.smithi135.stdout:1/217: symlink d1d/l40 0 2024-09-10T09:36:18.492 INFO:tasks.workunit.client.1.smithi135.stdout:1/218: write d1d/d20/d24/f29 [4721686,29160] 0 2024-09-10T09:36:18.493 INFO:tasks.workunit.client.1.smithi135.stdout:1/219: rename le to d1d/d20/d24/d37/l41 0 2024-09-10T09:36:18.495 INFO:tasks.workunit.client.1.smithi135.stdout:1/220: mkdir d1d/d20/d42 0 2024-09-10T09:36:18.496 INFO:tasks.workunit.client.1.smithi135.stdout:1/221: write d1d/f2c [1288568,74533] 0 2024-09-10T09:36:18.498 INFO:tasks.workunit.client.1.smithi135.stdout:1/222: fsync f11 0 2024-09-10T09:36:18.500 INFO:tasks.workunit.client.1.smithi135.stdout:1/223: unlink c5 0 2024-09-10T09:36:18.501 INFO:tasks.workunit.client.1.smithi135.stdout:1/224: write d1d/f1e [457446,81560] 0 2024-09-10T09:36:18.509 INFO:tasks.workunit.client.1.smithi135.stdout:3/167: dwrite d4/f25 [0,4194304] 0 2024-09-10T09:36:18.512 INFO:tasks.workunit.client.1.smithi135.stdout:3/168: creat d4/d5/db/d1b/d1f/f37 x:0 0 0 2024-09-10T09:36:18.512 INFO:tasks.workunit.client.1.smithi135.stdout:3/169: chown d4/d5/db/d1b/c29 428 1 2024-09-10T09:36:18.512 INFO:tasks.workunit.client.1.smithi135.stdout:1/225: dread d1d/f1e [0,4194304] 0 2024-09-10T09:36:18.512 INFO:tasks.workunit.client.1.smithi135.stdout:1/226: chown f1b 800 1 2024-09-10T09:36:18.512 INFO:tasks.workunit.client.1.smithi135.stdout:3/170: creat d4/d5/db/f38 x:0 0 0 2024-09-10T09:36:18.513 INFO:tasks.workunit.client.1.smithi135.stdout:1/227: link d1d/f2a d1d/d20/f43 0 2024-09-10T09:36:18.513 INFO:tasks.workunit.client.1.smithi135.stdout:1/228: creat d1d/d20/d24/d2b/f44 x:0 0 0 2024-09-10T09:36:18.515 INFO:tasks.workunit.client.1.smithi135.stdout:3/171: creat d4/d5/f39 x:0 0 0 2024-09-10T09:36:18.517 INFO:tasks.workunit.client.1.smithi135.stdout:1/229: creat d1d/f45 x:0 0 0 2024-09-10T09:36:18.517 INFO:tasks.workunit.client.1.smithi135.stdout:1/230: read - d1d/d20/d24/d2b/f44 zero size 2024-09-10T09:36:18.517 INFO:tasks.workunit.client.1.smithi135.stdout:1/231: stat l15 0 2024-09-10T09:36:18.517 INFO:tasks.workunit.client.1.smithi135.stdout:1/232: truncate d1d/d20/d24/d2b/f3a 1079414 0 2024-09-10T09:36:18.519 INFO:tasks.workunit.client.1.smithi135.stdout:3/172: dread d4/d5/db/d1b/d1f/f2a [0,4194304] 0 2024-09-10T09:36:18.519 INFO:tasks.workunit.client.1.smithi135.stdout:3/173: write d4/d5/db/f2f [608883,118372] 0 2024-09-10T09:36:18.521 INFO:tasks.workunit.client.1.smithi135.stdout:3/174: creat d4/d5/db/f3a x:0 0 0 2024-09-10T09:36:18.521 INFO:tasks.workunit.client.1.smithi135.stdout:3/175: chown d4/d5/db/dd 8596576 1 2024-09-10T09:36:18.521 INFO:tasks.workunit.client.1.smithi135.stdout:3/176: dread - d4/d5/db/f3a zero size 2024-09-10T09:36:18.521 INFO:tasks.workunit.client.1.smithi135.stdout:3/177: fsync d4/f32 0 2024-09-10T09:36:18.547 INFO:tasks.workunit.client.1.smithi135.stdout:3/178: dwrite d4/f32 [0,4194304] 0 2024-09-10T09:36:18.547 INFO:tasks.workunit.client.1.smithi135.stdout:3/179: read - d4/d5/db/f3a zero size 2024-09-10T09:36:18.547 INFO:tasks.workunit.client.1.smithi135.stdout:3/180: creat d4/f3b x:0 0 0 2024-09-10T09:36:18.547 INFO:tasks.workunit.client.1.smithi135.stdout:3/181: truncate d4/d5/dc/f19 13604810 0 2024-09-10T09:36:18.547 INFO:tasks.workunit.client.1.smithi135.stdout:1/233: dwrite d1d/f1e [0,4194304] 0 2024-09-10T09:36:18.547 INFO:tasks.workunit.client.1.smithi135.stdout:1/234: write d1d/d20/d24/f29 [5509355,7249] 0 2024-09-10T09:36:18.547 INFO:tasks.workunit.client.1.smithi135.stdout:1/235: write d1d/d20/d24/d2b/f3a [1423680,75657] 0 2024-09-10T09:36:18.710 INFO:tasks.workunit.client.1.smithi135.stdout:4/333: sync 2024-09-10T09:36:18.711 INFO:tasks.workunit.client.1.smithi135.stdout:4/334: mknod d1/de/c66 0 2024-09-10T09:36:18.719 INFO:tasks.workunit.client.1.smithi135.stdout:4/335: write d1/f56 [515942,56194] 0 2024-09-10T09:36:18.769 INFO:tasks.workunit.client.1.smithi135.stdout:4/336: write d1/db/f46 [3731597,84500] 0 2024-09-10T09:36:18.769 INFO:tasks.workunit.client.1.smithi135.stdout:4/337: getdents d1/db/d9/d55 0 2024-09-10T09:36:18.769 INFO:tasks.workunit.client.1.smithi135.stdout:4/338: write d1/de/f34 [1179575,69372] 0 2024-09-10T09:36:18.778 INFO:tasks.workunit.client.1.smithi135.stdout:4/339: dread d1/de/f34 [0,4194304] 0 2024-09-10T09:36:18.786 INFO:tasks.workunit.client.1.smithi135.stdout:4/340: getdents d1/de 0 2024-09-10T09:36:18.800 INFO:tasks.workunit.client.1.smithi135.stdout:4/341: dread d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:18.800 INFO:tasks.workunit.client.1.smithi135.stdout:4/342: creat d1/de/d16/f67 x:0 0 0 2024-09-10T09:36:18.819 INFO:tasks.workunit.client.1.smithi135.stdout:5/170: sync 2024-09-10T09:36:18.819 INFO:tasks.workunit.client.1.smithi135.stdout:5/171: creat d3/f31 x:0 0 0 2024-09-10T09:36:18.819 INFO:tasks.workunit.client.1.smithi135.stdout:5/172: chown d3/dc/f10 72 1 2024-09-10T09:36:18.820 INFO:tasks.workunit.client.1.smithi135.stdout:4/343: dwrite d1/db/d23/f30 [0,4194304] 0 2024-09-10T09:36:18.820 INFO:tasks.workunit.client.1.smithi135.stdout:4/344: chown d1/db 1 1 2024-09-10T09:36:18.822 INFO:tasks.workunit.client.1.smithi135.stdout:5/173: mknod d3/dc/d17/d22/c32 0 2024-09-10T09:36:18.827 INFO:tasks.workunit.client.1.smithi135.stdout:5/174: symlink d3/dc/d17/l33 0 2024-09-10T09:36:18.827 INFO:tasks.workunit.client.1.smithi135.stdout:5/175: creat d3/dc/d16/f34 x:0 0 0 2024-09-10T09:36:18.828 INFO:tasks.workunit.client.1.smithi135.stdout:4/345: getdents d1 0 2024-09-10T09:36:18.829 INFO:tasks.workunit.client.1.smithi135.stdout:4/346: creat d1/de/d16/f68 x:0 0 0 2024-09-10T09:36:18.829 INFO:tasks.workunit.client.1.smithi135.stdout:4/347: readlink d1/db/d23/l2a 0 2024-09-10T09:36:18.829 INFO:tasks.workunit.client.1.smithi135.stdout:4/348: write d1/db/d9/f32 [5847518,27447] 0 2024-09-10T09:36:18.835 INFO:tasks.workunit.client.1.smithi135.stdout:4/349: link d1/db/d23/f42 d1/de/d16/f69 0 2024-09-10T09:36:18.835 INFO:tasks.workunit.client.1.smithi135.stdout:4/350: fdatasync d1/db/f6 0 2024-09-10T09:36:18.835 INFO:tasks.workunit.client.1.smithi135.stdout:4/351: creat d1/db/d9/f6a x:0 0 0 2024-09-10T09:36:18.840 INFO:tasks.workunit.client.1.smithi135.stdout:5/176: write d3/fd [120772,111026] 0 2024-09-10T09:36:18.844 INFO:tasks.workunit.client.1.smithi135.stdout:1/236: sync 2024-09-10T09:36:18.844 INFO:tasks.workunit.client.1.smithi135.stdout:3/182: sync 2024-09-10T09:36:18.844 INFO:tasks.workunit.client.1.smithi135.stdout:8/270: sync 2024-09-10T09:36:18.844 INFO:tasks.workunit.client.1.smithi135.stdout:3/183: truncate d4/d5/f39 290439 0 2024-09-10T09:36:18.844 INFO:tasks.workunit.client.1.smithi135.stdout:7/240: sync 2024-09-10T09:36:18.844 INFO:tasks.workunit.client.1.smithi135.stdout:1/237: write d1d/d20/d24/d2b/f36 [1252278,130445] 0 2024-09-10T09:36:18.844 INFO:tasks.workunit.client.1.smithi135.stdout:1/238: fdatasync d1d/f3f 0 2024-09-10T09:36:18.845 INFO:tasks.workunit.client.1.smithi135.stdout:6/266: sync 2024-09-10T09:36:18.845 INFO:tasks.workunit.client.1.smithi135.stdout:9/224: sync 2024-09-10T09:36:18.845 INFO:tasks.workunit.client.1.smithi135.stdout:2/236: sync 2024-09-10T09:36:18.846 INFO:tasks.workunit.client.1.smithi135.stdout:2/237: creat df/d1b/d23/f48 x:0 0 0 2024-09-10T09:36:18.846 INFO:tasks.workunit.client.1.smithi135.stdout:0/300: sync 2024-09-10T09:36:18.847 INFO:tasks.workunit.client.1.smithi135.stdout:1/239: dread d1d/f25 [0,4194304] 0 2024-09-10T09:36:18.847 INFO:tasks.workunit.client.1.smithi135.stdout:1/240: fsync d1d/d20/f43 0 2024-09-10T09:36:18.847 INFO:tasks.workunit.client.1.smithi135.stdout:0/301: write d8/d1c/f57 [958657,88320] 0 2024-09-10T09:36:18.847 INFO:tasks.workunit.client.1.smithi135.stdout:0/302: write d8/dd/d18/f1a [1336780,53326] 0 2024-09-10T09:36:18.847 INFO:tasks.workunit.client.1.smithi135.stdout:0/303: readlink d8/d1c/d2c/l2a 0 2024-09-10T09:36:18.851 INFO:tasks.workunit.client.1.smithi135.stdout:4/352: write d1/db/d23/f42 [3831246,82848] 0 2024-09-10T09:36:18.851 INFO:tasks.workunit.client.1.smithi135.stdout:4/353: getdents d1/de 0 2024-09-10T09:36:18.851 INFO:tasks.workunit.client.1.smithi135.stdout:4/354: stat d1/db/d23/l5e 0 2024-09-10T09:36:18.851 INFO:tasks.workunit.client.1.smithi135.stdout:4/355: readlink d1/de/d16/l1d 0 2024-09-10T09:36:18.853 INFO:tasks.workunit.client.1.smithi135.stdout:1/241: write d1d/f3f [5419781,63293] 0 2024-09-10T09:36:18.855 INFO:tasks.workunit.client.1.smithi135.stdout:3/184: rename d4/d5/db/dd/le to d4/d5/db/dd/l3c 0 2024-09-10T09:36:18.855 INFO:tasks.workunit.client.1.smithi135.stdout:3/185: write d4/d5/db/d1b/d1f/f37 [455266,12244] 0 2024-09-10T09:36:18.859 INFO:tasks.workunit.client.1.smithi135.stdout:0/304: rename d8/de/d2e/c4f to d8/de/c5e 0 2024-09-10T09:36:18.859 INFO:tasks.workunit.client.1.smithi135.stdout:0/305: chown d8/de/d2e/l5c 0 1 2024-09-10T09:36:18.861 INFO:tasks.workunit.client.1.smithi135.stdout:9/225: dread de/df/d1d/d23/d25/d28/f37 [0,4194304] 0 2024-09-10T09:36:18.865 INFO:tasks.workunit.client.1.smithi135.stdout:3/186: creat d4/d5/db/dd/f3d x:0 0 0 2024-09-10T09:36:18.867 INFO:tasks.workunit.client.1.smithi135.stdout:9/226: creat de/f4a x:0 0 0 2024-09-10T09:36:18.870 INFO:tasks.workunit.client.1.smithi135.stdout:4/356: dread d1/db/f54 [0,4194304] 0 2024-09-10T09:36:18.873 INFO:tasks.workunit.client.1.smithi135.stdout:7/241: dread d2/d15/f1c [4194304,4194304] 0 2024-09-10T09:36:18.873 INFO:tasks.workunit.client.1.smithi135.stdout:7/242: write d2/d11/d30/d46/f4f [162831,52895] 0 2024-09-10T09:36:18.875 INFO:tasks.workunit.client.1.smithi135.stdout:2/238: dwrite df/d1b/d23/d36/f39 [0,4194304] 0 2024-09-10T09:36:18.877 INFO:tasks.workunit.client.1.smithi135.stdout:5/177: dread d3/dc/d17/d22/f2f [0,4194304] 0 2024-09-10T09:36:18.877 INFO:tasks.workunit.client.1.smithi135.stdout:7/243: mkdir d2/d15/d39/d53 0 2024-09-10T09:36:18.880 INFO:tasks.workunit.client.1.smithi135.stdout:3/187: dread d4/f32 [0,4194304] 0 2024-09-10T09:36:18.880 INFO:tasks.workunit.client.1.smithi135.stdout:0/306: read d8/dd/d11/d17/f42 [2663330,111388] 0 2024-09-10T09:36:18.881 INFO:tasks.workunit.client.1.smithi135.stdout:2/239: symlink df/d13/l49 0 2024-09-10T09:36:18.882 INFO:tasks.workunit.client.1.smithi135.stdout:8/271: dwrite d1/f7 [0,4194304] 0 2024-09-10T09:36:18.883 INFO:tasks.workunit.client.1.smithi135.stdout:8/272: readlink d1/l1d 0 2024-09-10T09:36:18.883 INFO:tasks.workunit.client.1.smithi135.stdout:8/273: creat d1/d15/d16/d33/d45/f5d x:0 0 0 2024-09-10T09:36:18.883 INFO:tasks.workunit.client.1.smithi135.stdout:7/244: mkdir d2/d11/d54 0 2024-09-10T09:36:18.883 INFO:tasks.workunit.client.1.smithi135.stdout:7/245: truncate d2/d11/f27 283374 0 2024-09-10T09:36:18.886 INFO:tasks.workunit.client.1.smithi135.stdout:2/240: mkdir df/d1b/d31/d4a 0 2024-09-10T09:36:18.890 INFO:tasks.workunit.client.1.smithi135.stdout:9/227: dwrite de/df/d1d/f43 [0,4194304] 0 2024-09-10T09:36:18.890 INFO:tasks.workunit.client.1.smithi135.stdout:9/228: readlink de/df/l14 0 2024-09-10T09:36:18.891 INFO:tasks.workunit.client.1.smithi135.stdout:5/178: dread d3/f12 [0,4194304] 0 2024-09-10T09:36:18.892 INFO:tasks.workunit.client.1.smithi135.stdout:8/274: symlink d1/d15/d16/d33/d45/l5e 0 2024-09-10T09:36:18.898 INFO:tasks.workunit.client.1.smithi135.stdout:3/188: rename d4/d5/db/dd/l27 to d4/d5/db/l3e 0 2024-09-10T09:36:18.905 INFO:tasks.workunit.client.1.smithi135.stdout:5/179: read d3/dc/d16/f19 [3588511,93227] 0 2024-09-10T09:36:18.905 INFO:tasks.workunit.client.1.smithi135.stdout:5/180: creat d3/dc/d17/f35 x:0 0 0 2024-09-10T09:36:18.908 INFO:tasks.workunit.client.1.smithi135.stdout:5/181: dread d3/ff [0,4194304] 0 2024-09-10T09:36:18.911 INFO:tasks.workunit.client.1.smithi135.stdout:2/241: stat df/d15/l1f 0 2024-09-10T09:36:18.920 INFO:tasks.workunit.client.1.smithi135.stdout:9/229: rmdir de/df/d46 0 2024-09-10T09:36:18.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/275: mknod d1/d13/c5f 0 2024-09-10T09:36:18.925 INFO:tasks.workunit.client.1.smithi135.stdout:9/230: symlink de/df/d1d/d23/l4b 0 2024-09-10T09:36:18.925 INFO:tasks.workunit.client.1.smithi135.stdout:9/231: creat de/df/d1d/d23/d25/d28/f4c x:0 0 0 2024-09-10T09:36:18.927 INFO:tasks.workunit.client.1.smithi135.stdout:8/276: unlink d1/ce 0 2024-09-10T09:36:18.929 INFO:tasks.workunit.client.1.smithi135.stdout:9/232: mknod de/df/d1d/d23/c4d 0 2024-09-10T09:36:18.930 INFO:tasks.workunit.client.1.smithi135.stdout:8/277: symlink d1/d15/d49/l60 0 2024-09-10T09:36:18.931 INFO:tasks.workunit.client.1.smithi135.stdout:9/233: mkdir de/df/d1d/d23/d25/d28/d4e 0 2024-09-10T09:36:18.931 INFO:tasks.workunit.client.1.smithi135.stdout:9/234: write de/df/d1d/d23/d25/f48 [86966,96924] 0 2024-09-10T09:36:18.932 INFO:tasks.workunit.client.1.smithi135.stdout:8/278: creat d1/d15/d16/f61 x:0 0 0 2024-09-10T09:36:18.932 INFO:tasks.workunit.client.1.smithi135.stdout:4/357: dwrite d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:18.933 INFO:tasks.workunit.client.1.smithi135.stdout:0/307: dwrite d8/fc [4194304,4194304] 0 2024-09-10T09:36:18.934 INFO:tasks.workunit.client.1.smithi135.stdout:3/189: dwrite d4/d5/db/dd/f3d [0,4194304] 0 2024-09-10T09:36:18.934 INFO:tasks.workunit.client.1.smithi135.stdout:7/246: dwrite d2/d11/d30/f34 [4194304,4194304] 0 2024-09-10T09:36:18.934 INFO:tasks.workunit.client.1.smithi135.stdout:9/235: link de/df/d1d/d23/f2d de/df/d1d/d1e/d3f/f4f 0 2024-09-10T09:36:18.935 INFO:tasks.workunit.client.1.smithi135.stdout:9/236: creat de/df/d1d/d23/d25/f50 x:0 0 0 2024-09-10T09:36:18.935 INFO:tasks.workunit.client.1.smithi135.stdout:8/279: symlink d1/d15/d16/d33/d39/l62 0 2024-09-10T09:36:18.937 INFO:tasks.workunit.client.1.smithi135.stdout:5/182: dwrite d3/fa [4194304,4194304] 0 2024-09-10T09:36:18.938 INFO:tasks.workunit.client.1.smithi135.stdout:0/308: rename d8/d1c/d2c to d8/dd/d4a/d50/d54/d5f 0 2024-09-10T09:36:18.938 INFO:tasks.workunit.client.1.smithi135.stdout:0/309: dread - d8/dd/d18/f43 zero size 2024-09-10T09:36:18.939 INFO:tasks.workunit.client.1.smithi135.stdout:3/190: creat d4/d5/db/f3f x:0 0 0 2024-09-10T09:36:18.941 INFO:tasks.workunit.client.1.smithi135.stdout:2/242: dwrite df/d1b/d23/d36/f39 [0,4194304] 0 2024-09-10T09:36:18.942 INFO:tasks.workunit.client.1.smithi135.stdout:7/247: truncate d2/d15/f1c 6186340 0 2024-09-10T09:36:18.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/243: write df/d13/f38 [74233,66033] 0 2024-09-10T09:36:18.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/244: creat df/d1b/d30/f4b x:0 0 0 2024-09-10T09:36:18.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/245: chown df/d1b/d23/c29 1154965 1 2024-09-10T09:36:18.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/246: write df/d13/f38 [1520971,35002] 0 2024-09-10T09:36:18.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/247: write df/f3b [1189201,20172] 0 2024-09-10T09:36:18.942 INFO:tasks.workunit.client.1.smithi135.stdout:2/248: fdatasync f8 0 2024-09-10T09:36:18.944 INFO:tasks.workunit.client.1.smithi135.stdout:0/310: dread d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:36:18.947 INFO:tasks.workunit.client.1.smithi135.stdout:9/237: link de/c29 de/df/d1d/d23/d25/c51 0 2024-09-10T09:36:18.951 INFO:tasks.workunit.client.1.smithi135.stdout:3/191: mknod d4/d5/dc/c40 0 2024-09-10T09:36:18.952 INFO:tasks.workunit.client.1.smithi135.stdout:0/311: dread d8/dd/d11/f2b [0,4194304] 0 2024-09-10T09:36:18.956 INFO:tasks.workunit.client.1.smithi135.stdout:2/249: symlink df/d1b/d23/l4c 0 2024-09-10T09:36:18.958 INFO:tasks.workunit.client.1.smithi135.stdout:9/238: mkdir de/df/d1d/d1e/d52 0 2024-09-10T09:36:18.958 INFO:tasks.workunit.client.1.smithi135.stdout:9/239: read - de/f4a zero size 2024-09-10T09:36:18.960 INFO:tasks.workunit.client.1.smithi135.stdout:3/192: link d4/f3b d4/d5/db/d1b/d1f/f41 0 2024-09-10T09:36:18.960 INFO:tasks.workunit.client.1.smithi135.stdout:3/193: chown d4/f3b 45 1 2024-09-10T09:36:18.960 INFO:tasks.workunit.client.1.smithi135.stdout:3/194: readlink d4/l6 0 2024-09-10T09:36:18.962 INFO:tasks.workunit.client.1.smithi135.stdout:0/312: unlink d8/d1c/d37/f4e 0 2024-09-10T09:36:18.962 INFO:tasks.workunit.client.1.smithi135.stdout:4/358: dwrite d1/f63 [0,4194304] 0 2024-09-10T09:36:18.964 INFO:tasks.workunit.client.1.smithi135.stdout:2/250: symlink df/d1b/d27/d2c/l4d 0 2024-09-10T09:36:18.969 INFO:tasks.workunit.client.1.smithi135.stdout:4/359: unlink d1/d33/d40/f4d 0 2024-09-10T09:36:18.970 INFO:tasks.workunit.client.1.smithi135.stdout:4/360: read d1/de/d16/f21 [960154,109975] 0 2024-09-10T09:36:18.970 INFO:tasks.workunit.client.1.smithi135.stdout:4/361: getdents d1/de 0 2024-09-10T09:36:18.970 INFO:tasks.workunit.client.1.smithi135.stdout:2/251: symlink df/d1b/d31/l4e 0 2024-09-10T09:36:18.970 INFO:tasks.workunit.client.1.smithi135.stdout:2/252: chown df/d1b/d27 51 1 2024-09-10T09:36:18.971 INFO:tasks.workunit.client.1.smithi135.stdout:2/253: fdatasync df/d1b/d23/d36/f39 0 2024-09-10T09:36:18.971 INFO:tasks.workunit.client.1.smithi135.stdout:2/254: truncate df/f10 745506 0 2024-09-10T09:36:18.974 INFO:tasks.workunit.client.1.smithi135.stdout:0/313: dread d8/fc [8388608,4194304] 0 2024-09-10T09:36:18.976 INFO:tasks.workunit.client.1.smithi135.stdout:8/280: dwrite d1/d15/d16/f29 [0,4194304] 0 2024-09-10T09:36:18.976 INFO:tasks.workunit.client.1.smithi135.stdout:0/314: mknod d8/dd/d4a/c60 0 2024-09-10T09:36:18.977 INFO:tasks.workunit.client.1.smithi135.stdout:0/315: fdatasync d8/de/f38 0 2024-09-10T09:36:18.977 INFO:tasks.workunit.client.1.smithi135.stdout:0/316: dread - d8/dd/d1e/f49 zero size 2024-09-10T09:36:18.977 INFO:tasks.workunit.client.1.smithi135.stdout:7/248: dwrite d2/d15/d4a/f48 [0,4194304] 0 2024-09-10T09:36:18.977 INFO:tasks.workunit.client.1.smithi135.stdout:7/249: fsync d2/f1e 0 2024-09-10T09:36:18.977 INFO:tasks.workunit.client.1.smithi135.stdout:5/183: dwrite d3/dc/f1c [0,4194304] 0 2024-09-10T09:36:18.977 INFO:tasks.workunit.client.1.smithi135.stdout:5/184: truncate d3/f5 4123559 0 2024-09-10T09:36:18.982 INFO:tasks.workunit.client.1.smithi135.stdout:2/255: dread df/f12 [0,4194304] 0 2024-09-10T09:36:18.984 INFO:tasks.workunit.client.1.smithi135.stdout:0/317: mkdir d8/d1c/d61 0 2024-09-10T09:36:18.987 INFO:tasks.workunit.client.1.smithi135.stdout:5/185: dread d3/fd [0,4194304] 0 2024-09-10T09:36:18.994 INFO:tasks.workunit.client.1.smithi135.stdout:3/195: dwrite d4/d5/db/d1b/d1f/f37 [0,4194304] 0 2024-09-10T09:36:18.994 INFO:tasks.workunit.client.1.smithi135.stdout:3/196: fsync d4/d5/dc/f19 0 2024-09-10T09:36:18.994 INFO:tasks.workunit.client.1.smithi135.stdout:8/281: rename d1/d27/d3d/d47 to d1/d15/d63 0 2024-09-10T09:36:18.995 INFO:tasks.workunit.client.1.smithi135.stdout:8/282: chown d1/d27/c4b 26073896 1 2024-09-10T09:36:18.996 INFO:tasks.workunit.client.1.smithi135.stdout:2/256: rmdir df/d1b/d31/d40 0 2024-09-10T09:36:18.997 INFO:tasks.workunit.client.1.smithi135.stdout:0/318: creat d8/dd/d4a/d50/d54/f62 x:0 0 0 2024-09-10T09:36:18.997 INFO:tasks.workunit.client.1.smithi135.stdout:0/319: write d8/dd/d1e/f23 [1410900,88760] 0 2024-09-10T09:36:18.998 INFO:tasks.workunit.client.1.smithi135.stdout:5/186: creat d3/dc/d17/d22/f36 x:0 0 0 2024-09-10T09:36:19.001 INFO:tasks.workunit.client.1.smithi135.stdout:9/240: getdents de/df/d1d/d1e 0 2024-09-10T09:36:19.005 INFO:tasks.workunit.client.1.smithi135.stdout:7/250: rename d2/d11/d30/d46/f4c to d2/d15/d39/f55 0 2024-09-10T09:36:19.005 INFO:tasks.workunit.client.1.smithi135.stdout:7/251: fsync d2/f10 0 2024-09-10T09:36:19.008 INFO:tasks.workunit.client.1.smithi135.stdout:5/187: creat d3/dc/f37 x:0 0 0 2024-09-10T09:36:19.008 INFO:tasks.workunit.client.1.smithi135.stdout:4/362: write d1/f63 [4710462,129915] 0 2024-09-10T09:36:19.010 INFO:tasks.workunit.client.1.smithi135.stdout:2/257: dread df/f17 [0,4194304] 0 2024-09-10T09:36:19.011 INFO:tasks.workunit.client.1.smithi135.stdout:2/258: stat df/d1b 0 2024-09-10T09:36:19.011 INFO:tasks.workunit.client.1.smithi135.stdout:3/197: mknod d4/d5/db/c42 0 2024-09-10T09:36:19.012 INFO:tasks.workunit.client.1.smithi135.stdout:5/188: write d3/f5 [344993,52744] 0 2024-09-10T09:36:19.012 INFO:tasks.workunit.client.1.smithi135.stdout:5/189: stat d3/dc/d17/d22/f36 0 2024-09-10T09:36:19.012 INFO:tasks.workunit.client.1.smithi135.stdout:5/190: dread - d3/dc/f13 zero size 2024-09-10T09:36:19.014 INFO:tasks.workunit.client.1.smithi135.stdout:7/252: truncate d2/d25/f38 4721073 0 2024-09-10T09:36:19.016 INFO:tasks.workunit.client.1.smithi135.stdout:9/241: getdents de/df/d1d 0 2024-09-10T09:36:19.016 INFO:tasks.workunit.client.1.smithi135.stdout:9/242: readlink l5 0 2024-09-10T09:36:19.016 INFO:tasks.workunit.client.1.smithi135.stdout:5/191: dread d3/fd [0,4194304] 0 2024-09-10T09:36:19.016 INFO:tasks.workunit.client.1.smithi135.stdout:0/320: dwrite d8/dd/d11/f1f [0,4194304] 0 2024-09-10T09:36:19.016 INFO:tasks.workunit.client.1.smithi135.stdout:0/321: truncate d8/f26 2137386 0 2024-09-10T09:36:19.017 INFO:tasks.workunit.client.1.smithi135.stdout:2/259: mkdir df/d13/d4f 0 2024-09-10T09:36:19.017 INFO:tasks.workunit.client.1.smithi135.stdout:2/260: stat df 0 2024-09-10T09:36:19.017 INFO:tasks.workunit.client.1.smithi135.stdout:2/261: stat df/d1b/f1c 0 2024-09-10T09:36:19.021 INFO:tasks.workunit.client.1.smithi135.stdout:2/262: write df/d1b/f1c [4426196,43184] 0 2024-09-10T09:36:19.024 INFO:tasks.workunit.client.1.smithi135.stdout:8/283: rename d1/d15/d16/f38 to d1/d15/f64 0 2024-09-10T09:36:19.025 INFO:tasks.workunit.client.1.smithi135.stdout:7/253: truncate d2/f3a 4060431 0 2024-09-10T09:36:19.026 INFO:tasks.workunit.client.1.smithi135.stdout:7/254: dread d2/f1e [0,4194304] 0 2024-09-10T09:36:19.028 INFO:tasks.workunit.client.1.smithi135.stdout:9/243: write de/df/d1d/d23/d25/d28/f37 [4911678,95014] 0 2024-09-10T09:36:19.029 INFO:tasks.workunit.client.1.smithi135.stdout:0/322: unlink d8/dd/d4a/l51 0 2024-09-10T09:36:19.032 INFO:tasks.workunit.client.1.smithi135.stdout:2/263: symlink df/d1b/d31/d4a/l50 0 2024-09-10T09:36:19.039 INFO:tasks.workunit.client.1.smithi135.stdout:3/198: dwrite d4/f25 [0,4194304] 0 2024-09-10T09:36:19.039 INFO:tasks.workunit.client.1.smithi135.stdout:3/199: readlink d4/d5/db/d1b/d1f/l35 0 2024-09-10T09:36:19.043 INFO:tasks.workunit.client.1.smithi135.stdout:4/363: rename d1/d33/c41 to d1/db/d23/c6b 0 2024-09-10T09:36:19.046 INFO:tasks.workunit.client.1.smithi135.stdout:7/255: truncate d2/d15/f2c 1750442 0 2024-09-10T09:36:19.047 INFO:tasks.workunit.client.1.smithi135.stdout:5/192: link d3/dc/l2a d3/dc/l38 0 2024-09-10T09:36:19.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/244: truncate f9 3436724 0 2024-09-10T09:36:19.050 INFO:tasks.workunit.client.1.smithi135.stdout:7/256: write d2/d15/f24 [1420048,29014] 0 2024-09-10T09:36:19.051 INFO:tasks.workunit.client.1.smithi135.stdout:9/245: dread de/f17 [0,4194304] 0 2024-09-10T09:36:19.055 INFO:tasks.workunit.client.1.smithi135.stdout:5/193: dread d3/dc/f10 [0,4194304] 0 2024-09-10T09:36:19.059 INFO:tasks.workunit.client.1.smithi135.stdout:0/323: dwrite d8/dd/d4a/d50/d54/d5f/f30 [0,4194304] 0 2024-09-10T09:36:19.060 INFO:tasks.workunit.client.1.smithi135.stdout:2/264: dwrite df/d15/f24 [0,4194304] 0 2024-09-10T09:36:19.064 INFO:tasks.workunit.client.1.smithi135.stdout:2/265: dread df/f12 [0,4194304] 0 2024-09-10T09:36:19.070 INFO:tasks.workunit.client.1.smithi135.stdout:2/266: write df/f12 [3006298,90622] 0 2024-09-10T09:36:19.075 INFO:tasks.workunit.client.1.smithi135.stdout:3/200: mkdir d4/d5/db/d36/d43 0 2024-09-10T09:36:19.075 INFO:tasks.workunit.client.1.smithi135.stdout:3/201: chown d4/d5/db/f2f 0 1 2024-09-10T09:36:19.077 INFO:tasks.workunit.client.1.smithi135.stdout:8/284: rename d1/d15/d49/c56 to d1/d15/d63/c65 0 2024-09-10T09:36:19.077 INFO:tasks.workunit.client.1.smithi135.stdout:8/285: chown d1/d15/d16/f61 0 1 2024-09-10T09:36:19.078 INFO:tasks.workunit.client.1.smithi135.stdout:8/286: write d1/f25 [1802672,125269] 0 2024-09-10T09:36:19.078 INFO:tasks.workunit.client.1.smithi135.stdout:8/287: stat d1/c4 0 2024-09-10T09:36:19.082 INFO:tasks.workunit.client.1.smithi135.stdout:4/364: unlink d1/db/f43 0 2024-09-10T09:36:19.090 INFO:tasks.workunit.client.1.smithi135.stdout:7/257: mknod d2/d15/d41/d49/d52/c56 0 2024-09-10T09:36:19.091 INFO:tasks.workunit.client.1.smithi135.stdout:3/202: dwrite d4/f3b [0,4194304] 0 2024-09-10T09:36:19.092 INFO:tasks.workunit.client.1.smithi135.stdout:3/203: write f3 [507343,35765] 0 2024-09-10T09:36:19.100 INFO:tasks.workunit.client.1.smithi135.stdout:9/246: creat de/df/d1d/d1e/d52/f53 x:0 0 0 2024-09-10T09:36:19.103 INFO:tasks.workunit.client.1.smithi135.stdout:5/194: mknod d3/dc/d17/d22/c39 0 2024-09-10T09:36:19.108 INFO:tasks.workunit.client.1.smithi135.stdout:5/195: dread d3/dc/d17/d22/f2f [0,4194304] 0 2024-09-10T09:36:19.109 INFO:tasks.workunit.client.1.smithi135.stdout:0/324: symlink d8/d1c/l63 0 2024-09-10T09:36:19.109 INFO:tasks.workunit.client.1.smithi135.stdout:0/325: creat d8/d1c/d37/f64 x:0 0 0 2024-09-10T09:36:19.109 INFO:tasks.workunit.client.1.smithi135.stdout:0/326: creat d8/d1c/d37/f65 x:0 0 0 2024-09-10T09:36:19.109 INFO:tasks.workunit.client.1.smithi135.stdout:0/327: chown d8/de/f38 9553 1 2024-09-10T09:36:19.112 INFO:tasks.workunit.client.1.smithi135.stdout:2/267: mknod df/d13/d4f/c51 0 2024-09-10T09:36:19.112 INFO:tasks.workunit.client.1.smithi135.stdout:2/268: fdatasync df/f17 0 2024-09-10T09:36:19.112 INFO:tasks.workunit.client.1.smithi135.stdout:4/365: symlink d1/l6c 0 2024-09-10T09:36:19.112 INFO:tasks.workunit.client.1.smithi135.stdout:4/366: chown d1/de/d16 7877300 1 2024-09-10T09:36:19.113 INFO:tasks.workunit.client.1.smithi135.stdout:7/258: symlink d2/d15/d39/l57 0 2024-09-10T09:36:19.113 INFO:tasks.workunit.client.1.smithi135.stdout:7/259: fsync d2/f1f 0 2024-09-10T09:36:19.117 INFO:tasks.workunit.client.1.smithi135.stdout:9/247: symlink de/df/d1d/d1e/d3f/l54 0 2024-09-10T09:36:19.122 INFO:tasks.workunit.client.1.smithi135.stdout:3/204: dwrite f1 [4194304,4194304] 0 2024-09-10T09:36:19.122 INFO:tasks.workunit.client.1.smithi135.stdout:8/288: dwrite d1/d13/f1b [0,4194304] 0 2024-09-10T09:36:19.122 INFO:tasks.workunit.client.1.smithi135.stdout:3/205: read - d4/d5/db/d1b/f1e zero size 2024-09-10T09:36:19.124 INFO:tasks.workunit.client.1.smithi135.stdout:2/269: rmdir df/d1b/d27/d45 0 2024-09-10T09:36:19.125 INFO:tasks.workunit.client.1.smithi135.stdout:3/206: write d4/f32 [700986,33818] 0 2024-09-10T09:36:19.126 INFO:tasks.workunit.client.1.smithi135.stdout:4/367: mkdir d1/d4a/d6d 0 2024-09-10T09:36:19.126 INFO:tasks.workunit.client.1.smithi135.stdout:4/368: creat d1/d33/f6e x:0 0 0 2024-09-10T09:36:19.127 INFO:tasks.workunit.client.1.smithi135.stdout:4/369: chown d1/c5f 1535 1 2024-09-10T09:36:19.128 INFO:tasks.workunit.client.1.smithi135.stdout:7/260: unlink d2/d15/d39/l57 0 2024-09-10T09:36:19.129 INFO:tasks.workunit.client.1.smithi135.stdout:7/261: getdents d2/d15/d39/d53 0 2024-09-10T09:36:19.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/196: dwrite d3/dc/d17/f35 [0,4194304] 0 2024-09-10T09:36:19.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/197: dread - d3/f31 zero size 2024-09-10T09:36:19.134 INFO:tasks.workunit.client.1.smithi135.stdout:0/328: dwrite d8/de/f4d [4194304,4194304] 0 2024-09-10T09:36:19.134 INFO:tasks.workunit.client.1.smithi135.stdout:0/329: stat d8/dd/d11/f1f 0 2024-09-10T09:36:19.134 INFO:tasks.workunit.client.1.smithi135.stdout:8/289: rename d1/d13/c5f to d1/d15/d16/d33/d45/c66 0 2024-09-10T09:36:19.137 INFO:tasks.workunit.client.1.smithi135.stdout:2/270: mkdir df/d13/d52 0 2024-09-10T09:36:19.137 INFO:tasks.workunit.client.1.smithi135.stdout:2/271: fdatasync df/d1b/d23/d36/f39 0 2024-09-10T09:36:19.142 INFO:tasks.workunit.client.1.smithi135.stdout:2/272: dread df/d1b/f26 [0,4194304] 0 2024-09-10T09:36:19.142 INFO:tasks.workunit.client.1.smithi135.stdout:2/273: fdatasync df/d13/f1d 0 2024-09-10T09:36:19.145 INFO:tasks.workunit.client.1.smithi135.stdout:0/330: write d8/dd/d11/f1f [2162378,17666] 0 2024-09-10T09:36:19.145 INFO:tasks.workunit.client.1.smithi135.stdout:7/262: truncate d2/d11/f43 29680 0 2024-09-10T09:36:19.145 INFO:tasks.workunit.client.1.smithi135.stdout:7/263: chown d2/d15/l1a 327214 1 2024-09-10T09:36:19.149 INFO:tasks.workunit.client.1.smithi135.stdout:9/248: rmdir de/df/d1d/d23/d25 39 2024-09-10T09:36:19.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/198: mknod d3/c3a 0 2024-09-10T09:36:19.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/199: read d3/dc/d17/d22/f2f [3801602,125822] 0 2024-09-10T09:36:19.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/200: chown d3/f18 246604 1 2024-09-10T09:36:19.154 INFO:tasks.workunit.client.1.smithi135.stdout:5/201: write d3/f5 [4361543,13599] 0 2024-09-10T09:36:19.155 INFO:tasks.workunit.client.1.smithi135.stdout:8/290: rmdir d1/d15 39 2024-09-10T09:36:19.157 INFO:tasks.workunit.client.1.smithi135.stdout:3/207: mkdir d4/d5/db/d44 0 2024-09-10T09:36:19.160 INFO:tasks.workunit.client.1.smithi135.stdout:2/274: mknod df/d1b/d27/d2c/c53 0 2024-09-10T09:36:19.160 INFO:tasks.workunit.client.1.smithi135.stdout:2/275: dread - df/d15/f33 zero size 2024-09-10T09:36:19.160 INFO:tasks.workunit.client.1.smithi135.stdout:2/276: truncate df/f3b 1876961 0 2024-09-10T09:36:19.161 INFO:tasks.workunit.client.1.smithi135.stdout:2/277: creat df/f54 x:0 0 0 2024-09-10T09:36:19.163 INFO:tasks.workunit.client.1.smithi135.stdout:9/249: write de/df/d1d/f43 [2810712,86912] 0 2024-09-10T09:36:19.166 INFO:tasks.workunit.client.1.smithi135.stdout:8/291: dread d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:19.166 INFO:tasks.workunit.client.1.smithi135.stdout:9/250: dread de/df/d1d/d23/f26 [0,4194304] 0 2024-09-10T09:36:19.170 INFO:tasks.workunit.client.1.smithi135.stdout:2/278: creat df/d1b/d23/d36/f55 x:0 0 0 2024-09-10T09:36:19.171 INFO:tasks.workunit.client.1.smithi135.stdout:9/251: mknod de/df/d1d/c55 0 2024-09-10T09:36:19.171 INFO:tasks.workunit.client.1.smithi135.stdout:9/252: dread - de/df/d1d/d1e/d52/f53 zero size 2024-09-10T09:36:19.172 INFO:tasks.workunit.client.1.smithi135.stdout:9/253: dread de/f17 [0,4194304] 0 2024-09-10T09:36:19.172 INFO:tasks.workunit.client.1.smithi135.stdout:9/254: chown de 1 1 2024-09-10T09:36:19.172 INFO:tasks.workunit.client.1.smithi135.stdout:9/255: fdatasync de/df/d1d/d23/d25/f48 0 2024-09-10T09:36:19.174 INFO:tasks.workunit.client.1.smithi135.stdout:0/331: dwrite d8/d1c/d37/f58 [0,4194304] 0 2024-09-10T09:36:19.174 INFO:tasks.workunit.client.1.smithi135.stdout:2/279: rmdir df/d1b/d27 39 2024-09-10T09:36:19.175 INFO:tasks.workunit.client.1.smithi135.stdout:4/370: getdents d1/d33 0 2024-09-10T09:36:19.175 INFO:tasks.workunit.client.1.smithi135.stdout:4/371: readlink d1/de/d16/l1d 0 2024-09-10T09:36:19.178 INFO:tasks.workunit.client.1.smithi135.stdout:9/256: symlink de/df/d1d/d23/d25/l56 0 2024-09-10T09:36:19.178 INFO:tasks.workunit.client.1.smithi135.stdout:8/292: read d1/f14 [624046,120483] 0 2024-09-10T09:36:19.180 INFO:tasks.workunit.client.1.smithi135.stdout:3/208: dwrite d4/d5/db/f38 [0,4194304] 0 2024-09-10T09:36:19.180 INFO:tasks.workunit.client.1.smithi135.stdout:0/332: mknod d8/dd/d18/c66 0 2024-09-10T09:36:19.182 INFO:tasks.workunit.client.1.smithi135.stdout:2/280: link df/d15/l22 df/d1b/d23/d42/l56 0 2024-09-10T09:36:19.183 INFO:tasks.workunit.client.1.smithi135.stdout:4/372: truncate d1/f19 4126082 0 2024-09-10T09:36:19.185 INFO:tasks.workunit.client.1.smithi135.stdout:9/257: creat de/df/d1d/d23/f57 x:0 0 0 2024-09-10T09:36:19.186 INFO:tasks.workunit.client.1.smithi135.stdout:2/281: write df/f17 [3542911,36067] 0 2024-09-10T09:36:19.189 INFO:tasks.workunit.client.1.smithi135.stdout:3/209: dread d4/d5/db/d1b/d1f/f41 [0,4194304] 0 2024-09-10T09:36:19.189 INFO:tasks.workunit.client.1.smithi135.stdout:3/210: write d4/d5/db/d1b/f1e [188028,98420] 0 2024-09-10T09:36:19.189 INFO:tasks.workunit.client.1.smithi135.stdout:3/211: chown d4/d5/db/dd/f3d 1671463 1 2024-09-10T09:36:19.189 INFO:tasks.workunit.client.1.smithi135.stdout:0/333: mkdir d8/dd/d4a/d50/d67 0 2024-09-10T09:36:19.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/282: dread df/f3b [0,4194304] 0 2024-09-10T09:36:19.193 INFO:tasks.workunit.client.1.smithi135.stdout:9/258: read de/df/d1d/d23/d25/d28/f37 [1331704,104714] 0 2024-09-10T09:36:19.196 INFO:tasks.workunit.client.1.smithi135.stdout:3/212: dread d4/d5/db/d1b/f1e [0,4194304] 0 2024-09-10T09:36:19.196 INFO:tasks.workunit.client.1.smithi135.stdout:3/213: chown d4/d5/db/d44 0 1 2024-09-10T09:36:19.203 INFO:tasks.workunit.client.1.smithi135.stdout:4/373: link d1/db/d23/l2a d1/l6f 0 2024-09-10T09:36:19.203 INFO:tasks.workunit.client.1.smithi135.stdout:4/374: truncate d1/de/d16/f2f 4999189 0 2024-09-10T09:36:19.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/293: symlink d1/d15/l67 0 2024-09-10T09:36:19.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/294: creat d1/d27/f68 x:0 0 0 2024-09-10T09:36:19.205 INFO:tasks.workunit.client.1.smithi135.stdout:2/283: dwrite df/d1b/f26 [4194304,4194304] 0 2024-09-10T09:36:19.211 INFO:tasks.workunit.client.1.smithi135.stdout:0/334: truncate d8/dd/d4a/d50/d54/d5f/f30 3188394 0 2024-09-10T09:36:19.211 INFO:tasks.workunit.client.1.smithi135.stdout:0/335: getdents d8/dd/d33 0 2024-09-10T09:36:19.211 INFO:tasks.workunit.client.1.smithi135.stdout:0/336: creat d8/de/f68 x:0 0 0 2024-09-10T09:36:19.214 INFO:tasks.workunit.client.1.smithi135.stdout:3/214: mknod d4/d5/db/d44/c45 0 2024-09-10T09:36:19.219 INFO:tasks.workunit.client.1.smithi135.stdout:8/295: mkdir d1/d15/d49/d69 0 2024-09-10T09:36:19.227 INFO:tasks.workunit.client.1.smithi135.stdout:0/337: creat d8/d1c/d61/f69 x:0 0 0 2024-09-10T09:36:19.227 INFO:tasks.workunit.client.1.smithi135.stdout:4/375: dwrite d1/f63 [4194304,4194304] 0 2024-09-10T09:36:19.228 INFO:tasks.workunit.client.1.smithi135.stdout:4/376: fdatasync d1/de/d16/f3f 0 2024-09-10T09:36:19.229 INFO:tasks.workunit.client.1.smithi135.stdout:3/215: creat d4/d5/db/d36/d43/f46 x:0 0 0 2024-09-10T09:36:19.229 INFO:tasks.workunit.client.1.smithi135.stdout:3/216: dread - d4/d5/db/f3f zero size 2024-09-10T09:36:19.232 INFO:tasks.workunit.client.1.smithi135.stdout:2/284: dwrite df/d1b/d30/f4b [0,4194304] 0 2024-09-10T09:36:19.232 INFO:tasks.workunit.client.1.smithi135.stdout:2/285: chown df/d15 105503899 1 2024-09-10T09:36:19.233 INFO:tasks.workunit.client.1.smithi135.stdout:2/286: chown df/d13/c2d 722020441 1 2024-09-10T09:36:19.233 INFO:tasks.workunit.client.1.smithi135.stdout:4/377: mkdir d1/db/d9/d55/d70 0 2024-09-10T09:36:19.235 INFO:tasks.workunit.client.1.smithi135.stdout:3/217: truncate d4/d5/db/f2f 229359 0 2024-09-10T09:36:19.238 INFO:tasks.workunit.client.1.smithi135.stdout:0/338: getdents d8/dd/d4a/d50/d54 0 2024-09-10T09:36:19.238 INFO:tasks.workunit.client.1.smithi135.stdout:8/296: dwrite d1/d15/d16/d33/d45/f5d [0,4194304] 0 2024-09-10T09:36:19.241 INFO:tasks.workunit.client.1.smithi135.stdout:0/339: write d8/d1c/f57 [188528,31915] 0 2024-09-10T09:36:19.246 INFO:tasks.workunit.client.1.smithi135.stdout:2/287: mknod df/d1b/d30/c57 0 2024-09-10T09:36:19.248 INFO:tasks.workunit.client.1.smithi135.stdout:4/378: unlink d1/f63 0 2024-09-10T09:36:19.248 INFO:tasks.workunit.client.1.smithi135.stdout:4/379: stat d1/db/d23/c29 0 2024-09-10T09:36:19.248 INFO:tasks.workunit.client.1.smithi135.stdout:4/380: chown d1/db/d9/d55/d70 220564 1 2024-09-10T09:36:19.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/297: rename d1/d13/f1b to d1/d15/d24/f6a 0 2024-09-10T09:36:19.255 INFO:tasks.workunit.client.1.smithi135.stdout:3/218: dwrite d4/f32 [0,4194304] 0 2024-09-10T09:36:19.258 INFO:tasks.workunit.client.1.smithi135.stdout:0/340: symlink d8/d1c/d37/l6a 0 2024-09-10T09:36:19.258 INFO:tasks.workunit.client.1.smithi135.stdout:0/341: chown d8/dd/d11/d17/l31 23975313 1 2024-09-10T09:36:19.259 INFO:tasks.workunit.client.1.smithi135.stdout:8/298: link d1/l1d d1/d15/d63/l6b 0 2024-09-10T09:36:19.260 INFO:tasks.workunit.client.1.smithi135.stdout:2/288: dread df/d1b/f1c [0,4194304] 0 2024-09-10T09:36:19.262 INFO:tasks.workunit.client.1.smithi135.stdout:4/381: read d1/de/d16/f69 [2877571,107635] 0 2024-09-10T09:36:19.265 INFO:tasks.workunit.client.1.smithi135.stdout:3/219: unlink d4/d5/db/f38 0 2024-09-10T09:36:19.265 INFO:tasks.workunit.client.1.smithi135.stdout:3/220: creat d4/f47 x:0 0 0 2024-09-10T09:36:19.265 INFO:tasks.workunit.client.1.smithi135.stdout:0/342: symlink d8/d1c/d37/l6b 0 2024-09-10T09:36:19.278 INFO:tasks.workunit.client.1.smithi135.stdout:2/289: write df/d1b/d30/f4b [2293721,101778] 0 2024-09-10T09:36:19.279 INFO:tasks.workunit.client.1.smithi135.stdout:4/382: rename d1/db/d9/c2b to d1/d33/d40/c71 0 2024-09-10T09:36:19.280 INFO:tasks.workunit.client.1.smithi135.stdout:8/299: write d1/d15/d16/f26 [431380,14841] 0 2024-09-10T09:36:19.295 INFO:tasks.workunit.client.1.smithi135.stdout:3/221: dwrite d4/f3b [0,4194304] 0 2024-09-10T09:36:19.299 INFO:tasks.workunit.client.1.smithi135.stdout:4/383: dread d1/db/f6 [0,4194304] 0 2024-09-10T09:36:19.300 INFO:tasks.workunit.client.1.smithi135.stdout:4/384: link d1/db/d23/c6b d1/db/d9/d55/c72 0 2024-09-10T09:36:19.300 INFO:tasks.workunit.client.1.smithi135.stdout:4/385: getdents d1/db/d9/d55/d70 0 2024-09-10T09:36:19.300 INFO:tasks.workunit.client.1.smithi135.stdout:4/386: write d1/de/d16/f44 [401733,3529] 0 2024-09-10T09:36:19.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/343: dwrite d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:19.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/344: write d8/dd/d11/f1f [821601,84384] 0 2024-09-10T09:36:19.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/345: fdatasync d8/d1c/d37/f58 0 2024-09-10T09:36:19.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/346: read - d8/d1c/d37/f64 zero size 2024-09-10T09:36:19.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/347: getdents d8/dd/d18/d3d 0 2024-09-10T09:36:19.310 INFO:tasks.workunit.client.1.smithi135.stdout:0/348: symlink d8/dd/d4a/d50/d54/l6c 0 2024-09-10T09:36:19.312 INFO:tasks.workunit.client.1.smithi135.stdout:3/222: dread d4/f3b [0,4194304] 0 2024-09-10T09:36:19.312 INFO:tasks.workunit.client.1.smithi135.stdout:3/223: chown d4/d5/db/c23 423939274 1 2024-09-10T09:36:19.314 INFO:tasks.workunit.client.1.smithi135.stdout:2/290: dwrite df/d1b/d23/f48 [0,4194304] 0 2024-09-10T09:36:19.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/224: rename d4/d5/db/c42 to d4/d5/dc/c48 0 2024-09-10T09:36:19.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/225: fsync f1 0 2024-09-10T09:36:19.317 INFO:tasks.workunit.client.1.smithi135.stdout:8/300: dwrite d1/d15/d49/f4e [0,4194304] 0 2024-09-10T09:36:19.320 INFO:tasks.workunit.client.1.smithi135.stdout:2/291: creat df/d13/d52/f58 x:0 0 0 2024-09-10T09:36:19.323 INFO:tasks.workunit.client.1.smithi135.stdout:4/387: dwrite d1/de/f3c [0,4194304] 0 2024-09-10T09:36:19.323 INFO:tasks.workunit.client.1.smithi135.stdout:3/226: dread f3 [0,4194304] 0 2024-09-10T09:36:19.323 INFO:tasks.workunit.client.1.smithi135.stdout:3/227: chown d4/d5/dc/c48 176682692 1 2024-09-10T09:36:19.324 INFO:tasks.workunit.client.1.smithi135.stdout:8/301: link d1/d13/l4c d1/d15/d49/d69/l6c 0 2024-09-10T09:36:19.325 INFO:tasks.workunit.client.1.smithi135.stdout:2/292: mknod df/d1b/d23/d42/c59 0 2024-09-10T09:36:19.325 INFO:tasks.workunit.client.1.smithi135.stdout:8/302: write d1/d27/f36 [221715,55303] 0 2024-09-10T09:36:19.325 INFO:tasks.workunit.client.1.smithi135.stdout:8/303: fdatasync d1/d15/f19 0 2024-09-10T09:36:19.327 INFO:tasks.workunit.client.1.smithi135.stdout:4/388: truncate d1/db/f46 91939 0 2024-09-10T09:36:19.329 INFO:tasks.workunit.client.1.smithi135.stdout:3/228: creat d4/d5/dc/f49 x:0 0 0 2024-09-10T09:36:19.329 INFO:tasks.workunit.client.1.smithi135.stdout:3/229: dread - d4/d5/db/f3a zero size 2024-09-10T09:36:19.332 INFO:tasks.workunit.client.1.smithi135.stdout:2/293: mknod df/d1b/c5a 0 2024-09-10T09:36:19.332 INFO:tasks.workunit.client.1.smithi135.stdout:2/294: read - df/d13/d52/f58 zero size 2024-09-10T09:36:19.332 INFO:tasks.workunit.client.1.smithi135.stdout:2/295: write df/d1b/f26 [4146780,36659] 0 2024-09-10T09:36:19.333 INFO:tasks.workunit.client.1.smithi135.stdout:2/296: fsync df/d15/f33 0 2024-09-10T09:36:19.333 INFO:tasks.workunit.client.1.smithi135.stdout:2/297: write df/f16 [1275383,92871] 0 2024-09-10T09:36:19.333 INFO:tasks.workunit.client.1.smithi135.stdout:2/298: write df/f16 [4349040,60274] 0 2024-09-10T09:36:19.333 INFO:tasks.workunit.client.1.smithi135.stdout:2/299: dread - df/d13/f44 zero size 2024-09-10T09:36:19.333 INFO:tasks.workunit.client.1.smithi135.stdout:8/304: symlink d1/d15/d49/d69/l6d 0 2024-09-10T09:36:19.334 INFO:tasks.workunit.client.1.smithi135.stdout:8/305: fsync d1/d13/f2f 0 2024-09-10T09:36:19.334 INFO:tasks.workunit.client.1.smithi135.stdout:0/349: dwrite f4 [0,4194304] 0 2024-09-10T09:36:19.336 INFO:tasks.workunit.client.1.smithi135.stdout:4/389: unlink d1/de/f3c 0 2024-09-10T09:36:19.339 INFO:tasks.workunit.client.1.smithi135.stdout:3/230: symlink d4/l4a 0 2024-09-10T09:36:19.340 INFO:tasks.workunit.client.1.smithi135.stdout:2/300: creat df/d1b/d27/d3d/f5b x:0 0 0 2024-09-10T09:36:19.340 INFO:tasks.workunit.client.1.smithi135.stdout:2/301: stat df/d1b/d23/c29 0 2024-09-10T09:36:19.341 INFO:tasks.workunit.client.1.smithi135.stdout:2/302: creat df/d1b/f5c x:0 0 0 2024-09-10T09:36:19.341 INFO:tasks.workunit.client.1.smithi135.stdout:2/303: write df/f10 [1536896,114211] 0 2024-09-10T09:36:19.343 INFO:tasks.workunit.client.1.smithi135.stdout:8/306: rename d1/d15/d16/d33/d45/f52 to d1/d13/f6e 0 2024-09-10T09:36:19.343 INFO:tasks.workunit.client.1.smithi135.stdout:8/307: truncate d1/d15/d24/f3f 630578 0 2024-09-10T09:36:19.363 INFO:tasks.workunit.client.1.smithi135.stdout:0/350: link d8/dd/d11/d17/l31 d8/dd/d4a/d50/l6d 0 2024-09-10T09:36:19.363 INFO:tasks.workunit.client.1.smithi135.stdout:0/351: creat d8/dd/d1e/f6e x:0 0 0 2024-09-10T09:36:19.363 INFO:tasks.workunit.client.1.smithi135.stdout:3/231: dwrite d4/d5/db/f3a [0,4194304] 0 2024-09-10T09:36:19.366 INFO:tasks.workunit.client.1.smithi135.stdout:4/390: mknod d1/d4a/d6d/c73 0 2024-09-10T09:36:19.366 INFO:tasks.workunit.client.1.smithi135.stdout:8/308: dwrite d1/f20 [0,4194304] 0 2024-09-10T09:36:19.366 INFO:tasks.workunit.client.1.smithi135.stdout:8/309: readlink d1/d15/d16/d33/d39/l62 0 2024-09-10T09:36:19.366 INFO:tasks.workunit.client.1.smithi135.stdout:4/391: fdatasync d1/de/d16/f69 0 2024-09-10T09:36:19.366 INFO:tasks.workunit.client.1.smithi135.stdout:8/310: write d1/d15/d16/f1a [1107775,106087] 0 2024-09-10T09:36:19.373 INFO:tasks.workunit.client.1.smithi135.stdout:2/304: rename df/d1b/f3e to df/d1b/d27/d3d/f5d 0 2024-09-10T09:36:19.380 INFO:tasks.workunit.client.1.smithi135.stdout:4/392: mknod d1/db/d9/d55/d70/c74 0 2024-09-10T09:36:19.382 INFO:tasks.workunit.client.1.smithi135.stdout:2/305: creat df/d13/d4f/f5e x:0 0 0 2024-09-10T09:36:19.382 INFO:tasks.workunit.client.1.smithi135.stdout:4/393: mknod d1/db/d9/d55/d70/c75 0 2024-09-10T09:36:19.383 INFO:tasks.workunit.client.1.smithi135.stdout:8/311: rmdir d1/d13 39 2024-09-10T09:36:19.388 INFO:tasks.workunit.client.1.smithi135.stdout:4/394: rmdir d1/db/d23/d37 0 2024-09-10T09:36:19.388 INFO:tasks.workunit.client.1.smithi135.stdout:4/395: mkdir d1/db/d9/d55/d76 0 2024-09-10T09:36:19.389 INFO:tasks.workunit.client.1.smithi135.stdout:4/396: creat d1/f77 x:0 0 0 2024-09-10T09:36:19.393 INFO:tasks.workunit.client.1.smithi135.stdout:0/352: dwrite d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:19.394 INFO:tasks.workunit.client.1.smithi135.stdout:3/232: dwrite d4/d5/db/d1b/d1f/f41 [0,4194304] 0 2024-09-10T09:36:19.394 INFO:tasks.workunit.client.1.smithi135.stdout:4/397: fdatasync d1/de/d16/f44 0 2024-09-10T09:36:19.394 INFO:tasks.workunit.client.1.smithi135.stdout:3/233: stat d4/d5/db/dd/c12 0 2024-09-10T09:36:19.394 INFO:tasks.workunit.client.1.smithi135.stdout:3/234: chown d4/d5/dc/l30 0 1 2024-09-10T09:36:19.403 INFO:tasks.workunit.client.1.smithi135.stdout:4/398: dread d1/db/d9/f38 [0,4194304] 0 2024-09-10T09:36:19.405 INFO:tasks.workunit.client.1.smithi135.stdout:3/235: dread d4/f3b [0,4194304] 0 2024-09-10T09:36:19.425 INFO:tasks.workunit.client.1.smithi135.stdout:4/399: dwrite d1/de/d16/f68 [0,4194304] 0 2024-09-10T09:36:19.461 INFO:tasks.workunit.client.1.smithi135.stdout:0/353: symlink d8/d1c/d61/l6f 0 2024-09-10T09:36:19.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/267: sync 2024-09-10T09:36:19.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/268: readlink d5/d1e/d35/l24 0 2024-09-10T09:36:19.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/269: truncate d5/f11 4372760 0 2024-09-10T09:36:19.474 INFO:tasks.workunit.client.1.smithi135.stdout:1/242: sync 2024-09-10T09:36:19.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/306: rename df/d1b/d27 to df/d1b/d23/d36/d5f 0 2024-09-10T09:36:19.498 INFO:tasks.workunit.client.1.smithi135.stdout:2/307: dwrite df/d13/d4f/f5e [0,4194304] 0 2024-09-10T09:36:19.501 INFO:tasks.workunit.client.1.smithi135.stdout:2/308: dread df/d13/f38 [0,4194304] 0 2024-09-10T09:36:19.518 INFO:tasks.workunit.client.1.smithi135.stdout:2/309: dwrite df/f10 [0,4194304] 0 2024-09-10T09:36:19.518 INFO:tasks.workunit.client.1.smithi135.stdout:2/310: creat df/d13/d52/f60 x:0 0 0 2024-09-10T09:36:19.535 INFO:tasks.workunit.client.1.smithi135.stdout:2/311: dwrite df/d1b/d23/d36/d5f/d3d/f5d [0,4194304] 0 2024-09-10T09:36:19.535 INFO:tasks.workunit.client.1.smithi135.stdout:2/312: dread - df/d13/d52/f60 zero size 2024-09-10T09:36:19.541 INFO:tasks.workunit.client.1.smithi135.stdout:6/270: truncate d5/d1e/d35/f30 1760666 0 2024-09-10T09:36:19.545 INFO:tasks.workunit.client.1.smithi135.stdout:1/243: rename d1d/d20/d24/f29 to d1d/d20/f46 0 2024-09-10T09:36:19.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/244: dwrite d1d/d20/d3c/f3d [0,4194304] 0 2024-09-10T09:36:19.567 INFO:tasks.workunit.client.1.smithi135.stdout:3/236: rmdir d4/d5 39 2024-09-10T09:36:19.580 INFO:tasks.workunit.client.1.smithi135.stdout:1/245: dwrite f1b [0,4194304] 0 2024-09-10T09:36:19.581 INFO:tasks.workunit.client.1.smithi135.stdout:6/271: mknod d5/d1e/c5d 0 2024-09-10T09:36:19.588 INFO:tasks.workunit.client.1.smithi135.stdout:2/313: rename df/d1b/d31/d4a/l50 to df/d1b/d23/l61 0 2024-09-10T09:36:19.588 INFO:tasks.workunit.client.1.smithi135.stdout:2/314: write df/d13/f44 [716843,42234] 0 2024-09-10T09:36:19.594 INFO:tasks.workunit.client.1.smithi135.stdout:3/237: rmdir d4/d5 39 2024-09-10T09:36:19.598 INFO:tasks.workunit.client.1.smithi135.stdout:3/238: dread d4/d5/db/d1b/d1f/f41 [0,4194304] 0 2024-09-10T09:36:19.598 INFO:tasks.workunit.client.1.smithi135.stdout:6/272: creat d5/d1e/d3b/d42/d2d/d55/d5b/f5e x:0 0 0 2024-09-10T09:36:19.602 INFO:tasks.workunit.client.1.smithi135.stdout:1/246: dwrite d1d/d20/d24/d2b/f3a [0,4194304] 0 2024-09-10T09:36:19.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/315: mknod df/d1b/d23/d36/d5f/d2c/c62 0 2024-09-10T09:36:19.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/316: write df/d13/d52/f58 [762732,22670] 0 2024-09-10T09:36:19.614 INFO:tasks.workunit.client.1.smithi135.stdout:3/239: rename d4/l4a to d4/d5/l4b 0 2024-09-10T09:36:19.614 INFO:tasks.workunit.client.1.smithi135.stdout:3/240: fsync d4/d5/dc/f19 0 2024-09-10T09:36:19.614 INFO:tasks.workunit.client.1.smithi135.stdout:3/241: fsync d4/f32 0 2024-09-10T09:36:19.614 INFO:tasks.workunit.client.1.smithi135.stdout:3/242: write d4/d5/db/f2f [538782,73133] 0 2024-09-10T09:36:19.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/273: dwrite d5/d1e/d3b/d42/d2d/f31 [0,4194304] 0 2024-09-10T09:36:19.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/274: write d5/ff [542320,22254] 0 2024-09-10T09:36:19.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/275: chown f4 25 1 2024-09-10T09:36:19.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/276: creat d5/d15/d27/f5f x:0 0 0 2024-09-10T09:36:19.618 INFO:tasks.workunit.client.1.smithi135.stdout:6/277: readlink d5/dd/l19 0 2024-09-10T09:36:19.630 INFO:tasks.workunit.client.1.smithi135.stdout:1/247: rename d1d/l3e to d1d/d20/d24/d2b/l47 0 2024-09-10T09:36:19.644 INFO:tasks.workunit.client.1.smithi135.stdout:2/317: dwrite df/d1b/f1c [0,4194304] 0 2024-09-10T09:36:19.644 INFO:tasks.workunit.client.1.smithi135.stdout:2/318: readlink df/d1b/l1e 0 2024-09-10T09:36:19.649 INFO:tasks.workunit.client.1.smithi135.stdout:3/243: dwrite f1 [8388608,4194304] 0 2024-09-10T09:36:19.649 INFO:tasks.workunit.client.1.smithi135.stdout:3/244: chown d4/d5/db/dd 1410572 1 2024-09-10T09:36:19.650 INFO:tasks.workunit.client.1.smithi135.stdout:6/278: dwrite d5/d15/d27/f52 [0,4194304] 0 2024-09-10T09:36:19.650 INFO:tasks.workunit.client.1.smithi135.stdout:6/279: chown d5/c40 9156 1 2024-09-10T09:36:19.650 INFO:tasks.workunit.client.1.smithi135.stdout:6/280: fdatasync d5/d1e/f28 0 2024-09-10T09:36:19.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/245: dread d4/f25 [0,4194304] 0 2024-09-10T09:36:19.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/246: write d4/d5/db/f3f [785521,27635] 0 2024-09-10T09:36:19.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/247: stat d4/d5/dc/f19 0 2024-09-10T09:36:19.673 INFO:tasks.workunit.client.1.smithi135.stdout:6/281: dwrite f4 [8388608,4194304] 0 2024-09-10T09:36:19.674 INFO:tasks.workunit.client.1.smithi135.stdout:3/248: dread d4/f9 [0,4194304] 0 2024-09-10T09:36:19.674 INFO:tasks.workunit.client.1.smithi135.stdout:1/248: dwrite d1d/f27 [0,4194304] 0 2024-09-10T09:36:19.677 INFO:tasks.workunit.client.1.smithi135.stdout:1/249: write d1d/f2c [582943,19905] 0 2024-09-10T09:36:19.677 INFO:tasks.workunit.client.1.smithi135.stdout:6/282: creat d5/f60 x:0 0 0 2024-09-10T09:36:19.680 INFO:tasks.workunit.client.1.smithi135.stdout:3/249: write d4/d5/dc/f17 [382447,108219] 0 2024-09-10T09:36:19.681 INFO:tasks.workunit.client.1.smithi135.stdout:1/250: truncate d1d/d20/d24/d2b/f36 965405 0 2024-09-10T09:36:19.682 INFO:tasks.workunit.client.1.smithi135.stdout:6/283: mknod d5/d1e/d3b/d42/d2d/d55/c61 0 2024-09-10T09:36:19.684 INFO:tasks.workunit.client.1.smithi135.stdout:3/250: unlink d4/d5/db/dd/f3d 0 2024-09-10T09:36:19.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/251: getdents d1d/d20/d24/d37 0 2024-09-10T09:36:19.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/252: rename d1d/d20/d3c to d1d/d20/d3c/d48 22 2024-09-10T09:36:19.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/253: chown d1d/l1f 1195593862 1 2024-09-10T09:36:19.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/254: write d1d/f45 [415586,39243] 0 2024-09-10T09:36:19.686 INFO:tasks.workunit.client.1.smithi135.stdout:6/284: mkdir d5/d1e/d62 0 2024-09-10T09:36:19.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/255: rmdir d1d/d20/d24 39 2024-09-10T09:36:19.696 INFO:tasks.workunit.client.1.smithi135.stdout:6/285: symlink d5/d1e/d3b/d42/d3c/d44/l63 0 2024-09-10T09:36:19.696 INFO:tasks.workunit.client.1.smithi135.stdout:6/286: stat d5/dd/d50/c53 0 2024-09-10T09:36:19.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/287: read d5/ff [277374,77779] 0 2024-09-10T09:36:19.698 INFO:tasks.workunit.client.1.smithi135.stdout:6/288: fdatasync d5/d15/f25 0 2024-09-10T09:36:19.698 INFO:tasks.workunit.client.1.smithi135.stdout:6/289: read d5/d1e/d3b/d42/f38 [1065881,64457] 0 2024-09-10T09:36:19.698 INFO:tasks.workunit.client.1.smithi135.stdout:1/256: truncate f11 760981 0 2024-09-10T09:36:19.698 INFO:tasks.workunit.client.1.smithi135.stdout:1/257: fsync d1d/d20/d24/d2b/f44 0 2024-09-10T09:36:19.699 INFO:tasks.workunit.client.1.smithi135.stdout:3/251: dwrite d4/f3b [4194304,4194304] 0 2024-09-10T09:36:19.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/258: dread d1d/f45 [0,4194304] 0 2024-09-10T09:36:19.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/259: readlink d1d/d20/d24/d2b/l33 0 2024-09-10T09:36:19.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/260: write d1d/f3f [6000560,107338] 0 2024-09-10T09:36:19.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/261: dread - d1d/d20/d24/d2b/f32 zero size 2024-09-10T09:36:19.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/262: dread - d1d/d20/f2e zero size 2024-09-10T09:36:19.707 INFO:tasks.workunit.client.1.smithi135.stdout:6/290: rmdir d5/d15 39 2024-09-10T09:36:19.709 INFO:tasks.workunit.client.1.smithi135.stdout:1/263: rmdir d1d/d20/d3c 39 2024-09-10T09:36:19.711 INFO:tasks.workunit.client.1.smithi135.stdout:6/291: getdents d5/dd 0 2024-09-10T09:36:19.711 INFO:tasks.workunit.client.1.smithi135.stdout:6/292: fdatasync d5/d1e/d35/f21 0 2024-09-10T09:36:19.718 INFO:tasks.workunit.client.1.smithi135.stdout:3/252: dwrite d4/d5/dc/f19 [8388608,4194304] 0 2024-09-10T09:36:19.718 INFO:tasks.workunit.client.1.smithi135.stdout:3/253: fsync d4/d5/db/d1b/d1f/f41 0 2024-09-10T09:36:19.730 INFO:tasks.workunit.client.1.smithi135.stdout:3/254: link d4/d5/db/d36/d43/f46 d4/d5/db/f4c 0 2024-09-10T09:36:19.730 INFO:tasks.workunit.client.1.smithi135.stdout:3/255: creat d4/f4d x:0 0 0 2024-09-10T09:36:19.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/256: dwrite d4/d5/db/d1b/d1f/f41 [4194304,4194304] 0 2024-09-10T09:36:19.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/257: stat d4/d5/db/f4c 0 2024-09-10T09:36:19.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/258: dread - d4/d5/db/f4c zero size 2024-09-10T09:36:19.747 INFO:tasks.workunit.client.1.smithi135.stdout:3/259: rmdir d4/d5/db/d36/d43 39 2024-09-10T09:36:19.754 INFO:tasks.workunit.client.1.smithi135.stdout:6/293: rmdir d5/d1e/d3b/d42/d2d/d55/d5b 39 2024-09-10T09:36:19.754 INFO:tasks.workunit.client.1.smithi135.stdout:6/294: readlink d5/d15/d27/l36 0 2024-09-10T09:36:19.755 INFO:tasks.workunit.client.1.smithi135.stdout:6/295: mkdir d5/d1e/d3b/d42/d2d/d64 0 2024-09-10T09:36:19.755 INFO:tasks.workunit.client.1.smithi135.stdout:6/296: dread - d5/d1e/d3b/d42/d2d/d55/d5b/f5e zero size 2024-09-10T09:36:19.766 INFO:tasks.workunit.client.1.smithi135.stdout:6/297: dread d5/f6 [0,4194304] 0 2024-09-10T09:36:19.768 INFO:tasks.workunit.client.1.smithi135.stdout:6/298: mkdir d5/d1e/d35/d65 0 2024-09-10T09:36:19.771 INFO:tasks.workunit.client.1.smithi135.stdout:6/299: truncate d5/d1e/d3b/d42/f2e 3358601 0 2024-09-10T09:36:19.789 INFO:tasks.workunit.client.1.smithi135.stdout:3/260: truncate d4/d5/db/f3f 375389 0 2024-09-10T09:36:19.792 INFO:tasks.workunit.client.1.smithi135.stdout:0/354: creat d8/f70 x:0 0 0 2024-09-10T09:36:19.793 INFO:tasks.workunit.client.1.smithi135.stdout:0/355: unlink d8/d1c/f3e 0 2024-09-10T09:36:19.800 INFO:tasks.workunit.client.1.smithi135.stdout:0/356: dread d8/dd/d11/f1f [0,4194304] 0 2024-09-10T09:36:19.806 INFO:tasks.workunit.client.1.smithi135.stdout:3/261: dwrite d4/d5/db/f4c [0,4194304] 0 2024-09-10T09:36:19.815 INFO:tasks.workunit.client.1.smithi135.stdout:3/262: write d4/d5/dc/f10 [3558656,90678] 0 2024-09-10T09:36:19.822 INFO:tasks.workunit.client.1.smithi135.stdout:0/357: dwrite d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:36:19.831 INFO:tasks.workunit.client.1.smithi135.stdout:3/263: dwrite d4/d5/f39 [0,4194304] 0 2024-09-10T09:36:19.841 INFO:tasks.workunit.client.1.smithi135.stdout:2/319: rmdir df/d1b 39 2024-09-10T09:36:19.847 INFO:tasks.workunit.client.1.smithi135.stdout:0/358: dwrite d8/dd/d11/f46 [4194304,4194304] 0 2024-09-10T09:36:19.847 INFO:tasks.workunit.client.1.smithi135.stdout:0/359: fsync d8/dd/d1e/f23 0 2024-09-10T09:36:19.847 INFO:tasks.workunit.client.1.smithi135.stdout:3/264: dwrite d4/f3b [4194304,4194304] 0 2024-09-10T09:36:19.847 INFO:tasks.workunit.client.1.smithi135.stdout:3/265: read d4/d5/dc/f17 [3598804,121150] 0 2024-09-10T09:36:19.847 INFO:tasks.workunit.client.1.smithi135.stdout:3/266: chown d4/d5/dc/f49 0 1 2024-09-10T09:36:19.848 INFO:tasks.workunit.client.1.smithi135.stdout:0/360: rmdir d8/dd/d4a/d50/d54 39 2024-09-10T09:36:19.850 INFO:tasks.workunit.client.1.smithi135.stdout:3/267: creat d4/d5/db/d44/f4e x:0 0 0 2024-09-10T09:36:19.853 INFO:tasks.workunit.client.1.smithi135.stdout:0/361: creat d8/dd/d4a/d50/d67/f71 x:0 0 0 2024-09-10T09:36:19.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/362: dwrite d8/fc [0,4194304] 0 2024-09-10T09:36:19.880 INFO:tasks.workunit.client.1.smithi135.stdout:0/363: dread - d8/de/f68 zero size 2024-09-10T09:36:19.880 INFO:tasks.workunit.client.1.smithi135.stdout:0/364: dread - d8/de/f68 zero size 2024-09-10T09:36:19.883 INFO:tasks.workunit.client.1.smithi135.stdout:3/268: dwrite d4/d5/db/d44/f4e [0,4194304] 0 2024-09-10T09:36:19.884 INFO:tasks.workunit.client.1.smithi135.stdout:0/365: mknod d8/dd/c72 0 2024-09-10T09:36:19.892 INFO:tasks.workunit.client.1.smithi135.stdout:0/366: rmdir d8/dd/d18/d3d 39 2024-09-10T09:36:19.899 INFO:tasks.workunit.client.1.smithi135.stdout:3/269: rename d4/d5/db/c11 to d4/d5/dc/c4f 0 2024-09-10T09:36:19.902 INFO:tasks.workunit.client.1.smithi135.stdout:3/270: creat d4/d5/dc/f50 x:0 0 0 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:5/202: sync 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/264: sync 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:9/259: sync 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:4/400: sync 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:4/401: dread - d1/de/f59 zero size 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:8/312: sync 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/265: dread d2/d11/f27 [0,4194304] 0 2024-09-10T09:36:19.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/266: stat d2/d15/f2f 0 2024-09-10T09:36:19.910 INFO:tasks.workunit.client.1.smithi135.stdout:5/203: unlink d3/dc/d17/d22/l29 0 2024-09-10T09:36:19.910 INFO:tasks.workunit.client.1.smithi135.stdout:0/367: dwrite d8/dd/f35 [0,4194304] 0 2024-09-10T09:36:19.913 INFO:tasks.workunit.client.1.smithi135.stdout:4/402: unlink d1/d33/d40/l50 0 2024-09-10T09:36:19.913 INFO:tasks.workunit.client.1.smithi135.stdout:4/403: chown d1/de/d16/f67 206275115 1 2024-09-10T09:36:19.914 INFO:tasks.workunit.client.1.smithi135.stdout:9/260: getdents de 0 2024-09-10T09:36:19.914 INFO:tasks.workunit.client.1.smithi135.stdout:9/261: chown de/c45 16550023 1 2024-09-10T09:36:19.917 INFO:tasks.workunit.client.1.smithi135.stdout:7/267: symlink d2/d15/d41/l58 0 2024-09-10T09:36:19.919 INFO:tasks.workunit.client.1.smithi135.stdout:5/204: rename d3/dc/d17/d22/f36 to d3/d26/f3b 0 2024-09-10T09:36:19.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/313: getdents d1/d15/d16/d33/d39 0 2024-09-10T09:36:19.926 INFO:tasks.workunit.client.1.smithi135.stdout:5/205: creat d3/d26/f3c x:0 0 0 2024-09-10T09:36:19.933 INFO:tasks.workunit.client.1.smithi135.stdout:8/314: mkdir d1/d15/d16/d33/d45/d6f 0 2024-09-10T09:36:19.933 INFO:tasks.workunit.client.1.smithi135.stdout:9/262: dread de/f21 [4194304,4194304] 0 2024-09-10T09:36:19.934 INFO:tasks.workunit.client.1.smithi135.stdout:8/315: mkdir d1/d15/d16/d33/d45/d70 0 2024-09-10T09:36:19.939 INFO:tasks.workunit.client.1.smithi135.stdout:9/263: creat de/df/d1d/d1e/d3f/f58 x:0 0 0 2024-09-10T09:36:19.946 INFO:tasks.workunit.client.1.smithi135.stdout:9/264: symlink de/df/d1d/d23/d25/d28/l59 0 2024-09-10T09:36:19.947 INFO:tasks.workunit.client.1.smithi135.stdout:9/265: dread - de/df/d1d/d23/f57 zero size 2024-09-10T09:36:19.947 INFO:tasks.workunit.client.1.smithi135.stdout:9/266: creat de/df/f5a x:0 0 0 2024-09-10T09:36:19.953 INFO:tasks.workunit.client.1.smithi135.stdout:9/267: creat de/df/d1d/d23/d25/f5b x:0 0 0 2024-09-10T09:36:19.956 INFO:tasks.workunit.client.1.smithi135.stdout:9/268: unlink de/df/d1d/f34 0 2024-09-10T09:36:19.956 INFO:tasks.workunit.client.1.smithi135.stdout:9/269: getdents de 0 2024-09-10T09:36:19.957 INFO:tasks.workunit.client.1.smithi135.stdout:9/270: dread de/df/f1b [0,4194304] 0 2024-09-10T09:36:19.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:19 smithi079 ceph-mon[27592]: pgmap v264: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 184 MiB/s rd, 212 MiB/s wr, 344 op/s 2024-09-10T09:36:19.965 INFO:tasks.workunit.client.1.smithi135.stdout:3/271: getdents d4/d5/db 0 2024-09-10T09:36:19.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:19 smithi135 ceph-mon[33411]: pgmap v264: 65 pgs: 65 active+clean; 2.4 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 184 MiB/s rd, 212 MiB/s wr, 344 op/s 2024-09-10T09:36:19.967 INFO:tasks.workunit.client.1.smithi135.stdout:4/404: dwrite d1/db/f54 [4194304,4194304] 0 2024-09-10T09:36:19.968 INFO:tasks.workunit.client.1.smithi135.stdout:4/405: creat d1/de/d16/f78 x:0 0 0 2024-09-10T09:36:19.968 INFO:tasks.workunit.client.1.smithi135.stdout:3/272: getdents d4/d5/db/d36/d43 0 2024-09-10T09:36:19.968 INFO:tasks.workunit.client.1.smithi135.stdout:3/273: chown d4/f4d 4032 1 2024-09-10T09:36:19.972 INFO:tasks.workunit.client.1.smithi135.stdout:8/316: dwrite d1/f25 [0,4194304] 0 2024-09-10T09:36:19.976 INFO:tasks.workunit.client.1.smithi135.stdout:5/206: dwrite f2 [0,4194304] 0 2024-09-10T09:36:19.976 INFO:tasks.workunit.client.1.smithi135.stdout:7/268: dwrite d2/d25/f2a [0,4194304] 0 2024-09-10T09:36:19.977 INFO:tasks.workunit.client.1.smithi135.stdout:7/269: chown d2/d25 186 1 2024-09-10T09:36:19.977 INFO:tasks.workunit.client.1.smithi135.stdout:4/406: stat d1/l1f 0 2024-09-10T09:36:19.978 INFO:tasks.workunit.client.1.smithi135.stdout:9/271: dwrite f9 [0,4194304] 0 2024-09-10T09:36:19.978 INFO:tasks.workunit.client.1.smithi135.stdout:9/272: truncate de/f4a 97355 0 2024-09-10T09:36:19.978 INFO:tasks.workunit.client.1.smithi135.stdout:9/273: getdents de 0 2024-09-10T09:36:19.980 INFO:tasks.workunit.client.1.smithi135.stdout:8/317: mkdir d1/d15/d16/d71 0 2024-09-10T09:36:19.980 INFO:tasks.workunit.client.1.smithi135.stdout:4/407: dread d1/db/d23/f3e [0,4194304] 0 2024-09-10T09:36:19.998 INFO:tasks.workunit.client.1.smithi135.stdout:7/270: chown d2/d25/l3b 34792 1 2024-09-10T09:36:20.002 INFO:tasks.workunit.client.1.smithi135.stdout:9/274: unlink de/df/d1d/d23/d25/c30 0 2024-09-10T09:36:20.005 INFO:tasks.workunit.client.1.smithi135.stdout:8/318: symlink d1/l72 0 2024-09-10T09:36:20.007 INFO:tasks.workunit.client.1.smithi135.stdout:4/408: mknod d1/db/c79 0 2024-09-10T09:36:20.014 INFO:tasks.workunit.client.1.smithi135.stdout:5/207: symlink d3/dc/l3d 0 2024-09-10T09:36:20.014 INFO:tasks.workunit.client.1.smithi135.stdout:5/208: creat d3/f3e x:0 0 0 2024-09-10T09:36:20.015 INFO:tasks.workunit.client.1.smithi135.stdout:7/271: creat d2/d15/d4a/d36/f59 x:0 0 0 2024-09-10T09:36:20.020 INFO:tasks.workunit.client.1.smithi135.stdout:5/209: dread d3/dc/d16/f19 [0,4194304] 0 2024-09-10T09:36:20.021 INFO:tasks.workunit.client.1.smithi135.stdout:9/275: mkdir de/df/d1d/d23/d25/d5c 0 2024-09-10T09:36:20.023 INFO:tasks.workunit.client.1.smithi135.stdout:8/319: symlink d1/d15/d63/l73 0 2024-09-10T09:36:20.023 INFO:tasks.workunit.client.1.smithi135.stdout:8/320: truncate d1/d27/f68 482217 0 2024-09-10T09:36:20.027 INFO:tasks.workunit.client.1.smithi135.stdout:5/210: symlink d3/dc/d17/d22/l3f 0 2024-09-10T09:36:20.029 INFO:tasks.workunit.client.1.smithi135.stdout:9/276: mknod de/df/d1d/d23/d25/c5d 0 2024-09-10T09:36:20.029 INFO:tasks.workunit.client.1.smithi135.stdout:9/277: getdents de/df/d1d/d23/d25/d5c 0 2024-09-10T09:36:20.029 INFO:tasks.workunit.client.1.smithi135.stdout:9/278: write de/df/d1d/d23/d25/f5b [326927,127496] 0 2024-09-10T09:36:20.031 INFO:tasks.workunit.client.1.smithi135.stdout:5/211: mkdir d3/d26/d40 0 2024-09-10T09:36:20.032 INFO:tasks.workunit.client.1.smithi135.stdout:9/279: rename de/df/d1d/d23/d25/c5d to de/df/d1d/d23/d25/d28/d4e/c5e 0 2024-09-10T09:36:20.032 INFO:tasks.workunit.client.1.smithi135.stdout:9/280: fdatasync de/df/f10 0 2024-09-10T09:36:20.037 INFO:tasks.workunit.client.1.smithi135.stdout:9/281: truncate de/df/f10 1627097 0 2024-09-10T09:36:20.040 INFO:tasks.workunit.client.1.smithi135.stdout:8/321: write d1/f25 [3755751,75428] 0 2024-09-10T09:36:20.040 INFO:tasks.workunit.client.1.smithi135.stdout:8/322: chown d1/d13/l58 369914293 1 2024-09-10T09:36:20.041 INFO:tasks.workunit.client.1.smithi135.stdout:8/323: mknod d1/d15/d16/d33/d39/c74 0 2024-09-10T09:36:20.041 INFO:tasks.workunit.client.1.smithi135.stdout:8/324: creat d1/d15/d16/f75 x:0 0 0 2024-09-10T09:36:20.048 INFO:tasks.workunit.client.1.smithi135.stdout:7/272: dwrite d2/f10 [0,4194304] 0 2024-09-10T09:36:20.050 INFO:tasks.workunit.client.1.smithi135.stdout:4/409: dwrite d1/de/d16/f44 [0,4194304] 0 2024-09-10T09:36:20.050 INFO:tasks.workunit.client.1.smithi135.stdout:8/325: fdatasync d1/f25 0 2024-09-10T09:36:20.053 INFO:tasks.workunit.client.1.smithi135.stdout:8/326: mkdir d1/d15/d16/d33/d76 0 2024-09-10T09:36:20.053 INFO:tasks.workunit.client.1.smithi135.stdout:8/327: truncate d1/d15/d16/f1a 2237996 0 2024-09-10T09:36:20.056 INFO:tasks.workunit.client.1.smithi135.stdout:5/212: dwrite d3/f3e [0,4194304] 0 2024-09-10T09:36:20.068 INFO:tasks.workunit.client.1.smithi135.stdout:5/213: rename d3/d26/d40 to d3/dc/d16/d41 0 2024-09-10T09:36:20.077 INFO:tasks.workunit.client.1.smithi135.stdout:5/214: mknod d3/dc/d17/c42 0 2024-09-10T09:36:20.077 INFO:tasks.workunit.client.1.smithi135.stdout:5/215: creat d3/dc/d16/f43 x:0 0 0 2024-09-10T09:36:20.077 INFO:tasks.workunit.client.1.smithi135.stdout:5/216: dread - d3/dc/f37 zero size 2024-09-10T09:36:20.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/217: rename d3/dc/d17 to d3/d44 0 2024-09-10T09:36:20.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/218: chown d3/f5 190019 1 2024-09-10T09:36:20.092 INFO:tasks.workunit.client.1.smithi135.stdout:5/219: stat d3/dc/d16 0 2024-09-10T09:36:20.104 INFO:tasks.workunit.client.1.smithi135.stdout:5/220: write f2 [3334878,12723] 0 2024-09-10T09:36:20.104 INFO:tasks.workunit.client.1.smithi135.stdout:5/221: write d3/dc/d16/f2c [669698,49771] 0 2024-09-10T09:36:20.114 INFO:tasks.workunit.client.1.smithi135.stdout:5/222: dread d3/d44/f35 [0,4194304] 0 2024-09-10T09:36:20.114 INFO:tasks.workunit.client.1.smithi135.stdout:5/223: dread - d3/d26/f3b zero size 2024-09-10T09:36:20.135 INFO:tasks.workunit.client.1.smithi135.stdout:5/224: dwrite d3/d44/f30 [0,4194304] 0 2024-09-10T09:36:20.143 INFO:tasks.workunit.client.1.smithi135.stdout:5/225: truncate d3/d44/f30 88840 0 2024-09-10T09:36:20.143 INFO:tasks.workunit.client.1.smithi135.stdout:5/226: creat d3/dc/d16/f45 x:0 0 0 2024-09-10T09:36:20.152 INFO:tasks.workunit.client.1.smithi135.stdout:5/227: read d3/d44/f30 [13973,42645] 0 2024-09-10T09:36:20.181 INFO:tasks.workunit.client.1.smithi135.stdout:5/228: dwrite d3/dc/d16/f45 [0,4194304] 0 2024-09-10T09:36:20.186 INFO:tasks.workunit.client.1.smithi135.stdout:5/229: rename d3/dc/l1f to d3/d26/l46 0 2024-09-10T09:36:20.191 INFO:tasks.workunit.client.1.smithi135.stdout:5/230: write d3/d44/f35 [4180702,119746] 0 2024-09-10T09:36:20.194 INFO:tasks.workunit.client.1.smithi135.stdout:5/231: rename d3/d44/c24 to d3/c47 0 2024-09-10T09:36:20.200 INFO:tasks.workunit.client.1.smithi135.stdout:5/232: rmdir d3 39 2024-09-10T09:36:20.200 INFO:tasks.workunit.client.1.smithi135.stdout:5/233: fsync d3/dc/f37 0 2024-09-10T09:36:20.203 INFO:tasks.workunit.client.1.smithi135.stdout:5/234: mkdir d3/d26/d48 0 2024-09-10T09:36:20.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/235: symlink d3/d26/l49 0 2024-09-10T09:36:20.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/236: chown d3/dc/l3d 531 1 2024-09-10T09:36:20.205 INFO:tasks.workunit.client.1.smithi135.stdout:5/237: write d3/f18 [232057,12527] 0 2024-09-10T09:36:20.207 INFO:tasks.workunit.client.1.smithi135.stdout:5/238: rename d3/c2b to d3/dc/d16/d41/c4a 0 2024-09-10T09:36:20.210 INFO:tasks.workunit.client.1.smithi135.stdout:5/239: rename d3/f3e to d3/d26/f4b 0 2024-09-10T09:36:20.212 INFO:tasks.workunit.client.1.smithi135.stdout:5/240: creat d3/d44/f4c x:0 0 0 2024-09-10T09:36:20.212 INFO:tasks.workunit.client.1.smithi135.stdout:5/241: chown d3/d44/d22/f2f 0 1 2024-09-10T09:36:20.214 INFO:tasks.workunit.client.1.smithi135.stdout:5/242: truncate d3/d44/d22/f2f 3791159 0 2024-09-10T09:36:20.217 INFO:tasks.workunit.client.1.smithi135.stdout:5/243: unlink d3/d44/l33 0 2024-09-10T09:36:20.217 INFO:tasks.workunit.client.1.smithi135.stdout:5/244: write d3/d44/f30 [714996,19713] 0 2024-09-10T09:36:20.220 INFO:tasks.workunit.client.1.smithi135.stdout:5/245: mknod d3/d26/d48/c4d 0 2024-09-10T09:36:20.220 INFO:tasks.workunit.client.1.smithi135.stdout:5/246: stat d3/d44/d22/f2f 0 2024-09-10T09:36:20.475 INFO:tasks.workunit.client.1.smithi135.stdout:1/264: sync 2024-09-10T09:36:20.475 INFO:tasks.workunit.client.1.smithi135.stdout:1/265: fdatasync d1d/d20/d24/d2b/f32 0 2024-09-10T09:36:20.475 INFO:tasks.workunit.client.1.smithi135.stdout:1/266: readlink d1d/d20/d24/d2b/l47 0 2024-09-10T09:36:20.475 INFO:tasks.workunit.client.1.smithi135.stdout:1/267: dread - d1d/d20/f31 zero size 2024-09-10T09:36:20.477 INFO:tasks.workunit.client.1.smithi135.stdout:1/268: mknod d1d/d20/c49 0 2024-09-10T09:36:20.478 INFO:tasks.workunit.client.1.smithi135.stdout:1/269: symlink d1d/d20/d3c/l4a 0 2024-09-10T09:36:20.478 INFO:tasks.workunit.client.1.smithi135.stdout:1/270: stat f4 0 2024-09-10T09:36:20.504 INFO:tasks.workunit.client.1.smithi135.stdout:1/271: dwrite d1d/d20/f30 [0,4194304] 0 2024-09-10T09:36:20.529 INFO:tasks.workunit.client.1.smithi135.stdout:1/272: mkdir d1d/d28/d4b 0 2024-09-10T09:36:20.530 INFO:tasks.workunit.client.1.smithi135.stdout:1/273: mkdir d1d/d20/d24/d2b/d4c 0 2024-09-10T09:36:20.549 INFO:tasks.workunit.client.1.smithi135.stdout:1/274: dwrite d1d/f22 [0,4194304] 0 2024-09-10T09:36:20.555 INFO:tasks.workunit.client.1.smithi135.stdout:1/275: rmdir d1d 39 2024-09-10T09:36:20.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/276: creat d1d/d20/d24/f4d x:0 0 0 2024-09-10T09:36:20.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/277: write f11 [908517,107772] 0 2024-09-10T09:36:20.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/278: truncate d1d/f2a 50594 0 2024-09-10T09:36:20.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/279: chown d1d/d20/d24/d2b/f44 20667015 1 2024-09-10T09:36:20.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/280: chown d1d/d20/d3c 241716195 1 2024-09-10T09:36:20.561 INFO:tasks.workunit.client.1.smithi135.stdout:1/281: truncate d1d/d20/f46 1914294 0 2024-09-10T09:36:20.563 INFO:tasks.workunit.client.1.smithi135.stdout:1/282: mkdir d1d/d20/d3c/d4e 0 2024-09-10T09:36:20.586 INFO:tasks.workunit.client.1.smithi135.stdout:6/300: sync 2024-09-10T09:36:20.605 INFO:tasks.workunit.client.1.smithi135.stdout:6/301: mknod d5/d1e/c66 0 2024-09-10T09:36:20.605 INFO:tasks.workunit.client.1.smithi135.stdout:6/302: write d5/d1e/d35/f4b [339577,42224] 0 2024-09-10T09:36:20.613 INFO:tasks.workunit.client.1.smithi135.stdout:6/303: dread d5/d15/d27/f3d [0,4194304] 0 2024-09-10T09:36:20.621 INFO:tasks.workunit.client.1.smithi135.stdout:6/304: write f4 [3972180,84899] 0 2024-09-10T09:36:20.624 INFO:tasks.workunit.client.1.smithi135.stdout:6/305: getdents d5/d1e/d3b/d42/d2d 0 2024-09-10T09:36:20.626 INFO:tasks.workunit.client.1.smithi135.stdout:6/306: creat d5/d1e/f67 x:0 0 0 2024-09-10T09:36:20.626 INFO:tasks.workunit.client.1.smithi135.stdout:6/307: write d5/d15/d27/f5f [771720,67841] 0 2024-09-10T09:36:20.644 INFO:tasks.workunit.client.1.smithi135.stdout:6/308: dwrite d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:20.646 INFO:tasks.workunit.client.1.smithi135.stdout:6/309: truncate d5/d1e/d35/f30 981344 0 2024-09-10T09:36:20.646 INFO:tasks.workunit.client.1.smithi135.stdout:6/310: fdatasync d5/d1e/d3b/d42/d2d/d55/d5b/f5e 0 2024-09-10T09:36:20.647 INFO:tasks.workunit.client.1.smithi135.stdout:6/311: mkdir d5/dd/d50/d54/d68 0 2024-09-10T09:36:20.647 INFO:tasks.workunit.client.1.smithi135.stdout:6/312: chown d5/c40 0 1 2024-09-10T09:36:20.648 INFO:tasks.workunit.client.1.smithi135.stdout:6/313: mknod d5/dd/d50/d54/d68/c69 0 2024-09-10T09:36:20.648 INFO:tasks.workunit.client.1.smithi135.stdout:6/314: chown d5/d1e/d3b/d42/d2d/d55/d5b 120984 1 2024-09-10T09:36:20.656 INFO:tasks.workunit.client.1.smithi135.stdout:6/315: write d5/d1e/d3b/d42/d2d/f31 [3047066,79505] 0 2024-09-10T09:36:20.656 INFO:tasks.workunit.client.1.smithi135.stdout:6/316: readlink d5/d1e/d35/l24 0 2024-09-10T09:36:20.659 INFO:tasks.workunit.client.1.smithi135.stdout:6/317: creat d5/dd/d50/d57/f6a x:0 0 0 2024-09-10T09:36:20.659 INFO:tasks.workunit.client.1.smithi135.stdout:6/318: dread - d5/f60 zero size 2024-09-10T09:36:20.661 INFO:tasks.workunit.client.1.smithi135.stdout:6/319: read d5/d1e/d35/f30 [790363,21102] 0 2024-09-10T09:36:20.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/320: dread d5/d15/f1c [0,4194304] 0 2024-09-10T09:36:20.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/321: creat d5/f6b x:0 0 0 2024-09-10T09:36:20.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/322: write d5/d15/f22 [5271735,48978] 0 2024-09-10T09:36:20.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/323: stat d5/d1e/l4e 0 2024-09-10T09:36:20.675 INFO:tasks.workunit.client.1.smithi135.stdout:0/368: sync 2024-09-10T09:36:20.675 INFO:tasks.workunit.client.1.smithi135.stdout:3/274: sync 2024-09-10T09:36:20.675 INFO:tasks.workunit.client.1.smithi135.stdout:2/320: sync 2024-09-10T09:36:20.675 INFO:tasks.workunit.client.1.smithi135.stdout:3/275: write f3 [3629094,103712] 0 2024-09-10T09:36:20.675 INFO:tasks.workunit.client.1.smithi135.stdout:3/276: fsync f1 0 2024-09-10T09:36:20.677 INFO:tasks.workunit.client.1.smithi135.stdout:6/324: read d5/d15/d27/f52 [324827,108671] 0 2024-09-10T09:36:20.677 INFO:tasks.workunit.client.1.smithi135.stdout:6/325: fsync d5/f17 0 2024-09-10T09:36:20.677 INFO:tasks.workunit.client.1.smithi135.stdout:0/369: mkdir d8/d1c/d37/d73 0 2024-09-10T09:36:20.677 INFO:tasks.workunit.client.1.smithi135.stdout:0/370: dread - d8/d1c/d37/f65 zero size 2024-09-10T09:36:20.678 INFO:tasks.workunit.client.1.smithi135.stdout:0/371: creat d8/d1c/d61/f74 x:0 0 0 2024-09-10T09:36:20.682 INFO:tasks.workunit.client.1.smithi135.stdout:6/326: symlink d5/d15/d27/l6c 0 2024-09-10T09:36:20.682 INFO:tasks.workunit.client.1.smithi135.stdout:6/327: stat d5/d1e/d3b/d42/d3c/d44 0 2024-09-10T09:36:20.682 INFO:tasks.workunit.client.1.smithi135.stdout:6/328: stat d5/d1e/d62 0 2024-09-10T09:36:20.683 INFO:tasks.workunit.client.1.smithi135.stdout:6/329: read f4 [3335324,88855] 0 2024-09-10T09:36:20.683 INFO:tasks.workunit.client.1.smithi135.stdout:6/330: fdatasync d5/d1e/d35/f30 0 2024-09-10T09:36:20.686 INFO:tasks.workunit.client.1.smithi135.stdout:0/372: rename d8/dd/d4a/d50/d54/f62 to d8/dd/d4a/d50/d54/d5f/d4b/f75 0 2024-09-10T09:36:20.689 INFO:tasks.workunit.client.1.smithi135.stdout:2/321: rmdir df/d1b/d31/d4a 0 2024-09-10T09:36:20.690 INFO:tasks.workunit.client.1.smithi135.stdout:3/277: dwrite d4/d5/db/f3f [0,4194304] 0 2024-09-10T09:36:20.690 INFO:tasks.workunit.client.1.smithi135.stdout:3/278: readlink d4/d5/l4b 0 2024-09-10T09:36:20.691 INFO:tasks.workunit.client.1.smithi135.stdout:6/331: mkdir d5/d1e/d3b/d6d 0 2024-09-10T09:36:20.691 INFO:tasks.workunit.client.1.smithi135.stdout:6/332: fdatasync d5/d1e/d3b/d42/d2d/d55/d5b/f5e 0 2024-09-10T09:36:20.692 INFO:tasks.workunit.client.1.smithi135.stdout:0/373: symlink d8/dd/d33/l76 0 2024-09-10T09:36:20.693 INFO:tasks.workunit.client.1.smithi135.stdout:2/322: getdents df/d1b/d23/d42 0 2024-09-10T09:36:20.708 INFO:tasks.workunit.client.1.smithi135.stdout:0/374: dread f4 [0,4194304] 0 2024-09-10T09:36:20.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/279: mkdir d4/d5/d51 0 2024-09-10T09:36:20.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/280: chown d4/d5/dc/f17 2137 1 2024-09-10T09:36:20.708 INFO:tasks.workunit.client.1.smithi135.stdout:3/281: stat d4/d5/db/d1b/d1f/c33 0 2024-09-10T09:36:20.712 INFO:tasks.workunit.client.1.smithi135.stdout:6/333: rename d5/d15/d27/f5f to d5/dd/f6e 0 2024-09-10T09:36:20.712 INFO:tasks.workunit.client.1.smithi135.stdout:6/334: chown d5/d15/f25 62847535 1 2024-09-10T09:36:20.712 INFO:tasks.workunit.client.1.smithi135.stdout:6/335: getdents d5/d58 0 2024-09-10T09:36:20.716 INFO:tasks.workunit.client.1.smithi135.stdout:0/375: creat d8/dd/f77 x:0 0 0 2024-09-10T09:36:20.718 INFO:tasks.workunit.client.1.smithi135.stdout:3/282: creat d4/d5/db/d36/d43/f52 x:0 0 0 2024-09-10T09:36:20.720 INFO:tasks.workunit.client.1.smithi135.stdout:6/336: symlink d5/d58/l6f 0 2024-09-10T09:36:20.722 INFO:tasks.workunit.client.1.smithi135.stdout:0/376: link d8/l47 d8/d1c/l78 0 2024-09-10T09:36:20.722 INFO:tasks.workunit.client.1.smithi135.stdout:0/377: dread - d8/f70 zero size 2024-09-10T09:36:20.722 INFO:tasks.workunit.client.1.smithi135.stdout:0/378: chown d8/de 1 1 2024-09-10T09:36:20.722 INFO:tasks.workunit.client.1.smithi135.stdout:2/323: dwrite df/f3b [0,4194304] 0 2024-09-10T09:36:20.722 INFO:tasks.workunit.client.1.smithi135.stdout:2/324: chown df/d1b/c5a 105236 1 2024-09-10T09:36:20.722 INFO:tasks.workunit.client.1.smithi135.stdout:2/325: chown df/d13/f44 59407865 1 2024-09-10T09:36:20.722 INFO:tasks.workunit.client.1.smithi135.stdout:2/326: write df/d1b/d23/f48 [4584538,9546] 0 2024-09-10T09:36:20.723 INFO:tasks.workunit.client.1.smithi135.stdout:4/410: sync 2024-09-10T09:36:20.723 INFO:tasks.workunit.client.1.smithi135.stdout:7/273: sync 2024-09-10T09:36:20.723 INFO:tasks.workunit.client.1.smithi135.stdout:9/282: sync 2024-09-10T09:36:20.723 INFO:tasks.workunit.client.1.smithi135.stdout:8/328: sync 2024-09-10T09:36:20.723 INFO:tasks.workunit.client.1.smithi135.stdout:9/283: dread - de/df/d1d/f41 zero size 2024-09-10T09:36:20.723 INFO:tasks.workunit.client.1.smithi135.stdout:5/247: sync 2024-09-10T09:36:20.723 INFO:tasks.workunit.client.1.smithi135.stdout:3/283: rename f3 to d4/d5/db/d36/f53 0 2024-09-10T09:36:20.726 INFO:tasks.workunit.client.1.smithi135.stdout:6/337: dread d5/d1e/d3b/d42/f38 [0,4194304] 0 2024-09-10T09:36:20.726 INFO:tasks.workunit.client.1.smithi135.stdout:6/338: write d5/d1e/d35/f3a [243844,53524] 0 2024-09-10T09:36:20.726 INFO:tasks.workunit.client.1.smithi135.stdout:6/339: chown d5 11306 1 2024-09-10T09:36:20.728 INFO:tasks.workunit.client.1.smithi135.stdout:0/379: creat d8/dd/d4a/f79 x:0 0 0 2024-09-10T09:36:20.730 INFO:tasks.workunit.client.1.smithi135.stdout:2/327: dread df/d15/f24 [0,4194304] 0 2024-09-10T09:36:20.733 INFO:tasks.workunit.client.1.smithi135.stdout:3/284: dread d4/d5/db/d44/f4e [0,4194304] 0 2024-09-10T09:36:20.734 INFO:tasks.workunit.client.1.smithi135.stdout:4/411: symlink d1/d33/d40/l7a 0 2024-09-10T09:36:20.736 INFO:tasks.workunit.client.1.smithi135.stdout:1/283: sync 2024-09-10T09:36:20.737 INFO:tasks.workunit.client.1.smithi135.stdout:1/284: read d1d/f2c [114152,79500] 0 2024-09-10T09:36:20.737 INFO:tasks.workunit.client.1.smithi135.stdout:1/285: write d1d/d20/d24/d2b/f32 [64032,92991] 0 2024-09-10T09:36:20.737 INFO:tasks.workunit.client.1.smithi135.stdout:1/286: fsync d1d/f3f 0 2024-09-10T09:36:20.737 INFO:tasks.workunit.client.1.smithi135.stdout:1/287: write d1d/f3f [6456111,65754] 0 2024-09-10T09:36:20.737 INFO:tasks.workunit.client.1.smithi135.stdout:8/329: getdents d1/d15/d49/d69 0 2024-09-10T09:36:20.738 INFO:tasks.workunit.client.1.smithi135.stdout:9/284: mknod de/df/d1d/d23/d25/d28/d4e/c5f 0 2024-09-10T09:36:20.740 INFO:tasks.workunit.client.1.smithi135.stdout:5/248: mkdir d3/d26/d4e 0 2024-09-10T09:36:20.740 INFO:tasks.workunit.client.1.smithi135.stdout:5/249: chown f2 0 1 2024-09-10T09:36:20.742 INFO:tasks.workunit.client.1.smithi135.stdout:7/274: rename d2/d15/f2c to d2/d15/d4a/f5a 0 2024-09-10T09:36:20.742 INFO:tasks.workunit.client.1.smithi135.stdout:7/275: creat d2/d15/d4a/d36/f5b x:0 0 0 2024-09-10T09:36:20.743 INFO:tasks.workunit.client.1.smithi135.stdout:6/340: truncate d5/d15/d27/f3f 867771 0 2024-09-10T09:36:20.744 INFO:tasks.workunit.client.1.smithi135.stdout:0/380: mkdir d8/d1c/d37/d7a 0 2024-09-10T09:36:20.747 INFO:tasks.workunit.client.1.smithi135.stdout:2/328: truncate df/d1b/f26 1361521 0 2024-09-10T09:36:20.748 INFO:tasks.workunit.client.1.smithi135.stdout:3/285: creat d4/d5/db/d36/f54 x:0 0 0 2024-09-10T09:36:20.750 INFO:tasks.workunit.client.1.smithi135.stdout:1/288: dread d1d/d20/d3c/f3d [0,4194304] 0 2024-09-10T09:36:20.757 INFO:tasks.workunit.client.1.smithi135.stdout:4/412: mkdir d1/db/d9/d55/d7b 0 2024-09-10T09:36:20.757 INFO:tasks.workunit.client.1.smithi135.stdout:0/381: dread d8/dd/d11/f46 [4194304,4194304] 0 2024-09-10T09:36:20.757 INFO:tasks.workunit.client.1.smithi135.stdout:0/382: read - d8/dd/d1e/f49 zero size 2024-09-10T09:36:20.757 INFO:tasks.workunit.client.1.smithi135.stdout:8/330: symlink d1/l77 0 2024-09-10T09:36:20.757 INFO:tasks.workunit.client.1.smithi135.stdout:9/285: dwrite de/df/d1d/d23/d25/d28/f4c [0,4194304] 0 2024-09-10T09:36:20.762 INFO:tasks.workunit.client.1.smithi135.stdout:5/250: mkdir d3/d26/d4f 0 2024-09-10T09:36:20.764 INFO:tasks.workunit.client.1.smithi135.stdout:5/251: read d3/dc/d16/f2c [41010,31026] 0 2024-09-10T09:36:20.764 INFO:tasks.workunit.client.1.smithi135.stdout:5/252: rename d3 to d3/dc/d16/d50 22 2024-09-10T09:36:20.769 INFO:tasks.workunit.client.1.smithi135.stdout:6/341: dwrite d5/d15/d27/f3d [0,4194304] 0 2024-09-10T09:36:20.769 INFO:tasks.workunit.client.1.smithi135.stdout:5/253: dread d3/dc/f23 [0,4194304] 0 2024-09-10T09:36:20.771 INFO:tasks.workunit.client.1.smithi135.stdout:7/276: truncate d2/d15/f1c 326356 0 2024-09-10T09:36:20.772 INFO:tasks.workunit.client.1.smithi135.stdout:7/277: write d2/d15/f24 [4497012,121849] 0 2024-09-10T09:36:20.773 INFO:tasks.workunit.client.1.smithi135.stdout:2/329: symlink df/d1b/d30/l63 0 2024-09-10T09:36:20.776 INFO:tasks.workunit.client.1.smithi135.stdout:3/286: mkdir d4/d55 0 2024-09-10T09:36:20.778 INFO:tasks.workunit.client.1.smithi135.stdout:1/289: mknod d1d/d20/d3c/c4f 0 2024-09-10T09:36:20.779 INFO:tasks.workunit.client.1.smithi135.stdout:7/278: write d2/d15/f21 [265739,19060] 0 2024-09-10T09:36:20.779 INFO:tasks.workunit.client.1.smithi135.stdout:4/413: mknod d1/db/d9/d55/d70/c7c 0 2024-09-10T09:36:20.780 INFO:tasks.workunit.client.1.smithi135.stdout:8/331: mknod d1/d15/d16/d33/d45/d70/c78 0 2024-09-10T09:36:20.784 INFO:tasks.workunit.client.1.smithi135.stdout:6/342: dread d5/d1e/d35/f21 [0,4194304] 0 2024-09-10T09:36:20.786 INFO:tasks.workunit.client.1.smithi135.stdout:0/383: dwrite d8/d1c/d37/f5d [0,4194304] 0 2024-09-10T09:36:20.789 INFO:tasks.workunit.client.1.smithi135.stdout:4/414: dread d1/f56 [0,4194304] 0 2024-09-10T09:36:20.789 INFO:tasks.workunit.client.1.smithi135.stdout:9/286: dwrite de/df/f3e [0,4194304] 0 2024-09-10T09:36:20.789 INFO:tasks.workunit.client.1.smithi135.stdout:9/287: getdents de/df/d1d/d1e 0 2024-09-10T09:36:20.789 INFO:tasks.workunit.client.1.smithi135.stdout:9/288: readlink de/df/d1d/d23/l4b 0 2024-09-10T09:36:20.793 INFO:tasks.workunit.client.1.smithi135.stdout:2/330: rename df/d1b/l21 to df/d13/d4f/l64 0 2024-09-10T09:36:20.793 INFO:tasks.workunit.client.1.smithi135.stdout:5/254: dwrite d3/dc/f37 [0,4194304] 0 2024-09-10T09:36:20.797 INFO:tasks.workunit.client.1.smithi135.stdout:3/287: mkdir d4/d5/d56 0 2024-09-10T09:36:20.797 INFO:tasks.workunit.client.1.smithi135.stdout:3/288: dread - d4/d5/db/d36/f54 zero size 2024-09-10T09:36:20.798 INFO:tasks.workunit.client.1.smithi135.stdout:1/290: creat d1d/d20/d3c/f50 x:0 0 0 2024-09-10T09:36:20.798 INFO:tasks.workunit.client.1.smithi135.stdout:1/291: chown d1d/d20/f46 24311251 1 2024-09-10T09:36:20.799 INFO:tasks.workunit.client.1.smithi135.stdout:7/279: mkdir d2/d15/d5c 0 2024-09-10T09:36:20.802 INFO:tasks.workunit.client.1.smithi135.stdout:6/343: creat d5/d1e/d62/f70 x:0 0 0 2024-09-10T09:36:20.805 INFO:tasks.workunit.client.1.smithi135.stdout:8/332: dwrite d1/f23 [0,4194304] 0 2024-09-10T09:36:20.807 INFO:tasks.workunit.client.1.smithi135.stdout:0/384: creat d8/d1c/d37/d7a/f7b x:0 0 0 2024-09-10T09:36:20.807 INFO:tasks.workunit.client.1.smithi135.stdout:0/385: read d8/dd/d11/f59 [77791,20687] 0 2024-09-10T09:36:20.813 INFO:tasks.workunit.client.1.smithi135.stdout:9/289: symlink de/df/l60 0 2024-09-10T09:36:20.815 INFO:tasks.workunit.client.1.smithi135.stdout:4/415: rename d1/f56 to d1/db/d9/f7d 0 2024-09-10T09:36:20.815 INFO:tasks.workunit.client.1.smithi135.stdout:4/416: creat d1/d33/d40/f7e x:0 0 0 2024-09-10T09:36:20.818 INFO:tasks.workunit.client.1.smithi135.stdout:5/255: mknod d3/d26/d4f/c51 0 2024-09-10T09:36:20.818 INFO:tasks.workunit.client.1.smithi135.stdout:5/256: write f2 [2791566,3809] 0 2024-09-10T09:36:20.818 INFO:tasks.workunit.client.1.smithi135.stdout:5/257: chown d3/d26/f3c 70184 1 2024-09-10T09:36:20.818 INFO:tasks.workunit.client.1.smithi135.stdout:5/258: read d3/dc/d16/f19 [283388,68119] 0 2024-09-10T09:36:20.818 INFO:tasks.workunit.client.1.smithi135.stdout:5/259: chown d3/d44/d22/c39 64016455 1 2024-09-10T09:36:20.821 INFO:tasks.workunit.client.1.smithi135.stdout:1/292: mknod d1d/d28/d4b/c51 0 2024-09-10T09:36:20.821 INFO:tasks.workunit.client.1.smithi135.stdout:5/260: dread d3/dc/f10 [0,4194304] 0 2024-09-10T09:36:20.822 INFO:tasks.workunit.client.1.smithi135.stdout:7/280: unlink d2/d15/f24 0 2024-09-10T09:36:20.823 INFO:tasks.workunit.client.1.smithi135.stdout:7/281: dread - d2/d15/f2f zero size 2024-09-10T09:36:20.823 INFO:tasks.workunit.client.1.smithi135.stdout:7/282: truncate d2/d15/d4a/d36/f59 851253 0 2024-09-10T09:36:20.823 INFO:tasks.workunit.client.1.smithi135.stdout:6/344: rmdir d5/dd/d50/d54/d68 39 2024-09-10T09:36:20.824 INFO:tasks.workunit.client.1.smithi135.stdout:6/345: creat d5/d15/d27/f71 x:0 0 0 2024-09-10T09:36:20.824 INFO:tasks.workunit.client.1.smithi135.stdout:8/333: rmdir d1/d13 39 2024-09-10T09:36:20.824 INFO:tasks.workunit.client.1.smithi135.stdout:8/334: dread - d1/d15/d16/f75 zero size 2024-09-10T09:36:20.826 INFO:tasks.workunit.client.1.smithi135.stdout:0/386: mkdir d8/dd/d4a/d50/d54/d5f/d7c 0 2024-09-10T09:36:20.828 INFO:tasks.workunit.client.1.smithi135.stdout:2/331: rename df/d1b/d23/d36/d5f/d3d/f5d to df/d1b/d23/d42/f65 0 2024-09-10T09:36:20.828 INFO:tasks.workunit.client.1.smithi135.stdout:9/290: rename de/df/d1d to de/df/d1d/d1e/d61 22 2024-09-10T09:36:20.830 INFO:tasks.workunit.client.1.smithi135.stdout:3/289: rmdir d4/d5/db/dd 39 2024-09-10T09:36:20.832 INFO:tasks.workunit.client.1.smithi135.stdout:5/261: creat d3/dc/f52 x:0 0 0 2024-09-10T09:36:20.832 INFO:tasks.workunit.client.1.smithi135.stdout:5/262: readlink d3/d44/l28 0 2024-09-10T09:36:20.832 INFO:tasks.workunit.client.1.smithi135.stdout:5/263: fsync d3/dc/f10 0 2024-09-10T09:36:20.835 INFO:tasks.workunit.client.1.smithi135.stdout:7/283: chown d2/cb 7375297 1 2024-09-10T09:36:20.837 INFO:tasks.workunit.client.1.smithi135.stdout:4/417: dwrite d1/db/f46 [0,4194304] 0 2024-09-10T09:36:20.838 INFO:tasks.workunit.client.1.smithi135.stdout:8/335: mknod d1/d27/d3d/c79 0 2024-09-10T09:36:20.842 INFO:tasks.workunit.client.1.smithi135.stdout:0/387: creat d8/dd/d4a/d50/d54/d5f/f7d x:0 0 0 2024-09-10T09:36:20.842 INFO:tasks.workunit.client.1.smithi135.stdout:2/332: stat df/d1b/d23/d42/l56 0 2024-09-10T09:36:20.843 INFO:tasks.workunit.client.1.smithi135.stdout:1/293: dwrite d1d/f22 [4194304,4194304] 0 2024-09-10T09:36:20.844 INFO:tasks.workunit.client.1.smithi135.stdout:6/346: rename d5/d15/l4f to d5/d1e/d3b/d42/d2d/d55/l72 0 2024-09-10T09:36:20.845 INFO:tasks.workunit.client.1.smithi135.stdout:9/291: mkdir de/df/d1d/d62 0 2024-09-10T09:36:20.846 INFO:tasks.workunit.client.1.smithi135.stdout:3/290: link d4/d5/db/f4c d4/d5/dc/f57 0 2024-09-10T09:36:20.846 INFO:tasks.workunit.client.1.smithi135.stdout:3/291: write d4/d5/db/d36/f53 [4254170,17126] 0 2024-09-10T09:36:20.846 INFO:tasks.workunit.client.1.smithi135.stdout:4/418: getdents d1/de 0 2024-09-10T09:36:20.847 INFO:tasks.workunit.client.1.smithi135.stdout:8/336: rmdir d1/d15/d16/d33/d76 0 2024-09-10T09:36:20.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/337: readlink d1/d15/d49/l60 0 2024-09-10T09:36:20.848 INFO:tasks.workunit.client.1.smithi135.stdout:0/388: mknod d8/dd/d4a/d50/d54/d5f/c7e 0 2024-09-10T09:36:20.848 INFO:tasks.workunit.client.1.smithi135.stdout:0/389: chown d8/d1c/l78 161 1 2024-09-10T09:36:20.849 INFO:tasks.workunit.client.1.smithi135.stdout:2/333: getdents df/d1b/d23/d36/d5f 0 2024-09-10T09:36:20.849 INFO:tasks.workunit.client.1.smithi135.stdout:2/334: dread - df/d1b/f5c zero size 2024-09-10T09:36:20.850 INFO:tasks.workunit.client.1.smithi135.stdout:2/335: write df/d1b/d30/f4b [3869216,4771] 0 2024-09-10T09:36:20.851 INFO:tasks.workunit.client.1.smithi135.stdout:1/294: mkdir d1d/d20/d52 0 2024-09-10T09:36:20.851 INFO:tasks.workunit.client.1.smithi135.stdout:5/264: dwrite d3/d44/f35 [0,4194304] 0 2024-09-10T09:36:20.851 INFO:tasks.workunit.client.1.smithi135.stdout:5/265: readlink d3/dc/l3d 0 2024-09-10T09:36:20.852 INFO:tasks.workunit.client.1.smithi135.stdout:6/347: rmdir d5/d1e/d3b/d6d 0 2024-09-10T09:36:20.852 INFO:tasks.workunit.client.1.smithi135.stdout:6/348: truncate d5/d15/d27/f52 4343251 0 2024-09-10T09:36:20.853 INFO:tasks.workunit.client.1.smithi135.stdout:9/292: symlink de/df/d1d/d23/l63 0 2024-09-10T09:36:20.854 INFO:tasks.workunit.client.1.smithi135.stdout:4/419: creat d1/db/d9/d55/d76/f7f x:0 0 0 2024-09-10T09:36:20.855 INFO:tasks.workunit.client.1.smithi135.stdout:4/420: truncate d1/f22 1778467 0 2024-09-10T09:36:20.856 INFO:tasks.workunit.client.1.smithi135.stdout:8/338: symlink d1/d15/d16/d33/d45/l7a 0 2024-09-10T09:36:20.859 INFO:tasks.workunit.client.1.smithi135.stdout:2/336: symlink df/d13/l66 0 2024-09-10T09:36:20.859 INFO:tasks.workunit.client.1.smithi135.stdout:2/337: fsync df/f16 0 2024-09-10T09:36:20.862 INFO:tasks.workunit.client.1.smithi135.stdout:1/295: mkdir d1d/d28/d4b/d53 0 2024-09-10T09:36:20.862 INFO:tasks.workunit.client.1.smithi135.stdout:1/296: write d1d/d20/f2e [896471,81251] 0 2024-09-10T09:36:20.862 INFO:tasks.workunit.client.1.smithi135.stdout:1/297: getdents d1d/d20/d24/d37 0 2024-09-10T09:36:20.868 INFO:tasks.workunit.client.1.smithi135.stdout:7/284: rename d2/d11/d30/d46 to d2/d25/d5d 0 2024-09-10T09:36:20.871 INFO:tasks.workunit.client.1.smithi135.stdout:5/266: creat d3/dc/d16/d41/f53 x:0 0 0 2024-09-10T09:36:20.871 INFO:tasks.workunit.client.1.smithi135.stdout:5/267: fsync d3/d44/f4c 0 2024-09-10T09:36:20.871 INFO:tasks.workunit.client.1.smithi135.stdout:5/268: chown d3/dc/f23 18 1 2024-09-10T09:36:20.871 INFO:tasks.workunit.client.1.smithi135.stdout:5/269: dread - d3/dc/d16/f43 zero size 2024-09-10T09:36:20.873 INFO:tasks.workunit.client.1.smithi135.stdout:9/293: mknod de/df/d1d/d23/c64 0 2024-09-10T09:36:20.873 INFO:tasks.workunit.client.1.smithi135.stdout:9/294: getdents de/df/d1d/d1e 0 2024-09-10T09:36:20.877 INFO:tasks.workunit.client.1.smithi135.stdout:1/298: mknod d1d/d28/c54 0 2024-09-10T09:36:20.879 INFO:tasks.workunit.client.1.smithi135.stdout:3/292: rename d4/d5/db/d1b/d1f/f37 to d4/d5/f58 0 2024-09-10T09:36:20.881 INFO:tasks.workunit.client.1.smithi135.stdout:7/285: mkdir d2/d11/d54/d5e 0 2024-09-10T09:36:20.883 INFO:tasks.workunit.client.1.smithi135.stdout:5/270: getdents d3/d26 0 2024-09-10T09:36:20.886 INFO:tasks.workunit.client.1.smithi135.stdout:0/390: rename d8/dd/d4a/d50/d54/d5f/d7c to d8/d1c/d37/d73/d7f 0 2024-09-10T09:36:20.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/271: symlink d3/d26/d4e/l54 0 2024-09-10T09:36:20.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/272: write d3/f12 [5182268,48382] 0 2024-09-10T09:36:20.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/273: truncate d3/dc/d16/f34 483625 0 2024-09-10T09:36:20.891 INFO:tasks.workunit.client.1.smithi135.stdout:7/286: dread d2/d25/f38 [0,4194304] 0 2024-09-10T09:36:20.891 INFO:tasks.workunit.client.1.smithi135.stdout:7/287: chown d2/d25/f38 0 1 2024-09-10T09:36:20.892 INFO:tasks.workunit.client.1.smithi135.stdout:2/338: rename df/f3b to df/d15/f67 0 2024-09-10T09:36:20.893 INFO:tasks.workunit.client.1.smithi135.stdout:1/299: fsync d1d/d20/d24/d2b/f32 0 2024-09-10T09:36:20.893 INFO:tasks.workunit.client.1.smithi135.stdout:5/274: truncate d3/f14 3518718 0 2024-09-10T09:36:20.894 INFO:tasks.workunit.client.1.smithi135.stdout:8/339: dwrite d1/d15/d16/d33/d45/f5d [0,4194304] 0 2024-09-10T09:36:20.895 INFO:tasks.workunit.client.1.smithi135.stdout:4/421: dwrite d1/de/f34 [0,4194304] 0 2024-09-10T09:36:20.895 INFO:tasks.workunit.client.1.smithi135.stdout:6/349: dwrite d5/d15/f22 [4194304,4194304] 0 2024-09-10T09:36:20.895 INFO:tasks.workunit.client.1.smithi135.stdout:6/350: readlink d5/d15/d27/l36 0 2024-09-10T09:36:20.895 INFO:tasks.workunit.client.1.smithi135.stdout:6/351: creat d5/f73 x:0 0 0 2024-09-10T09:36:20.896 INFO:tasks.workunit.client.1.smithi135.stdout:7/288: creat d2/d15/d39/f5f x:0 0 0 2024-09-10T09:36:20.896 INFO:tasks.workunit.client.1.smithi135.stdout:7/289: fdatasync d2/d25/d5d/f4f 0 2024-09-10T09:36:20.896 INFO:tasks.workunit.client.1.smithi135.stdout:7/290: write d2/d11/f22 [4170922,32046] 0 2024-09-10T09:36:20.896 INFO:tasks.workunit.client.1.smithi135.stdout:4/422: write d1/de/d16/f3b [154362,128185] 0 2024-09-10T09:36:20.901 INFO:tasks.workunit.client.1.smithi135.stdout:5/275: mkdir d3/d44/d22/d55 0 2024-09-10T09:36:20.903 INFO:tasks.workunit.client.1.smithi135.stdout:8/340: mknod d1/d15/d16/d33/d45/d6f/c7b 0 2024-09-10T09:36:20.903 INFO:tasks.workunit.client.1.smithi135.stdout:1/300: write f4 [872966,64251] 0 2024-09-10T09:36:20.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/341: write d1/d15/f4d [370074,18981] 0 2024-09-10T09:36:20.908 INFO:tasks.workunit.client.1.smithi135.stdout:6/352: rename d5/dd/d50/d54/d68 to d5/d1e/d3b/d74 0 2024-09-10T09:36:20.914 INFO:tasks.workunit.client.1.smithi135.stdout:8/342: rename d1/d15/d63 to d1/d15/d49/d7c 0 2024-09-10T09:36:20.917 INFO:tasks.workunit.client.1.smithi135.stdout:7/291: dread d2/f4 [0,4194304] 0 2024-09-10T09:36:20.918 INFO:tasks.workunit.client.1.smithi135.stdout:8/343: rename d1/fd to d1/d15/d16/d33/d39/f7d 0 2024-09-10T09:36:20.922 INFO:tasks.workunit.client.1.smithi135.stdout:0/391: dwrite d8/dd/d4a/d50/d67/f71 [0,4194304] 0 2024-09-10T09:36:20.923 INFO:tasks.workunit.client.1.smithi135.stdout:6/353: getdents d5/dd/d50/d57 0 2024-09-10T09:36:20.923 INFO:tasks.workunit.client.1.smithi135.stdout:6/354: truncate d5/f73 1024398 0 2024-09-10T09:36:20.923 INFO:tasks.workunit.client.1.smithi135.stdout:4/423: dread d1/f19 [0,4194304] 0 2024-09-10T09:36:20.927 INFO:tasks.workunit.client.1.smithi135.stdout:2/339: getdents df/d13 0 2024-09-10T09:36:20.930 INFO:tasks.workunit.client.1.smithi135.stdout:6/355: mknod d5/d1e/d3b/d42/d2d/d55/d5b/c75 0 2024-09-10T09:36:20.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/276: dwrite d3/d44/d22/f2f [0,4194304] 0 2024-09-10T09:36:20.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/277: fdatasync d3/dc/d16/f19 0 2024-09-10T09:36:20.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/278: chown d3/dc/l15 515781571 1 2024-09-10T09:36:20.934 INFO:tasks.workunit.client.1.smithi135.stdout:5/279: write d3/d44/f35 [5209857,110445] 0 2024-09-10T09:36:20.937 INFO:tasks.workunit.client.1.smithi135.stdout:7/292: write d2/d11/d16/f28 [1189385,103415] 0 2024-09-10T09:36:20.937 INFO:tasks.workunit.client.1.smithi135.stdout:7/293: dread - d2/d15/d4a/d36/f5b zero size 2024-09-10T09:36:20.939 INFO:tasks.workunit.client.1.smithi135.stdout:7/294: dread d2/d15/f47 [0,4194304] 0 2024-09-10T09:36:20.939 INFO:tasks.workunit.client.1.smithi135.stdout:7/295: truncate d2/d15/d39/f55 1026654 0 2024-09-10T09:36:20.939 INFO:tasks.workunit.client.1.smithi135.stdout:7/296: stat d2/d11/d54/d5e 0 2024-09-10T09:36:20.942 INFO:tasks.workunit.client.1.smithi135.stdout:4/424: symlink d1/d4a/d6d/l80 0 2024-09-10T09:36:20.942 INFO:tasks.workunit.client.1.smithi135.stdout:6/356: truncate d5/d1e/d3b/d42/f38 2053533 0 2024-09-10T09:36:20.952 INFO:tasks.workunit.client.1.smithi135.stdout:4/425: symlink d1/db/d9/d55/d70/l81 0 2024-09-10T09:36:20.955 INFO:tasks.workunit.client.1.smithi135.stdout:6/357: truncate f4 3005914 0 2024-09-10T09:36:20.955 INFO:tasks.workunit.client.1.smithi135.stdout:6/358: readlink d5/d1e/d35/l18 0 2024-09-10T09:36:20.958 INFO:tasks.workunit.client.1.smithi135.stdout:7/297: rename d2/d11 to d2/d15/d41/d49/d60 0 2024-09-10T09:36:20.960 INFO:tasks.workunit.client.1.smithi135.stdout:4/426: mknod d1/d33/c82 0 2024-09-10T09:36:20.964 INFO:tasks.workunit.client.1.smithi135.stdout:7/298: mknod d2/d15/d41/d49/d60/c61 0 2024-09-10T09:36:20.967 INFO:tasks.workunit.client.1.smithi135.stdout:4/427: mkdir d1/db/d83 0 2024-09-10T09:36:20.970 INFO:tasks.workunit.client.1.smithi135.stdout:6/359: dread d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:20.970 INFO:tasks.workunit.client.1.smithi135.stdout:0/392: dwrite d8/dd/d4a/d50/d54/d5f/f36 [0,4194304] 0 2024-09-10T09:36:20.972 INFO:tasks.workunit.client.1.smithi135.stdout:8/344: dwrite d1/d15/d16/d33/d45/f5d [0,4194304] 0 2024-09-10T09:36:20.972 INFO:tasks.workunit.client.1.smithi135.stdout:8/345: chown d1/d15/d49/d7c/c5a 58 1 2024-09-10T09:36:20.972 INFO:tasks.workunit.client.1.smithi135.stdout:8/346: write d1/f7 [1874238,77443] 0 2024-09-10T09:36:20.972 INFO:tasks.workunit.client.1.smithi135.stdout:8/347: fsync d1/d15/f19 0 2024-09-10T09:36:20.974 INFO:tasks.workunit.client.1.smithi135.stdout:5/280: dwrite d3/d44/d22/f2f [0,4194304] 0 2024-09-10T09:36:20.975 INFO:tasks.workunit.client.1.smithi135.stdout:6/360: dread d5/d15/d27/f3f [0,4194304] 0 2024-09-10T09:36:20.975 INFO:tasks.workunit.client.1.smithi135.stdout:6/361: readlink d5/d1e/d3b/d42/d3c/d44/l63 0 2024-09-10T09:36:20.975 INFO:tasks.workunit.client.1.smithi135.stdout:6/362: chown d5/d1e/d3b/d42/d2d/l37 495946077 1 2024-09-10T09:36:20.975 INFO:tasks.workunit.client.1.smithi135.stdout:6/363: write d5/d15/d27/f52 [3219788,37185] 0 2024-09-10T09:36:20.975 INFO:tasks.workunit.client.1.smithi135.stdout:2/340: dwrite df/d1b/f1c [4194304,4194304] 0 2024-09-10T09:36:20.976 INFO:tasks.workunit.client.1.smithi135.stdout:8/348: unlink d1/d15/d24/f6a 0 2024-09-10T09:36:20.978 INFO:tasks.workunit.client.1.smithi135.stdout:5/281: chown d3/dc/ce 9 1 2024-09-10T09:36:20.980 INFO:tasks.workunit.client.1.smithi135.stdout:6/364: creat d5/d1e/d3b/d42/d3c/d44/f76 x:0 0 0 2024-09-10T09:36:20.980 INFO:tasks.workunit.client.1.smithi135.stdout:6/365: getdents d5/d15/d56 0 2024-09-10T09:36:20.980 INFO:tasks.workunit.client.1.smithi135.stdout:6/366: write d5/d1e/d3b/d42/d3c/f59 [185533,9531] 0 2024-09-10T09:36:20.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/349: dread d1/d15/d24/f2d [0,4194304] 0 2024-09-10T09:36:20.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/341: mknod df/c68 0 2024-09-10T09:36:20.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/342: dread - df/d1b/d23/d36/d5f/d3d/f5b zero size 2024-09-10T09:36:20.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/343: dread - df/d1b/f5c zero size 2024-09-10T09:36:20.986 INFO:tasks.workunit.client.1.smithi135.stdout:5/282: dread d3/d44/f35 [4194304,4194304] 0 2024-09-10T09:36:20.987 INFO:tasks.workunit.client.1.smithi135.stdout:8/350: rename d1/d15/d16/f26 to d1/d15/d24/f7e 0 2024-09-10T09:36:20.987 INFO:tasks.workunit.client.1.smithi135.stdout:8/351: truncate d1/d13/f6e 8099 0 2024-09-10T09:36:20.991 INFO:tasks.workunit.client.1.smithi135.stdout:2/344: unlink df/d1b/d23/l61 0 2024-09-10T09:36:20.993 INFO:tasks.workunit.client.1.smithi135.stdout:5/283: rename d3/d44/d22/l3f to d3/d26/d4f/l56 0 2024-09-10T09:36:20.993 INFO:tasks.workunit.client.1.smithi135.stdout:5/284: chown d3 71 1 2024-09-10T09:36:20.994 INFO:tasks.workunit.client.1.smithi135.stdout:5/285: write d3/ff [510343,7569] 0 2024-09-10T09:36:21.004 INFO:tasks.workunit.client.1.smithi135.stdout:4/428: dwrite d1/db/d23/f3e [0,4194304] 0 2024-09-10T09:36:21.004 INFO:tasks.workunit.client.1.smithi135.stdout:4/429: stat d1/db/d9/l24 0 2024-09-10T09:36:21.004 INFO:tasks.workunit.client.1.smithi135.stdout:6/367: dwrite d5/d15/d27/f71 [0,4194304] 0 2024-09-10T09:36:21.005 INFO:tasks.workunit.client.1.smithi135.stdout:0/393: dwrite d8/f26 [0,4194304] 0 2024-09-10T09:36:21.006 INFO:tasks.workunit.client.1.smithi135.stdout:5/286: mkdir d3/d26/d48/d57 0 2024-09-10T09:36:21.009 INFO:tasks.workunit.client.1.smithi135.stdout:4/430: rename d1/d33/l35 to d1/db/d23/l84 0 2024-09-10T09:36:21.010 INFO:tasks.workunit.client.1.smithi135.stdout:4/431: fdatasync d1/db/d23/f3e 0 2024-09-10T09:36:21.010 INFO:tasks.workunit.client.1.smithi135.stdout:4/432: fdatasync d1/f19 0 2024-09-10T09:36:21.013 INFO:tasks.workunit.client.1.smithi135.stdout:6/368: creat d5/d1e/d3b/f77 x:0 0 0 2024-09-10T09:36:21.017 INFO:tasks.workunit.client.1.smithi135.stdout:5/287: mknod d3/d26/d4f/c58 0 2024-09-10T09:36:21.019 INFO:tasks.workunit.client.1.smithi135.stdout:2/345: truncate df/d1b/f1c 7959833 0 2024-09-10T09:36:21.027 INFO:tasks.workunit.client.1.smithi135.stdout:4/433: mkdir d1/d85 0 2024-09-10T09:36:21.032 INFO:tasks.workunit.client.1.smithi135.stdout:5/288: dwrite d3/d44/d22/f2f [0,4194304] 0 2024-09-10T09:36:21.034 INFO:tasks.workunit.client.1.smithi135.stdout:0/394: mkdir d8/d80 0 2024-09-10T09:36:21.034 INFO:tasks.workunit.client.1.smithi135.stdout:0/395: read - d8/d1c/d37/f65 zero size 2024-09-10T09:36:21.037 INFO:tasks.workunit.client.1.smithi135.stdout:2/346: symlink df/d1b/d23/d36/l69 0 2024-09-10T09:36:21.037 INFO:tasks.workunit.client.1.smithi135.stdout:2/347: readlink df/d1b/d30/l63 0 2024-09-10T09:36:21.041 INFO:tasks.workunit.client.1.smithi135.stdout:4/434: rename d1/db/d23/c6b to d1/de/c86 0 2024-09-10T09:36:21.041 INFO:tasks.workunit.client.1.smithi135.stdout:4/435: write d1/d33/d40/f7e [313154,58761] 0 2024-09-10T09:36:21.041 INFO:tasks.workunit.client.1.smithi135.stdout:5/289: mknod d3/d44/d22/d55/c59 0 2024-09-10T09:36:21.042 INFO:tasks.workunit.client.1.smithi135.stdout:0/396: mknod d8/d80/c81 0 2024-09-10T09:36:21.044 INFO:tasks.workunit.client.1.smithi135.stdout:2/348: creat df/d1b/d30/f6a x:0 0 0 2024-09-10T09:36:21.044 INFO:tasks.workunit.client.1.smithi135.stdout:2/349: truncate df/d15/f33 118758 0 2024-09-10T09:36:21.045 INFO:tasks.workunit.client.1.smithi135.stdout:4/436: creat d1/d4a/f87 x:0 0 0 2024-09-10T09:36:21.046 INFO:tasks.workunit.client.1.smithi135.stdout:5/290: creat d3/d26/d4f/f5a x:0 0 0 2024-09-10T09:36:21.046 INFO:tasks.workunit.client.1.smithi135.stdout:5/291: readlink d3/d26/d4f/l56 0 2024-09-10T09:36:21.047 INFO:tasks.workunit.client.1.smithi135.stdout:4/437: symlink d1/de/d16/l88 0 2024-09-10T09:36:21.049 INFO:tasks.workunit.client.1.smithi135.stdout:5/292: getdents d3/d44/d22 0 2024-09-10T09:36:21.052 INFO:tasks.workunit.client.1.smithi135.stdout:0/397: dread d8/d1c/d37/f58 [0,4194304] 0 2024-09-10T09:36:21.052 INFO:tasks.workunit.client.1.smithi135.stdout:0/398: fdatasync d8/d1c/d61/f69 0 2024-09-10T09:36:21.052 INFO:tasks.workunit.client.1.smithi135.stdout:2/350: dread df/d1b/d23/d42/f65 [0,4194304] 0 2024-09-10T09:36:21.054 INFO:tasks.workunit.client.1.smithi135.stdout:0/399: rename d8/d1c/d37/c53 to d8/dd/d1e/c82 0 2024-09-10T09:36:21.054 INFO:tasks.workunit.client.1.smithi135.stdout:0/400: stat d8/d1c/d37/d73/d7f 0 2024-09-10T09:36:21.054 INFO:tasks.workunit.client.1.smithi135.stdout:0/401: dread - d8/dd/d4a/d50/d54/d5f/d4b/f75 zero size 2024-09-10T09:36:21.057 INFO:tasks.workunit.client.1.smithi135.stdout:4/438: write d1/db/d23/f3e [1716922,104093] 0 2024-09-10T09:36:21.061 INFO:tasks.workunit.client.1.smithi135.stdout:4/439: mkdir d1/d85/d89 0 2024-09-10T09:36:21.061 INFO:tasks.workunit.client.1.smithi135.stdout:4/440: write d1/de/d16/f21 [2314225,108486] 0 2024-09-10T09:36:21.061 INFO:tasks.workunit.client.1.smithi135.stdout:4/441: fsync d1/f22 0 2024-09-10T09:36:21.061 INFO:tasks.workunit.client.1.smithi135.stdout:4/442: truncate d1/f77 978858 0 2024-09-10T09:36:21.062 INFO:tasks.workunit.client.1.smithi135.stdout:4/443: chown d1/db/d23/f3e 13 1 2024-09-10T09:36:21.062 INFO:tasks.workunit.client.1.smithi135.stdout:4/444: write d1/db/d9/f38 [5503396,29602] 0 2024-09-10T09:36:21.062 INFO:tasks.workunit.client.1.smithi135.stdout:2/351: dread df/d15/f24 [0,4194304] 0 2024-09-10T09:36:21.062 INFO:tasks.workunit.client.1.smithi135.stdout:2/352: chown cb 41 1 2024-09-10T09:36:21.064 INFO:tasks.workunit.client.1.smithi135.stdout:5/293: dread d3/d44/d22/f2f [0,4194304] 0 2024-09-10T09:36:21.064 INFO:tasks.workunit.client.1.smithi135.stdout:0/402: dread d8/de/f4d [4194304,4194304] 0 2024-09-10T09:36:21.066 INFO:tasks.workunit.client.1.smithi135.stdout:4/445: mkdir d1/d8a 0 2024-09-10T09:36:21.068 INFO:tasks.workunit.client.1.smithi135.stdout:2/353: symlink df/d1b/d23/d36/d5f/d2c/l6b 0 2024-09-10T09:36:21.068 INFO:tasks.workunit.client.1.smithi135.stdout:2/354: readlink df/d1b/d23/d42/l56 0 2024-09-10T09:36:21.069 INFO:tasks.workunit.client.1.smithi135.stdout:5/294: rename d3/d44/f35 to d3/d26/d4f/f5b 0 2024-09-10T09:36:21.072 INFO:tasks.workunit.client.1.smithi135.stdout:2/355: symlink df/d1b/d23/d42/l6c 0 2024-09-10T09:36:21.073 INFO:tasks.workunit.client.1.smithi135.stdout:5/295: mknod d3/d44/c5c 0 2024-09-10T09:36:21.074 INFO:tasks.workunit.client.1.smithi135.stdout:4/446: dread d1/d33/d40/f7e [0,4194304] 0 2024-09-10T09:36:21.074 INFO:tasks.workunit.client.1.smithi135.stdout:5/296: read d3/d44/f30 [287102,24023] 0 2024-09-10T09:36:21.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/356: creat df/d1b/d23/d36/d5f/d2c/f6d x:0 0 0 2024-09-10T09:36:21.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/357: write df/d15/f24 [4265871,108683] 0 2024-09-10T09:36:21.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/358: dread - df/d1b/d23/d36/f55 zero size 2024-09-10T09:36:21.078 INFO:tasks.workunit.client.1.smithi135.stdout:4/447: mkdir d1/de/d16/d8b 0 2024-09-10T09:36:21.080 INFO:tasks.workunit.client.1.smithi135.stdout:4/448: truncate d1/de/d16/f68 3355258 0 2024-09-10T09:36:21.082 INFO:tasks.workunit.client.1.smithi135.stdout:0/403: dwrite d8/dd/d18/f43 [0,4194304] 0 2024-09-10T09:36:21.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/359: dread df/d1b/d23/d42/f65 [0,4194304] 0 2024-09-10T09:36:21.082 INFO:tasks.workunit.client.1.smithi135.stdout:4/449: mknod d1/d85/c8c 0 2024-09-10T09:36:21.093 INFO:tasks.workunit.client.1.smithi135.stdout:4/450: creat d1/de/f8d x:0 0 0 2024-09-10T09:36:21.094 INFO:tasks.workunit.client.1.smithi135.stdout:0/404: dread d8/dd/d18/f43 [0,4194304] 0 2024-09-10T09:36:21.094 INFO:tasks.workunit.client.1.smithi135.stdout:0/405: readlink d8/dd/d11/l25 0 2024-09-10T09:36:21.094 INFO:tasks.workunit.client.1.smithi135.stdout:0/406: chown d8/d1c/d37/d7a 4 1 2024-09-10T09:36:21.094 INFO:tasks.workunit.client.1.smithi135.stdout:0/407: creat d8/d1c/d37/f83 x:0 0 0 2024-09-10T09:36:21.094 INFO:tasks.workunit.client.1.smithi135.stdout:0/408: creat d8/dd/d4a/f84 x:0 0 0 2024-09-10T09:36:21.096 INFO:tasks.workunit.client.1.smithi135.stdout:4/451: link d1/d33/d40/c5c d1/d33/d40/c8e 0 2024-09-10T09:36:21.100 INFO:tasks.workunit.client.1.smithi135.stdout:0/409: link d8/de/f38 d8/dd/d4a/d50/d54/d5f/f85 0 2024-09-10T09:36:21.100 INFO:tasks.workunit.client.1.smithi135.stdout:0/410: stat d8/d1c/d37/f5d 0 2024-09-10T09:36:21.100 INFO:tasks.workunit.client.1.smithi135.stdout:0/411: stat d8/dd/d4a 0 2024-09-10T09:36:21.101 INFO:tasks.workunit.client.1.smithi135.stdout:4/452: symlink d1/d85/l8f 0 2024-09-10T09:36:21.102 INFO:tasks.workunit.client.1.smithi135.stdout:4/453: rmdir d1 39 2024-09-10T09:36:21.102 INFO:tasks.workunit.client.1.smithi135.stdout:4/454: fsync d1/de/d16/f3b 0 2024-09-10T09:36:21.103 INFO:tasks.workunit.client.1.smithi135.stdout:4/455: chown d1/db/d9/d55/c72 110 1 2024-09-10T09:36:21.103 INFO:tasks.workunit.client.1.smithi135.stdout:4/456: chown d1/de/c60 411548 1 2024-09-10T09:36:21.105 INFO:tasks.workunit.client.1.smithi135.stdout:0/412: rename d8/dd/d4a/d50/d54/d5f/f36 to d8/f86 0 2024-09-10T09:36:21.105 INFO:tasks.workunit.client.1.smithi135.stdout:0/413: readlink d8/de/l3c 0 2024-09-10T09:36:21.106 INFO:tasks.workunit.client.1.smithi135.stdout:0/414: read d8/dd/f13 [4172041,17001] 0 2024-09-10T09:36:21.107 INFO:tasks.workunit.client.1.smithi135.stdout:0/415: symlink d8/d1c/d37/l87 0 2024-09-10T09:36:21.110 INFO:tasks.workunit.client.1.smithi135.stdout:0/416: mkdir d8/d1c/d37/d73/d88 0 2024-09-10T09:36:21.291 INFO:tasks.workunit.client.1.smithi135.stdout:9/295: sync 2024-09-10T09:36:21.291 INFO:tasks.workunit.client.1.smithi135.stdout:1/301: sync 2024-09-10T09:36:21.291 INFO:tasks.workunit.client.1.smithi135.stdout:3/293: sync 2024-09-10T09:36:21.291 INFO:tasks.workunit.client.1.smithi135.stdout:9/296: chown de/f17 106155 1 2024-09-10T09:36:21.291 INFO:tasks.workunit.client.1.smithi135.stdout:3/294: stat d4/d5/db/l1a 0 2024-09-10T09:36:21.292 INFO:tasks.workunit.client.1.smithi135.stdout:9/297: dread de/f17 [0,4194304] 0 2024-09-10T09:36:21.292 INFO:tasks.workunit.client.1.smithi135.stdout:9/298: creat de/df/d1d/d1e/d3f/f65 x:0 0 0 2024-09-10T09:36:21.302 INFO:tasks.workunit.client.1.smithi135.stdout:9/299: dread f6 [0,4194304] 0 2024-09-10T09:36:21.302 INFO:tasks.workunit.client.1.smithi135.stdout:9/300: dread - de/df/d1d/d1e/d52/f53 zero size 2024-09-10T09:36:21.302 INFO:tasks.workunit.client.1.smithi135.stdout:9/301: fsync de/df/f3e 0 2024-09-10T09:36:21.303 INFO:tasks.workunit.client.1.smithi135.stdout:9/302: mknod de/df/d1d/d23/d25/d28/d4e/c66 0 2024-09-10T09:36:21.307 INFO:tasks.workunit.client.1.smithi135.stdout:1/302: dwrite d1d/d20/d24/d2b/f3a [0,4194304] 0 2024-09-10T09:36:21.310 INFO:tasks.workunit.client.1.smithi135.stdout:1/303: creat d1d/d20/d24/d2b/d4c/f55 x:0 0 0 2024-09-10T09:36:21.310 INFO:tasks.workunit.client.1.smithi135.stdout:1/304: chown d1d/d28/c54 0 1 2024-09-10T09:36:21.310 INFO:tasks.workunit.client.1.smithi135.stdout:1/305: getdents d1d/d20/d52 0 2024-09-10T09:36:21.312 INFO:tasks.workunit.client.1.smithi135.stdout:9/303: write de/df/d1d/d23/f2d [1258145,26250] 0 2024-09-10T09:36:21.312 INFO:tasks.workunit.client.1.smithi135.stdout:9/304: creat de/df/d1d/d23/f67 x:0 0 0 2024-09-10T09:36:21.312 INFO:tasks.workunit.client.1.smithi135.stdout:9/305: write de/df/f1b [2112339,55721] 0 2024-09-10T09:36:21.312 INFO:tasks.workunit.client.1.smithi135.stdout:1/306: read d1d/f25 [107195,116975] 0 2024-09-10T09:36:21.316 INFO:tasks.workunit.client.1.smithi135.stdout:9/306: mkdir de/df/d1d/d1e/d68 0 2024-09-10T09:36:21.316 INFO:tasks.workunit.client.1.smithi135.stdout:9/307: readlink de/df/l60 0 2024-09-10T09:36:21.319 INFO:tasks.workunit.client.1.smithi135.stdout:9/308: mkdir de/df/d1d/d23/d25/d5c/d69 0 2024-09-10T09:36:21.321 INFO:tasks.workunit.client.1.smithi135.stdout:9/309: creat de/df/d1d/f6a x:0 0 0 2024-09-10T09:36:21.323 INFO:tasks.workunit.client.1.smithi135.stdout:1/307: write d1d/f27 [587894,109151] 0 2024-09-10T09:36:21.324 INFO:tasks.workunit.client.1.smithi135.stdout:1/308: chown d1d/d20/c49 0 1 2024-09-10T09:36:21.324 INFO:tasks.workunit.client.1.smithi135.stdout:9/310: mkdir de/df/d1d/d6b 0 2024-09-10T09:36:21.324 INFO:tasks.workunit.client.1.smithi135.stdout:9/311: chown de/df/d1d/d23/f57 2899 1 2024-09-10T09:36:21.326 INFO:tasks.workunit.client.1.smithi135.stdout:1/309: creat d1d/d20/d3c/d4e/f56 x:0 0 0 2024-09-10T09:36:21.326 INFO:tasks.workunit.client.1.smithi135.stdout:1/310: readlink d1d/d20/d24/d37/l41 0 2024-09-10T09:36:21.327 INFO:tasks.workunit.client.1.smithi135.stdout:9/312: mknod de/df/d1d/d1e/c6c 0 2024-09-10T09:36:21.327 INFO:tasks.workunit.client.1.smithi135.stdout:1/311: read d1d/d20/f2e [27427,14176] 0 2024-09-10T09:36:21.329 INFO:tasks.workunit.client.1.smithi135.stdout:9/313: creat de/df/d1d/d23/d25/d5c/f6d x:0 0 0 2024-09-10T09:36:21.330 INFO:tasks.workunit.client.1.smithi135.stdout:9/314: symlink de/df/d1d/d1e/l6e 0 2024-09-10T09:36:21.331 INFO:tasks.workunit.client.1.smithi135.stdout:9/315: link de/df/d1d/d23/f67 de/df/d1d/d1e/d68/f6f 0 2024-09-10T09:36:21.333 INFO:tasks.workunit.client.1.smithi135.stdout:1/312: write d1d/d20/d3c/f3d [606689,70109] 0 2024-09-10T09:36:21.334 INFO:tasks.workunit.client.1.smithi135.stdout:1/313: getdents d1d 0 2024-09-10T09:36:21.335 INFO:tasks.workunit.client.1.smithi135.stdout:1/314: mknod d1d/d28/c57 0 2024-09-10T09:36:21.337 INFO:tasks.workunit.client.1.smithi135.stdout:1/315: unlink l13 0 2024-09-10T09:36:21.346 INFO:tasks.workunit.client.1.smithi135.stdout:1/316: dread f11 [0,4194304] 0 2024-09-10T09:36:21.348 INFO:tasks.workunit.client.1.smithi135.stdout:9/316: dwrite f6 [0,4194304] 0 2024-09-10T09:36:21.349 INFO:tasks.workunit.client.1.smithi135.stdout:1/317: creat d1d/f58 x:0 0 0 2024-09-10T09:36:21.353 INFO:tasks.workunit.client.1.smithi135.stdout:9/317: mknod de/df/d1d/d1e/c70 0 2024-09-10T09:36:21.354 INFO:tasks.workunit.client.1.smithi135.stdout:1/318: link l15 d1d/d20/d24/d37/l59 0 2024-09-10T09:36:21.378 INFO:tasks.workunit.client.1.smithi135.stdout:1/319: dwrite d1d/d20/d24/d2b/f36 [0,4194304] 0 2024-09-10T09:36:21.378 INFO:tasks.workunit.client.1.smithi135.stdout:9/318: dwrite de/df/d1d/d1e/d3f/f4f [0,4194304] 0 2024-09-10T09:36:21.382 INFO:tasks.workunit.client.1.smithi135.stdout:1/320: creat d1d/d20/d52/f5a x:0 0 0 2024-09-10T09:36:21.383 INFO:tasks.workunit.client.1.smithi135.stdout:1/321: dread d1d/f25 [0,4194304] 0 2024-09-10T09:36:21.386 INFO:tasks.workunit.client.1.smithi135.stdout:1/322: dread d1d/d20/f2e [0,4194304] 0 2024-09-10T09:36:21.392 INFO:tasks.workunit.client.1.smithi135.stdout:1/323: dread d1d/d20/d3c/f3d [0,4194304] 0 2024-09-10T09:36:21.393 INFO:tasks.workunit.client.1.smithi135.stdout:1/324: rmdir d1d/d28 39 2024-09-10T09:36:21.410 INFO:tasks.workunit.client.1.smithi135.stdout:1/325: dwrite d1d/d20/d3c/d4e/f56 [0,4194304] 0 2024-09-10T09:36:21.428 INFO:tasks.workunit.client.1.smithi135.stdout:1/326: dwrite d1d/f22 [4194304,4194304] 0 2024-09-10T09:36:21.438 INFO:tasks.workunit.client.1.smithi135.stdout:1/327: dread d1d/f3f [0,4194304] 0 2024-09-10T09:36:21.439 INFO:tasks.workunit.client.1.smithi135.stdout:1/328: symlink d1d/d20/d3c/d4e/l5b 0 2024-09-10T09:36:21.441 INFO:tasks.workunit.client.1.smithi135.stdout:1/329: truncate d1d/f1e 745387 0 2024-09-10T09:36:21.442 INFO:tasks.workunit.client.1.smithi135.stdout:1/330: mknod d1d/d20/d24/d37/c5c 0 2024-09-10T09:36:21.444 INFO:tasks.workunit.client.1.smithi135.stdout:1/331: dread d1d/d20/f2e [0,4194304] 0 2024-09-10T09:36:21.446 INFO:tasks.workunit.client.1.smithi135.stdout:1/332: mkdir d1d/d20/d5d 0 2024-09-10T09:36:21.447 INFO:tasks.workunit.client.1.smithi135.stdout:1/333: dread - d1d/d20/d24/d2b/d4c/f55 zero size 2024-09-10T09:36:21.450 INFO:tasks.workunit.client.1.smithi135.stdout:1/334: mknod d1d/d20/d24/d2b/d4c/c5e 0 2024-09-10T09:36:21.450 INFO:tasks.workunit.client.1.smithi135.stdout:1/335: write d1d/d20/d24/d2b/f32 [656083,71533] 0 2024-09-10T09:36:21.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/457: sync 2024-09-10T09:36:21.558 INFO:tasks.workunit.client.1.smithi135.stdout:8/352: sync 2024-09-10T09:36:21.558 INFO:tasks.workunit.client.1.smithi135.stdout:7/299: sync 2024-09-10T09:36:21.558 INFO:tasks.workunit.client.1.smithi135.stdout:5/297: sync 2024-09-10T09:36:21.558 INFO:tasks.workunit.client.1.smithi135.stdout:6/369: sync 2024-09-10T09:36:21.558 INFO:tasks.workunit.client.1.smithi135.stdout:0/417: sync 2024-09-10T09:36:21.559 INFO:tasks.workunit.client.1.smithi135.stdout:2/360: sync 2024-09-10T09:36:21.559 INFO:tasks.workunit.client.1.smithi135.stdout:0/418: stat d8/dd/d4a/d50/d54 0 2024-09-10T09:36:21.559 INFO:tasks.workunit.client.1.smithi135.stdout:8/353: dread - d1/d15/d16/f61 zero size 2024-09-10T09:36:21.560 INFO:tasks.workunit.client.1.smithi135.stdout:5/298: unlink d3/dc/l2a 0 2024-09-10T09:36:21.560 INFO:tasks.workunit.client.1.smithi135.stdout:5/299: write d3/dc/f37 [4280603,36100] 0 2024-09-10T09:36:21.561 INFO:tasks.workunit.client.1.smithi135.stdout:6/370: mknod d5/dd/d50/d57/c78 0 2024-09-10T09:36:21.561 INFO:tasks.workunit.client.1.smithi135.stdout:4/458: creat d1/f90 x:0 0 0 2024-09-10T09:36:21.563 INFO:tasks.workunit.client.1.smithi135.stdout:7/300: mkdir d2/d15/d5c/d62 0 2024-09-10T09:36:21.563 INFO:tasks.workunit.client.1.smithi135.stdout:7/301: getdents d2/d15/d5c/d62 0 2024-09-10T09:36:21.564 INFO:tasks.workunit.client.1.smithi135.stdout:0/419: write d8/dd/d4a/d50/d67/f71 [3835407,101288] 0 2024-09-10T09:36:21.568 INFO:tasks.workunit.client.1.smithi135.stdout:7/302: write d2/f1f [2976379,18387] 0 2024-09-10T09:36:21.572 INFO:tasks.workunit.client.1.smithi135.stdout:4/459: write d1/db/f46 [2060065,68132] 0 2024-09-10T09:36:21.572 INFO:tasks.workunit.client.1.smithi135.stdout:4/460: fsync d1/d33/f6e 0 2024-09-10T09:36:21.588 INFO:tasks.workunit.client.1.smithi135.stdout:7/303: dwrite d2/ff [0,4194304] 0 2024-09-10T09:36:21.588 INFO:tasks.workunit.client.1.smithi135.stdout:7/304: fsync d2/d15/f21 0 2024-09-10T09:36:21.665 INFO:tasks.workunit.client.1.smithi135.stdout:5/300: rename d3/d44/d22/d55 to d3/d26/d4e/d5d 0 2024-09-10T09:36:21.666 INFO:tasks.workunit.client.1.smithi135.stdout:6/371: getdents d5/d1e/d3b/d42 0 2024-09-10T09:36:21.666 INFO:tasks.workunit.client.1.smithi135.stdout:8/354: symlink d1/d15/d49/d7c/l7f 0 2024-09-10T09:36:21.667 INFO:tasks.workunit.client.1.smithi135.stdout:8/355: truncate d1/d15/d16/d33/d39/f7d 5613096 0 2024-09-10T09:36:21.669 INFO:tasks.workunit.client.1.smithi135.stdout:5/301: dread d3/f14 [0,4194304] 0 2024-09-10T09:36:21.671 INFO:tasks.workunit.client.1.smithi135.stdout:4/461: creat d1/d85/d89/f91 x:0 0 0 2024-09-10T09:36:21.673 INFO:tasks.workunit.client.1.smithi135.stdout:7/305: creat d2/d15/d41/d49/f63 x:0 0 0 2024-09-10T09:36:21.673 INFO:tasks.workunit.client.1.smithi135.stdout:7/306: chown d2/d15/d41/d49/d52 48 1 2024-09-10T09:36:21.678 INFO:tasks.workunit.client.1.smithi135.stdout:6/372: getdents d5/d1e/d35 0 2024-09-10T09:36:21.681 INFO:tasks.workunit.client.1.smithi135.stdout:5/302: rmdir d3/d26/d4e 39 2024-09-10T09:36:21.684 INFO:tasks.workunit.client.1.smithi135.stdout:7/307: link d2/f4 d2/d15/d41/d49/d60/d54/d5e/f64 0 2024-09-10T09:36:21.688 INFO:tasks.workunit.client.1.smithi135.stdout:6/373: symlink d5/d1e/l79 0 2024-09-10T09:36:21.690 INFO:tasks.workunit.client.1.smithi135.stdout:5/303: creat d3/d26/d48/d57/f5e x:0 0 0 2024-09-10T09:36:21.690 INFO:tasks.workunit.client.1.smithi135.stdout:4/462: dwrite d1/db/f46 [0,4194304] 0 2024-09-10T09:36:21.690 INFO:tasks.workunit.client.1.smithi135.stdout:4/463: readlink d1/db/d9/l10 0 2024-09-10T09:36:21.691 INFO:tasks.workunit.client.1.smithi135.stdout:4/464: read d1/db/f6 [3738970,26285] 0 2024-09-10T09:36:21.695 INFO:tasks.workunit.client.1.smithi135.stdout:6/374: unlink d5/d15/c48 0 2024-09-10T09:36:21.700 INFO:tasks.workunit.client.1.smithi135.stdout:4/465: mkdir d1/db/d9/d55/d70/d92 0 2024-09-10T09:36:21.701 INFO:tasks.workunit.client.1.smithi135.stdout:6/375: symlink d5/d1e/d3b/d42/d3c/l7a 0 2024-09-10T09:36:21.704 INFO:tasks.workunit.client.1.smithi135.stdout:5/304: unlink d3/dc/d16/c20 0 2024-09-10T09:36:21.704 INFO:tasks.workunit.client.1.smithi135.stdout:4/466: mknod d1/d33/d40/c93 0 2024-09-10T09:36:21.706 INFO:tasks.workunit.client.1.smithi135.stdout:8/356: dwrite d1/d15/f19 [0,4194304] 0 2024-09-10T09:36:21.706 INFO:tasks.workunit.client.1.smithi135.stdout:7/308: dwrite d2/d15/d41/d49/d60/f43 [0,4194304] 0 2024-09-10T09:36:21.708 INFO:tasks.workunit.client.1.smithi135.stdout:6/376: unlink d5/d1e/d3b/d42/d2d/f51 0 2024-09-10T09:36:21.723 INFO:tasks.workunit.client.1.smithi135.stdout:8/357: write d1/f20 [1166105,101317] 0 2024-09-10T09:36:21.723 INFO:tasks.workunit.client.1.smithi135.stdout:8/358: read d1/d15/d16/d33/d39/f7d [2137832,66127] 0 2024-09-10T09:36:21.733 INFO:tasks.workunit.client.1.smithi135.stdout:7/309: getdents d2 0 2024-09-10T09:36:21.733 INFO:tasks.workunit.client.1.smithi135.stdout:7/310: truncate d2/d15/f20 217319 0 2024-09-10T09:36:21.733 INFO:tasks.workunit.client.1.smithi135.stdout:7/311: fdatasync d2/d15/f20 0 2024-09-10T09:36:21.733 INFO:tasks.workunit.client.1.smithi135.stdout:7/312: chown d2/d15/d39/f55 6519 1 2024-09-10T09:36:21.737 INFO:tasks.workunit.client.1.smithi135.stdout:8/359: truncate d1/d15/d24/f2d 79920 0 2024-09-10T09:36:21.745 INFO:tasks.workunit.client.1.smithi135.stdout:6/377: dwrite d5/dd/d50/d57/f6a [0,4194304] 0 2024-09-10T09:36:21.746 INFO:tasks.workunit.client.1.smithi135.stdout:7/313: dread d2/f10 [0,4194304] 0 2024-09-10T09:36:21.747 INFO:tasks.workunit.client.1.smithi135.stdout:5/305: dwrite d3/d44/f4c [0,4194304] 0 2024-09-10T09:36:21.747 INFO:tasks.workunit.client.1.smithi135.stdout:4/467: dwrite d1/db/ff [4194304,4194304] 0 2024-09-10T09:36:21.750 INFO:tasks.workunit.client.1.smithi135.stdout:7/314: creat d2/d25/f65 x:0 0 0 2024-09-10T09:36:21.753 INFO:tasks.workunit.client.1.smithi135.stdout:5/306: creat d3/d26/f5f x:0 0 0 2024-09-10T09:36:21.754 INFO:tasks.workunit.client.1.smithi135.stdout:4/468: creat d1/db/d9/d55/f94 x:0 0 0 2024-09-10T09:36:21.754 INFO:tasks.workunit.client.1.smithi135.stdout:4/469: readlink d1/db/d23/l5e 0 2024-09-10T09:36:21.754 INFO:tasks.workunit.client.1.smithi135.stdout:4/470: write d1/db/d9/f6a [764163,54848] 0 2024-09-10T09:36:21.755 INFO:tasks.workunit.client.1.smithi135.stdout:4/471: write d1/de/d16/f44 [4589465,64875] 0 2024-09-10T09:36:21.755 INFO:tasks.workunit.client.1.smithi135.stdout:4/472: fdatasync d1/de/d16/f67 0 2024-09-10T09:36:21.755 INFO:tasks.workunit.client.1.smithi135.stdout:4/473: dread - d1/de/f8d zero size 2024-09-10T09:36:21.757 INFO:tasks.workunit.client.1.smithi135.stdout:4/474: mkdir d1/de/d16/d95 0 2024-09-10T09:36:21.758 INFO:tasks.workunit.client.1.smithi135.stdout:5/307: rename d3/dc/l38 to d3/d26/d48/l60 0 2024-09-10T09:36:21.760 INFO:tasks.workunit.client.1.smithi135.stdout:3/295: sync 2024-09-10T09:36:21.760 INFO:tasks.workunit.client.1.smithi135.stdout:3/296: write d4/d5/db/d1b/d1f/f2a [2383628,88094] 0 2024-09-10T09:36:21.760 INFO:tasks.workunit.client.1.smithi135.stdout:4/475: rename d1/db/c61 to d1/de/d16/c96 0 2024-09-10T09:36:21.760 INFO:tasks.workunit.client.1.smithi135.stdout:4/476: write d1/db/d9/d55/f94 [45581,90892] 0 2024-09-10T09:36:21.760 INFO:tasks.workunit.client.1.smithi135.stdout:4/477: fsync d1/db/d9/f38 0 2024-09-10T09:36:21.761 INFO:tasks.workunit.client.1.smithi135.stdout:5/308: mkdir d3/d26/d4f/d61 0 2024-09-10T09:36:21.762 INFO:tasks.workunit.client.1.smithi135.stdout:3/297: symlink d4/d5/db/d36/d43/l59 0 2024-09-10T09:36:21.762 INFO:tasks.workunit.client.1.smithi135.stdout:7/315: dread d2/d15/f2d [4194304,4194304] 0 2024-09-10T09:36:21.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/478: symlink d1/de/d16/d8b/l97 0 2024-09-10T09:36:21.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/479: fdatasync d1/d4a/f51 0 2024-09-10T09:36:21.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/480: write d1/db/f46 [4879398,74484] 0 2024-09-10T09:36:21.763 INFO:tasks.workunit.client.1.smithi135.stdout:4/481: fdatasync d1/de/f8d 0 2024-09-10T09:36:21.764 INFO:tasks.workunit.client.1.smithi135.stdout:4/482: write d1/db/f6 [531120,3001] 0 2024-09-10T09:36:21.764 INFO:tasks.workunit.client.1.smithi135.stdout:4/483: write d1/db/d23/f30 [5111252,60723] 0 2024-09-10T09:36:21.764 INFO:tasks.workunit.client.1.smithi135.stdout:5/309: creat d3/dc/d16/d41/f62 x:0 0 0 2024-09-10T09:36:21.765 INFO:tasks.workunit.client.1.smithi135.stdout:7/316: rmdir d2/d15/d41/d49/d60/d30 39 2024-09-10T09:36:21.765 INFO:tasks.workunit.client.1.smithi135.stdout:8/360: dwrite d1/f25 [0,4194304] 0 2024-09-10T09:36:21.765 INFO:tasks.workunit.client.1.smithi135.stdout:7/317: fdatasync d2/d15/d4a/f5a 0 2024-09-10T09:36:21.766 INFO:tasks.workunit.client.1.smithi135.stdout:6/378: dwrite d5/d1e/d3b/f41 [0,4194304] 0 2024-09-10T09:36:21.770 INFO:tasks.workunit.client.1.smithi135.stdout:5/310: creat d3/d26/d48/f63 x:0 0 0 2024-09-10T09:36:21.770 INFO:tasks.workunit.client.1.smithi135.stdout:5/311: truncate d3/dc/d16/d41/f62 941615 0 2024-09-10T09:36:21.771 INFO:tasks.workunit.client.1.smithi135.stdout:7/318: stat d2/d25/f3f 0 2024-09-10T09:36:21.776 INFO:tasks.workunit.client.1.smithi135.stdout:8/361: truncate d1/d27/f68 439971 0 2024-09-10T09:36:21.778 INFO:tasks.workunit.client.1.smithi135.stdout:3/298: write d4/d5/dc/f19 [4197278,28047] 0 2024-09-10T09:36:21.785 INFO:tasks.workunit.client.1.smithi135.stdout:3/299: fdatasync d4/d5/dc/f19 0 2024-09-10T09:36:21.785 INFO:tasks.workunit.client.1.smithi135.stdout:6/379: dwrite d5/d1e/d3b/d42/d2d/d55/d5b/f5e [0,4194304] 0 2024-09-10T09:36:21.785 INFO:tasks.workunit.client.1.smithi135.stdout:6/380: write d5/d15/f1c [954316,66352] 0 2024-09-10T09:36:21.785 INFO:tasks.workunit.client.1.smithi135.stdout:6/381: chown d5/d15/d27/f5c 97621737 1 2024-09-10T09:36:21.792 INFO:tasks.workunit.client.1.smithi135.stdout:8/362: dwrite d1/d15/d24/f35 [0,4194304] 0 2024-09-10T09:36:21.795 INFO:tasks.workunit.client.1.smithi135.stdout:5/312: link d3/d26/d48/c4d d3/d44/d22/c64 0 2024-09-10T09:36:21.795 INFO:tasks.workunit.client.1.smithi135.stdout:5/313: chown d3/d44/c42 33672 1 2024-09-10T09:36:21.795 INFO:tasks.workunit.client.1.smithi135.stdout:5/314: write d3/dc/d16/f43 [175440,41567] 0 2024-09-10T09:36:21.795 INFO:tasks.workunit.client.1.smithi135.stdout:5/315: write d3/f5 [5214899,11247] 0 2024-09-10T09:36:21.796 INFO:tasks.workunit.client.1.smithi135.stdout:7/319: stat d2/d15/d4a/c19 0 2024-09-10T09:36:21.796 INFO:tasks.workunit.client.1.smithi135.stdout:7/320: chown d2/d15/f47 0 1 2024-09-10T09:36:21.802 INFO:tasks.workunit.client.1.smithi135.stdout:6/382: creat d5/dd/d50/f7b x:0 0 0 2024-09-10T09:36:21.809 INFO:tasks.workunit.client.1.smithi135.stdout:8/363: creat d1/d15/d16/d71/f80 x:0 0 0 2024-09-10T09:36:21.809 INFO:tasks.workunit.client.1.smithi135.stdout:8/364: creat d1/d15/d49/f81 x:0 0 0 2024-09-10T09:36:21.809 INFO:tasks.workunit.client.1.smithi135.stdout:8/365: chown d1/d27 243 1 2024-09-10T09:36:21.810 INFO:tasks.workunit.client.1.smithi135.stdout:8/366: dread - d1/d27/f40 zero size 2024-09-10T09:36:21.811 INFO:tasks.workunit.client.1.smithi135.stdout:5/316: mkdir d3/d26/d4e/d5d/d65 0 2024-09-10T09:36:21.813 INFO:tasks.workunit.client.1.smithi135.stdout:7/321: symlink d2/d15/l66 0 2024-09-10T09:36:21.817 INFO:tasks.workunit.client.1.smithi135.stdout:7/322: link d2/d15/d41/d49/d60/f22 d2/d15/d41/d49/d60/f67 0 2024-09-10T09:36:21.817 INFO:tasks.workunit.client.1.smithi135.stdout:7/323: write d2/d15/d41/d49/f63 [223963,88371] 0 2024-09-10T09:36:21.817 INFO:tasks.workunit.client.1.smithi135.stdout:8/367: getdents d1/d27 0 2024-09-10T09:36:21.823 INFO:tasks.workunit.client.1.smithi135.stdout:7/324: unlink d2/d15/d39/c4b 0 2024-09-10T09:36:21.824 INFO:tasks.workunit.client.1.smithi135.stdout:8/368: symlink d1/d15/d16/d33/d39/l82 0 2024-09-10T09:36:21.825 INFO:tasks.workunit.client.1.smithi135.stdout:7/325: dread d2/d15/f47 [0,4194304] 0 2024-09-10T09:36:21.827 INFO:tasks.workunit.client.1.smithi135.stdout:8/369: mknod d1/d15/d49/c83 0 2024-09-10T09:36:21.831 INFO:tasks.workunit.client.1.smithi135.stdout:8/370: creat d1/d15/d49/d69/f84 x:0 0 0 2024-09-10T09:36:21.831 INFO:tasks.workunit.client.1.smithi135.stdout:8/371: write d1/d15/d16/d71/f80 [644865,117761] 0 2024-09-10T09:36:21.831 INFO:tasks.workunit.client.1.smithi135.stdout:8/372: stat d1/d15/d16/d71/f80 0 2024-09-10T09:36:21.831 INFO:tasks.workunit.client.1.smithi135.stdout:8/373: creat d1/d15/d49/f85 x:0 0 0 2024-09-10T09:36:21.838 INFO:tasks.workunit.client.1.smithi135.stdout:8/374: symlink d1/d15/d24/l86 0 2024-09-10T09:36:21.848 INFO:tasks.workunit.client.1.smithi135.stdout:8/375: write d1/d15/d24/f7e [3360177,83605] 0 2024-09-10T09:36:21.851 INFO:tasks.workunit.client.1.smithi135.stdout:6/383: dwrite f3 [0,4194304] 0 2024-09-10T09:36:21.851 INFO:tasks.workunit.client.1.smithi135.stdout:7/326: dwrite d2/ff [0,4194304] 0 2024-09-10T09:36:21.853 INFO:tasks.workunit.client.1.smithi135.stdout:6/384: mknod d5/d1e/d3b/c7c 0 2024-09-10T09:36:21.854 INFO:tasks.workunit.client.1.smithi135.stdout:7/327: mknod d2/d15/d41/d49/d60/c68 0 2024-09-10T09:36:21.857 INFO:tasks.workunit.client.1.smithi135.stdout:6/385: rename d5/d1e/d62/f70 to d5/d1e/d3b/d42/f7d 0 2024-09-10T09:36:21.857 INFO:tasks.workunit.client.1.smithi135.stdout:6/386: chown d5/d15/d27/f3f 79 1 2024-09-10T09:36:21.857 INFO:tasks.workunit.client.1.smithi135.stdout:6/387: stat d5/d1e/d3b 0 2024-09-10T09:36:21.858 INFO:tasks.workunit.client.1.smithi135.stdout:7/328: creat d2/d15/d41/d49/d60/d30/f69 x:0 0 0 2024-09-10T09:36:21.863 INFO:tasks.workunit.client.1.smithi135.stdout:9/319: sync 2024-09-10T09:36:21.863 INFO:tasks.workunit.client.1.smithi135.stdout:1/336: sync 2024-09-10T09:36:21.863 INFO:tasks.workunit.client.1.smithi135.stdout:1/337: creat d1d/d20/d3c/f5f x:0 0 0 2024-09-10T09:36:21.865 INFO:tasks.workunit.client.1.smithi135.stdout:9/320: creat de/df/d1d/d1e/d68/f71 x:0 0 0 2024-09-10T09:36:21.865 INFO:tasks.workunit.client.1.smithi135.stdout:9/321: stat de/c1a 0 2024-09-10T09:36:21.865 INFO:tasks.workunit.client.1.smithi135.stdout:9/322: dread - de/df/d1d/d23/d25/d28/f49 zero size 2024-09-10T09:36:21.866 INFO:tasks.workunit.client.1.smithi135.stdout:6/388: write d5/dd/d50/d57/f6a [2382292,65721] 0 2024-09-10T09:36:21.867 INFO:tasks.workunit.client.1.smithi135.stdout:1/338: creat d1d/d20/d42/f60 x:0 0 0 2024-09-10T09:36:21.868 INFO:tasks.workunit.client.1.smithi135.stdout:6/389: creat d5/dd/f7e x:0 0 0 2024-09-10T09:36:21.869 INFO:tasks.workunit.client.1.smithi135.stdout:1/339: rmdir d1d/d20/d24/d37 39 2024-09-10T09:36:21.872 INFO:tasks.workunit.client.1.smithi135.stdout:1/340: symlink d1d/l61 0 2024-09-10T09:36:21.873 INFO:tasks.workunit.client.1.smithi135.stdout:9/323: write de/df/d1d/d1e/f22 [686125,3888] 0 2024-09-10T09:36:21.876 INFO:tasks.workunit.client.1.smithi135.stdout:9/324: rename l5 to de/l72 0 2024-09-10T09:36:21.877 INFO:tasks.workunit.client.1.smithi135.stdout:9/325: truncate de/f18 2269650 0 2024-09-10T09:36:21.879 INFO:tasks.workunit.client.1.smithi135.stdout:9/326: rename de/df/d1d/d1e/f22 to de/df/d1d/d23/d25/d28/d4e/f73 0 2024-09-10T09:36:21.879 INFO:tasks.workunit.client.1.smithi135.stdout:9/327: dread - de/df/d1d/d1e/d3f/f58 zero size 2024-09-10T09:36:21.888 INFO:tasks.workunit.client.1.smithi135.stdout:6/390: dwrite d5/d1e/d3b/f41 [0,4194304] 0 2024-09-10T09:36:21.888 INFO:tasks.workunit.client.1.smithi135.stdout:6/391: fsync d5/f6 0 2024-09-10T09:36:21.890 INFO:tasks.workunit.client.1.smithi135.stdout:6/392: mkdir d5/d1e/d3b/d42/d2d/d7f 0 2024-09-10T09:36:21.890 INFO:tasks.workunit.client.1.smithi135.stdout:6/393: dread - d5/d1e/d3b/d42/f7d zero size 2024-09-10T09:36:21.891 INFO:tasks.workunit.client.1.smithi135.stdout:6/394: symlink d5/d1e/d35/d65/l80 0 2024-09-10T09:36:21.898 INFO:tasks.workunit.client.1.smithi135.stdout:9/328: dwrite f6 [0,4194304] 0 2024-09-10T09:36:21.900 INFO:tasks.workunit.client.1.smithi135.stdout:9/329: unlink de/df/d1d/d1e/d3f/l44 0 2024-09-10T09:36:21.905 INFO:tasks.workunit.client.1.smithi135.stdout:9/330: dread de/df/f10 [0,4194304] 0 2024-09-10T09:36:21.905 INFO:tasks.workunit.client.1.smithi135.stdout:9/331: write de/df/d1d/d1e/d68/f71 [710001,31966] 0 2024-09-10T09:36:21.907 INFO:tasks.workunit.client.1.smithi135.stdout:9/332: rename de/df/d1d/d1e/d68/f71 to de/df/d1d/d23/d25/f74 0 2024-09-10T09:36:21.907 INFO:tasks.workunit.client.1.smithi135.stdout:9/333: fdatasync de/f18 0 2024-09-10T09:36:21.914 INFO:tasks.workunit.client.1.smithi135.stdout:6/395: dwrite d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:21.919 INFO:tasks.workunit.client.1.smithi135.stdout:6/396: rename d5/d1e/d3b/d42/d2d/d7f to d5/dd/d50/d57/d81 0 2024-09-10T09:36:21.919 INFO:tasks.workunit.client.1.smithi135.stdout:6/397: creat d5/d1e/d62/f82 x:0 0 0 2024-09-10T09:36:21.921 INFO:tasks.workunit.client.1.smithi135.stdout:9/334: write de/f15 [1709090,3091] 0 2024-09-10T09:36:21.926 INFO:tasks.workunit.client.1.smithi135.stdout:9/335: truncate de/df/f3d 226319 0 2024-09-10T09:36:21.926 INFO:tasks.workunit.client.1.smithi135.stdout:9/336: read de/df/d1d/f1f [2254530,81151] 0 2024-09-10T09:36:21.932 INFO:tasks.workunit.client.1.smithi135.stdout:9/337: symlink de/df/d1d/l75 0 2024-09-10T09:36:21.934 INFO:tasks.workunit.client.1.smithi135.stdout:9/338: mknod de/df/d1d/d23/d25/c76 0 2024-09-10T09:36:21.941 INFO:tasks.workunit.client.1.smithi135.stdout:6/398: dwrite d5/d1e/d3b/d42/f2a [0,4194304] 0 2024-09-10T09:36:21.950 INFO:tasks.workunit.client.1.smithi135.stdout:9/339: write f9 [1394372,91182] 0 2024-09-10T09:36:21.956 INFO:tasks.workunit.client.1.smithi135.stdout:7/329: rmdir d2/d15/d41/d49 39 2024-09-10T09:36:21.960 INFO:tasks.workunit.client.1.smithi135.stdout:9/340: getdents de/df/d1d/d1e/d52 0 2024-09-10T09:36:21.960 INFO:tasks.workunit.client.1.smithi135.stdout:9/341: dread - de/df/f5a zero size 2024-09-10T09:36:21.960 INFO:tasks.workunit.client.1.smithi135.stdout:9/342: truncate de/df/d1d/d23/f67 15457 0 2024-09-10T09:36:21.961 INFO:tasks.workunit.client.1.smithi135.stdout:9/343: chown de/c29 37376132 1 2024-09-10T09:36:21.961 INFO:tasks.workunit.client.1.smithi135.stdout:9/344: mknod de/df/d1d/d1e/d68/c77 0 2024-09-10T09:36:21.961 INFO:tasks.workunit.client.1.smithi135.stdout:9/345: readlink de/df/d1d/d23/d25/l56 0 2024-09-10T09:36:21.965 INFO:tasks.workunit.client.1.smithi135.stdout:6/399: dwrite d5/d1e/d3b/d42/f2e [0,4194304] 0 2024-09-10T09:36:21.970 INFO:tasks.workunit.client.1.smithi135.stdout:6/400: creat d5/d1e/d35/f83 x:0 0 0 2024-09-10T09:36:21.972 INFO:tasks.workunit.client.1.smithi135.stdout:7/330: dread d2/d15/d41/d49/d60/f43 [0,4194304] 0 2024-09-10T09:36:21.972 INFO:tasks.workunit.client.1.smithi135.stdout:7/331: chown d2/d15/d41/d49/d60/c17 3 1 2024-09-10T09:36:21.976 INFO:tasks.workunit.client.1.smithi135.stdout:9/346: dread f9 [0,4194304] 0 2024-09-10T09:36:21.976 INFO:tasks.workunit.client.1.smithi135.stdout:9/347: chown de/df/d1d/d23/d25/d28/f4c 105771750 1 2024-09-10T09:36:21.977 INFO:tasks.workunit.client.1.smithi135.stdout:7/332: unlink d2/ca 0 2024-09-10T09:36:21.977 INFO:tasks.workunit.client.1.smithi135.stdout:7/333: chown d2/d15/d41/d49/d60/f43 420 1 2024-09-10T09:36:21.981 INFO:tasks.workunit.client.1.smithi135.stdout:7/334: getdents d2/d26 0 2024-09-10T09:36:21.981 INFO:tasks.workunit.client.1.smithi135.stdout:7/335: creat d2/d15/d4a/d36/f6a x:0 0 0 2024-09-10T09:36:21.981 INFO:tasks.workunit.client.1.smithi135.stdout:7/336: chown d2/f10 812 1 2024-09-10T09:36:21.982 INFO:tasks.workunit.client.1.smithi135.stdout:7/337: chown d2/d15/c3e 1 1 2024-09-10T09:36:21.982 INFO:tasks.workunit.client.1.smithi135.stdout:7/338: write d2/d15/f20 [1232933,43433] 0 2024-09-10T09:36:21.991 INFO:tasks.workunit.client.1.smithi135.stdout:6/401: dwrite d5/dd/d50/d57/f6a [0,4194304] 0 2024-09-10T09:36:22.010 INFO:tasks.workunit.client.1.smithi135.stdout:9/348: getdents de/df/d1d/d23/d25 0 2024-09-10T09:36:22.013 INFO:tasks.workunit.client.1.smithi135.stdout:9/349: mkdir de/df/d1d/d23/d25/d78 0 2024-09-10T09:36:22.018 INFO:tasks.workunit.client.1.smithi135.stdout:9/350: symlink de/df/d1d/d23/d25/l79 0 2024-09-10T09:36:22.019 INFO:tasks.workunit.client.1.smithi135.stdout:9/351: dread de/f4a [0,4194304] 0 2024-09-10T09:36:22.020 INFO:tasks.workunit.client.1.smithi135.stdout:6/402: dwrite d5/dd/d50/f7b [0,4194304] 0 2024-09-10T09:36:22.021 INFO:tasks.workunit.client.1.smithi135.stdout:9/352: chown de/df/d1d/d23/d25/d5c/f6d 6039 1 2024-09-10T09:36:22.030 INFO:tasks.workunit.client.1.smithi135.stdout:6/403: creat d5/d1e/d35/d65/f84 x:0 0 0 2024-09-10T09:36:22.030 INFO:tasks.workunit.client.1.smithi135.stdout:6/404: dread - d5/d1e/d35/f83 zero size 2024-09-10T09:36:22.032 INFO:tasks.workunit.client.1.smithi135.stdout:6/405: read d5/dd/f6e [630451,128091] 0 2024-09-10T09:36:22.034 INFO:tasks.workunit.client.1.smithi135.stdout:9/353: write de/df/d1d/d23/d25/d28/f39 [4402897,104710] 0 2024-09-10T09:36:22.037 INFO:tasks.workunit.client.1.smithi135.stdout:6/406: mknod d5/d1e/d35/d65/c85 0 2024-09-10T09:36:22.041 INFO:tasks.workunit.client.1.smithi135.stdout:7/339: rmdir d2/d15/d4a/d36 39 2024-09-10T09:36:22.041 INFO:tasks.workunit.client.1.smithi135.stdout:7/340: write d2/d15/d41/d49/d60/f27 [409451,5458] 0 2024-09-10T09:36:22.041 INFO:tasks.workunit.client.1.smithi135.stdout:7/341: fdatasync d2/f10 0 2024-09-10T09:36:22.041 INFO:tasks.workunit.client.1.smithi135.stdout:7/342: write d2/d25/f2a [1184253,6711] 0 2024-09-10T09:36:22.053 INFO:tasks.workunit.client.1.smithi135.stdout:6/407: dread d5/d1e/d3b/d42/d2d/d55/d5b/f5e [0,4194304] 0 2024-09-10T09:36:22.055 INFO:tasks.workunit.client.1.smithi135.stdout:7/343: truncate d2/d15/f20 230991 0 2024-09-10T09:36:22.056 INFO:tasks.workunit.client.1.smithi135.stdout:6/408: mkdir d5/dd/d50/d86 0 2024-09-10T09:36:22.057 INFO:tasks.workunit.client.1.smithi135.stdout:6/409: mknod d5/d1e/d62/c87 0 2024-09-10T09:36:22.062 INFO:tasks.workunit.client.1.smithi135.stdout:6/410: unlink d5/d1e/d35/c13 0 2024-09-10T09:36:22.062 INFO:tasks.workunit.client.1.smithi135.stdout:6/411: read d5/d1e/d35/f4b [131425,47706] 0 2024-09-10T09:36:22.068 INFO:tasks.workunit.client.1.smithi135.stdout:6/412: symlink d5/d1e/d3b/d42/d2d/d55/d5b/l88 0 2024-09-10T09:36:22.075 INFO:tasks.workunit.client.1.smithi135.stdout:6/413: creat d5/dd/d50/d57/d81/f89 x:0 0 0 2024-09-10T09:36:22.081 INFO:tasks.workunit.client.1.smithi135.stdout:6/414: unlink d5/l46 0 2024-09-10T09:36:22.083 INFO:tasks.workunit.client.1.smithi135.stdout:6/415: unlink d5/ff 0 2024-09-10T09:36:22.084 INFO:tasks.workunit.client.1.smithi135.stdout:6/416: mkdir d5/d1e/d62/d8a 0 2024-09-10T09:36:22.085 INFO:tasks.workunit.client.1.smithi135.stdout:7/344: dwrite d2/d15/d41/d49/d60/d16/f28 [0,4194304] 0 2024-09-10T09:36:22.085 INFO:tasks.workunit.client.1.smithi135.stdout:6/417: mknod d5/d1e/d3b/d42/d2d/d64/c8b 0 2024-09-10T09:36:22.087 INFO:tasks.workunit.client.1.smithi135.stdout:6/418: rename d5/dd/d50/d57/c78 to d5/dd/d50/d57/c8c 0 2024-09-10T09:36:22.088 INFO:tasks.workunit.client.1.smithi135.stdout:6/419: unlink d5/dd/d50/d57/d81/f89 0 2024-09-10T09:36:22.096 INFO:tasks.workunit.client.1.smithi135.stdout:7/345: dread d2/d15/d4a/f12 [0,4194304] 0 2024-09-10T09:36:22.098 INFO:tasks.workunit.client.1.smithi135.stdout:7/346: mkdir d2/d15/d41/d49/d60/d30/d6b 0 2024-09-10T09:36:22.109 INFO:tasks.workunit.client.1.smithi135.stdout:2/361: sync 2024-09-10T09:36:22.109 INFO:tasks.workunit.client.1.smithi135.stdout:2/362: chown df/d15/f24 60419 1 2024-09-10T09:36:22.110 INFO:tasks.workunit.client.1.smithi135.stdout:6/420: dwrite d5/d15/d27/f3f [0,4194304] 0 2024-09-10T09:36:22.112 INFO:tasks.workunit.client.1.smithi135.stdout:6/421: link d5/f6b d5/d1e/d62/d8a/f8d 0 2024-09-10T09:36:22.114 INFO:tasks.workunit.client.1.smithi135.stdout:7/347: dread d2/d15/d41/d49/d60/f67 [0,4194304] 0 2024-09-10T09:36:22.114 INFO:tasks.workunit.client.1.smithi135.stdout:7/348: creat d2/d15/d41/f6c x:0 0 0 2024-09-10T09:36:22.114 INFO:tasks.workunit.client.1.smithi135.stdout:7/349: truncate d2/d15/d4a/d36/f59 994447 0 2024-09-10T09:36:22.114 INFO:tasks.workunit.client.1.smithi135.stdout:2/363: dread df/d1b/d23/d36/f3a [0,4194304] 0 2024-09-10T09:36:22.114 INFO:tasks.workunit.client.1.smithi135.stdout:2/364: write df/d1b/d23/d36/f55 [217704,40026] 0 2024-09-10T09:36:22.114 INFO:tasks.workunit.client.1.smithi135.stdout:6/422: symlink d5/dd/d50/l8e 0 2024-09-10T09:36:22.119 INFO:tasks.workunit.client.1.smithi135.stdout:7/350: rename d2/d15/d41/d49/d60/d30/f69 to d2/d15/d39/f6d 0 2024-09-10T09:36:22.121 INFO:tasks.workunit.client.1.smithi135.stdout:2/365: rename df/d13/d4f/f5e to df/d1b/d23/d42/f6e 0 2024-09-10T09:36:22.124 INFO:tasks.workunit.client.1.smithi135.stdout:7/351: rename d2/d15/d41/d49/d60/c51 to d2/d15/c6e 0 2024-09-10T09:36:22.125 INFO:tasks.workunit.client.1.smithi135.stdout:7/352: mkdir d2/d15/d39/d6f 0 2024-09-10T09:36:22.134 INFO:tasks.workunit.client.1.smithi135.stdout:7/353: dread d2/d15/d4a/fe [0,4194304] 0 2024-09-10T09:36:22.138 INFO:tasks.workunit.client.1.smithi135.stdout:6/423: dwrite d5/d1e/d3b/f41 [0,4194304] 0 2024-09-10T09:36:22.138 INFO:tasks.workunit.client.1.smithi135.stdout:6/424: stat d5/d1e/d62/c87 0 2024-09-10T09:36:22.139 INFO:tasks.workunit.client.1.smithi135.stdout:6/425: stat d5/d15/l1a 0 2024-09-10T09:36:22.139 INFO:tasks.workunit.client.1.smithi135.stdout:6/426: fsync d5/f11 0 2024-09-10T09:36:22.139 INFO:tasks.workunit.client.1.smithi135.stdout:6/427: chown d5/dd/c1b 464 1 2024-09-10T09:36:22.139 INFO:tasks.workunit.client.1.smithi135.stdout:0/420: sync 2024-09-10T09:36:22.140 INFO:tasks.workunit.client.1.smithi135.stdout:0/421: chown d8/d1c/d37/l87 3915034 1 2024-09-10T09:36:22.140 INFO:tasks.workunit.client.1.smithi135.stdout:6/428: unlink d5/c8 0 2024-09-10T09:36:22.150 INFO:tasks.workunit.client.1.smithi135.stdout:0/422: write d8/f26 [482727,61801] 0 2024-09-10T09:36:22.152 INFO:tasks.workunit.client.1.smithi135.stdout:0/423: rename d8/dd/d18/c66 to d8/d80/c89 0 2024-09-10T09:36:22.152 INFO:tasks.workunit.client.1.smithi135.stdout:0/424: creat d8/d1c/d61/f8a x:0 0 0 2024-09-10T09:36:22.154 INFO:tasks.workunit.client.1.smithi135.stdout:0/425: rename d8/d1c/d37/f83 to d8/d80/f8b 0 2024-09-10T09:36:22.155 INFO:tasks.workunit.client.1.smithi135.stdout:6/429: dwrite d5/dd/f6e [0,4194304] 0 2024-09-10T09:36:22.155 INFO:tasks.workunit.client.1.smithi135.stdout:6/430: readlink d5/l9 0 2024-09-10T09:36:22.156 INFO:tasks.workunit.client.1.smithi135.stdout:6/431: chown d5/d1e/l4e 1 1 2024-09-10T09:36:22.156 INFO:tasks.workunit.client.1.smithi135.stdout:0/426: mkdir d8/d1c/d37/d73/d7f/d8c 0 2024-09-10T09:36:22.156 INFO:tasks.workunit.client.1.smithi135.stdout:0/427: fdatasync d8/dd/f35 0 2024-09-10T09:36:22.181 INFO:tasks.workunit.client.1.smithi135.stdout:6/432: dwrite d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:22.181 INFO:tasks.workunit.client.1.smithi135.stdout:0/428: dwrite d8/d1c/d37/d7a/f7b [0,4194304] 0 2024-09-10T09:36:22.207 INFO:tasks.workunit.client.1.smithi135.stdout:6/433: dwrite d5/d1e/d35/f30 [0,4194304] 0 2024-09-10T09:36:22.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/429: dwrite d8/dd/f10 [0,4194304] 0 2024-09-10T09:36:22.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:21 smithi079 ceph-mon[27592]: pgmap v265: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 215 MiB/s rd, 246 MiB/s wr, 405 op/s 2024-09-10T09:36:22.211 INFO:tasks.workunit.client.1.smithi135.stdout:0/430: dread d8/dd/d18/f43 [0,4194304] 0 2024-09-10T09:36:22.214 INFO:tasks.workunit.client.1.smithi135.stdout:0/431: creat d8/de/d2e/f8d x:0 0 0 2024-09-10T09:36:22.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:21 smithi135 ceph-mon[33411]: pgmap v265: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 215 MiB/s rd, 246 MiB/s wr, 405 op/s 2024-09-10T09:36:22.218 INFO:tasks.workunit.client.1.smithi135.stdout:6/434: write d5/d15/f22 [1816841,66277] 0 2024-09-10T09:36:22.221 INFO:tasks.workunit.client.1.smithi135.stdout:6/435: mkdir d5/d1e/d3b/d42/d2d/d8f 0 2024-09-10T09:36:22.222 INFO:tasks.workunit.client.1.smithi135.stdout:6/436: write d5/d15/f1c [1386043,13004] 0 2024-09-10T09:36:22.229 INFO:tasks.workunit.client.1.smithi135.stdout:0/432: dwrite d8/d1c/d37/f64 [0,4194304] 0 2024-09-10T09:36:22.230 INFO:tasks.workunit.client.1.smithi135.stdout:0/433: truncate d8/d1c/d37/f58 5012482 0 2024-09-10T09:36:22.230 INFO:tasks.workunit.client.1.smithi135.stdout:0/434: write d8/dd/d1e/f49 [112893,1908] 0 2024-09-10T09:36:22.231 INFO:tasks.workunit.client.1.smithi135.stdout:6/437: rmdir d5/d1e/d3b/d42/d3c 39 2024-09-10T09:36:22.231 INFO:tasks.workunit.client.1.smithi135.stdout:6/438: truncate d5/d1e/d3b/d42/d3c/f59 346343 0 2024-09-10T09:36:22.237 INFO:tasks.workunit.client.1.smithi135.stdout:0/435: mkdir d8/de/d8e 0 2024-09-10T09:36:22.239 INFO:tasks.workunit.client.1.smithi135.stdout:6/439: unlink d5/d1e/d3b/d42/f2e 0 2024-09-10T09:36:22.241 INFO:tasks.workunit.client.1.smithi135.stdout:0/436: mkdir d8/d1c/d8f 0 2024-09-10T09:36:22.274 INFO:tasks.workunit.client.1.smithi135.stdout:6/440: dwrite d5/d1e/d3b/d42/d3c/f47 [0,4194304] 0 2024-09-10T09:36:22.274 INFO:tasks.workunit.client.1.smithi135.stdout:0/437: dwrite d8/de/f68 [0,4194304] 0 2024-09-10T09:36:22.277 INFO:tasks.workunit.client.1.smithi135.stdout:6/441: rename f3 to d5/d15/d56/f90 0 2024-09-10T09:36:22.277 INFO:tasks.workunit.client.1.smithi135.stdout:6/442: truncate d5/d1e/d3b/f77 835940 0 2024-09-10T09:36:22.282 INFO:tasks.workunit.client.1.smithi135.stdout:0/438: unlink d8/d1c/d61/f74 0 2024-09-10T09:36:22.285 INFO:tasks.workunit.client.1.smithi135.stdout:6/443: unlink d5/d1e/d35/l24 0 2024-09-10T09:36:22.288 INFO:tasks.workunit.client.1.smithi135.stdout:0/439: dread d8/dd/d4a/d50/d54/d5f/f30 [0,4194304] 0 2024-09-10T09:36:22.303 INFO:tasks.workunit.client.1.smithi135.stdout:6/444: dwrite d5/d1e/d3b/f77 [0,4194304] 0 2024-09-10T09:36:22.303 INFO:tasks.workunit.client.1.smithi135.stdout:6/445: dread - d5/d1e/f67 zero size 2024-09-10T09:36:22.402 INFO:tasks.workunit.client.1.smithi135.stdout:0/440: mkdir d8/dd/d11/d90 0 2024-09-10T09:36:22.404 INFO:tasks.workunit.client.1.smithi135.stdout:0/441: dread d8/dd/d4a/d50/d54/d5f/f85 [0,4194304] 0 2024-09-10T09:36:22.409 INFO:tasks.workunit.client.1.smithi135.stdout:6/446: creat d5/d1e/d3b/d42/d2d/d55/d5b/f91 x:0 0 0 2024-09-10T09:36:22.421 INFO:tasks.workunit.client.1.smithi135.stdout:0/442: dwrite d8/de/f4d [4194304,4194304] 0 2024-09-10T09:36:22.432 INFO:tasks.workunit.client.1.smithi135.stdout:0/443: dread d8/dd/d1e/f23 [0,4194304] 0 2024-09-10T09:36:22.432 INFO:tasks.workunit.client.1.smithi135.stdout:0/444: creat d8/de/d2e/f91 x:0 0 0 2024-09-10T09:36:22.432 INFO:tasks.workunit.client.1.smithi135.stdout:0/445: fsync f4 0 2024-09-10T09:36:22.435 INFO:tasks.workunit.client.1.smithi135.stdout:6/447: rename d5/d1e/f28 to d5/dd/f92 0 2024-09-10T09:36:22.435 INFO:tasks.workunit.client.1.smithi135.stdout:6/448: stat d5/d1e/c66 0 2024-09-10T09:36:22.440 INFO:tasks.workunit.client.1.smithi135.stdout:0/446: creat d8/dd/d11/f92 x:0 0 0 2024-09-10T09:36:22.442 INFO:tasks.workunit.client.1.smithi135.stdout:0/447: creat d8/d1c/d8f/f93 x:0 0 0 2024-09-10T09:36:22.442 INFO:tasks.workunit.client.1.smithi135.stdout:0/448: creat d8/d1c/d61/f94 x:0 0 0 2024-09-10T09:36:22.445 INFO:tasks.workunit.client.1.smithi135.stdout:6/449: write d5/f17 [1467273,39557] 0 2024-09-10T09:36:22.445 INFO:tasks.workunit.client.1.smithi135.stdout:0/449: mknod d8/d1c/c95 0 2024-09-10T09:36:22.448 INFO:tasks.workunit.client.1.smithi135.stdout:6/450: symlink d5/d1e/d3b/d42/d2d/d64/l93 0 2024-09-10T09:36:22.451 INFO:tasks.workunit.client.1.smithi135.stdout:0/450: stat d8/de/d2e/c44 0 2024-09-10T09:36:22.451 INFO:tasks.workunit.client.1.smithi135.stdout:0/451: stat d8 0 2024-09-10T09:36:22.452 INFO:tasks.workunit.client.1.smithi135.stdout:6/451: creat d5/d1e/d3b/d49/f94 x:0 0 0 2024-09-10T09:36:22.452 INFO:tasks.workunit.client.1.smithi135.stdout:4/484: sync 2024-09-10T09:36:22.460 INFO:tasks.workunit.client.1.smithi135.stdout:0/452: symlink d8/dd/d18/d3d/l96 0 2024-09-10T09:36:22.484 INFO:tasks.workunit.client.1.smithi135.stdout:6/452: dwrite d5/d1e/f67 [0,4194304] 0 2024-09-10T09:36:22.485 INFO:tasks.workunit.client.1.smithi135.stdout:4/485: dwrite d1/db/d23/f3e [4194304,4194304] 0 2024-09-10T09:36:22.485 INFO:tasks.workunit.client.1.smithi135.stdout:6/453: dread - d5/d1e/d35/f83 zero size 2024-09-10T09:36:22.485 INFO:tasks.workunit.client.1.smithi135.stdout:0/453: dwrite d8/dd/d4a/f84 [0,4194304] 0 2024-09-10T09:36:22.485 INFO:tasks.workunit.client.1.smithi135.stdout:0/454: readlink d8/dd/d18/d3d/l96 0 2024-09-10T09:36:22.485 INFO:tasks.workunit.client.1.smithi135.stdout:0/455: write d8/de/f38 [142729,59730] 0 2024-09-10T09:36:22.485 INFO:tasks.workunit.client.1.smithi135.stdout:0/456: write d8/dd/d11/f1f [4357185,92157] 0 2024-09-10T09:36:22.599 INFO:tasks.workunit.client.1.smithi135.stdout:4/486: mkdir d1/de/d16/d98 0 2024-09-10T09:36:22.604 INFO:tasks.workunit.client.1.smithi135.stdout:4/487: dread d1/f19 [0,4194304] 0 2024-09-10T09:36:22.605 INFO:tasks.workunit.client.1.smithi135.stdout:4/488: write d1/d33/f6e [197220,130424] 0 2024-09-10T09:36:22.608 INFO:tasks.workunit.client.1.smithi135.stdout:0/457: mkdir d8/dd/d33/d97 0 2024-09-10T09:36:22.608 INFO:tasks.workunit.client.1.smithi135.stdout:6/454: getdents d5/d1e/d3b/d42/d2d/d64 0 2024-09-10T09:36:22.617 INFO:tasks.workunit.client.1.smithi135.stdout:6/455: write d5/d1e/d3b/d42/d3c/f47 [2670114,94450] 0 2024-09-10T09:36:22.617 INFO:tasks.workunit.client.1.smithi135.stdout:6/456: write d5/d1e/d3b/d42/d3c/d44/f76 [603647,121206] 0 2024-09-10T09:36:22.620 INFO:tasks.workunit.client.1.smithi135.stdout:6/457: rename d5/dd/f7e to d5/d15/d56/f95 0 2024-09-10T09:36:22.621 INFO:tasks.workunit.client.1.smithi135.stdout:6/458: write d5/f6b [530461,94590] 0 2024-09-10T09:36:22.622 INFO:tasks.workunit.client.1.smithi135.stdout:0/458: dread d8/dd/d4a/f84 [0,4194304] 0 2024-09-10T09:36:22.622 INFO:tasks.workunit.client.1.smithi135.stdout:0/459: write d8/dd/d4a/f79 [301719,56935] 0 2024-09-10T09:36:22.622 INFO:tasks.workunit.client.1.smithi135.stdout:0/460: fdatasync d8/dd/d4a/d50/d54/d5f/d4b/f75 0 2024-09-10T09:36:22.622 INFO:tasks.workunit.client.1.smithi135.stdout:0/461: creat d8/d1c/f98 x:0 0 0 2024-09-10T09:36:22.629 INFO:tasks.workunit.client.1.smithi135.stdout:0/462: symlink d8/dd/d1e/l99 0 2024-09-10T09:36:22.632 INFO:tasks.workunit.client.1.smithi135.stdout:0/463: creat d8/dd/d4a/d50/d54/f9a x:0 0 0 2024-09-10T09:36:22.632 INFO:tasks.workunit.client.1.smithi135.stdout:0/464: write d8/dd/f77 [71069,47522] 0 2024-09-10T09:36:22.643 INFO:tasks.workunit.client.1.smithi135.stdout:0/465: read d8/d1c/d37/f64 [2695542,28454] 0 2024-09-10T09:36:22.644 INFO:tasks.workunit.client.1.smithi135.stdout:4/489: dwrite d1/db/d23/f3e [0,4194304] 0 2024-09-10T09:36:22.644 INFO:tasks.workunit.client.1.smithi135.stdout:6/459: dwrite d5/d1e/d3b/d42/f7d [0,4194304] 0 2024-09-10T09:36:22.645 INFO:tasks.workunit.client.1.smithi135.stdout:0/466: mknod d8/de/c9b 0 2024-09-10T09:36:22.645 INFO:tasks.workunit.client.1.smithi135.stdout:0/467: write d8/f26 [456518,32365] 0 2024-09-10T09:36:22.651 INFO:tasks.workunit.client.1.smithi135.stdout:6/460: dread d5/d1e/d3b/d42/d3c/d44/f76 [0,4194304] 0 2024-09-10T09:36:22.656 INFO:tasks.workunit.client.1.smithi135.stdout:4/490: read d1/de/f57 [7836,103268] 0 2024-09-10T09:36:22.656 INFO:tasks.workunit.client.1.smithi135.stdout:4/491: chown d1/d85/l8f 13 1 2024-09-10T09:36:22.656 INFO:tasks.workunit.client.1.smithi135.stdout:4/492: chown d1/db/d9/l24 0 1 2024-09-10T09:36:22.656 INFO:tasks.workunit.client.1.smithi135.stdout:4/493: chown d1/db/d9/l24 1 1 2024-09-10T09:36:22.659 INFO:tasks.workunit.client.1.smithi135.stdout:6/461: dread d5/d1e/d35/f30 [0,4194304] 0 2024-09-10T09:36:22.671 INFO:tasks.workunit.client.1.smithi135.stdout:4/494: rename d1/db/d9/f62 to d1/d33/d40/f99 0 2024-09-10T09:36:22.675 INFO:tasks.workunit.client.1.smithi135.stdout:6/462: dwrite d5/d1e/d35/f83 [0,4194304] 0 2024-09-10T09:36:22.676 INFO:tasks.workunit.client.1.smithi135.stdout:4/495: link d1/d33/d40/c49 d1/de/d16/d95/c9a 0 2024-09-10T09:36:22.683 INFO:tasks.workunit.client.1.smithi135.stdout:6/463: link d5/d1e/d3b/d42/d3c/l7a d5/d58/l96 0 2024-09-10T09:36:22.687 INFO:tasks.workunit.client.1.smithi135.stdout:4/496: symlink d1/d4a/d6d/l9b 0 2024-09-10T09:36:22.689 INFO:tasks.workunit.client.1.smithi135.stdout:6/464: truncate d5/d15/d27/f52 1326268 0 2024-09-10T09:36:22.689 INFO:tasks.workunit.client.1.smithi135.stdout:6/465: write d5/d1e/f2f [319196,73384] 0 2024-09-10T09:36:22.691 INFO:tasks.workunit.client.1.smithi135.stdout:4/497: truncate d1/de/f34 1537442 0 2024-09-10T09:36:22.696 INFO:tasks.workunit.client.1.smithi135.stdout:6/466: creat d5/d1e/d3b/d42/d2d/d8f/f97 x:0 0 0 2024-09-10T09:36:22.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/467: chown d5/d1e/d3b/d42/d2d/d55/l72 650 1 2024-09-10T09:36:22.704 INFO:tasks.workunit.client.1.smithi135.stdout:6/468: read d5/d1e/f67 [324056,120194] 0 2024-09-10T09:36:22.707 INFO:tasks.workunit.client.1.smithi135.stdout:4/498: dwrite d1/d4a/f51 [0,4194304] 0 2024-09-10T09:36:22.709 INFO:tasks.workunit.client.1.smithi135.stdout:6/469: dread d5/d1e/d62/d8a/f8d [0,4194304] 0 2024-09-10T09:36:22.714 INFO:tasks.workunit.client.1.smithi135.stdout:4/499: symlink d1/db/d9/d55/d70/d92/l9c 0 2024-09-10T09:36:22.715 INFO:tasks.workunit.client.1.smithi135.stdout:6/470: mknod d5/d58/c98 0 2024-09-10T09:36:22.719 INFO:tasks.workunit.client.1.smithi135.stdout:6/471: mknod d5/d1e/d3b/d42/d2d/d64/c99 0 2024-09-10T09:36:22.719 INFO:tasks.workunit.client.1.smithi135.stdout:6/472: write d5/d1e/d3b/d42/d2d/f31 [4973522,12806] 0 2024-09-10T09:36:22.719 INFO:tasks.workunit.client.1.smithi135.stdout:6/473: truncate d5/d1e/d62/f82 155741 0 2024-09-10T09:36:22.720 INFO:tasks.workunit.client.1.smithi135.stdout:4/500: rmdir d1/de/d16 39 2024-09-10T09:36:22.725 INFO:tasks.workunit.client.1.smithi135.stdout:4/501: mkdir d1/d4a/d9d 0 2024-09-10T09:36:22.727 INFO:tasks.workunit.client.1.smithi135.stdout:6/474: rmdir d5/dd 39 2024-09-10T09:36:22.728 INFO:tasks.workunit.client.1.smithi135.stdout:6/475: chown d5/d1e/l4e 16095 1 2024-09-10T09:36:22.728 INFO:tasks.workunit.client.1.smithi135.stdout:6/476: chown d5/d15/f25 224691320 1 2024-09-10T09:36:22.728 INFO:tasks.workunit.client.1.smithi135.stdout:6/477: read d5/d15/d27/f52 [1233532,100504] 0 2024-09-10T09:36:22.729 INFO:tasks.workunit.client.1.smithi135.stdout:4/502: unlink d1/db/l4b 0 2024-09-10T09:36:22.731 INFO:tasks.workunit.client.1.smithi135.stdout:6/478: rename d5/dd/l19 to d5/d15/l9a 0 2024-09-10T09:36:22.737 INFO:tasks.workunit.client.1.smithi135.stdout:4/503: write d1/de/d16/f68 [2018271,6022] 0 2024-09-10T09:36:22.740 INFO:tasks.workunit.client.1.smithi135.stdout:6/479: write d5/d15/f22 [4953807,71451] 0 2024-09-10T09:36:22.742 INFO:tasks.workunit.client.1.smithi135.stdout:4/504: write d1/f22 [1189920,47431] 0 2024-09-10T09:36:22.742 INFO:tasks.workunit.client.1.smithi135.stdout:4/505: chown d1/db/d9/d55/d76/f7f 4 1 2024-09-10T09:36:22.742 INFO:tasks.workunit.client.1.smithi135.stdout:2/366: sync 2024-09-10T09:36:22.742 INFO:tasks.workunit.client.1.smithi135.stdout:1/341: sync 2024-09-10T09:36:22.742 INFO:tasks.workunit.client.1.smithi135.stdout:8/376: sync 2024-09-10T09:36:22.742 INFO:tasks.workunit.client.1.smithi135.stdout:5/317: sync 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:9/354: sync 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:1/342: creat d1d/d20/d24/d2b/d4c/f62 x:0 0 0 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:3/300: sync 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:8/377: creat d1/d15/d16/d33/d45/f87 x:0 0 0 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:1/343: stat d1d/f1e 0 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:1/344: stat c17 0 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:1/345: fdatasync d1d/d20/f46 0 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:1/346: chown d1d/f58 32660012 1 2024-09-10T09:36:22.743 INFO:tasks.workunit.client.1.smithi135.stdout:7/354: sync 2024-09-10T09:36:22.744 INFO:tasks.workunit.client.1.smithi135.stdout:6/480: link d5/d1e/d3b/d42/f7d d5/d1e/d35/f9b 0 2024-09-10T09:36:22.744 INFO:tasks.workunit.client.1.smithi135.stdout:4/506: truncate d1/de/d16/f5b 3159281 0 2024-09-10T09:36:22.746 INFO:tasks.workunit.client.1.smithi135.stdout:2/367: mknod df/d13/d52/c6f 0 2024-09-10T09:36:22.746 INFO:tasks.workunit.client.1.smithi135.stdout:2/368: fsync df/d1b/f26 0 2024-09-10T09:36:22.746 INFO:tasks.workunit.client.1.smithi135.stdout:6/481: dread d5/d15/f1c [0,4194304] 0 2024-09-10T09:36:22.749 INFO:tasks.workunit.client.1.smithi135.stdout:5/318: unlink d3/dc/d16/f19 0 2024-09-10T09:36:22.754 INFO:tasks.workunit.client.1.smithi135.stdout:8/378: rename d1/d27/l2b to d1/d15/d16/d33/d45/d70/l88 0 2024-09-10T09:36:22.756 INFO:tasks.workunit.client.1.smithi135.stdout:9/355: creat de/df/d1d/d23/d25/d28/d4e/f7a x:0 0 0 2024-09-10T09:36:22.756 INFO:tasks.workunit.client.1.smithi135.stdout:9/356: chown de/df/c2a 7613 1 2024-09-10T09:36:22.758 INFO:tasks.workunit.client.1.smithi135.stdout:3/301: symlink d4/d5/db/d1b/l5a 0 2024-09-10T09:36:22.760 INFO:tasks.workunit.client.1.smithi135.stdout:1/347: mkdir d1d/d20/d24/d2b/d4c/d63 0 2024-09-10T09:36:22.763 INFO:tasks.workunit.client.1.smithi135.stdout:7/355: creat d2/d15/d41/d49/d60/d30/f70 x:0 0 0 2024-09-10T09:36:22.764 INFO:tasks.workunit.client.1.smithi135.stdout:3/302: write d4/d5/db/d36/f53 [3016433,91337] 0 2024-09-10T09:36:22.764 INFO:tasks.workunit.client.1.smithi135.stdout:4/507: write d1/de/d16/f3f [1238002,26513] 0 2024-09-10T09:36:22.767 INFO:tasks.workunit.client.1.smithi135.stdout:7/356: write d2/d15/f1c [149772,26642] 0 2024-09-10T09:36:22.767 INFO:tasks.workunit.client.1.smithi135.stdout:7/357: chown d2/d26/c40 1029131 1 2024-09-10T09:36:22.767 INFO:tasks.workunit.client.1.smithi135.stdout:1/348: dread d1d/d20/f46 [0,4194304] 0 2024-09-10T09:36:22.767 INFO:tasks.workunit.client.1.smithi135.stdout:1/349: fdatasync d1d/d20/d3c/f5f 0 2024-09-10T09:36:22.767 INFO:tasks.workunit.client.1.smithi135.stdout:1/350: stat d1d/d20/d24/d2b/f44 0 2024-09-10T09:36:22.769 INFO:tasks.workunit.client.1.smithi135.stdout:1/351: dread f11 [0,4194304] 0 2024-09-10T09:36:22.770 INFO:tasks.workunit.client.1.smithi135.stdout:6/482: mkdir d5/d1e/d3b/d42/d2d/d8f/d9c 0 2024-09-10T09:36:22.771 INFO:tasks.workunit.client.1.smithi135.stdout:5/319: truncate d3/dc/f37 4485605 0 2024-09-10T09:36:22.773 INFO:tasks.workunit.client.1.smithi135.stdout:2/369: dwrite df/d1b/d23/f48 [4194304,4194304] 0 2024-09-10T09:36:22.775 INFO:tasks.workunit.client.1.smithi135.stdout:8/379: getdents d1/d15 0 2024-09-10T09:36:22.777 INFO:tasks.workunit.client.1.smithi135.stdout:9/357: unlink de/c1a 0 2024-09-10T09:36:22.779 INFO:tasks.workunit.client.1.smithi135.stdout:3/303: truncate d4/f32 2223873 0 2024-09-10T09:36:22.779 INFO:tasks.workunit.client.1.smithi135.stdout:3/304: truncate d4/d5/dc/f50 522945 0 2024-09-10T09:36:22.780 INFO:tasks.workunit.client.1.smithi135.stdout:1/352: symlink d1d/d20/d3c/l64 0 2024-09-10T09:36:22.781 INFO:tasks.workunit.client.1.smithi135.stdout:6/483: truncate d5/d15/d27/f3d 1581823 0 2024-09-10T09:36:22.782 INFO:tasks.workunit.client.1.smithi135.stdout:5/320: mknod d3/dc/d16/d41/c66 0 2024-09-10T09:36:22.782 INFO:tasks.workunit.client.1.smithi135.stdout:5/321: creat d3/d26/d48/d57/f67 x:0 0 0 2024-09-10T09:36:22.782 INFO:tasks.workunit.client.1.smithi135.stdout:5/322: fdatasync d3/dc/d16/f2c 0 2024-09-10T09:36:22.783 INFO:tasks.workunit.client.1.smithi135.stdout:5/323: chown d3/f18 1283 1 2024-09-10T09:36:22.783 INFO:tasks.workunit.client.1.smithi135.stdout:5/324: creat d3/d26/f68 x:0 0 0 2024-09-10T09:36:22.786 INFO:tasks.workunit.client.1.smithi135.stdout:9/358: mkdir de/df/d1d/d23/d25/d28/d7b 0 2024-09-10T09:36:22.787 INFO:tasks.workunit.client.1.smithi135.stdout:1/353: rename c17 to d1d/d28/d4b/c65 0 2024-09-10T09:36:22.787 INFO:tasks.workunit.client.1.smithi135.stdout:1/354: dread - d1d/d20/d24/d2b/d4c/f62 zero size 2024-09-10T09:36:22.787 INFO:tasks.workunit.client.1.smithi135.stdout:1/355: stat d1d/d20/d3c/f3d 0 2024-09-10T09:36:22.788 INFO:tasks.workunit.client.1.smithi135.stdout:8/380: rmdir d1/d15/d49/d69 39 2024-09-10T09:36:22.789 INFO:tasks.workunit.client.1.smithi135.stdout:8/381: write d1/d15/f4d [900277,110347] 0 2024-09-10T09:36:22.789 INFO:tasks.workunit.client.1.smithi135.stdout:9/359: readlink de/df/d1d/d23/d25/l56 0 2024-09-10T09:36:22.791 INFO:tasks.workunit.client.1.smithi135.stdout:8/382: mknod d1/d15/d16/d33/d45/d70/c89 0 2024-09-10T09:36:22.792 INFO:tasks.workunit.client.1.smithi135.stdout:9/360: mkdir de/df/d1d/d1e/d3f/d7c 0 2024-09-10T09:36:22.792 INFO:tasks.workunit.client.1.smithi135.stdout:9/361: write de/f15 [4101978,14132] 0 2024-09-10T09:36:22.793 INFO:tasks.workunit.client.1.smithi135.stdout:5/325: rename d3/d26/d4e/d5d to d3/dc/d69 0 2024-09-10T09:36:22.794 INFO:tasks.workunit.client.1.smithi135.stdout:5/326: chown d3/c47 0 1 2024-09-10T09:36:22.795 INFO:tasks.workunit.client.1.smithi135.stdout:8/383: symlink d1/d15/d24/l8a 0 2024-09-10T09:36:22.795 INFO:tasks.workunit.client.1.smithi135.stdout:8/384: write d1/d15/d16/f75 [118596,78128] 0 2024-09-10T09:36:22.801 INFO:tasks.workunit.client.1.smithi135.stdout:9/362: dread de/df/d1d/f3a [0,4194304] 0 2024-09-10T09:36:22.801 INFO:tasks.workunit.client.1.smithi135.stdout:9/363: chown de/df/d1d/d23/d25/c51 61711 1 2024-09-10T09:36:22.843 INFO:tasks.workunit.client.1.smithi135.stdout:2/370: dwrite df/d1b/d23/f48 [4194304,4194304] 0 2024-09-10T09:36:22.846 INFO:tasks.workunit.client.1.smithi135.stdout:2/371: mkdir df/d1b/d70 0 2024-09-10T09:36:22.848 INFO:tasks.workunit.client.1.smithi135.stdout:6/484: dwrite d5/d1e/f2f [0,4194304] 0 2024-09-10T09:36:22.848 INFO:tasks.workunit.client.1.smithi135.stdout:5/327: dwrite d3/d26/d48/d57/f5e [0,4194304] 0 2024-09-10T09:36:22.849 INFO:tasks.workunit.client.1.smithi135.stdout:5/328: creat d3/d26/f6a x:0 0 0 2024-09-10T09:36:22.849 INFO:tasks.workunit.client.1.smithi135.stdout:5/329: chown d3/c1e 63974017 1 2024-09-10T09:36:22.849 INFO:tasks.workunit.client.1.smithi135.stdout:2/372: rmdir df/d1b/d23/d42 39 2024-09-10T09:36:22.852 INFO:tasks.workunit.client.1.smithi135.stdout:6/485: symlink d5/d1e/d3b/d42/d2d/d55/d5b/l9d 0 2024-09-10T09:36:22.863 INFO:tasks.workunit.client.1.smithi135.stdout:8/385: rmdir d1/d15/d24 39 2024-09-10T09:36:22.864 INFO:tasks.workunit.client.1.smithi135.stdout:5/330: symlink d3/d26/d4f/d61/l6b 0 2024-09-10T09:36:22.866 INFO:tasks.workunit.client.1.smithi135.stdout:2/373: mknod df/c71 0 2024-09-10T09:36:22.866 INFO:tasks.workunit.client.1.smithi135.stdout:2/374: chown df/d1b/d23/d42/f65 368106957 1 2024-09-10T09:36:22.867 INFO:tasks.workunit.client.1.smithi135.stdout:2/375: write df/d13/f44 [318027,112158] 0 2024-09-10T09:36:22.868 INFO:tasks.workunit.client.1.smithi135.stdout:6/486: truncate d5/d1e/d3b/d42/f38 1535857 0 2024-09-10T09:36:22.868 INFO:tasks.workunit.client.1.smithi135.stdout:6/487: chown d5/d1e/d35/c3e 20 1 2024-09-10T09:36:22.868 INFO:tasks.workunit.client.1.smithi135.stdout:6/488: chown d5/d1e/d62 4055 1 2024-09-10T09:36:22.869 INFO:tasks.workunit.client.1.smithi135.stdout:2/376: dread df/d13/f38 [0,4194304] 0 2024-09-10T09:36:22.869 INFO:tasks.workunit.client.1.smithi135.stdout:2/377: fsync f6 0 2024-09-10T09:36:22.870 INFO:tasks.workunit.client.1.smithi135.stdout:8/386: symlink d1/d15/l8b 0 2024-09-10T09:36:22.870 INFO:tasks.workunit.client.1.smithi135.stdout:8/387: dread - d1/d15/d49/f81 zero size 2024-09-10T09:36:22.873 INFO:tasks.workunit.client.1.smithi135.stdout:6/489: rename d5/d1e/d35/c45 to d5/d1e/d3b/d42/d3c/d44/c9e 0 2024-09-10T09:36:22.873 INFO:tasks.workunit.client.1.smithi135.stdout:6/490: creat d5/d1e/d35/f9f x:0 0 0 2024-09-10T09:36:22.874 INFO:tasks.workunit.client.1.smithi135.stdout:2/378: mknod df/d1b/d23/c72 0 2024-09-10T09:36:22.875 INFO:tasks.workunit.client.1.smithi135.stdout:5/331: read d3/dc/d16/f45 [2064119,102775] 0 2024-09-10T09:36:22.876 INFO:tasks.workunit.client.1.smithi135.stdout:8/388: rename d1/d15/d24/l3a to d1/d15/d16/d33/d45/d70/l8c 0 2024-09-10T09:36:22.876 INFO:tasks.workunit.client.1.smithi135.stdout:8/389: write d1/d15/d16/d33/d45/f87 [309281,82147] 0 2024-09-10T09:36:22.885 INFO:tasks.workunit.client.1.smithi135.stdout:6/491: dread d5/d1e/d3b/d42/f2a [0,4194304] 0 2024-09-10T09:36:22.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/390: dread d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:22.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/391: truncate d1/d13/f6e 1014727 0 2024-09-10T09:36:22.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/392: creat d1/d15/d16/d71/f8d x:0 0 0 2024-09-10T09:36:22.894 INFO:tasks.workunit.client.1.smithi135.stdout:8/393: mknod d1/d15/d49/c8e 0 2024-09-10T09:36:22.896 INFO:tasks.workunit.client.1.smithi135.stdout:8/394: mkdir d1/d8f 0 2024-09-10T09:36:22.902 INFO:tasks.workunit.client.1.smithi135.stdout:8/395: dread d1/d13/f5c [0,4194304] 0 2024-09-10T09:36:22.902 INFO:tasks.workunit.client.1.smithi135.stdout:2/379: dwrite df/d1b/f5c [0,4194304] 0 2024-09-10T09:36:22.905 INFO:tasks.workunit.client.1.smithi135.stdout:2/380: creat df/d1b/d23/d36/f73 x:0 0 0 2024-09-10T09:36:22.912 INFO:tasks.workunit.client.1.smithi135.stdout:5/332: dwrite d3/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:22.913 INFO:tasks.workunit.client.1.smithi135.stdout:6/492: dwrite d5/dd/d50/f7b [4194304,4194304] 0 2024-09-10T09:36:22.916 INFO:tasks.workunit.client.1.smithi135.stdout:5/333: mkdir d3/dc/d69/d65/d6c 0 2024-09-10T09:36:22.919 INFO:tasks.workunit.client.1.smithi135.stdout:8/396: write d1/d15/d24/f35 [7920,18168] 0 2024-09-10T09:36:22.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/381: dwrite df/d1b/d23/d42/f46 [0,4194304] 0 2024-09-10T09:36:22.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/382: chown df/d1b/d23/d36/f73 257291 1 2024-09-10T09:36:22.930 INFO:tasks.workunit.client.1.smithi135.stdout:8/397: write d1/d15/f19 [939199,58753] 0 2024-09-10T09:36:22.930 INFO:tasks.workunit.client.1.smithi135.stdout:8/398: readlink d1/d15/d16/d33/d45/d70/l88 0 2024-09-10T09:36:22.930 INFO:tasks.workunit.client.1.smithi135.stdout:8/399: fdatasync d1/d15/d16/f61 0 2024-09-10T09:36:22.930 INFO:tasks.workunit.client.1.smithi135.stdout:8/400: chown d1/d15/d16/d33/d45 87 1 2024-09-10T09:36:22.930 INFO:tasks.workunit.client.1.smithi135.stdout:8/401: readlink d1/d15/l1c 0 2024-09-10T09:36:22.931 INFO:tasks.workunit.client.1.smithi135.stdout:6/493: dwrite d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:22.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/334: dread d3/fd [0,4194304] 0 2024-09-10T09:36:22.938 INFO:tasks.workunit.client.1.smithi135.stdout:2/383: mknod df/d1b/d70/c74 0 2024-09-10T09:36:22.940 INFO:tasks.workunit.client.1.smithi135.stdout:8/402: rename d1/d15/d16/d33/d45/c55 to d1/d15/d49/c90 0 2024-09-10T09:36:22.943 INFO:tasks.workunit.client.1.smithi135.stdout:6/494: creat d5/d58/fa0 x:0 0 0 2024-09-10T09:36:22.945 INFO:tasks.workunit.client.1.smithi135.stdout:5/335: mknod d3/d26/c6d 0 2024-09-10T09:36:22.947 INFO:tasks.workunit.client.1.smithi135.stdout:2/384: creat df/d1b/d23/d36/d5f/f75 x:0 0 0 2024-09-10T09:36:22.950 INFO:tasks.workunit.client.1.smithi135.stdout:2/385: dread df/d1b/f26 [0,4194304] 0 2024-09-10T09:36:22.951 INFO:tasks.workunit.client.1.smithi135.stdout:6/495: symlink d5/d1e/d62/d8a/la1 0 2024-09-10T09:36:22.951 INFO:tasks.workunit.client.1.smithi135.stdout:6/496: stat d5/d1e/d62/d8a/la1 0 2024-09-10T09:36:22.951 INFO:tasks.workunit.client.1.smithi135.stdout:6/497: write d5/d1e/d3b/d42/d3c/f47 [2556723,37207] 0 2024-09-10T09:36:22.951 INFO:tasks.workunit.client.1.smithi135.stdout:6/498: chown d5/dd/c2b 3 1 2024-09-10T09:36:22.951 INFO:tasks.workunit.client.1.smithi135.stdout:5/336: symlink d3/d26/d4e/l6e 0 2024-09-10T09:36:22.953 INFO:tasks.workunit.client.1.smithi135.stdout:2/386: mknod df/c76 0 2024-09-10T09:36:22.954 INFO:tasks.workunit.client.1.smithi135.stdout:2/387: dread - df/d13/d52/f60 zero size 2024-09-10T09:36:22.959 INFO:tasks.workunit.client.1.smithi135.stdout:6/499: creat d5/d1e/d3b/d42/d3c/fa2 x:0 0 0 2024-09-10T09:36:22.960 INFO:tasks.workunit.client.1.smithi135.stdout:5/337: mknod d3/d44/c6f 0 2024-09-10T09:36:22.966 INFO:tasks.workunit.client.1.smithi135.stdout:5/338: mkdir d3/dc/d69/d70 0 2024-09-10T09:36:22.966 INFO:tasks.workunit.client.1.smithi135.stdout:5/339: fsync d3/dc/d16/f43 0 2024-09-10T09:36:22.971 INFO:tasks.workunit.client.1.smithi135.stdout:5/340: rename d3/d26/d4f to d3/d71 0 2024-09-10T09:36:22.971 INFO:tasks.workunit.client.1.smithi135.stdout:5/341: dread d3/dc/d16/d41/f62 [0,4194304] 0 2024-09-10T09:36:22.973 INFO:tasks.workunit.client.1.smithi135.stdout:5/342: mkdir d3/dc/d69/d72 0 2024-09-10T09:36:22.974 INFO:tasks.workunit.client.1.smithi135.stdout:5/343: truncate d3/dc/f1c 4643056 0 2024-09-10T09:36:22.975 INFO:tasks.workunit.client.1.smithi135.stdout:5/344: truncate d3/f5 283693 0 2024-09-10T09:36:22.977 INFO:tasks.workunit.client.1.smithi135.stdout:5/345: creat d3/dc/d69/f73 x:0 0 0 2024-09-10T09:36:22.977 INFO:tasks.workunit.client.1.smithi135.stdout:5/346: write d3/dc/d16/f34 [1039827,98618] 0 2024-09-10T09:36:22.979 INFO:tasks.workunit.client.1.smithi135.stdout:2/388: dwrite df/d13/d52/f60 [0,4194304] 0 2024-09-10T09:36:22.984 INFO:tasks.workunit.client.1.smithi135.stdout:6/500: dwrite d5/d1e/d35/f9b [4194304,4194304] 0 2024-09-10T09:36:22.984 INFO:tasks.workunit.client.1.smithi135.stdout:6/501: write d5/d1e/d3b/d42/d3c/f47 [3967249,87533] 0 2024-09-10T09:36:22.987 INFO:tasks.workunit.client.1.smithi135.stdout:6/502: mkdir d5/dd/da3 0 2024-09-10T09:36:22.987 INFO:tasks.workunit.client.1.smithi135.stdout:6/503: dread - d5/d1e/d3b/d42/d2d/d55/d5b/f91 zero size 2024-09-10T09:36:22.989 INFO:tasks.workunit.client.1.smithi135.stdout:8/403: dwrite d1/d13/f6e [0,4194304] 0 2024-09-10T09:36:22.991 INFO:tasks.workunit.client.1.smithi135.stdout:6/504: symlink d5/d1e/d3b/d42/d2d/d8f/la4 0 2024-09-10T09:36:22.991 INFO:tasks.workunit.client.1.smithi135.stdout:6/505: readlink d5/dd/l14 0 2024-09-10T09:36:22.992 INFO:tasks.workunit.client.1.smithi135.stdout:5/347: dread d3/dc/f1c [0,4194304] 0 2024-09-10T09:36:23.001 INFO:tasks.workunit.client.1.smithi135.stdout:2/389: dwrite df/f54 [0,4194304] 0 2024-09-10T09:36:23.002 INFO:tasks.workunit.client.1.smithi135.stdout:6/506: unlink d5/d1e/d3b/d42/d2d/d8f/la4 0 2024-09-10T09:36:23.004 INFO:tasks.workunit.client.1.smithi135.stdout:5/348: dread d3/d26/d48/d57/f5e [0,4194304] 0 2024-09-10T09:36:23.004 INFO:tasks.workunit.client.1.smithi135.stdout:5/349: creat d3/d44/f74 x:0 0 0 2024-09-10T09:36:23.016 INFO:tasks.workunit.client.1.smithi135.stdout:2/390: rmdir df/d13 39 2024-09-10T09:36:23.018 INFO:tasks.workunit.client.1.smithi135.stdout:5/350: truncate d3/f18 186390 0 2024-09-10T09:36:23.019 INFO:tasks.workunit.client.1.smithi135.stdout:6/507: dwrite d5/d15/d56/f90 [0,4194304] 0 2024-09-10T09:36:23.020 INFO:tasks.workunit.client.1.smithi135.stdout:2/391: symlink df/d1b/l77 0 2024-09-10T09:36:23.025 INFO:tasks.workunit.client.1.smithi135.stdout:6/508: mknod d5/d1e/d3b/d42/d3c/d44/ca5 0 2024-09-10T09:36:23.027 INFO:tasks.workunit.client.1.smithi135.stdout:6/509: creat d5/d1e/d3b/d42/d2d/d55/fa6 x:0 0 0 2024-09-10T09:36:23.027 INFO:tasks.workunit.client.1.smithi135.stdout:6/510: dread - d5/f60 zero size 2024-09-10T09:36:23.030 INFO:tasks.workunit.client.1.smithi135.stdout:2/392: read df/d1b/d23/f48 [2666580,129199] 0 2024-09-10T09:36:23.030 INFO:tasks.workunit.client.1.smithi135.stdout:2/393: dread - df/d1b/d23/d36/f73 zero size 2024-09-10T09:36:23.030 INFO:tasks.workunit.client.1.smithi135.stdout:6/511: creat d5/dd/fa7 x:0 0 0 2024-09-10T09:36:23.032 INFO:tasks.workunit.client.1.smithi135.stdout:2/394: creat df/d1b/d70/f78 x:0 0 0 2024-09-10T09:36:23.033 INFO:tasks.workunit.client.1.smithi135.stdout:5/351: fsync d3/f18 0 2024-09-10T09:36:23.034 INFO:tasks.workunit.client.1.smithi135.stdout:2/395: creat df/f79 x:0 0 0 2024-09-10T09:36:23.038 INFO:tasks.workunit.client.1.smithi135.stdout:2/396: creat df/d13/f7a x:0 0 0 2024-09-10T09:36:23.039 INFO:tasks.workunit.client.1.smithi135.stdout:6/512: read d5/d1e/d3b/f41 [3371571,8205] 0 2024-09-10T09:36:23.039 INFO:tasks.workunit.client.1.smithi135.stdout:6/513: write d5/d1e/f67 [1795540,77720] 0 2024-09-10T09:36:23.039 INFO:tasks.workunit.client.1.smithi135.stdout:6/514: chown d5/dd/d50/d57 51305 1 2024-09-10T09:36:23.040 INFO:tasks.workunit.client.1.smithi135.stdout:5/352: dread d3/dc/f10 [0,4194304] 0 2024-09-10T09:36:23.040 INFO:tasks.workunit.client.1.smithi135.stdout:5/353: dread - d3/d26/f5f zero size 2024-09-10T09:36:23.040 INFO:tasks.workunit.client.1.smithi135.stdout:2/397: symlink df/d1b/d70/l7b 0 2024-09-10T09:36:23.041 INFO:tasks.workunit.client.1.smithi135.stdout:2/398: creat df/d15/f7c x:0 0 0 2024-09-10T09:36:23.043 INFO:tasks.workunit.client.1.smithi135.stdout:6/515: mknod d5/d1e/d3b/d42/d2d/d55/d5b/ca8 0 2024-09-10T09:36:23.052 INFO:tasks.workunit.client.1.smithi135.stdout:6/516: dread d5/f6 [0,4194304] 0 2024-09-10T09:36:23.052 INFO:tasks.workunit.client.1.smithi135.stdout:5/354: rmdir d3/d44 39 2024-09-10T09:36:23.053 INFO:tasks.workunit.client.1.smithi135.stdout:5/355: chown d3/dc/d69 1 1 2024-09-10T09:36:23.055 INFO:tasks.workunit.client.1.smithi135.stdout:2/399: getdents df/d13/d4f 0 2024-09-10T09:36:23.060 INFO:tasks.workunit.client.1.smithi135.stdout:2/400: mkdir df/d1b/d23/d36/d5f/d2c/d7d 0 2024-09-10T09:36:23.060 INFO:tasks.workunit.client.1.smithi135.stdout:0/468: sync 2024-09-10T09:36:23.060 INFO:tasks.workunit.client.1.smithi135.stdout:0/469: chown d8/d1c/d37/d7a 1269011 1 2024-09-10T09:36:23.065 INFO:tasks.workunit.client.1.smithi135.stdout:2/401: getdents df/d1b/d23/d36/d5f 0 2024-09-10T09:36:23.065 INFO:tasks.workunit.client.1.smithi135.stdout:2/402: chown df/d1b/d23/d36/d5f/d3d/c3f 32202832 1 2024-09-10T09:36:23.065 INFO:tasks.workunit.client.1.smithi135.stdout:2/403: write df/d1b/f26 [114590,18283] 0 2024-09-10T09:36:23.067 INFO:tasks.workunit.client.1.smithi135.stdout:5/356: dwrite d3/ff [0,4194304] 0 2024-09-10T09:36:23.074 INFO:tasks.workunit.client.1.smithi135.stdout:6/517: truncate d5/dd/d50/f7b 5141215 0 2024-09-10T09:36:23.076 INFO:tasks.workunit.client.1.smithi135.stdout:5/357: mknod d3/d26/d48/c75 0 2024-09-10T09:36:23.080 INFO:tasks.workunit.client.1.smithi135.stdout:5/358: creat d3/d26/d4e/f76 x:0 0 0 2024-09-10T09:36:23.080 INFO:tasks.workunit.client.1.smithi135.stdout:5/359: read - d3/d26/d4e/f76 zero size 2024-09-10T09:36:23.090 INFO:tasks.workunit.client.1.smithi135.stdout:5/360: rename d3/d71/f5b to d3/d26/d48/d57/f77 0 2024-09-10T09:36:23.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/404: dwrite df/f16 [0,4194304] 0 2024-09-10T09:36:23.093 INFO:tasks.workunit.client.1.smithi135.stdout:6/518: dwrite d5/d1e/d3b/d42/d3c/fa2 [0,4194304] 0 2024-09-10T09:36:23.094 INFO:tasks.workunit.client.1.smithi135.stdout:2/405: mknod df/c7e 0 2024-09-10T09:36:23.096 INFO:tasks.workunit.client.1.smithi135.stdout:6/519: rmdir d5/d1e/d62/d8a 39 2024-09-10T09:36:23.098 INFO:tasks.workunit.client.1.smithi135.stdout:2/406: mkdir df/d15/d7f 0 2024-09-10T09:36:23.100 INFO:tasks.workunit.client.1.smithi135.stdout:6/520: unlink d5/d1e/d3b/d42/d2d/d55/c61 0 2024-09-10T09:36:23.101 INFO:tasks.workunit.client.1.smithi135.stdout:6/521: write d5/d15/f1c [1141789,88225] 0 2024-09-10T09:36:23.104 INFO:tasks.workunit.client.1.smithi135.stdout:2/407: creat df/d1b/d23/f80 x:0 0 0 2024-09-10T09:36:23.104 INFO:tasks.workunit.client.1.smithi135.stdout:2/408: creat df/d1b/d23/d36/d5f/d2c/f81 x:0 0 0 2024-09-10T09:36:23.107 INFO:tasks.workunit.client.1.smithi135.stdout:6/522: mkdir d5/dd/d50/d54/da9 0 2024-09-10T09:36:23.108 INFO:tasks.workunit.client.1.smithi135.stdout:5/361: dwrite d3/fa [0,4194304] 0 2024-09-10T09:36:23.111 INFO:tasks.workunit.client.1.smithi135.stdout:2/409: rmdir df/d15/d7f 0 2024-09-10T09:36:23.111 INFO:tasks.workunit.client.1.smithi135.stdout:2/410: creat df/d13/f82 x:0 0 0 2024-09-10T09:36:23.115 INFO:tasks.workunit.client.1.smithi135.stdout:5/362: rename d3/d26/d4e/l6e to d3/d26/l78 0 2024-09-10T09:36:23.115 INFO:tasks.workunit.client.1.smithi135.stdout:5/363: fsync d3/dc/d16/f2c 0 2024-09-10T09:36:23.115 INFO:tasks.workunit.client.1.smithi135.stdout:5/364: dread - d3/d26/f3c zero size 2024-09-10T09:36:23.116 INFO:tasks.workunit.client.1.smithi135.stdout:5/365: fsync d3/f14 0 2024-09-10T09:36:23.116 INFO:tasks.workunit.client.1.smithi135.stdout:5/366: dread - d3/f31 zero size 2024-09-10T09:36:23.118 INFO:tasks.workunit.client.1.smithi135.stdout:6/523: getdents d5/d1e/d35 0 2024-09-10T09:36:23.118 INFO:tasks.workunit.client.1.smithi135.stdout:6/524: readlink d5/d1e/l4e 0 2024-09-10T09:36:23.118 INFO:tasks.workunit.client.1.smithi135.stdout:6/525: write d5/d1e/d62/f82 [839285,81061] 0 2024-09-10T09:36:23.118 INFO:tasks.workunit.client.1.smithi135.stdout:6/526: getdents d5/dd/da3 0 2024-09-10T09:36:23.118 INFO:tasks.workunit.client.1.smithi135.stdout:6/527: readlink d5/d1e/l79 0 2024-09-10T09:36:23.118 INFO:tasks.workunit.client.1.smithi135.stdout:6/528: write d5/d1e/d62/f82 [1708966,40282] 0 2024-09-10T09:36:23.120 INFO:tasks.workunit.client.1.smithi135.stdout:2/411: rename df/d15/f33 to df/d1b/d23/d36/d5f/d2c/f83 0 2024-09-10T09:36:23.136 INFO:tasks.workunit.client.1.smithi135.stdout:5/367: rmdir d3/d26/d48 39 2024-09-10T09:36:23.151 INFO:tasks.workunit.client.1.smithi135.stdout:5/368: dwrite d3/dc/d16/f45 [4194304,4194304] 0 2024-09-10T09:36:23.165 INFO:tasks.workunit.client.1.smithi135.stdout:5/369: dwrite d3/d26/f5f [0,4194304] 0 2024-09-10T09:36:23.169 INFO:tasks.workunit.client.1.smithi135.stdout:5/370: link d3/dc/d16/f43 d3/d44/d22/f79 0 2024-09-10T09:36:23.171 INFO:tasks.workunit.client.1.smithi135.stdout:5/371: mkdir d3/dc/d7a 0 2024-09-10T09:36:23.173 INFO:tasks.workunit.client.1.smithi135.stdout:5/372: symlink d3/d26/d48/l7b 0 2024-09-10T09:36:23.174 INFO:tasks.workunit.client.1.smithi135.stdout:5/373: creat d3/d26/d48/d57/f7c x:0 0 0 2024-09-10T09:36:23.183 INFO:tasks.workunit.client.1.smithi135.stdout:5/374: dread d3/dc/f37 [4194304,4194304] 0 2024-09-10T09:36:23.183 INFO:tasks.workunit.client.1.smithi135.stdout:5/375: getdents d3/dc/d69/d65/d6c 0 2024-09-10T09:36:23.199 INFO:tasks.workunit.client.1.smithi135.stdout:5/376: dwrite d3/d26/d4e/f76 [0,4194304] 0 2024-09-10T09:36:23.200 INFO:tasks.workunit.client.1.smithi135.stdout:5/377: write d3/dc/f10 [796510,1357] 0 2024-09-10T09:36:23.218 INFO:tasks.workunit.client.1.smithi135.stdout:5/378: dwrite d3/dc/d16/d41/f62 [0,4194304] 0 2024-09-10T09:36:23.222 INFO:tasks.workunit.client.1.smithi135.stdout:5/379: rename d3/c1e to d3/dc/d69/d65/d6c/c7d 0 2024-09-10T09:36:23.225 INFO:tasks.workunit.client.1.smithi135.stdout:5/380: rename d3/dc/f23 to d3/dc/d16/d41/f7e 0 2024-09-10T09:36:23.226 INFO:tasks.workunit.client.1.smithi135.stdout:5/381: getdents d3/d44/d22 0 2024-09-10T09:36:23.228 INFO:tasks.workunit.client.1.smithi135.stdout:5/382: creat d3/dc/d69/d72/f7f x:0 0 0 2024-09-10T09:36:23.228 INFO:tasks.workunit.client.1.smithi135.stdout:5/383: chown d3/d26/d48 86857 1 2024-09-10T09:36:23.232 INFO:tasks.workunit.client.1.smithi135.stdout:5/384: rename d3/fd to d3/dc/f80 0 2024-09-10T09:36:23.255 INFO:tasks.workunit.client.1.smithi135.stdout:5/385: dwrite d3/d26/f68 [0,4194304] 0 2024-09-10T09:36:23.258 INFO:tasks.workunit.client.1.smithi135.stdout:5/386: mkdir d3/d81 0 2024-09-10T09:36:23.259 INFO:tasks.workunit.client.1.smithi135.stdout:5/387: chown d3/dc/f10 73 1 2024-09-10T09:36:23.261 INFO:tasks.workunit.client.1.smithi135.stdout:5/388: getdents d3/dc/d69 0 2024-09-10T09:36:23.261 INFO:tasks.workunit.client.1.smithi135.stdout:5/389: fsync d3/dc/f80 0 2024-09-10T09:36:23.261 INFO:tasks.workunit.client.1.smithi135.stdout:5/390: fdatasync f2 0 2024-09-10T09:36:23.262 INFO:tasks.workunit.client.1.smithi135.stdout:5/391: symlink d3/dc/d16/l82 0 2024-09-10T09:36:23.266 INFO:tasks.workunit.client.1.smithi135.stdout:5/392: dread d3/d44/d22/f2f [0,4194304] 0 2024-09-10T09:36:23.269 INFO:tasks.workunit.client.1.smithi135.stdout:5/393: rename d3/dc/l15 to d3/dc/d69/d65/l83 0 2024-09-10T09:36:23.285 INFO:tasks.workunit.client.1.smithi135.stdout:5/394: dwrite d3/dc/f27 [0,4194304] 0 2024-09-10T09:36:23.286 INFO:tasks.workunit.client.1.smithi135.stdout:5/395: mknod d3/dc/d16/c84 0 2024-09-10T09:36:23.302 INFO:tasks.workunit.client.1.smithi135.stdout:5/396: dwrite d3/dc/f27 [0,4194304] 0 2024-09-10T09:36:23.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/397: rename d3/dc/d69/d72/f7f to d3/dc/d69/d65/f85 0 2024-09-10T09:36:23.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/398: stat d3/d44/f74 0 2024-09-10T09:36:23.315 INFO:tasks.workunit.client.1.smithi135.stdout:5/399: write d3/f9 [1161820,71180] 0 2024-09-10T09:36:23.323 INFO:tasks.workunit.client.1.smithi135.stdout:5/400: dread d3/f9 [0,4194304] 0 2024-09-10T09:36:23.476 INFO:tasks.workunit.client.1.smithi135.stdout:4/508: sync 2024-09-10T09:36:23.476 INFO:tasks.workunit.client.1.smithi135.stdout:7/358: sync 2024-09-10T09:36:23.479 INFO:tasks.workunit.client.1.smithi135.stdout:4/509: mknod d1/d4a/c9e 0 2024-09-10T09:36:23.479 INFO:tasks.workunit.client.1.smithi135.stdout:4/510: chown d1/de/c86 25930 1 2024-09-10T09:36:23.479 INFO:tasks.workunit.client.1.smithi135.stdout:4/511: dread - d1/de/d16/f78 zero size 2024-09-10T09:36:23.480 INFO:tasks.workunit.client.1.smithi135.stdout:4/512: truncate d1/de/d16/f44 2923948 0 2024-09-10T09:36:23.480 INFO:tasks.workunit.client.1.smithi135.stdout:4/513: rename d1/d4a to d1/d4a/d6d/d9f 22 2024-09-10T09:36:23.481 INFO:tasks.workunit.client.1.smithi135.stdout:4/514: chown d1/d4a/c9e 355 1 2024-09-10T09:36:23.481 INFO:tasks.workunit.client.1.smithi135.stdout:4/515: write d1/d33/d40/f7e [273578,120395] 0 2024-09-10T09:36:23.482 INFO:tasks.workunit.client.1.smithi135.stdout:4/516: chown d1/db/d9/d55/d70/c7c 12468 1 2024-09-10T09:36:23.483 INFO:tasks.workunit.client.1.smithi135.stdout:7/359: dread d2/d25/f2a [0,4194304] 0 2024-09-10T09:36:23.484 INFO:tasks.workunit.client.1.smithi135.stdout:7/360: chown d2/d15/d41/d49/d52 11058 1 2024-09-10T09:36:23.486 INFO:tasks.workunit.client.1.smithi135.stdout:7/361: mkdir d2/d15/d41/d49/d60/d30/d71 0 2024-09-10T09:36:23.487 INFO:tasks.workunit.client.1.smithi135.stdout:4/517: dread d1/de/d16/f5b [0,4194304] 0 2024-09-10T09:36:23.488 INFO:tasks.workunit.client.1.smithi135.stdout:7/362: mknod d2/d15/d41/d49/d60/d54/c72 0 2024-09-10T09:36:23.496 INFO:tasks.workunit.client.1.smithi135.stdout:7/363: dread d2/f2e [0,4194304] 0 2024-09-10T09:36:23.500 INFO:tasks.workunit.client.1.smithi135.stdout:4/518: dread d1/de/d16/f44 [0,4194304] 0 2024-09-10T09:36:23.500 INFO:tasks.workunit.client.1.smithi135.stdout:4/519: dread - d1/de/f8d zero size 2024-09-10T09:36:23.500 INFO:tasks.workunit.client.1.smithi135.stdout:4/520: fdatasync d1/de/d16/f78 0 2024-09-10T09:36:23.500 INFO:tasks.workunit.client.1.smithi135.stdout:4/521: read - d1/de/f8d zero size 2024-09-10T09:36:23.500 INFO:tasks.workunit.client.1.smithi135.stdout:7/364: dread d2/d15/d4a/f12 [0,4194304] 0 2024-09-10T09:36:23.501 INFO:tasks.workunit.client.1.smithi135.stdout:7/365: chown d2/d15/d39/f6d 7278 1 2024-09-10T09:36:23.503 INFO:tasks.workunit.client.1.smithi135.stdout:4/522: mkdir d1/db/da0 0 2024-09-10T09:36:23.503 INFO:tasks.workunit.client.1.smithi135.stdout:7/366: write d2/d15/d4a/f12 [1042264,46060] 0 2024-09-10T09:36:23.505 INFO:tasks.workunit.client.1.smithi135.stdout:4/523: mkdir d1/d4a/d9d/da1 0 2024-09-10T09:36:23.507 INFO:tasks.workunit.client.1.smithi135.stdout:7/367: mknod d2/d15/d41/d49/d60/d54/d5e/c73 0 2024-09-10T09:36:23.508 INFO:tasks.workunit.client.1.smithi135.stdout:4/524: symlink d1/de/d16/d95/la2 0 2024-09-10T09:36:23.508 INFO:tasks.workunit.client.1.smithi135.stdout:4/525: dread - d1/de/d16/f67 zero size 2024-09-10T09:36:23.508 INFO:tasks.workunit.client.1.smithi135.stdout:4/526: write d1/de/f13 [1358830,24377] 0 2024-09-10T09:36:23.509 INFO:tasks.workunit.client.1.smithi135.stdout:4/527: chown d1/db/d9/d55/d70/c7c 3618 1 2024-09-10T09:36:23.509 INFO:tasks.workunit.client.1.smithi135.stdout:7/368: truncate d2/d15/d41/d49/d60/d30/f34 6049840 0 2024-09-10T09:36:23.511 INFO:tasks.workunit.client.1.smithi135.stdout:4/528: unlink d1/d33/d40/f99 0 2024-09-10T09:36:23.511 INFO:tasks.workunit.client.1.smithi135.stdout:4/529: dread - d1/de/f8d zero size 2024-09-10T09:36:23.513 INFO:tasks.workunit.client.1.smithi135.stdout:4/530: getdents d1/db/d9/d55/d70 0 2024-09-10T09:36:23.513 INFO:tasks.workunit.client.1.smithi135.stdout:4/531: write d1/db/d9/d55/f94 [844920,5022] 0 2024-09-10T09:36:23.514 INFO:tasks.workunit.client.1.smithi135.stdout:4/532: read d1/f77 [746599,16874] 0 2024-09-10T09:36:23.517 INFO:tasks.workunit.client.1.smithi135.stdout:4/533: creat d1/d8a/fa3 x:0 0 0 2024-09-10T09:36:23.517 INFO:tasks.workunit.client.1.smithi135.stdout:4/534: stat d1/d4a/d6d/l80 0 2024-09-10T09:36:23.524 INFO:tasks.workunit.client.1.smithi135.stdout:4/535: dread d1/de/d16/f5b [0,4194304] 0 2024-09-10T09:36:23.524 INFO:tasks.workunit.client.1.smithi135.stdout:4/536: fdatasync d1/de/d16/f2f 0 2024-09-10T09:36:23.524 INFO:tasks.workunit.client.1.smithi135.stdout:4/537: stat d1/db/d9/d55/d70/c75 0 2024-09-10T09:36:23.524 INFO:tasks.workunit.client.1.smithi135.stdout:4/538: chown d1/d4a/d6d/l9b 6038 1 2024-09-10T09:36:23.524 INFO:tasks.workunit.client.1.smithi135.stdout:4/539: read - d1/de/d16/f67 zero size 2024-09-10T09:36:23.525 INFO:tasks.workunit.client.1.smithi135.stdout:4/540: mkdir d1/db/d9/d55/d70/da4 0 2024-09-10T09:36:23.525 INFO:tasks.workunit.client.1.smithi135.stdout:4/541: write d1/db/d9/f6a [830770,20835] 0 2024-09-10T09:36:23.528 INFO:tasks.workunit.client.1.smithi135.stdout:4/542: rename d1/db/d9/c26 to d1/db/d23/ca5 0 2024-09-10T09:36:23.528 INFO:tasks.workunit.client.1.smithi135.stdout:4/543: write d1/de/d16/f3f [213618,20302] 0 2024-09-10T09:36:23.545 INFO:tasks.workunit.client.1.smithi135.stdout:4/544: dwrite d1/d4a/f87 [0,4194304] 0 2024-09-10T09:36:23.550 INFO:tasks.workunit.client.1.smithi135.stdout:4/545: symlink d1/db/d9/d55/d70/la6 0 2024-09-10T09:36:23.552 INFO:tasks.workunit.client.1.smithi135.stdout:4/546: link d1/db/d9/l24 d1/db/la7 0 2024-09-10T09:36:23.555 INFO:tasks.workunit.client.1.smithi135.stdout:4/547: unlink d1/d33/c82 0 2024-09-10T09:36:23.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/548: creat d1/db/d23/fa8 x:0 0 0 2024-09-10T09:36:23.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/549: chown d1/db/d9/l4e 26225 1 2024-09-10T09:36:23.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/550: dread - d1/de/d16/f67 zero size 2024-09-10T09:36:23.567 INFO:tasks.workunit.client.1.smithi135.stdout:4/551: dread d1/db/d9/f38 [0,4194304] 0 2024-09-10T09:36:23.624 INFO:tasks.workunit.client.1.smithi135.stdout:4/552: mknod d1/ca9 0 2024-09-10T09:36:23.637 INFO:tasks.workunit.client.1.smithi135.stdout:4/553: dwrite d1/db/d9/f32 [4194304,4194304] 0 2024-09-10T09:36:23.681 INFO:tasks.workunit.client.1.smithi135.stdout:4/554: rename d1/d85/l8f to d1/de/d16/laa 0 2024-09-10T09:36:23.681 INFO:tasks.workunit.client.1.smithi135.stdout:4/555: creat d1/d8a/fab x:0 0 0 2024-09-10T09:36:23.687 INFO:tasks.workunit.client.1.smithi135.stdout:4/556: mkdir d1/db/d9/d55/d70/da4/dac 0 2024-09-10T09:36:23.689 INFO:tasks.workunit.client.1.smithi135.stdout:4/557: creat d1/de/d16/d95/fad x:0 0 0 2024-09-10T09:36:23.690 INFO:tasks.workunit.client.1.smithi135.stdout:3/305: sync 2024-09-10T09:36:23.690 INFO:tasks.workunit.client.1.smithi135.stdout:1/356: sync 2024-09-10T09:36:23.690 INFO:tasks.workunit.client.1.smithi135.stdout:1/357: read f6 [801974,58150] 0 2024-09-10T09:36:23.690 INFO:tasks.workunit.client.1.smithi135.stdout:1/358: write d1d/d20/f43 [736086,122143] 0 2024-09-10T09:36:23.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/359: rename d1d/d20/f46 to d1d/d20/d24/d2b/d4c/d63/f66 0 2024-09-10T09:36:23.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/360: truncate d1d/d20/d3c/f5f 958270 0 2024-09-10T09:36:23.696 INFO:tasks.workunit.client.1.smithi135.stdout:3/306: getdents d4/d5/db/d44 0 2024-09-10T09:36:23.699 INFO:tasks.workunit.client.1.smithi135.stdout:4/558: dread d1/db/f46 [0,4194304] 0 2024-09-10T09:36:23.699 INFO:tasks.workunit.client.1.smithi135.stdout:4/559: truncate d1/de/f8d 8175 0 2024-09-10T09:36:23.699 INFO:tasks.workunit.client.1.smithi135.stdout:3/307: rmdir d4/d5/db/d1b/d1f 39 2024-09-10T09:36:23.700 INFO:tasks.workunit.client.1.smithi135.stdout:1/361: getdents d1d/d20/d42 0 2024-09-10T09:36:23.701 INFO:tasks.workunit.client.1.smithi135.stdout:3/308: mkdir d4/d5/db/d1b/d5b 0 2024-09-10T09:36:23.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/362: mknod d1d/d28/c67 0 2024-09-10T09:36:23.705 INFO:tasks.workunit.client.1.smithi135.stdout:3/309: symlink d4/l5c 0 2024-09-10T09:36:23.705 INFO:tasks.workunit.client.1.smithi135.stdout:3/310: write d4/d5/dc/f10 [5063818,38608] 0 2024-09-10T09:36:23.706 INFO:tasks.workunit.client.1.smithi135.stdout:4/560: write d1/d4a/f87 [4082424,95232] 0 2024-09-10T09:36:23.707 INFO:tasks.workunit.client.1.smithi135.stdout:4/561: fdatasync d1/de/d16/f2f 0 2024-09-10T09:36:23.707 INFO:tasks.workunit.client.1.smithi135.stdout:4/562: chown d1/d4a/d6d/l9b 55995 1 2024-09-10T09:36:23.707 INFO:tasks.workunit.client.1.smithi135.stdout:1/363: unlink d1d/f25 0 2024-09-10T09:36:23.707 INFO:tasks.workunit.client.1.smithi135.stdout:1/364: stat f4 0 2024-09-10T09:36:23.707 INFO:tasks.workunit.client.1.smithi135.stdout:1/365: creat d1d/d20/d3c/d4e/f68 x:0 0 0 2024-09-10T09:36:23.707 INFO:tasks.workunit.client.1.smithi135.stdout:1/366: fdatasync d1d/d20/d24/d2b/f36 0 2024-09-10T09:36:23.707 INFO:tasks.workunit.client.1.smithi135.stdout:1/367: chown d1d/d20/d24/d2b/f32 63 1 2024-09-10T09:36:23.712 INFO:tasks.workunit.client.1.smithi135.stdout:1/368: creat d1d/d28/d4b/f69 x:0 0 0 2024-09-10T09:36:23.724 INFO:tasks.workunit.client.1.smithi135.stdout:4/563: write d1/db/f54 [2520754,18704] 0 2024-09-10T09:36:23.724 INFO:tasks.workunit.client.1.smithi135.stdout:4/564: creat d1/d8a/fae x:0 0 0 2024-09-10T09:36:23.726 INFO:tasks.workunit.client.1.smithi135.stdout:4/565: write d1/db/d9/f6a [681055,32393] 0 2024-09-10T09:36:23.727 INFO:tasks.workunit.client.1.smithi135.stdout:4/566: dread d1/f77 [0,4194304] 0 2024-09-10T09:36:23.734 INFO:tasks.workunit.client.1.smithi135.stdout:3/311: dwrite d4/d5/db/d36/f53 [0,4194304] 0 2024-09-10T09:36:23.738 INFO:tasks.workunit.client.1.smithi135.stdout:1/369: dwrite d1d/f2a [0,4194304] 0 2024-09-10T09:36:23.744 INFO:tasks.workunit.client.1.smithi135.stdout:4/567: dwrite d1/d8a/fab [0,4194304] 0 2024-09-10T09:36:23.744 INFO:tasks.workunit.client.1.smithi135.stdout:4/568: readlink d1/db/d9/l4e 0 2024-09-10T09:36:23.744 INFO:tasks.workunit.client.1.smithi135.stdout:4/569: write d1/de/d16/f67 [150445,65324] 0 2024-09-10T09:36:23.745 INFO:tasks.workunit.client.1.smithi135.stdout:3/312: rename d4/d5/db/d1b to d4/d55/d5d 0 2024-09-10T09:36:23.745 INFO:tasks.workunit.client.1.smithi135.stdout:3/313: stat d4 0 2024-09-10T09:36:23.750 INFO:tasks.workunit.client.1.smithi135.stdout:1/370: mkdir d1d/d20/d3c/d6a 0 2024-09-10T09:36:23.755 INFO:tasks.workunit.client.1.smithi135.stdout:4/570: rename d1/de/d16/f3b to d1/db/faf 0 2024-09-10T09:36:23.755 INFO:tasks.workunit.client.1.smithi135.stdout:1/371: stat l15 0 2024-09-10T09:36:23.757 INFO:tasks.workunit.client.1.smithi135.stdout:1/372: symlink d1d/d20/d24/d2b/l6b 0 2024-09-10T09:36:23.758 INFO:tasks.workunit.client.1.smithi135.stdout:1/373: mkdir d1d/d20/d6c 0 2024-09-10T09:36:23.759 INFO:tasks.workunit.client.1.smithi135.stdout:1/374: read d1d/d20/d24/d2b/d4c/d63/f66 [787683,106714] 0 2024-09-10T09:36:23.759 INFO:tasks.workunit.client.1.smithi135.stdout:1/375: fsync d1d/d20/d24/d2b/f32 0 2024-09-10T09:36:23.760 INFO:tasks.workunit.client.1.smithi135.stdout:1/376: mkdir d1d/d20/d24/d37/d6d 0 2024-09-10T09:36:23.769 INFO:tasks.workunit.client.1.smithi135.stdout:9/364: sync 2024-09-10T09:36:23.769 INFO:tasks.workunit.client.1.smithi135.stdout:8/404: sync 2024-09-10T09:36:23.769 INFO:tasks.workunit.client.1.smithi135.stdout:0/470: sync 2024-09-10T09:36:23.769 INFO:tasks.workunit.client.1.smithi135.stdout:8/405: readlink d1/d13/l58 0 2024-09-10T09:36:23.772 INFO:tasks.workunit.client.1.smithi135.stdout:9/365: mknod de/df/d1d/d1e/d68/c7d 0 2024-09-10T09:36:23.774 INFO:tasks.workunit.client.1.smithi135.stdout:0/471: mkdir d8/d1c/d37/d9c 0 2024-09-10T09:36:23.774 INFO:tasks.workunit.client.1.smithi135.stdout:0/472: fdatasync d8/f86 0 2024-09-10T09:36:23.777 INFO:tasks.workunit.client.1.smithi135.stdout:1/377: dread d1d/d20/d3c/f3d [0,4194304] 0 2024-09-10T09:36:23.778 INFO:tasks.workunit.client.1.smithi135.stdout:4/571: dwrite d1/db/f46 [0,4194304] 0 2024-09-10T09:36:23.778 INFO:tasks.workunit.client.1.smithi135.stdout:3/314: dwrite d4/d5/dc/f49 [0,4194304] 0 2024-09-10T09:36:23.779 INFO:tasks.workunit.client.1.smithi135.stdout:9/366: rmdir de/df/d1d/d1e/d3f/d7c 0 2024-09-10T09:36:23.779 INFO:tasks.workunit.client.1.smithi135.stdout:9/367: fdatasync de/df/d1d/d23/f26 0 2024-09-10T09:36:23.782 INFO:tasks.workunit.client.1.smithi135.stdout:0/473: creat d8/d1c/d37/d9c/f9d x:0 0 0 2024-09-10T09:36:23.789 INFO:tasks.workunit.client.1.smithi135.stdout:4/572: unlink d1/de/d16/d95/la2 0 2024-09-10T09:36:23.789 INFO:tasks.workunit.client.1.smithi135.stdout:4/573: chown d1/f22 45590 1 2024-09-10T09:36:23.792 INFO:tasks.workunit.client.1.smithi135.stdout:3/315: dread d4/d5/dc/f17 [0,4194304] 0 2024-09-10T09:36:23.796 INFO:tasks.workunit.client.1.smithi135.stdout:0/474: dread d8/dd/d11/f46 [0,4194304] 0 2024-09-10T09:36:23.799 INFO:tasks.workunit.client.1.smithi135.stdout:9/368: rename de/df/d1d/d23/d25/d5c/d69 to de/df/d7e 0 2024-09-10T09:36:23.799 INFO:tasks.workunit.client.1.smithi135.stdout:9/369: write de/df/d1d/f43 [4915074,56993] 0 2024-09-10T09:36:23.799 INFO:tasks.workunit.client.1.smithi135.stdout:9/370: write de/df/d1d/d23/d25/d28/f37 [1072175,16695] 0 2024-09-10T09:36:23.800 INFO:tasks.workunit.client.1.smithi135.stdout:3/316: unlink d4/d5/db/c2c 0 2024-09-10T09:36:23.802 INFO:tasks.workunit.client.1.smithi135.stdout:9/371: rename de/df/d1d/d1e/d3f/f4f to de/df/d1d/d6b/f7f 0 2024-09-10T09:36:23.802 INFO:tasks.workunit.client.1.smithi135.stdout:9/372: stat de/df/d1d/d23/f2d 0 2024-09-10T09:36:23.803 INFO:tasks.workunit.client.1.smithi135.stdout:9/373: creat de/f80 x:0 0 0 2024-09-10T09:36:23.808 INFO:tasks.workunit.client.1.smithi135.stdout:8/406: dwrite d1/d15/d16/d33/d39/f7d [4194304,4194304] 0 2024-09-10T09:36:23.809 INFO:tasks.workunit.client.1.smithi135.stdout:1/378: dwrite d1d/d20/d24/d2b/d4c/f62 [0,4194304] 0 2024-09-10T09:36:23.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/317: dread d4/d5/db/f3a [0,4194304] 0 2024-09-10T09:36:23.813 INFO:tasks.workunit.client.1.smithi135.stdout:1/379: truncate d1d/d20/d3c/f3d 258450 0 2024-09-10T09:36:23.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/318: mknod d4/d55/d5d/d5b/c5e 0 2024-09-10T09:36:23.816 INFO:tasks.workunit.client.1.smithi135.stdout:3/319: chown d4/d5/d51 3390 1 2024-09-10T09:36:23.816 INFO:tasks.workunit.client.1.smithi135.stdout:8/407: dread d1/d15/d24/f7e [0,4194304] 0 2024-09-10T09:36:23.816 INFO:tasks.workunit.client.1.smithi135.stdout:8/408: truncate d1/d27/f40 984329 0 2024-09-10T09:36:23.816 INFO:tasks.workunit.client.1.smithi135.stdout:8/409: chown d1/d15/d16/d33/l3c 0 1 2024-09-10T09:36:23.817 INFO:tasks.workunit.client.1.smithi135.stdout:4/574: dread d1/db/d9/f6a [0,4194304] 0 2024-09-10T09:36:23.817 INFO:tasks.workunit.client.1.smithi135.stdout:0/475: dwrite d8/d1c/d8f/f93 [0,4194304] 0 2024-09-10T09:36:23.817 INFO:tasks.workunit.client.1.smithi135.stdout:0/476: dread - d8/de/d2e/f8d zero size 2024-09-10T09:36:23.817 INFO:tasks.workunit.client.1.smithi135.stdout:4/575: dread - d1/de/d16/f78 zero size 2024-09-10T09:36:23.817 INFO:tasks.workunit.client.1.smithi135.stdout:4/576: write d1/db/d9/f64 [544310,33796] 0 2024-09-10T09:36:23.817 INFO:tasks.workunit.client.1.smithi135.stdout:1/380: truncate f11 513832 0 2024-09-10T09:36:23.819 INFO:tasks.workunit.client.1.smithi135.stdout:3/320: creat d4/d5/db/dd/f5f x:0 0 0 2024-09-10T09:36:23.825 INFO:tasks.workunit.client.1.smithi135.stdout:0/477: rename d8/dd/d4a/f79 to d8/dd/d4a/d50/f9e 0 2024-09-10T09:36:23.829 INFO:tasks.workunit.client.1.smithi135.stdout:3/321: creat d4/d55/f60 x:0 0 0 2024-09-10T09:36:23.831 INFO:tasks.workunit.client.1.smithi135.stdout:1/381: write d1d/d20/d24/d2b/f36 [2797467,59063] 0 2024-09-10T09:36:23.833 INFO:tasks.workunit.client.1.smithi135.stdout:8/410: dread d1/d15/d16/d33/d45/f5d [0,4194304] 0 2024-09-10T09:36:23.833 INFO:tasks.workunit.client.1.smithi135.stdout:8/411: write d1/d13/f5c [1509979,93250] 0 2024-09-10T09:36:23.833 INFO:tasks.workunit.client.1.smithi135.stdout:8/412: chown d1/d15/l1c 601245071 1 2024-09-10T09:36:23.833 INFO:tasks.workunit.client.1.smithi135.stdout:8/413: dread - d1/d27/d3d/f48 zero size 2024-09-10T09:36:23.833 INFO:tasks.workunit.client.1.smithi135.stdout:9/374: dwrite de/df/d1d/d23/d25/d28/d4e/f73 [0,4194304] 0 2024-09-10T09:36:23.833 INFO:tasks.workunit.client.1.smithi135.stdout:0/478: creat d8/f9f x:0 0 0 2024-09-10T09:36:23.835 INFO:tasks.workunit.client.1.smithi135.stdout:8/414: mknod d1/d15/d16/d71/c91 0 2024-09-10T09:36:23.837 INFO:tasks.workunit.client.1.smithi135.stdout:9/375: creat de/df/d1d/d23/d25/d28/f81 x:0 0 0 2024-09-10T09:36:23.837 INFO:tasks.workunit.client.1.smithi135.stdout:8/415: dread d1/d15/d16/d33/d45/f87 [0,4194304] 0 2024-09-10T09:36:23.840 INFO:tasks.workunit.client.1.smithi135.stdout:0/479: rename d8/dd/f35 to d8/d1c/d37/d9c/fa0 0 2024-09-10T09:36:23.843 INFO:tasks.workunit.client.1.smithi135.stdout:9/376: symlink de/df/d7e/l82 0 2024-09-10T09:36:23.845 INFO:tasks.workunit.client.1.smithi135.stdout:9/377: write de/df/f1b [1070950,42880] 0 2024-09-10T09:36:23.846 INFO:tasks.workunit.client.1.smithi135.stdout:3/322: write d4/f3b [503459,3794] 0 2024-09-10T09:36:23.848 INFO:tasks.workunit.client.1.smithi135.stdout:3/323: symlink d4/d55/d5d/d5b/l61 0 2024-09-10T09:36:23.848 INFO:tasks.workunit.client.1.smithi135.stdout:3/324: write d4/d5/db/d36/d43/f52 [241499,37862] 0 2024-09-10T09:36:23.851 INFO:tasks.workunit.client.1.smithi135.stdout:8/416: write d1/d15/d16/f29 [2861863,62733] 0 2024-09-10T09:36:23.851 INFO:tasks.workunit.client.1.smithi135.stdout:3/325: rename d4/l6 to d4/l62 0 2024-09-10T09:36:23.852 INFO:tasks.workunit.client.1.smithi135.stdout:3/326: mknod d4/d5/db/d44/c63 0 2024-09-10T09:36:23.855 INFO:tasks.workunit.client.1.smithi135.stdout:8/417: creat d1/d15/d16/d33/d45/d6f/f92 x:0 0 0 2024-09-10T09:36:23.855 INFO:tasks.workunit.client.1.smithi135.stdout:8/418: chown d1/c12 998 1 2024-09-10T09:36:23.855 INFO:tasks.workunit.client.1.smithi135.stdout:8/419: stat d1/f7 0 2024-09-10T09:36:23.856 INFO:tasks.workunit.client.1.smithi135.stdout:8/420: creat d1/d15/d16/d33/d45/d70/f93 x:0 0 0 2024-09-10T09:36:23.856 INFO:tasks.workunit.client.1.smithi135.stdout:1/382: dwrite d1d/d20/d24/d2b/d4c/f55 [0,4194304] 0 2024-09-10T09:36:23.857 INFO:tasks.workunit.client.1.smithi135.stdout:8/421: mkdir d1/d27/d3d/d94 0 2024-09-10T09:36:23.859 INFO:tasks.workunit.client.1.smithi135.stdout:9/378: write de/df/d1d/d6b/f7f [1898742,44252] 0 2024-09-10T09:36:23.861 INFO:tasks.workunit.client.1.smithi135.stdout:1/383: mknod d1d/d20/d24/c6e 0 2024-09-10T09:36:23.865 INFO:tasks.workunit.client.1.smithi135.stdout:4/577: dwrite d1/de/f59 [0,4194304] 0 2024-09-10T09:36:23.865 INFO:tasks.workunit.client.1.smithi135.stdout:4/578: truncate d1/db/d9/f7d 4582541 0 2024-09-10T09:36:23.867 INFO:tasks.workunit.client.1.smithi135.stdout:3/327: write d4/d5/db/d36/f53 [1006192,32167] 0 2024-09-10T09:36:23.868 INFO:tasks.workunit.client.1.smithi135.stdout:9/379: mkdir de/df/d1d/d23/d25/d5c/d83 0 2024-09-10T09:36:23.870 INFO:tasks.workunit.client.1.smithi135.stdout:1/384: mknod d1d/d20/c6f 0 2024-09-10T09:36:23.879 INFO:tasks.workunit.client.1.smithi135.stdout:3/328: write d4/d5/db/f3f [3850967,102753] 0 2024-09-10T09:36:23.881 INFO:tasks.workunit.client.1.smithi135.stdout:9/380: rename de/df/d1d/d23/c64 to de/df/d1d/d1e/d3f/c84 0 2024-09-10T09:36:23.885 INFO:tasks.workunit.client.1.smithi135.stdout:1/385: read d1d/f22 [3571656,113557] 0 2024-09-10T09:36:23.885 INFO:tasks.workunit.client.1.smithi135.stdout:1/386: stat d1d/d20/d24/d2b/d4c/d63/f66 0 2024-09-10T09:36:23.886 INFO:tasks.workunit.client.1.smithi135.stdout:8/422: dwrite d1/d15/d16/f75 [0,4194304] 0 2024-09-10T09:36:23.918 INFO:tasks.workunit.client.1.smithi135.stdout:1/387: creat d1d/d20/d5d/f70 x:0 0 0 2024-09-10T09:36:23.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/423: creat d1/d13/f95 x:0 0 0 2024-09-10T09:36:23.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/424: truncate d1/d13/f95 567628 0 2024-09-10T09:36:23.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/425: chown d1/l77 1 1 2024-09-10T09:36:23.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/426: chown d1/d15/d16/d33/l3c 1337928 1 2024-09-10T09:36:23.928 INFO:tasks.workunit.client.1.smithi135.stdout:1/388: mkdir d1d/d71 0 2024-09-10T09:36:23.932 INFO:tasks.workunit.client.1.smithi135.stdout:1/389: symlink d1d/d28/d4b/l72 0 2024-09-10T09:36:23.934 INFO:tasks.workunit.client.1.smithi135.stdout:1/390: truncate d1d/f27 2184313 0 2024-09-10T09:36:23.935 INFO:tasks.workunit.client.1.smithi135.stdout:1/391: chown d1d/d28/c67 1045 1 2024-09-10T09:36:23.940 INFO:tasks.workunit.client.1.smithi135.stdout:1/392: rename d1d/d20/d24/d37/l59 to d1d/d20/l73 0 2024-09-10T09:36:23.944 INFO:tasks.workunit.client.1.smithi135.stdout:1/393: creat d1d/d20/d6c/f74 x:0 0 0 2024-09-10T09:36:23.944 INFO:tasks.workunit.client.1.smithi135.stdout:1/394: write d1d/d20/d3c/f5f [134735,23022] 0 2024-09-10T09:36:23.945 INFO:tasks.workunit.client.1.smithi135.stdout:1/395: creat d1d/d20/d3c/f75 x:0 0 0 2024-09-10T09:36:23.946 INFO:tasks.workunit.client.1.smithi135.stdout:8/427: dwrite d1/d15/d16/d33/d45/f5d [4194304,4194304] 0 2024-09-10T09:36:23.951 INFO:tasks.workunit.client.1.smithi135.stdout:8/428: mkdir d1/d15/d16/d96 0 2024-09-10T09:36:23.951 INFO:tasks.workunit.client.1.smithi135.stdout:8/429: read d1/d15/d16/f29 [492483,10562] 0 2024-09-10T09:36:23.951 INFO:tasks.workunit.client.1.smithi135.stdout:8/430: chown d1/d15/d16/d33/d39/l82 0 1 2024-09-10T09:36:23.962 INFO:tasks.workunit.client.1.smithi135.stdout:3/329: unlink d4/l62 0 2024-09-10T09:36:23.962 INFO:tasks.workunit.client.1.smithi135.stdout:3/330: fdatasync d4/d5/db/d44/f4e 0 2024-09-10T09:36:23.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:23 smithi135 ceph-mon[33411]: pgmap v266: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 182 MiB/s rd, 204 MiB/s wr, 324 op/s 2024-09-10T09:36:23.970 INFO:tasks.workunit.client.1.smithi135.stdout:8/431: dwrite d1/d15/d16/d33/d45/d6f/f92 [0,4194304] 0 2024-09-10T09:36:23.973 INFO:tasks.workunit.client.1.smithi135.stdout:8/432: unlink d1/d15/d16/d33/d45/c4f 0 2024-09-10T09:36:23.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/331: read d4/d5/f39 [416488,14305] 0 2024-09-10T09:36:23.975 INFO:tasks.workunit.client.1.smithi135.stdout:8/433: rename d1/d15/f64 to d1/d15/d16/d33/f97 0 2024-09-10T09:36:23.989 INFO:tasks.workunit.client.1.smithi135.stdout:2/412: sync 2024-09-10T09:36:23.989 INFO:tasks.workunit.client.1.smithi135.stdout:6/529: sync 2024-09-10T09:36:23.989 INFO:tasks.workunit.client.1.smithi135.stdout:7/369: sync 2024-09-10T09:36:23.990 INFO:tasks.workunit.client.1.smithi135.stdout:6/530: rename d5/d1e to d5/d1e/daa 22 2024-09-10T09:36:23.990 INFO:tasks.workunit.client.1.smithi135.stdout:5/401: sync 2024-09-10T09:36:24.001 INFO:tasks.workunit.client.1.smithi135.stdout:7/370: dread d2/d15/d41/d49/d60/f22 [0,4194304] 0 2024-09-10T09:36:24.001 INFO:tasks.workunit.client.1.smithi135.stdout:7/371: chown d2/d15/d39/d6f 43097984 1 2024-09-10T09:36:24.003 INFO:tasks.workunit.client.1.smithi135.stdout:7/372: symlink d2/d15/d41/d49/d52/l74 0 2024-09-10T09:36:24.003 INFO:tasks.workunit.client.1.smithi135.stdout:7/373: chown d2/d15/f2f 167604459 1 2024-09-10T09:36:24.010 INFO:tasks.workunit.client.1.smithi135.stdout:7/374: dread d2/d15/d4a/f5a [0,4194304] 0 2024-09-10T09:36:24.010 INFO:tasks.workunit.client.1.smithi135.stdout:7/375: chown d2/d15/f3d 210 1 2024-09-10T09:36:24.010 INFO:tasks.workunit.client.1.smithi135.stdout:7/376: write d2/d15/f21 [2348283,47161] 0 2024-09-10T09:36:24.012 INFO:tasks.workunit.client.1.smithi135.stdout:7/377: creat d2/d15/d41/d49/d60/f75 x:0 0 0 2024-09-10T09:36:24.012 INFO:tasks.workunit.client.1.smithi135.stdout:7/378: write d2/d15/d4a/f12 [4095522,18921] 0 2024-09-10T09:36:24.012 INFO:tasks.workunit.client.1.smithi135.stdout:7/379: readlink l0 0 2024-09-10T09:36:24.012 INFO:tasks.workunit.client.1.smithi135.stdout:8/434: dwrite d1/d15/d16/f29 [4194304,4194304] 0 2024-09-10T09:36:24.012 INFO:tasks.workunit.client.1.smithi135.stdout:8/435: fsync d1/d27/f40 0 2024-09-10T09:36:24.013 INFO:tasks.workunit.client.1.smithi135.stdout:3/332: dwrite d4/f4d [0,4194304] 0 2024-09-10T09:36:24.013 INFO:tasks.workunit.client.1.smithi135.stdout:2/413: dwrite df/d1b/d30/f37 [0,4194304] 0 2024-09-10T09:36:24.016 INFO:tasks.workunit.client.1.smithi135.stdout:3/333: rename d4/d55/d5d/d1f to d4/d55/d64 0 2024-09-10T09:36:24.017 INFO:tasks.workunit.client.1.smithi135.stdout:3/334: write d4/d5/db/dd/f5f [507921,68918] 0 2024-09-10T09:36:24.021 INFO:tasks.workunit.client.1.smithi135.stdout:2/414: mkdir df/d1b/d23/d36/d5f/d2c/d7d/d84 0 2024-09-10T09:36:24.024 INFO:tasks.workunit.client.1.smithi135.stdout:3/335: stat d4/d5/dc/c48 0 2024-09-10T09:36:24.031 INFO:tasks.workunit.client.1.smithi135.stdout:2/415: dread df/f10 [0,4194304] 0 2024-09-10T09:36:24.031 INFO:tasks.workunit.client.1.smithi135.stdout:7/380: dwrite d2/d15/d4a/f12 [0,4194304] 0 2024-09-10T09:36:24.040 INFO:tasks.workunit.client.1.smithi135.stdout:7/381: creat d2/d15/d39/d6f/f76 x:0 0 0 2024-09-10T09:36:24.040 INFO:tasks.workunit.client.1.smithi135.stdout:7/382: chown d2/d15/d41/d49/d60/d54/d5e 5959083 1 2024-09-10T09:36:24.045 INFO:tasks.workunit.client.1.smithi135.stdout:2/416: dwrite df/d1b/d23/d36/d5f/d2c/f6d [0,4194304] 0 2024-09-10T09:36:24.048 INFO:tasks.workunit.client.1.smithi135.stdout:7/383: write d2/d25/f3f [91688,99835] 0 2024-09-10T09:36:24.048 INFO:tasks.workunit.client.1.smithi135.stdout:7/384: chown d2/d15/d41/d49/d60/f27 1639 1 2024-09-10T09:36:24.048 INFO:tasks.workunit.client.1.smithi135.stdout:2/417: creat df/d1b/f85 x:0 0 0 2024-09-10T09:36:24.056 INFO:tasks.workunit.client.1.smithi135.stdout:7/385: dread d2/d25/f3f [0,4194304] 0 2024-09-10T09:36:24.057 INFO:tasks.workunit.client.1.smithi135.stdout:7/386: creat d2/f77 x:0 0 0 2024-09-10T09:36:24.057 INFO:tasks.workunit.client.1.smithi135.stdout:7/387: write d2/d15/f2f [884915,93419] 0 2024-09-10T09:36:24.067 INFO:tasks.workunit.client.1.smithi135.stdout:7/388: dread d2/d15/f3d [0,4194304] 0 2024-09-10T09:36:24.074 INFO:tasks.workunit.client.1.smithi135.stdout:2/418: dwrite f6 [4194304,4194304] 0 2024-09-10T09:36:24.076 INFO:tasks.workunit.client.1.smithi135.stdout:2/419: creat df/d1b/d31/f86 x:0 0 0 2024-09-10T09:36:24.078 INFO:tasks.workunit.client.1.smithi135.stdout:7/389: dread d2/d15/d41/d49/d60/d30/f35 [0,4194304] 0 2024-09-10T09:36:24.078 INFO:tasks.workunit.client.1.smithi135.stdout:7/390: readlink d2/d15/d41/l58 0 2024-09-10T09:36:24.080 INFO:tasks.workunit.client.1.smithi135.stdout:7/391: creat d2/d15/d4a/d36/f78 x:0 0 0 2024-09-10T09:36:24.082 INFO:tasks.workunit.client.1.smithi135.stdout:7/392: mknod d2/c79 0 2024-09-10T09:36:24.082 INFO:tasks.workunit.client.1.smithi135.stdout:7/393: write d2/d15/f21 [3264174,130232] 0 2024-09-10T09:36:24.083 INFO:tasks.workunit.client.1.smithi135.stdout:7/394: creat d2/d15/d41/d49/d60/d30/f7a x:0 0 0 2024-09-10T09:36:24.085 INFO:tasks.workunit.client.1.smithi135.stdout:2/420: dread df/d1b/f1c [0,4194304] 0 2024-09-10T09:36:24.086 INFO:tasks.workunit.client.1.smithi135.stdout:7/395: mknod d2/d15/d4a/d36/c7b 0 2024-09-10T09:36:24.086 INFO:tasks.workunit.client.1.smithi135.stdout:7/396: fdatasync d2/d15/d41/d49/d60/f75 0 2024-09-10T09:36:24.141 INFO:tasks.workunit.client.1.smithi135.stdout:7/397: dwrite d2/d15/d41/d49/d60/f67 [0,4194304] 0 2024-09-10T09:36:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:23 smithi079 ceph-mon[27592]: pgmap v266: 65 pgs: 65 active+clean; 2.3 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 182 MiB/s rd, 204 MiB/s wr, 324 op/s 2024-09-10T09:36:24.318 INFO:tasks.workunit.client.1.smithi135.stdout:0/480: sync 2024-09-10T09:36:24.318 INFO:tasks.workunit.client.1.smithi135.stdout:0/481: stat d8/dd/d18/f1a 0 2024-09-10T09:36:24.318 INFO:tasks.workunit.client.1.smithi135.stdout:0/482: fsync d8/dd/d18/f43 0 2024-09-10T09:36:24.318 INFO:tasks.workunit.client.1.smithi135.stdout:0/483: read d8/de/f4d [1837439,26499] 0 2024-09-10T09:36:24.319 INFO:tasks.workunit.client.1.smithi135.stdout:0/484: rename d8/f70 to d8/d1c/d37/d73/d7f/fa1 0 2024-09-10T09:36:24.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/485: dread d8/dd/f77 [0,4194304] 0 2024-09-10T09:36:24.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/486: creat d8/dd/d1e/fa2 x:0 0 0 2024-09-10T09:36:24.330 INFO:tasks.workunit.client.1.smithi135.stdout:0/487: dread d8/dd/f13 [0,4194304] 0 2024-09-10T09:36:24.331 INFO:tasks.workunit.client.1.smithi135.stdout:0/488: truncate d8/dd/d18/f1a 1445309 0 2024-09-10T09:36:24.331 INFO:tasks.workunit.client.1.smithi135.stdout:0/489: write d8/dd/f77 [1061357,41930] 0 2024-09-10T09:36:24.334 INFO:tasks.workunit.client.1.smithi135.stdout:0/490: creat d8/dd/d11/d17/fa3 x:0 0 0 2024-09-10T09:36:24.335 INFO:tasks.workunit.client.1.smithi135.stdout:0/491: symlink d8/d1c/d61/la4 0 2024-09-10T09:36:24.337 INFO:tasks.workunit.client.1.smithi135.stdout:0/492: dread d8/de/f38 [0,4194304] 0 2024-09-10T09:36:24.337 INFO:tasks.workunit.client.1.smithi135.stdout:0/493: write d8/dd/d11/d17/f42 [4200274,6545] 0 2024-09-10T09:36:24.351 INFO:tasks.workunit.client.1.smithi135.stdout:0/494: dwrite d8/d80/f8b [0,4194304] 0 2024-09-10T09:36:24.368 INFO:tasks.workunit.client.1.smithi135.stdout:0/495: dwrite d8/d1c/f98 [0,4194304] 0 2024-09-10T09:36:24.368 INFO:tasks.workunit.client.1.smithi135.stdout:0/496: read - d8/dd/d4a/d50/d54/f9a zero size 2024-09-10T09:36:24.372 INFO:tasks.workunit.client.1.smithi135.stdout:0/497: rename d8/dd/l20 to d8/dd/d4a/d50/d54/d5f/d4b/la5 0 2024-09-10T09:36:24.372 INFO:tasks.workunit.client.1.smithi135.stdout:0/498: creat d8/dd/d11/d17/fa6 x:0 0 0 2024-09-10T09:36:24.523 INFO:tasks.workunit.client.1.smithi135.stdout:4/579: sync 2024-09-10T09:36:24.523 INFO:tasks.workunit.client.1.smithi135.stdout:9/381: sync 2024-09-10T09:36:24.523 INFO:tasks.workunit.client.1.smithi135.stdout:9/382: fdatasync de/df/d1d/d23/d25/d28/f4c 0 2024-09-10T09:36:24.523 INFO:tasks.workunit.client.1.smithi135.stdout:4/580: truncate d1/f90 738593 0 2024-09-10T09:36:24.524 INFO:tasks.workunit.client.1.smithi135.stdout:4/581: creat d1/d4a/d6d/fb0 x:0 0 0 2024-09-10T09:36:24.525 INFO:tasks.workunit.client.1.smithi135.stdout:4/582: readlink d1/db/d23/l5e 0 2024-09-10T09:36:24.527 INFO:tasks.workunit.client.1.smithi135.stdout:4/583: mknod d1/d4a/cb1 0 2024-09-10T09:36:24.528 INFO:tasks.workunit.client.1.smithi135.stdout:9/383: dread de/f15 [0,4194304] 0 2024-09-10T09:36:24.529 INFO:tasks.workunit.client.1.smithi135.stdout:9/384: dread de/df/d1d/d23/f67 [0,4194304] 0 2024-09-10T09:36:24.530 INFO:tasks.workunit.client.1.smithi135.stdout:4/584: truncate d1/db/d9/f38 1465185 0 2024-09-10T09:36:24.531 INFO:tasks.workunit.client.1.smithi135.stdout:4/585: read d1/db/d23/f42 [2428506,109602] 0 2024-09-10T09:36:24.532 INFO:tasks.workunit.client.1.smithi135.stdout:9/385: mknod de/df/d1d/d23/d25/d28/c85 0 2024-09-10T09:36:24.538 INFO:tasks.workunit.client.1.smithi135.stdout:9/386: getdents de/df 0 2024-09-10T09:36:24.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/586: rmdir d1/de/d16/d95 39 2024-09-10T09:36:24.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/587: chown d1/db/d9/c52 130148777 1 2024-09-10T09:36:24.544 INFO:tasks.workunit.client.1.smithi135.stdout:9/387: mkdir de/df/d1d/d1e/d52/d86 0 2024-09-10T09:36:24.552 INFO:tasks.workunit.client.1.smithi135.stdout:9/388: rename de/df/d1d/d1e/d68/c7d to de/df/d1d/d1e/d52/c87 0 2024-09-10T09:36:24.566 INFO:tasks.workunit.client.1.smithi135.stdout:4/588: dwrite d1/db/d9/d55/f94 [0,4194304] 0 2024-09-10T09:36:24.567 INFO:tasks.workunit.client.1.smithi135.stdout:1/396: sync 2024-09-10T09:36:24.567 INFO:tasks.workunit.client.1.smithi135.stdout:3/336: sync 2024-09-10T09:36:24.567 INFO:tasks.workunit.client.1.smithi135.stdout:8/436: sync 2024-09-10T09:36:24.568 INFO:tasks.workunit.client.1.smithi135.stdout:5/402: sync 2024-09-10T09:36:24.568 INFO:tasks.workunit.client.1.smithi135.stdout:6/531: sync 2024-09-10T09:36:24.568 INFO:tasks.workunit.client.1.smithi135.stdout:6/532: chown d5/d1e/d35/f9f 919849 1 2024-09-10T09:36:24.568 INFO:tasks.workunit.client.1.smithi135.stdout:8/437: read d1/d15/d16/f29 [1561666,130430] 0 2024-09-10T09:36:24.570 INFO:tasks.workunit.client.1.smithi135.stdout:4/589: link d1/db/d9/d55/c72 d1/db/d9/d55/d70/da4/cb2 0 2024-09-10T09:36:24.571 INFO:tasks.workunit.client.1.smithi135.stdout:9/389: dwrite de/df/d1d/d23/f2d [0,4194304] 0 2024-09-10T09:36:24.572 INFO:tasks.workunit.client.1.smithi135.stdout:5/403: rename d3/d26/d48/f63 to d3/d26/d4e/f86 0 2024-09-10T09:36:24.573 INFO:tasks.workunit.client.1.smithi135.stdout:5/404: stat d3/d26/c6d 0 2024-09-10T09:36:24.574 INFO:tasks.workunit.client.1.smithi135.stdout:3/337: dread d4/d5/db/f3f [0,4194304] 0 2024-09-10T09:36:24.575 INFO:tasks.workunit.client.1.smithi135.stdout:6/533: creat d5/fab x:0 0 0 2024-09-10T09:36:24.575 INFO:tasks.workunit.client.1.smithi135.stdout:1/397: dread d1d/d20/d24/d2b/f36 [0,4194304] 0 2024-09-10T09:36:24.575 INFO:tasks.workunit.client.1.smithi135.stdout:8/438: symlink d1/d13/l98 0 2024-09-10T09:36:24.577 INFO:tasks.workunit.client.1.smithi135.stdout:4/590: mkdir d1/d85/db3 0 2024-09-10T09:36:24.577 INFO:tasks.workunit.client.1.smithi135.stdout:3/338: mknod d4/d55/d64/c65 0 2024-09-10T09:36:24.578 INFO:tasks.workunit.client.1.smithi135.stdout:5/405: dread d3/d26/d48/d57/f5e [0,4194304] 0 2024-09-10T09:36:24.582 INFO:tasks.workunit.client.1.smithi135.stdout:6/534: dread d5/d15/d27/f3f [0,4194304] 0 2024-09-10T09:36:24.591 INFO:tasks.workunit.client.1.smithi135.stdout:6/535: write d5/d1e/d3b/f77 [1785464,17767] 0 2024-09-10T09:36:24.591 INFO:tasks.workunit.client.1.smithi135.stdout:6/536: fsync d5/d15/d56/f95 0 2024-09-10T09:36:24.628 INFO:tasks.workunit.client.1.smithi135.stdout:7/398: sync 2024-09-10T09:36:24.628 INFO:tasks.workunit.client.1.smithi135.stdout:2/421: sync 2024-09-10T09:36:24.628 INFO:tasks.workunit.client.1.smithi135.stdout:0/499: sync 2024-09-10T09:36:24.628 INFO:tasks.workunit.client.1.smithi135.stdout:2/422: read df/d1b/f26 [1048573,60402] 0 2024-09-10T09:36:24.629 INFO:tasks.workunit.client.1.smithi135.stdout:1/398: unlink d1d/d20/d3c/d4e/f56 0 2024-09-10T09:36:24.629 INFO:tasks.workunit.client.1.smithi135.stdout:1/399: read d1d/d20/d3c/f3d [167630,31687] 0 2024-09-10T09:36:24.630 INFO:tasks.workunit.client.1.smithi135.stdout:8/439: mkdir d1/d15/d16/d99 0 2024-09-10T09:36:24.630 INFO:tasks.workunit.client.1.smithi135.stdout:8/440: write d1/d15/d16/d71/f8d [884380,76564] 0 2024-09-10T09:36:24.631 INFO:tasks.workunit.client.1.smithi135.stdout:4/591: truncate d1/de/d16/f44 1881282 0 2024-09-10T09:36:24.631 INFO:tasks.workunit.client.1.smithi135.stdout:4/592: chown d1/d4a/f87 0 1 2024-09-10T09:36:24.634 INFO:tasks.workunit.client.1.smithi135.stdout:3/339: rename d4/l5c to d4/d5/db/l66 0 2024-09-10T09:36:24.636 INFO:tasks.workunit.client.1.smithi135.stdout:5/406: mkdir d3/d26/d4e/d87 0 2024-09-10T09:36:24.638 INFO:tasks.workunit.client.1.smithi135.stdout:3/340: dread d4/d55/d64/f41 [0,4194304] 0 2024-09-10T09:36:24.641 INFO:tasks.workunit.client.1.smithi135.stdout:6/537: link d5/d1e/d3b/d42/d3c/d44/ca5 d5/dd/da3/cac 0 2024-09-10T09:36:24.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/399: mknod d2/d15/d41/d49/d60/d30/d6b/c7c 0 2024-09-10T09:36:24.642 INFO:tasks.workunit.client.1.smithi135.stdout:7/400: write d2/d15/d39/f6d [926433,61567] 0 2024-09-10T09:36:24.644 INFO:tasks.workunit.client.1.smithi135.stdout:2/423: mkdir df/d1b/d23/d36/d5f/d3d/d87 0 2024-09-10T09:36:24.645 INFO:tasks.workunit.client.1.smithi135.stdout:1/400: mkdir d1d/d20/d24/d37/d6d/d76 0 2024-09-10T09:36:24.649 INFO:tasks.workunit.client.1.smithi135.stdout:8/441: creat d1/d15/d16/d33/d39/f9a x:0 0 0 2024-09-10T09:36:24.652 INFO:tasks.workunit.client.1.smithi135.stdout:3/341: dread d4/d5/db/d36/d43/f46 [0,4194304] 0 2024-09-10T09:36:24.652 INFO:tasks.workunit.client.1.smithi135.stdout:0/500: rename d8/l47 to d8/dd/d1e/la7 0 2024-09-10T09:36:24.655 INFO:tasks.workunit.client.1.smithi135.stdout:6/538: truncate d5/dd/f6e 936950 0 2024-09-10T09:36:24.655 INFO:tasks.workunit.client.1.smithi135.stdout:6/539: write d5/f17 [1110994,27850] 0 2024-09-10T09:36:24.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/401: dread d1d/d20/f43 [0,4194304] 0 2024-09-10T09:36:24.656 INFO:tasks.workunit.client.1.smithi135.stdout:2/424: rmdir df/d13 39 2024-09-10T09:36:24.657 INFO:tasks.workunit.client.1.smithi135.stdout:5/407: dwrite d3/d71/f5a [0,4194304] 0 2024-09-10T09:36:24.660 INFO:tasks.workunit.client.1.smithi135.stdout:8/442: truncate d1/d15/d24/f35 78812 0 2024-09-10T09:36:24.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/342: symlink d4/d55/l67 0 2024-09-10T09:36:24.664 INFO:tasks.workunit.client.1.smithi135.stdout:1/402: dread d1d/d20/f30 [0,4194304] 0 2024-09-10T09:36:24.664 INFO:tasks.workunit.client.1.smithi135.stdout:7/401: rename d2/d15/d41/d49/d60/c61 to d2/d15/d41/d49/d52/c7d 0 2024-09-10T09:36:24.667 INFO:tasks.workunit.client.1.smithi135.stdout:6/540: creat d5/dd/d50/d54/fad x:0 0 0 2024-09-10T09:36:24.669 INFO:tasks.workunit.client.1.smithi135.stdout:8/443: dread d1/f5 [4194304,4194304] 0 2024-09-10T09:36:24.670 INFO:tasks.workunit.client.1.smithi135.stdout:2/425: truncate df/d1b/d23/d42/f46 3184622 0 2024-09-10T09:36:24.670 INFO:tasks.workunit.client.1.smithi135.stdout:2/426: stat df/d1b/d23/f80 0 2024-09-10T09:36:24.673 INFO:tasks.workunit.client.1.smithi135.stdout:6/541: read d5/d1e/d35/f21 [3039212,34401] 0 2024-09-10T09:36:24.674 INFO:tasks.workunit.client.1.smithi135.stdout:5/408: mkdir d3/d26/d88 0 2024-09-10T09:36:24.677 INFO:tasks.workunit.client.1.smithi135.stdout:3/343: mkdir d4/d5/db/d44/d68 0 2024-09-10T09:36:24.680 INFO:tasks.workunit.client.1.smithi135.stdout:1/403: creat d1d/d20/f77 x:0 0 0 2024-09-10T09:36:24.681 INFO:tasks.workunit.client.1.smithi135.stdout:3/344: dread d4/d5/dc/f19 [4194304,4194304] 0 2024-09-10T09:36:24.684 INFO:tasks.workunit.client.1.smithi135.stdout:8/444: creat d1/f9b x:0 0 0 2024-09-10T09:36:24.686 INFO:tasks.workunit.client.1.smithi135.stdout:1/404: dread d1d/f2a [0,4194304] 0 2024-09-10T09:36:24.686 INFO:tasks.workunit.client.1.smithi135.stdout:1/405: chown d1d/d20/d24/d2b/d4c/f55 171553901 1 2024-09-10T09:36:24.689 INFO:tasks.workunit.client.1.smithi135.stdout:2/427: creat df/d1b/d23/f88 x:0 0 0 2024-09-10T09:36:24.689 INFO:tasks.workunit.client.1.smithi135.stdout:2/428: dread - df/d13/f82 zero size 2024-09-10T09:36:24.691 INFO:tasks.workunit.client.1.smithi135.stdout:6/542: symlink d5/dd/d50/d86/lae 0 2024-09-10T09:36:24.692 INFO:tasks.workunit.client.1.smithi135.stdout:5/409: mknod d3/dc/d69/d72/c89 0 2024-09-10T09:36:24.692 INFO:tasks.workunit.client.1.smithi135.stdout:5/410: readlink d3/dc/d16/l2e 0 2024-09-10T09:36:24.694 INFO:tasks.workunit.client.1.smithi135.stdout:8/445: dread d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:24.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/406: link d1d/d20/d3c/l4a d1d/d20/d3c/d4e/l78 0 2024-09-10T09:36:24.695 INFO:tasks.workunit.client.1.smithi135.stdout:6/543: link d5/d1e/d62/d8a/f8d d5/dd/da3/faf 0 2024-09-10T09:36:24.695 INFO:tasks.workunit.client.1.smithi135.stdout:6/544: creat d5/d1e/d3b/d42/d2d/d55/fb0 x:0 0 0 2024-09-10T09:36:24.697 INFO:tasks.workunit.client.1.smithi135.stdout:8/446: truncate d1/d15/f19 851720 0 2024-09-10T09:36:24.697 INFO:tasks.workunit.client.1.smithi135.stdout:8/447: dread - d1/d15/d49/f85 zero size 2024-09-10T09:36:24.697 INFO:tasks.workunit.client.1.smithi135.stdout:1/407: creat d1d/d20/d3c/d6a/f79 x:0 0 0 2024-09-10T09:36:24.697 INFO:tasks.workunit.client.1.smithi135.stdout:1/408: truncate d1d/d20/d5d/f70 675633 0 2024-09-10T09:36:24.700 INFO:tasks.workunit.client.1.smithi135.stdout:6/545: unlink d5/d1e/l4a 0 2024-09-10T09:36:24.702 INFO:tasks.workunit.client.1.smithi135.stdout:1/409: creat d1d/d28/d4b/d53/f7a x:0 0 0 2024-09-10T09:36:24.705 INFO:tasks.workunit.client.1.smithi135.stdout:1/410: creat d1d/d20/d24/d2b/f7b x:0 0 0 2024-09-10T09:36:24.705 INFO:tasks.workunit.client.1.smithi135.stdout:1/411: write d1d/f3f [1097727,60239] 0 2024-09-10T09:36:24.705 INFO:tasks.workunit.client.1.smithi135.stdout:1/412: fsync d1d/d20/d24/d2b/d4c/d63/f66 0 2024-09-10T09:36:24.708 INFO:tasks.workunit.client.1.smithi135.stdout:1/413: creat d1d/d28/f7c x:0 0 0 2024-09-10T09:36:24.738 INFO:tasks.workunit.client.1.smithi135.stdout:2/429: write df/d1b/d23/d42/f46 [884240,41632] 0 2024-09-10T09:36:24.739 INFO:tasks.workunit.client.1.smithi135.stdout:3/345: dwrite d4/d55/f60 [0,4194304] 0 2024-09-10T09:36:24.741 INFO:tasks.workunit.client.1.smithi135.stdout:1/414: dwrite d1d/f2c [0,4194304] 0 2024-09-10T09:36:24.745 INFO:tasks.workunit.client.1.smithi135.stdout:5/411: dread d3/d26/f5f [0,4194304] 0 2024-09-10T09:36:24.750 INFO:tasks.workunit.client.1.smithi135.stdout:1/415: dread d1d/f2c [0,4194304] 0 2024-09-10T09:36:24.756 INFO:tasks.workunit.client.1.smithi135.stdout:3/346: dwrite d4/d5/db/d36/d43/f52 [0,4194304] 0 2024-09-10T09:36:24.760 INFO:tasks.workunit.client.1.smithi135.stdout:5/412: unlink d3/c3a 0 2024-09-10T09:36:24.762 INFO:tasks.workunit.client.1.smithi135.stdout:2/430: getdents df/d1b/d23 0 2024-09-10T09:36:24.764 INFO:tasks.workunit.client.1.smithi135.stdout:1/416: getdents d1d/d20/d24/d2b/d4c/d63 0 2024-09-10T09:36:24.765 INFO:tasks.workunit.client.1.smithi135.stdout:1/417: dread d1d/d20/d5d/f70 [0,4194304] 0 2024-09-10T09:36:24.774 INFO:tasks.workunit.client.1.smithi135.stdout:5/413: unlink d3/d26/l46 0 2024-09-10T09:36:24.775 INFO:tasks.workunit.client.1.smithi135.stdout:2/431: link df/d1b/d30/f37 df/d1b/d23/d36/d5f/f89 0 2024-09-10T09:36:24.779 INFO:tasks.workunit.client.1.smithi135.stdout:1/418: link f6 d1d/d20/d24/f7d 0 2024-09-10T09:36:24.779 INFO:tasks.workunit.client.1.smithi135.stdout:1/419: readlink l1c 0 2024-09-10T09:36:24.780 INFO:tasks.workunit.client.1.smithi135.stdout:2/432: write df/d1b/f1c [3668440,81519] 0 2024-09-10T09:36:24.781 INFO:tasks.workunit.client.1.smithi135.stdout:2/433: dread - df/d1b/d23/d36/d5f/d2c/f81 zero size 2024-09-10T09:36:24.781 INFO:tasks.workunit.client.1.smithi135.stdout:5/414: rename d3/dc/d69/d70 to d3/d44/d8a 0 2024-09-10T09:36:24.783 INFO:tasks.workunit.client.1.smithi135.stdout:1/420: symlink d1d/d20/d42/l7e 0 2024-09-10T09:36:24.783 INFO:tasks.workunit.client.1.smithi135.stdout:1/421: fsync d1d/d20/f2e 0 2024-09-10T09:36:24.783 INFO:tasks.workunit.client.1.smithi135.stdout:2/434: dread df/d13/f38 [0,4194304] 0 2024-09-10T09:36:24.783 INFO:tasks.workunit.client.1.smithi135.stdout:2/435: dread - df/d1b/d23/d36/d5f/d2c/f81 zero size 2024-09-10T09:36:24.783 INFO:tasks.workunit.client.1.smithi135.stdout:2/436: fdatasync df/d13/f44 0 2024-09-10T09:36:24.784 INFO:tasks.workunit.client.1.smithi135.stdout:5/415: rename d3/d44/d22/f2f to d3/d26/f8b 0 2024-09-10T09:36:24.785 INFO:tasks.workunit.client.1.smithi135.stdout:1/422: symlink d1d/d71/l7f 0 2024-09-10T09:36:24.785 INFO:tasks.workunit.client.1.smithi135.stdout:5/416: write d3/dc/d16/f34 [332472,72275] 0 2024-09-10T09:36:24.787 INFO:tasks.workunit.client.1.smithi135.stdout:2/437: creat df/d1b/d23/f8a x:0 0 0 2024-09-10T09:36:24.787 INFO:tasks.workunit.client.1.smithi135.stdout:1/423: dread d1d/f1e [0,4194304] 0 2024-09-10T09:36:24.789 INFO:tasks.workunit.client.1.smithi135.stdout:2/438: rename df/d13/d52/c6f to df/d1b/d23/d36/c8b 0 2024-09-10T09:36:24.792 INFO:tasks.workunit.client.1.smithi135.stdout:1/424: link d1d/d28/d4b/f69 d1d/d20/d6c/f80 0 2024-09-10T09:36:24.795 INFO:tasks.workunit.client.1.smithi135.stdout:2/439: rename df/d1b/d23/d36/d5f/d2c/d7d/d84 to df/d1b/d23/d36/d5f/d2c/d7d/d8c 0 2024-09-10T09:36:24.795 INFO:tasks.workunit.client.1.smithi135.stdout:2/440: fsync df/d1b/d23/f88 0 2024-09-10T09:36:24.795 INFO:tasks.workunit.client.1.smithi135.stdout:2/441: chown df/d1b/d23/l4c 456643964 1 2024-09-10T09:36:24.797 INFO:tasks.workunit.client.1.smithi135.stdout:1/425: rmdir d1d/d71 39 2024-09-10T09:36:24.799 INFO:tasks.workunit.client.1.smithi135.stdout:2/442: creat df/d1b/d31/f8d x:0 0 0 2024-09-10T09:36:24.801 INFO:tasks.workunit.client.1.smithi135.stdout:1/426: rename d1d/d20/d6c/f80 to d1d/d20/d24/d2b/f81 0 2024-09-10T09:36:24.802 INFO:tasks.workunit.client.1.smithi135.stdout:1/427: rename d1d/d20/d3c/l64 to d1d/d20/d5d/l82 0 2024-09-10T09:36:24.805 INFO:tasks.workunit.client.1.smithi135.stdout:5/417: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:24.805 INFO:tasks.workunit.client.1.smithi135.stdout:5/418: dread - d3/d44/f74 zero size 2024-09-10T09:36:24.812 INFO:tasks.workunit.client.1.smithi135.stdout:2/443: dread df/f54 [0,4194304] 0 2024-09-10T09:36:24.817 INFO:tasks.workunit.client.1.smithi135.stdout:1/428: dread d1d/d20/d24/d2b/d4c/f62 [0,4194304] 0 2024-09-10T09:36:24.818 INFO:tasks.workunit.client.1.smithi135.stdout:1/429: mknod d1d/d20/d24/d2b/d4c/d63/c83 0 2024-09-10T09:36:24.819 INFO:tasks.workunit.client.1.smithi135.stdout:1/430: dread - d1d/d28/f7c zero size 2024-09-10T09:36:24.833 INFO:tasks.workunit.client.1.smithi135.stdout:1/431: rmdir d1d/d28/d4b 39 2024-09-10T09:36:24.833 INFO:tasks.workunit.client.1.smithi135.stdout:1/432: creat d1d/d20/d3c/f84 x:0 0 0 2024-09-10T09:36:24.835 INFO:tasks.workunit.client.1.smithi135.stdout:1/433: rename d1d/d20/d3c/d4e/l5b to d1d/d20/d3c/d6a/l85 0 2024-09-10T09:36:24.837 INFO:tasks.workunit.client.1.smithi135.stdout:5/419: dwrite d3/d26/f6a [0,4194304] 0 2024-09-10T09:36:24.837 INFO:tasks.workunit.client.1.smithi135.stdout:5/420: chown d3/d44/f30 400184658 1 2024-09-10T09:36:24.837 INFO:tasks.workunit.client.1.smithi135.stdout:5/421: write d3/f18 [427193,28583] 0 2024-09-10T09:36:24.839 INFO:tasks.workunit.client.1.smithi135.stdout:2/444: dwrite df/d1b/d23/d36/d5f/d2c/f2e [0,4194304] 0 2024-09-10T09:36:24.840 INFO:tasks.workunit.client.1.smithi135.stdout:5/422: creat d3/dc/f8c x:0 0 0 2024-09-10T09:36:24.843 INFO:tasks.workunit.client.1.smithi135.stdout:2/445: symlink df/d1b/d70/l8e 0 2024-09-10T09:36:24.845 INFO:tasks.workunit.client.1.smithi135.stdout:2/446: unlink df/d15/c32 0 2024-09-10T09:36:24.846 INFO:tasks.workunit.client.1.smithi135.stdout:2/447: mkdir df/d13/d52/d8f 0 2024-09-10T09:36:24.846 INFO:tasks.workunit.client.1.smithi135.stdout:2/448: readlink df/d1b/d23/d42/l6c 0 2024-09-10T09:36:24.846 INFO:tasks.workunit.client.1.smithi135.stdout:2/449: creat df/d1b/d70/f90 x:0 0 0 2024-09-10T09:36:24.849 INFO:tasks.workunit.client.1.smithi135.stdout:2/450: mknod df/d13/d4f/c91 0 2024-09-10T09:36:24.850 INFO:tasks.workunit.client.1.smithi135.stdout:2/451: rename df/d1b/d23/d36/d5f/f75 to df/d1b/d30/f92 0 2024-09-10T09:36:24.859 INFO:tasks.workunit.client.1.smithi135.stdout:1/434: dwrite d1d/d20/f77 [0,4194304] 0 2024-09-10T09:36:24.862 INFO:tasks.workunit.client.1.smithi135.stdout:2/452: write df/d13/d52/f60 [3504562,109826] 0 2024-09-10T09:36:24.862 INFO:tasks.workunit.client.1.smithi135.stdout:5/423: dwrite d3/f9 [0,4194304] 0 2024-09-10T09:36:24.989 INFO:tasks.workunit.client.1.smithi135.stdout:1/435: truncate d1d/d20/d24/d2b/d4c/f62 414863 0 2024-09-10T09:36:24.992 INFO:tasks.workunit.client.1.smithi135.stdout:2/453: mknod df/c93 0 2024-09-10T09:36:24.993 INFO:tasks.workunit.client.1.smithi135.stdout:5/424: truncate d3/fb 9159849 0 2024-09-10T09:36:25.000 INFO:tasks.workunit.client.1.smithi135.stdout:1/436: getdents d1d 0 2024-09-10T09:36:25.000 INFO:tasks.workunit.client.1.smithi135.stdout:1/437: fsync d1d/f1e 0 2024-09-10T09:36:25.000 INFO:tasks.workunit.client.1.smithi135.stdout:1/438: write d1d/f58 [152550,109174] 0 2024-09-10T09:36:25.006 INFO:tasks.workunit.client.1.smithi135.stdout:2/454: link df/d1b/l77 df/d1b/d23/d36/d5f/d3d/l94 0 2024-09-10T09:36:25.008 INFO:tasks.workunit.client.1.smithi135.stdout:5/425: dwrite d3/d26/f3b [0,4194304] 0 2024-09-10T09:36:25.014 INFO:tasks.workunit.client.1.smithi135.stdout:2/455: mkdir df/d13/d4f/d95 0 2024-09-10T09:36:25.014 INFO:tasks.workunit.client.1.smithi135.stdout:2/456: readlink df/d1b/d31/l4e 0 2024-09-10T09:36:25.019 INFO:tasks.workunit.client.1.smithi135.stdout:5/426: mkdir d3/d81/d8d 0 2024-09-10T09:36:25.025 INFO:tasks.workunit.client.1.smithi135.stdout:5/427: mknod d3/dc/c8e 0 2024-09-10T09:36:25.028 INFO:tasks.workunit.client.1.smithi135.stdout:5/428: creat d3/dc/d69/d65/f8f x:0 0 0 2024-09-10T09:36:25.033 INFO:tasks.workunit.client.1.smithi135.stdout:5/429: mknod d3/d44/c90 0 2024-09-10T09:36:25.033 INFO:tasks.workunit.client.1.smithi135.stdout:5/430: read d3/f18 [121388,76242] 0 2024-09-10T09:36:25.034 INFO:tasks.workunit.client.1.smithi135.stdout:5/431: write d3/d26/f6a [5115370,48102] 0 2024-09-10T09:36:25.037 INFO:tasks.workunit.client.1.smithi135.stdout:5/432: mkdir d3/d91 0 2024-09-10T09:36:25.040 INFO:tasks.workunit.client.1.smithi135.stdout:2/457: dwrite f6 [8388608,4194304] 0 2024-09-10T09:36:25.040 INFO:tasks.workunit.client.1.smithi135.stdout:2/458: dread - df/d13/f82 zero size 2024-09-10T09:36:25.042 INFO:tasks.workunit.client.1.smithi135.stdout:5/433: dread d3/d26/f5f [0,4194304] 0 2024-09-10T09:36:25.057 INFO:tasks.workunit.client.1.smithi135.stdout:1/439: rename d1d/d20/d24 to d1d/d20/d6c/d86 0 2024-09-10T09:36:25.057 INFO:tasks.workunit.client.1.smithi135.stdout:1/440: chown d1d/d20/l73 177727 1 2024-09-10T09:36:25.057 INFO:tasks.workunit.client.1.smithi135.stdout:1/441: fdatasync d1d/f22 0 2024-09-10T09:36:25.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/442: unlink cd 0 2024-09-10T09:36:25.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/443: creat d1d/d20/d6c/f87 x:0 0 0 2024-09-10T09:36:25.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/444: creat d1d/d20/d5d/f88 x:0 0 0 2024-09-10T09:36:25.067 INFO:tasks.workunit.client.1.smithi135.stdout:5/434: dwrite d3/dc/f80 [0,4194304] 0 2024-09-10T09:36:25.068 INFO:tasks.workunit.client.1.smithi135.stdout:2/459: dwrite df/d1b/f85 [0,4194304] 0 2024-09-10T09:36:25.068 INFO:tasks.workunit.client.1.smithi135.stdout:2/460: truncate df/d1b/d23/d36/f73 394414 0 2024-09-10T09:36:25.068 INFO:tasks.workunit.client.1.smithi135.stdout:2/461: chown df/f79 2636 1 2024-09-10T09:36:25.070 INFO:tasks.workunit.client.1.smithi135.stdout:1/445: creat d1d/d20/d6c/d86/d37/f89 x:0 0 0 2024-09-10T09:36:25.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/462: mkdir df/d13/d96 0 2024-09-10T09:36:25.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/446: mkdir d1d/d20/d52/d8a 0 2024-09-10T09:36:25.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/447: dread - d1d/d20/d6c/d86/d2b/f7b zero size 2024-09-10T09:36:25.086 INFO:tasks.workunit.client.1.smithi135.stdout:5/435: dread d3/dc/f37 [0,4194304] 0 2024-09-10T09:36:25.086 INFO:tasks.workunit.client.1.smithi135.stdout:5/436: read - d3/dc/f8c zero size 2024-09-10T09:36:25.091 INFO:tasks.workunit.client.1.smithi135.stdout:1/448: symlink d1d/d20/d5d/l8b 0 2024-09-10T09:36:25.094 INFO:tasks.workunit.client.1.smithi135.stdout:5/437: mknod d3/d26/d4e/d87/c92 0 2024-09-10T09:36:25.103 INFO:tasks.workunit.client.1.smithi135.stdout:1/449: unlink d1d/d20/d3c/f50 0 2024-09-10T09:36:25.107 INFO:tasks.workunit.client.1.smithi135.stdout:1/450: dread d1d/d20/d6c/d86/d2b/d4c/d63/f66 [0,4194304] 0 2024-09-10T09:36:25.107 INFO:tasks.workunit.client.1.smithi135.stdout:1/451: dread - d1d/d20/d6c/d86/d2b/f81 zero size 2024-09-10T09:36:25.110 INFO:tasks.workunit.client.1.smithi135.stdout:1/452: symlink d1d/d20/d6c/d86/d37/d6d/l8c 0 2024-09-10T09:36:25.115 INFO:tasks.workunit.client.1.smithi135.stdout:1/453: rename d1d/f45 to d1d/d28/d4b/d53/f8d 0 2024-09-10T09:36:25.121 INFO:tasks.workunit.client.1.smithi135.stdout:5/438: dwrite d3/dc/d69/d65/f85 [0,4194304] 0 2024-09-10T09:36:25.121 INFO:tasks.workunit.client.1.smithi135.stdout:5/439: fsync d3/f18 0 2024-09-10T09:36:25.122 INFO:tasks.workunit.client.1.smithi135.stdout:1/454: write d1d/f2c [2885390,17992] 0 2024-09-10T09:36:25.122 INFO:tasks.workunit.client.1.smithi135.stdout:1/455: write d1d/d28/d4b/d53/f7a [909730,18358] 0 2024-09-10T09:36:25.126 INFO:tasks.workunit.client.1.smithi135.stdout:5/440: mkdir d3/d26/d93 0 2024-09-10T09:36:25.131 INFO:tasks.workunit.client.1.smithi135.stdout:5/441: mknod d3/d26/c94 0 2024-09-10T09:36:25.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/442: rename d3/d26/d4e/f76 to d3/f95 0 2024-09-10T09:36:25.144 INFO:tasks.workunit.client.1.smithi135.stdout:5/443: unlink d3/d26/c6d 0 2024-09-10T09:36:25.145 INFO:tasks.workunit.client.1.smithi135.stdout:1/456: dwrite d1d/d20/d3c/f3d [0,4194304] 0 2024-09-10T09:36:25.157 INFO:tasks.workunit.client.1.smithi135.stdout:5/444: dread d3/d71/f5a [0,4194304] 0 2024-09-10T09:36:25.157 INFO:tasks.workunit.client.1.smithi135.stdout:1/457: link d1d/d28/d4b/f69 d1d/d28/f8e 0 2024-09-10T09:36:25.157 INFO:tasks.workunit.client.1.smithi135.stdout:1/458: stat d1d/d28/f7c 0 2024-09-10T09:36:25.167 INFO:tasks.workunit.client.1.smithi135.stdout:1/459: rename d1d/d71/l7f to d1d/d20/d42/l8f 0 2024-09-10T09:36:25.167 INFO:tasks.workunit.client.1.smithi135.stdout:1/460: truncate d1d/d20/d6c/d86/d2b/f7b 105468 0 2024-09-10T09:36:25.169 INFO:tasks.workunit.client.1.smithi135.stdout:5/445: read d3/dc/d16/f45 [6384042,94861] 0 2024-09-10T09:36:25.171 INFO:tasks.workunit.client.1.smithi135.stdout:5/446: creat d3/d44/d8a/f96 x:0 0 0 2024-09-10T09:36:25.173 INFO:tasks.workunit.client.1.smithi135.stdout:5/447: dread d3/f5 [0,4194304] 0 2024-09-10T09:36:25.177 INFO:tasks.workunit.client.1.smithi135.stdout:1/461: dread d1d/f27 [0,4194304] 0 2024-09-10T09:36:25.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/448: rename d3/d26/f4b to d3/dc/d69/d65/d6c/f97 0 2024-09-10T09:36:25.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/449: chown d3/d44/d22 690289691 1 2024-09-10T09:36:25.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/450: chown d3/d26/d88 5432 1 2024-09-10T09:36:25.177 INFO:tasks.workunit.client.1.smithi135.stdout:1/462: write d1d/d20/d6c/d86/d2b/f36 [2135895,18291] 0 2024-09-10T09:36:25.187 INFO:tasks.workunit.client.1.smithi135.stdout:5/451: creat d3/d91/f98 x:0 0 0 2024-09-10T09:36:25.188 INFO:tasks.workunit.client.1.smithi135.stdout:5/452: mkdir d3/d99 0 2024-09-10T09:36:25.189 INFO:tasks.workunit.client.1.smithi135.stdout:2/463: truncate f6 6835495 0 2024-09-10T09:36:25.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/464: mkdir df/d13/d4f/d95/d97 0 2024-09-10T09:36:25.191 INFO:tasks.workunit.client.1.smithi135.stdout:5/453: dread d3/dc/d16/f34 [0,4194304] 0 2024-09-10T09:36:25.192 INFO:tasks.workunit.client.1.smithi135.stdout:5/454: chown d3/dc/d69/c59 11489 1 2024-09-10T09:36:25.192 INFO:tasks.workunit.client.1.smithi135.stdout:1/463: dwrite d1d/d20/f43 [0,4194304] 0 2024-09-10T09:36:25.195 INFO:tasks.workunit.client.1.smithi135.stdout:5/455: creat d3/d44/f9a x:0 0 0 2024-09-10T09:36:25.197 INFO:tasks.workunit.client.1.smithi135.stdout:1/464: rename d1d/d20/d6c/d86/d37/c5c to d1d/d20/d6c/d86/d2b/c90 0 2024-09-10T09:36:25.198 INFO:tasks.workunit.client.1.smithi135.stdout:2/465: rename df/d1b/d23/d36 to df/d1b/d23/d98 0 2024-09-10T09:36:25.198 INFO:tasks.workunit.client.1.smithi135.stdout:2/466: chown df/f12 21842 1 2024-09-10T09:36:25.199 INFO:tasks.workunit.client.1.smithi135.stdout:5/456: creat d3/dc/f9b x:0 0 0 2024-09-10T09:36:25.204 INFO:tasks.workunit.client.1.smithi135.stdout:2/467: getdents df/d1b/d23/d98/d5f/d2c 0 2024-09-10T09:36:25.218 INFO:tasks.workunit.client.1.smithi135.stdout:2/468: dread df/d1b/d23/f28 [0,4194304] 0 2024-09-10T09:36:25.218 INFO:tasks.workunit.client.1.smithi135.stdout:2/469: chown df/d13/f44 58 1 2024-09-10T09:36:25.218 INFO:tasks.workunit.client.1.smithi135.stdout:5/457: dwrite d3/f18 [0,4194304] 0 2024-09-10T09:36:25.218 INFO:tasks.workunit.client.1.smithi135.stdout:5/458: truncate d3/dc/f9b 919808 0 2024-09-10T09:36:25.218 INFO:tasks.workunit.client.1.smithi135.stdout:5/459: getdents d3/d26/d88 0 2024-09-10T09:36:25.219 INFO:tasks.workunit.client.1.smithi135.stdout:2/470: dread df/d13/f38 [0,4194304] 0 2024-09-10T09:36:25.220 INFO:tasks.workunit.client.1.smithi135.stdout:1/465: dwrite d1d/d20/d5d/f70 [0,4194304] 0 2024-09-10T09:36:25.224 INFO:tasks.workunit.client.1.smithi135.stdout:5/460: rename d3/dc/d69/d65/d6c/f97 to d3/dc/d69/d72/f9c 0 2024-09-10T09:36:25.225 INFO:tasks.workunit.client.1.smithi135.stdout:2/471: creat df/d1b/d23/d98/d5f/d2c/d7d/d8c/f99 x:0 0 0 2024-09-10T09:36:25.226 INFO:tasks.workunit.client.1.smithi135.stdout:2/472: dread - df/f79 zero size 2024-09-10T09:36:25.226 INFO:tasks.workunit.client.1.smithi135.stdout:2/473: chown df/d1b/d23/d98/d5f/d2c/f83 15 1 2024-09-10T09:36:25.231 INFO:tasks.workunit.client.1.smithi135.stdout:1/466: unlink d1d/l1f 0 2024-09-10T09:36:25.232 INFO:tasks.workunit.client.1.smithi135.stdout:5/461: mkdir d3/d99/d9d 0 2024-09-10T09:36:25.234 INFO:tasks.workunit.client.1.smithi135.stdout:9/390: sync 2024-09-10T09:36:25.236 INFO:tasks.workunit.client.1.smithi135.stdout:5/462: rename d3/dc/d16/d41/f53 to d3/dc/d69/d65/f9e 0 2024-09-10T09:36:25.236 INFO:tasks.workunit.client.1.smithi135.stdout:5/463: chown d3/d44/c6f 179079167 1 2024-09-10T09:36:25.236 INFO:tasks.workunit.client.1.smithi135.stdout:5/464: write d3/dc/d16/f34 [464845,106276] 0 2024-09-10T09:36:25.241 INFO:tasks.workunit.client.1.smithi135.stdout:9/391: mkdir de/df/d1d/d23/d25/d5c/d88 0 2024-09-10T09:36:25.241 INFO:tasks.workunit.client.1.smithi135.stdout:9/392: fdatasync de/df/d1d/d23/d25/d28/f81 0 2024-09-10T09:36:25.242 INFO:tasks.workunit.client.1.smithi135.stdout:9/393: fsync de/df/f40 0 2024-09-10T09:36:25.242 INFO:tasks.workunit.client.1.smithi135.stdout:9/394: dread - de/f80 zero size 2024-09-10T09:36:25.242 INFO:tasks.workunit.client.1.smithi135.stdout:1/467: read d1d/f2a [836210,130559] 0 2024-09-10T09:36:25.247 INFO:tasks.workunit.client.1.smithi135.stdout:2/474: dwrite df/d15/f24 [4194304,4194304] 0 2024-09-10T09:36:25.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/468: rmdir d1d/d20/d6c/d86/d2b/d4c/d63 39 2024-09-10T09:36:25.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/469: chown d1d/d20/d3c 7602878 1 2024-09-10T09:36:25.247 INFO:tasks.workunit.client.1.smithi135.stdout:1/470: write d1d/d28/f7c [725314,17727] 0 2024-09-10T09:36:25.248 INFO:tasks.workunit.client.1.smithi135.stdout:9/395: dread de/df/d1d/d23/d25/d28/f37 [0,4194304] 0 2024-09-10T09:36:25.251 INFO:tasks.workunit.client.1.smithi135.stdout:1/471: creat d1d/d20/d42/f91 x:0 0 0 2024-09-10T09:36:25.252 INFO:tasks.workunit.client.1.smithi135.stdout:9/396: creat de/df/d1d/d23/d25/d5c/d88/f89 x:0 0 0 2024-09-10T09:36:25.252 INFO:tasks.workunit.client.1.smithi135.stdout:9/397: dread - de/df/f5a zero size 2024-09-10T09:36:25.253 INFO:tasks.workunit.client.1.smithi135.stdout:9/398: creat de/df/d1d/d23/d25/d28/d4e/f8a x:0 0 0 2024-09-10T09:36:25.253 INFO:tasks.workunit.client.1.smithi135.stdout:9/399: chown de/df/f5a 1400 1 2024-09-10T09:36:25.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/472: symlink d1d/d71/l92 0 2024-09-10T09:36:25.256 INFO:tasks.workunit.client.1.smithi135.stdout:5/465: dwrite d3/f18 [0,4194304] 0 2024-09-10T09:36:25.264 INFO:tasks.workunit.client.1.smithi135.stdout:9/400: creat de/df/d1d/f8b x:0 0 0 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:9/401: stat de/df/d1d/d23/d25/d28/c85 0 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:1/473: dread d1d/d20/f30 [0,4194304] 0 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:1/474: creat d1d/d20/d3c/d6a/f93 x:0 0 0 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:1/475: chown d1d/d28/d4b/f69 3765971 1 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:1/476: creat d1d/d20/f94 x:0 0 0 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:1/477: chown d1d/d20/d6c 259 1 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:9/402: symlink de/df/d1d/d1e/d3f/l8c 0 2024-09-10T09:36:25.265 INFO:tasks.workunit.client.1.smithi135.stdout:9/403: stat de 0 2024-09-10T09:36:25.267 INFO:tasks.workunit.client.1.smithi135.stdout:5/466: read d3/f14 [589387,38674] 0 2024-09-10T09:36:25.267 INFO:tasks.workunit.client.1.smithi135.stdout:5/467: chown d3/d26/d48/c75 11882 1 2024-09-10T09:36:25.267 INFO:tasks.workunit.client.1.smithi135.stdout:5/468: chown d3/dc/d16/d41/f62 76610991 1 2024-09-10T09:36:25.268 INFO:tasks.workunit.client.1.smithi135.stdout:1/478: truncate d1d/d20/d6c/d86/d2b/f3a 3257299 0 2024-09-10T09:36:25.270 INFO:tasks.workunit.client.1.smithi135.stdout:9/404: creat de/df/d1d/d23/f8d x:0 0 0 2024-09-10T09:36:25.271 INFO:tasks.workunit.client.1.smithi135.stdout:1/479: mknod d1d/d20/d52/d8a/c95 0 2024-09-10T09:36:25.275 INFO:tasks.workunit.client.1.smithi135.stdout:1/480: symlink d1d/d20/d6c/d86/d2b/l96 0 2024-09-10T09:36:25.275 INFO:tasks.workunit.client.1.smithi135.stdout:5/469: dread d3/d26/d48/d57/f77 [0,4194304] 0 2024-09-10T09:36:25.276 INFO:tasks.workunit.client.1.smithi135.stdout:2/475: dwrite df/d15/f67 [0,4194304] 0 2024-09-10T09:36:25.276 INFO:tasks.workunit.client.1.smithi135.stdout:2/476: readlink df/d1b/d31/l4e 0 2024-09-10T09:36:25.276 INFO:tasks.workunit.client.1.smithi135.stdout:2/477: chown df/d1b/f26 455273 1 2024-09-10T09:36:25.276 INFO:tasks.workunit.client.1.smithi135.stdout:2/478: stat df/d1b/d23/d98/d5f/d3d/f5b 0 2024-09-10T09:36:25.276 INFO:tasks.workunit.client.1.smithi135.stdout:2/479: dread - df/d1b/d23/f88 zero size 2024-09-10T09:36:25.278 INFO:tasks.workunit.client.1.smithi135.stdout:1/481: rename d1d/d20/d42/l8f to d1d/d71/l97 0 2024-09-10T09:36:25.288 INFO:tasks.workunit.client.1.smithi135.stdout:9/405: getdents de/df/d1d/d1e/d3f 0 2024-09-10T09:36:25.289 INFO:tasks.workunit.client.1.smithi135.stdout:9/406: creat de/df/d1d/d23/f8e x:0 0 0 2024-09-10T09:36:25.290 INFO:tasks.workunit.client.1.smithi135.stdout:5/470: write d3/f95 [4108028,2414] 0 2024-09-10T09:36:25.300 INFO:tasks.workunit.client.1.smithi135.stdout:2/480: unlink df/d1b/d23/d98/f55 0 2024-09-10T09:36:25.301 INFO:tasks.workunit.client.1.smithi135.stdout:1/482: dwrite d1d/d20/d6c/d86/d2b/f32 [0,4194304] 0 2024-09-10T09:36:25.301 INFO:tasks.workunit.client.1.smithi135.stdout:1/483: write d1d/d20/d6c/d86/f4d [875907,42128] 0 2024-09-10T09:36:25.302 INFO:tasks.workunit.client.1.smithi135.stdout:1/484: creat d1d/d20/d3c/d6a/f98 x:0 0 0 2024-09-10T09:36:25.302 INFO:tasks.workunit.client.1.smithi135.stdout:9/407: symlink de/df/d1d/d23/d25/d5c/d83/l8f 0 2024-09-10T09:36:25.303 INFO:tasks.workunit.client.1.smithi135.stdout:5/471: unlink d3/dc/d69/d65/f8f 0 2024-09-10T09:36:25.303 INFO:tasks.workunit.client.1.smithi135.stdout:5/472: dread - d3/f31 zero size 2024-09-10T09:36:25.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/473: readlink d3/l1b 0 2024-09-10T09:36:25.304 INFO:tasks.workunit.client.1.smithi135.stdout:5/474: readlink d3/dc/d16/l82 0 2024-09-10T09:36:25.308 INFO:tasks.workunit.client.1.smithi135.stdout:1/485: symlink d1d/d28/d4b/l99 0 2024-09-10T09:36:25.308 INFO:tasks.workunit.client.1.smithi135.stdout:2/481: dread df/f54 [0,4194304] 0 2024-09-10T09:36:25.310 INFO:tasks.workunit.client.1.smithi135.stdout:7/402: sync 2024-09-10T09:36:25.310 INFO:tasks.workunit.client.1.smithi135.stdout:8/448: sync 2024-09-10T09:36:25.310 INFO:tasks.workunit.client.1.smithi135.stdout:0/501: sync 2024-09-10T09:36:25.310 INFO:tasks.workunit.client.1.smithi135.stdout:4/593: sync 2024-09-10T09:36:25.310 INFO:tasks.workunit.client.1.smithi135.stdout:7/403: creat d2/d15/d39/f7e x:0 0 0 2024-09-10T09:36:25.311 INFO:tasks.workunit.client.1.smithi135.stdout:9/408: dread de/df/d1d/d23/d25/d28/f39 [0,4194304] 0 2024-09-10T09:36:25.312 INFO:tasks.workunit.client.1.smithi135.stdout:1/486: mkdir d1d/d20/d9a 0 2024-09-10T09:36:25.313 INFO:tasks.workunit.client.1.smithi135.stdout:8/449: dread d1/d15/f4d [0,4194304] 0 2024-09-10T09:36:25.315 INFO:tasks.workunit.client.1.smithi135.stdout:2/482: mkdir df/d13/d4f/d95/d97/d9a 0 2024-09-10T09:36:25.319 INFO:tasks.workunit.client.1.smithi135.stdout:4/594: symlink d1/db/d9/lb4 0 2024-09-10T09:36:25.320 INFO:tasks.workunit.client.1.smithi135.stdout:7/404: symlink d2/d15/d5c/l7f 0 2024-09-10T09:36:25.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/502: read d8/dd/d18/f43 [2760869,112990] 0 2024-09-10T09:36:25.323 INFO:tasks.workunit.client.1.smithi135.stdout:8/450: write d1/d13/f6e [2001419,104049] 0 2024-09-10T09:36:25.324 INFO:tasks.workunit.client.1.smithi135.stdout:5/475: symlink d3/dc/l9f 0 2024-09-10T09:36:25.324 INFO:tasks.workunit.client.1.smithi135.stdout:5/476: write d3/dc/f27 [5099229,125755] 0 2024-09-10T09:36:25.325 INFO:tasks.workunit.client.1.smithi135.stdout:6/546: sync 2024-09-10T09:36:25.325 INFO:tasks.workunit.client.1.smithi135.stdout:3/347: sync 2024-09-10T09:36:25.326 INFO:tasks.workunit.client.1.smithi135.stdout:1/487: creat d1d/d20/d9a/f9b x:0 0 0 2024-09-10T09:36:25.327 INFO:tasks.workunit.client.1.smithi135.stdout:2/483: creat df/d1b/d23/d98/f9b x:0 0 0 2024-09-10T09:36:25.329 INFO:tasks.workunit.client.1.smithi135.stdout:4/595: mkdir d1/db/d9/d55/db5 0 2024-09-10T09:36:25.331 INFO:tasks.workunit.client.1.smithi135.stdout:7/405: creat d2/d15/f80 x:0 0 0 2024-09-10T09:36:25.331 INFO:tasks.workunit.client.1.smithi135.stdout:8/451: read d1/d15/d16/f75 [2364271,53923] 0 2024-09-10T09:36:25.333 INFO:tasks.workunit.client.1.smithi135.stdout:0/503: mkdir d8/d1c/d37/d73/d7f/d8c/da8 0 2024-09-10T09:36:25.333 INFO:tasks.workunit.client.1.smithi135.stdout:0/504: stat d8/dd/d11/l25 0 2024-09-10T09:36:25.335 INFO:tasks.workunit.client.1.smithi135.stdout:9/409: mknod de/df/d1d/d23/d25/c90 0 2024-09-10T09:36:25.335 INFO:tasks.workunit.client.1.smithi135.stdout:3/348: write d4/d55/f60 [69088,82266] 0 2024-09-10T09:36:25.335 INFO:tasks.workunit.client.1.smithi135.stdout:3/349: chown d4/d5 6490701 1 2024-09-10T09:36:25.335 INFO:tasks.workunit.client.1.smithi135.stdout:3/350: creat d4/d5/dc/f69 x:0 0 0 2024-09-10T09:36:25.337 INFO:tasks.workunit.client.1.smithi135.stdout:5/477: rename d3/d26/f3b to d3/dc/d69/d65/fa0 0 2024-09-10T09:36:25.337 INFO:tasks.workunit.client.1.smithi135.stdout:9/410: dread de/df/f3d [0,4194304] 0 2024-09-10T09:36:25.339 INFO:tasks.workunit.client.1.smithi135.stdout:6/547: link d5/d1e/d3b/d42/d2d/d55/d5b/c75 d5/d1e/d3b/d74/cb1 0 2024-09-10T09:36:25.341 INFO:tasks.workunit.client.1.smithi135.stdout:3/351: write d4/d5/db/d44/f4e [1857277,115638] 0 2024-09-10T09:36:25.341 INFO:tasks.workunit.client.1.smithi135.stdout:3/352: write d4/d5/db/f3f [4987560,101032] 0 2024-09-10T09:36:25.341 INFO:tasks.workunit.client.1.smithi135.stdout:1/488: mknod d1d/d20/d42/c9c 0 2024-09-10T09:36:25.342 INFO:tasks.workunit.client.1.smithi135.stdout:2/484: creat df/d1b/f9c x:0 0 0 2024-09-10T09:36:25.342 INFO:tasks.workunit.client.1.smithi135.stdout:1/489: read d1d/d28/d4b/d53/f7a [672550,72705] 0 2024-09-10T09:36:25.343 INFO:tasks.workunit.client.1.smithi135.stdout:1/490: write d1d/d20/d3c/f5f [213216,76443] 0 2024-09-10T09:36:25.344 INFO:tasks.workunit.client.1.smithi135.stdout:7/406: mkdir d2/d15/d81 0 2024-09-10T09:36:25.345 INFO:tasks.workunit.client.1.smithi135.stdout:8/452: truncate d1/d15/d49/f4e 1455290 0 2024-09-10T09:36:25.349 INFO:tasks.workunit.client.1.smithi135.stdout:8/453: dread d1/d27/f40 [0,4194304] 0 2024-09-10T09:36:25.352 INFO:tasks.workunit.client.1.smithi135.stdout:0/505: unlink d8/d1c/d37/d9c/fa0 0 2024-09-10T09:36:25.358 INFO:tasks.workunit.client.1.smithi135.stdout:4/596: rename d1/db/d9/f64 to d1/db/d83/fb6 0 2024-09-10T09:36:25.361 INFO:tasks.workunit.client.1.smithi135.stdout:9/411: truncate de/f18 977442 0 2024-09-10T09:36:25.363 INFO:tasks.workunit.client.1.smithi135.stdout:3/353: mkdir d4/d5/db/d36/d6a 0 2024-09-10T09:36:25.365 INFO:tasks.workunit.client.1.smithi135.stdout:7/407: mknod d2/d25/d5d/c82 0 2024-09-10T09:36:25.367 INFO:tasks.workunit.client.1.smithi135.stdout:8/454: symlink d1/d15/d16/d96/l9c 0 2024-09-10T09:36:25.367 INFO:tasks.workunit.client.1.smithi135.stdout:8/455: write d1/d15/f19 [1883699,123361] 0 2024-09-10T09:36:25.367 INFO:tasks.workunit.client.1.smithi135.stdout:8/456: write d1/d13/f95 [1193940,48252] 0 2024-09-10T09:36:25.369 INFO:tasks.workunit.client.1.smithi135.stdout:5/478: link d3/dc/f13 d3/d26/d88/fa1 0 2024-09-10T09:36:25.373 INFO:tasks.workunit.client.1.smithi135.stdout:9/412: mknod de/df/d1d/d23/d25/d78/c91 0 2024-09-10T09:36:25.373 INFO:tasks.workunit.client.1.smithi135.stdout:9/413: truncate de/df/d1d/d23/d25/d28/f49 80629 0 2024-09-10T09:36:25.374 INFO:tasks.workunit.client.1.smithi135.stdout:6/548: dwrite d5/d1e/d35/f9f [0,4194304] 0 2024-09-10T09:36:25.376 INFO:tasks.workunit.client.1.smithi135.stdout:4/597: dread d1/d33/f3d [0,4194304] 0 2024-09-10T09:36:25.376 INFO:tasks.workunit.client.1.smithi135.stdout:3/354: creat d4/d5/d56/f6b x:0 0 0 2024-09-10T09:36:25.376 INFO:tasks.workunit.client.1.smithi135.stdout:3/355: write d4/f9 [4578948,686] 0 2024-09-10T09:36:25.377 INFO:tasks.workunit.client.1.smithi135.stdout:2/485: dwrite df/f54 [4194304,4194304] 0 2024-09-10T09:36:25.377 INFO:tasks.workunit.client.1.smithi135.stdout:2/486: fdatasync df/d15/f67 0 2024-09-10T09:36:25.378 INFO:tasks.workunit.client.1.smithi135.stdout:8/457: rename d1/d27/d3d/f48 to d1/d15/f9d 0 2024-09-10T09:36:25.379 INFO:tasks.workunit.client.1.smithi135.stdout:9/414: truncate de/df/d1d/d23/d25/d28/f37 736482 0 2024-09-10T09:36:25.380 INFO:tasks.workunit.client.1.smithi135.stdout:1/491: dwrite d1d/d20/d6c/d86/d2b/f36 [0,4194304] 0 2024-09-10T09:36:25.380 INFO:tasks.workunit.client.1.smithi135.stdout:1/492: readlink d1d/d20/d6c/d86/l38 0 2024-09-10T09:36:25.382 INFO:tasks.workunit.client.1.smithi135.stdout:2/487: unlink df/d15/f24 0 2024-09-10T09:36:25.383 INFO:tasks.workunit.client.1.smithi135.stdout:5/479: rename d3/dc/d69/c59 to d3/d81/d8d/ca2 0 2024-09-10T09:36:25.384 INFO:tasks.workunit.client.1.smithi135.stdout:9/415: mknod de/df/d7e/c92 0 2024-09-10T09:36:25.385 INFO:tasks.workunit.client.1.smithi135.stdout:0/506: dwrite d8/de/d2e/f91 [0,4194304] 0 2024-09-10T09:36:25.385 INFO:tasks.workunit.client.1.smithi135.stdout:2/488: mknod df/d13/d96/c9d 0 2024-09-10T09:36:25.385 INFO:tasks.workunit.client.1.smithi135.stdout:2/489: creat df/d1b/f9e x:0 0 0 2024-09-10T09:36:25.387 INFO:tasks.workunit.client.1.smithi135.stdout:6/549: dread d5/d1e/d3b/f41 [0,4194304] 0 2024-09-10T09:36:25.390 INFO:tasks.workunit.client.1.smithi135.stdout:8/458: dread d1/d15/d16/d71/f8d [0,4194304] 0 2024-09-10T09:36:25.390 INFO:tasks.workunit.client.1.smithi135.stdout:8/459: write d1/d15/d24/f35 [269844,79587] 0 2024-09-10T09:36:25.390 INFO:tasks.workunit.client.1.smithi135.stdout:8/460: fsync d1/d15/d16/f29 0 2024-09-10T09:36:25.391 INFO:tasks.workunit.client.1.smithi135.stdout:5/480: unlink d3/d26/d48/c4d 0 2024-09-10T09:36:25.391 INFO:tasks.workunit.client.1.smithi135.stdout:9/416: truncate de/df/d1d/d23/d25/d28/f4c 2550952 0 2024-09-10T09:36:25.392 INFO:tasks.workunit.client.1.smithi135.stdout:9/417: creat de/df/d1d/d23/d25/d5c/d88/f93 x:0 0 0 2024-09-10T09:36:25.392 INFO:tasks.workunit.client.1.smithi135.stdout:9/418: creat de/df/d1d/d23/d25/d5c/d88/f94 x:0 0 0 2024-09-10T09:36:25.394 INFO:tasks.workunit.client.1.smithi135.stdout:1/493: dread d1d/d20/d6c/d86/f7d [0,4194304] 0 2024-09-10T09:36:25.394 INFO:tasks.workunit.client.1.smithi135.stdout:3/356: write d4/f9 [3923722,75827] 0 2024-09-10T09:36:25.394 INFO:tasks.workunit.client.1.smithi135.stdout:4/598: write d1/db/d23/f3e [5139788,127025] 0 2024-09-10T09:36:25.394 INFO:tasks.workunit.client.1.smithi135.stdout:4/599: chown d1/ca9 5045 1 2024-09-10T09:36:25.396 INFO:tasks.workunit.client.1.smithi135.stdout:7/408: dwrite d2/d15/d41/d49/d60/d54/d5e/f64 [0,4194304] 0 2024-09-10T09:36:25.396 INFO:tasks.workunit.client.1.smithi135.stdout:7/409: fsync d2/d15/d41/d49/f63 0 2024-09-10T09:36:25.401 INFO:tasks.workunit.client.1.smithi135.stdout:2/490: read df/d1b/d23/d98/d5f/d2c/f2e [4093124,8656] 0 2024-09-10T09:36:25.401 INFO:tasks.workunit.client.1.smithi135.stdout:0/507: unlink d8/dd/d18/c19 0 2024-09-10T09:36:25.401 INFO:tasks.workunit.client.1.smithi135.stdout:0/508: creat d8/dd/d11/fa9 x:0 0 0 2024-09-10T09:36:25.409 INFO:tasks.workunit.client.1.smithi135.stdout:6/550: rename d5/d15/d27/f5c to d5/fb2 0 2024-09-10T09:36:25.415 INFO:tasks.workunit.client.1.smithi135.stdout:9/419: link de/df/f40 de/df/d1d/f95 0 2024-09-10T09:36:25.415 INFO:tasks.workunit.client.1.smithi135.stdout:9/420: readlink de/df/l14 0 2024-09-10T09:36:25.416 INFO:tasks.workunit.client.1.smithi135.stdout:9/421: write de/df/d1d/d23/d25/d28/f49 [34836,105781] 0 2024-09-10T09:36:25.416 INFO:tasks.workunit.client.1.smithi135.stdout:9/422: getdents de/df/d1d/d1e/d3f 0 2024-09-10T09:36:25.416 INFO:tasks.workunit.client.1.smithi135.stdout:9/423: write de/df/d1d/d23/f57 [943273,11805] 0 2024-09-10T09:36:25.416 INFO:tasks.workunit.client.1.smithi135.stdout:9/424: stat de/df/d1d/d23/f26 0 2024-09-10T09:36:25.416 INFO:tasks.workunit.client.1.smithi135.stdout:9/425: write de/df/d1d/d6b/f7f [4473386,478] 0 2024-09-10T09:36:25.417 INFO:tasks.workunit.client.1.smithi135.stdout:3/357: creat d4/d55/d5d/d5b/f6c x:0 0 0 2024-09-10T09:36:25.424 INFO:tasks.workunit.client.1.smithi135.stdout:2/491: mknod df/d1b/c9f 0 2024-09-10T09:36:25.429 INFO:tasks.workunit.client.1.smithi135.stdout:0/509: mkdir d8/d1c/d8f/daa 0 2024-09-10T09:36:25.429 INFO:tasks.workunit.client.1.smithi135.stdout:0/510: fdatasync d8/d1c/d37/d7a/f7b 0 2024-09-10T09:36:25.429 INFO:tasks.workunit.client.1.smithi135.stdout:6/551: dread d5/d1e/d3b/d42/f7d [4194304,4194304] 0 2024-09-10T09:36:25.435 INFO:tasks.workunit.client.1.smithi135.stdout:5/481: rename d3/dc/d16/d41 to d3/d26/d48/d57/da3 0 2024-09-10T09:36:25.435 INFO:tasks.workunit.client.1.smithi135.stdout:1/494: dwrite d1d/d20/d5d/f88 [0,4194304] 0 2024-09-10T09:36:25.435 INFO:tasks.workunit.client.1.smithi135.stdout:1/495: creat d1d/d20/d6c/f9d x:0 0 0 2024-09-10T09:36:25.437 INFO:tasks.workunit.client.1.smithi135.stdout:8/461: dwrite d1/d15/f19 [0,4194304] 0 2024-09-10T09:36:25.437 INFO:tasks.workunit.client.1.smithi135.stdout:9/426: symlink de/df/d1d/d1e/d52/l96 0 2024-09-10T09:36:25.437 INFO:tasks.workunit.client.1.smithi135.stdout:7/410: dwrite d2/d25/d5d/f4f [0,4194304] 0 2024-09-10T09:36:25.437 INFO:tasks.workunit.client.1.smithi135.stdout:7/411: write d2/d15/d41/f6c [230693,15566] 0 2024-09-10T09:36:25.438 INFO:tasks.workunit.client.1.smithi135.stdout:9/427: read de/df/d1d/f43 [4572463,62632] 0 2024-09-10T09:36:25.438 INFO:tasks.workunit.client.1.smithi135.stdout:4/600: getdents d1/d33/d40 0 2024-09-10T09:36:25.439 INFO:tasks.workunit.client.1.smithi135.stdout:3/358: dwrite d4/d5/f58 [0,4194304] 0 2024-09-10T09:36:25.439 INFO:tasks.workunit.client.1.smithi135.stdout:3/359: chown d4/d5/dc/c4f 1301 1 2024-09-10T09:36:25.440 INFO:tasks.workunit.client.1.smithi135.stdout:0/511: creat d8/d80/fab x:0 0 0 2024-09-10T09:36:25.444 INFO:tasks.workunit.client.1.smithi135.stdout:6/552: mkdir d5/dd/d50/db3 0 2024-09-10T09:36:25.444 INFO:tasks.workunit.client.1.smithi135.stdout:6/553: stat d5/d1e/d3b/d42/d2d/d64 0 2024-09-10T09:36:25.446 INFO:tasks.workunit.client.1.smithi135.stdout:2/492: dwrite df/d1b/d23/d98/d5f/d2c/f81 [0,4194304] 0 2024-09-10T09:36:25.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/482: rename f2 to d3/dc/d7a/fa4 0 2024-09-10T09:36:25.447 INFO:tasks.workunit.client.1.smithi135.stdout:9/428: fdatasync de/df/d1d/d23/f2d 0 2024-09-10T09:36:25.447 INFO:tasks.workunit.client.1.smithi135.stdout:9/429: chown de/l72 2900 1 2024-09-10T09:36:25.447 INFO:tasks.workunit.client.1.smithi135.stdout:9/430: fdatasync de/df/d1d/d1e/d68/f6f 0 2024-09-10T09:36:25.454 INFO:tasks.workunit.client.1.smithi135.stdout:0/512: dread d8/de/d2e/f91 [0,4194304] 0 2024-09-10T09:36:25.468 INFO:tasks.workunit.client.1.smithi135.stdout:8/462: truncate d1/f3 3885964 0 2024-09-10T09:36:25.469 INFO:tasks.workunit.client.1.smithi135.stdout:8/463: readlink d1/d13/l98 0 2024-09-10T09:36:25.469 INFO:tasks.workunit.client.1.smithi135.stdout:9/431: dread de/df/d1d/f43 [0,4194304] 0 2024-09-10T09:36:25.469 INFO:tasks.workunit.client.1.smithi135.stdout:6/554: dwrite d5/d15/d27/f3f [4194304,4194304] 0 2024-09-10T09:36:25.470 INFO:tasks.workunit.client.1.smithi135.stdout:7/412: mkdir d2/d25/d5d/d83 0 2024-09-10T09:36:25.473 INFO:tasks.workunit.client.1.smithi135.stdout:4/601: creat d1/db/d9/d55/d70/d92/fb7 x:0 0 0 2024-09-10T09:36:25.474 INFO:tasks.workunit.client.1.smithi135.stdout:3/360: symlink d4/d5/d56/l6d 0 2024-09-10T09:36:25.479 INFO:tasks.workunit.client.1.smithi135.stdout:2/493: mknod df/d1b/d23/d98/d5f/d3d/d87/ca0 0 2024-09-10T09:36:25.479 INFO:tasks.workunit.client.1.smithi135.stdout:2/494: fdatasync df/d1b/f1c 0 2024-09-10T09:36:25.479 INFO:tasks.workunit.client.1.smithi135.stdout:2/495: chown df/d1b/l1e 4 1 2024-09-10T09:36:25.480 INFO:tasks.workunit.client.1.smithi135.stdout:5/483: readlink d3/dc/l3d 0 2024-09-10T09:36:25.482 INFO:tasks.workunit.client.1.smithi135.stdout:0/513: creat d8/dd/d4a/d50/fac x:0 0 0 2024-09-10T09:36:25.483 INFO:tasks.workunit.client.1.smithi135.stdout:9/432: dread de/df/d1d/d23/f2d [0,4194304] 0 2024-09-10T09:36:25.486 INFO:tasks.workunit.client.1.smithi135.stdout:1/496: dwrite d1d/d20/d3c/f5f [0,4194304] 0 2024-09-10T09:36:25.486 INFO:tasks.workunit.client.1.smithi135.stdout:1/497: stat d1d/d20/d52/f5a 0 2024-09-10T09:36:25.491 INFO:tasks.workunit.client.1.smithi135.stdout:3/361: dread d4/d5/db/f4c [0,4194304] 0 2024-09-10T09:36:25.498 INFO:tasks.workunit.client.1.smithi135.stdout:6/555: link c1 d5/d1e/d3b/d42/d2d/d55/cb4 0 2024-09-10T09:36:25.499 INFO:tasks.workunit.client.1.smithi135.stdout:7/413: mkdir d2/d15/d4a/d36/d84 0 2024-09-10T09:36:25.501 INFO:tasks.workunit.client.1.smithi135.stdout:7/414: write d2/d15/d39/f6d [239620,109201] 0 2024-09-10T09:36:25.501 INFO:tasks.workunit.client.1.smithi135.stdout:7/415: readlink d2/d15/d41/l45 0 2024-09-10T09:36:25.502 INFO:tasks.workunit.client.1.smithi135.stdout:4/602: mkdir d1/de/d16/db8 0 2024-09-10T09:36:25.502 INFO:tasks.workunit.client.1.smithi135.stdout:4/603: fdatasync d1/de/d16/d95/fad 0 2024-09-10T09:36:25.502 INFO:tasks.workunit.client.1.smithi135.stdout:4/604: fsync d1/de/f8d 0 2024-09-10T09:36:25.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/496: dwrite df/d1b/f3c [0,4194304] 0 2024-09-10T09:36:25.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/497: write df/d13/d52/f60 [2507610,49834] 0 2024-09-10T09:36:25.524 INFO:tasks.workunit.client.1.smithi135.stdout:9/433: creat de/df/d1d/d1e/d3f/f97 x:0 0 0 2024-09-10T09:36:25.524 INFO:tasks.workunit.client.1.smithi135.stdout:9/434: chown de/df/l19 10580 1 2024-09-10T09:36:25.531 INFO:tasks.workunit.client.1.smithi135.stdout:1/498: dwrite d1d/f21 [0,4194304] 0 2024-09-10T09:36:25.531 INFO:tasks.workunit.client.1.smithi135.stdout:7/416: dwrite d2/d15/d4a/f48 [4194304,4194304] 0 2024-09-10T09:36:25.532 INFO:tasks.workunit.client.1.smithi135.stdout:4/605: dwrite d1/f22 [0,4194304] 0 2024-09-10T09:36:25.532 INFO:tasks.workunit.client.1.smithi135.stdout:4/606: write d1/de/d16/f68 [1579940,45038] 0 2024-09-10T09:36:25.533 INFO:tasks.workunit.client.1.smithi135.stdout:4/607: creat d1/fb9 x:0 0 0 2024-09-10T09:36:25.535 INFO:tasks.workunit.client.1.smithi135.stdout:9/435: read de/df/d1d/f95 [3938202,112046] 0 2024-09-10T09:36:25.535 INFO:tasks.workunit.client.1.smithi135.stdout:9/436: truncate de/df/d1d/d1e/d68/f6f 434726 0 2024-09-10T09:36:25.536 INFO:tasks.workunit.client.1.smithi135.stdout:9/437: chown de/df/f3e 467 1 2024-09-10T09:36:25.538 INFO:tasks.workunit.client.1.smithi135.stdout:3/362: getdents d4/d5/db 0 2024-09-10T09:36:25.543 INFO:tasks.workunit.client.1.smithi135.stdout:6/556: rename d5/d1e/d3b/d42/d2d/d64/l93 to d5/lb5 0 2024-09-10T09:36:25.553 INFO:tasks.workunit.client.1.smithi135.stdout:2/498: mknod df/d1b/d70/ca1 0 2024-09-10T09:36:25.565 INFO:tasks.workunit.client.1.smithi135.stdout:1/499: mkdir d1d/d71/d9e 0 2024-09-10T09:36:25.565 INFO:tasks.workunit.client.1.smithi135.stdout:1/500: fdatasync d1d/d20/d6c/d86/d2b/f32 0 2024-09-10T09:36:25.565 INFO:tasks.workunit.client.1.smithi135.stdout:1/501: dread - d1d/d20/d3c/f75 zero size 2024-09-10T09:36:25.568 INFO:tasks.workunit.client.1.smithi135.stdout:7/417: dwrite d2/d15/f1c [0,4194304] 0 2024-09-10T09:36:25.568 INFO:tasks.workunit.client.1.smithi135.stdout:7/418: stat d2/d15/f2d 0 2024-09-10T09:36:25.570 INFO:tasks.workunit.client.1.smithi135.stdout:9/438: dwrite de/df/d1d/f1f [0,4194304] 0 2024-09-10T09:36:25.570 INFO:tasks.workunit.client.1.smithi135.stdout:9/439: creat de/df/d1d/d23/d25/d5c/d88/f98 x:0 0 0 2024-09-10T09:36:25.570 INFO:tasks.workunit.client.1.smithi135.stdout:9/440: write de/df/f5a [663932,37248] 0 2024-09-10T09:36:25.571 INFO:tasks.workunit.client.1.smithi135.stdout:4/608: creat d1/db/da0/fba x:0 0 0 2024-09-10T09:36:25.571 INFO:tasks.workunit.client.1.smithi135.stdout:4/609: write d1/db/d9/d55/d76/f7f [402685,31870] 0 2024-09-10T09:36:25.573 INFO:tasks.workunit.client.1.smithi135.stdout:3/363: rename d4/d5/db/d36/f54 to d4/d5/db/d36/d43/f6e 0 2024-09-10T09:36:25.573 INFO:tasks.workunit.client.1.smithi135.stdout:3/364: chown d4/d55/f60 48 1 2024-09-10T09:36:25.576 INFO:tasks.workunit.client.1.smithi135.stdout:5/484: getdents d3/d44/d22 0 2024-09-10T09:36:25.576 INFO:tasks.workunit.client.1.smithi135.stdout:5/485: stat d3/d26/f5f 0 2024-09-10T09:36:25.578 INFO:tasks.workunit.client.1.smithi135.stdout:1/502: link f11 d1d/d20/d3c/f9f 0 2024-09-10T09:36:25.578 INFO:tasks.workunit.client.1.smithi135.stdout:1/503: chown d1d/d20/d6c/f74 163361890 1 2024-09-10T09:36:25.578 INFO:tasks.workunit.client.1.smithi135.stdout:1/504: truncate d1d/d20/d52/f5a 582389 0 2024-09-10T09:36:25.579 INFO:tasks.workunit.client.1.smithi135.stdout:7/419: truncate d2/ff 419060 0 2024-09-10T09:36:25.583 INFO:tasks.workunit.client.1.smithi135.stdout:4/610: mknod d1/db/cbb 0 2024-09-10T09:36:25.586 INFO:tasks.workunit.client.1.smithi135.stdout:6/557: rename d5/d1e/f67 to d5/d15/fb6 0 2024-09-10T09:36:25.588 INFO:tasks.workunit.client.1.smithi135.stdout:2/499: symlink df/d1b/d23/d98/d5f/d2c/d7d/la2 0 2024-09-10T09:36:25.591 INFO:tasks.workunit.client.1.smithi135.stdout:5/486: mknod d3/d81/ca5 0 2024-09-10T09:36:25.593 INFO:tasks.workunit.client.1.smithi135.stdout:6/558: write d5/dd/f6e [714229,67708] 0 2024-09-10T09:36:25.593 INFO:tasks.workunit.client.1.smithi135.stdout:6/559: creat d5/d1e/d62/fb7 x:0 0 0 2024-09-10T09:36:25.595 INFO:tasks.workunit.client.1.smithi135.stdout:1/505: creat d1d/d28/d4b/fa0 x:0 0 0 2024-09-10T09:36:25.595 INFO:tasks.workunit.client.1.smithi135.stdout:1/506: write d1d/d20/d6c/d86/d2b/f44 [57478,113267] 0 2024-09-10T09:36:25.596 INFO:tasks.workunit.client.1.smithi135.stdout:7/420: mkdir d2/d15/d5c/d85 0 2024-09-10T09:36:25.596 INFO:tasks.workunit.client.1.smithi135.stdout:9/441: dwrite de/df/d1d/d23/f42 [0,4194304] 0 2024-09-10T09:36:25.597 INFO:tasks.workunit.client.1.smithi135.stdout:2/500: creat df/d1b/d23/d98/d5f/d3d/d87/fa3 x:0 0 0 2024-09-10T09:36:25.598 INFO:tasks.workunit.client.1.smithi135.stdout:2/501: chown df/d1b/d23/d98 66095932 1 2024-09-10T09:36:25.599 INFO:tasks.workunit.client.1.smithi135.stdout:5/487: rename d3/d26/d48/d57/f77 to d3/d99/fa6 0 2024-09-10T09:36:25.599 INFO:tasks.workunit.client.1.smithi135.stdout:5/488: stat d3/dc/d69 0 2024-09-10T09:36:25.603 INFO:tasks.workunit.client.1.smithi135.stdout:3/365: dwrite d4/f47 [0,4194304] 0 2024-09-10T09:36:25.603 INFO:tasks.workunit.client.1.smithi135.stdout:3/366: creat d4/d55/d5d/d5b/f6f x:0 0 0 2024-09-10T09:36:25.603 INFO:tasks.workunit.client.1.smithi135.stdout:3/367: fdatasync d4/d55/d5d/d5b/f6c 0 2024-09-10T09:36:25.603 INFO:tasks.workunit.client.1.smithi135.stdout:3/368: readlink d4/d5/db/dd/l21 0 2024-09-10T09:36:25.603 INFO:tasks.workunit.client.1.smithi135.stdout:4/611: dwrite d1/d8a/fae [0,4194304] 0 2024-09-10T09:36:25.605 INFO:tasks.workunit.client.1.smithi135.stdout:6/560: mknod d5/d1e/d35/cb8 0 2024-09-10T09:36:25.608 INFO:tasks.workunit.client.1.smithi135.stdout:1/507: truncate d1d/d20/d6c/d86/f4d 79015 0 2024-09-10T09:36:25.612 INFO:tasks.workunit.client.1.smithi135.stdout:7/421: creat d2/d15/d41/d49/d60/d30/f86 x:0 0 0 2024-09-10T09:36:25.615 INFO:tasks.workunit.client.1.smithi135.stdout:9/442: mknod de/df/d1d/d1e/d52/d86/c99 0 2024-09-10T09:36:25.615 INFO:tasks.workunit.client.1.smithi135.stdout:9/443: write de/df/f13 [1621968,94048] 0 2024-09-10T09:36:25.615 INFO:tasks.workunit.client.1.smithi135.stdout:9/444: fsync de/df/d1d/f8b 0 2024-09-10T09:36:25.615 INFO:tasks.workunit.client.1.smithi135.stdout:9/445: fsync de/df/d1d/d23/d25/d28/f39 0 2024-09-10T09:36:25.616 INFO:tasks.workunit.client.1.smithi135.stdout:7/422: dread d2/d15/d4a/f5a [0,4194304] 0 2024-09-10T09:36:25.616 INFO:tasks.workunit.client.1.smithi135.stdout:7/423: rename d2/d15 to d2/d15/d5c/d62/d87 22 2024-09-10T09:36:25.616 INFO:tasks.workunit.client.1.smithi135.stdout:2/502: mknod df/ca4 0 2024-09-10T09:36:25.625 INFO:tasks.workunit.client.1.smithi135.stdout:3/369: unlink d4/d55/l67 0 2024-09-10T09:36:25.625 INFO:tasks.workunit.client.1.smithi135.stdout:3/370: write d4/d55/f60 [4074443,1123] 0 2024-09-10T09:36:25.625 INFO:tasks.workunit.client.1.smithi135.stdout:4/612: dwrite d1/db/da0/fba [0,4194304] 0 2024-09-10T09:36:25.625 INFO:tasks.workunit.client.1.smithi135.stdout:4/613: fdatasync d1/de/d16/f21 0 2024-09-10T09:36:25.625 INFO:tasks.workunit.client.1.smithi135.stdout:4/614: write d1/de/d16/f68 [542552,76457] 0 2024-09-10T09:36:25.632 INFO:tasks.workunit.client.1.smithi135.stdout:1/508: creat d1d/d28/d4b/d53/fa1 x:0 0 0 2024-09-10T09:36:25.632 INFO:tasks.workunit.client.1.smithi135.stdout:1/509: fdatasync d1d/d20/d5d/f70 0 2024-09-10T09:36:25.633 INFO:tasks.workunit.client.1.smithi135.stdout:7/424: mkdir d2/d15/d5c/d62/d88 0 2024-09-10T09:36:25.635 INFO:tasks.workunit.client.1.smithi135.stdout:9/446: dwrite de/df/d1d/f95 [0,4194304] 0 2024-09-10T09:36:25.635 INFO:tasks.workunit.client.1.smithi135.stdout:2/503: write df/d1b/d23/d98/f3a [906649,37612] 0 2024-09-10T09:36:25.635 INFO:tasks.workunit.client.1.smithi135.stdout:9/447: write de/df/f5a [1272519,33976] 0 2024-09-10T09:36:25.636 INFO:tasks.workunit.client.1.smithi135.stdout:1/510: dread d1d/d20/d6c/d86/f7d [0,4194304] 0 2024-09-10T09:36:25.636 INFO:tasks.workunit.client.1.smithi135.stdout:1/511: stat d1d/d20/d6c/d86/d2b/f32 0 2024-09-10T09:36:25.636 INFO:tasks.workunit.client.1.smithi135.stdout:7/425: dread d2/d15/d41/d49/d60/f27 [0,4194304] 0 2024-09-10T09:36:25.636 INFO:tasks.workunit.client.1.smithi135.stdout:3/371: creat d4/d5/db/d44/d68/f70 x:0 0 0 2024-09-10T09:36:25.637 INFO:tasks.workunit.client.1.smithi135.stdout:3/372: fdatasync d4/d5/dc/f17 0 2024-09-10T09:36:25.641 INFO:tasks.workunit.client.1.smithi135.stdout:4/615: creat d1/de/d16/fbc x:0 0 0 2024-09-10T09:36:25.642 INFO:tasks.workunit.client.1.smithi135.stdout:6/561: getdents d5/d1e/d3b/d49 0 2024-09-10T09:36:25.642 INFO:tasks.workunit.client.1.smithi135.stdout:6/562: chown d5/d58/l96 237 1 2024-09-10T09:36:25.644 INFO:tasks.workunit.client.1.smithi135.stdout:2/504: creat df/d1b/d23/d98/d5f/d2c/d7d/fa5 x:0 0 0 2024-09-10T09:36:25.646 INFO:tasks.workunit.client.1.smithi135.stdout:1/512: getdents d1d/d20/d6c/d86/d2b/d4c 0 2024-09-10T09:36:25.646 INFO:tasks.workunit.client.1.smithi135.stdout:1/513: write d1d/d20/d3c/d6a/f79 [117898,3569] 0 2024-09-10T09:36:25.648 INFO:tasks.workunit.client.1.smithi135.stdout:7/426: creat d2/d25/d5d/d83/f89 x:0 0 0 2024-09-10T09:36:25.649 INFO:tasks.workunit.client.1.smithi135.stdout:3/373: unlink d4/d55/d64/f2a 0 2024-09-10T09:36:25.651 INFO:tasks.workunit.client.1.smithi135.stdout:4/616: creat d1/de/d16/d98/fbd x:0 0 0 2024-09-10T09:36:25.652 INFO:tasks.workunit.client.1.smithi135.stdout:6/563: mkdir d5/dd/d50/d54/db9 0 2024-09-10T09:36:25.653 INFO:tasks.workunit.client.1.smithi135.stdout:9/448: dwrite de/df/d1d/d23/d25/d28/f37 [0,4194304] 0 2024-09-10T09:36:25.653 INFO:tasks.workunit.client.1.smithi135.stdout:9/449: chown de/df/d1d/d23/d25/d5c/d88/f93 78720 1 2024-09-10T09:36:25.653 INFO:tasks.workunit.client.1.smithi135.stdout:9/450: creat de/df/d1d/d1e/d3f/f9a x:0 0 0 2024-09-10T09:36:25.653 INFO:tasks.workunit.client.1.smithi135.stdout:9/451: write de/df/d1d/d23/d25/d28/d4e/f8a [579191,123029] 0 2024-09-10T09:36:25.653 INFO:tasks.workunit.client.1.smithi135.stdout:2/505: chown df/d1b/d23/d98/c8b 368363 1 2024-09-10T09:36:25.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/514: symlink d1d/d28/d4b/d53/la2 0 2024-09-10T09:36:25.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/515: creat d1d/d20/d3c/d4e/fa3 x:0 0 0 2024-09-10T09:36:25.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/516: read - d1d/d20/d3c/d4e/fa3 zero size 2024-09-10T09:36:25.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/517: truncate d1d/d20/f43 4615441 0 2024-09-10T09:36:25.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/518: chown l15 4796 1 2024-09-10T09:36:25.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/519: write d1d/d20/d6c/d86/d2b/f44 [452200,30625] 0 2024-09-10T09:36:25.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/520: write d1d/d20/d6c/d86/d2b/d4c/f62 [937891,116981] 0 2024-09-10T09:36:25.658 INFO:tasks.workunit.client.1.smithi135.stdout:7/427: symlink d2/d15/d41/d49/d60/d30/l8a 0 2024-09-10T09:36:25.660 INFO:tasks.workunit.client.1.smithi135.stdout:3/374: mkdir d4/d5/dc/d71 0 2024-09-10T09:36:25.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/375: read d4/d5/db/f2f [476817,44953] 0 2024-09-10T09:36:25.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/376: fsync d4/d5/db/f3a 0 2024-09-10T09:36:25.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/377: chown d4/f25 212884847 1 2024-09-10T09:36:25.661 INFO:tasks.workunit.client.1.smithi135.stdout:4/617: mknod d1/db/da0/cbe 0 2024-09-10T09:36:25.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/564: write d5/dd/d50/d57/f6a [694048,7783] 0 2024-09-10T09:36:25.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/565: creat d5/d1e/d3b/d42/d2d/d55/d5b/fba x:0 0 0 2024-09-10T09:36:25.664 INFO:tasks.workunit.client.1.smithi135.stdout:6/566: creat d5/fbb x:0 0 0 2024-09-10T09:36:25.664 INFO:tasks.workunit.client.1.smithi135.stdout:9/452: symlink de/df/d1d/d23/d25/d28/l9b 0 2024-09-10T09:36:25.664 INFO:tasks.workunit.client.1.smithi135.stdout:9/453: write de/df/d1d/d1e/d52/f53 [963521,47125] 0 2024-09-10T09:36:25.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/506: mknod df/d1b/d23/d42/ca6 0 2024-09-10T09:36:25.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/507: truncate df/d1b/d23/f80 626221 0 2024-09-10T09:36:25.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/508: write df/d1b/d31/f8d [712308,100973] 0 2024-09-10T09:36:25.673 INFO:tasks.workunit.client.1.smithi135.stdout:7/428: rename d2/d15/d39/f5f to d2/d26/f8b 0 2024-09-10T09:36:25.684 INFO:tasks.workunit.client.1.smithi135.stdout:3/378: getdents d4 0 2024-09-10T09:36:25.692 INFO:tasks.workunit.client.1.smithi135.stdout:6/567: unlink d5/d58/fa0 0 2024-09-10T09:36:25.694 INFO:tasks.workunit.client.1.smithi135.stdout:9/454: unlink de/df/d1d/d23/l63 0 2024-09-10T09:36:25.695 INFO:tasks.workunit.client.1.smithi135.stdout:2/509: creat df/d13/d52/d8f/fa7 x:0 0 0 2024-09-10T09:36:25.698 INFO:tasks.workunit.client.1.smithi135.stdout:7/429: mkdir d2/d15/d41/d49/d60/d54/d5e/d8c 0 2024-09-10T09:36:25.698 INFO:tasks.workunit.client.1.smithi135.stdout:7/430: chown d2/d15/d41/d49/d60/f22 2 1 2024-09-10T09:36:25.698 INFO:tasks.workunit.client.1.smithi135.stdout:7/431: write d2/d15/d41/d49/d60/d30/f7a [282187,27808] 0 2024-09-10T09:36:25.699 INFO:tasks.workunit.client.1.smithi135.stdout:4/618: truncate d1/db/da0/fba 632214 0 2024-09-10T09:36:25.699 INFO:tasks.workunit.client.1.smithi135.stdout:4/619: read - d1/de/d16/f78 zero size 2024-09-10T09:36:25.700 INFO:tasks.workunit.client.1.smithi135.stdout:3/379: dwrite d4/d5/f39 [0,4194304] 0 2024-09-10T09:36:25.701 INFO:tasks.workunit.client.1.smithi135.stdout:4/620: dread d1/d33/f6e [0,4194304] 0 2024-09-10T09:36:25.701 INFO:tasks.workunit.client.1.smithi135.stdout:6/568: link d5/d1e/d3b/d42/d2d/d64/c8b d5/d1e/d62/d8a/cbc 0 2024-09-10T09:36:25.701 INFO:tasks.workunit.client.1.smithi135.stdout:6/569: creat d5/d1e/d3b/d42/d2d/d8f/fbd x:0 0 0 2024-09-10T09:36:25.703 INFO:tasks.workunit.client.1.smithi135.stdout:9/455: creat de/df/d1d/d1e/d52/d86/f9c x:0 0 0 2024-09-10T09:36:25.705 INFO:tasks.workunit.client.1.smithi135.stdout:2/510: symlink df/d13/d4f/la8 0 2024-09-10T09:36:25.705 INFO:tasks.workunit.client.1.smithi135.stdout:2/511: write df/d1b/d23/f88 [984133,72584] 0 2024-09-10T09:36:25.705 INFO:tasks.workunit.client.1.smithi135.stdout:2/512: creat df/d1b/d30/fa9 x:0 0 0 2024-09-10T09:36:25.707 INFO:tasks.workunit.client.1.smithi135.stdout:7/432: unlink d2/d25/f2a 0 2024-09-10T09:36:25.710 INFO:tasks.workunit.client.1.smithi135.stdout:4/621: getdents d1/db/d9/d55 0 2024-09-10T09:36:25.710 INFO:tasks.workunit.client.1.smithi135.stdout:4/622: creat d1/d8a/fbf x:0 0 0 2024-09-10T09:36:25.712 INFO:tasks.workunit.client.1.smithi135.stdout:3/380: dread d4/d5/db/d36/d43/f52 [0,4194304] 0 2024-09-10T09:36:25.712 INFO:tasks.workunit.client.1.smithi135.stdout:3/381: fdatasync d4/d5/db/d44/f4e 0 2024-09-10T09:36:25.712 INFO:tasks.workunit.client.1.smithi135.stdout:9/456: symlink de/df/d1d/d1e/l9d 0 2024-09-10T09:36:25.717 INFO:tasks.workunit.client.1.smithi135.stdout:2/513: symlink df/d1b/d23/d98/d5f/d2c/laa 0 2024-09-10T09:36:25.721 INFO:tasks.workunit.client.1.smithi135.stdout:7/433: dread d2/d15/d4a/f12 [0,4194304] 0 2024-09-10T09:36:25.722 INFO:tasks.workunit.client.1.smithi135.stdout:4/623: truncate d1/de/f57 3349699 0 2024-09-10T09:36:25.722 INFO:tasks.workunit.client.1.smithi135.stdout:2/514: dread df/d1b/d23/d98/f3a [0,4194304] 0 2024-09-10T09:36:25.722 INFO:tasks.workunit.client.1.smithi135.stdout:2/515: chown df/d1b/d30/l63 38 1 2024-09-10T09:36:25.723 INFO:tasks.workunit.client.1.smithi135.stdout:6/570: dwrite d5/d1e/d62/d8a/f8d [0,4194304] 0 2024-09-10T09:36:25.726 INFO:tasks.workunit.client.1.smithi135.stdout:9/457: symlink de/df/d1d/d1e/d52/d86/l9e 0 2024-09-10T09:36:25.726 INFO:tasks.workunit.client.1.smithi135.stdout:9/458: fdatasync de/f80 0 2024-09-10T09:36:25.731 INFO:tasks.workunit.client.1.smithi135.stdout:4/624: mkdir d1/de/d16/d95/dc0 0 2024-09-10T09:36:25.733 INFO:tasks.workunit.client.1.smithi135.stdout:3/382: dwrite f1 [8388608,4194304] 0 2024-09-10T09:36:25.742 INFO:tasks.workunit.client.1.smithi135.stdout:9/459: write de/df/d1d/f1f [2334871,16616] 0 2024-09-10T09:36:25.747 INFO:tasks.workunit.client.1.smithi135.stdout:6/571: mkdir d5/d1e/d3b/d42/d2d/d8f/d9c/dbe 0 2024-09-10T09:36:25.751 INFO:tasks.workunit.client.1.smithi135.stdout:9/460: dread de/df/f40 [0,4194304] 0 2024-09-10T09:36:25.751 INFO:tasks.workunit.client.1.smithi135.stdout:9/461: fdatasync de/df/d1d/d23/d25/d28/d4e/f73 0 2024-09-10T09:36:25.758 INFO:tasks.workunit.client.1.smithi135.stdout:6/572: unlink d5/d1e/d3b/d42/d2d/d55/cb4 0 2024-09-10T09:36:25.758 INFO:tasks.workunit.client.1.smithi135.stdout:6/573: creat d5/fbf x:0 0 0 2024-09-10T09:36:25.760 INFO:tasks.workunit.client.1.smithi135.stdout:7/434: dwrite d2/d25/f3f [4194304,4194304] 0 2024-09-10T09:36:25.761 INFO:tasks.workunit.client.1.smithi135.stdout:2/516: dwrite df/d1b/f5c [0,4194304] 0 2024-09-10T09:36:25.761 INFO:tasks.workunit.client.1.smithi135.stdout:2/517: stat df/d1b/d23/d98/d5f/d3d/d87/fa3 0 2024-09-10T09:36:25.761 INFO:tasks.workunit.client.1.smithi135.stdout:3/383: dwrite d4/f32 [0,4194304] 0 2024-09-10T09:36:25.763 INFO:tasks.workunit.client.1.smithi135.stdout:9/462: mkdir de/df/d1d/d1e/d68/d9f 0 2024-09-10T09:36:25.763 INFO:tasks.workunit.client.1.smithi135.stdout:9/463: truncate de/df/d1d/d23/d25/d5c/d88/f93 277744 0 2024-09-10T09:36:25.766 INFO:tasks.workunit.client.1.smithi135.stdout:4/625: getdents d1/d85/d89 0 2024-09-10T09:36:25.768 INFO:tasks.workunit.client.1.smithi135.stdout:6/574: write d5/d1e/d35/f83 [2162994,15482] 0 2024-09-10T09:36:25.773 INFO:tasks.workunit.client.1.smithi135.stdout:6/575: fsync d5/d1e/d35/f83 0 2024-09-10T09:36:25.773 INFO:tasks.workunit.client.1.smithi135.stdout:6/576: write d5/d15/d27/f3d [1717800,71831] 0 2024-09-10T09:36:25.773 INFO:tasks.workunit.client.1.smithi135.stdout:6/577: readlink d5/d15/l1a 0 2024-09-10T09:36:25.773 INFO:tasks.workunit.client.1.smithi135.stdout:7/435: write d2/f1f [335633,114542] 0 2024-09-10T09:36:25.773 INFO:tasks.workunit.client.1.smithi135.stdout:7/436: write d2/d15/f20 [268364,127693] 0 2024-09-10T09:36:25.775 INFO:tasks.workunit.client.1.smithi135.stdout:2/518: unlink cb 0 2024-09-10T09:36:25.775 INFO:tasks.workunit.client.1.smithi135.stdout:2/519: dread - df/d1b/d30/f92 zero size 2024-09-10T09:36:25.775 INFO:tasks.workunit.client.1.smithi135.stdout:2/520: fsync df/d1b/d23/d98/d5f/d2c/f6d 0 2024-09-10T09:36:25.777 INFO:tasks.workunit.client.1.smithi135.stdout:4/626: dread d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:25.779 INFO:tasks.workunit.client.1.smithi135.stdout:9/464: symlink de/df/d1d/d1e/d68/la0 0 2024-09-10T09:36:25.780 INFO:tasks.workunit.client.1.smithi135.stdout:2/521: dread df/d1b/f26 [0,4194304] 0 2024-09-10T09:36:25.789 INFO:tasks.workunit.client.1.smithi135.stdout:7/437: creat d2/d25/d5d/f8d x:0 0 0 2024-09-10T09:36:25.790 INFO:tasks.workunit.client.1.smithi135.stdout:3/384: rmdir d4/d55/d64 39 2024-09-10T09:36:25.793 INFO:tasks.workunit.client.1.smithi135.stdout:4/627: symlink d1/d8a/lc1 0 2024-09-10T09:36:25.796 INFO:tasks.workunit.client.1.smithi135.stdout:6/578: dwrite d5/d1e/d3b/d42/d2d/d55/d5b/f5e [4194304,4194304] 0 2024-09-10T09:36:25.796 INFO:tasks.workunit.client.1.smithi135.stdout:9/465: rename de/df/d1d/d23/d25/d28/f39 to de/df/d1d/d1e/d68/d9f/fa1 0 2024-09-10T09:36:25.798 INFO:tasks.workunit.client.1.smithi135.stdout:7/438: mknod d2/d15/d41/d49/d60/d30/d71/c8e 0 2024-09-10T09:36:25.800 INFO:tasks.workunit.client.1.smithi135.stdout:3/385: symlink d4/d5/dc/d71/l72 0 2024-09-10T09:36:25.802 INFO:tasks.workunit.client.1.smithi135.stdout:2/522: dwrite df/d13/d52/d8f/fa7 [0,4194304] 0 2024-09-10T09:36:25.802 INFO:tasks.workunit.client.1.smithi135.stdout:2/523: chown df/d1b/d23/f28 0 1 2024-09-10T09:36:25.803 INFO:tasks.workunit.client.1.smithi135.stdout:2/524: write df/d1b/d23/f48 [3005534,74217] 0 2024-09-10T09:36:25.805 INFO:tasks.workunit.client.1.smithi135.stdout:3/386: read d4/d5/db/d36/d43/f52 [629344,8977] 0 2024-09-10T09:36:25.805 INFO:tasks.workunit.client.1.smithi135.stdout:3/387: truncate d4/d5/dc/f69 223917 0 2024-09-10T09:36:25.805 INFO:tasks.workunit.client.1.smithi135.stdout:3/388: creat d4/d5/db/d44/d68/f73 x:0 0 0 2024-09-10T09:36:25.808 INFO:tasks.workunit.client.1.smithi135.stdout:6/579: mknod d5/d1e/d3b/d42/cc0 0 2024-09-10T09:36:25.810 INFO:tasks.workunit.client.1.smithi135.stdout:7/439: unlink d2/d15/d41/d49/d52/l74 0 2024-09-10T09:36:25.816 INFO:tasks.workunit.client.1.smithi135.stdout:2/525: symlink df/d13/d52/d8f/lab 0 2024-09-10T09:36:25.818 INFO:tasks.workunit.client.1.smithi135.stdout:3/389: rename d4/d5/db/d44/c45 to d4/d55/d64/c74 0 2024-09-10T09:36:25.820 INFO:tasks.workunit.client.1.smithi135.stdout:4/628: dwrite d1/db/d9/f38 [0,4194304] 0 2024-09-10T09:36:25.820 INFO:tasks.workunit.client.1.smithi135.stdout:4/629: dread - d1/db/d9/d55/d70/d92/fb7 zero size 2024-09-10T09:36:25.821 INFO:tasks.workunit.client.1.smithi135.stdout:6/580: mkdir d5/dd/d50/d54/dc1 0 2024-09-10T09:36:25.822 INFO:tasks.workunit.client.1.smithi135.stdout:7/440: mknod d2/d15/d81/c8f 0 2024-09-10T09:36:25.824 INFO:tasks.workunit.client.1.smithi135.stdout:9/466: dwrite de/f15 [0,4194304] 0 2024-09-10T09:36:25.824 INFO:tasks.workunit.client.1.smithi135.stdout:2/526: getdents df/d1b/d31 0 2024-09-10T09:36:25.829 INFO:tasks.workunit.client.1.smithi135.stdout:9/467: creat de/df/d1d/d1e/fa2 x:0 0 0 2024-09-10T09:36:25.830 INFO:tasks.workunit.client.1.smithi135.stdout:6/581: dread d5/d1e/d35/f83 [0,4194304] 0 2024-09-10T09:36:25.832 INFO:tasks.workunit.client.1.smithi135.stdout:2/527: rename df/d13/d96/c9d to df/d13/d52/d8f/cac 0 2024-09-10T09:36:25.836 INFO:tasks.workunit.client.1.smithi135.stdout:7/441: write d2/d25/f3f [7956252,82026] 0 2024-09-10T09:36:25.839 INFO:tasks.workunit.client.1.smithi135.stdout:6/582: creat d5/d1e/d3b/d42/d2d/fc2 x:0 0 0 2024-09-10T09:36:25.839 INFO:tasks.workunit.client.1.smithi135.stdout:2/528: truncate df/d1b/d23/d98/d5f/f89 3107 0 2024-09-10T09:36:25.842 INFO:tasks.workunit.client.1.smithi135.stdout:7/442: creat d2/d15/d5c/f90 x:0 0 0 2024-09-10T09:36:25.843 INFO:tasks.workunit.client.1.smithi135.stdout:4/630: dwrite d1/f77 [0,4194304] 0 2024-09-10T09:36:25.843 INFO:tasks.workunit.client.1.smithi135.stdout:4/631: fsync d1/de/f34 0 2024-09-10T09:36:25.843 INFO:tasks.workunit.client.1.smithi135.stdout:4/632: stat d1/de/d16/f21 0 2024-09-10T09:36:25.844 INFO:tasks.workunit.client.1.smithi135.stdout:6/583: creat d5/d1e/d62/d8a/fc3 x:0 0 0 2024-09-10T09:36:25.846 INFO:tasks.workunit.client.1.smithi135.stdout:2/529: symlink df/d1b/lad 0 2024-09-10T09:36:25.850 INFO:tasks.workunit.client.1.smithi135.stdout:9/468: dwrite de/df/d1d/f6a [0,4194304] 0 2024-09-10T09:36:25.855 INFO:tasks.workunit.client.1.smithi135.stdout:7/443: dread d2/d25/f38 [0,4194304] 0 2024-09-10T09:36:25.855 INFO:tasks.workunit.client.1.smithi135.stdout:7/444: fsync d2/d15/f21 0 2024-09-10T09:36:25.857 INFO:tasks.workunit.client.1.smithi135.stdout:9/469: unlink de/df/d1d/d23/d25/d5c/d83/l8f 0 2024-09-10T09:36:25.857 INFO:tasks.workunit.client.1.smithi135.stdout:9/470: dread - de/df/d1d/d23/f8e zero size 2024-09-10T09:36:25.861 INFO:tasks.workunit.client.1.smithi135.stdout:4/633: write d1/db/d9/f38 [2433609,71520] 0 2024-09-10T09:36:25.861 INFO:tasks.workunit.client.1.smithi135.stdout:4/634: readlink d1/d4a/d6d/l80 0 2024-09-10T09:36:25.861 INFO:tasks.workunit.client.1.smithi135.stdout:4/635: readlink d1/db/la7 0 2024-09-10T09:36:25.864 INFO:tasks.workunit.client.1.smithi135.stdout:2/530: link df/d1b/d23/d98/f73 df/d13/d52/fae 0 2024-09-10T09:36:25.865 INFO:tasks.workunit.client.1.smithi135.stdout:7/445: rename d2/f4 to d2/d15/d4a/d36/d84/f91 0 2024-09-10T09:36:25.865 INFO:tasks.workunit.client.1.smithi135.stdout:9/471: dread de/df/d1d/d6b/f7f [0,4194304] 0 2024-09-10T09:36:25.869 INFO:tasks.workunit.client.1.smithi135.stdout:7/446: dread d2/d15/d41/d49/d60/f27 [0,4194304] 0 2024-09-10T09:36:25.870 INFO:tasks.workunit.client.1.smithi135.stdout:6/584: dwrite d5/d15/d27/f71 [0,4194304] 0 2024-09-10T09:36:25.870 INFO:tasks.workunit.client.1.smithi135.stdout:6/585: read - d5/fab zero size 2024-09-10T09:36:25.871 INFO:tasks.workunit.client.1.smithi135.stdout:9/472: truncate de/f21 2073149 0 2024-09-10T09:36:25.877 INFO:tasks.workunit.client.1.smithi135.stdout:7/447: rename d2/f3a to d2/d15/d41/d49/d60/d30/d71/f92 0 2024-09-10T09:36:25.877 INFO:tasks.workunit.client.1.smithi135.stdout:7/448: write d2/f77 [305919,103162] 0 2024-09-10T09:36:25.877 INFO:tasks.workunit.client.1.smithi135.stdout:7/449: chown d2/d15/d41/d49/d52/c7d 515493 1 2024-09-10T09:36:25.878 INFO:tasks.workunit.client.1.smithi135.stdout:2/531: write df/d1b/d23/d98/d5f/d2c/f81 [469341,60446] 0 2024-09-10T09:36:25.879 INFO:tasks.workunit.client.1.smithi135.stdout:6/586: symlink d5/d1e/d3b/d42/d2d/lc4 0 2024-09-10T09:36:25.879 INFO:tasks.workunit.client.1.smithi135.stdout:6/587: write d5/d1e/d62/fb7 [746437,4371] 0 2024-09-10T09:36:25.879 INFO:tasks.workunit.client.1.smithi135.stdout:6/588: fsync d5/dd/f92 0 2024-09-10T09:36:25.881 INFO:tasks.workunit.client.1.smithi135.stdout:4/636: dwrite d1/db/d9/f32 [8388608,4194304] 0 2024-09-10T09:36:25.882 INFO:tasks.workunit.client.1.smithi135.stdout:9/473: mknod de/df/d1d/d23/d25/d5c/ca3 0 2024-09-10T09:36:25.889 INFO:tasks.workunit.client.1.smithi135.stdout:2/532: getdents df/d1b/d23/d98/d5f 0 2024-09-10T09:36:25.890 INFO:tasks.workunit.client.1.smithi135.stdout:7/450: dread d2/f2e [0,4194304] 0 2024-09-10T09:36:25.894 INFO:tasks.workunit.client.1.smithi135.stdout:6/589: rmdir d5/d1e/d3b/d42 39 2024-09-10T09:36:25.895 INFO:tasks.workunit.client.1.smithi135.stdout:4/637: creat d1/db/d9/d55/d70/fc2 x:0 0 0 2024-09-10T09:36:25.901 INFO:tasks.workunit.client.1.smithi135.stdout:2/533: unlink df/d13/f82 0 2024-09-10T09:36:25.901 INFO:tasks.workunit.client.1.smithi135.stdout:2/534: creat df/d1b/faf x:0 0 0 2024-09-10T09:36:25.905 INFO:tasks.workunit.client.1.smithi135.stdout:9/474: dwrite de/df/d1d/d1e/d68/d9f/fa1 [0,4194304] 0 2024-09-10T09:36:25.905 INFO:tasks.workunit.client.1.smithi135.stdout:9/475: stat de/df/f3d 0 2024-09-10T09:36:25.908 INFO:tasks.workunit.client.1.smithi135.stdout:6/590: write d5/f6b [46958,108295] 0 2024-09-10T09:36:25.910 INFO:tasks.workunit.client.1.smithi135.stdout:2/535: mkdir df/d1b/d23/d98/d5f/d3d/d87/db0 0 2024-09-10T09:36:25.911 INFO:tasks.workunit.client.1.smithi135.stdout:2/536: creat df/fb1 x:0 0 0 2024-09-10T09:36:25.912 INFO:tasks.workunit.client.1.smithi135.stdout:9/476: rmdir de/df 39 2024-09-10T09:36:25.917 INFO:tasks.workunit.client.1.smithi135.stdout:4/638: dwrite d1/de/d16/d98/fbd [0,4194304] 0 2024-09-10T09:36:25.945 INFO:tasks.workunit.client.1.smithi135.stdout:2/537: dwrite df/d13/d52/d8f/fa7 [0,4194304] 0 2024-09-10T09:36:25.945 INFO:tasks.workunit.client.1.smithi135.stdout:2/538: chown df/d13/d4f 10978802 1 2024-09-10T09:36:25.945 INFO:tasks.workunit.client.1.smithi135.stdout:2/539: write df/d1b/d23/d98/d5f/d3d/f5b [843395,38486] 0 2024-09-10T09:36:25.946 INFO:tasks.workunit.client.1.smithi135.stdout:2/540: chown df/d1b 88564 1 2024-09-10T09:36:25.946 INFO:tasks.workunit.client.1.smithi135.stdout:9/477: dwrite de/df/d1d/d1e/d52/f53 [0,4194304] 0 2024-09-10T09:36:25.963 INFO:tasks.workunit.client.1.smithi135.stdout:6/591: unlink d5/d1e/d3b/d42/d2d/lc4 0 2024-09-10T09:36:25.978 INFO:tasks.workunit.client.1.smithi135.stdout:2/541: rename df/d15/l22 to df/d1b/d30/lb2 0 2024-09-10T09:36:25.979 INFO:tasks.workunit.client.1.smithi135.stdout:9/478: truncate de/df/f5a 316722 0 2024-09-10T09:36:25.983 INFO:tasks.workunit.client.1.smithi135.stdout:4/639: truncate d1/db/d9/f38 992722 0 2024-09-10T09:36:25.984 INFO:tasks.workunit.client.1.smithi135.stdout:9/479: write de/df/f40 [1894977,89916] 0 2024-09-10T09:36:25.985 INFO:tasks.workunit.client.1.smithi135.stdout:6/592: rename d5/d1e/c5d to d5/d1e/d3b/d42/d2d/d8f/d9c/cc5 0 2024-09-10T09:36:25.986 INFO:tasks.workunit.client.1.smithi135.stdout:2/542: truncate df/d1b/d23/d42/f6e 282234 0 2024-09-10T09:36:25.989 INFO:tasks.workunit.client.1.smithi135.stdout:4/640: getdents d1/db/d9/d55/d70/da4 0 2024-09-10T09:36:25.992 INFO:tasks.workunit.client.1.smithi135.stdout:9/480: getdents de/df/d1d/d23/d25/d78 0 2024-09-10T09:36:25.992 INFO:tasks.workunit.client.1.smithi135.stdout:9/481: read - de/df/d1d/d23/d25/d28/d4e/f7a zero size 2024-09-10T09:36:25.992 INFO:tasks.workunit.client.1.smithi135.stdout:9/482: write de/df/d1d/d23/f67 [1307479,12348] 0 2024-09-10T09:36:25.993 INFO:tasks.workunit.client.1.smithi135.stdout:6/593: symlink d5/lc6 0 2024-09-10T09:36:25.999 INFO:tasks.workunit.client.1.smithi135.stdout:2/543: creat df/d1b/d23/d98/d5f/d3d/fb3 x:0 0 0 2024-09-10T09:36:26.003 INFO:tasks.workunit.client.1.smithi135.stdout:4/641: write d1/db/ff [4214679,76329] 0 2024-09-10T09:36:26.003 INFO:tasks.workunit.client.1.smithi135.stdout:4/642: creat d1/d8a/fc3 x:0 0 0 2024-09-10T09:36:26.003 INFO:tasks.workunit.client.1.smithi135.stdout:6/594: symlink d5/dd/d50/db3/lc7 0 2024-09-10T09:36:26.008 INFO:tasks.workunit.client.1.smithi135.stdout:2/544: creat df/d13/d4f/d95/fb4 x:0 0 0 2024-09-10T09:36:26.008 INFO:tasks.workunit.client.1.smithi135.stdout:2/545: chown df/d13 2293332 1 2024-09-10T09:36:26.013 INFO:tasks.workunit.client.1.smithi135.stdout:9/483: dwrite de/df/d1d/d23/d25/d5c/d88/f93 [0,4194304] 0 2024-09-10T09:36:26.015 INFO:tasks.workunit.client.1.smithi135.stdout:4/643: mkdir d1/d85/dc4 0 2024-09-10T09:36:26.016 INFO:tasks.workunit.client.1.smithi135.stdout:4/644: fsync d1/db/d23/fa8 0 2024-09-10T09:36:26.018 INFO:tasks.workunit.client.1.smithi135.stdout:4/645: dread d1/db/da0/fba [0,4194304] 0 2024-09-10T09:36:26.019 INFO:tasks.workunit.client.1.smithi135.stdout:6/595: creat d5/dd/fc8 x:0 0 0 2024-09-10T09:36:26.019 INFO:tasks.workunit.client.1.smithi135.stdout:2/546: write df/d1b/f3c [3432327,5076] 0 2024-09-10T09:36:26.020 INFO:tasks.workunit.client.1.smithi135.stdout:2/547: dread - df/d1b/d23/d98/d5f/d2c/d7d/fa5 zero size 2024-09-10T09:36:26.020 INFO:tasks.workunit.client.1.smithi135.stdout:2/548: stat df/c76 0 2024-09-10T09:36:26.020 INFO:tasks.workunit.client.1.smithi135.stdout:2/549: fsync df/d1b/d23/d98/d5f/d3d/d87/fa3 0 2024-09-10T09:36:26.022 INFO:tasks.workunit.client.1.smithi135.stdout:2/550: dread df/d13/f44 [0,4194304] 0 2024-09-10T09:36:26.022 INFO:tasks.workunit.client.1.smithi135.stdout:2/551: fdatasync df/f54 0 2024-09-10T09:36:26.025 INFO:tasks.workunit.client.1.smithi135.stdout:9/484: rename de/df/d1d/f6a to de/df/d1d/d1e/d68/fa4 0 2024-09-10T09:36:26.034 INFO:tasks.workunit.client.1.smithi135.stdout:9/485: rmdir de/df/d1d/d1e/d52/d86 39 2024-09-10T09:36:26.035 INFO:tasks.workunit.client.1.smithi135.stdout:6/596: write d5/d15/d27/f3f [8233429,4845] 0 2024-09-10T09:36:26.035 INFO:tasks.workunit.client.1.smithi135.stdout:6/597: write d5/f6 [4774114,88384] 0 2024-09-10T09:36:26.037 INFO:tasks.workunit.client.1.smithi135.stdout:6/598: symlink d5/d1e/d3b/d42/d2d/d64/lc9 0 2024-09-10T09:36:26.040 INFO:tasks.workunit.client.1.smithi135.stdout:9/486: getdents de/df/d1d/d23/d25/d5c/d83 0 2024-09-10T09:36:26.044 INFO:tasks.workunit.client.1.smithi135.stdout:9/487: unlink de/df/d1d/d1e/c36 0 2024-09-10T09:36:26.044 INFO:tasks.workunit.client.1.smithi135.stdout:9/488: chown de/df/d1d/d1e/l9d 158229 1 2024-09-10T09:36:26.045 INFO:tasks.workunit.client.1.smithi135.stdout:4/646: dwrite d1/de/d16/f21 [0,4194304] 0 2024-09-10T09:36:26.045 INFO:tasks.workunit.client.1.smithi135.stdout:6/599: getdents d5/d1e/d62 0 2024-09-10T09:36:26.046 INFO:tasks.workunit.client.1.smithi135.stdout:9/489: creat de/df/d1d/d6b/fa5 x:0 0 0 2024-09-10T09:36:26.047 INFO:tasks.workunit.client.1.smithi135.stdout:2/552: dwrite df/d1b/d23/d98/d5f/d3d/d87/fa3 [0,4194304] 0 2024-09-10T09:36:26.047 INFO:tasks.workunit.client.1.smithi135.stdout:4/647: truncate d1/f90 522038 0 2024-09-10T09:36:26.050 INFO:tasks.workunit.client.1.smithi135.stdout:6/600: truncate d5/d1e/d3b/d42/f38 739761 0 2024-09-10T09:36:26.054 INFO:tasks.workunit.client.1.smithi135.stdout:2/553: dread df/d1b/f1c [0,4194304] 0 2024-09-10T09:36:26.055 INFO:tasks.workunit.client.1.smithi135.stdout:6/601: mkdir d5/d1e/d3b/d42/d3c/d44/dca 0 2024-09-10T09:36:26.060 INFO:tasks.workunit.client.1.smithi135.stdout:6/602: dread d5/d15/d27/f52 [0,4194304] 0 2024-09-10T09:36:26.060 INFO:tasks.workunit.client.1.smithi135.stdout:6/603: truncate d5/d1e/d62/d8a/fc3 644274 0 2024-09-10T09:36:26.061 INFO:tasks.workunit.client.1.smithi135.stdout:9/490: write de/df/d1d/d23/d25/d28/f37 [2350561,4237] 0 2024-09-10T09:36:26.061 INFO:tasks.workunit.client.1.smithi135.stdout:9/491: fdatasync de/df/f5a 0 2024-09-10T09:36:26.061 INFO:tasks.workunit.client.1.smithi135.stdout:9/492: creat de/df/d1d/d1e/d68/fa6 x:0 0 0 2024-09-10T09:36:26.063 INFO:tasks.workunit.client.1.smithi135.stdout:4/648: write d1/d4a/f51 [3349922,4255] 0 2024-09-10T09:36:26.063 INFO:tasks.workunit.client.1.smithi135.stdout:4/649: stat d1/de/d16/d8b 0 2024-09-10T09:36:26.065 INFO:tasks.workunit.client.1.smithi135.stdout:6/604: creat d5/d15/fcb x:0 0 0 2024-09-10T09:36:26.065 INFO:tasks.workunit.client.1.smithi135.stdout:6/605: readlink d5/d58/l6f 0 2024-09-10T09:36:26.068 INFO:tasks.workunit.client.1.smithi135.stdout:4/650: rename d1/de/d16/d8b/l97 to d1/d4a/lc5 0 2024-09-10T09:36:26.068 INFO:tasks.workunit.client.1.smithi135.stdout:4/651: stat d1/d33/d40/c71 0 2024-09-10T09:36:26.071 INFO:tasks.workunit.client.1.smithi135.stdout:6/606: mkdir d5/d1e/d62/dcc 0 2024-09-10T09:36:26.071 INFO:tasks.workunit.client.1.smithi135.stdout:6/607: readlink d5/dd/l14 0 2024-09-10T09:36:26.071 INFO:tasks.workunit.client.1.smithi135.stdout:6/608: write d5/d15/d27/f52 [118779,88006] 0 2024-09-10T09:36:26.071 INFO:tasks.workunit.client.1.smithi135.stdout:6/609: write d5/dd/f6e [570120,59973] 0 2024-09-10T09:36:26.081 INFO:tasks.workunit.client.1.smithi135.stdout:4/652: mkdir d1/de/d16/d8b/dc6 0 2024-09-10T09:36:26.081 INFO:tasks.workunit.client.1.smithi135.stdout:4/653: dread - d1/d85/d89/f91 zero size 2024-09-10T09:36:26.091 INFO:tasks.workunit.client.1.smithi135.stdout:2/554: dwrite df/f17 [0,4194304] 0 2024-09-10T09:36:26.091 INFO:tasks.workunit.client.1.smithi135.stdout:2/555: readlink df/d13/d52/d8f/lab 0 2024-09-10T09:36:26.100 INFO:tasks.workunit.client.1.smithi135.stdout:6/610: dwrite d5/d1e/d3b/f77 [4194304,4194304] 0 2024-09-10T09:36:26.100 INFO:tasks.workunit.client.1.smithi135.stdout:9/493: dwrite de/df/d1d/d23/f2d [0,4194304] 0 2024-09-10T09:36:26.101 INFO:tasks.workunit.client.1.smithi135.stdout:4/654: dwrite d1/de/d16/f78 [0,4194304] 0 2024-09-10T09:36:26.106 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:25 smithi135 ceph-mon[33411]: pgmap v267: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 165 MiB/s rd, 191 MiB/s wr, 338 op/s 2024-09-10T09:36:26.106 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:25 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:26.109 INFO:tasks.workunit.client.1.smithi135.stdout:6/611: dread d5/dd/f6e [0,4194304] 0 2024-09-10T09:36:26.110 INFO:tasks.workunit.client.1.smithi135.stdout:2/556: dwrite df/f54 [4194304,4194304] 0 2024-09-10T09:36:26.112 INFO:tasks.workunit.client.1.smithi135.stdout:2/557: dread df/f12 [0,4194304] 0 2024-09-10T09:36:26.117 INFO:tasks.workunit.client.1.smithi135.stdout:6/612: write d5/d15/d27/f3d [176912,127760] 0 2024-09-10T09:36:26.117 INFO:tasks.workunit.client.1.smithi135.stdout:6/613: readlink d5/d1e/d3b/d42/d3c/l7a 0 2024-09-10T09:36:26.117 INFO:tasks.workunit.client.1.smithi135.stdout:6/614: write d5/f7 [1058370,63885] 0 2024-09-10T09:36:26.118 INFO:tasks.workunit.client.1.smithi135.stdout:9/494: mknod de/df/d1d/d23/d25/d28/ca7 0 2024-09-10T09:36:26.124 INFO:tasks.workunit.client.1.smithi135.stdout:2/558: dread df/f16 [0,4194304] 0 2024-09-10T09:36:26.124 INFO:tasks.workunit.client.1.smithi135.stdout:2/559: fdatasync df/d1b/f3c 0 2024-09-10T09:36:26.124 INFO:tasks.workunit.client.1.smithi135.stdout:4/655: symlink d1/d33/lc7 0 2024-09-10T09:36:26.125 INFO:tasks.workunit.client.1.smithi135.stdout:9/495: dread de/df/d1d/f3a [0,4194304] 0 2024-09-10T09:36:26.136 INFO:tasks.workunit.client.1.smithi135.stdout:6/615: mkdir d5/dd/d50/d86/dcd 0 2024-09-10T09:36:26.143 INFO:tasks.workunit.client.1.smithi135.stdout:9/496: mknod de/df/d1d/d23/d25/d5c/ca8 0 2024-09-10T09:36:26.150 INFO:tasks.workunit.client.1.smithi135.stdout:6/616: rename d5/lb5 to d5/d1e/d3b/d42/d2d/d8f/lce 0 2024-09-10T09:36:26.160 INFO:tasks.workunit.client.1.smithi135.stdout:2/560: dread df/d1b/d23/d98/f39 [4194304,4194304] 0 2024-09-10T09:36:26.168 INFO:tasks.workunit.client.1.smithi135.stdout:4/656: dwrite d1/de/d16/f78 [4194304,4194304] 0 2024-09-10T09:36:26.168 INFO:tasks.workunit.client.1.smithi135.stdout:4/657: write d1/db/d9/f38 [599018,100195] 0 2024-09-10T09:36:26.168 INFO:tasks.workunit.client.1.smithi135.stdout:9/497: dread de/df/d1d/d23/f27 [0,4194304] 0 2024-09-10T09:36:26.168 INFO:tasks.workunit.client.1.smithi135.stdout:9/498: chown de/df/d1d/l75 17452 1 2024-09-10T09:36:26.176 INFO:tasks.workunit.client.1.smithi135.stdout:2/561: write df/f10 [1871619,31465] 0 2024-09-10T09:36:26.176 INFO:tasks.workunit.client.1.smithi135.stdout:6/617: dwrite d5/fbb [0,4194304] 0 2024-09-10T09:36:26.181 INFO:tasks.workunit.client.1.smithi135.stdout:2/562: truncate df/d1b/d30/f4b 730343 0 2024-09-10T09:36:26.185 INFO:tasks.workunit.client.1.smithi135.stdout:6/618: rename d5/dd/d50/d57/f6a to d5/dd/d50/d54/db9/fcf 0 2024-09-10T09:36:26.186 INFO:tasks.workunit.client.1.smithi135.stdout:2/563: symlink df/d1b/d23/d98/d5f/d3d/lb5 0 2024-09-10T09:36:26.187 INFO:tasks.workunit.client.1.smithi135.stdout:6/619: mkdir d5/d1e/d3b/dd0 0 2024-09-10T09:36:26.187 INFO:tasks.workunit.client.1.smithi135.stdout:2/564: mkdir df/d1b/d23/db6 0 2024-09-10T09:36:26.189 INFO:tasks.workunit.client.1.smithi135.stdout:6/620: unlink d5/dd/da3/cac 0 2024-09-10T09:36:26.189 INFO:tasks.workunit.client.1.smithi135.stdout:6/621: fdatasync d5/fab 0 2024-09-10T09:36:26.189 INFO:tasks.workunit.client.1.smithi135.stdout:6/622: truncate d5/d1e/d3b/d42/d3c/f59 472563 0 2024-09-10T09:36:26.189 INFO:tasks.workunit.client.1.smithi135.stdout:6/623: dread - d5/fb2 zero size 2024-09-10T09:36:26.189 INFO:tasks.workunit.client.1.smithi135.stdout:6/624: fsync d5/d1e/f2f 0 2024-09-10T09:36:26.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/565: mkdir df/d1b/db7 0 2024-09-10T09:36:26.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/566: chown df/d13/d4f/c51 2461 1 2024-09-10T09:36:26.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/567: write df/d1b/d23/d98/d5f/d2c/f81 [2293660,30609] 0 2024-09-10T09:36:26.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/568: truncate df/d1b/f9c 871190 0 2024-09-10T09:36:26.191 INFO:tasks.workunit.client.1.smithi135.stdout:2/569: unlink df/d1b/d23/d98/f39 0 2024-09-10T09:36:26.197 INFO:tasks.workunit.client.1.smithi135.stdout:9/499: dwrite de/f18 [0,4194304] 0 2024-09-10T09:36:26.200 INFO:tasks.workunit.client.1.smithi135.stdout:9/500: dread de/df/d1d/d23/d25/f48 [0,4194304] 0 2024-09-10T09:36:26.201 INFO:tasks.workunit.client.1.smithi135.stdout:6/625: read d5/d1e/f2f [1917050,96034] 0 2024-09-10T09:36:26.201 INFO:tasks.workunit.client.1.smithi135.stdout:4/658: dwrite d1/db/da0/fba [0,4194304] 0 2024-09-10T09:36:26.202 INFO:tasks.workunit.client.1.smithi135.stdout:9/501: link de/df/c2e de/df/d1d/d1e/d52/ca9 0 2024-09-10T09:36:26.203 INFO:tasks.workunit.client.1.smithi135.stdout:6/626: creat d5/dd/d50/d54/db9/fd1 x:0 0 0 2024-09-10T09:36:26.206 INFO:tasks.workunit.client.1.smithi135.stdout:4/659: mknod d1/de/d16/d95/cc8 0 2024-09-10T09:36:26.206 INFO:tasks.workunit.client.1.smithi135.stdout:4/660: stat d1/l6c 0 2024-09-10T09:36:26.206 INFO:tasks.workunit.client.1.smithi135.stdout:4/661: truncate d1/d8a/fbf 350520 0 2024-09-10T09:36:26.206 INFO:tasks.workunit.client.1.smithi135.stdout:4/662: chown d1/l1f 212656 1 2024-09-10T09:36:26.206 INFO:tasks.workunit.client.1.smithi135.stdout:9/502: symlink de/df/d1d/d1e/laa 0 2024-09-10T09:36:26.208 INFO:tasks.workunit.client.1.smithi135.stdout:6/627: mknod d5/dd/d50/d54/da9/cd2 0 2024-09-10T09:36:26.209 INFO:tasks.workunit.client.1.smithi135.stdout:6/628: stat d5/d1e/d3b/d42/d2d/l33 0 2024-09-10T09:36:26.210 INFO:tasks.workunit.client.1.smithi135.stdout:4/663: mknod d1/de/d16/d8b/cc9 0 2024-09-10T09:36:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:25 smithi079 ceph-mon[27592]: pgmap v267: 65 pgs: 65 active+clean; 2.3 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 165 MiB/s rd, 191 MiB/s wr, 338 op/s 2024-09-10T09:36:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:25 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:26.212 INFO:tasks.workunit.client.1.smithi135.stdout:9/503: creat de/df/d1d/d1e/d68/d9f/fab x:0 0 0 2024-09-10T09:36:26.213 INFO:tasks.workunit.client.1.smithi135.stdout:4/664: rename d1/db/d9/l24 to d1/db/d9/d55/d70/lca 0 2024-09-10T09:36:26.213 INFO:tasks.workunit.client.1.smithi135.stdout:2/570: dwrite df/d1b/d23/f48 [0,4194304] 0 2024-09-10T09:36:26.213 INFO:tasks.workunit.client.1.smithi135.stdout:2/571: dread - df/fb1 zero size 2024-09-10T09:36:26.213 INFO:tasks.workunit.client.1.smithi135.stdout:2/572: creat df/d1b/fb8 x:0 0 0 2024-09-10T09:36:26.214 INFO:tasks.workunit.client.1.smithi135.stdout:9/504: mkdir de/df/dac 0 2024-09-10T09:36:26.218 INFO:tasks.workunit.client.1.smithi135.stdout:2/573: unlink df/d1b/d70/f90 0 2024-09-10T09:36:26.218 INFO:tasks.workunit.client.1.smithi135.stdout:2/574: chown df/d1b/d23/d98/d5f/d2c/f83 900779 1 2024-09-10T09:36:26.220 INFO:tasks.workunit.client.1.smithi135.stdout:2/575: dread df/d1b/d30/f37 [0,4194304] 0 2024-09-10T09:36:26.220 INFO:tasks.workunit.client.1.smithi135.stdout:9/505: truncate de/df/f1b 733076 0 2024-09-10T09:36:26.223 INFO:tasks.workunit.client.1.smithi135.stdout:2/576: symlink df/d13/d4f/lb9 0 2024-09-10T09:36:26.223 INFO:tasks.workunit.client.1.smithi135.stdout:6/629: dread d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:26.223 INFO:tasks.workunit.client.1.smithi135.stdout:6/630: chown d5/d1e/d3b/d42/d2d/d8f/fbd 113943753 1 2024-09-10T09:36:26.225 INFO:tasks.workunit.client.1.smithi135.stdout:6/631: rmdir d5/d1e/d3b/d49 39 2024-09-10T09:36:26.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/632: symlink d5/dd/ld3 0 2024-09-10T09:36:26.226 INFO:tasks.workunit.client.1.smithi135.stdout:6/633: dread - d5/d15/d56/f95 zero size 2024-09-10T09:36:26.243 INFO:tasks.workunit.client.1.smithi135.stdout:6/634: dwrite d5/d1e/d3b/d42/d2d/d55/fb0 [0,4194304] 0 2024-09-10T09:36:26.280 INFO:tasks.workunit.client.1.smithi135.stdout:6/635: mknod d5/dd/d50/d57/d81/cd4 0 2024-09-10T09:36:26.281 INFO:tasks.workunit.client.1.smithi135.stdout:4/665: dwrite d1/db/da0/fba [0,4194304] 0 2024-09-10T09:36:26.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/636: link d5/d15/c16 d5/dd/da3/cd5 0 2024-09-10T09:36:26.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/637: write d5/d1e/d3b/d42/d2d/d55/d5b/f91 [401697,56721] 0 2024-09-10T09:36:26.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/638: write d5/d1e/d3b/d49/f94 [1033433,69592] 0 2024-09-10T09:36:26.282 INFO:tasks.workunit.client.1.smithi135.stdout:8/464: sync 2024-09-10T09:36:26.282 INFO:tasks.workunit.client.1.smithi135.stdout:6/639: readlink d5/d1e/d62/d8a/la1 0 2024-09-10T09:36:26.285 INFO:tasks.workunit.client.1.smithi135.stdout:4/666: symlink d1/d85/db3/lcb 0 2024-09-10T09:36:26.285 INFO:tasks.workunit.client.1.smithi135.stdout:4/667: fsync d1/db/d9/d55/f94 0 2024-09-10T09:36:26.287 INFO:tasks.workunit.client.1.smithi135.stdout:6/640: link d5/f60 d5/dd/d50/fd6 0 2024-09-10T09:36:26.289 INFO:tasks.workunit.client.1.smithi135.stdout:4/668: creat d1/de/d16/d8b/fcc x:0 0 0 2024-09-10T09:36:26.292 INFO:tasks.workunit.client.1.smithi135.stdout:6/641: unlink d5/d1e/f2f 0 2024-09-10T09:36:26.295 INFO:tasks.workunit.client.1.smithi135.stdout:4/669: creat d1/de/d16/d8b/dc6/fcd x:0 0 0 2024-09-10T09:36:26.296 INFO:tasks.workunit.client.1.smithi135.stdout:6/642: mkdir d5/d1e/d62/dcc/dd7 0 2024-09-10T09:36:26.296 INFO:tasks.workunit.client.1.smithi135.stdout:6/643: write f4 [1558488,87911] 0 2024-09-10T09:36:26.298 INFO:tasks.workunit.client.1.smithi135.stdout:6/644: mknod d5/d1e/d3b/d42/d2d/d55/d5b/cd8 0 2024-09-10T09:36:26.298 INFO:tasks.workunit.client.1.smithi135.stdout:6/645: fdatasync d5/dd/fa7 0 2024-09-10T09:36:26.303 INFO:tasks.workunit.client.1.smithi135.stdout:6/646: write d5/d15/f25 [4176465,22229] 0 2024-09-10T09:36:26.349 INFO:tasks.workunit.client.1.smithi135.stdout:0/514: sync 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:7/451: sync 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:5/489: sync 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:7/452: fsync d2/d15/d41/d49/d60/f43 0 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:1/521: sync 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:1/522: fsync d1d/d20/d6c/f87 0 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:1/523: readlink d1d/d28/d4b/l99 0 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:1/524: stat l19 0 2024-09-10T09:36:26.350 INFO:tasks.workunit.client.1.smithi135.stdout:5/490: creat d3/d81/fa7 x:0 0 0 2024-09-10T09:36:26.351 INFO:tasks.workunit.client.1.smithi135.stdout:7/453: mknod d2/d15/d39/d6f/c93 0 2024-09-10T09:36:26.351 INFO:tasks.workunit.client.1.smithi135.stdout:7/454: chown d2/d15/d41/d49/d60/d54/d5e/c73 4354372 1 2024-09-10T09:36:26.352 INFO:tasks.workunit.client.1.smithi135.stdout:1/525: link d1d/f1e d1d/d20/d3c/d6a/fa4 0 2024-09-10T09:36:26.352 INFO:tasks.workunit.client.1.smithi135.stdout:1/526: creat d1d/d20/d3c/d4e/fa5 x:0 0 0 2024-09-10T09:36:26.353 INFO:tasks.workunit.client.1.smithi135.stdout:1/527: creat d1d/d20/fa6 x:0 0 0 2024-09-10T09:36:26.353 INFO:tasks.workunit.client.1.smithi135.stdout:1/528: chown d1d/d20/c49 30 1 2024-09-10T09:36:26.355 INFO:tasks.workunit.client.1.smithi135.stdout:7/455: link d2/d25/d5d/f4f d2/d26/f94 0 2024-09-10T09:36:26.355 INFO:tasks.workunit.client.1.smithi135.stdout:7/456: truncate d2/d15/d41/d49/d60/d54/d5e/f64 4629742 0 2024-09-10T09:36:26.357 INFO:tasks.workunit.client.1.smithi135.stdout:3/390: sync 2024-09-10T09:36:26.361 INFO:tasks.workunit.client.1.smithi135.stdout:3/391: dread d4/d5/db/dd/f5f [0,4194304] 0 2024-09-10T09:36:26.361 INFO:tasks.workunit.client.1.smithi135.stdout:3/392: chown d4/f4d 465 1 2024-09-10T09:36:26.361 INFO:tasks.workunit.client.1.smithi135.stdout:6/647: rename d5/d1e/d62/dcc to d5/dd/d50/d54/db9/dd9 0 2024-09-10T09:36:26.363 INFO:tasks.workunit.client.1.smithi135.stdout:0/515: write d8/fc [11642982,73719] 0 2024-09-10T09:36:26.366 INFO:tasks.workunit.client.1.smithi135.stdout:0/516: symlink d8/dd/d33/lad 0 2024-09-10T09:36:26.368 INFO:tasks.workunit.client.1.smithi135.stdout:0/517: rename d8/d1c/d37/l6a to d8/dd/lae 0 2024-09-10T09:36:26.374 INFO:tasks.workunit.client.1.smithi135.stdout:8/465: dwrite d1/d15/d16/d33/d45/d70/f93 [0,4194304] 0 2024-09-10T09:36:26.374 INFO:tasks.workunit.client.1.smithi135.stdout:8/466: write d1/d15/d49/f85 [1038136,83833] 0 2024-09-10T09:36:26.376 INFO:tasks.workunit.client.1.smithi135.stdout:3/393: write d4/d5/db/f4c [83112,89] 0 2024-09-10T09:36:26.376 INFO:tasks.workunit.client.1.smithi135.stdout:3/394: chown d4/d5/db/d36 35 1 2024-09-10T09:36:26.380 INFO:tasks.workunit.client.1.smithi135.stdout:0/518: dread d8/dd/f13 [0,4194304] 0 2024-09-10T09:36:26.381 INFO:tasks.workunit.client.1.smithi135.stdout:0/519: mknod d8/dd/d33/d97/caf 0 2024-09-10T09:36:26.394 INFO:tasks.workunit.client.1.smithi135.stdout:0/520: dread d8/dd/d18/f43 [0,4194304] 0 2024-09-10T09:36:26.394 INFO:tasks.workunit.client.1.smithi135.stdout:1/529: dwrite d1d/d20/f30 [0,4194304] 0 2024-09-10T09:36:26.394 INFO:tasks.workunit.client.1.smithi135.stdout:5/491: dwrite d3/dc/f10 [0,4194304] 0 2024-09-10T09:36:26.395 INFO:tasks.workunit.client.1.smithi135.stdout:1/530: readlink d1d/l61 0 2024-09-10T09:36:26.395 INFO:tasks.workunit.client.1.smithi135.stdout:0/521: chown d8/dd/d1e/c3a 1 1 2024-09-10T09:36:26.395 INFO:tasks.workunit.client.1.smithi135.stdout:5/492: write d3/d26/f3c [20147,100072] 0 2024-09-10T09:36:26.395 INFO:tasks.workunit.client.1.smithi135.stdout:6/648: dwrite d5/d1e/d3b/d42/d3c/f59 [0,4194304] 0 2024-09-10T09:36:26.396 INFO:tasks.workunit.client.1.smithi135.stdout:6/649: chown d5/d1e/d35/f21 2128082 1 2024-09-10T09:36:26.396 INFO:tasks.workunit.client.1.smithi135.stdout:6/650: write d5/d1e/d3b/d42/d2d/d55/fb0 [4292100,109434] 0 2024-09-10T09:36:26.396 INFO:tasks.workunit.client.1.smithi135.stdout:6/651: stat d5/d58 0 2024-09-10T09:36:26.396 INFO:tasks.workunit.client.1.smithi135.stdout:6/652: fsync d5/d15/f22 0 2024-09-10T09:36:26.396 INFO:tasks.workunit.client.1.smithi135.stdout:5/493: write d3/dc/f9b [623650,73669] 0 2024-09-10T09:36:26.402 INFO:tasks.workunit.client.1.smithi135.stdout:1/531: unlink d1d/d20/d5d/f70 0 2024-09-10T09:36:26.412 INFO:tasks.workunit.client.1.smithi135.stdout:5/494: creat d3/d81/d8d/fa8 x:0 0 0 2024-09-10T09:36:26.414 INFO:tasks.workunit.client.1.smithi135.stdout:1/532: link d1d/d20/d6c/d86/d2b/l96 d1d/d28/d4b/la7 0 2024-09-10T09:36:26.414 INFO:tasks.workunit.client.1.smithi135.stdout:1/533: dread - d1d/d20/d3c/d4e/fa3 zero size 2024-09-10T09:36:26.414 INFO:tasks.workunit.client.1.smithi135.stdout:1/534: fdatasync d1d/d20/d6c/f74 0 2024-09-10T09:36:26.414 INFO:tasks.workunit.client.1.smithi135.stdout:6/653: dwrite d5/dd/d50/d54/db9/fd1 [0,4194304] 0 2024-09-10T09:36:26.414 INFO:tasks.workunit.client.1.smithi135.stdout:6/654: readlink d5/d58/l6f 0 2024-09-10T09:36:26.418 INFO:tasks.workunit.client.1.smithi135.stdout:1/535: rename d1d/d20/d6c/d86/d37/d6d/d76 to d1d/d20/d6c/d86/d2b/da8 0 2024-09-10T09:36:26.419 INFO:tasks.workunit.client.1.smithi135.stdout:5/495: getdents d3/d81 0 2024-09-10T09:36:26.421 INFO:tasks.workunit.client.1.smithi135.stdout:1/536: creat d1d/d71/d9e/fa9 x:0 0 0 2024-09-10T09:36:26.421 INFO:tasks.workunit.client.1.smithi135.stdout:1/537: truncate d1d/d20/f94 473949 0 2024-09-10T09:36:26.422 INFO:tasks.workunit.client.1.smithi135.stdout:0/522: dwrite d8/dd/d4a/f84 [0,4194304] 0 2024-09-10T09:36:26.423 INFO:tasks.workunit.client.1.smithi135.stdout:5/496: unlink d3/dc/d16/f43 0 2024-09-10T09:36:26.424 INFO:tasks.workunit.client.1.smithi135.stdout:5/497: readlink d3/d26/d48/l60 0 2024-09-10T09:36:26.425 INFO:tasks.workunit.client.1.smithi135.stdout:6/655: dread d5/d1e/d3b/d42/f7d [0,4194304] 0 2024-09-10T09:36:26.425 INFO:tasks.workunit.client.1.smithi135.stdout:6/656: chown d5/d58/c98 1039923 1 2024-09-10T09:36:26.425 INFO:tasks.workunit.client.1.smithi135.stdout:6/657: truncate d5/d1e/d3b/d42/d3c/d44/f76 1026751 0 2024-09-10T09:36:26.426 INFO:tasks.workunit.client.1.smithi135.stdout:1/538: creat d1d/d20/d6c/d86/d2b/d4c/faa x:0 0 0 2024-09-10T09:36:26.429 INFO:tasks.workunit.client.1.smithi135.stdout:0/523: truncate d8/d1c/d37/d7a/f7b 1791042 0 2024-09-10T09:36:26.432 INFO:tasks.workunit.client.1.smithi135.stdout:6/658: creat d5/d1e/d3b/d42/fda x:0 0 0 2024-09-10T09:36:26.436 INFO:tasks.workunit.client.1.smithi135.stdout:5/498: unlink d3/dc/f52 0 2024-09-10T09:36:26.436 INFO:tasks.workunit.client.1.smithi135.stdout:5/499: chown d3/dc/f10 497659440 1 2024-09-10T09:36:26.436 INFO:tasks.workunit.client.1.smithi135.stdout:0/524: dread d8/dd/d11/f1f [0,4194304] 0 2024-09-10T09:36:26.437 INFO:tasks.workunit.client.1.smithi135.stdout:6/659: unlink d5/d1e/d35/f30 0 2024-09-10T09:36:26.440 INFO:tasks.workunit.client.1.smithi135.stdout:1/539: getdents d1d/d20/d3c/d4e 0 2024-09-10T09:36:26.440 INFO:tasks.workunit.client.1.smithi135.stdout:0/525: dread d8/dd/d18/f1a [0,4194304] 0 2024-09-10T09:36:26.440 INFO:tasks.workunit.client.1.smithi135.stdout:0/526: readlink d8/dd/d18/d3d/l96 0 2024-09-10T09:36:26.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/500: mkdir d3/d26/d48/d57/da9 0 2024-09-10T09:36:26.443 INFO:tasks.workunit.client.1.smithi135.stdout:6/660: write d5/d1e/d3b/d42/f7d [6796846,43117] 0 2024-09-10T09:36:26.444 INFO:tasks.workunit.client.1.smithi135.stdout:1/540: symlink d1d/d71/lab 0 2024-09-10T09:36:26.447 INFO:tasks.workunit.client.1.smithi135.stdout:5/501: creat d3/d44/d8a/faa x:0 0 0 2024-09-10T09:36:26.448 INFO:tasks.workunit.client.1.smithi135.stdout:5/502: chown d3/d44/c5c 11091530 1 2024-09-10T09:36:26.455 INFO:tasks.workunit.client.1.smithi135.stdout:6/661: symlink d5/dd/d50/d86/dcd/ldb 0 2024-09-10T09:36:26.460 INFO:tasks.workunit.client.1.smithi135.stdout:6/662: getdents d5/dd/d50/d86 0 2024-09-10T09:36:26.464 INFO:tasks.workunit.client.1.smithi135.stdout:6/663: creat d5/dd/d50/db3/fdc x:0 0 0 2024-09-10T09:36:26.473 INFO:tasks.workunit.client.1.smithi135.stdout:1/541: dwrite d1d/d20/d3c/d4e/fa3 [0,4194304] 0 2024-09-10T09:36:26.473 INFO:tasks.workunit.client.1.smithi135.stdout:0/527: dwrite d8/dd/d4a/d50/f9e [0,4194304] 0 2024-09-10T09:36:26.474 INFO:tasks.workunit.client.1.smithi135.stdout:0/528: write d8/de/d2e/f8d [301964,116080] 0 2024-09-10T09:36:26.474 INFO:tasks.workunit.client.1.smithi135.stdout:0/529: write d8/dd/f10 [5023314,124939] 0 2024-09-10T09:36:26.478 INFO:tasks.workunit.client.1.smithi135.stdout:1/542: link d1d/d20/f31 d1d/d20/d6c/d86/d2b/d4c/d63/fac 0 2024-09-10T09:36:26.485 INFO:tasks.workunit.client.1.smithi135.stdout:6/664: dread d5/d1e/d3b/d42/d3c/fa2 [0,4194304] 0 2024-09-10T09:36:26.490 INFO:tasks.workunit.client.1.smithi135.stdout:1/543: rename d1d/d20/d3c/f84 to d1d/fad 0 2024-09-10T09:36:26.490 INFO:tasks.workunit.client.1.smithi135.stdout:1/544: write d1d/d20/d6c/d86/d2b/d4c/d63/f66 [1046712,100268] 0 2024-09-10T09:36:26.490 INFO:tasks.workunit.client.1.smithi135.stdout:1/545: chown d1d/d20/d6c/d86/f7d 4062802 1 2024-09-10T09:36:26.490 INFO:tasks.workunit.client.1.smithi135.stdout:1/546: fdatasync f1b 0 2024-09-10T09:36:26.493 INFO:tasks.workunit.client.1.smithi135.stdout:1/547: symlink d1d/d28/lae 0 2024-09-10T09:36:26.493 INFO:tasks.workunit.client.1.smithi135.stdout:1/548: chown d1d/d20/d6c/d86/f4d 7962200 1 2024-09-10T09:36:26.493 INFO:tasks.workunit.client.1.smithi135.stdout:1/549: write d1d/d20/d3c/d6a/f93 [545249,130625] 0 2024-09-10T09:36:26.499 INFO:tasks.workunit.client.1.smithi135.stdout:6/665: rmdir d5/dd/d50/d54 39 2024-09-10T09:36:26.499 INFO:tasks.workunit.client.1.smithi135.stdout:6/666: getdents d5/d1e/d3b/dd0 0 2024-09-10T09:36:26.500 INFO:tasks.workunit.client.1.smithi135.stdout:6/667: dread d5/d1e/d62/d8a/fc3 [0,4194304] 0 2024-09-10T09:36:26.500 INFO:tasks.workunit.client.1.smithi135.stdout:1/550: truncate d1d/d20/d6c/d86/d2b/f44 208915 0 2024-09-10T09:36:26.504 INFO:tasks.workunit.client.1.smithi135.stdout:6/668: link d5/d1e/d62/d8a/f8d d5/dd/fdd 0 2024-09-10T09:36:26.506 INFO:tasks.workunit.client.1.smithi135.stdout:5/503: dwrite d3/d26/f3c [0,4194304] 0 2024-09-10T09:36:26.506 INFO:tasks.workunit.client.1.smithi135.stdout:0/530: dwrite d8/dd/d4a/d50/d67/f71 [0,4194304] 0 2024-09-10T09:36:26.510 INFO:tasks.workunit.client.1.smithi135.stdout:5/504: creat d3/dc/d16/fab x:0 0 0 2024-09-10T09:36:26.521 INFO:tasks.workunit.client.1.smithi135.stdout:6/669: dwrite d5/d1e/d3b/d42/d2d/fc2 [0,4194304] 0 2024-09-10T09:36:26.524 INFO:tasks.workunit.client.1.smithi135.stdout:6/670: creat d5/d1e/d3b/d42/d3c/d44/dca/fde x:0 0 0 2024-09-10T09:36:26.524 INFO:tasks.workunit.client.1.smithi135.stdout:6/671: readlink d5/d15/l1a 0 2024-09-10T09:36:26.526 INFO:tasks.workunit.client.1.smithi135.stdout:5/505: mknod d3/d44/d22/cac 0 2024-09-10T09:36:26.526 INFO:tasks.workunit.client.1.smithi135.stdout:5/506: dread - d3/dc/d69/d65/f9e zero size 2024-09-10T09:36:26.527 INFO:tasks.workunit.client.1.smithi135.stdout:5/507: write d3/d26/d48/d57/da3/f7e [1671452,100944] 0 2024-09-10T09:36:26.527 INFO:tasks.workunit.client.1.smithi135.stdout:5/508: write d3/dc/d69/d65/f85 [5036500,11380] 0 2024-09-10T09:36:26.527 INFO:tasks.workunit.client.1.smithi135.stdout:5/509: dread - d3/dc/f8c zero size 2024-09-10T09:36:26.527 INFO:tasks.workunit.client.1.smithi135.stdout:5/510: write d3/f31 [1005724,34576] 0 2024-09-10T09:36:26.527 INFO:tasks.workunit.client.1.smithi135.stdout:6/672: mkdir d5/d15/ddf 0 2024-09-10T09:36:26.529 INFO:tasks.workunit.client.1.smithi135.stdout:5/511: mkdir d3/d26/d93/dad 0 2024-09-10T09:36:26.531 INFO:tasks.workunit.client.1.smithi135.stdout:6/673: getdents d5/dd/d50/d57/d81 0 2024-09-10T09:36:26.533 INFO:tasks.workunit.client.1.smithi135.stdout:6/674: mknod d5/d1e/d3b/d42/d2d/d8f/d9c/dbe/ce0 0 2024-09-10T09:36:26.535 INFO:tasks.workunit.client.1.smithi135.stdout:6/675: mknod d5/d1e/d3b/dd0/ce1 0 2024-09-10T09:36:26.535 INFO:tasks.workunit.client.1.smithi135.stdout:6/676: read - d5/d1e/d3b/d42/d2d/d8f/f97 zero size 2024-09-10T09:36:26.535 INFO:tasks.workunit.client.1.smithi135.stdout:6/677: chown d5/fbf 913673 1 2024-09-10T09:36:26.537 INFO:tasks.workunit.client.1.smithi135.stdout:6/678: unlink d5/d1e/d3b/d42/d3c/fa2 0 2024-09-10T09:36:26.537 INFO:tasks.workunit.client.1.smithi135.stdout:6/679: dread - d5/dd/fc8 zero size 2024-09-10T09:36:26.538 INFO:tasks.workunit.client.1.smithi135.stdout:6/680: mkdir d5/d1e/d3b/d42/d3c/de2 0 2024-09-10T09:36:26.539 INFO:tasks.workunit.client.1.smithi135.stdout:6/681: symlink d5/dd/d50/d54/db9/dd9/dd7/le3 0 2024-09-10T09:36:26.539 INFO:tasks.workunit.client.1.smithi135.stdout:6/682: chown d5/d1e/d3b/d42/d2d/d8f/d9c/cc5 209054771 1 2024-09-10T09:36:26.540 INFO:tasks.workunit.client.1.smithi135.stdout:6/683: getdents d5/d1e/d3b/d42/d3c/d44 0 2024-09-10T09:36:26.542 INFO:tasks.workunit.client.1.smithi135.stdout:6/684: mkdir d5/dd/d50/d54/da9/de4 0 2024-09-10T09:36:26.543 INFO:tasks.workunit.client.1.smithi135.stdout:6/685: mkdir d5/d58/de5 0 2024-09-10T09:36:26.544 INFO:tasks.workunit.client.1.smithi135.stdout:6/686: fsync d5/d1e/d3b/d42/d2d/fc2 0 2024-09-10T09:36:26.545 INFO:tasks.workunit.client.1.smithi135.stdout:6/687: unlink d5/fb2 0 2024-09-10T09:36:26.547 INFO:tasks.workunit.client.1.smithi135.stdout:5/512: dwrite d3/d71/f5a [0,4194304] 0 2024-09-10T09:36:26.549 INFO:tasks.workunit.client.1.smithi135.stdout:5/513: mkdir d3/d26/dae 0 2024-09-10T09:36:26.556 INFO:tasks.workunit.client.1.smithi135.stdout:6/688: read d5/dd/d50/f7b [2872744,109965] 0 2024-09-10T09:36:26.557 INFO:tasks.workunit.client.1.smithi135.stdout:6/689: symlink d5/d1e/d35/d65/le6 0 2024-09-10T09:36:26.558 INFO:tasks.workunit.client.1.smithi135.stdout:5/514: write d3/d44/f4c [3424597,115789] 0 2024-09-10T09:36:26.561 INFO:tasks.workunit.client.1.smithi135.stdout:5/515: rmdir d3/d26/d93/dad 0 2024-09-10T09:36:26.562 INFO:tasks.workunit.client.1.smithi135.stdout:5/516: readlink d3/d44/l28 0 2024-09-10T09:36:26.562 INFO:tasks.workunit.client.1.smithi135.stdout:5/517: fdatasync d3/d71/f5a 0 2024-09-10T09:36:26.575 INFO:tasks.workunit.client.1.smithi135.stdout:6/690: dwrite d5/d1e/d35/f9f [0,4194304] 0 2024-09-10T09:36:26.575 INFO:tasks.workunit.client.1.smithi135.stdout:6/691: fdatasync d5/dd/fa7 0 2024-09-10T09:36:26.576 INFO:tasks.workunit.client.1.smithi135.stdout:6/692: rename d5/dd/d50/d54/db9/fcf to d5/d1e/fe7 0 2024-09-10T09:36:26.576 INFO:tasks.workunit.client.1.smithi135.stdout:6/693: write d5/d1e/d3b/d42/d3c/f47 [2879773,125238] 0 2024-09-10T09:36:26.577 INFO:tasks.workunit.client.1.smithi135.stdout:6/694: fdatasync d5/d15/d27/f3d 0 2024-09-10T09:36:26.577 INFO:tasks.workunit.client.1.smithi135.stdout:6/695: stat d5/d1e/d3b 0 2024-09-10T09:36:26.578 INFO:tasks.workunit.client.1.smithi135.stdout:6/696: mkdir d5/de8 0 2024-09-10T09:36:26.579 INFO:tasks.workunit.client.1.smithi135.stdout:6/697: dread d5/f6 [4194304,4194304] 0 2024-09-10T09:36:26.581 INFO:tasks.workunit.client.1.smithi135.stdout:6/698: creat d5/d1e/d3b/fe9 x:0 0 0 2024-09-10T09:36:26.582 INFO:tasks.workunit.client.1.smithi135.stdout:6/699: fdatasync d5/d1e/d35/f9f 0 2024-09-10T09:36:26.582 INFO:tasks.workunit.client.1.smithi135.stdout:6/700: write d5/f17 [3484246,118162] 0 2024-09-10T09:36:26.582 INFO:tasks.workunit.client.1.smithi135.stdout:6/701: dread d5/d1e/d62/d8a/fc3 [0,4194304] 0 2024-09-10T09:36:26.583 INFO:tasks.workunit.client.1.smithi135.stdout:6/702: mknod d5/d1e/d3b/d42/d3c/d44/cea 0 2024-09-10T09:36:26.850 INFO:tasks.workunit.client.1.smithi135.stdout:9/506: sync 2024-09-10T09:36:26.850 INFO:tasks.workunit.client.1.smithi135.stdout:9/507: chown de/df/d1d/d1e/d68/fa6 76245810 1 2024-09-10T09:36:26.851 INFO:tasks.workunit.client.1.smithi135.stdout:9/508: mkdir de/dad 0 2024-09-10T09:36:26.853 INFO:tasks.workunit.client.1.smithi135.stdout:9/509: write de/df/d1d/d23/f57 [926580,50027] 0 2024-09-10T09:36:26.853 INFO:tasks.workunit.client.1.smithi135.stdout:9/510: chown de/df/d1d/d23/d25/d5c/d88/f89 12988558 1 2024-09-10T09:36:26.856 INFO:tasks.workunit.client.1.smithi135.stdout:9/511: rename de/df/d1d/f95 to de/df/d1d/d23/d25/d28/fae 0 2024-09-10T09:36:26.858 INFO:tasks.workunit.client.1.smithi135.stdout:9/512: creat de/df/faf x:0 0 0 2024-09-10T09:36:26.862 INFO:tasks.workunit.client.1.smithi135.stdout:9/513: truncate de/df/d1d/f3a 1822659 0 2024-09-10T09:36:26.864 INFO:tasks.workunit.client.1.smithi135.stdout:9/514: creat de/df/d1d/d23/d25/d5c/d83/fb0 x:0 0 0 2024-09-10T09:36:26.864 INFO:tasks.workunit.client.1.smithi135.stdout:9/515: truncate de/df/d1d/f41 194252 0 2024-09-10T09:36:26.867 INFO:tasks.workunit.client.1.smithi135.stdout:9/516: rename de/df/d1d/d23/d25/d28/d4e/c5f to de/df/d1d/d1e/cb1 0 2024-09-10T09:36:26.869 INFO:tasks.workunit.client.1.smithi135.stdout:9/517: getdents de/df/d1d/d23/d25 0 2024-09-10T09:36:26.869 INFO:tasks.workunit.client.1.smithi135.stdout:9/518: fsync de/df/d1d/f1f 0 2024-09-10T09:36:26.869 INFO:tasks.workunit.client.1.smithi135.stdout:9/519: creat de/df/d1d/fb2 x:0 0 0 2024-09-10T09:36:26.873 INFO:tasks.workunit.client.1.smithi135.stdout:9/520: unlink de/df/d1d/d23/d25/d28/d4e/f8a 0 2024-09-10T09:36:26.876 INFO:tasks.workunit.client.1.smithi135.stdout:9/521: rename de/df/d1d/d1e/d52/c87 to de/df/d1d/d23/d25/d28/d4e/cb3 0 2024-09-10T09:36:26.876 INFO:tasks.workunit.client.1.smithi135.stdout:9/522: stat de/df/d1d/d23/d25/d28/l33 0 2024-09-10T09:36:26.902 INFO:tasks.workunit.client.1.smithi135.stdout:9/523: dwrite de/df/d1d/d23/d25/d28/f81 [0,4194304] 0 2024-09-10T09:36:26.905 INFO:tasks.workunit.client.1.smithi135.stdout:9/524: mknod de/df/d1d/d1e/d68/d9f/cb4 0 2024-09-10T09:36:26.905 INFO:tasks.workunit.client.1.smithi135.stdout:9/525: getdents de/df/dac 0 2024-09-10T09:36:26.911 INFO:tasks.workunit.client.1.smithi135.stdout:9/526: rename de/df/d1d/d23/d25/d5c to de/df/d1d/d1e/db5 0 2024-09-10T09:36:26.913 INFO:tasks.workunit.client.1.smithi135.stdout:9/527: rename de/df/d1d/f41 to de/df/d1d/d62/fb6 0 2024-09-10T09:36:26.930 INFO:tasks.workunit.client.1.smithi135.stdout:9/528: dwrite de/df/d1d/d1e/d3f/f97 [0,4194304] 0 2024-09-10T09:36:26.930 INFO:tasks.workunit.client.1.smithi135.stdout:9/529: read - de/df/d1d/d1e/d68/d9f/fab zero size 2024-09-10T09:36:26.930 INFO:tasks.workunit.client.1.smithi135.stdout:9/530: chown de/df/d1d/d23/d25/d28/ca7 1420 1 2024-09-10T09:36:26.930 INFO:tasks.workunit.client.1.smithi135.stdout:9/531: write de/df/d1d/d1e/db5/d88/f98 [8385,24306] 0 2024-09-10T09:36:27.070 INFO:tasks.workunit.client.1.smithi135.stdout:9/532: mkdir de/df/dac/db7 0 2024-09-10T09:36:27.073 INFO:tasks.workunit.client.1.smithi135.stdout:9/533: dread de/df/d1d/f3a [0,4194304] 0 2024-09-10T09:36:27.079 INFO:tasks.workunit.client.1.smithi135.stdout:9/534: dread de/df/d1d/d23/d25/d28/d4e/f73 [0,4194304] 0 2024-09-10T09:36:27.081 INFO:tasks.workunit.client.1.smithi135.stdout:9/535: dread de/df/d1d/d23/f57 [0,4194304] 0 2024-09-10T09:36:27.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/536: truncate de/df/d1d/d1e/d52/f53 2701055 0 2024-09-10T09:36:27.084 INFO:tasks.workunit.client.1.smithi135.stdout:9/537: dread - de/df/d1d/d1e/d68/d9f/fab zero size 2024-09-10T09:36:27.084 INFO:tasks.workunit.client.1.smithi135.stdout:9/538: write de/df/d1d/d1e/db5/d83/fb0 [77055,64628] 0 2024-09-10T09:36:27.084 INFO:tasks.workunit.client.1.smithi135.stdout:9/539: read - de/df/d1d/f8b zero size 2024-09-10T09:36:27.085 INFO:tasks.workunit.client.1.smithi135.stdout:9/540: symlink de/df/d7e/lb8 0 2024-09-10T09:36:27.087 INFO:tasks.workunit.client.1.smithi135.stdout:9/541: symlink de/lb9 0 2024-09-10T09:36:27.106 INFO:tasks.workunit.client.1.smithi135.stdout:9/542: dwrite de/df/d1d/d1e/d68/f6f [0,4194304] 0 2024-09-10T09:36:27.118 INFO:tasks.workunit.client.1.smithi135.stdout:9/543: link de/df/d1d/d1e/c70 de/df/d1d/d62/cba 0 2024-09-10T09:36:27.118 INFO:tasks.workunit.client.1.smithi135.stdout:9/544: stat de/df/d1d/d1e/db5/ca8 0 2024-09-10T09:36:27.118 INFO:tasks.workunit.client.1.smithi135.stdout:9/545: write de/df/d1d/d23/d25/d28/f49 [210379,90872] 0 2024-09-10T09:36:27.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/546: mkdir de/df/d1d/d1e/d3f/dbb 0 2024-09-10T09:36:27.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/547: truncate de/df/d1d/d1e/d52/d86/f9c 405518 0 2024-09-10T09:36:27.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/548: stat de/df/d1d/d23/d25/d28/f37 0 2024-09-10T09:36:27.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/549: truncate de/df/d1d/d23/d25/d28/f49 827881 0 2024-09-10T09:36:27.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/550: truncate de/df/d1d/d6b/fa5 78579 0 2024-09-10T09:36:27.121 INFO:tasks.workunit.client.1.smithi135.stdout:9/551: mknod de/df/d1d/d1e/d52/cbc 0 2024-09-10T09:36:27.122 INFO:tasks.workunit.client.1.smithi135.stdout:9/552: truncate de/f18 2819218 0 2024-09-10T09:36:27.127 INFO:tasks.workunit.client.1.smithi135.stdout:9/553: rename de/df/d1d/d23/d25/d78/c91 to de/df/d1d/d1e/db5/d83/cbd 0 2024-09-10T09:36:27.127 INFO:tasks.workunit.client.1.smithi135.stdout:9/554: readlink de/lb9 0 2024-09-10T09:36:27.129 INFO:tasks.workunit.client.1.smithi135.stdout:9/555: mkdir de/df/d1d/d23/d25/d28/dbe 0 2024-09-10T09:36:27.132 INFO:tasks.workunit.client.1.smithi135.stdout:9/556: rmdir de/df/d7e 39 2024-09-10T09:36:27.132 INFO:tasks.workunit.client.1.smithi135.stdout:9/557: dread - de/df/d1d/d1e/db5/d88/f89 zero size 2024-09-10T09:36:27.132 INFO:tasks.workunit.client.1.smithi135.stdout:9/558: dread - de/df/d1d/d23/d25/d28/d4e/f7a zero size 2024-09-10T09:36:27.133 INFO:tasks.workunit.client.1.smithi135.stdout:9/559: mknod de/df/d1d/d1e/d52/d86/cbf 0 2024-09-10T09:36:27.147 INFO:tasks.workunit.client.1.smithi135.stdout:2/577: sync 2024-09-10T09:36:27.147 INFO:tasks.workunit.client.1.smithi135.stdout:2/578: truncate df/d1b/d23/d98/d5f/d2c/d7d/d8c/f99 606653 0 2024-09-10T09:36:27.148 INFO:tasks.workunit.client.1.smithi135.stdout:2/579: rename df/d1b/d70/ca1 to df/d1b/d23/db6/cba 0 2024-09-10T09:36:27.149 INFO:tasks.workunit.client.1.smithi135.stdout:2/580: creat df/d1b/d23/d98/fbb x:0 0 0 2024-09-10T09:36:27.157 INFO:tasks.workunit.client.1.smithi135.stdout:2/581: write df/d13/d52/d8f/fa7 [3995846,12646] 0 2024-09-10T09:36:27.159 INFO:tasks.workunit.client.1.smithi135.stdout:2/582: dread df/d13/f44 [0,4194304] 0 2024-09-10T09:36:27.168 INFO:tasks.workunit.client.1.smithi135.stdout:2/583: write df/d1b/f85 [2622851,12341] 0 2024-09-10T09:36:27.169 INFO:tasks.workunit.client.1.smithi135.stdout:2/584: chown df/d1b/d23/d98/d5f 183974601 1 2024-09-10T09:36:27.183 INFO:tasks.workunit.client.1.smithi135.stdout:2/585: dwrite df/d13/d52/f58 [0,4194304] 0 2024-09-10T09:36:27.183 INFO:tasks.workunit.client.1.smithi135.stdout:2/586: chown df/d1b/d23/f48 397 1 2024-09-10T09:36:27.187 INFO:tasks.workunit.client.1.smithi135.stdout:2/587: link df/d1b/d70/c74 df/d1b/d23/d98/d5f/d2c/d7d/cbc 0 2024-09-10T09:36:27.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/588: creat df/d1b/d23/db6/fbd x:0 0 0 2024-09-10T09:36:27.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/589: dread - df/d13/d4f/d95/fb4 zero size 2024-09-10T09:36:27.191 INFO:tasks.workunit.client.1.smithi135.stdout:2/590: truncate df/fb1 1029599 0 2024-09-10T09:36:27.191 INFO:tasks.workunit.client.1.smithi135.stdout:2/591: creat df/d1b/d23/fbe x:0 0 0 2024-09-10T09:36:27.197 INFO:tasks.workunit.client.1.smithi135.stdout:2/592: creat df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf x:0 0 0 2024-09-10T09:36:27.201 INFO:tasks.workunit.client.1.smithi135.stdout:2/593: rename df/d13/f38 to df/d13/d52/fc0 0 2024-09-10T09:36:27.214 INFO:tasks.workunit.client.1.smithi135.stdout:2/594: rmdir df/d1b/d23/d98 39 2024-09-10T09:36:27.214 INFO:tasks.workunit.client.1.smithi135.stdout:2/595: readlink df/d1b/d23/d98/d5f/d2c/l6b 0 2024-09-10T09:36:27.222 INFO:tasks.workunit.client.1.smithi135.stdout:2/596: write df/f54 [1710240,103920] 0 2024-09-10T09:36:27.384 INFO:tasks.workunit.client.1.smithi135.stdout:8/467: sync 2024-09-10T09:36:27.384 INFO:tasks.workunit.client.1.smithi135.stdout:4/670: sync 2024-09-10T09:36:27.385 INFO:tasks.workunit.client.1.smithi135.stdout:7/457: sync 2024-09-10T09:36:27.385 INFO:tasks.workunit.client.1.smithi135.stdout:7/458: write d2/d15/d41/d49/f63 [156943,42105] 0 2024-09-10T09:36:27.385 INFO:tasks.workunit.client.1.smithi135.stdout:7/459: creat d2/d15/d5c/f95 x:0 0 0 2024-09-10T09:36:27.386 INFO:tasks.workunit.client.1.smithi135.stdout:4/671: mknod d1/de/d16/d95/cce 0 2024-09-10T09:36:27.390 INFO:tasks.workunit.client.1.smithi135.stdout:7/460: mkdir d2/d15/d41/d49/d52/d96 0 2024-09-10T09:36:27.390 INFO:tasks.workunit.client.1.smithi135.stdout:7/461: write d2/d15/d41/d49/d60/d54/d5e/f64 [2511742,20279] 0 2024-09-10T09:36:27.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/672: mknod d1/de/d16/db8/ccf 0 2024-09-10T09:36:27.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/673: chown d1/db/d9/d55/d70/d92/fb7 59840505 1 2024-09-10T09:36:27.392 INFO:tasks.workunit.client.1.smithi135.stdout:8/468: dread d1/d15/d24/f7e [0,4194304] 0 2024-09-10T09:36:27.393 INFO:tasks.workunit.client.1.smithi135.stdout:7/462: creat d2/d15/d41/d49/d60/d54/d5e/d8c/f97 x:0 0 0 2024-09-10T09:36:27.395 INFO:tasks.workunit.client.1.smithi135.stdout:4/674: rename d1/de/d16/f78 to d1/db/d9/fd0 0 2024-09-10T09:36:27.395 INFO:tasks.workunit.client.1.smithi135.stdout:4/675: chown d1/db/ff 695 1 2024-09-10T09:36:27.396 INFO:tasks.workunit.client.1.smithi135.stdout:7/463: mknod d2/d15/c98 0 2024-09-10T09:36:27.396 INFO:tasks.workunit.client.1.smithi135.stdout:7/464: truncate d2/d15/d4a/d36/f59 1123131 0 2024-09-10T09:36:27.397 INFO:tasks.workunit.client.1.smithi135.stdout:4/676: rename d1/db/d23/l2a to d1/ld1 0 2024-09-10T09:36:27.398 INFO:tasks.workunit.client.1.smithi135.stdout:7/465: stat d2/d15/d4a/l32 0 2024-09-10T09:36:27.398 INFO:tasks.workunit.client.1.smithi135.stdout:8/469: write d1/f25 [183620,95109] 0 2024-09-10T09:36:27.399 INFO:tasks.workunit.client.1.smithi135.stdout:4/677: creat d1/db/d9/d55/d70/da4/fd2 x:0 0 0 2024-09-10T09:36:27.400 INFO:tasks.workunit.client.1.smithi135.stdout:4/678: read d1/db/d23/f42 [2207773,4315] 0 2024-09-10T09:36:27.400 INFO:tasks.workunit.client.1.smithi135.stdout:4/679: stat d1/db/d9/d55/d7b 0 2024-09-10T09:36:27.400 INFO:tasks.workunit.client.1.smithi135.stdout:4/680: dread - d1/d8a/fc3 zero size 2024-09-10T09:36:27.400 INFO:tasks.workunit.client.1.smithi135.stdout:7/466: symlink d2/d15/d5c/d85/l99 0 2024-09-10T09:36:27.404 INFO:tasks.workunit.client.1.smithi135.stdout:8/470: rmdir d1/d15/d16/d96 39 2024-09-10T09:36:27.407 INFO:tasks.workunit.client.1.smithi135.stdout:4/681: symlink d1/d4a/d9d/ld3 0 2024-09-10T09:36:27.407 INFO:tasks.workunit.client.1.smithi135.stdout:4/682: getdents d1/db/d9/d55/d70/da4/dac 0 2024-09-10T09:36:27.411 INFO:tasks.workunit.client.1.smithi135.stdout:8/471: symlink d1/d27/l9e 0 2024-09-10T09:36:27.414 INFO:tasks.workunit.client.1.smithi135.stdout:4/683: truncate d1/db/ff 2054957 0 2024-09-10T09:36:27.441 INFO:tasks.workunit.client.1.smithi135.stdout:8/472: dwrite d1/d15/f9d [0,4194304] 0 2024-09-10T09:36:27.443 INFO:tasks.workunit.client.1.smithi135.stdout:4/684: dwrite d1/d33/d40/f7e [0,4194304] 0 2024-09-10T09:36:27.447 INFO:tasks.workunit.client.1.smithi135.stdout:8/473: rename d1/f9b to d1/d15/d16/d96/f9f 0 2024-09-10T09:36:27.453 INFO:tasks.workunit.client.1.smithi135.stdout:4/685: mknod d1/d85/d89/cd4 0 2024-09-10T09:36:27.462 INFO:tasks.workunit.client.1.smithi135.stdout:8/474: dwrite d1/d15/d49/d69/f84 [0,4194304] 0 2024-09-10T09:36:27.467 INFO:tasks.workunit.client.1.smithi135.stdout:8/475: mkdir d1/d8f/da0 0 2024-09-10T09:36:27.477 INFO:tasks.workunit.client.1.smithi135.stdout:8/476: dread d1/d15/d16/f29 [4194304,4194304] 0 2024-09-10T09:36:27.477 INFO:tasks.workunit.client.1.smithi135.stdout:8/477: fdatasync d1/d15/d24/f2d 0 2024-09-10T09:36:27.479 INFO:tasks.workunit.client.1.smithi135.stdout:8/478: link d1/f20 d1/d15/d16/d33/fa1 0 2024-09-10T09:36:27.481 INFO:tasks.workunit.client.1.smithi135.stdout:8/479: mkdir d1/d8f/da2 0 2024-09-10T09:36:27.481 INFO:tasks.workunit.client.1.smithi135.stdout:8/480: truncate d1/d15/d16/d33/d45/f50 7428 0 2024-09-10T09:36:27.506 INFO:tasks.workunit.client.1.smithi135.stdout:8/481: dwrite d1/d15/d16/d33/d45/f50 [0,4194304] 0 2024-09-10T09:36:27.522 INFO:tasks.workunit.client.1.smithi135.stdout:8/482: dwrite d1/d27/f68 [0,4194304] 0 2024-09-10T09:36:27.525 INFO:tasks.workunit.client.1.smithi135.stdout:8/483: mknod d1/d15/d24/ca3 0 2024-09-10T09:36:27.529 INFO:tasks.workunit.client.1.smithi135.stdout:8/484: mknod d1/d8f/da0/ca4 0 2024-09-10T09:36:27.529 INFO:tasks.workunit.client.1.smithi135.stdout:3/395: sync 2024-09-10T09:36:27.529 INFO:tasks.workunit.client.1.smithi135.stdout:3/396: read d4/d5/dc/f50 [512615,47212] 0 2024-09-10T09:36:27.539 INFO:tasks.workunit.client.1.smithi135.stdout:8/485: dread d1/d15/d16/f29 [0,4194304] 0 2024-09-10T09:36:27.541 INFO:tasks.workunit.client.1.smithi135.stdout:8/486: truncate d1/d15/d49/f4e 554589 0 2024-09-10T09:36:27.549 INFO:tasks.workunit.client.1.smithi135.stdout:3/397: dwrite d4/d5/f58 [0,4194304] 0 2024-09-10T09:36:27.550 INFO:tasks.workunit.client.1.smithi135.stdout:3/398: truncate d4/d55/d5d/d5b/f6f 918207 0 2024-09-10T09:36:27.550 INFO:tasks.workunit.client.1.smithi135.stdout:3/399: creat d4/d55/d5d/d5b/f75 x:0 0 0 2024-09-10T09:36:27.553 INFO:tasks.workunit.client.1.smithi135.stdout:3/400: mkdir d4/d5/d76 0 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:5/518: sync 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:0/531: sync 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:6/703: sync 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:2/597: sync 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:1/551: sync 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:1/552: dread - d1d/d20/d9a/f9b zero size 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:6/704: write d5/d15/d27/f52 [1538985,26265] 0 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:6/705: write d5/d1e/d3b/d42/f7d [5213528,130287] 0 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:9/560: sync 2024-09-10T09:36:27.678 INFO:tasks.workunit.client.1.smithi135.stdout:6/706: chown d5/d1e/d3b/d42/d3c/d44/dca 1 1 2024-09-10T09:36:27.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/707: read d5/d1e/d35/f3a [18053,65597] 0 2024-09-10T09:36:27.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/708: write d5/dd/f6e [30023,49378] 0 2024-09-10T09:36:27.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/709: readlink d5/d1e/d3b/d42/d2d/d64/lc9 0 2024-09-10T09:36:27.679 INFO:tasks.workunit.client.1.smithi135.stdout:0/532: unlink d8/de/c9b 0 2024-09-10T09:36:27.682 INFO:tasks.workunit.client.1.smithi135.stdout:2/598: rename df/d1b/d23/d98/d5f/d2c/f6d to df/d13/d4f/d95/fc1 0 2024-09-10T09:36:27.684 INFO:tasks.workunit.client.1.smithi135.stdout:5/519: dread d3/f95 [0,4194304] 0 2024-09-10T09:36:27.685 INFO:tasks.workunit.client.1.smithi135.stdout:1/553: symlink d1d/d71/laf 0 2024-09-10T09:36:27.689 INFO:tasks.workunit.client.1.smithi135.stdout:6/710: mkdir d5/d1e/d3b/d74/deb 0 2024-09-10T09:36:27.691 INFO:tasks.workunit.client.1.smithi135.stdout:2/599: mknod df/d1b/d23/cc2 0 2024-09-10T09:36:27.692 INFO:tasks.workunit.client.1.smithi135.stdout:2/600: read df/d1b/d23/d98/d5f/d2c/d7d/d8c/f99 [113658,129293] 0 2024-09-10T09:36:27.694 INFO:tasks.workunit.client.1.smithi135.stdout:1/554: rename d1d/d20/d3c/d6a/fa4 to d1d/d20/d3c/d6a/fb0 0 2024-09-10T09:36:27.697 INFO:tasks.workunit.client.1.smithi135.stdout:0/533: getdents d8/dd 0 2024-09-10T09:36:27.700 INFO:tasks.workunit.client.1.smithi135.stdout:2/601: truncate df/d1b/f26 1232564 0 2024-09-10T09:36:27.706 INFO:tasks.workunit.client.1.smithi135.stdout:5/520: write d3/fa [3997151,32540] 0 2024-09-10T09:36:27.706 INFO:tasks.workunit.client.1.smithi135.stdout:9/561: dwrite de/df/d1d/d23/d25/d28/f37 [0,4194304] 0 2024-09-10T09:36:27.707 INFO:tasks.workunit.client.1.smithi135.stdout:9/562: stat de/df/d1d/d1e/db5/d88/f89 0 2024-09-10T09:36:27.710 INFO:tasks.workunit.client.1.smithi135.stdout:0/534: mkdir d8/dd/db0 0 2024-09-10T09:36:27.714 INFO:tasks.workunit.client.1.smithi135.stdout:1/555: dread d1d/d20/d6c/d86/d2b/f36 [0,4194304] 0 2024-09-10T09:36:27.716 INFO:tasks.workunit.client.1.smithi135.stdout:6/711: dwrite d5/dd/d50/db3/fdc [0,4194304] 0 2024-09-10T09:36:27.717 INFO:tasks.workunit.client.1.smithi135.stdout:1/556: unlink d1d/d20/d3c/f3d 0 2024-09-10T09:36:27.730 INFO:tasks.workunit.client.1.smithi135.stdout:1/557: unlink d1d/d20/d3c/d6a/f98 0 2024-09-10T09:36:27.736 INFO:tasks.workunit.client.1.smithi135.stdout:5/521: dwrite d3/ff [4194304,4194304] 0 2024-09-10T09:36:27.743 INFO:tasks.workunit.client.1.smithi135.stdout:6/712: dwrite d5/d1e/d3b/d42/d3c/d44/dca/fde [0,4194304] 0 2024-09-10T09:36:27.748 INFO:tasks.workunit.client.1.smithi135.stdout:1/558: write d1d/d20/d6c/d86/d2b/f32 [2205726,63218] 0 2024-09-10T09:36:27.748 INFO:tasks.workunit.client.1.smithi135.stdout:1/559: chown d1d/d28/d4b/l99 305 1 2024-09-10T09:36:27.748 INFO:tasks.workunit.client.1.smithi135.stdout:2/602: dwrite df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf [0,4194304] 0 2024-09-10T09:36:27.748 INFO:tasks.workunit.client.1.smithi135.stdout:1/560: write d1d/f21 [4313021,60745] 0 2024-09-10T09:36:27.748 INFO:tasks.workunit.client.1.smithi135.stdout:2/603: write df/d1b/d23/d42/f46 [957805,12596] 0 2024-09-10T09:36:27.749 INFO:tasks.workunit.client.1.smithi135.stdout:1/561: dread d1d/d20/d6c/d86/f4d [0,4194304] 0 2024-09-10T09:36:27.752 INFO:tasks.workunit.client.1.smithi135.stdout:0/535: dwrite d8/fb [0,4194304] 0 2024-09-10T09:36:27.753 INFO:tasks.workunit.client.1.smithi135.stdout:6/713: symlink d5/dd/d50/d54/da9/de4/lec 0 2024-09-10T09:36:27.755 INFO:tasks.workunit.client.1.smithi135.stdout:5/522: dwrite d3/dc/d7a/fa4 [4194304,4194304] 0 2024-09-10T09:36:27.759 INFO:tasks.workunit.client.1.smithi135.stdout:1/562: mknod d1d/d28/d4b/d53/cb1 0 2024-09-10T09:36:27.771 INFO:tasks.workunit.client.1.smithi135.stdout:0/536: fsync d8/dd/d1e/fa2 0 2024-09-10T09:36:27.773 INFO:tasks.workunit.client.1.smithi135.stdout:5/523: dwrite d3/f31 [0,4194304] 0 2024-09-10T09:36:27.773 INFO:tasks.workunit.client.1.smithi135.stdout:5/524: chown d3/dc/d7a 937 1 2024-09-10T09:36:27.773 INFO:tasks.workunit.client.1.smithi135.stdout:5/525: chown d3/d26/d48/d57/f7c 1 1 2024-09-10T09:36:27.778 INFO:tasks.workunit.client.1.smithi135.stdout:0/537: mkdir d8/d1c/d61/db1 0 2024-09-10T09:36:27.784 INFO:tasks.workunit.client.1.smithi135.stdout:5/526: symlink d3/d26/d48/d57/da3/laf 0 2024-09-10T09:36:27.785 INFO:tasks.workunit.client.1.smithi135.stdout:1/563: getdents d1d/d20/d3c 0 2024-09-10T09:36:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:1/564: stat d1d/d20/d6c/d86/d2b/d4c/d63/fac 0 2024-09-10T09:36:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:1/565: fdatasync d1d/d20/d3c/d6a/fb0 0 2024-09-10T09:36:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:1/566: fsync d1d/d20/d6c/d86/f7d 0 2024-09-10T09:36:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:0/538: fdatasync d8/dd/d4a/d50/d54/d5f/f30 0 2024-09-10T09:36:27.786 INFO:tasks.workunit.client.1.smithi135.stdout:1/567: write d1d/d28/d4b/d53/f8d [366077,27067] 0 2024-09-10T09:36:27.789 INFO:tasks.workunit.client.1.smithi135.stdout:5/527: rmdir d3/d99/d9d 0 2024-09-10T09:36:27.791 INFO:tasks.workunit.client.1.smithi135.stdout:0/539: dread - d8/dd/d11/f92 zero size 2024-09-10T09:36:27.791 INFO:tasks.workunit.client.1.smithi135.stdout:0/540: truncate d8/dd/d1e/f6e 529559 0 2024-09-10T09:36:27.794 INFO:tasks.workunit.client.1.smithi135.stdout:1/568: creat d1d/d20/d6c/d86/d37/d6d/fb2 x:0 0 0 2024-09-10T09:36:27.794 INFO:tasks.workunit.client.1.smithi135.stdout:1/569: dread - d1d/d20/d42/f60 zero size 2024-09-10T09:36:27.797 INFO:tasks.workunit.client.1.smithi135.stdout:5/528: creat d3/fb0 x:0 0 0 2024-09-10T09:36:27.797 INFO:tasks.workunit.client.1.smithi135.stdout:5/529: write d3/d91/f98 [756226,31206] 0 2024-09-10T09:36:27.800 INFO:tasks.workunit.client.1.smithi135.stdout:5/530: mkdir d3/d26/d48/d57/da3/db1 0 2024-09-10T09:36:27.800 INFO:tasks.workunit.client.1.smithi135.stdout:5/531: fsync d3/d26/d48/d57/f7c 0 2024-09-10T09:36:27.801 INFO:tasks.workunit.client.1.smithi135.stdout:1/570: dread d1d/d20/d6c/d86/d2b/f36 [0,4194304] 0 2024-09-10T09:36:27.803 INFO:tasks.workunit.client.1.smithi135.stdout:5/532: symlink d3/d26/dae/lb2 0 2024-09-10T09:36:27.806 INFO:tasks.workunit.client.1.smithi135.stdout:1/571: symlink d1d/d20/d6c/d86/d37/lb3 0 2024-09-10T09:36:27.808 INFO:tasks.workunit.client.1.smithi135.stdout:1/572: mkdir d1d/d20/d6c/d86/db4 0 2024-09-10T09:36:27.810 INFO:tasks.workunit.client.1.smithi135.stdout:1/573: getdents d1d/d20/d6c/d86/d2b 0 2024-09-10T09:36:27.811 INFO:tasks.workunit.client.1.smithi135.stdout:1/574: truncate d1d/d20/d3c/f5f 249170 0 2024-09-10T09:36:27.811 INFO:tasks.workunit.client.1.smithi135.stdout:1/575: dread - d1d/d20/d6c/d86/d37/d6d/fb2 zero size 2024-09-10T09:36:27.813 INFO:tasks.workunit.client.1.smithi135.stdout:0/541: dwrite d8/dd/d4a/d50/d67/f71 [0,4194304] 0 2024-09-10T09:36:27.815 INFO:tasks.workunit.client.1.smithi135.stdout:1/576: rmdir d1d/d28 39 2024-09-10T09:36:27.819 INFO:tasks.workunit.client.1.smithi135.stdout:0/542: chown d8/dd/f10 31583 1 2024-09-10T09:36:27.819 INFO:tasks.workunit.client.1.smithi135.stdout:0/543: chown d8/dd/d4a 336 1 2024-09-10T09:36:27.819 INFO:tasks.workunit.client.1.smithi135.stdout:0/544: readlink d8/d1c/d37/l6b 0 2024-09-10T09:36:27.819 INFO:tasks.workunit.client.1.smithi135.stdout:5/533: dread d3/f18 [0,4194304] 0 2024-09-10T09:36:27.819 INFO:tasks.workunit.client.1.smithi135.stdout:5/534: fsync d3/d44/f4c 0 2024-09-10T09:36:27.820 INFO:tasks.workunit.client.1.smithi135.stdout:1/577: mknod d1d/d20/d9a/cb5 0 2024-09-10T09:36:27.820 INFO:tasks.workunit.client.1.smithi135.stdout:1/578: write d1d/d20/d6c/f9d [841998,70982] 0 2024-09-10T09:36:27.821 INFO:tasks.workunit.client.1.smithi135.stdout:1/579: mknod d1d/d20/d52/d8a/cb6 0 2024-09-10T09:36:27.821 INFO:tasks.workunit.client.1.smithi135.stdout:1/580: creat d1d/d20/d6c/d86/d2b/d4c/fb7 x:0 0 0 2024-09-10T09:36:27.825 INFO:tasks.workunit.client.1.smithi135.stdout:1/581: mkdir d1d/d20/d6c/d86/d37/db8 0 2024-09-10T09:36:27.834 INFO:tasks.workunit.client.1.smithi135.stdout:5/535: dwrite d3/d44/f30 [0,4194304] 0 2024-09-10T09:36:27.836 INFO:tasks.workunit.client.1.smithi135.stdout:5/536: creat d3/d26/dae/fb3 x:0 0 0 2024-09-10T09:36:27.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/582: write d1d/d20/d3c/f5f [330197,102258] 0 2024-09-10T09:36:27.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/583: write d1d/f1e [1227307,33863] 0 2024-09-10T09:36:27.838 INFO:tasks.workunit.client.1.smithi135.stdout:1/584: dread d1d/d20/d3c/d6a/f93 [0,4194304] 0 2024-09-10T09:36:27.839 INFO:tasks.workunit.client.1.smithi135.stdout:5/537: creat d3/d26/d48/d57/da3/db1/fb4 x:0 0 0 2024-09-10T09:36:27.854 INFO:tasks.workunit.client.1.smithi135.stdout:7/467: sync 2024-09-10T09:36:27.856 INFO:tasks.workunit.client.1.smithi135.stdout:7/468: unlink d2/f2e 0 2024-09-10T09:36:27.858 INFO:tasks.workunit.client.1.smithi135.stdout:7/469: rename d2/d15/d5c/f90 to d2/d25/d5d/d83/f9a 0 2024-09-10T09:36:27.858 INFO:tasks.workunit.client.1.smithi135.stdout:7/470: fsync d2/d15/d41/d49/d60/f22 0 2024-09-10T09:36:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:7/471: creat d2/d15/d5c/d85/f9b x:0 0 0 2024-09-10T09:36:27.859 INFO:tasks.workunit.client.1.smithi135.stdout:7/472: write d2/d15/d41/d49/d60/d30/f70 [752971,57791] 0 2024-09-10T09:36:27.863 INFO:tasks.workunit.client.1.smithi135.stdout:5/538: dwrite d3/dc/d7a/fa4 [8388608,4194304] 0 2024-09-10T09:36:27.866 INFO:tasks.workunit.client.1.smithi135.stdout:7/473: dread d2/d15/d41/d49/d60/d30/f35 [0,4194304] 0 2024-09-10T09:36:27.866 INFO:tasks.workunit.client.1.smithi135.stdout:1/585: dwrite d1d/d20/d9a/f9b [0,4194304] 0 2024-09-10T09:36:27.873 INFO:tasks.workunit.client.1.smithi135.stdout:1/586: link d1d/d20/d6c/d86/d2b/f7b d1d/d20/d6c/d86/fb9 0 2024-09-10T09:36:27.873 INFO:tasks.workunit.client.1.smithi135.stdout:1/587: chown d1d/d20/d6c/d86/fb9 1369513759 1 2024-09-10T09:36:27.882 INFO:tasks.workunit.client.1.smithi135.stdout:1/588: rmdir d1d/d20/d42 39 2024-09-10T09:36:27.883 INFO:tasks.workunit.client.1.smithi135.stdout:1/589: truncate d1d/f58 1305241 0 2024-09-10T09:36:27.883 INFO:tasks.workunit.client.1.smithi135.stdout:1/590: truncate d1d/d20/f31 888797 0 2024-09-10T09:36:27.893 INFO:tasks.workunit.client.1.smithi135.stdout:5/539: dwrite d3/d26/f3c [0,4194304] 0 2024-09-10T09:36:27.894 INFO:tasks.workunit.client.1.smithi135.stdout:1/591: dread d1d/f21 [0,4194304] 0 2024-09-10T09:36:27.894 INFO:tasks.workunit.client.1.smithi135.stdout:1/592: fdatasync f4 0 2024-09-10T09:36:27.894 INFO:tasks.workunit.client.1.smithi135.stdout:1/593: creat d1d/d20/d5d/fba x:0 0 0 2024-09-10T09:36:27.901 INFO:tasks.workunit.client.1.smithi135.stdout:1/594: link d1d/d28/lae d1d/d20/d5d/lbb 0 2024-09-10T09:36:27.901 INFO:tasks.workunit.client.1.smithi135.stdout:1/595: chown d1d/d20/d52/f5a 212319134 1 2024-09-10T09:36:27.902 INFO:tasks.workunit.client.1.smithi135.stdout:1/596: chown d1d/d20/d6c/d86/f7d 47 1 2024-09-10T09:36:27.908 INFO:tasks.workunit.client.1.smithi135.stdout:1/597: dread d1d/d20/d6c/d86/d2b/d4c/d63/fac [0,4194304] 0 2024-09-10T09:36:27.908 INFO:tasks.workunit.client.1.smithi135.stdout:1/598: getdents d1d/d20/d6c/d86/d2b 0 2024-09-10T09:36:27.918 INFO:tasks.workunit.client.1.smithi135.stdout:5/540: dwrite d3/dc/f37 [0,4194304] 0 2024-09-10T09:36:27.924 INFO:tasks.workunit.client.1.smithi135.stdout:1/599: write d1d/d20/f77 [2001867,78838] 0 2024-09-10T09:36:27.925 INFO:tasks.workunit.client.1.smithi135.stdout:1/600: fsync d1d/d20/d6c/d86/d2b/f32 0 2024-09-10T09:36:27.925 INFO:tasks.workunit.client.1.smithi135.stdout:1/601: truncate d1d/d20/d6c/d86/d2b/d4c/f62 1441348 0 2024-09-10T09:36:27.925 INFO:tasks.workunit.client.1.smithi135.stdout:5/541: rename d3/d44/d22 to d3/d91/db5 0 2024-09-10T09:36:27.927 INFO:tasks.workunit.client.1.smithi135.stdout:5/542: symlink d3/d81/d8d/lb6 0 2024-09-10T09:36:27.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/543: symlink d3/d71/d61/lb7 0 2024-09-10T09:36:27.934 INFO:tasks.workunit.client.1.smithi135.stdout:5/544: creat d3/d81/fb8 x:0 0 0 2024-09-10T09:36:27.946 INFO:tasks.workunit.client.1.smithi135.stdout:1/602: dwrite d1d/d20/d3c/d4e/fa5 [0,4194304] 0 2024-09-10T09:36:27.946 INFO:tasks.workunit.client.1.smithi135.stdout:1/603: dread - d1d/fad zero size 2024-09-10T09:36:27.947 INFO:tasks.workunit.client.1.smithi135.stdout:5/545: dread d3/fa [4194304,4194304] 0 2024-09-10T09:36:27.947 INFO:tasks.workunit.client.1.smithi135.stdout:5/546: write d3/d44/d8a/f96 [620193,70322] 0 2024-09-10T09:36:27.947 INFO:tasks.workunit.client.1.smithi135.stdout:5/547: fdatasync d3/dc/f8c 0 2024-09-10T09:36:27.950 INFO:tasks.workunit.client.1.smithi135.stdout:1/604: creat d1d/d20/d6c/d86/d37/db8/fbc x:0 0 0 2024-09-10T09:36:27.951 INFO:tasks.workunit.client.1.smithi135.stdout:5/548: mkdir d3/dc/d7a/db9 0 2024-09-10T09:36:27.953 INFO:tasks.workunit.client.1.smithi135.stdout:5/549: getdents d3/dc/d69/d65/d6c 0 2024-09-10T09:36:27.954 INFO:tasks.workunit.client.1.smithi135.stdout:1/605: dread d1d/d20/d3c/d6a/f93 [0,4194304] 0 2024-09-10T09:36:27.978 INFO:tasks.workunit.client.1.smithi135.stdout:1/606: creat d1d/d20/d52/d8a/fbd x:0 0 0 2024-09-10T09:36:27.978 INFO:tasks.workunit.client.1.smithi135.stdout:1/607: chown d1d/d20/d52/d8a 4 1 2024-09-10T09:36:27.978 INFO:tasks.workunit.client.1.smithi135.stdout:1/608: chown d1d/d20/d52/d8a/cb6 24475569 1 2024-09-10T09:36:27.978 INFO:tasks.workunit.client.1.smithi135.stdout:1/609: write d1d/f22 [2142113,13708] 0 2024-09-10T09:36:27.978 INFO:tasks.workunit.client.1.smithi135.stdout:1/610: chown d1d/c2d 63362588 1 2024-09-10T09:36:27.979 INFO:tasks.workunit.client.1.smithi135.stdout:1/611: write d1d/d20/d6c/d86/d2b/f81 [321799,65107] 0 2024-09-10T09:36:27.983 INFO:tasks.workunit.client.1.smithi135.stdout:1/612: creat d1d/d20/d6c/d86/fbe x:0 0 0 2024-09-10T09:36:27.983 INFO:tasks.workunit.client.1.smithi135.stdout:1/613: write d1d/d20/d6c/d86/d2b/f32 [1559896,80464] 0 2024-09-10T09:36:27.993 INFO:tasks.workunit.client.1.smithi135.stdout:1/614: symlink d1d/d20/d52/d8a/lbf 0 2024-09-10T09:36:27.993 INFO:tasks.workunit.client.1.smithi135.stdout:1/615: readlink d1d/d20/d6c/d86/d37/l41 0 2024-09-10T09:36:27.994 INFO:tasks.workunit.client.1.smithi135.stdout:5/550: rename d3/d26 to d3/dc/dba 0 2024-09-10T09:36:27.995 INFO:tasks.workunit.client.1.smithi135.stdout:1/616: creat d1d/d20/d42/fc0 x:0 0 0 2024-09-10T09:36:27.997 INFO:tasks.workunit.client.1.smithi135.stdout:5/551: link d3/f12 d3/d99/fbb 0 2024-09-10T09:36:27.998 INFO:tasks.workunit.client.1.smithi135.stdout:5/552: truncate d3/dc/d69/d65/f85 4274390 0 2024-09-10T09:36:28.000 INFO:tasks.workunit.client.1.smithi135.stdout:5/553: link d3/dc/dba/d88/fa1 d3/dc/dba/d48/fbc 0 2024-09-10T09:36:28.001 INFO:tasks.workunit.client.1.smithi135.stdout:5/554: read - d3/fb0 zero size 2024-09-10T09:36:28.008 INFO:tasks.workunit.client.1.smithi135.stdout:1/617: dread d1d/d20/f30 [0,4194304] 0 2024-09-10T09:36:28.008 INFO:tasks.workunit.client.1.smithi135.stdout:1/618: dread - d1d/d20/fa6 zero size 2024-09-10T09:36:28.010 INFO:tasks.workunit.client.1.smithi135.stdout:1/619: mkdir d1d/d20/d6c/d86/d2b/da8/dc1 0 2024-09-10T09:36:28.011 INFO:tasks.workunit.client.1.smithi135.stdout:1/620: mkdir d1d/d20/d52/d8a/dc2 0 2024-09-10T09:36:28.031 INFO:tasks.workunit.client.1.smithi135.stdout:5/555: dwrite d3/dc/f10 [0,4194304] 0 2024-09-10T09:36:28.031 INFO:tasks.workunit.client.1.smithi135.stdout:1/621: dwrite d1d/d20/d6c/d86/d2b/d4c/d63/fac [0,4194304] 0 2024-09-10T09:36:28.035 INFO:tasks.workunit.client.1.smithi135.stdout:1/622: truncate d1d/d20/d6c/d86/d2b/f81 380246 0 2024-09-10T09:36:28.035 INFO:tasks.workunit.client.1.smithi135.stdout:1/623: creat d1d/d20/d52/d8a/fc3 x:0 0 0 2024-09-10T09:36:28.037 INFO:tasks.workunit.client.1.smithi135.stdout:1/624: symlink d1d/d20/d9a/lc4 0 2024-09-10T09:36:28.038 INFO:tasks.workunit.client.1.smithi135.stdout:5/556: dread d3/d99/fbb [0,4194304] 0 2024-09-10T09:36:28.038 INFO:tasks.workunit.client.1.smithi135.stdout:5/557: truncate d3/dc/f8c 907238 0 2024-09-10T09:36:28.040 INFO:tasks.workunit.client.1.smithi135.stdout:5/558: mknod d3/dc/dba/dae/cbd 0 2024-09-10T09:36:28.040 INFO:tasks.workunit.client.1.smithi135.stdout:5/559: dread - d3/dc/dba/d48/fbc zero size 2024-09-10T09:36:28.042 INFO:tasks.workunit.client.1.smithi135.stdout:3/401: sync 2024-09-10T09:36:28.042 INFO:tasks.workunit.client.1.smithi135.stdout:8/487: sync 2024-09-10T09:36:28.042 INFO:tasks.workunit.client.1.smithi135.stdout:4/686: sync 2024-09-10T09:36:28.045 INFO:tasks.workunit.client.1.smithi135.stdout:1/625: dread d1d/d20/d6c/d86/d2b/f32 [0,4194304] 0 2024-09-10T09:36:28.046 INFO:tasks.workunit.client.1.smithi135.stdout:1/626: write f6 [1617548,23203] 0 2024-09-10T09:36:28.047 INFO:tasks.workunit.client.1.smithi135.stdout:3/402: getdents d4/d55 0 2024-09-10T09:36:28.050 INFO:tasks.workunit.client.1.smithi135.stdout:5/560: write d3/d44/f30 [3340290,61649] 0 2024-09-10T09:36:28.050 INFO:tasks.workunit.client.1.smithi135.stdout:5/561: truncate d3/dc/dba/d48/d57/f5e 4375643 0 2024-09-10T09:36:28.050 INFO:tasks.workunit.client.1.smithi135.stdout:1/627: mkdir d1d/d28/d4b/d53/dc5 0 2024-09-10T09:36:28.054 INFO:tasks.workunit.client.1.smithi135.stdout:3/403: mknod d4/d5/d51/c77 0 2024-09-10T09:36:28.054 INFO:tasks.workunit.client.1.smithi135.stdout:1/628: read d1d/d20/d6c/d86/d2b/f36 [4128483,14036] 0 2024-09-10T09:36:28.054 INFO:tasks.workunit.client.1.smithi135.stdout:1/629: creat d1d/d20/d6c/fc6 x:0 0 0 2024-09-10T09:36:28.056 INFO:tasks.workunit.client.1.smithi135.stdout:4/687: read d1/d8a/fae [337569,62607] 0 2024-09-10T09:36:28.058 INFO:tasks.workunit.client.1.smithi135.stdout:3/404: unlink d4/d5/db/d44/d68/f70 0 2024-09-10T09:36:28.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/630: truncate d1d/d20/d3c/d4e/fa5 789886 0 2024-09-10T09:36:28.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/631: readlink d1d/d28/lae 0 2024-09-10T09:36:28.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/632: creat d1d/d20/d6c/d86/d37/d6d/fc7 x:0 0 0 2024-09-10T09:36:28.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/633: dread - d1d/d20/d6c/d86/d37/db8/fbc zero size 2024-09-10T09:36:28.061 INFO:tasks.workunit.client.1.smithi135.stdout:1/634: truncate d1d/d20/d3c/f9f 1395877 0 2024-09-10T09:36:28.062 INFO:tasks.workunit.client.1.smithi135.stdout:5/562: getdents d3/d91 0 2024-09-10T09:36:28.065 INFO:tasks.workunit.client.1.smithi135.stdout:4/688: truncate d1/d8a/fae 3282126 0 2024-09-10T09:36:28.065 INFO:tasks.workunit.client.1.smithi135.stdout:4/689: creat d1/fd5 x:0 0 0 2024-09-10T09:36:28.068 INFO:tasks.workunit.client.1.smithi135.stdout:3/405: creat d4/d5/db/f78 x:0 0 0 2024-09-10T09:36:28.076 INFO:tasks.workunit.client.1.smithi135.stdout:1/635: symlink d1d/d28/d4b/d53/lc8 0 2024-09-10T09:36:28.076 INFO:tasks.workunit.client.1.smithi135.stdout:1/636: stat d1d/d71/laf 0 2024-09-10T09:36:28.077 INFO:tasks.workunit.client.1.smithi135.stdout:1/637: chown d1d/c2d 417 1 2024-09-10T09:36:28.081 INFO:tasks.workunit.client.1.smithi135.stdout:4/690: truncate d1/f22 498080 0 2024-09-10T09:36:28.083 INFO:tasks.workunit.client.1.smithi135.stdout:1/638: creat d1d/d20/d6c/d86/d37/fc9 x:0 0 0 2024-09-10T09:36:28.096 INFO:tasks.workunit.client.1.smithi135.stdout:4/691: write d1/db/da0/fba [99188,23487] 0 2024-09-10T09:36:28.096 INFO:tasks.workunit.client.1.smithi135.stdout:4/692: getdents d1/de/d16/db8 0 2024-09-10T09:36:28.102 INFO:tasks.workunit.client.1.smithi135.stdout:3/406: dwrite d4/d5/f58 [0,4194304] 0 2024-09-10T09:36:28.103 INFO:tasks.workunit.client.1.smithi135.stdout:5/563: dwrite d3/ff [4194304,4194304] 0 2024-09-10T09:36:28.103 INFO:tasks.workunit.client.1.smithi135.stdout:1/639: dwrite d1d/d20/d6c/f74 [0,4194304] 0 2024-09-10T09:36:28.103 INFO:tasks.workunit.client.1.smithi135.stdout:1/640: write d1d/d20/d6c/d86/d2b/d4c/d63/f66 [354380,114012] 0 2024-09-10T09:36:28.110 INFO:tasks.workunit.client.1.smithi135.stdout:3/407: rmdir d4/d5/db/dd 39 2024-09-10T09:36:28.115 INFO:tasks.workunit.client.1.smithi135.stdout:3/408: getdents d4/d5/d56 0 2024-09-10T09:36:28.122 INFO:tasks.workunit.client.1.smithi135.stdout:4/693: dwrite d1/d33/f6e [0,4194304] 0 2024-09-10T09:36:28.122 INFO:tasks.workunit.client.1.smithi135.stdout:1/641: dwrite d1d/d20/d6c/d86/f4d [0,4194304] 0 2024-09-10T09:36:28.123 INFO:tasks.workunit.client.1.smithi135.stdout:1/642: write d1d/d20/d5d/fba [553902,42359] 0 2024-09-10T09:36:28.126 INFO:tasks.workunit.client.1.smithi135.stdout:5/564: dread d3/d44/f30 [0,4194304] 0 2024-09-10T09:36:28.126 INFO:tasks.workunit.client.1.smithi135.stdout:5/565: creat d3/d44/fbe x:0 0 0 2024-09-10T09:36:28.126 INFO:tasks.workunit.client.1.smithi135.stdout:5/566: fdatasync d3/fb0 0 2024-09-10T09:36:28.126 INFO:tasks.workunit.client.1.smithi135.stdout:5/567: dread - d3/dc/dba/d48/fbc zero size 2024-09-10T09:36:28.126 INFO:tasks.workunit.client.1.smithi135.stdout:4/694: mkdir d1/d4a/d9d/da1/dd6 0 2024-09-10T09:36:28.128 INFO:tasks.workunit.client.1.smithi135.stdout:3/409: dread d4/d55/f60 [0,4194304] 0 2024-09-10T09:36:28.128 INFO:tasks.workunit.client.1.smithi135.stdout:3/410: chown d4/f32 11 1 2024-09-10T09:36:28.128 INFO:tasks.workunit.client.1.smithi135.stdout:3/411: stat d4/d5/db/l66 0 2024-09-10T09:36:28.128 INFO:tasks.workunit.client.1.smithi135.stdout:3/412: fdatasync d4/d5/db/d44/f4e 0 2024-09-10T09:36:28.128 INFO:tasks.workunit.client.1.smithi135.stdout:3/413: truncate d4/d5/db/d36/d43/f6e 717659 0 2024-09-10T09:36:28.132 INFO:tasks.workunit.client.1.smithi135.stdout:5/568: mkdir d3/dc/dba/dbf 0 2024-09-10T09:36:28.132 INFO:tasks.workunit.client.1.smithi135.stdout:4/695: mkdir d1/db/d9/d55/d70/da4/dac/dd7 0 2024-09-10T09:36:28.139 INFO:tasks.workunit.client.1.smithi135.stdout:5/569: truncate d3/dc/dba/f5f 11761 0 2024-09-10T09:36:28.160 INFO:tasks.workunit.client.1.smithi135.stdout:1/643: rename d1d/d20/d6c/d86 to d1d/d20/d52/d8a/dc2/dca 0 2024-09-10T09:36:28.161 INFO:tasks.workunit.client.1.smithi135.stdout:1/644: fdatasync d1d/d20/d3c/d6a/fb0 0 2024-09-10T09:36:28.162 INFO:tasks.workunit.client.1.smithi135.stdout:5/570: mkdir d3/dc/d16/dc0 0 2024-09-10T09:36:28.162 INFO:tasks.workunit.client.1.smithi135.stdout:4/696: rmdir d1/d33 39 2024-09-10T09:36:28.165 INFO:tasks.workunit.client.1.smithi135.stdout:3/414: rename d4/d55/d64 to d4/d5/db/dd/d79 0 2024-09-10T09:36:28.168 INFO:tasks.workunit.client.1.smithi135.stdout:1/645: link d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/c83 d1d/d20/d52/d8a/dc2/dca/d2b/da8/ccb 0 2024-09-10T09:36:28.169 INFO:tasks.workunit.client.1.smithi135.stdout:5/571: creat d3/dc/dba/d88/fc1 x:0 0 0 2024-09-10T09:36:28.169 INFO:tasks.workunit.client.1.smithi135.stdout:5/572: stat d3/dc/dba/f68 0 2024-09-10T09:36:28.172 INFO:tasks.workunit.client.1.smithi135.stdout:4/697: link d1/db/d23/c5d d1/de/d16/d95/cd8 0 2024-09-10T09:36:28.175 INFO:tasks.workunit.client.1.smithi135.stdout:3/415: link d4/d55/d5d/c29 d4/d55/d5d/d5b/c7a 0 2024-09-10T09:36:28.176 INFO:tasks.workunit.client.1.smithi135.stdout:1/646: symlink d1d/d28/d4b/d53/dc5/lcc 0 2024-09-10T09:36:28.176 INFO:tasks.workunit.client.1.smithi135.stdout:1/647: chown d1d/d20/d52/f5a 0 1 2024-09-10T09:36:28.177 INFO:tasks.workunit.client.1.smithi135.stdout:1/648: dread - d1d/d20/d3c/d4e/f68 zero size 2024-09-10T09:36:28.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/573: symlink d3/dc/dba/d4e/lc2 0 2024-09-10T09:36:28.177 INFO:tasks.workunit.client.1.smithi135.stdout:5/574: creat d3/dc/dba/d88/fc3 x:0 0 0 2024-09-10T09:36:28.178 INFO:tasks.workunit.client.1.smithi135.stdout:1/649: truncate d1d/d20/f94 374780 0 2024-09-10T09:36:28.178 INFO:tasks.workunit.client.1.smithi135.stdout:1/650: getdents d1d/d20/d52/d8a/dc2/dca/db4 0 2024-09-10T09:36:28.178 INFO:tasks.workunit.client.1.smithi135.stdout:1/651: chown d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/fac 11 1 2024-09-10T09:36:28.181 INFO:tasks.workunit.client.1.smithi135.stdout:5/575: mkdir d3/dc/dba/d48/d57/dc4 0 2024-09-10T09:36:28.181 INFO:tasks.workunit.client.1.smithi135.stdout:5/576: dread - d3/dc/dba/d88/fa1 zero size 2024-09-10T09:36:28.182 INFO:tasks.workunit.client.1.smithi135.stdout:1/652: creat d1d/d20/d52/d8a/dc2/dca/db4/fcd x:0 0 0 2024-09-10T09:36:28.184 INFO:tasks.workunit.client.1.smithi135.stdout:5/577: creat d3/dc/d16/dc0/fc5 x:0 0 0 2024-09-10T09:36:28.184 INFO:tasks.workunit.client.1.smithi135.stdout:5/578: chown d3/d81/d8d/ca2 82142931 1 2024-09-10T09:36:28.184 INFO:tasks.workunit.client.1.smithi135.stdout:5/579: stat d3/dc/dba/d4e/d87 0 2024-09-10T09:36:28.186 INFO:tasks.workunit.client.1.smithi135.stdout:1/653: creat d1d/d20/d52/d8a/dc2/dca/d2b/fce x:0 0 0 2024-09-10T09:36:28.186 INFO:tasks.workunit.client.1.smithi135.stdout:1/654: write d1d/f2a [1227430,92775] 0 2024-09-10T09:36:28.187 INFO:tasks.workunit.client.1.smithi135.stdout:5/580: creat d3/dc/dba/d48/d57/da3/fc6 x:0 0 0 2024-09-10T09:36:28.189 INFO:tasks.workunit.client.1.smithi135.stdout:1/655: mkdir d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dcf 0 2024-09-10T09:36:28.197 INFO:tasks.workunit.client.1.smithi135.stdout:5/581: write d3/f9 [1004120,73276] 0 2024-09-10T09:36:28.197 INFO:tasks.workunit.client.1.smithi135.stdout:4/698: dwrite d1/d85/d89/f91 [0,4194304] 0 2024-09-10T09:36:28.204 INFO:tasks.workunit.client.1.smithi135.stdout:5/582: truncate d3/d44/f30 2583823 0 2024-09-10T09:36:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:27 smithi079 ceph-mon[27592]: pgmap v268: 65 pgs: 65 active+clean; 2.2 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 157 MiB/s rd, 175 MiB/s wr, 311 op/s 2024-09-10T09:36:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:27 smithi135 ceph-mon[33411]: pgmap v268: 65 pgs: 65 active+clean; 2.2 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 157 MiB/s rd, 175 MiB/s wr, 311 op/s 2024-09-10T09:36:28.225 INFO:tasks.workunit.client.1.smithi135.stdout:9/563: sync 2024-09-10T09:36:28.225 INFO:tasks.workunit.client.1.smithi135.stdout:9/564: write de/f18 [3133764,22252] 0 2024-09-10T09:36:28.226 INFO:tasks.workunit.client.1.smithi135.stdout:9/565: dread de/df/d1d/d6b/fa5 [0,4194304] 0 2024-09-10T09:36:28.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/699: dwrite d1/db/d9/d55/d76/f7f [0,4194304] 0 2024-09-10T09:36:28.229 INFO:tasks.workunit.client.1.smithi135.stdout:4/700: creat d1/de/fd9 x:0 0 0 2024-09-10T09:36:28.231 INFO:tasks.workunit.client.1.smithi135.stdout:9/566: rename de/df/d1d/d1e/c70 to de/df/d1d/d23/d25/cc0 0 2024-09-10T09:36:28.233 INFO:tasks.workunit.client.1.smithi135.stdout:5/583: dwrite d3/dc/d69/d65/f85 [0,4194304] 0 2024-09-10T09:36:28.233 INFO:tasks.workunit.client.1.smithi135.stdout:5/584: readlink d3/d71/d61/l6b 0 2024-09-10T09:36:28.237 INFO:tasks.workunit.client.1.smithi135.stdout:4/701: rename d1/de/d16/l1d to d1/d4a/d6d/lda 0 2024-09-10T09:36:28.237 INFO:tasks.workunit.client.1.smithi135.stdout:4/702: truncate d1/db/d9/d55/d70/da4/fd2 1006827 0 2024-09-10T09:36:28.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/703: chown d1/db/d23/ca5 1 1 2024-09-10T09:36:28.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/704: chown d1/db/d9/d55/d70/lca 11003003 1 2024-09-10T09:36:28.238 INFO:tasks.workunit.client.1.smithi135.stdout:4/705: dread - d1/de/d16/fbc zero size 2024-09-10T09:36:28.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/567: creat de/df/d1d/d23/d25/fc1 x:0 0 0 2024-09-10T09:36:28.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/568: write de/df/f40 [721493,11413] 0 2024-09-10T09:36:28.242 INFO:tasks.workunit.client.1.smithi135.stdout:5/585: mknod d3/d91/db5/cc7 0 2024-09-10T09:36:28.244 INFO:tasks.workunit.client.1.smithi135.stdout:5/586: truncate d3/dc/f1c 963783 0 2024-09-10T09:36:28.245 INFO:tasks.workunit.client.1.smithi135.stdout:4/706: write d1/db/d9/fd0 [650647,120644] 0 2024-09-10T09:36:28.245 INFO:tasks.workunit.client.1.smithi135.stdout:4/707: creat d1/fdb x:0 0 0 2024-09-10T09:36:28.247 INFO:tasks.workunit.client.1.smithi135.stdout:5/587: unlink d3/dc/dba/dae/fb3 0 2024-09-10T09:36:28.247 INFO:tasks.workunit.client.1.smithi135.stdout:5/588: write d3/dc/f9b [1572,9443] 0 2024-09-10T09:36:28.247 INFO:tasks.workunit.client.1.smithi135.stdout:5/589: stat d3/dc/dba/d88 0 2024-09-10T09:36:28.250 INFO:tasks.workunit.client.1.smithi135.stdout:4/708: creat d1/d4a/d9d/da1/dd6/fdc x:0 0 0 2024-09-10T09:36:28.250 INFO:tasks.workunit.client.1.smithi135.stdout:4/709: chown d1/d4a/cb1 11954589 1 2024-09-10T09:36:28.250 INFO:tasks.workunit.client.1.smithi135.stdout:4/710: chown d1/de/d16/d8b/fcc 3559 1 2024-09-10T09:36:28.252 INFO:tasks.workunit.client.1.smithi135.stdout:5/590: unlink d3/dc/l9f 0 2024-09-10T09:36:28.252 INFO:tasks.workunit.client.1.smithi135.stdout:5/591: fdatasync d3/dc/d69/f73 0 2024-09-10T09:36:28.252 INFO:tasks.workunit.client.1.smithi135.stdout:5/592: dread - d3/dc/dba/d88/fa1 zero size 2024-09-10T09:36:28.253 INFO:tasks.workunit.client.1.smithi135.stdout:4/711: creat d1/d33/d40/fdd x:0 0 0 2024-09-10T09:36:28.256 INFO:tasks.workunit.client.1.smithi135.stdout:5/593: link d3/dc/dba/d48/d57/da3/f62 d3/d99/fc8 0 2024-09-10T09:36:28.259 INFO:tasks.workunit.client.1.smithi135.stdout:9/569: dwrite de/df/d1d/d1e/d68/f6f [0,4194304] 0 2024-09-10T09:36:28.259 INFO:tasks.workunit.client.1.smithi135.stdout:5/594: symlink d3/dc/dba/d48/lc9 0 2024-09-10T09:36:28.261 INFO:tasks.workunit.client.1.smithi135.stdout:9/570: creat de/df/d1d/d1e/d3f/dbb/fc2 x:0 0 0 2024-09-10T09:36:28.262 INFO:tasks.workunit.client.1.smithi135.stdout:5/595: mkdir d3/dc/dba/d48/d57/dca 0 2024-09-10T09:36:28.262 INFO:tasks.workunit.client.1.smithi135.stdout:5/596: dread - d3/dc/dba/d48/d57/f67 zero size 2024-09-10T09:36:28.266 INFO:tasks.workunit.client.1.smithi135.stdout:9/571: getdents de/df/d1d/d6b 0 2024-09-10T09:36:28.266 INFO:tasks.workunit.client.1.smithi135.stdout:9/572: fsync de/f21 0 2024-09-10T09:36:28.271 INFO:tasks.workunit.client.1.smithi135.stdout:4/712: dwrite d1/f19 [0,4194304] 0 2024-09-10T09:36:28.272 INFO:tasks.workunit.client.1.smithi135.stdout:9/573: rename de/df/d1d/c20 to de/df/d1d/d23/d25/d78/cc3 0 2024-09-10T09:36:28.272 INFO:tasks.workunit.client.1.smithi135.stdout:9/574: chown de/df/d1d/d1e/d68/f6f 73 1 2024-09-10T09:36:28.272 INFO:tasks.workunit.client.1.smithi135.stdout:9/575: chown de/df/d1d/d23/d25/d28/f37 30 1 2024-09-10T09:36:28.272 INFO:tasks.workunit.client.1.smithi135.stdout:9/576: stat de 0 2024-09-10T09:36:28.276 INFO:tasks.workunit.client.1.smithi135.stdout:4/713: truncate d1/d8a/fab 1015263 0 2024-09-10T09:36:28.277 INFO:tasks.workunit.client.1.smithi135.stdout:9/577: dread de/df/d1d/d23/f57 [0,4194304] 0 2024-09-10T09:36:28.280 INFO:tasks.workunit.client.1.smithi135.stdout:4/714: truncate d1/d8a/fae 1320383 0 2024-09-10T09:36:28.289 INFO:tasks.workunit.client.1.smithi135.stdout:5/597: dwrite d3/dc/dba/f68 [0,4194304] 0 2024-09-10T09:36:28.300 INFO:tasks.workunit.client.1.smithi135.stdout:4/715: dwrite d1/d33/d40/f7e [4194304,4194304] 0 2024-09-10T09:36:28.302 INFO:tasks.workunit.client.1.smithi135.stdout:9/578: getdents de/df/d1d/d23/d25 0 2024-09-10T09:36:28.304 INFO:tasks.workunit.client.1.smithi135.stdout:4/716: dread d1/db/d9/f7d [0,4194304] 0 2024-09-10T09:36:28.305 INFO:tasks.workunit.client.1.smithi135.stdout:5/598: mknod d3/dc/dba/d48/d57/ccb 0 2024-09-10T09:36:28.305 INFO:tasks.workunit.client.1.smithi135.stdout:5/599: truncate d3/fb0 961624 0 2024-09-10T09:36:28.316 INFO:tasks.workunit.client.1.smithi135.stdout:9/579: symlink de/lc4 0 2024-09-10T09:36:28.319 INFO:tasks.workunit.client.1.smithi135.stdout:4/717: rename d1/de/d16/d95/dc0 to d1/de/dde 0 2024-09-10T09:36:28.319 INFO:tasks.workunit.client.1.smithi135.stdout:5/600: rename d3 to d3/dc/d7a/db9/dcc 22 2024-09-10T09:36:28.327 INFO:tasks.workunit.client.1.smithi135.stdout:5/601: unlink d3/d81/ca5 0 2024-09-10T09:36:28.329 INFO:tasks.workunit.client.1.smithi135.stdout:5/602: dread d3/dc/d16/f34 [0,4194304] 0 2024-09-10T09:36:28.329 INFO:tasks.workunit.client.1.smithi135.stdout:5/603: stat d3/d81/d8d 0 2024-09-10T09:36:28.340 INFO:tasks.workunit.client.1.smithi135.stdout:9/580: rmdir de 39 2024-09-10T09:36:28.343 INFO:tasks.workunit.client.1.smithi135.stdout:4/718: rmdir d1/de/d16/d98 39 2024-09-10T09:36:28.343 INFO:tasks.workunit.client.1.smithi135.stdout:4/719: write d1/de/d16/fbc [28574,128189] 0 2024-09-10T09:36:28.346 INFO:tasks.workunit.client.1.smithi135.stdout:5/604: unlink d3/dc/dba/d48/d57/f7c 0 2024-09-10T09:36:28.347 INFO:tasks.workunit.client.1.smithi135.stdout:9/581: truncate de/df/d1d/d6b/fa5 26816 0 2024-09-10T09:36:28.348 INFO:tasks.workunit.client.1.smithi135.stdout:4/720: symlink d1/d85/ldf 0 2024-09-10T09:36:28.349 INFO:tasks.workunit.client.1.smithi135.stdout:4/721: readlink d1/l58 0 2024-09-10T09:36:28.350 INFO:tasks.workunit.client.1.smithi135.stdout:9/582: dread de/df/d1d/d23/d25/f74 [0,4194304] 0 2024-09-10T09:36:28.350 INFO:tasks.workunit.client.1.smithi135.stdout:9/583: write de/df/d1d/fb2 [391625,75135] 0 2024-09-10T09:36:28.351 INFO:tasks.workunit.client.1.smithi135.stdout:5/605: mknod d3/dc/dba/d48/d57/da9/ccd 0 2024-09-10T09:36:28.353 INFO:tasks.workunit.client.1.smithi135.stdout:4/722: rename d1/de/d16/l88 to d1/d4a/d9d/da1/le0 0 2024-09-10T09:36:28.354 INFO:tasks.workunit.client.1.smithi135.stdout:9/584: mknod de/df/d1d/d1e/db5/d88/cc5 0 2024-09-10T09:36:28.354 INFO:tasks.workunit.client.1.smithi135.stdout:9/585: truncate de/df/d1d/f8b 454655 0 2024-09-10T09:36:28.365 INFO:tasks.workunit.client.1.smithi135.stdout:9/586: write de/df/f3d [1920926,59435] 0 2024-09-10T09:36:28.368 INFO:tasks.workunit.client.1.smithi135.stdout:5/606: getdents d3/dc 0 2024-09-10T09:36:28.370 INFO:tasks.workunit.client.1.smithi135.stdout:5/607: rename d3/d81/fa7 to d3/dc/dba/dae/fce 0 2024-09-10T09:36:28.372 INFO:tasks.workunit.client.1.smithi135.stdout:4/723: dwrite d1/de/f34 [0,4194304] 0 2024-09-10T09:36:28.372 INFO:tasks.workunit.client.1.smithi135.stdout:4/724: fdatasync d1/de/d16/d8b/fcc 0 2024-09-10T09:36:28.379 INFO:tasks.workunit.client.1.smithi135.stdout:9/587: dread de/df/d1d/d23/d25/d28/f37 [0,4194304] 0 2024-09-10T09:36:28.379 INFO:tasks.workunit.client.1.smithi135.stdout:9/588: write de/df/d1d/d23/d25/d28/f4c [3051249,105787] 0 2024-09-10T09:36:28.381 INFO:tasks.workunit.client.1.smithi135.stdout:5/608: getdents d3/dc/dba/d93 0 2024-09-10T09:36:28.384 INFO:tasks.workunit.client.1.smithi135.stdout:4/725: mknod d1/de/d16/d98/ce1 0 2024-09-10T09:36:28.386 INFO:tasks.workunit.client.1.smithi135.stdout:9/589: mkdir de/df/d1d/d1e/db5/d88/dc6 0 2024-09-10T09:36:28.386 INFO:tasks.workunit.client.1.smithi135.stdout:9/590: write de/df/f13 [1306425,70136] 0 2024-09-10T09:36:28.387 INFO:tasks.workunit.client.1.smithi135.stdout:4/726: creat d1/db/d9/d55/d7b/fe2 x:0 0 0 2024-09-10T09:36:28.388 INFO:tasks.workunit.client.1.smithi135.stdout:9/591: rename de/f17 to de/df/d1d/fc7 0 2024-09-10T09:36:28.389 INFO:tasks.workunit.client.1.smithi135.stdout:5/609: dread d3/dc/d16/f45 [0,4194304] 0 2024-09-10T09:36:28.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/727: dread d1/db/d9/f7d [0,4194304] 0 2024-09-10T09:36:28.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/728: chown d1/d8a 6785653 1 2024-09-10T09:36:28.392 INFO:tasks.workunit.client.1.smithi135.stdout:4/729: truncate d1/d8a/fae 2061460 0 2024-09-10T09:36:28.401 INFO:tasks.workunit.client.1.smithi135.stdout:9/592: dread de/df/d1d/d1e/d68/d9f/fa1 [0,4194304] 0 2024-09-10T09:36:28.407 INFO:tasks.workunit.client.1.smithi135.stdout:5/610: dwrite d3/dc/dba/d88/fc3 [0,4194304] 0 2024-09-10T09:36:28.410 INFO:tasks.workunit.client.1.smithi135.stdout:5/611: link d3/d81/d8d/fa8 d3/dc/dba/d88/fcf 0 2024-09-10T09:36:28.414 INFO:tasks.workunit.client.1.smithi135.stdout:5/612: rename d3/d44/d8a to d3/dc/dba/d4e/dd0 0 2024-09-10T09:36:28.414 INFO:tasks.workunit.client.1.smithi135.stdout:5/613: truncate d3/d44/f9a 998598 0 2024-09-10T09:36:28.414 INFO:tasks.workunit.client.1.smithi135.stdout:5/614: stat d3/dc/d16/l82 0 2024-09-10T09:36:28.414 INFO:tasks.workunit.client.1.smithi135.stdout:9/593: write de/df/d1d/d23/d25/d28/d4e/f73 [2650640,76327] 0 2024-09-10T09:36:28.414 INFO:tasks.workunit.client.1.smithi135.stdout:9/594: dread - de/df/d1d/d1e/db5/d88/f89 zero size 2024-09-10T09:36:28.414 INFO:tasks.workunit.client.1.smithi135.stdout:4/730: dwrite d1/db/d9/f32 [4194304,4194304] 0 2024-09-10T09:36:28.418 INFO:tasks.workunit.client.1.smithi135.stdout:5/615: creat d3/dc/dba/fd1 x:0 0 0 2024-09-10T09:36:28.421 INFO:tasks.workunit.client.1.smithi135.stdout:5/616: mkdir d3/dc/dba/d48/dd2 0 2024-09-10T09:36:28.427 INFO:tasks.workunit.client.1.smithi135.stdout:5/617: mknod d3/dc/dba/dbf/cd3 0 2024-09-10T09:36:28.431 INFO:tasks.workunit.client.1.smithi135.stdout:5/618: unlink d3/dc/dba/f3c 0 2024-09-10T09:36:28.432 INFO:tasks.workunit.client.1.smithi135.stdout:5/619: chown d3/d44/l28 14409476 1 2024-09-10T09:36:28.432 INFO:tasks.workunit.client.1.smithi135.stdout:9/595: dwrite de/df/d1d/d1e/d68/d9f/fa1 [0,4194304] 0 2024-09-10T09:36:28.437 INFO:tasks.workunit.client.1.smithi135.stdout:5/620: dread d3/dc/f9b [0,4194304] 0 2024-09-10T09:36:28.438 INFO:tasks.workunit.client.1.smithi135.stdout:5/621: creat d3/dc/dba/d48/d57/da9/fd4 x:0 0 0 2024-09-10T09:36:28.441 INFO:tasks.workunit.client.1.smithi135.stdout:5/622: symlink d3/d99/ld5 0 2024-09-10T09:36:28.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/623: link d3/dc/dba/d88/fa1 d3/fd6 0 2024-09-10T09:36:28.455 INFO:tasks.workunit.client.1.smithi135.stdout:9/596: dwrite de/df/d1d/d23/f27 [0,4194304] 0 2024-09-10T09:36:28.458 INFO:tasks.workunit.client.1.smithi135.stdout:9/597: rename de/df/d1d/d1e/d68/fa6 to de/df/d1d/d1e/d52/fc8 0 2024-09-10T09:36:28.458 INFO:tasks.workunit.client.1.smithi135.stdout:9/598: write de/df/d1d/d23/d25/f48 [282583,10737] 0 2024-09-10T09:36:28.459 INFO:tasks.workunit.client.1.smithi135.stdout:9/599: truncate de/df/d1d/d6b/fa5 660118 0 2024-09-10T09:36:28.461 INFO:tasks.workunit.client.1.smithi135.stdout:5/624: dwrite d3/dc/dba/d48/d57/f67 [0,4194304] 0 2024-09-10T09:36:28.522 INFO:tasks.workunit.client.1.smithi135.stdout:2/604: sync 2024-09-10T09:36:28.605 INFO:tasks.workunit.client.1.smithi135.stdout:5/625: symlink d3/dc/dba/d4e/dd0/ld7 0 2024-09-10T09:36:28.605 INFO:tasks.workunit.client.1.smithi135.stdout:5/626: dread - d3/dc/dba/d88/fcf zero size 2024-09-10T09:36:28.607 INFO:tasks.workunit.client.1.smithi135.stdout:2/605: rename df/d13/f1d to df/d1b/d23/fc3 0 2024-09-10T09:36:28.617 INFO:tasks.workunit.client.1.smithi135.stdout:5/627: creat d3/d91/db5/fd8 x:0 0 0 2024-09-10T09:36:28.619 INFO:tasks.workunit.client.1.smithi135.stdout:2/606: link df/d1b/d23/d98/d5f/d2c/f2e df/d13/d4f/d95/fc4 0 2024-09-10T09:36:28.621 INFO:tasks.workunit.client.1.smithi135.stdout:2/607: dread df/d1b/d23/d98/d5f/d3d/f5b [0,4194304] 0 2024-09-10T09:36:28.621 INFO:tasks.workunit.client.1.smithi135.stdout:5/628: mknod d3/dc/dba/d48/d57/dca/cd9 0 2024-09-10T09:36:28.643 INFO:tasks.workunit.client.1.smithi135.stdout:2/608: dwrite df/d1b/d23/d98/d5f/d3d/d87/fa3 [4194304,4194304] 0 2024-09-10T09:36:28.644 INFO:tasks.workunit.client.1.smithi135.stdout:5/629: dwrite d3/dc/d16/dc0/fc5 [0,4194304] 0 2024-09-10T09:36:28.649 INFO:tasks.workunit.client.1.smithi135.stdout:5/630: mknod d3/dc/dba/dae/cda 0 2024-09-10T09:36:28.652 INFO:tasks.workunit.client.1.smithi135.stdout:2/609: dread df/d1b/f3c [0,4194304] 0 2024-09-10T09:36:28.654 INFO:tasks.workunit.client.1.smithi135.stdout:2/610: creat df/d1b/d31/fc5 x:0 0 0 2024-09-10T09:36:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:2/611: mknod df/d1b/d23/d98/d5f/d3d/d87/cc6 0 2024-09-10T09:36:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:2/612: stat df/d1b/f5c 0 2024-09-10T09:36:28.657 INFO:tasks.workunit.client.1.smithi135.stdout:2/613: chown df/d15 6074436 1 2024-09-10T09:36:28.665 INFO:tasks.workunit.client.1.smithi135.stdout:2/614: write df/d13/d52/f58 [349544,34407] 0 2024-09-10T09:36:28.666 INFO:tasks.workunit.client.1.smithi135.stdout:5/631: dwrite d3/d71/f5a [0,4194304] 0 2024-09-10T09:36:28.666 INFO:tasks.workunit.client.1.smithi135.stdout:5/632: dread - d3/fd6 zero size 2024-09-10T09:36:28.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/615: mknod df/d13/d4f/cc7 0 2024-09-10T09:36:28.667 INFO:tasks.workunit.client.1.smithi135.stdout:2/616: readlink df/d1b/d23/d98/d5f/d3d/l94 0 2024-09-10T09:36:28.667 INFO:tasks.workunit.client.1.smithi135.stdout:2/617: fdatasync df/d1b/d23/d98/d5f/f89 0 2024-09-10T09:36:28.667 INFO:tasks.workunit.client.1.smithi135.stdout:2/618: write df/d1b/d23/d98/d5f/d2c/d7d/fa5 [115589,33297] 0 2024-09-10T09:36:28.668 INFO:tasks.workunit.client.1.smithi135.stdout:2/619: creat df/d13/d4f/d95/d97/fc8 x:0 0 0 2024-09-10T09:36:28.668 INFO:tasks.workunit.client.1.smithi135.stdout:2/620: chown f8 1324431 1 2024-09-10T09:36:28.678 INFO:tasks.workunit.client.1.smithi135.stdout:3/416: sync 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:7/474: sync 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:0/545: sync 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:8/488: sync 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:7/475: write d2/d15/f2d [2345338,34981] 0 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/714: sync 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/715: chown d5/dd/da3/faf 16782 1 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/716: truncate d5/d1e/d62/fb7 1600546 0 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:2/621: dread df/d1b/d23/d98/d5f/d3d/d87/fa3 [4194304,4194304] 0 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/717: write d5/d1e/d3b/d42/d2d/fc2 [4860459,122889] 0 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/718: chown d5/f6 6134874 1 2024-09-10T09:36:28.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/719: fsync d5/d15/d27/f3d 0 2024-09-10T09:36:28.686 INFO:tasks.workunit.client.1.smithi135.stdout:3/417: unlink d4/d5/db/f78 0 2024-09-10T09:36:28.687 INFO:tasks.workunit.client.1.smithi135.stdout:3/418: dread d4/d5/dc/f69 [0,4194304] 0 2024-09-10T09:36:28.691 INFO:tasks.workunit.client.1.smithi135.stdout:8/489: mknod d1/d15/d16/d33/d45/d6f/ca5 0 2024-09-10T09:36:28.692 INFO:tasks.workunit.client.1.smithi135.stdout:7/476: link d2/d15/d41/d49/d52/c56 d2/d15/c9c 0 2024-09-10T09:36:28.692 INFO:tasks.workunit.client.1.smithi135.stdout:7/477: write d2/d15/d4a/d36/f78 [119823,6069] 0 2024-09-10T09:36:28.693 INFO:tasks.workunit.client.1.smithi135.stdout:2/622: dwrite f6 [0,4194304] 0 2024-09-10T09:36:28.694 INFO:tasks.workunit.client.1.smithi135.stdout:6/720: creat d5/d15/d56/fed x:0 0 0 2024-09-10T09:36:28.695 INFO:tasks.workunit.client.1.smithi135.stdout:3/419: creat d4/f7b x:0 0 0 2024-09-10T09:36:28.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/721: dread d5/d1e/d35/f4b [0,4194304] 0 2024-09-10T09:36:28.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/722: fsync d5/d1e/d35/f83 0 2024-09-10T09:36:28.697 INFO:tasks.workunit.client.1.smithi135.stdout:6/723: chown d5/c40 18 1 2024-09-10T09:36:28.698 INFO:tasks.workunit.client.1.smithi135.stdout:0/546: creat d8/dd/d18/d3d/fb2 x:0 0 0 2024-09-10T09:36:28.703 INFO:tasks.workunit.client.1.smithi135.stdout:2/623: rename df/d1b/f26 to df/d13/d4f/d95/d97/fc9 0 2024-09-10T09:36:28.706 INFO:tasks.workunit.client.1.smithi135.stdout:3/420: dread d4/d5/db/f3a [0,4194304] 0 2024-09-10T09:36:28.713 INFO:tasks.workunit.client.1.smithi135.stdout:8/490: rmdir d1/d15/d16/d33/d45 39 2024-09-10T09:36:28.714 INFO:tasks.workunit.client.1.smithi135.stdout:7/478: mkdir d2/d25/d9d 0 2024-09-10T09:36:28.715 INFO:tasks.workunit.client.1.smithi135.stdout:7/479: chown d2/d15/d4a/d36/c7b 5578 1 2024-09-10T09:36:28.716 INFO:tasks.workunit.client.1.smithi135.stdout:3/421: mknod d4/d5/d56/c7c 0 2024-09-10T09:36:28.717 INFO:tasks.workunit.client.1.smithi135.stdout:0/547: symlink d8/lb3 0 2024-09-10T09:36:28.718 INFO:tasks.workunit.client.1.smithi135.stdout:0/548: truncate d8/d1c/d61/f8a 145667 0 2024-09-10T09:36:28.718 INFO:tasks.workunit.client.1.smithi135.stdout:3/422: dread d4/d55/d5d/d5b/f6f [0,4194304] 0 2024-09-10T09:36:28.718 INFO:tasks.workunit.client.1.smithi135.stdout:3/423: readlink d4/d5/db/d36/d43/l59 0 2024-09-10T09:36:28.723 INFO:tasks.workunit.client.1.smithi135.stdout:8/491: creat d1/d15/fa6 x:0 0 0 2024-09-10T09:36:28.725 INFO:tasks.workunit.client.1.smithi135.stdout:3/424: unlink d4/d55/d5d/d5b/f6f 0 2024-09-10T09:36:28.727 INFO:tasks.workunit.client.1.smithi135.stdout:6/724: dwrite d5/dd/d50/db3/fdc [0,4194304] 0 2024-09-10T09:36:28.727 INFO:tasks.workunit.client.1.smithi135.stdout:6/725: chown d5/dd/d50/d54/fad 44788453 1 2024-09-10T09:36:28.727 INFO:tasks.workunit.client.1.smithi135.stdout:6/726: write d5/fbb [4451846,6953] 0 2024-09-10T09:36:28.727 INFO:tasks.workunit.client.1.smithi135.stdout:6/727: chown d5/d1e 3428 1 2024-09-10T09:36:28.727 INFO:tasks.workunit.client.1.smithi135.stdout:6/728: write d5/d1e/d3b/d42/d2d/d8f/fbd [188451,43305] 0 2024-09-10T09:36:28.729 INFO:tasks.workunit.client.1.smithi135.stdout:8/492: mkdir d1/d27/d3d/d94/da7 0 2024-09-10T09:36:28.729 INFO:tasks.workunit.client.1.smithi135.stdout:8/493: read - d1/d15/fa6 zero size 2024-09-10T09:36:28.729 INFO:tasks.workunit.client.1.smithi135.stdout:8/494: truncate d1/d13/f2f 194516 0 2024-09-10T09:36:28.730 INFO:tasks.workunit.client.1.smithi135.stdout:7/480: dread d2/d15/d41/d49/d60/d30/d71/f92 [0,4194304] 0 2024-09-10T09:36:28.731 INFO:tasks.workunit.client.1.smithi135.stdout:8/495: dread d1/d15/d24/f2d [0,4194304] 0 2024-09-10T09:36:28.731 INFO:tasks.workunit.client.1.smithi135.stdout:8/496: truncate d1/d15/f19 4876090 0 2024-09-10T09:36:28.733 INFO:tasks.workunit.client.1.smithi135.stdout:8/497: write d1/d15/d49/f85 [324144,82024] 0 2024-09-10T09:36:28.733 INFO:tasks.workunit.client.1.smithi135.stdout:8/498: stat d1/f23 0 2024-09-10T09:36:28.733 INFO:tasks.workunit.client.1.smithi135.stdout:2/624: dwrite df/d1b/d23/db6/fbd [0,4194304] 0 2024-09-10T09:36:28.733 INFO:tasks.workunit.client.1.smithi135.stdout:2/625: readlink df/d1b/d23/d98/d5f/d2c/d7d/la2 0 2024-09-10T09:36:28.733 INFO:tasks.workunit.client.1.smithi135.stdout:2/626: creat df/d15/fca x:0 0 0 2024-09-10T09:36:28.733 INFO:tasks.workunit.client.1.smithi135.stdout:3/425: creat d4/d5/d51/f7d x:0 0 0 2024-09-10T09:36:28.735 INFO:tasks.workunit.client.1.smithi135.stdout:6/729: creat d5/dd/d50/d86/dcd/fee x:0 0 0 2024-09-10T09:36:28.735 INFO:tasks.workunit.client.1.smithi135.stdout:6/730: chown d5/d15/l9a 1862787 1 2024-09-10T09:36:28.735 INFO:tasks.workunit.client.1.smithi135.stdout:6/731: fsync d5/d1e/d35/f9b 0 2024-09-10T09:36:28.735 INFO:tasks.workunit.client.1.smithi135.stdout:6/732: chown d5/dd/c2b 31694079 1 2024-09-10T09:36:28.735 INFO:tasks.workunit.client.1.smithi135.stdout:8/499: getdents d1/d15/d24 0 2024-09-10T09:36:28.743 INFO:tasks.workunit.client.1.smithi135.stdout:0/549: dwrite d8/dd/d11/d17/fa6 [0,4194304] 0 2024-09-10T09:36:28.745 INFO:tasks.workunit.client.1.smithi135.stdout:6/733: mkdir d5/d1e/d62/d8a/def 0 2024-09-10T09:36:28.750 INFO:tasks.workunit.client.1.smithi135.stdout:2/627: mkdir df/d1b/d23/d98/dcb 0 2024-09-10T09:36:28.752 INFO:tasks.workunit.client.1.smithi135.stdout:8/500: dwrite d1/f23 [4194304,4194304] 0 2024-09-10T09:36:28.752 INFO:tasks.workunit.client.1.smithi135.stdout:8/501: write d1/d15/d16/f61 [719115,61467] 0 2024-09-10T09:36:28.756 INFO:tasks.workunit.client.1.smithi135.stdout:0/550: creat d8/dd/db0/fb4 x:0 0 0 2024-09-10T09:36:28.756 INFO:tasks.workunit.client.1.smithi135.stdout:0/551: stat d8/dd/d1e/f6e 0 2024-09-10T09:36:28.757 INFO:tasks.workunit.client.1.smithi135.stdout:0/552: creat d8/d1c/d8f/fb5 x:0 0 0 2024-09-10T09:36:28.757 INFO:tasks.workunit.client.1.smithi135.stdout:0/553: write d8/d1c/d37/f64 [2233407,112761] 0 2024-09-10T09:36:28.758 INFO:tasks.workunit.client.1.smithi135.stdout:3/426: getdents d4/d5/db 0 2024-09-10T09:36:28.760 INFO:tasks.workunit.client.1.smithi135.stdout:6/734: link d5/d1e/l4e d5/d15/lf0 0 2024-09-10T09:36:28.761 INFO:tasks.workunit.client.1.smithi135.stdout:8/502: truncate d1/f20 2601717 0 2024-09-10T09:36:28.765 INFO:tasks.workunit.client.1.smithi135.stdout:0/554: mkdir d8/d1c/d37/d73/d88/db6 0 2024-09-10T09:36:28.765 INFO:tasks.workunit.client.1.smithi135.stdout:0/555: fdatasync d8/f86 0 2024-09-10T09:36:28.766 INFO:tasks.workunit.client.1.smithi135.stdout:3/427: creat d4/d5/d56/f7e x:0 0 0 2024-09-10T09:36:28.767 INFO:tasks.workunit.client.1.smithi135.stdout:6/735: getdents d5/dd/d50/d54/da9/de4 0 2024-09-10T09:36:28.769 INFO:tasks.workunit.client.1.smithi135.stdout:8/503: symlink d1/d15/d49/d69/la8 0 2024-09-10T09:36:28.777 INFO:tasks.workunit.client.1.smithi135.stdout:0/556: link f4 d8/d1c/d37/d73/fb7 0 2024-09-10T09:36:28.784 INFO:tasks.workunit.client.1.smithi135.stdout:3/428: rename d4/d5/d51/c77 to d4/d5/d76/c7f 0 2024-09-10T09:36:28.785 INFO:tasks.workunit.client.1.smithi135.stdout:6/736: mkdir d5/d15/df1 0 2024-09-10T09:36:28.788 INFO:tasks.workunit.client.1.smithi135.stdout:8/504: dread d1/d13/f2f [0,4194304] 0 2024-09-10T09:36:28.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/557: creat d8/dd/d11/d90/fb8 x:0 0 0 2024-09-10T09:36:28.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/558: dread - d8/d1c/d37/d9c/f9d zero size 2024-09-10T09:36:28.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/559: fdatasync d8/dd/d11/fa9 0 2024-09-10T09:36:28.790 INFO:tasks.workunit.client.1.smithi135.stdout:3/429: creat d4/d5/f80 x:0 0 0 2024-09-10T09:36:28.796 INFO:tasks.workunit.client.1.smithi135.stdout:0/560: unlink f4 0 2024-09-10T09:36:28.798 INFO:tasks.workunit.client.1.smithi135.stdout:3/430: mknod d4/d5/db/d36/c81 0 2024-09-10T09:36:28.798 INFO:tasks.workunit.client.1.smithi135.stdout:3/431: write d4/d5/db/d44/f4e [349150,53077] 0 2024-09-10T09:36:28.799 INFO:tasks.workunit.client.1.smithi135.stdout:0/561: mkdir d8/d1c/d37/d73/d7f/d8c/da8/db9 0 2024-09-10T09:36:28.802 INFO:tasks.workunit.client.1.smithi135.stdout:3/432: creat d4/d5/db/d36/d6a/f82 x:0 0 0 2024-09-10T09:36:28.805 INFO:tasks.workunit.client.1.smithi135.stdout:0/562: symlink d8/d1c/d37/d73/d88/db6/lba 0 2024-09-10T09:36:28.807 INFO:tasks.workunit.client.1.smithi135.stdout:0/563: mknod d8/dd/d4a/d50/cbb 0 2024-09-10T09:36:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:8/505: dwrite d1/d13/f5c [0,4194304] 0 2024-09-10T09:36:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:6/737: dwrite d5/d1e/d3b/d42/d3c/f59 [0,4194304] 0 2024-09-10T09:36:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:6/738: write d5/d15/d27/f52 [66696,31534] 0 2024-09-10T09:36:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:6/739: readlink d5/l9 0 2024-09-10T09:36:28.810 INFO:tasks.workunit.client.1.smithi135.stdout:6/740: write d5/d1e/d3b/d42/f2a [5056316,10744] 0 2024-09-10T09:36:28.813 INFO:tasks.workunit.client.1.smithi135.stdout:3/433: dread d4/d5/dc/f49 [0,4194304] 0 2024-09-10T09:36:28.815 INFO:tasks.workunit.client.1.smithi135.stdout:8/506: mkdir d1/d15/d16/d99/da9 0 2024-09-10T09:36:28.820 INFO:tasks.workunit.client.1.smithi135.stdout:8/507: rename d1/d27/d3d/l4a to d1/d15/d16/d33/laa 0 2024-09-10T09:36:28.823 INFO:tasks.workunit.client.1.smithi135.stdout:6/741: rmdir d5/d1e/d35 39 2024-09-10T09:36:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:8/508: mkdir d1/d13/dab 0 2024-09-10T09:36:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:3/434: dread d4/f4d [0,4194304] 0 2024-09-10T09:36:28.825 INFO:tasks.workunit.client.1.smithi135.stdout:3/435: chown d4/d5/dc/f69 977 1 2024-09-10T09:36:28.827 INFO:tasks.workunit.client.1.smithi135.stdout:6/742: mkdir d5/d1e/d3b/d74/deb/df2 0 2024-09-10T09:36:28.830 INFO:tasks.workunit.client.1.smithi135.stdout:6/743: mknod d5/dd/d50/d54/db9/cf3 0 2024-09-10T09:36:28.830 INFO:tasks.workunit.client.1.smithi135.stdout:6/744: write d5/d1e/d3b/d42/d3c/f47 [3090955,110605] 0 2024-09-10T09:36:28.832 INFO:tasks.workunit.client.1.smithi135.stdout:3/436: dread d4/f3b [0,4194304] 0 2024-09-10T09:36:28.833 INFO:tasks.workunit.client.1.smithi135.stdout:6/745: mkdir d5/de8/df4 0 2024-09-10T09:36:28.833 INFO:tasks.workunit.client.1.smithi135.stdout:6/746: chown d5/dd/d50/d54/db9/fd1 6428073 1 2024-09-10T09:36:28.833 INFO:tasks.workunit.client.1.smithi135.stdout:6/747: creat d5/d1e/d3b/d42/d2d/d8f/ff5 x:0 0 0 2024-09-10T09:36:28.835 INFO:tasks.workunit.client.1.smithi135.stdout:3/437: symlink d4/d5/d56/l83 0 2024-09-10T09:36:28.835 INFO:tasks.workunit.client.1.smithi135.stdout:3/438: chown d4/d55/d5d/l5a 455522 1 2024-09-10T09:36:28.835 INFO:tasks.workunit.client.1.smithi135.stdout:3/439: chown d4/d5/db/dd/l21 5531527 1 2024-09-10T09:36:28.836 INFO:tasks.workunit.client.1.smithi135.stdout:8/509: dread d1/f3 [0,4194304] 0 2024-09-10T09:36:28.837 INFO:tasks.workunit.client.1.smithi135.stdout:8/510: dread - d1/d15/d49/f81 zero size 2024-09-10T09:36:28.841 INFO:tasks.workunit.client.1.smithi135.stdout:6/748: symlink d5/d1e/d3b/d42/d3c/de2/lf6 0 2024-09-10T09:36:28.846 INFO:tasks.workunit.client.1.smithi135.stdout:3/440: getdents d4/d5/db/dd/d79 0 2024-09-10T09:36:28.847 INFO:tasks.workunit.client.1.smithi135.stdout:8/511: creat d1/d15/d16/d33/d45/d6f/fac x:0 0 0 2024-09-10T09:36:28.857 INFO:tasks.workunit.client.1.smithi135.stdout:8/512: write d1/d15/d16/d33/d45/d70/f93 [1622381,46633] 0 2024-09-10T09:36:28.865 INFO:tasks.workunit.client.1.smithi135.stdout:8/513: dread d1/f7 [4194304,4194304] 0 2024-09-10T09:36:28.888 INFO:tasks.workunit.client.1.smithi135.stdout:8/514: dwrite d1/d15/d24/f3f [0,4194304] 0 2024-09-10T09:36:28.937 INFO:tasks.workunit.client.1.smithi135.stdout:3/441: rename d4/d5/dc/c4f to d4/d5/dc/d71/c84 0 2024-09-10T09:36:28.938 INFO:tasks.workunit.client.1.smithi135.stdout:3/442: stat d4/d55/d5d/d5b/f6c 0 2024-09-10T09:36:28.938 INFO:tasks.workunit.client.1.smithi135.stdout:6/749: getdents d5/d15 0 2024-09-10T09:36:28.945 INFO:tasks.workunit.client.1.smithi135.stdout:8/515: rename d1/d15/d49/f85 to d1/fad 0 2024-09-10T09:36:28.945 INFO:tasks.workunit.client.1.smithi135.stdout:8/516: truncate d1/d15/d16/f75 5177218 0 2024-09-10T09:36:28.945 INFO:tasks.workunit.client.1.smithi135.stdout:8/517: creat d1/d13/fae x:0 0 0 2024-09-10T09:36:28.946 INFO:tasks.workunit.client.1.smithi135.stdout:3/443: creat d4/d5/db/dd/d79/f85 x:0 0 0 2024-09-10T09:36:28.947 INFO:tasks.workunit.client.1.smithi135.stdout:6/750: unlink d5/d1e/d3b/fe9 0 2024-09-10T09:36:28.947 INFO:tasks.workunit.client.1.smithi135.stdout:6/751: write d5/dd/f92 [937464,58594] 0 2024-09-10T09:36:28.949 INFO:tasks.workunit.client.1.smithi135.stdout:3/444: truncate d4/d5/dc/f17 2515492 0 2024-09-10T09:36:28.952 INFO:tasks.workunit.client.1.smithi135.stdout:6/752: dread d5/f6 [0,4194304] 0 2024-09-10T09:36:28.955 INFO:tasks.workunit.client.1.smithi135.stdout:3/445: dread d4/d5/db/d36/d43/f46 [0,4194304] 0 2024-09-10T09:36:28.956 INFO:tasks.workunit.client.1.smithi135.stdout:8/518: dread d1/d15/d16/d33/d39/f7d [0,4194304] 0 2024-09-10T09:36:28.956 INFO:tasks.workunit.client.1.smithi135.stdout:3/446: rmdir d4/d5/dc/d71 39 2024-09-10T09:36:28.959 INFO:tasks.workunit.client.1.smithi135.stdout:8/519: dread d1/d15/d16/f1a [0,4194304] 0 2024-09-10T09:36:28.962 INFO:tasks.workunit.client.1.smithi135.stdout:8/520: dread d1/d13/f95 [0,4194304] 0 2024-09-10T09:36:28.962 INFO:tasks.workunit.client.1.smithi135.stdout:8/521: dread - d1/d13/fae zero size 2024-09-10T09:36:28.962 INFO:tasks.workunit.client.1.smithi135.stdout:8/522: fdatasync d1/f14 0 2024-09-10T09:36:28.962 INFO:tasks.workunit.client.1.smithi135.stdout:8/523: stat d1/d15/l30 0 2024-09-10T09:36:28.963 INFO:tasks.workunit.client.1.smithi135.stdout:8/524: chown d1/d15/l67 2503 1 2024-09-10T09:36:28.963 INFO:tasks.workunit.client.1.smithi135.stdout:6/753: read d5/dd/d50/db3/fdc [303812,75398] 0 2024-09-10T09:36:28.966 INFO:tasks.workunit.client.1.smithi135.stdout:3/447: dread d4/d5/dc/f10 [0,4194304] 0 2024-09-10T09:36:28.966 INFO:tasks.workunit.client.1.smithi135.stdout:3/448: creat d4/d5/d51/f86 x:0 0 0 2024-09-10T09:36:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/449: dread d4/f9 [0,4194304] 0 2024-09-10T09:36:28.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/450: fdatasync d4/d5/db/dd/d79/f41 0 2024-09-10T09:36:28.976 INFO:tasks.workunit.client.1.smithi135.stdout:6/754: fsync d5/d1e/d3b/d42/d2d/d8f/ff5 0 2024-09-10T09:36:28.980 INFO:tasks.workunit.client.1.smithi135.stdout:6/755: rmdir d5/de8/df4 0 2024-09-10T09:36:28.980 INFO:tasks.workunit.client.1.smithi135.stdout:6/756: stat d5/d1e/d3b/d42 0 2024-09-10T09:36:28.989 INFO:tasks.workunit.client.1.smithi135.stdout:6/757: write d5/fbb [3305521,73397] 0 2024-09-10T09:36:28.991 INFO:tasks.workunit.client.1.smithi135.stdout:6/758: creat d5/d15/ff7 x:0 0 0 2024-09-10T09:36:28.996 INFO:tasks.workunit.client.1.smithi135.stdout:6/759: link d5/d1e/c4d d5/d1e/d3b/d42/d2d/cf8 0 2024-09-10T09:36:28.999 INFO:tasks.workunit.client.1.smithi135.stdout:6/760: creat d5/dd/d50/d54/da9/de4/ff9 x:0 0 0 2024-09-10T09:36:29.002 INFO:tasks.workunit.client.1.smithi135.stdout:6/761: creat d5/d15/ddf/ffa x:0 0 0 2024-09-10T09:36:29.008 INFO:tasks.workunit.client.1.smithi135.stdout:6/762: stat d5/d1e/d3b/d42/d2d/cf8 0 2024-09-10T09:36:29.008 INFO:tasks.workunit.client.1.smithi135.stdout:6/763: truncate d5/d1e/d3b/f77 9070245 0 2024-09-10T09:36:29.008 INFO:tasks.workunit.client.1.smithi135.stdout:1/656: sync 2024-09-10T09:36:29.012 INFO:tasks.workunit.client.1.smithi135.stdout:1/657: rename d1d/d20/d6c/f74 to d1d/d20/d52/d8a/dc2/dca/d2b/da8/fd0 0 2024-09-10T09:36:29.012 INFO:tasks.workunit.client.1.smithi135.stdout:1/658: fsync d1d/d28/d4b/d53/f8d 0 2024-09-10T09:36:29.021 INFO:tasks.workunit.client.1.smithi135.stdout:6/764: dread d5/d1e/d3b/d42/d3c/f59 [0,4194304] 0 2024-09-10T09:36:29.021 INFO:tasks.workunit.client.1.smithi135.stdout:6/765: write d5/f17 [4791544,28188] 0 2024-09-10T09:36:29.034 INFO:tasks.workunit.client.1.smithi135.stdout:6/766: dread d5/f7 [0,4194304] 0 2024-09-10T09:36:29.034 INFO:tasks.workunit.client.1.smithi135.stdout:6/767: chown d5/dd/d50/d54/fad 8 1 2024-09-10T09:36:29.039 INFO:tasks.workunit.client.1.smithi135.stdout:8/525: write d1/f3 [4772236,99668] 0 2024-09-10T09:36:29.042 INFO:tasks.workunit.client.1.smithi135.stdout:8/526: mknod d1/d15/d16/d33/d45/d6f/caf 0 2024-09-10T09:36:29.046 INFO:tasks.workunit.client.1.smithi135.stdout:6/768: dread d5/d1e/d3b/d42/d2d/fc2 [0,4194304] 0 2024-09-10T09:36:29.046 INFO:tasks.workunit.client.1.smithi135.stdout:6/769: write d5/d1e/d3b/d42/d3c/d44/f76 [1482381,101771] 0 2024-09-10T09:36:29.046 INFO:tasks.workunit.client.1.smithi135.stdout:6/770: write d5/f6b [3963293,125626] 0 2024-09-10T09:36:29.048 INFO:tasks.workunit.client.1.smithi135.stdout:8/527: rename d1/l72 to d1/d15/d16/d33/d45/d6f/lb0 0 2024-09-10T09:36:29.048 INFO:tasks.workunit.client.1.smithi135.stdout:8/528: write d1/d15/d24/f35 [837078,117518] 0 2024-09-10T09:36:29.049 INFO:tasks.workunit.client.1.smithi135.stdout:6/771: creat d5/dd/d50/ffb x:0 0 0 2024-09-10T09:36:29.054 INFO:tasks.workunit.client.1.smithi135.stdout:6/772: creat d5/d58/de5/ffc x:0 0 0 2024-09-10T09:36:29.056 INFO:tasks.workunit.client.1.smithi135.stdout:6/773: mknod d5/d1e/d3b/d74/deb/cfd 0 2024-09-10T09:36:29.057 INFO:tasks.workunit.client.1.smithi135.stdout:6/774: stat d5/d1e/d3b/d42/d2d/d55/fa6 0 2024-09-10T09:36:29.057 INFO:tasks.workunit.client.1.smithi135.stdout:6/775: truncate d5/d58/de5/ffc 186435 0 2024-09-10T09:36:29.058 INFO:tasks.workunit.client.1.smithi135.stdout:6/776: creat d5/d1e/d3b/d42/d2d/d8f/d9c/ffe x:0 0 0 2024-09-10T09:36:29.080 INFO:tasks.workunit.client.1.smithi135.stdout:6/777: mkdir d5/d1e/d3b/d42/d3c/dff 0 2024-09-10T09:36:29.084 INFO:tasks.workunit.client.1.smithi135.stdout:6/778: rename d5/d1e/d3b/d42/d2d/d8f/ff5 to d5/d15/f100 0 2024-09-10T09:36:29.086 INFO:tasks.workunit.client.1.smithi135.stdout:6/779: rename d5/d15/c16 to d5/d15/c101 0 2024-09-10T09:36:29.088 INFO:tasks.workunit.client.1.smithi135.stdout:6/780: rename c1 to d5/d58/c102 0 2024-09-10T09:36:29.088 INFO:tasks.workunit.client.1.smithi135.stdout:6/781: write d5/d1e/d3b/d42/d2d/fc2 [5790252,31033] 0 2024-09-10T09:36:29.091 INFO:tasks.workunit.client.1.smithi135.stdout:8/529: dwrite d1/d15/d16/f61 [0,4194304] 0 2024-09-10T09:36:29.091 INFO:tasks.workunit.client.1.smithi135.stdout:8/530: truncate d1/d15/fa6 538055 0 2024-09-10T09:36:29.091 INFO:tasks.workunit.client.1.smithi135.stdout:6/782: truncate d5/d1e/d3b/d42/f38 574327 0 2024-09-10T09:36:29.091 INFO:tasks.workunit.client.1.smithi135.stdout:6/783: chown d5/d15/l9a 304 1 2024-09-10T09:36:29.092 INFO:tasks.workunit.client.1.smithi135.stdout:6/784: write d5/dd/fc8 [386913,92945] 0 2024-09-10T09:36:29.100 INFO:tasks.workunit.client.1.smithi135.stdout:8/531: dread d1/f14 [4194304,4194304] 0 2024-09-10T09:36:29.100 INFO:tasks.workunit.client.1.smithi135.stdout:8/532: fsync d1/d15/f9d 0 2024-09-10T09:36:29.101 INFO:tasks.workunit.client.1.smithi135.stdout:8/533: fsync d1/d27/f40 0 2024-09-10T09:36:29.101 INFO:tasks.workunit.client.1.smithi135.stdout:8/534: getdents d1/d15/d24 0 2024-09-10T09:36:29.101 INFO:tasks.workunit.client.1.smithi135.stdout:8/535: readlink d1/d15/d24/l86 0 2024-09-10T09:36:29.119 INFO:tasks.workunit.client.1.smithi135.stdout:6/785: dwrite d5/d15/ddf/ffa [0,4194304] 0 2024-09-10T09:36:29.119 INFO:tasks.workunit.client.1.smithi135.stdout:6/786: dread - d5/d1e/d3b/d42/fda zero size 2024-09-10T09:36:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:4/731: sync 2024-09-10T09:36:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:9/600: sync 2024-09-10T09:36:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:4/732: write d1/d4a/f87 [4459139,79713] 0 2024-09-10T09:36:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:4/733: chown d1/de/f57 8 1 2024-09-10T09:36:29.131 INFO:tasks.workunit.client.1.smithi135.stdout:4/734: fdatasync d1/db/d9/f7d 0 2024-09-10T09:36:29.138 INFO:tasks.workunit.client.1.smithi135.stdout:6/787: dwrite d5/d1e/d3b/d42/d3c/d44/f76 [0,4194304] 0 2024-09-10T09:36:29.144 INFO:tasks.workunit.client.1.smithi135.stdout:9/601: write f6 [2274050,25480] 0 2024-09-10T09:36:29.145 INFO:tasks.workunit.client.1.smithi135.stdout:4/735: dread d1/db/d9/f7d [0,4194304] 0 2024-09-10T09:36:29.148 INFO:tasks.workunit.client.1.smithi135.stdout:4/736: dread d1/db/d9/f6a [0,4194304] 0 2024-09-10T09:36:29.149 INFO:tasks.workunit.client.1.smithi135.stdout:6/788: getdents d5/dd/d50/d86/dcd 0 2024-09-10T09:36:29.153 INFO:tasks.workunit.client.1.smithi135.stdout:4/737: creat d1/db/d9/d55/fe3 x:0 0 0 2024-09-10T09:36:29.153 INFO:tasks.workunit.client.1.smithi135.stdout:6/789: rmdir d5/dd/d50/d57 39 2024-09-10T09:36:29.154 INFO:tasks.workunit.client.1.smithi135.stdout:6/790: truncate d5/f73 2049894 0 2024-09-10T09:36:29.157 INFO:tasks.workunit.client.1.smithi135.stdout:4/738: dread d1/db/da0/fba [0,4194304] 0 2024-09-10T09:36:29.160 INFO:tasks.workunit.client.1.smithi135.stdout:4/739: link d1/f77 d1/d85/d89/fe4 0 2024-09-10T09:36:29.162 INFO:tasks.workunit.client.1.smithi135.stdout:4/740: creat d1/de/dde/fe5 x:0 0 0 2024-09-10T09:36:29.164 INFO:tasks.workunit.client.1.smithi135.stdout:9/602: dwrite de/df/d1d/d23/f67 [0,4194304] 0 2024-09-10T09:36:29.166 INFO:tasks.workunit.client.1.smithi135.stdout:4/741: rename d1/d33/d40/c5c to d1/de/d16/db8/ce6 0 2024-09-10T09:36:29.166 INFO:tasks.workunit.client.1.smithi135.stdout:4/742: rename d1/d33 to d1/d33/d40/de7 22 2024-09-10T09:36:29.167 INFO:tasks.workunit.client.1.smithi135.stdout:9/603: mknod de/df/d1d/d23/d25/cc9 0 2024-09-10T09:36:29.169 INFO:tasks.workunit.client.1.smithi135.stdout:4/743: rmdir d1/db/d9/d55/d76 39 2024-09-10T09:36:29.170 INFO:tasks.workunit.client.1.smithi135.stdout:4/744: symlink d1/d33/le8 0 2024-09-10T09:36:29.171 INFO:tasks.workunit.client.1.smithi135.stdout:4/745: write d1/de/d16/f68 [1292933,11656] 0 2024-09-10T09:36:29.180 INFO:tasks.workunit.client.1.smithi135.stdout:6/791: dwrite d5/d15/ddf/ffa [0,4194304] 0 2024-09-10T09:36:29.182 INFO:tasks.workunit.client.1.smithi135.stdout:6/792: rmdir d5/d15/df1 0 2024-09-10T09:36:29.185 INFO:tasks.workunit.client.1.smithi135.stdout:6/793: symlink d5/d1e/d3b/d42/d2d/d55/l103 0 2024-09-10T09:36:29.185 INFO:tasks.workunit.client.1.smithi135.stdout:6/794: creat d5/d1e/d3b/d42/f104 x:0 0 0 2024-09-10T09:36:29.187 INFO:tasks.workunit.client.1.smithi135.stdout:4/746: dwrite d1/d33/f3d [0,4194304] 0 2024-09-10T09:36:29.188 INFO:tasks.workunit.client.1.smithi135.stdout:6/795: unlink d5/dd/d50/d54/da9/de4/ff9 0 2024-09-10T09:36:29.190 INFO:tasks.workunit.client.1.smithi135.stdout:6/796: dread d5/dd/fc8 [0,4194304] 0 2024-09-10T09:36:29.197 INFO:tasks.workunit.client.1.smithi135.stdout:4/747: write d1/d85/d89/fe4 [180441,72783] 0 2024-09-10T09:36:29.209 INFO:tasks.workunit.client.1.smithi135.stdout:4/748: write d1/d33/d40/f7e [1889752,79133] 0 2024-09-10T09:36:29.209 INFO:tasks.workunit.client.1.smithi135.stdout:4/749: dread - d1/d4a/d9d/da1/dd6/fdc zero size 2024-09-10T09:36:29.211 INFO:tasks.workunit.client.1.smithi135.stdout:4/750: symlink d1/db/d9/d55/d76/le9 0 2024-09-10T09:36:29.217 INFO:tasks.workunit.client.1.smithi135.stdout:4/751: rmdir d1/de 39 2024-09-10T09:36:29.217 INFO:tasks.workunit.client.1.smithi135.stdout:6/797: dwrite d5/d1e/d62/d8a/fc3 [0,4194304] 0 2024-09-10T09:36:29.217 INFO:tasks.workunit.client.1.smithi135.stdout:6/798: chown d5/l9 1629 1 2024-09-10T09:36:29.233 INFO:tasks.workunit.client.1.smithi135.stdout:6/799: mknod d5/d1e/d3b/d42/d3c/dff/c105 0 2024-09-10T09:36:29.233 INFO:tasks.workunit.client.1.smithi135.stdout:6/800: chown d5/d1e/d3b/d42/d2d/d64/c8b 14465442 1 2024-09-10T09:36:29.235 INFO:tasks.workunit.client.1.smithi135.stdout:4/752: dwrite d1/db/d9/f7d [0,4194304] 0 2024-09-10T09:36:29.235 INFO:tasks.workunit.client.1.smithi135.stdout:4/753: chown d1/d4a/d9d/da1/le0 1489072 1 2024-09-10T09:36:29.235 INFO:tasks.workunit.client.1.smithi135.stdout:4/754: fdatasync d1/db/d83/fb6 0 2024-09-10T09:36:29.235 INFO:tasks.workunit.client.1.smithi135.stdout:4/755: write d1/d4a/f87 [4893387,99950] 0 2024-09-10T09:36:29.236 INFO:tasks.workunit.client.1.smithi135.stdout:4/756: symlink d1/db/d9/d55/d70/da4/lea 0 2024-09-10T09:36:29.241 INFO:tasks.workunit.client.1.smithi135.stdout:7/481: sync 2024-09-10T09:36:29.241 INFO:tasks.workunit.client.1.smithi135.stdout:5/633: sync 2024-09-10T09:36:29.241 INFO:tasks.workunit.client.1.smithi135.stdout:7/482: fdatasync d2/d15/d41/d49/d60/d54/d5e/d8c/f97 0 2024-09-10T09:36:29.241 INFO:tasks.workunit.client.1.smithi135.stdout:7/483: write d2/d15/d5c/f95 [139506,82860] 0 2024-09-10T09:36:29.241 INFO:tasks.workunit.client.1.smithi135.stdout:5/634: write d3/dc/dba/d4e/f86 [898948,125155] 0 2024-09-10T09:36:29.241 INFO:tasks.workunit.client.1.smithi135.stdout:5/635: truncate d3/dc/dba/dae/fce 146140 0 2024-09-10T09:36:29.242 INFO:tasks.workunit.client.1.smithi135.stdout:5/636: fdatasync d3/dc/f9b 0 2024-09-10T09:36:29.242 INFO:tasks.workunit.client.1.smithi135.stdout:4/757: getdents d1 0 2024-09-10T09:36:29.242 INFO:tasks.workunit.client.1.smithi135.stdout:4/758: creat d1/db/d9/d55/feb x:0 0 0 2024-09-10T09:36:29.242 INFO:tasks.workunit.client.1.smithi135.stdout:4/759: write d1/db/faf [812667,12271] 0 2024-09-10T09:36:29.243 INFO:tasks.workunit.client.1.smithi135.stdout:6/801: dread d5/d1e/d35/f9f [0,4194304] 0 2024-09-10T09:36:29.243 INFO:tasks.workunit.client.1.smithi135.stdout:6/802: write d5/dd/f92 [737781,28970] 0 2024-09-10T09:36:29.250 INFO:tasks.workunit.client.1.smithi135.stdout:4/760: rename d1/d4a/d6d/c73 to d1/d33/cec 0 2024-09-10T09:36:29.251 INFO:tasks.workunit.client.1.smithi135.stdout:7/484: dread d2/d15/d41/d49/d60/f43 [0,4194304] 0 2024-09-10T09:36:29.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/485: dread d2/d15/d41/d49/f63 [0,4194304] 0 2024-09-10T09:36:29.253 INFO:tasks.workunit.client.1.smithi135.stdout:7/486: chown d2/d15/d41/d49/d60/d30/f70 865 1 2024-09-10T09:36:29.262 INFO:tasks.workunit.client.1.smithi135.stdout:7/487: symlink d2/d15/d41/d49/d60/d30/l9e 0 2024-09-10T09:36:29.262 INFO:tasks.workunit.client.1.smithi135.stdout:7/488: stat d2/d15/d41/d49/d60/d30/d71/f92 0 2024-09-10T09:36:29.262 INFO:tasks.workunit.client.1.smithi135.stdout:7/489: dread - d2/d15/d39/d6f/f76 zero size 2024-09-10T09:36:29.262 INFO:tasks.workunit.client.1.smithi135.stdout:5/637: write d3/dc/f1c [1299296,32546] 0 2024-09-10T09:36:29.262 INFO:tasks.workunit.client.1.smithi135.stdout:5/638: fsync d3/d91/db5/fd8 0 2024-09-10T09:36:29.264 INFO:tasks.workunit.client.1.smithi135.stdout:4/761: rename d1/db/d9/d55/feb to d1/d85/fed 0 2024-09-10T09:36:29.266 INFO:tasks.workunit.client.1.smithi135.stdout:5/639: unlink d3/d44/c6f 0 2024-09-10T09:36:29.267 INFO:tasks.workunit.client.1.smithi135.stdout:7/490: rename d2/d15/d5c/d62/d88 to d2/d15/d39/d9f 0 2024-09-10T09:36:29.268 INFO:tasks.workunit.client.1.smithi135.stdout:7/491: chown d2/d15/d4a/d36/f5b 53 1 2024-09-10T09:36:29.268 INFO:tasks.workunit.client.1.smithi135.stdout:4/762: mkdir d1/d4a/d6d/dee 0 2024-09-10T09:36:29.270 INFO:tasks.workunit.client.1.smithi135.stdout:5/640: symlink d3/dc/d7a/db9/ldb 0 2024-09-10T09:36:29.270 INFO:tasks.workunit.client.1.smithi135.stdout:5/641: read - d3/dc/d69/d65/f9e zero size 2024-09-10T09:36:29.272 INFO:tasks.workunit.client.1.smithi135.stdout:4/763: mkdir d1/d33/d40/def 0 2024-09-10T09:36:29.272 INFO:tasks.workunit.client.1.smithi135.stdout:4/764: creat d1/db/da0/ff0 x:0 0 0 2024-09-10T09:36:29.272 INFO:tasks.workunit.client.1.smithi135.stdout:4/765: write d1/db/da0/fba [3315143,4962] 0 2024-09-10T09:36:29.273 INFO:tasks.workunit.client.1.smithi135.stdout:5/642: mknod d3/dc/dba/d4e/cdc 0 2024-09-10T09:36:29.273 INFO:tasks.workunit.client.1.smithi135.stdout:5/643: dread - d3/dc/dba/d88/fcf zero size 2024-09-10T09:36:29.273 INFO:tasks.workunit.client.1.smithi135.stdout:7/492: dread d2/d15/d4a/fe [0,4194304] 0 2024-09-10T09:36:29.275 INFO:tasks.workunit.client.1.smithi135.stdout:5/644: link d3/dc/dba/d88/fc3 d3/dc/dba/d88/fdd 0 2024-09-10T09:36:29.275 INFO:tasks.workunit.client.1.smithi135.stdout:5/645: chown d3/dc/dba/d48/d57/da3/c4a 231691 1 2024-09-10T09:36:29.277 INFO:tasks.workunit.client.1.smithi135.stdout:7/493: creat d2/d15/d41/d49/fa0 x:0 0 0 2024-09-10T09:36:29.279 INFO:tasks.workunit.client.1.smithi135.stdout:7/494: mkdir d2/d15/da1 0 2024-09-10T09:36:29.280 INFO:tasks.workunit.client.1.smithi135.stdout:7/495: dread d2/d15/d41/d49/f63 [0,4194304] 0 2024-09-10T09:36:29.284 INFO:tasks.workunit.client.1.smithi135.stdout:5/646: dread d3/dc/dba/d48/d57/f67 [0,4194304] 0 2024-09-10T09:36:29.286 INFO:tasks.workunit.client.1.smithi135.stdout:5/647: mknod d3/dc/d16/cde 0 2024-09-10T09:36:29.289 INFO:tasks.workunit.client.1.smithi135.stdout:5/648: rmdir d3/dc/dba/d48/d57/da3 39 2024-09-10T09:36:29.293 INFO:tasks.workunit.client.1.smithi135.stdout:5/649: rmdir d3/dc/dba/d88 39 2024-09-10T09:36:29.294 INFO:tasks.workunit.client.1.smithi135.stdout:5/650: symlink d3/dc/dba/d4e/dd0/ldf 0 2024-09-10T09:36:29.294 INFO:tasks.workunit.client.1.smithi135.stdout:5/651: creat d3/dc/dba/d48/d57/da9/fe0 x:0 0 0 2024-09-10T09:36:29.297 INFO:tasks.workunit.client.1.smithi135.stdout:5/652: link d3/dc/dba/d4e/d87/c92 d3/dc/d16/dc0/ce1 0 2024-09-10T09:36:29.297 INFO:tasks.workunit.client.1.smithi135.stdout:5/653: fsync d3/dc/f27 0 2024-09-10T09:36:29.298 INFO:tasks.workunit.client.1.smithi135.stdout:7/496: getdents d2/d15/d41/d49 0 2024-09-10T09:36:29.299 INFO:tasks.workunit.client.1.smithi135.stdout:4/766: truncate d1/db/da0/fba 1915777 0 2024-09-10T09:36:29.330 INFO:tasks.workunit.client.1.smithi135.stdout:5/654: dwrite d3/d44/f74 [0,4194304] 0 2024-09-10T09:36:29.330 INFO:tasks.workunit.client.1.smithi135.stdout:4/767: dwrite d1/de/d16/fbc [0,4194304] 0 2024-09-10T09:36:29.330 INFO:tasks.workunit.client.1.smithi135.stdout:7/497: dwrite d2/d15/d41/d49/d60/d30/f34 [0,4194304] 0 2024-09-10T09:36:29.337 INFO:tasks.workunit.client.1.smithi135.stdout:7/498: symlink d2/d15/d41/d49/d60/d54/la2 0 2024-09-10T09:36:29.340 INFO:tasks.workunit.client.1.smithi135.stdout:7/499: getdents d2/d15/d39/d6f 0 2024-09-10T09:36:29.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/768: write d1/db/d9/d55/f94 [912671,61178] 0 2024-09-10T09:36:29.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/769: read - d1/de/d16/d8b/fcc zero size 2024-09-10T09:36:29.344 INFO:tasks.workunit.client.1.smithi135.stdout:4/770: creat d1/d33/d40/def/ff1 x:0 0 0 2024-09-10T09:36:29.346 INFO:tasks.workunit.client.1.smithi135.stdout:4/771: creat d1/de/d16/d98/ff2 x:0 0 0 2024-09-10T09:36:29.349 INFO:tasks.workunit.client.1.smithi135.stdout:4/772: getdents d1/d4a/d9d/da1/dd6 0 2024-09-10T09:36:29.350 INFO:tasks.workunit.client.1.smithi135.stdout:5/655: dwrite d3/d91/f98 [0,4194304] 0 2024-09-10T09:36:29.351 INFO:tasks.workunit.client.1.smithi135.stdout:4/773: unlink d1/f19 0 2024-09-10T09:36:29.351 INFO:tasks.workunit.client.1.smithi135.stdout:4/774: chown d1/d4a/d6d/l9b 1 1 2024-09-10T09:36:29.357 INFO:tasks.workunit.client.1.smithi135.stdout:5/656: symlink d3/dc/dba/d48/d57/da3/db1/le2 0 2024-09-10T09:36:29.358 INFO:tasks.workunit.client.1.smithi135.stdout:4/775: dread d1/d4a/f87 [0,4194304] 0 2024-09-10T09:36:29.358 INFO:tasks.workunit.client.1.smithi135.stdout:4/776: fdatasync d1/d8a/fa3 0 2024-09-10T09:36:29.358 INFO:tasks.workunit.client.1.smithi135.stdout:4/777: write d1/db/d9/d55/d70/fc2 [243313,31232] 0 2024-09-10T09:36:29.358 INFO:tasks.workunit.client.1.smithi135.stdout:4/778: write d1/de/dde/fe5 [182555,91254] 0 2024-09-10T09:36:29.360 INFO:tasks.workunit.client.1.smithi135.stdout:5/657: truncate d3/dc/dba/d88/fc3 3060088 0 2024-09-10T09:36:29.364 INFO:tasks.workunit.client.1.smithi135.stdout:4/779: rename d1/d33/cec to d1/cf3 0 2024-09-10T09:36:29.364 INFO:tasks.workunit.client.1.smithi135.stdout:4/780: read d1/db/d9/fd0 [1626420,65986] 0 2024-09-10T09:36:29.364 INFO:tasks.workunit.client.1.smithi135.stdout:4/781: read d1/db/da0/fba [859304,108971] 0 2024-09-10T09:36:29.364 INFO:tasks.workunit.client.1.smithi135.stdout:4/782: fsync d1/db/faf 0 2024-09-10T09:36:29.370 INFO:tasks.workunit.client.1.smithi135.stdout:4/783: truncate d1/db/d9/fd0 4170517 0 2024-09-10T09:36:29.370 INFO:tasks.workunit.client.1.smithi135.stdout:4/784: truncate d1/d8a/fc3 912658 0 2024-09-10T09:36:29.383 INFO:tasks.workunit.client.1.smithi135.stdout:5/658: rename d3/fa to d3/d91/db5/fe3 0 2024-09-10T09:36:29.384 INFO:tasks.workunit.client.1.smithi135.stdout:4/785: truncate d1/db/d9/d55/f94 2256228 0 2024-09-10T09:36:29.386 INFO:tasks.workunit.client.1.smithi135.stdout:5/659: symlink d3/d91/le4 0 2024-09-10T09:36:29.389 INFO:tasks.workunit.client.1.smithi135.stdout:5/660: symlink d3/dc/d16/dc0/le5 0 2024-09-10T09:36:29.389 INFO:tasks.workunit.client.1.smithi135.stdout:5/661: dread - d3/dc/dba/d48/d57/da3/db1/fb4 zero size 2024-09-10T09:36:29.389 INFO:tasks.workunit.client.1.smithi135.stdout:5/662: write d3/dc/dba/d4e/dd0/faa [218778,48722] 0 2024-09-10T09:36:29.389 INFO:tasks.workunit.client.1.smithi135.stdout:4/786: rmdir d1/db/d23 39 2024-09-10T09:36:29.421 INFO:tasks.workunit.client.1.smithi135.stdout:5/663: getdents d3/d81/d8d 0 2024-09-10T09:36:29.422 INFO:tasks.workunit.client.1.smithi135.stdout:5/664: stat d3/dc/dba/d88/fa1 0 2024-09-10T09:36:29.425 INFO:tasks.workunit.client.1.smithi135.stdout:5/665: dread d3/dc/f1c [0,4194304] 0 2024-09-10T09:36:29.426 INFO:tasks.workunit.client.1.smithi135.stdout:5/666: write d3/dc/f27 [4281157,70783] 0 2024-09-10T09:36:29.467 INFO:tasks.workunit.client.1.smithi135.stdout:0/564: sync 2024-09-10T09:36:29.467 INFO:tasks.workunit.client.1.smithi135.stdout:2/628: sync 2024-09-10T09:36:29.472 INFO:tasks.workunit.client.1.smithi135.stdout:5/667: truncate d3/dc/dba/f68 3502553 0 2024-09-10T09:36:29.474 INFO:tasks.workunit.client.1.smithi135.stdout:2/629: symlink df/d15/lcc 0 2024-09-10T09:36:29.475 INFO:tasks.workunit.client.1.smithi135.stdout:5/668: symlink d3/d71/le6 0 2024-09-10T09:36:29.476 INFO:tasks.workunit.client.1.smithi135.stdout:0/565: mknod d8/d1c/d37/d73/d7f/d8c/da8/cbc 0 2024-09-10T09:36:29.476 INFO:tasks.workunit.client.1.smithi135.stdout:0/566: write d8/dd/d18/d3d/fb2 [643311,122699] 0 2024-09-10T09:36:29.477 INFO:tasks.workunit.client.1.smithi135.stdout:2/630: unlink df/d1b/d23/cc2 0 2024-09-10T09:36:29.480 INFO:tasks.workunit.client.1.smithi135.stdout:0/567: rename d8/dd/f10 to d8/dd/d4a/d50/d67/fbd 0 2024-09-10T09:36:29.483 INFO:tasks.workunit.client.1.smithi135.stdout:2/631: rmdir df/d13/d52 39 2024-09-10T09:36:29.486 INFO:tasks.workunit.client.1.smithi135.stdout:0/568: read d8/dd/d11/f2b [1127804,82753] 0 2024-09-10T09:36:29.486 INFO:tasks.workunit.client.1.smithi135.stdout:0/569: chown d8/c40 511826355 1 2024-09-10T09:36:29.487 INFO:tasks.workunit.client.1.smithi135.stdout:0/570: symlink d8/d1c/d37/d73/d7f/d8c/lbe 0 2024-09-10T09:36:29.489 INFO:tasks.workunit.client.1.smithi135.stdout:2/632: write f6 [6435720,18174] 0 2024-09-10T09:36:29.492 INFO:tasks.workunit.client.1.smithi135.stdout:2/633: rename df/d1b/d23/f80 to df/d1b/d23/db6/fcd 0 2024-09-10T09:36:29.492 INFO:tasks.workunit.client.1.smithi135.stdout:2/634: chown df/d13/d4f/d95/d97/fc8 170478 1 2024-09-10T09:36:29.492 INFO:tasks.workunit.client.1.smithi135.stdout:2/635: readlink df/d1b/d31/l35 0 2024-09-10T09:36:29.516 INFO:tasks.workunit.client.1.smithi135.stdout:5/669: mkdir d3/dc/d69/d65/de7 0 2024-09-10T09:36:29.517 INFO:tasks.workunit.client.1.smithi135.stdout:5/670: unlink d3/dc/d16/dc0/ce1 0 2024-09-10T09:36:29.522 INFO:tasks.workunit.client.1.smithi135.stdout:5/671: rename d3/dc/dba/d4e/f86 to d3/dc/dba/d88/fe8 0 2024-09-10T09:36:29.552 INFO:tasks.workunit.client.1.smithi135.stdout:5/672: dwrite d3/dc/d69/d72/f9c [0,4194304] 0 2024-09-10T09:36:29.553 INFO:tasks.workunit.client.1.smithi135.stdout:0/571: dwrite d8/d1c/d61/f8a [0,4194304] 0 2024-09-10T09:36:29.556 INFO:tasks.workunit.client.1.smithi135.stdout:5/673: dread d3/dc/dba/dae/fce [0,4194304] 0 2024-09-10T09:36:29.556 INFO:tasks.workunit.client.1.smithi135.stdout:5/674: read d3/f95 [2792793,77952] 0 2024-09-10T09:36:29.584 INFO:tasks.workunit.client.1.smithi135.stdout:0/572: dwrite d8/dd/d4a/d50/d54/f9a [0,4194304] 0 2024-09-10T09:36:29.585 INFO:tasks.workunit.client.1.smithi135.stdout:5/675: dwrite d3/dc/d16/fab [0,4194304] 0 2024-09-10T09:36:29.585 INFO:tasks.workunit.client.1.smithi135.stdout:5/676: read d3/dc/f8c [186871,91435] 0 2024-09-10T09:36:29.586 INFO:tasks.workunit.client.1.smithi135.stdout:0/573: symlink d8/dd/d4a/d50/d54/lbf 0 2024-09-10T09:36:29.587 INFO:tasks.workunit.client.1.smithi135.stdout:0/574: readlink d8/d1c/d37/l6b 0 2024-09-10T09:36:29.590 INFO:tasks.workunit.client.1.smithi135.stdout:5/677: mkdir d3/dc/d69/de9 0 2024-09-10T09:36:29.592 INFO:tasks.workunit.client.1.smithi135.stdout:0/575: creat d8/d1c/d37/fc0 x:0 0 0 2024-09-10T09:36:29.593 INFO:tasks.workunit.client.1.smithi135.stdout:5/678: symlink d3/dc/d7a/lea 0 2024-09-10T09:36:29.596 INFO:tasks.workunit.client.1.smithi135.stdout:5/679: mknod d3/dc/dba/d4e/d87/ceb 0 2024-09-10T09:36:29.600 INFO:tasks.workunit.client.1.smithi135.stdout:5/680: mkdir d3/dc/d69/d72/dec 0 2024-09-10T09:36:29.601 INFO:tasks.workunit.client.1.smithi135.stdout:0/576: rename d8/d1c/d37/d7a to d8/d1c/d37/d73/d7f/d8c/da8/db9/dc1 0 2024-09-10T09:36:29.603 INFO:tasks.workunit.client.1.smithi135.stdout:5/681: link d3/dc/dba/dae/fce d3/d99/fed 0 2024-09-10T09:36:29.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/577: mknod d8/d1c/d37/cc2 0 2024-09-10T09:36:29.604 INFO:tasks.workunit.client.1.smithi135.stdout:0/578: write d8/d1c/d8f/f93 [5168378,104383] 0 2024-09-10T09:36:29.606 INFO:tasks.workunit.client.1.smithi135.stdout:5/682: creat d3/dc/dba/d88/fee x:0 0 0 2024-09-10T09:36:29.611 INFO:tasks.workunit.client.1.smithi135.stdout:0/579: dread d8/f86 [0,4194304] 0 2024-09-10T09:36:29.612 INFO:tasks.workunit.client.1.smithi135.stdout:0/580: chown d8/dd/d1e/c82 31 1 2024-09-10T09:36:29.626 INFO:tasks.workunit.client.1.smithi135.stdout:0/581: truncate d8/d1c/d8f/f93 2467001 0 2024-09-10T09:36:29.626 INFO:tasks.workunit.client.1.smithi135.stdout:0/582: write d8/dd/d18/f43 [541800,26058] 0 2024-09-10T09:36:29.640 INFO:tasks.workunit.client.1.smithi135.stdout:0/583: rename d8/d1c to d8/dd/d18/d3d/dc3 0 2024-09-10T09:36:29.655 INFO:tasks.workunit.client.1.smithi135.stdout:0/584: dwrite d8/d80/fab [0,4194304] 0 2024-09-10T09:36:29.657 INFO:tasks.workunit.client.1.smithi135.stdout:0/585: mkdir d8/dd/d11/d90/dc4 0 2024-09-10T09:36:29.657 INFO:tasks.workunit.client.1.smithi135.stdout:0/586: stat d8/dd/d11/d17/fa6 0 2024-09-10T09:36:29.659 INFO:tasks.workunit.client.1.smithi135.stdout:0/587: mkdir d8/dd/d18/d3d/dc3/d37/d73/dc5 0 2024-09-10T09:36:29.660 INFO:tasks.workunit.client.1.smithi135.stdout:0/588: unlink d8/dd/d18/d3d/l45 0 2024-09-10T09:36:29.675 INFO:tasks.workunit.client.1.smithi135.stdout:0/589: dwrite d8/dd/d4a/d50/d54/d5f/f30 [0,4194304] 0 2024-09-10T09:36:29.677 INFO:tasks.workunit.client.1.smithi135.stdout:0/590: link d8/dd/d1e/l99 d8/dd/d11/lc6 0 2024-09-10T09:36:29.677 INFO:tasks.workunit.client.1.smithi135.stdout:0/591: chown d8/de/f68 50554 1 2024-09-10T09:36:29.677 INFO:tasks.workunit.client.1.smithi135.stdout:0/592: mknod d8/de/cc7 0 2024-09-10T09:36:29.687 INFO:tasks.workunit.client.1.smithi135.stdout:0/593: dread d8/fc [4194304,4194304] 0 2024-09-10T09:36:29.694 INFO:tasks.workunit.client.1.smithi135.stdout:0/594: dread d8/dd/d11/d17/fa6 [0,4194304] 0 2024-09-10T09:36:29.697 INFO:tasks.workunit.client.1.smithi135.stdout:0/595: rename d8/dd/d33/d97 to d8/dd/d18/d3d/dc3/d37/d73/dc8 0 2024-09-10T09:36:29.698 INFO:tasks.workunit.client.1.smithi135.stdout:0/596: truncate d8/dd/f13 4243023 0 2024-09-10T09:36:29.698 INFO:tasks.workunit.client.1.smithi135.stdout:0/597: chown d8/dd/d18/d3d/dc3/c95 5 1 2024-09-10T09:36:29.700 INFO:tasks.workunit.client.1.smithi135.stdout:0/598: rename d8/dd/d11/fa9 to d8/dd/d4a/fc9 0 2024-09-10T09:36:29.703 INFO:tasks.workunit.client.1.smithi135.stdout:0/599: rename d8/dd/lae to d8/de/d2e/lca 0 2024-09-10T09:36:29.703 INFO:tasks.workunit.client.1.smithi135.stdout:0/600: fdatasync d8/dd/d18/d3d/dc3/d61/f94 0 2024-09-10T09:36:29.703 INFO:tasks.workunit.client.1.smithi135.stdout:0/601: truncate d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1/f7b 2408841 0 2024-09-10T09:36:29.705 INFO:tasks.workunit.client.1.smithi135.stdout:0/602: rename d8/dd/d4a/d50/f9e to d8/fcb 0 2024-09-10T09:36:29.706 INFO:tasks.workunit.client.1.smithi135.stdout:0/603: rename d8/d80/fab to d8/dd/d18/d3d/dc3/d8f/daa/fcc 0 2024-09-10T09:36:29.710 INFO:tasks.workunit.client.1.smithi135.stdout:0/604: dread d8/f86 [0,4194304] 0 2024-09-10T09:36:29.710 INFO:tasks.workunit.client.1.smithi135.stdout:0/605: write d8/dd/d11/f1f [282577,122250] 0 2024-09-10T09:36:29.710 INFO:tasks.workunit.client.1.smithi135.stdout:0/606: chown d8/dd/d4a/f84 110 1 2024-09-10T09:36:29.710 INFO:tasks.workunit.client.1.smithi135.stdout:0/607: creat d8/dd/d4a/d50/d54/d5f/fcd x:0 0 0 2024-09-10T09:36:29.713 INFO:tasks.workunit.client.1.smithi135.stdout:0/608: creat d8/dd/d18/d3d/dc3/d37/d73/dc8/fce x:0 0 0 2024-09-10T09:36:29.713 INFO:tasks.workunit.client.1.smithi135.stdout:0/609: chown d8/dd/d4a/d50/d54/d5f/d4b/f75 2977578 1 2024-09-10T09:36:29.720 INFO:tasks.workunit.client.1.smithi135.stdout:0/610: dread d8/dd/d4a/d50/d67/fbd [0,4194304] 0 2024-09-10T09:36:29.720 INFO:tasks.workunit.client.1.smithi135.stdout:0/611: dread - d8/dd/d18/d3d/dc3/d61/f69 zero size 2024-09-10T09:36:29.723 INFO:tasks.workunit.client.1.smithi135.stdout:0/612: getdents d8/dd/d18/d3d/dc3 0 2024-09-10T09:36:29.725 INFO:tasks.workunit.client.1.smithi135.stdout:0/613: mkdir d8/dd/d18/d3d/dc3/d37/d9c/dcf 0 2024-09-10T09:36:29.734 INFO:tasks.workunit.client.1.smithi135.stdout:3/451: sync 2024-09-10T09:36:29.736 INFO:tasks.workunit.client.1.smithi135.stdout:3/452: unlink d4/d5/d56/f6b 0 2024-09-10T09:36:29.736 INFO:tasks.workunit.client.1.smithi135.stdout:3/453: chown d4/d55/d5d/c29 7348 1 2024-09-10T09:36:29.737 INFO:tasks.workunit.client.1.smithi135.stdout:3/454: unlink d4/d5/db/d36/d43/l59 0 2024-09-10T09:36:29.744 INFO:tasks.workunit.client.1.smithi135.stdout:0/614: dwrite d8/fb [0,4194304] 0 2024-09-10T09:36:29.749 INFO:tasks.workunit.client.1.smithi135.stdout:0/615: rmdir d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1 39 2024-09-10T09:36:29.753 INFO:tasks.workunit.client.1.smithi135.stdout:0/616: unlink d8/d80/c89 0 2024-09-10T09:36:29.753 INFO:tasks.workunit.client.1.smithi135.stdout:0/617: fsync d8/f26 0 2024-09-10T09:36:29.755 INFO:tasks.workunit.client.1.smithi135.stdout:1/659: sync 2024-09-10T09:36:29.755 INFO:tasks.workunit.client.1.smithi135.stdout:1/660: fdatasync f11 0 2024-09-10T09:36:29.755 INFO:tasks.workunit.client.1.smithi135.stdout:0/618: truncate d8/dd/d4a/d50/d54/f9a 2326422 0 2024-09-10T09:36:29.757 INFO:tasks.workunit.client.1.smithi135.stdout:1/661: mkdir d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1 0 2024-09-10T09:36:29.757 INFO:tasks.workunit.client.1.smithi135.stdout:1/662: fdatasync d1d/d20/d52/f5a 0 2024-09-10T09:36:29.757 INFO:tasks.workunit.client.1.smithi135.stdout:1/663: dread - d1d/d20/d52/d8a/dc2/dca/d37/db8/fbc zero size 2024-09-10T09:36:29.774 INFO:tasks.workunit.client.1.smithi135.stdout:1/664: dwrite d1d/d20/d3c/d4e/fa5 [0,4194304] 0 2024-09-10T09:36:29.774 INFO:tasks.workunit.client.1.smithi135.stdout:1/665: write f6 [2878163,101553] 0 2024-09-10T09:36:29.775 INFO:tasks.workunit.client.1.smithi135.stdout:1/666: mkdir d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/dd2 0 2024-09-10T09:36:29.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/667: mkdir d1d/d20/d42/dd3 0 2024-09-10T09:36:29.777 INFO:tasks.workunit.client.1.smithi135.stdout:1/668: unlink d1d/d20/d52/d8a/dc2/dca/d37/lb3 0 2024-09-10T09:36:29.784 INFO:tasks.workunit.client.1.smithi135.stdout:0/619: dwrite d8/dd/d4a/d50/d54/f9a [0,4194304] 0 2024-09-10T09:36:29.784 INFO:tasks.workunit.client.1.smithi135.stdout:0/620: truncate d8/dd/db0/fb4 23444 0 2024-09-10T09:36:29.786 INFO:tasks.workunit.client.1.smithi135.stdout:0/621: rename d8/de/d2e/f8d to d8/dd/d18/d3d/dc3/d61/fd0 0 2024-09-10T09:36:29.786 INFO:tasks.workunit.client.1.smithi135.stdout:0/622: truncate d8/fb 4914141 0 2024-09-10T09:36:29.786 INFO:tasks.workunit.client.1.smithi135.stdout:0/623: chown d8/dd/d18/f1a 1 1 2024-09-10T09:36:29.791 INFO:tasks.workunit.client.1.smithi135.stdout:1/669: write d1d/f21 [2057687,121903] 0 2024-09-10T09:36:29.793 INFO:tasks.workunit.client.1.smithi135.stdout:1/670: symlink d1d/d20/d52/ld4 0 2024-09-10T09:36:29.794 INFO:tasks.workunit.client.1.smithi135.stdout:1/671: creat d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/fd5 x:0 0 0 2024-09-10T09:36:29.794 INFO:tasks.workunit.client.1.smithi135.stdout:1/672: chown d1d/d20/d52/d8a/dc2/dca/d2b/da8/ccb 20274 1 2024-09-10T09:36:29.794 INFO:tasks.workunit.client.1.smithi135.stdout:1/673: fdatasync d1d/f2c 0 2024-09-10T09:36:29.796 INFO:tasks.workunit.client.1.smithi135.stdout:1/674: mknod d1d/d71/d9e/cd6 0 2024-09-10T09:36:29.797 INFO:tasks.workunit.client.1.smithi135.stdout:1/675: mknod d1d/d20/d52/d8a/dc2/dca/d37/db8/cd7 0 2024-09-10T09:36:29.797 INFO:tasks.workunit.client.1.smithi135.stdout:1/676: write d1d/d20/d52/f5a [1057930,126790] 0 2024-09-10T09:36:29.799 INFO:tasks.workunit.client.1.smithi135.stdout:1/677: unlink d1d/fad 0 2024-09-10T09:36:29.803 INFO:tasks.workunit.client.1.smithi135.stdout:0/624: dwrite d8/dd/d4a/d50/d54/f9a [4194304,4194304] 0 2024-09-10T09:36:29.803 INFO:tasks.workunit.client.1.smithi135.stdout:0/625: creat d8/dd/db0/fd1 x:0 0 0 2024-09-10T09:36:29.806 INFO:tasks.workunit.client.1.smithi135.stdout:0/626: dread d8/dd/d11/f2b [0,4194304] 0 2024-09-10T09:36:29.810 INFO:tasks.workunit.client.1.smithi135.stdout:0/627: symlink d8/dd/d18/d3d/dc3/d37/d73/ld2 0 2024-09-10T09:36:29.810 INFO:tasks.workunit.client.1.smithi135.stdout:0/628: fsync d8/dd/d18/d3d/dc3/d61/f8a 0 2024-09-10T09:36:29.810 INFO:tasks.workunit.client.1.smithi135.stdout:1/678: dread d1d/f22 [0,4194304] 0 2024-09-10T09:36:29.812 INFO:tasks.workunit.client.1.smithi135.stdout:0/629: truncate d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1/f7b 147843 0 2024-09-10T09:36:29.814 INFO:tasks.workunit.client.1.smithi135.stdout:1/679: truncate d1d/f3f 3676614 0 2024-09-10T09:36:29.814 INFO:tasks.workunit.client.1.smithi135.stdout:1/680: fsync d1d/d28/f8e 0 2024-09-10T09:36:29.817 INFO:tasks.workunit.client.1.smithi135.stdout:0/630: creat d8/dd/d11/d90/dc4/fd3 x:0 0 0 2024-09-10T09:36:29.825 INFO:tasks.workunit.client.1.smithi135.stdout:1/681: rename d1d/d28/d4b/l72 to d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/ld8 0 2024-09-10T09:36:29.832 INFO:tasks.workunit.client.1.smithi135.stdout:1/682: rmdir d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dcf 0 2024-09-10T09:36:29.834 INFO:tasks.workunit.client.1.smithi135.stdout:1/683: mknod d1d/d20/d42/cd9 0 2024-09-10T09:36:29.834 INFO:tasks.workunit.client.1.smithi135.stdout:1/684: truncate d1d/d28/d4b/d53/fa1 518109 0 2024-09-10T09:36:29.837 INFO:tasks.workunit.client.1.smithi135.stdout:1/685: mkdir d1d/d28/d4b/dda 0 2024-09-10T09:36:29.839 INFO:tasks.workunit.client.1.smithi135.stdout:1/686: symlink d1d/d71/d9e/ldb 0 2024-09-10T09:36:29.839 INFO:tasks.workunit.client.1.smithi135.stdout:1/687: creat d1d/d20/d42/fdc x:0 0 0 2024-09-10T09:36:29.857 INFO:tasks.workunit.client.1.smithi135.stdout:1/688: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/fce [0,4194304] 0 2024-09-10T09:36:29.860 INFO:tasks.workunit.client.1.smithi135.stdout:1/689: creat d1d/d28/d4b/fdd x:0 0 0 2024-09-10T09:36:29.860 INFO:tasks.workunit.client.1.smithi135.stdout:1/690: truncate d1d/d28/f7c 1692511 0 2024-09-10T09:36:29.860 INFO:tasks.workunit.client.1.smithi135.stdout:1/691: write d1d/d20/f94 [396720,23253] 0 2024-09-10T09:36:29.860 INFO:tasks.workunit.client.1.smithi135.stdout:1/692: mknod d1d/d28/d4b/cde 0 2024-09-10T09:36:29.861 INFO:tasks.workunit.client.1.smithi135.stdout:1/693: mknod d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/cdf 0 2024-09-10T09:36:29.862 INFO:tasks.workunit.client.1.smithi135.stdout:1/694: truncate d1d/f2a 2728457 0 2024-09-10T09:36:29.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/695: getdents d1d/d20 0 2024-09-10T09:36:29.865 INFO:tasks.workunit.client.1.smithi135.stdout:1/696: fsync d1d/d20/d52/d8a/dc2/dca/d2b/d4c/fb7 0 2024-09-10T09:36:29.879 INFO:tasks.workunit.client.1.smithi135.stdout:1/697: dwrite d1d/d20/d5d/fba [0,4194304] 0 2024-09-10T09:36:29.882 INFO:tasks.workunit.client.1.smithi135.stdout:1/698: symlink d1d/d28/d4b/d53/dc5/le0 0 2024-09-10T09:36:29.886 INFO:tasks.workunit.client.1.smithi135.stdout:1/699: unlink d1d/d20/d6c/f9d 0 2024-09-10T09:36:29.888 INFO:tasks.workunit.client.1.smithi135.stdout:1/700: symlink d1d/d20/d52/d8a/dc2/dca/d37/db8/le1 0 2024-09-10T09:36:29.889 INFO:tasks.workunit.client.1.smithi135.stdout:1/701: dread d1d/d20/d52/d8a/dc2/dca/fb9 [0,4194304] 0 2024-09-10T09:36:29.890 INFO:tasks.workunit.client.1.smithi135.stdout:1/702: link d1d/d20/d42/cd9 d1d/d20/d52/d8a/dc2/dca/ce2 0 2024-09-10T09:36:29.891 INFO:tasks.workunit.client.1.smithi135.stdout:1/703: symlink d1d/d20/d52/d8a/dc2/dca/d2b/da8/le3 0 2024-09-10T09:36:29.892 INFO:tasks.workunit.client.1.smithi135.stdout:1/704: rmdir d1d/d20/d52/d8a/dc2/dca/db4 39 2024-09-10T09:36:29.910 INFO:tasks.workunit.client.1.smithi135.stdout:1/705: dwrite f11 [0,4194304] 0 2024-09-10T09:36:29.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:29 smithi079 ceph-mon[27592]: pgmap v269: 65 pgs: 65 active+clean; 2.2 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 111 MiB/s rd, 117 MiB/s wr, 222 op/s 2024-09-10T09:36:29.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:29 smithi135 ceph-mon[33411]: pgmap v269: 65 pgs: 65 active+clean; 2.2 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 111 MiB/s rd, 117 MiB/s wr, 222 op/s 2024-09-10T09:36:30.034 INFO:tasks.workunit.client.1.smithi135.stdout:8/536: sync 2024-09-10T09:36:30.036 INFO:tasks.workunit.client.1.smithi135.stdout:8/537: getdents d1/d15/d16/d33/d39 0 2024-09-10T09:36:30.040 INFO:tasks.workunit.client.1.smithi135.stdout:8/538: rename d1/d15/d49/c8e to d1/d15/d49/cb1 0 2024-09-10T09:36:30.056 INFO:tasks.workunit.client.1.smithi135.stdout:8/539: dwrite d1/d27/f68 [4194304,4194304] 0 2024-09-10T09:36:30.059 INFO:tasks.workunit.client.1.smithi135.stdout:8/540: creat d1/d15/d49/fb2 x:0 0 0 2024-09-10T09:36:30.061 INFO:tasks.workunit.client.1.smithi135.stdout:8/541: truncate d1/d15/d16/d33/d45/d70/f93 3434515 0 2024-09-10T09:36:30.062 INFO:tasks.workunit.client.1.smithi135.stdout:8/542: mknod d1/d15/d16/d33/d45/d6f/cb3 0 2024-09-10T09:36:30.062 INFO:tasks.workunit.client.1.smithi135.stdout:8/543: creat d1/d15/d16/d33/d45/d6f/fb4 x:0 0 0 2024-09-10T09:36:30.066 INFO:tasks.workunit.client.1.smithi135.stdout:8/544: rmdir d1/d15/d16/d96 39 2024-09-10T09:36:30.076 INFO:tasks.workunit.client.1.smithi135.stdout:8/545: read d1/d15/d16/d33/f97 [2089341,110715] 0 2024-09-10T09:36:30.076 INFO:tasks.workunit.client.1.smithi135.stdout:8/546: rename d1/d15/d16/f1a to d1/d15/d16/d33/d45/d6f/fb5 0 2024-09-10T09:36:30.093 INFO:tasks.workunit.client.1.smithi135.stdout:8/547: dwrite d1/f23 [0,4194304] 0 2024-09-10T09:36:30.194 INFO:tasks.workunit.client.1.smithi135.stdout:9/604: sync 2024-09-10T09:36:30.198 INFO:tasks.workunit.client.1.smithi135.stdout:9/605: creat de/df/d1d/fca x:0 0 0 2024-09-10T09:36:30.198 INFO:tasks.workunit.client.1.smithi135.stdout:9/606: stat de/df/d1d/c55 0 2024-09-10T09:36:30.201 INFO:tasks.workunit.client.1.smithi135.stdout:9/607: rename de/df/d1d/d23/d25/d28/f81 to de/df/dac/db7/fcb 0 2024-09-10T09:36:30.207 INFO:tasks.workunit.client.1.smithi135.stdout:9/608: creat de/df/d1d/d23/d25/fcc x:0 0 0 2024-09-10T09:36:30.209 INFO:tasks.workunit.client.1.smithi135.stdout:9/609: unlink de/df/d1d/d1e/d52/d86/l9e 0 2024-09-10T09:36:30.211 INFO:tasks.workunit.client.1.smithi135.stdout:9/610: write de/df/d1d/fb2 [83235,48261] 0 2024-09-10T09:36:30.211 INFO:tasks.workunit.client.1.smithi135.stdout:9/611: write de/f21 [1840187,102632] 0 2024-09-10T09:36:30.220 INFO:tasks.workunit.client.1.smithi135.stdout:9/612: dread de/df/d1d/d6b/f7f [0,4194304] 0 2024-09-10T09:36:30.220 INFO:tasks.workunit.client.1.smithi135.stdout:9/613: chown f6 367 1 2024-09-10T09:36:30.237 INFO:tasks.workunit.client.1.smithi135.stdout:9/614: dwrite de/df/d1d/d6b/f7f [0,4194304] 0 2024-09-10T09:36:30.238 INFO:tasks.workunit.client.1.smithi135.stdout:9/615: symlink de/df/d1d/d23/d25/d78/lcd 0 2024-09-10T09:36:30.240 INFO:tasks.workunit.client.1.smithi135.stdout:9/616: mknod de/df/d1d/d1e/d52/cce 0 2024-09-10T09:36:30.258 INFO:tasks.workunit.client.1.smithi135.stdout:9/617: dwrite de/df/d1d/d6b/fa5 [0,4194304] 0 2024-09-10T09:36:30.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/618: write de/f15 [1943701,43011] 0 2024-09-10T09:36:30.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/619: chown de/df/d1d/fc7 47 1 2024-09-10T09:36:30.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/620: rmdir de/df/d1d/d1e 39 2024-09-10T09:36:30.268 INFO:tasks.workunit.client.1.smithi135.stdout:9/621: chown de/df/d7e/c92 0 1 2024-09-10T09:36:30.277 INFO:tasks.workunit.client.1.smithi135.stdout:9/622: dread de/df/d1d/d23/f67 [0,4194304] 0 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:7/500: sync 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:4/787: sync 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:3/455: sync 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:8/548: sync 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:0/631: sync 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:7/501: chown d2/d15/da1 1590 1 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:7/502: getdents d2/d15/d39/d6f 0 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:0/632: read d8/dd/d11/f2b [2098180,105108] 0 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:0/633: write d8/dd/d11/d17/fa6 [4485717,40334] 0 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:1/706: sync 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:6/803: sync 2024-09-10T09:36:30.279 INFO:tasks.workunit.client.1.smithi135.stdout:9/623: mkdir de/df/d1d/d23/d25/d28/d7b/dcf 0 2024-09-10T09:36:30.281 INFO:tasks.workunit.client.1.smithi135.stdout:2/636: sync 2024-09-10T09:36:30.281 INFO:tasks.workunit.client.1.smithi135.stdout:5/683: sync 2024-09-10T09:36:30.281 INFO:tasks.workunit.client.1.smithi135.stdout:2/637: write df/d1b/f85 [4405659,13624] 0 2024-09-10T09:36:30.281 INFO:tasks.workunit.client.1.smithi135.stdout:2/638: read df/f12 [1208196,3296] 0 2024-09-10T09:36:30.281 INFO:tasks.workunit.client.1.smithi135.stdout:2/639: fdatasync df/d1b/d23/d98/d5f/d3d/d87/fa3 0 2024-09-10T09:36:30.281 INFO:tasks.workunit.client.1.smithi135.stdout:4/788: symlink d1/de/d16/d8b/dc6/lf4 0 2024-09-10T09:36:30.285 INFO:tasks.workunit.client.1.smithi135.stdout:0/634: mknod d8/dd/d18/d3d/dc3/d37/d73/dc8/cd4 0 2024-09-10T09:36:30.289 INFO:tasks.workunit.client.1.smithi135.stdout:9/624: mknod de/df/d1d/d23/d25/d28/cd0 0 2024-09-10T09:36:30.289 INFO:tasks.workunit.client.1.smithi135.stdout:9/625: chown de/lc4 22387397 1 2024-09-10T09:36:30.290 INFO:tasks.workunit.client.1.smithi135.stdout:5/684: symlink d3/dc/d69/de9/lef 0 2024-09-10T09:36:30.290 INFO:tasks.workunit.client.1.smithi135.stdout:5/685: chown d3/dc/d69/de9 1 1 2024-09-10T09:36:30.290 INFO:tasks.workunit.client.1.smithi135.stdout:5/686: fdatasync d3/fd6 0 2024-09-10T09:36:30.291 INFO:tasks.workunit.client.1.smithi135.stdout:3/456: dread d4/f25 [0,4194304] 0 2024-09-10T09:36:30.295 INFO:tasks.workunit.client.1.smithi135.stdout:3/457: write d4/d5/dc/f69 [163655,106413] 0 2024-09-10T09:36:30.295 INFO:tasks.workunit.client.1.smithi135.stdout:3/458: write d4/d5/f39 [4380805,123658] 0 2024-09-10T09:36:30.297 INFO:tasks.workunit.client.1.smithi135.stdout:2/640: link df/d1b/f85 df/d1b/d23/d98/d5f/d2c/d7d/fce 0 2024-09-10T09:36:30.299 INFO:tasks.workunit.client.1.smithi135.stdout:0/635: rename d8/lb3 to d8/dd/d18/d3d/dc3/d37/d9c/dcf/ld5 0 2024-09-10T09:36:30.299 INFO:tasks.workunit.client.1.smithi135.stdout:0/636: chown d8/dd/d11/f59 43563 1 2024-09-10T09:36:30.300 INFO:tasks.workunit.client.1.smithi135.stdout:0/637: write d8/dd/d18/f43 [809868,100837] 0 2024-09-10T09:36:30.300 INFO:tasks.workunit.client.1.smithi135.stdout:0/638: creat d8/dd/d4a/d50/d67/fd6 x:0 0 0 2024-09-10T09:36:30.302 INFO:tasks.workunit.client.1.smithi135.stdout:9/626: mknod de/df/d1d/d23/d25/d28/cd1 0 2024-09-10T09:36:30.306 INFO:tasks.workunit.client.1.smithi135.stdout:3/459: mkdir d4/d5/db/d36/d43/d87 0 2024-09-10T09:36:30.313 INFO:tasks.workunit.client.1.smithi135.stdout:5/687: rename d3/d91/db5/cac to d3/dc/dba/d4e/d87/cf0 0 2024-09-10T09:36:30.315 INFO:tasks.workunit.client.1.smithi135.stdout:9/627: unlink de/df/d1d/d1e/l9d 0 2024-09-10T09:36:30.317 INFO:tasks.workunit.client.1.smithi135.stdout:0/639: rmdir d8/dd/d11/d90/dc4 39 2024-09-10T09:36:30.321 INFO:tasks.workunit.client.1.smithi135.stdout:9/628: creat de/df/d1d/d1e/db5/d88/fd2 x:0 0 0 2024-09-10T09:36:30.321 INFO:tasks.workunit.client.1.smithi135.stdout:9/629: fsync de/df/d1d/d1e/d68/fa4 0 2024-09-10T09:36:30.321 INFO:tasks.workunit.client.1.smithi135.stdout:9/630: write de/df/faf [462700,34984] 0 2024-09-10T09:36:30.321 INFO:tasks.workunit.client.1.smithi135.stdout:9/631: write de/df/d1d/d1e/db5/f6d [966506,16382] 0 2024-09-10T09:36:30.323 INFO:tasks.workunit.client.1.smithi135.stdout:3/460: rmdir d4/d55/d5d/d5b 39 2024-09-10T09:36:30.323 INFO:tasks.workunit.client.1.smithi135.stdout:3/461: chown d4/d5/dc/f50 44546297 1 2024-09-10T09:36:30.324 INFO:tasks.workunit.client.1.smithi135.stdout:0/640: creat d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/fd7 x:0 0 0 2024-09-10T09:36:30.324 INFO:tasks.workunit.client.1.smithi135.stdout:0/641: chown d8/dd/d4a/d50/d67/f71 11886039 1 2024-09-10T09:36:30.324 INFO:tasks.workunit.client.1.smithi135.stdout:0/642: write d8/dd/d4a/d50/d54/d5f/f7d [69598,113756] 0 2024-09-10T09:36:30.325 INFO:tasks.workunit.client.1.smithi135.stdout:0/643: stat d8/dd/d4a/d50/d54/d5f/f7d 0 2024-09-10T09:36:30.325 INFO:tasks.workunit.client.1.smithi135.stdout:0/644: creat d8/dd/d11/d90/fd8 x:0 0 0 2024-09-10T09:36:30.326 INFO:tasks.workunit.client.1.smithi135.stdout:9/632: rename de/df/d1d/d23/d25/cc0 to de/df/d1d/d1e/db5/d88/dc6/cd3 0 2024-09-10T09:36:30.329 INFO:tasks.workunit.client.1.smithi135.stdout:9/633: rmdir de/df/d1d/d23/d25/d28 39 2024-09-10T09:36:30.330 INFO:tasks.workunit.client.1.smithi135.stdout:9/634: mknod de/df/d1d/d23/d25/d78/cd4 0 2024-09-10T09:36:30.338 INFO:tasks.workunit.client.1.smithi135.stdout:3/462: read d4/f4d [2627033,82240] 0 2024-09-10T09:36:30.339 INFO:tasks.workunit.client.1.smithi135.stdout:8/549: dwrite d1/f5 [4194304,4194304] 0 2024-09-10T09:36:30.340 INFO:tasks.workunit.client.1.smithi135.stdout:3/463: link d4/d5/db/l22 d4/d5/db/d36/d6a/l88 0 2024-09-10T09:36:30.341 INFO:tasks.workunit.client.1.smithi135.stdout:8/550: creat d1/d15/d16/d99/fb6 x:0 0 0 2024-09-10T09:36:30.342 INFO:tasks.workunit.client.1.smithi135.stdout:4/789: dwrite d1/de/d16/d8b/fcc [0,4194304] 0 2024-09-10T09:36:30.342 INFO:tasks.workunit.client.1.smithi135.stdout:0/645: dread d8/f26 [0,4194304] 0 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:3/464: rename d4/d5/db/dd/d79/c33 to d4/d5/dc/c89 0 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:3/465: chown d4/d5/db/dd/l24 3 1 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:6/804: dwrite d5/d1e/d3b/f41 [0,4194304] 0 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:6/805: chown d5/dd/d50/d86/lae 1524 1 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:6/806: write d5/d1e/fe7 [3216482,85463] 0 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:6/807: truncate d5/dd/d50/d86/dcd/fee 514905 0 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:6/808: read d5/d15/f25 [2606706,18820] 0 2024-09-10T09:36:30.344 INFO:tasks.workunit.client.1.smithi135.stdout:6/809: chown d5/d1e/d3b/d42/f7d 31190 1 2024-09-10T09:36:30.345 INFO:tasks.workunit.client.1.smithi135.stdout:4/790: mknod d1/db/d9/d55/db5/cf5 0 2024-09-10T09:36:30.346 INFO:tasks.workunit.client.1.smithi135.stdout:0/646: rename d8/fcb to d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/fd9 0 2024-09-10T09:36:30.348 INFO:tasks.workunit.client.1.smithi135.stdout:4/791: creat d1/d4a/d9d/da1/ff6 x:0 0 0 2024-09-10T09:36:30.348 INFO:tasks.workunit.client.1.smithi135.stdout:4/792: dread - d1/d4a/d6d/fb0 zero size 2024-09-10T09:36:30.348 INFO:tasks.workunit.client.1.smithi135.stdout:0/647: mknod d8/de/d2e/cda 0 2024-09-10T09:36:30.349 INFO:tasks.workunit.client.1.smithi135.stdout:6/810: getdents d5/d15/d56 0 2024-09-10T09:36:30.350 INFO:tasks.workunit.client.1.smithi135.stdout:7/503: dwrite d2/f10 [0,4194304] 0 2024-09-10T09:36:30.350 INFO:tasks.workunit.client.1.smithi135.stdout:7/504: dread - d2/d25/d5d/d83/f89 zero size 2024-09-10T09:36:30.351 INFO:tasks.workunit.client.1.smithi135.stdout:7/505: dread - d2/d25/d5d/d83/f9a zero size 2024-09-10T09:36:30.351 INFO:tasks.workunit.client.1.smithi135.stdout:7/506: dread - d2/d25/d5d/f8d zero size 2024-09-10T09:36:30.351 INFO:tasks.workunit.client.1.smithi135.stdout:6/811: getdents d5/d58 0 2024-09-10T09:36:30.352 INFO:tasks.workunit.client.1.smithi135.stdout:6/812: write d5/d1e/d62/fb7 [1551258,119742] 0 2024-09-10T09:36:30.353 INFO:tasks.workunit.client.1.smithi135.stdout:5/688: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:30.353 INFO:tasks.workunit.client.1.smithi135.stdout:2/641: dwrite df/d1b/f9c [0,4194304] 0 2024-09-10T09:36:30.353 INFO:tasks.workunit.client.1.smithi135.stdout:9/635: dwrite de/df/f3e [0,4194304] 0 2024-09-10T09:36:30.354 INFO:tasks.workunit.client.1.smithi135.stdout:8/551: write d1/f23 [694987,56590] 0 2024-09-10T09:36:30.354 INFO:tasks.workunit.client.1.smithi135.stdout:1/707: dwrite d1d/d20/d52/d8a/dc2/dca/f4d [0,4194304] 0 2024-09-10T09:36:30.354 INFO:tasks.workunit.client.1.smithi135.stdout:1/708: fdatasync d1d/d20/d52/d8a/dc2/dca/db4/fcd 0 2024-09-10T09:36:30.354 INFO:tasks.workunit.client.1.smithi135.stdout:0/648: dread d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1/f7b [0,4194304] 0 2024-09-10T09:36:30.355 INFO:tasks.workunit.client.1.smithi135.stdout:0/649: write d8/dd/d4a/fc9 [295740,62251] 0 2024-09-10T09:36:30.355 INFO:tasks.workunit.client.1.smithi135.stdout:0/650: write d8/dd/d18/d3d/dc3/f57 [1247261,75363] 0 2024-09-10T09:36:30.355 INFO:tasks.workunit.client.1.smithi135.stdout:7/507: rename d2/d15/d5c/d85/l99 to d2/d15/d41/d49/la3 0 2024-09-10T09:36:30.356 INFO:tasks.workunit.client.1.smithi135.stdout:7/508: read d2/d25/f38 [4384529,129429] 0 2024-09-10T09:36:30.358 INFO:tasks.workunit.client.1.smithi135.stdout:6/813: mkdir d5/d15/d56/d106 0 2024-09-10T09:36:30.359 INFO:tasks.workunit.client.1.smithi135.stdout:5/689: rmdir d3/dc/d69 39 2024-09-10T09:36:30.359 INFO:tasks.workunit.client.1.smithi135.stdout:3/466: write d4/d5/db/f3a [1933073,76184] 0 2024-09-10T09:36:30.360 INFO:tasks.workunit.client.1.smithi135.stdout:3/467: creat d4/d5/db/dd/d79/f8a x:0 0 0 2024-09-10T09:36:30.360 INFO:tasks.workunit.client.1.smithi135.stdout:3/468: chown d4/f4d 610643 1 2024-09-10T09:36:30.360 INFO:tasks.workunit.client.1.smithi135.stdout:3/469: dread - d4/d5/db/d36/d6a/f82 zero size 2024-09-10T09:36:30.369 INFO:tasks.workunit.client.1.smithi135.stdout:7/509: read d2/d25/f38 [1740445,113342] 0 2024-09-10T09:36:30.370 INFO:tasks.workunit.client.1.smithi135.stdout:9/636: getdents de/df/d1d/d1e/db5 0 2024-09-10T09:36:30.373 INFO:tasks.workunit.client.1.smithi135.stdout:8/552: mkdir d1/d27/d3d/db7 0 2024-09-10T09:36:30.373 INFO:tasks.workunit.client.1.smithi135.stdout:6/814: dread d5/d15/d27/f3f [4194304,4194304] 0 2024-09-10T09:36:30.377 INFO:tasks.workunit.client.1.smithi135.stdout:1/709: rename d1d/f21 to d1d/d20/d52/d8a/dc2/dca/d37/fe4 0 2024-09-10T09:36:30.379 INFO:tasks.workunit.client.1.smithi135.stdout:5/690: truncate d3/dc/dba/d48/d57/f67 627198 0 2024-09-10T09:36:30.386 INFO:tasks.workunit.client.1.smithi135.stdout:7/510: symlink d2/d15/d4a/d36/d84/la4 0 2024-09-10T09:36:30.387 INFO:tasks.workunit.client.1.smithi135.stdout:0/651: dwrite d8/dd/db0/fd1 [0,4194304] 0 2024-09-10T09:36:30.388 INFO:tasks.workunit.client.1.smithi135.stdout:9/637: unlink de/df/d1d/d1e/d3f/f9a 0 2024-09-10T09:36:30.389 INFO:tasks.workunit.client.1.smithi135.stdout:8/553: creat d1/d8f/fb8 x:0 0 0 2024-09-10T09:36:30.389 INFO:tasks.workunit.client.1.smithi135.stdout:8/554: chown d1/d15/d16/d33/d45/d6f/ca5 12660762 1 2024-09-10T09:36:30.390 INFO:tasks.workunit.client.1.smithi135.stdout:6/815: symlink d5/d58/l107 0 2024-09-10T09:36:30.390 INFO:tasks.workunit.client.1.smithi135.stdout:6/816: chown d5/dd/d50/ffb 3 1 2024-09-10T09:36:30.392 INFO:tasks.workunit.client.1.smithi135.stdout:5/691: symlink d3/dc/dba/d48/d57/dca/lf1 0 2024-09-10T09:36:30.393 INFO:tasks.workunit.client.1.smithi135.stdout:4/793: dwrite d1/f77 [0,4194304] 0 2024-09-10T09:36:30.394 INFO:tasks.workunit.client.1.smithi135.stdout:3/470: dwrite d4/d5/dc/f19 [8388608,4194304] 0 2024-09-10T09:36:30.396 INFO:tasks.workunit.client.1.smithi135.stdout:1/710: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/f3a [0,4194304] 0 2024-09-10T09:36:30.400 INFO:tasks.workunit.client.1.smithi135.stdout:0/652: creat d8/dd/d11/d90/dc4/fdb x:0 0 0 2024-09-10T09:36:30.405 INFO:tasks.workunit.client.1.smithi135.stdout:9/638: link f9 de/df/d1d/d1e/d68/d9f/fd5 0 2024-09-10T09:36:30.405 INFO:tasks.workunit.client.1.smithi135.stdout:6/817: dread d5/d1e/fe7 [0,4194304] 0 2024-09-10T09:36:30.410 INFO:tasks.workunit.client.1.smithi135.stdout:8/555: creat d1/d15/d16/d33/d39/fb9 x:0 0 0 2024-09-10T09:36:30.410 INFO:tasks.workunit.client.1.smithi135.stdout:8/556: readlink d1/d15/d16/d33/d45/l7a 0 2024-09-10T09:36:30.414 INFO:tasks.workunit.client.1.smithi135.stdout:6/818: dread d5/d1e/d35/f4b [0,4194304] 0 2024-09-10T09:36:30.415 INFO:tasks.workunit.client.1.smithi135.stdout:5/692: rmdir d3/dc/dba/d48 39 2024-09-10T09:36:30.416 INFO:tasks.workunit.client.1.smithi135.stdout:5/693: dread d3/dc/dba/dae/fce [0,4194304] 0 2024-09-10T09:36:30.417 INFO:tasks.workunit.client.1.smithi135.stdout:7/511: rename d2/d15/d41/d49/d60/d54 to d2/d15/d5c/d62/da5 0 2024-09-10T09:36:30.422 INFO:tasks.workunit.client.1.smithi135.stdout:4/794: mkdir d1/d85/dc4/df7 0 2024-09-10T09:36:30.422 INFO:tasks.workunit.client.1.smithi135.stdout:4/795: chown d1/d8a 5 1 2024-09-10T09:36:30.432 INFO:tasks.workunit.client.1.smithi135.stdout:9/639: unlink de/df/d1d/d23/c2b 0 2024-09-10T09:36:30.436 INFO:tasks.workunit.client.1.smithi135.stdout:3/471: dwrite d4/f3b [4194304,4194304] 0 2024-09-10T09:36:30.436 INFO:tasks.workunit.client.1.smithi135.stdout:3/472: chown d4/ca 154 1 2024-09-10T09:36:30.437 INFO:tasks.workunit.client.1.smithi135.stdout:8/557: mknod d1/d8f/da2/cba 0 2024-09-10T09:36:30.437 INFO:tasks.workunit.client.1.smithi135.stdout:0/653: dwrite d8/dd/db0/fd1 [0,4194304] 0 2024-09-10T09:36:30.437 INFO:tasks.workunit.client.1.smithi135.stdout:0/654: dread - d8/dd/d18/d3d/dc3/d61/f94 zero size 2024-09-10T09:36:30.439 INFO:tasks.workunit.client.1.smithi135.stdout:7/512: creat d2/d15/d5c/d62/da5/d5e/fa6 x:0 0 0 2024-09-10T09:36:30.439 INFO:tasks.workunit.client.1.smithi135.stdout:7/513: dread - d2/d15/d41/d49/d60/f75 zero size 2024-09-10T09:36:30.439 INFO:tasks.workunit.client.1.smithi135.stdout:7/514: stat d2/d15/d5c/f95 0 2024-09-10T09:36:30.442 INFO:tasks.workunit.client.1.smithi135.stdout:9/640: unlink de/df/d1d/d23/d25/d28/d4e/f73 0 2024-09-10T09:36:30.442 INFO:tasks.workunit.client.1.smithi135.stdout:9/641: write de/df/d1d/d1e/db5/f6d [1146220,6669] 0 2024-09-10T09:36:30.444 INFO:tasks.workunit.client.1.smithi135.stdout:0/655: rmdir d8/dd/d18/d3d/dc3/d37/d73 39 2024-09-10T09:36:30.445 INFO:tasks.workunit.client.1.smithi135.stdout:2/642: truncate df/d1b/f9c 518554 0 2024-09-10T09:36:30.445 INFO:tasks.workunit.client.1.smithi135.stdout:2/643: write df/f10 [3166327,39900] 0 2024-09-10T09:36:30.447 INFO:tasks.workunit.client.1.smithi135.stdout:7/515: rename d2/d15/d4a/d36/f78 to d2/d25/d9d/fa7 0 2024-09-10T09:36:30.448 INFO:tasks.workunit.client.1.smithi135.stdout:3/473: dread f1 [0,4194304] 0 2024-09-10T09:36:30.449 INFO:tasks.workunit.client.1.smithi135.stdout:8/558: dread d1/d15/d16/d33/d45/f5d [4194304,4194304] 0 2024-09-10T09:36:30.449 INFO:tasks.workunit.client.1.smithi135.stdout:1/711: dwrite d1d/f2c [0,4194304] 0 2024-09-10T09:36:30.450 INFO:tasks.workunit.client.1.smithi135.stdout:6/819: dwrite d5/dd/d50/d54/db9/fd1 [0,4194304] 0 2024-09-10T09:36:30.451 INFO:tasks.workunit.client.1.smithi135.stdout:2/644: symlink df/d1b/d23/d98/d5f/d2c/lcf 0 2024-09-10T09:36:30.453 INFO:tasks.workunit.client.1.smithi135.stdout:5/694: dwrite d3/fd6 [0,4194304] 0 2024-09-10T09:36:30.453 INFO:tasks.workunit.client.1.smithi135.stdout:6/820: dread d5/d1e/d3b/d49/f94 [0,4194304] 0 2024-09-10T09:36:30.453 INFO:tasks.workunit.client.1.smithi135.stdout:6/821: readlink d5/d1e/d35/l18 0 2024-09-10T09:36:30.453 INFO:tasks.workunit.client.1.smithi135.stdout:6/822: write d5/d1e/d3b/d42/fda [830930,110173] 0 2024-09-10T09:36:30.456 INFO:tasks.workunit.client.1.smithi135.stdout:9/642: write de/df/d1d/d1e/d68/fa4 [817949,16094] 0 2024-09-10T09:36:30.456 INFO:tasks.workunit.client.1.smithi135.stdout:9/643: fsync de/df/d1d/d23/d25/f48 0 2024-09-10T09:36:30.456 INFO:tasks.workunit.client.1.smithi135.stdout:9/644: write de/df/d1d/d1e/d68/d9f/fab [70957,25773] 0 2024-09-10T09:36:30.456 INFO:tasks.workunit.client.1.smithi135.stdout:9/645: truncate de/df/d1d/d1e/d52/fc8 375050 0 2024-09-10T09:36:30.456 INFO:tasks.workunit.client.1.smithi135.stdout:9/646: dread - de/df/d1d/d1e/db5/d88/f89 zero size 2024-09-10T09:36:30.456 INFO:tasks.workunit.client.1.smithi135.stdout:9/647: creat de/df/d1d/d1e/db5/d88/fd6 x:0 0 0 2024-09-10T09:36:30.457 INFO:tasks.workunit.client.1.smithi135.stdout:0/656: rename d8/dd/d18/d3d/dc3/d37/d9c/dcf/ld5 to d8/dd/d33/ldc 0 2024-09-10T09:36:30.457 INFO:tasks.workunit.client.1.smithi135.stdout:0/657: creat d8/dd/d4a/d50/fdd x:0 0 0 2024-09-10T09:36:30.458 INFO:tasks.workunit.client.1.smithi135.stdout:4/796: dwrite d1/de/f59 [0,4194304] 0 2024-09-10T09:36:30.458 INFO:tasks.workunit.client.1.smithi135.stdout:4/797: creat d1/de/d16/d98/ff8 x:0 0 0 2024-09-10T09:36:30.459 INFO:tasks.workunit.client.1.smithi135.stdout:7/516: unlink d2/d15/f80 0 2024-09-10T09:36:30.461 INFO:tasks.workunit.client.1.smithi135.stdout:3/474: mkdir d4/d5/dc/d8b 0 2024-09-10T09:36:30.461 INFO:tasks.workunit.client.1.smithi135.stdout:3/475: creat d4/d5/f8c x:0 0 0 2024-09-10T09:36:30.463 INFO:tasks.workunit.client.1.smithi135.stdout:8/559: write d1/d15/d49/d69/f84 [3301226,73552] 0 2024-09-10T09:36:30.465 INFO:tasks.workunit.client.1.smithi135.stdout:2/645: mknod df/d1b/d23/d98/d5f/d3d/d87/db0/cd0 0 2024-09-10T09:36:30.465 INFO:tasks.workunit.client.1.smithi135.stdout:2/646: read df/d1b/d23/d98/d5f/d2c/f81 [2280124,79981] 0 2024-09-10T09:36:30.467 INFO:tasks.workunit.client.1.smithi135.stdout:0/658: dread d8/dd/f13 [0,4194304] 0 2024-09-10T09:36:30.468 INFO:tasks.workunit.client.1.smithi135.stdout:5/695: rmdir d3/dc/dba/d48/d57/da3/db1 39 2024-09-10T09:36:30.471 INFO:tasks.workunit.client.1.smithi135.stdout:1/712: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/d4c/faa [0,4194304] 0 2024-09-10T09:36:30.471 INFO:tasks.workunit.client.1.smithi135.stdout:1/713: dread - d1d/d20/d6c/fc6 zero size 2024-09-10T09:36:30.471 INFO:tasks.workunit.client.1.smithi135.stdout:9/648: truncate de/df/d1d/d23/d25/f74 541908 0 2024-09-10T09:36:30.471 INFO:tasks.workunit.client.1.smithi135.stdout:9/649: write de/f80 [330249,6838] 0 2024-09-10T09:36:30.472 INFO:tasks.workunit.client.1.smithi135.stdout:4/798: dread d1/f77 [0,4194304] 0 2024-09-10T09:36:30.472 INFO:tasks.workunit.client.1.smithi135.stdout:4/799: chown d1/de/f57 19 1 2024-09-10T09:36:30.474 INFO:tasks.workunit.client.1.smithi135.stdout:6/823: rename d5/d1e/d3b/d74/deb/df2 to d5/dd/d50/d54/da9/de4/d108 0 2024-09-10T09:36:30.481 INFO:tasks.workunit.client.1.smithi135.stdout:0/659: write d8/dd/d18/d3d/dc3/f98 [97942,53849] 0 2024-09-10T09:36:30.482 INFO:tasks.workunit.client.1.smithi135.stdout:0/660: write d8/de/f68 [4755414,103146] 0 2024-09-10T09:36:30.486 INFO:tasks.workunit.client.1.smithi135.stdout:2/647: creat df/fd1 x:0 0 0 2024-09-10T09:36:30.488 INFO:tasks.workunit.client.1.smithi135.stdout:5/696: creat d3/dc/dba/d48/d57/da3/db1/ff2 x:0 0 0 2024-09-10T09:36:30.498 INFO:tasks.workunit.client.1.smithi135.stdout:6/824: dwrite d5/dd/d50/d86/dcd/fee [0,4194304] 0 2024-09-10T09:36:30.499 INFO:tasks.workunit.client.1.smithi135.stdout:1/714: getdents d1d/d28/d4b/d53 0 2024-09-10T09:36:30.504 INFO:tasks.workunit.client.1.smithi135.stdout:4/800: mkdir d1/de/d16/df9 0 2024-09-10T09:36:30.504 INFO:tasks.workunit.client.1.smithi135.stdout:4/801: write d1/de/d16/d95/fad [178305,64915] 0 2024-09-10T09:36:30.507 INFO:tasks.workunit.client.1.smithi135.stdout:0/661: chown d8/dd/c72 3586243 1 2024-09-10T09:36:30.510 INFO:tasks.workunit.client.1.smithi135.stdout:7/517: mkdir d2/d25/da8 0 2024-09-10T09:36:30.511 INFO:tasks.workunit.client.1.smithi135.stdout:2/648: dwrite df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf [0,4194304] 0 2024-09-10T09:36:30.511 INFO:tasks.workunit.client.1.smithi135.stdout:2/649: truncate df/d1b/d23/fbe 833399 0 2024-09-10T09:36:30.513 INFO:tasks.workunit.client.1.smithi135.stdout:7/518: dread d2/f1e [0,4194304] 0 2024-09-10T09:36:30.527 INFO:tasks.workunit.client.1.smithi135.stdout:0/662: dread d8/dd/d11/d17/f42 [0,4194304] 0 2024-09-10T09:36:30.527 INFO:tasks.workunit.client.1.smithi135.stdout:5/697: dwrite d3/dc/dba/d88/fe8 [0,4194304] 0 2024-09-10T09:36:30.535 INFO:tasks.workunit.client.1.smithi135.stdout:1/715: mknod d1d/d28/d4b/ce5 0 2024-09-10T09:36:30.536 INFO:tasks.workunit.client.1.smithi135.stdout:1/716: read - d1d/d20/fa6 zero size 2024-09-10T09:36:30.536 INFO:tasks.workunit.client.1.smithi135.stdout:5/698: dread d3/d91/f98 [0,4194304] 0 2024-09-10T09:36:30.541 INFO:tasks.workunit.client.1.smithi135.stdout:4/802: creat d1/db/d9/d55/d76/ffa x:0 0 0 2024-09-10T09:36:30.542 INFO:tasks.workunit.client.1.smithi135.stdout:4/803: read d1/de/dde/fe5 [133437,497] 0 2024-09-10T09:36:30.547 INFO:tasks.workunit.client.1.smithi135.stdout:3/476: truncate f1 5771811 0 2024-09-10T09:36:30.547 INFO:tasks.workunit.client.1.smithi135.stdout:3/477: fdatasync f1 0 2024-09-10T09:36:30.547 INFO:tasks.workunit.client.1.smithi135.stdout:0/663: dwrite d8/de/f68 [0,4194304] 0 2024-09-10T09:36:30.549 INFO:tasks.workunit.client.1.smithi135.stdout:7/519: creat d2/d15/d41/d49/d60/d30/d71/fa9 x:0 0 0 2024-09-10T09:36:30.549 INFO:tasks.workunit.client.1.smithi135.stdout:7/520: chown d2/d15/d5c/l7f 2 1 2024-09-10T09:36:30.550 INFO:tasks.workunit.client.1.smithi135.stdout:8/560: truncate d1/f5 7389446 0 2024-09-10T09:36:30.550 INFO:tasks.workunit.client.1.smithi135.stdout:8/561: fdatasync d1/d15/d24/f2c 0 2024-09-10T09:36:30.558 INFO:tasks.workunit.client.1.smithi135.stdout:9/650: truncate de/df/faf 282783 0 2024-09-10T09:36:30.558 INFO:tasks.workunit.client.1.smithi135.stdout:9/651: chown de/df/c3b 176 1 2024-09-10T09:36:30.564 INFO:tasks.workunit.client.1.smithi135.stdout:5/699: dwrite d3/fd6 [0,4194304] 0 2024-09-10T09:36:30.565 INFO:tasks.workunit.client.1.smithi135.stdout:4/804: dwrite d1/db/d9/d55/d70/fc2 [0,4194304] 0 2024-09-10T09:36:30.566 INFO:tasks.workunit.client.1.smithi135.stdout:4/805: stat d1/de/d16/d8b/dc6/fcd 0 2024-09-10T09:36:30.566 INFO:tasks.workunit.client.1.smithi135.stdout:4/806: truncate d1/d85/fed 733017 0 2024-09-10T09:36:30.581 INFO:tasks.workunit.client.1.smithi135.stdout:5/700: dwrite d3/f5 [0,4194304] 0 2024-09-10T09:36:30.587 INFO:tasks.workunit.client.1.smithi135.stdout:6/825: rmdir d5/d1e/d3b 39 2024-09-10T09:36:30.588 INFO:tasks.workunit.client.1.smithi135.stdout:1/717: creat d1d/d28/d4b/dda/fe6 x:0 0 0 2024-09-10T09:36:30.593 INFO:tasks.workunit.client.1.smithi135.stdout:0/664: mkdir d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1/dde 0 2024-09-10T09:36:30.593 INFO:tasks.workunit.client.1.smithi135.stdout:0/665: readlink d8/dd/d18/d3d/dc3/d61/la4 0 2024-09-10T09:36:30.593 INFO:tasks.workunit.client.1.smithi135.stdout:7/521: rmdir d2/d15/d81 39 2024-09-10T09:36:30.595 INFO:tasks.workunit.client.1.smithi135.stdout:8/562: rename d1/d13/f2f to d1/d27/d3d/d94/da7/fbb 0 2024-09-10T09:36:30.598 INFO:tasks.workunit.client.1.smithi135.stdout:9/652: mknod de/df/dac/db7/cd7 0 2024-09-10T09:36:30.598 INFO:tasks.workunit.client.1.smithi135.stdout:9/653: fsync de/df/d1d/d1e/db5/d88/f89 0 2024-09-10T09:36:30.602 INFO:tasks.workunit.client.1.smithi135.stdout:0/666: dread d8/dd/d18/d3d/dc3/d37/f64 [0,4194304] 0 2024-09-10T09:36:30.603 INFO:tasks.workunit.client.1.smithi135.stdout:4/807: creat d1/de/d16/d95/ffb x:0 0 0 2024-09-10T09:36:30.603 INFO:tasks.workunit.client.1.smithi135.stdout:4/808: truncate d1/d4a/d6d/fb0 616068 0 2024-09-10T09:36:30.603 INFO:tasks.workunit.client.1.smithi135.stdout:4/809: chown d1/de/d16/d95/cd8 549621 1 2024-09-10T09:36:30.606 INFO:tasks.workunit.client.1.smithi135.stdout:7/522: read d2/d25/d5d/f4f [329971,65478] 0 2024-09-10T09:36:30.606 INFO:tasks.workunit.client.1.smithi135.stdout:5/701: link d3/dc/dba/d48/d57/f67 d3/d71/d61/ff3 0 2024-09-10T09:36:30.606 INFO:tasks.workunit.client.1.smithi135.stdout:1/718: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/f3a [0,4194304] 0 2024-09-10T09:36:30.608 INFO:tasks.workunit.client.1.smithi135.stdout:6/826: mknod d5/d1e/d3b/d42/d2d/d64/c109 0 2024-09-10T09:36:30.608 INFO:tasks.workunit.client.1.smithi135.stdout:3/478: getdents d4/d5/db/dd/d79 0 2024-09-10T09:36:30.612 INFO:tasks.workunit.client.1.smithi135.stdout:8/563: symlink d1/d15/d49/d7c/lbc 0 2024-09-10T09:36:30.612 INFO:tasks.workunit.client.1.smithi135.stdout:8/564: fsync d1/d15/d16/f75 0 2024-09-10T09:36:30.612 INFO:tasks.workunit.client.1.smithi135.stdout:8/565: creat d1/d15/d49/fbd x:0 0 0 2024-09-10T09:36:30.615 INFO:tasks.workunit.client.1.smithi135.stdout:0/667: rename d8/dd/d4a/d50/d54/d5f/l2a to d8/dd/d11/d90/ldf 0 2024-09-10T09:36:30.617 INFO:tasks.workunit.client.1.smithi135.stdout:4/810: rmdir d1/d4a/d9d/da1/dd6 39 2024-09-10T09:36:30.618 INFO:tasks.workunit.client.1.smithi135.stdout:4/811: read d1/d8a/fae [1673555,95801] 0 2024-09-10T09:36:30.618 INFO:tasks.workunit.client.1.smithi135.stdout:4/812: write d1/de/d16/f69 [3205545,34193] 0 2024-09-10T09:36:30.618 INFO:tasks.workunit.client.1.smithi135.stdout:4/813: readlink d1/l12 0 2024-09-10T09:36:30.622 INFO:tasks.workunit.client.1.smithi135.stdout:5/702: unlink d3/f18 0 2024-09-10T09:36:30.627 INFO:tasks.workunit.client.1.smithi135.stdout:6/827: truncate d5/f17 3754624 0 2024-09-10T09:36:30.627 INFO:tasks.workunit.client.1.smithi135.stdout:6/828: creat d5/d15/ddf/f10a x:0 0 0 2024-09-10T09:36:30.627 INFO:tasks.workunit.client.1.smithi135.stdout:6/829: fdatasync d5/d1e/d3b/d42/d2d/d55/d5b/f91 0 2024-09-10T09:36:30.630 INFO:tasks.workunit.client.1.smithi135.stdout:8/566: creat d1/d15/d16/d96/fbe x:0 0 0 2024-09-10T09:36:30.631 INFO:tasks.workunit.client.1.smithi135.stdout:8/567: fdatasync d1/d15/d16/d33/fa1 0 2024-09-10T09:36:30.631 INFO:tasks.workunit.client.1.smithi135.stdout:1/719: rename d1d/d20/f94 to d1d/d71/d9e/fe7 0 2024-09-10T09:36:30.633 INFO:tasks.workunit.client.1.smithi135.stdout:7/523: mkdir d2/d25/daa 0 2024-09-10T09:36:30.636 INFO:tasks.workunit.client.1.smithi135.stdout:4/814: unlink d1/de/d16/f5b 0 2024-09-10T09:36:30.637 INFO:tasks.workunit.client.1.smithi135.stdout:0/668: dwrite d8/dd/d4a/d50/d54/d5f/f30 [0,4194304] 0 2024-09-10T09:36:30.640 INFO:tasks.workunit.client.1.smithi135.stdout:5/703: mknod d3/dc/dba/d4e/d87/cf4 0 2024-09-10T09:36:30.640 INFO:tasks.workunit.client.1.smithi135.stdout:9/654: dwrite de/df/d1d/d23/d25/d28/f49 [0,4194304] 0 2024-09-10T09:36:30.643 INFO:tasks.workunit.client.1.smithi135.stdout:6/830: mknod d5/d58/c10b 0 2024-09-10T09:36:30.643 INFO:tasks.workunit.client.1.smithi135.stdout:6/831: readlink d5/d15/d27/l6c 0 2024-09-10T09:36:30.646 INFO:tasks.workunit.client.1.smithi135.stdout:8/568: symlink d1/d15/d49/d7c/lbf 0 2024-09-10T09:36:30.647 INFO:tasks.workunit.client.1.smithi135.stdout:8/569: chown d1/d15/d24 37 1 2024-09-10T09:36:30.649 INFO:tasks.workunit.client.1.smithi135.stdout:7/524: dwrite d2/d25/f65 [0,4194304] 0 2024-09-10T09:36:30.649 INFO:tasks.workunit.client.1.smithi135.stdout:7/525: dread - d2/d15/d5c/d62/da5/d5e/fa6 zero size 2024-09-10T09:36:30.649 INFO:tasks.workunit.client.1.smithi135.stdout:3/479: rename d4/d5/dc/f57 to d4/d55/d5d/d5b/f8d 0 2024-09-10T09:36:30.653 INFO:tasks.workunit.client.1.smithi135.stdout:1/720: creat d1d/d28/fe8 x:0 0 0 2024-09-10T09:36:30.653 INFO:tasks.workunit.client.1.smithi135.stdout:1/721: dread - d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/fd5 zero size 2024-09-10T09:36:30.657 INFO:tasks.workunit.client.1.smithi135.stdout:7/526: read d2/d15/d4a/f48 [8118091,36928] 0 2024-09-10T09:36:30.664 INFO:tasks.workunit.client.1.smithi135.stdout:4/815: unlink d1/de/d16/d95/cd8 0 2024-09-10T09:36:30.665 INFO:tasks.workunit.client.1.smithi135.stdout:4/816: fsync d1/d4a/d9d/da1/ff6 0 2024-09-10T09:36:30.666 INFO:tasks.workunit.client.1.smithi135.stdout:0/669: symlink d8/dd/d18/d3d/le0 0 2024-09-10T09:36:30.667 INFO:tasks.workunit.client.1.smithi135.stdout:3/480: dwrite d4/d5/db/d44/f4e [0,4194304] 0 2024-09-10T09:36:30.667 INFO:tasks.workunit.client.1.smithi135.stdout:3/481: write d4/d55/d5d/f1e [1165078,41407] 0 2024-09-10T09:36:30.675 INFO:tasks.workunit.client.1.smithi135.stdout:5/704: creat d3/dc/d69/d65/d6c/ff5 x:0 0 0 2024-09-10T09:36:30.680 INFO:tasks.workunit.client.1.smithi135.stdout:9/655: creat de/df/dac/db7/fd8 x:0 0 0 2024-09-10T09:36:30.681 INFO:tasks.workunit.client.1.smithi135.stdout:0/670: write d8/de/f4d [6920159,112045] 0 2024-09-10T09:36:30.682 INFO:tasks.workunit.client.1.smithi135.stdout:4/817: dread d1/db/d23/f42 [0,4194304] 0 2024-09-10T09:36:30.682 INFO:tasks.workunit.client.1.smithi135.stdout:4/818: stat d1/d8a/fa3 0 2024-09-10T09:36:30.682 INFO:tasks.workunit.client.1.smithi135.stdout:5/705: dread d3/d99/fbb [4194304,4194304] 0 2024-09-10T09:36:30.682 INFO:tasks.workunit.client.1.smithi135.stdout:5/706: fdatasync d3/dc/d69/f73 0 2024-09-10T09:36:30.682 INFO:tasks.workunit.client.1.smithi135.stdout:5/707: write d3/dc/dba/d48/d57/da3/fc6 [298664,33753] 0 2024-09-10T09:36:30.685 INFO:tasks.workunit.client.1.smithi135.stdout:3/482: dwrite d4/d5/db/d36/d43/f46 [4194304,4194304] 0 2024-09-10T09:36:30.685 INFO:tasks.workunit.client.1.smithi135.stdout:8/570: link d1/d15/d16/d33/d45/d6f/fb4 d1/d27/d3d/d94/fc0 0 2024-09-10T09:36:30.685 INFO:tasks.workunit.client.1.smithi135.stdout:8/571: truncate d1/d27/d3d/d94/da7/fbb 361427 0 2024-09-10T09:36:30.693 INFO:tasks.workunit.client.1.smithi135.stdout:7/527: mknod d2/d15/d5c/d62/cab 0 2024-09-10T09:36:30.702 INFO:tasks.workunit.client.1.smithi135.stdout:0/671: creat d8/fe1 x:0 0 0 2024-09-10T09:36:30.703 INFO:tasks.workunit.client.1.smithi135.stdout:4/819: creat d1/db/d9/ffc x:0 0 0 2024-09-10T09:36:30.705 INFO:tasks.workunit.client.1.smithi135.stdout:6/832: truncate d5/f17 1545857 0 2024-09-10T09:36:30.705 INFO:tasks.workunit.client.1.smithi135.stdout:6/833: chown d5/dd/d50/d57 191582 1 2024-09-10T09:36:30.708 INFO:tasks.workunit.client.1.smithi135.stdout:5/708: creat d3/dc/dba/d48/d57/dc4/ff6 x:0 0 0 2024-09-10T09:36:30.714 INFO:tasks.workunit.client.1.smithi135.stdout:3/483: rename d4/d5/dc/c48 to d4/d5/db/dd/c8e 0 2024-09-10T09:36:30.715 INFO:tasks.workunit.client.1.smithi135.stdout:6/834: dread f4 [0,4194304] 0 2024-09-10T09:36:30.716 INFO:tasks.workunit.client.1.smithi135.stdout:6/835: chown d5/dd/d50/db3/lc7 112604 1 2024-09-10T09:36:30.716 INFO:tasks.workunit.client.1.smithi135.stdout:9/656: dwrite de/df/d1d/d23/f27 [0,4194304] 0 2024-09-10T09:36:30.716 INFO:tasks.workunit.client.1.smithi135.stdout:8/572: stat d1/d15/d49/f4e 0 2024-09-10T09:36:30.717 INFO:tasks.workunit.client.1.smithi135.stdout:1/722: rmdir d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1 39 2024-09-10T09:36:30.717 INFO:tasks.workunit.client.1.smithi135.stdout:1/723: read - d1d/d28/fe8 zero size 2024-09-10T09:36:30.719 INFO:tasks.workunit.client.1.smithi135.stdout:7/528: mkdir d2/d15/d5c/d62/da5/d5e/dac 0 2024-09-10T09:36:30.719 INFO:tasks.workunit.client.1.smithi135.stdout:7/529: write d2/d25/d5d/f4f [3043837,128724] 0 2024-09-10T09:36:30.719 INFO:tasks.workunit.client.1.smithi135.stdout:7/530: write d2/f77 [548047,87017] 0 2024-09-10T09:36:30.721 INFO:tasks.workunit.client.1.smithi135.stdout:0/672: mkdir d8/dd/d18/d3d/dc3/d37/d9c/de2 0 2024-09-10T09:36:30.724 INFO:tasks.workunit.client.1.smithi135.stdout:5/709: unlink d3/dc/d16/f45 0 2024-09-10T09:36:30.725 INFO:tasks.workunit.client.1.smithi135.stdout:3/484: symlink d4/d5/dc/l8f 0 2024-09-10T09:36:30.727 INFO:tasks.workunit.client.1.smithi135.stdout:6/836: creat d5/dd/d50/d86/dcd/f10c x:0 0 0 2024-09-10T09:36:30.730 INFO:tasks.workunit.client.1.smithi135.stdout:9/657: creat de/df/d1d/d1e/d52/fd9 x:0 0 0 2024-09-10T09:36:30.733 INFO:tasks.workunit.client.1.smithi135.stdout:8/573: rename d1/d15/d16/d71/c91 to d1/d8f/da2/cc1 0 2024-09-10T09:36:30.735 INFO:tasks.workunit.client.1.smithi135.stdout:1/724: mkdir d1d/d20/d6c/de9 0 2024-09-10T09:36:30.738 INFO:tasks.workunit.client.1.smithi135.stdout:7/531: dread d2/d15/d4a/d36/f59 [0,4194304] 0 2024-09-10T09:36:30.740 INFO:tasks.workunit.client.1.smithi135.stdout:0/673: link d8/dd/d4a/d50/d54/d5f/d4b/la5 d8/dd/d11/le3 0 2024-09-10T09:36:30.740 INFO:tasks.workunit.client.1.smithi135.stdout:4/820: getdents d1/d4a/d6d 0 2024-09-10T09:36:30.743 INFO:tasks.workunit.client.1.smithi135.stdout:9/658: creat de/df/fda x:0 0 0 2024-09-10T09:36:30.745 INFO:tasks.workunit.client.1.smithi135.stdout:1/725: dread d1d/d20/d5d/fba [0,4194304] 0 2024-09-10T09:36:30.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/485: dwrite d4/d5/db/d36/d43/f46 [4194304,4194304] 0 2024-09-10T09:36:30.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/486: dread - d4/f7b zero size 2024-09-10T09:36:30.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/487: write d4/d5/db/dd/f5f [1047039,101964] 0 2024-09-10T09:36:30.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/488: fdatasync d4/d5/d51/f7d 0 2024-09-10T09:36:30.749 INFO:tasks.workunit.client.1.smithi135.stdout:5/710: rename d3/dc/d16/f34 to d3/dc/d69/d65/d6c/ff7 0 2024-09-10T09:36:30.751 INFO:tasks.workunit.client.1.smithi135.stdout:8/574: unlink d1/d27/l9e 0 2024-09-10T09:36:30.751 INFO:tasks.workunit.client.1.smithi135.stdout:8/575: readlink d1/d15/l8b 0 2024-09-10T09:36:30.751 INFO:tasks.workunit.client.1.smithi135.stdout:8/576: chown d1/d27/f68 2 1 2024-09-10T09:36:30.755 INFO:tasks.workunit.client.1.smithi135.stdout:3/489: dread d4/d5/dc/f17 [0,4194304] 0 2024-09-10T09:36:30.757 INFO:tasks.workunit.client.1.smithi135.stdout:7/532: unlink d2/d15/d5c/l7f 0 2024-09-10T09:36:30.758 INFO:tasks.workunit.client.1.smithi135.stdout:4/821: stat d1/db/d9/d55/d70/da4/cb2 0 2024-09-10T09:36:30.761 INFO:tasks.workunit.client.1.smithi135.stdout:9/659: mkdir de/df/d1d/d1e/d3f/ddb 0 2024-09-10T09:36:30.761 INFO:tasks.workunit.client.1.smithi135.stdout:9/660: readlink de/df/d1d/d1e/d68/la0 0 2024-09-10T09:36:30.761 INFO:tasks.workunit.client.1.smithi135.stdout:9/661: write de/df/d1d/d1e/db5/d88/f89 [447330,63796] 0 2024-09-10T09:36:30.762 INFO:tasks.workunit.client.1.smithi135.stdout:1/726: mkdir d1d/d20/d52/d8a/dc2/dca/d2b/d4c/dea 0 2024-09-10T09:36:30.764 INFO:tasks.workunit.client.1.smithi135.stdout:0/674: dwrite d8/dd/d4a/d50/d67/fd6 [0,4194304] 0 2024-09-10T09:36:30.764 INFO:tasks.workunit.client.1.smithi135.stdout:0/675: chown d8/de/d2e/l5c 1547435 1 2024-09-10T09:36:30.764 INFO:tasks.workunit.client.1.smithi135.stdout:9/662: dread de/df/d1d/d1e/db5/d88/f98 [0,4194304] 0 2024-09-10T09:36:30.764 INFO:tasks.workunit.client.1.smithi135.stdout:9/663: getdents de/df/d1d/d23/d25/d28/dbe 0 2024-09-10T09:36:30.768 INFO:tasks.workunit.client.1.smithi135.stdout:3/490: creat d4/d5/db/d36/f90 x:0 0 0 2024-09-10T09:36:30.768 INFO:tasks.workunit.client.1.smithi135.stdout:3/491: truncate d4/d5/db/d36/d43/f52 4825416 0 2024-09-10T09:36:30.769 INFO:tasks.workunit.client.1.smithi135.stdout:3/492: readlink d4/d55/d5d/l5a 0 2024-09-10T09:36:30.769 INFO:tasks.workunit.client.1.smithi135.stdout:3/493: dread - d4/d5/f8c zero size 2024-09-10T09:36:30.770 INFO:tasks.workunit.client.1.smithi135.stdout:7/533: getdents d2/d15/d4a/d36/d84 0 2024-09-10T09:36:30.773 INFO:tasks.workunit.client.1.smithi135.stdout:4/822: unlink d1/d33/d40/c71 0 2024-09-10T09:36:30.773 INFO:tasks.workunit.client.1.smithi135.stdout:8/577: dwrite d1/d15/d49/fbd [0,4194304] 0 2024-09-10T09:36:30.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/727: dread f11 [0,4194304] 0 2024-09-10T09:36:30.784 INFO:tasks.workunit.client.1.smithi135.stdout:9/664: unlink de/df/d1d/d23/d25/d28/fae 0 2024-09-10T09:36:30.786 INFO:tasks.workunit.client.1.smithi135.stdout:5/711: getdents d3/d81 0 2024-09-10T09:36:30.786 INFO:tasks.workunit.client.1.smithi135.stdout:5/712: creat d3/dc/d69/d65/d6c/ff8 x:0 0 0 2024-09-10T09:36:30.787 INFO:tasks.workunit.client.1.smithi135.stdout:3/494: symlink d4/d5/db/d44/d68/l91 0 2024-09-10T09:36:30.789 INFO:tasks.workunit.client.1.smithi135.stdout:4/823: unlink d1/db/d9/c52 0 2024-09-10T09:36:30.794 INFO:tasks.workunit.client.1.smithi135.stdout:8/578: mkdir d1/d8f/da2/dc2 0 2024-09-10T09:36:30.795 INFO:tasks.workunit.client.1.smithi135.stdout:1/728: symlink d1d/d71/d9e/leb 0 2024-09-10T09:36:30.801 INFO:tasks.workunit.client.1.smithi135.stdout:0/676: mkdir d8/dd/d18/d3d/dc3/d37/d73/d88/de4 0 2024-09-10T09:36:30.801 INFO:tasks.workunit.client.1.smithi135.stdout:0/677: stat d8/c1d 0 2024-09-10T09:36:30.801 INFO:tasks.workunit.client.1.smithi135.stdout:0/678: write d8/dd/d11/f59 [650151,71503] 0 2024-09-10T09:36:30.801 INFO:tasks.workunit.client.1.smithi135.stdout:0/679: chown d8/dd/d4a 2 1 2024-09-10T09:36:30.805 INFO:tasks.workunit.client.1.smithi135.stdout:9/665: creat de/df/d1d/d62/fdc x:0 0 0 2024-09-10T09:36:30.807 INFO:tasks.workunit.client.1.smithi135.stdout:4/824: read d1/d33/f6e [1161788,94806] 0 2024-09-10T09:36:30.813 INFO:tasks.workunit.client.1.smithi135.stdout:5/713: mknod d3/dc/d69/d65/d6c/cf9 0 2024-09-10T09:36:30.815 INFO:tasks.workunit.client.1.smithi135.stdout:3/495: rename d4/d5/db/d36/d6a/l88 to d4/d5/d51/l92 0 2024-09-10T09:36:30.817 INFO:tasks.workunit.client.1.smithi135.stdout:7/534: truncate d2/d26/f94 1327959 0 2024-09-10T09:36:30.819 INFO:tasks.workunit.client.1.smithi135.stdout:8/579: symlink d1/d15/lc3 0 2024-09-10T09:36:30.821 INFO:tasks.workunit.client.1.smithi135.stdout:9/666: mknod de/df/d1d/d23/d25/d28/d7b/dcf/cdd 0 2024-09-10T09:36:30.825 INFO:tasks.workunit.client.1.smithi135.stdout:4/825: getdents d1/db/d9/d55/db5 0 2024-09-10T09:36:30.825 INFO:tasks.workunit.client.1.smithi135.stdout:4/826: creat d1/db/d9/d55/d76/ffd x:0 0 0 2024-09-10T09:36:30.826 INFO:tasks.workunit.client.1.smithi135.stdout:7/535: symlink d2/d26/lad 0 2024-09-10T09:36:30.828 INFO:tasks.workunit.client.1.smithi135.stdout:5/714: dread d3/f14 [0,4194304] 0 2024-09-10T09:36:30.829 INFO:tasks.workunit.client.1.smithi135.stdout:8/580: mkdir d1/d15/d16/d33/d45/dc4 0 2024-09-10T09:36:30.831 INFO:tasks.workunit.client.1.smithi135.stdout:9/667: mkdir de/df/d1d/d1e/db5/d88/dde 0 2024-09-10T09:36:30.833 INFO:tasks.workunit.client.1.smithi135.stdout:3/496: dread d4/f32 [0,4194304] 0 2024-09-10T09:36:30.833 INFO:tasks.workunit.client.1.smithi135.stdout:3/497: fsync d4/d5/db/d36/d43/f46 0 2024-09-10T09:36:30.833 INFO:tasks.workunit.client.1.smithi135.stdout:3/498: fsync d4/d5/db/f3a 0 2024-09-10T09:36:30.833 INFO:tasks.workunit.client.1.smithi135.stdout:3/499: dread - d4/d5/f80 zero size 2024-09-10T09:36:30.833 INFO:tasks.workunit.client.1.smithi135.stdout:1/729: dwrite d1d/d20/d52/d8a/fc3 [0,4194304] 0 2024-09-10T09:36:30.833 INFO:tasks.workunit.client.1.smithi135.stdout:1/730: readlink d1d/l61 0 2024-09-10T09:36:30.833 INFO:tasks.workunit.client.1.smithi135.stdout:1/731: write d1d/d20/d52/d8a/dc2/dca/db4/fcd [693332,61549] 0 2024-09-10T09:36:30.841 INFO:tasks.workunit.client.1.smithi135.stdout:8/581: dread d1/d15/d16/d33/d45/f87 [0,4194304] 0 2024-09-10T09:36:30.841 INFO:tasks.workunit.client.1.smithi135.stdout:8/582: truncate d1/d15/d49/f81 74462 0 2024-09-10T09:36:30.841 INFO:tasks.workunit.client.1.smithi135.stdout:5/715: symlink d3/dc/d7a/db9/lfa 0 2024-09-10T09:36:30.841 INFO:tasks.workunit.client.1.smithi135.stdout:5/716: truncate d3/d81/d8d/fa8 912936 0 2024-09-10T09:36:30.842 INFO:tasks.workunit.client.1.smithi135.stdout:9/668: creat de/df/d1d/d23/d25/d28/d4e/fdf x:0 0 0 2024-09-10T09:36:30.842 INFO:tasks.workunit.client.1.smithi135.stdout:9/669: readlink de/df/d1d/d23/d25/l47 0 2024-09-10T09:36:30.847 INFO:tasks.workunit.client.1.smithi135.stdout:7/536: dwrite d2/d15/d5c/d62/da5/d5e/d8c/f97 [0,4194304] 0 2024-09-10T09:36:30.850 INFO:tasks.workunit.client.1.smithi135.stdout:8/583: dread d1/f14 [4194304,4194304] 0 2024-09-10T09:36:30.850 INFO:tasks.workunit.client.1.smithi135.stdout:3/500: mknod d4/d5/db/d36/c93 0 2024-09-10T09:36:30.850 INFO:tasks.workunit.client.1.smithi135.stdout:3/501: chown d4/d5/db/l22 448482219 1 2024-09-10T09:36:30.850 INFO:tasks.workunit.client.1.smithi135.stdout:8/584: write d1/d15/d24/f35 [610365,120458] 0 2024-09-10T09:36:30.851 INFO:tasks.workunit.client.1.smithi135.stdout:3/502: write d4/d5/db/dd/f5f [713434,75957] 0 2024-09-10T09:36:30.851 INFO:tasks.workunit.client.1.smithi135.stdout:8/585: dread d1/d15/d49/f81 [0,4194304] 0 2024-09-10T09:36:30.851 INFO:tasks.workunit.client.1.smithi135.stdout:8/586: write d1/d8f/fb8 [243592,25629] 0 2024-09-10T09:36:30.853 INFO:tasks.workunit.client.1.smithi135.stdout:1/732: rename d1d/d20/d52/d8a/dc2/dca/d37/d6d/l8c to d1d/d20/d42/dd3/lec 0 2024-09-10T09:36:30.856 INFO:tasks.workunit.client.1.smithi135.stdout:4/827: mkdir d1/de/d16/db8/dfe 0 2024-09-10T09:36:30.858 INFO:tasks.workunit.client.1.smithi135.stdout:5/717: creat d3/d71/d61/ffb x:0 0 0 2024-09-10T09:36:30.864 INFO:tasks.workunit.client.1.smithi135.stdout:7/537: write d2/d26/f94 [483620,60767] 0 2024-09-10T09:36:30.864 INFO:tasks.workunit.client.1.smithi135.stdout:8/587: rmdir d1/d8f/da0 39 2024-09-10T09:36:30.869 INFO:tasks.workunit.client.1.smithi135.stdout:9/670: rename de/df/d1d/f1f to de/df/d1d/d1e/db5/d88/dde/fe0 0 2024-09-10T09:36:30.872 INFO:tasks.workunit.client.1.smithi135.stdout:9/671: dread de/df/d1d/d1e/d68/d9f/fab [0,4194304] 0 2024-09-10T09:36:30.879 INFO:tasks.workunit.client.1.smithi135.stdout:4/828: symlink d1/de/d16/db8/dfe/lff 0 2024-09-10T09:36:30.879 INFO:tasks.workunit.client.1.smithi135.stdout:4/829: chown d1/d85/dc4 24830247 1 2024-09-10T09:36:30.880 INFO:tasks.workunit.client.1.smithi135.stdout:5/718: mkdir d3/dc/dba/d48/dfc 0 2024-09-10T09:36:30.883 INFO:tasks.workunit.client.1.smithi135.stdout:7/538: stat d2/d15/l1a 0 2024-09-10T09:36:30.889 INFO:tasks.workunit.client.1.smithi135.stdout:8/588: unlink d1/d15/l41 0 2024-09-10T09:36:30.890 INFO:tasks.workunit.client.1.smithi135.stdout:4/830: write d1/db/d9/d55/d70/fc2 [590309,122309] 0 2024-09-10T09:36:30.891 INFO:tasks.workunit.client.1.smithi135.stdout:8/589: read d1/d15/d24/f35 [145216,15650] 0 2024-09-10T09:36:30.891 INFO:tasks.workunit.client.1.smithi135.stdout:8/590: stat d1/d15/d16/d33/f97 0 2024-09-10T09:36:30.891 INFO:tasks.workunit.client.1.smithi135.stdout:8/591: chown d1/d15/d16/d33/d39/c74 255856878 1 2024-09-10T09:36:30.893 INFO:tasks.workunit.client.1.smithi135.stdout:9/672: dread - de/df/d1d/d23/f8e zero size 2024-09-10T09:36:30.893 INFO:tasks.workunit.client.1.smithi135.stdout:9/673: creat de/df/d1d/d1e/d52/fe1 x:0 0 0 2024-09-10T09:36:30.899 INFO:tasks.workunit.client.1.smithi135.stdout:8/592: truncate d1/d15/f9d 1788771 0 2024-09-10T09:36:30.903 INFO:tasks.workunit.client.1.smithi135.stdout:9/674: creat de/df/d1d/d1e/fe2 x:0 0 0 2024-09-10T09:36:30.903 INFO:tasks.workunit.client.1.smithi135.stdout:9/675: fdatasync de/df/d1d/d1e/db5/d88/f93 0 2024-09-10T09:36:30.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/593: unlink d1/d15/fa6 0 2024-09-10T09:36:30.906 INFO:tasks.workunit.client.1.smithi135.stdout:7/539: dwrite d2/f1e [0,4194304] 0 2024-09-10T09:36:30.907 INFO:tasks.workunit.client.1.smithi135.stdout:9/676: symlink de/df/d1d/d23/d25/le3 0 2024-09-10T09:36:30.907 INFO:tasks.workunit.client.1.smithi135.stdout:4/831: dwrite d1/db/f6 [4194304,4194304] 0 2024-09-10T09:36:30.908 INFO:tasks.workunit.client.1.smithi135.stdout:8/594: truncate d1/d15/d16/d33/d45/f50 3028951 0 2024-09-10T09:36:30.909 INFO:tasks.workunit.client.1.smithi135.stdout:7/540: dread d2/ff [0,4194304] 0 2024-09-10T09:36:30.909 INFO:tasks.workunit.client.1.smithi135.stdout:7/541: read d2/ff [394308,112809] 0 2024-09-10T09:36:30.914 INFO:tasks.workunit.client.1.smithi135.stdout:9/677: rename de/df/d1d/d6b/f7f to de/df/d1d/d1e/d52/fe4 0 2024-09-10T09:36:30.915 INFO:tasks.workunit.client.1.smithi135.stdout:4/832: unlink d1/db/d9/lb4 0 2024-09-10T09:36:30.916 INFO:tasks.workunit.client.1.smithi135.stdout:4/833: chown d1/db/d23/fa8 1073 1 2024-09-10T09:36:30.917 INFO:tasks.workunit.client.1.smithi135.stdout:8/595: symlink d1/lc5 0 2024-09-10T09:36:30.918 INFO:tasks.workunit.client.1.smithi135.stdout:7/542: truncate d2/d15/d4a/f48 8161400 0 2024-09-10T09:36:30.920 INFO:tasks.workunit.client.1.smithi135.stdout:8/596: rename d1/d27/c4b to d1/d15/d49/d7c/cc6 0 2024-09-10T09:36:30.922 INFO:tasks.workunit.client.1.smithi135.stdout:7/543: mkdir d2/d15/d41/d49/d60/d30/dae 0 2024-09-10T09:36:30.936 INFO:tasks.workunit.client.1.smithi135.stdout:7/544: dread d2/f1e [0,4194304] 0 2024-09-10T09:36:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/545: mkdir d2/d25/d9d/daf 0 2024-09-10T09:36:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/546: stat d2/d15/d41/d49/f63 0 2024-09-10T09:36:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/547: chown d2/d15/f2d 870 1 2024-09-10T09:36:30.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/548: fsync d2/d15/d4a/d36/d84/f91 0 2024-09-10T09:36:30.946 INFO:tasks.workunit.client.1.smithi135.stdout:7/549: rename d2/d15/c6e to d2/d15/d39/d53/cb0 0 2024-09-10T09:36:30.946 INFO:tasks.workunit.client.1.smithi135.stdout:7/550: dread d2/d15/d4a/d36/f59 [0,4194304] 0 2024-09-10T09:36:30.954 INFO:tasks.workunit.client.1.smithi135.stdout:4/834: dwrite d1/f90 [0,4194304] 0 2024-09-10T09:36:30.954 INFO:tasks.workunit.client.1.smithi135.stdout:8/597: dwrite d1/d15/d16/d33/d45/d70/f93 [0,4194304] 0 2024-09-10T09:36:30.954 INFO:tasks.workunit.client.1.smithi135.stdout:4/835: getdents d1/db/d9/d55/d70/da4/dac/dd7 0 2024-09-10T09:36:30.966 INFO:tasks.workunit.client.1.smithi135.stdout:8/598: rmdir d1/d8f 39 2024-09-10T09:36:30.967 INFO:tasks.workunit.client.1.smithi135.stdout:7/551: dwrite d2/d15/d39/f6d [0,4194304] 0 2024-09-10T09:36:30.967 INFO:tasks.workunit.client.1.smithi135.stdout:7/552: chown d2/d15/d5c/d62/da5 10 1 2024-09-10T09:36:30.967 INFO:tasks.workunit.client.1.smithi135.stdout:7/553: truncate d2/d15/d5c/d85/f9b 539239 0 2024-09-10T09:36:30.968 INFO:tasks.workunit.client.1.smithi135.stdout:4/836: rename d1/de/d16/d95/fad to d1/d4a/d9d/f100 0 2024-09-10T09:36:30.968 INFO:tasks.workunit.client.1.smithi135.stdout:4/837: truncate d1/d33/d40/def/ff1 145207 0 2024-09-10T09:36:30.975 INFO:tasks.workunit.client.1.smithi135.stdout:4/838: symlink d1/d4a/d6d/l101 0 2024-09-10T09:36:30.983 INFO:tasks.workunit.client.1.smithi135.stdout:4/839: rename d1/de/d16/d98/ce1 to d1/d85/dc4/c102 0 2024-09-10T09:36:30.984 INFO:tasks.workunit.client.1.smithi135.stdout:4/840: write d1/db/f54 [8625375,124299] 0 2024-09-10T09:36:30.984 INFO:tasks.workunit.client.1.smithi135.stdout:4/841: fdatasync d1/d4a/d6d/fb0 0 2024-09-10T09:36:30.990 INFO:tasks.workunit.client.1.smithi135.stdout:4/842: dread d1/d8a/fab [0,4194304] 0 2024-09-10T09:36:30.994 INFO:tasks.workunit.client.1.smithi135.stdout:4/843: creat d1/d85/db3/f103 x:0 0 0 2024-09-10T09:36:30.997 INFO:tasks.workunit.client.1.smithi135.stdout:4/844: creat d1/db/d83/f104 x:0 0 0 2024-09-10T09:36:30.998 INFO:tasks.workunit.client.1.smithi135.stdout:8/599: dwrite d1/d15/d16/d33/d45/d6f/fb5 [0,4194304] 0 2024-09-10T09:36:30.998 INFO:tasks.workunit.client.1.smithi135.stdout:7/554: dwrite d2/d26/f94 [0,4194304] 0 2024-09-10T09:36:30.999 INFO:tasks.workunit.client.1.smithi135.stdout:7/555: write d2/d15/f47 [200796,10173] 0 2024-09-10T09:36:31.001 INFO:tasks.workunit.client.1.smithi135.stdout:4/845: link d1/de/d16/d98/fbd d1/db/d9/d55/f105 0 2024-09-10T09:36:31.023 INFO:tasks.workunit.client.1.smithi135.stdout:7/556: symlink d2/d15/d5c/lb1 0 2024-09-10T09:36:31.071 INFO:tasks.workunit.client.1.smithi135.stdout:4/846: rename d1/de/d16/laa to d1/db/d9/d55/l106 0 2024-09-10T09:36:31.074 INFO:tasks.workunit.client.1.smithi135.stdout:7/557: rename d2/d15/d41/d49/d52 to d2/d15/d39/d9f/db2 0 2024-09-10T09:36:31.077 INFO:tasks.workunit.client.1.smithi135.stdout:7/558: mknod d2/d15/d41/d49/cb3 0 2024-09-10T09:36:31.078 INFO:tasks.workunit.client.1.smithi135.stdout:7/559: mknod d2/d15/da1/cb4 0 2024-09-10T09:36:31.078 INFO:tasks.workunit.client.1.smithi135.stdout:7/560: readlink d2/d26/lad 0 2024-09-10T09:36:31.079 INFO:tasks.workunit.client.1.smithi135.stdout:7/561: rmdir d2/d15/d39/d9f/db2/d96 0 2024-09-10T09:36:31.087 INFO:tasks.workunit.client.1.smithi135.stdout:4/847: dwrite d1/db/d9/d55/d76/f7f [0,4194304] 0 2024-09-10T09:36:31.088 INFO:tasks.workunit.client.1.smithi135.stdout:4/848: dread d1/d8a/fbf [0,4194304] 0 2024-09-10T09:36:31.088 INFO:tasks.workunit.client.1.smithi135.stdout:8/600: truncate d1/d15/d16/d33/d45/d6f/fb5 3270011 0 2024-09-10T09:36:31.090 INFO:tasks.workunit.client.1.smithi135.stdout:4/849: rename d1/db/d23/l84 to d1/db/d9/d55/l107 0 2024-09-10T09:36:31.100 INFO:tasks.workunit.client.1.smithi135.stdout:8/601: write d1/d15/f19 [2147568,3886] 0 2024-09-10T09:36:31.100 INFO:tasks.workunit.client.1.smithi135.stdout:8/602: read d1/f20 [586043,3906] 0 2024-09-10T09:36:31.102 INFO:tasks.workunit.client.1.smithi135.stdout:8/603: mknod d1/d15/d24/cc7 0 2024-09-10T09:36:31.102 INFO:tasks.workunit.client.1.smithi135.stdout:8/604: chown d1/d15/d16/d71 208 1 2024-09-10T09:36:31.102 INFO:tasks.workunit.client.1.smithi135.stdout:8/605: read - d1/d13/fae zero size 2024-09-10T09:36:31.102 INFO:tasks.workunit.client.1.smithi135.stdout:4/850: dread d1/de/f34 [0,4194304] 0 2024-09-10T09:36:31.104 INFO:tasks.workunit.client.1.smithi135.stdout:8/606: truncate d1/f14 2805909 0 2024-09-10T09:36:31.104 INFO:tasks.workunit.client.1.smithi135.stdout:8/607: write d1/d15/d24/f35 [826207,40162] 0 2024-09-10T09:36:31.104 INFO:tasks.workunit.client.1.smithi135.stdout:8/608: fsync d1/f23 0 2024-09-10T09:36:31.107 INFO:tasks.workunit.client.1.smithi135.stdout:8/609: rename d1/d15/d16/d33/fa1 to d1/d15/d49/fc8 0 2024-09-10T09:36:31.108 INFO:tasks.workunit.client.1.smithi135.stdout:8/610: truncate d1/d27/f68 5186185 0 2024-09-10T09:36:31.108 INFO:tasks.workunit.client.1.smithi135.stdout:8/611: fsync d1/d27/f40 0 2024-09-10T09:36:31.113 INFO:tasks.workunit.client.1.smithi135.stdout:7/562: getdents d2/d15/d39/d9f 0 2024-09-10T09:36:31.113 INFO:tasks.workunit.client.1.smithi135.stdout:7/563: chown d2/d15/d4a/d36/f6a 2045 1 2024-09-10T09:36:31.118 INFO:tasks.workunit.client.1.smithi135.stdout:7/564: rmdir d2/d15/d4a/d36 39 2024-09-10T09:36:31.120 INFO:tasks.workunit.client.1.smithi135.stdout:4/851: dwrite d1/d4a/f51 [0,4194304] 0 2024-09-10T09:36:31.121 INFO:tasks.workunit.client.1.smithi135.stdout:4/852: fdatasync d1/db/d9/ffc 0 2024-09-10T09:36:31.125 INFO:tasks.workunit.client.1.smithi135.stdout:4/853: truncate d1/de/f34 2492345 0 2024-09-10T09:36:31.132 INFO:tasks.workunit.client.1.smithi135.stdout:4/854: getdents d1/de/d16/d8b/dc6 0 2024-09-10T09:36:31.134 INFO:tasks.workunit.client.1.smithi135.stdout:7/565: dwrite d2/d15/d4a/fe [0,4194304] 0 2024-09-10T09:36:31.134 INFO:tasks.workunit.client.1.smithi135.stdout:4/855: mkdir d1/db/d9/d55/d70/da4/d108 0 2024-09-10T09:36:31.135 INFO:tasks.workunit.client.1.smithi135.stdout:7/566: truncate d2/d15/f2d 4096169 0 2024-09-10T09:36:31.138 INFO:tasks.workunit.client.1.smithi135.stdout:4/856: link d1/db/d9/d55/d76/f7f d1/de/d16/f109 0 2024-09-10T09:36:31.138 INFO:tasks.workunit.client.1.smithi135.stdout:8/612: write d1/d15/d49/f4e [791872,4817] 0 2024-09-10T09:36:31.140 INFO:tasks.workunit.client.1.smithi135.stdout:8/613: rename d1/d13/dab to d1/d27/d3d/dc9 0 2024-09-10T09:36:31.144 INFO:tasks.workunit.client.1.smithi135.stdout:8/614: symlink d1/d15/lca 0 2024-09-10T09:36:31.149 INFO:tasks.workunit.client.1.smithi135.stdout:7/567: read d2/d26/f94 [2837726,16245] 0 2024-09-10T09:36:31.155 INFO:tasks.workunit.client.1.smithi135.stdout:7/568: creat d2/d25/fb5 x:0 0 0 2024-09-10T09:36:31.157 INFO:tasks.workunit.client.1.smithi135.stdout:7/569: dread d2/d15/d41/d49/d60/d30/f70 [0,4194304] 0 2024-09-10T09:36:31.159 INFO:tasks.workunit.client.1.smithi135.stdout:7/570: mknod d2/d15/d5c/d62/da5/d5e/cb6 0 2024-09-10T09:36:31.164 INFO:tasks.workunit.client.1.smithi135.stdout:4/857: dwrite d1/d85/db3/f103 [0,4194304] 0 2024-09-10T09:36:31.166 INFO:tasks.workunit.client.1.smithi135.stdout:4/858: symlink d1/db/d83/l10a 0 2024-09-10T09:36:31.168 INFO:tasks.workunit.client.1.smithi135.stdout:4/859: rename d1/d4a/d9d/da1/dd6 to d1/db/da0/d10b 0 2024-09-10T09:36:31.173 INFO:tasks.workunit.client.1.smithi135.stdout:8/615: dwrite d1/d15/d16/d96/f9f [0,4194304] 0 2024-09-10T09:36:31.178 INFO:tasks.workunit.client.1.smithi135.stdout:8/616: rmdir d1/d27/d3d/dc9 0 2024-09-10T09:36:31.186 INFO:tasks.workunit.client.1.smithi135.stdout:7/571: dwrite d2/d25/f38 [0,4194304] 0 2024-09-10T09:36:31.187 INFO:tasks.workunit.client.1.smithi135.stdout:7/572: chown d2/d15/d41/d49/d60/d30/f34 5251533 1 2024-09-10T09:36:31.187 INFO:tasks.workunit.client.1.smithi135.stdout:7/573: mknod d2/d25/daa/cb7 0 2024-09-10T09:36:31.188 INFO:tasks.workunit.client.1.smithi135.stdout:7/574: stat d2/d15/d41/d49/d60 0 2024-09-10T09:36:31.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/575: mkdir d2/d15/d39/d9f/db8 0 2024-09-10T09:36:31.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/576: readlink d2/d15/l1a 0 2024-09-10T09:36:31.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/577: truncate d2/d25/d5d/d83/f89 822926 0 2024-09-10T09:36:31.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/578: read - d2/d26/f8b zero size 2024-09-10T09:36:31.190 INFO:tasks.workunit.client.1.smithi135.stdout:7/579: fdatasync d2/d25/fb5 0 2024-09-10T09:36:31.193 INFO:tasks.workunit.client.1.smithi135.stdout:7/580: truncate d2/d15/f47 232021 0 2024-09-10T09:36:31.195 INFO:tasks.workunit.client.1.smithi135.stdout:8/617: dwrite d1/d13/f6e [4194304,4194304] 0 2024-09-10T09:36:31.197 INFO:tasks.workunit.client.1.smithi135.stdout:8/618: creat d1/d15/d16/fcb x:0 0 0 2024-09-10T09:36:31.200 INFO:tasks.workunit.client.1.smithi135.stdout:8/619: rename d1/d15/d16/d33/d45/d70/f93 to d1/d15/fcc 0 2024-09-10T09:36:31.203 INFO:tasks.workunit.client.1.smithi135.stdout:8/620: rmdir d1/d8f/da2/dc2 0 2024-09-10T09:36:31.203 INFO:tasks.workunit.client.1.smithi135.stdout:8/621: fdatasync d1/f7 0 2024-09-10T09:36:31.220 INFO:tasks.workunit.client.1.smithi135.stdout:7/581: dwrite d2/f10 [0,4194304] 0 2024-09-10T09:36:31.220 INFO:tasks.workunit.client.1.smithi135.stdout:7/582: chown d2/d15/d4a/d36/d84/f91 7343 1 2024-09-10T09:36:31.220 INFO:tasks.workunit.client.1.smithi135.stdout:7/583: fdatasync d2/d25/d5d/d83/f89 0 2024-09-10T09:36:31.220 INFO:tasks.workunit.client.1.smithi135.stdout:8/622: dwrite d1/d15/d16/f61 [0,4194304] 0 2024-09-10T09:36:31.235 INFO:tasks.workunit.client.1.smithi135.stdout:7/584: dwrite d2/d15/d41/d49/d60/d30/f70 [0,4194304] 0 2024-09-10T09:36:31.235 INFO:tasks.workunit.client.1.smithi135.stdout:7/585: chown d2/d15/f20 462961 1 2024-09-10T09:36:31.241 INFO:tasks.workunit.client.1.smithi135.stdout:8/623: truncate d1/d15/d16/f61 369602 0 2024-09-10T09:36:31.242 INFO:tasks.workunit.client.1.smithi135.stdout:7/586: rename d2/f77 to d2/d15/d41/fb9 0 2024-09-10T09:36:31.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/587: write d2/d25/f3f [5534360,51637] 0 2024-09-10T09:36:31.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/588: truncate d2/d25/d5d/d83/f89 868054 0 2024-09-10T09:36:31.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/589: chown d2/d15/d5c/d62/da5/d5e 51015 1 2024-09-10T09:36:31.247 INFO:tasks.workunit.client.1.smithi135.stdout:8/624: rename d1/d15/d49/cb1 to d1/d15/d16/d33/ccd 0 2024-09-10T09:36:31.247 INFO:tasks.workunit.client.1.smithi135.stdout:8/625: dread - d1/d15/d16/d96/fbe zero size 2024-09-10T09:36:31.251 INFO:tasks.workunit.client.1.smithi135.stdout:8/626: mkdir d1/d15/d16/d99/da9/dce 0 2024-09-10T09:36:31.251 INFO:tasks.workunit.client.1.smithi135.stdout:8/627: chown d1/d27/f68 181542 1 2024-09-10T09:36:31.253 INFO:tasks.workunit.client.1.smithi135.stdout:8/628: mknod d1/d15/d16/d99/da9/dce/ccf 0 2024-09-10T09:36:31.255 INFO:tasks.workunit.client.1.smithi135.stdout:8/629: creat d1/d15/d49/d7c/fd0 x:0 0 0 2024-09-10T09:36:31.256 INFO:tasks.workunit.client.1.smithi135.stdout:8/630: symlink d1/d15/d16/d33/d45/d70/ld1 0 2024-09-10T09:36:31.259 INFO:tasks.workunit.client.1.smithi135.stdout:7/590: dwrite d2/d25/d5d/f4f [0,4194304] 0 2024-09-10T09:36:31.259 INFO:tasks.workunit.client.1.smithi135.stdout:8/631: dread d1/d15/d16/d71/f80 [0,4194304] 0 2024-09-10T09:36:31.261 INFO:tasks.workunit.client.1.smithi135.stdout:8/632: unlink d1/d15/l67 0 2024-09-10T09:36:31.262 INFO:tasks.workunit.client.1.smithi135.stdout:8/633: mkdir d1/d15/d16/d33/d45/dc4/dd2 0 2024-09-10T09:36:31.270 INFO:tasks.workunit.client.1.smithi135.stdout:7/591: dread d2/d15/d41/d49/d60/d30/f70 [0,4194304] 0 2024-09-10T09:36:31.286 INFO:tasks.workunit.client.1.smithi135.stdout:7/592: dwrite d2/d25/d5d/f4f [0,4194304] 0 2024-09-10T09:36:31.288 INFO:tasks.workunit.client.1.smithi135.stdout:7/593: creat d2/d15/d39/d9f/fba x:0 0 0 2024-09-10T09:36:31.289 INFO:tasks.workunit.client.1.smithi135.stdout:7/594: creat d2/d15/d5c/d62/da5/fbb x:0 0 0 2024-09-10T09:36:31.291 INFO:tasks.workunit.client.1.smithi135.stdout:7/595: dread d2/d15/d41/f6c [0,4194304] 0 2024-09-10T09:36:31.301 INFO:tasks.workunit.client.1.smithi135.stdout:7/596: write d2/d15/d4a/f48 [1000524,101647] 0 2024-09-10T09:36:31.301 INFO:tasks.workunit.client.1.smithi135.stdout:7/597: read - d2/d15/d41/d49/d60/d30/d71/fa9 zero size 2024-09-10T09:36:31.301 INFO:tasks.workunit.client.1.smithi135.stdout:7/598: readlink d2/d15/d5c/lb1 0 2024-09-10T09:36:31.302 INFO:tasks.workunit.client.1.smithi135.stdout:7/599: chown d2/d15/d39/d6f/f76 264054 1 2024-09-10T09:36:31.302 INFO:tasks.workunit.client.1.smithi135.stdout:7/600: write d2/d15/d41/d49/d60/f75 [578747,71271] 0 2024-09-10T09:36:31.302 INFO:tasks.workunit.client.1.smithi135.stdout:7/601: dread d2/d15/d41/d49/f63 [0,4194304] 0 2024-09-10T09:36:31.306 INFO:tasks.workunit.client.1.smithi135.stdout:6/837: sync 2024-09-10T09:36:31.306 INFO:tasks.workunit.client.1.smithi135.stdout:0/680: sync 2024-09-10T09:36:31.307 INFO:tasks.workunit.client.1.smithi135.stdout:2/650: sync 2024-09-10T09:36:31.307 INFO:tasks.workunit.client.1.smithi135.stdout:2/651: chown df/d13/d4f/la8 15 1 2024-09-10T09:36:31.307 INFO:tasks.workunit.client.1.smithi135.stdout:0/681: dread - d8/dd/d11/d90/dc4/fd3 zero size 2024-09-10T09:36:31.309 INFO:tasks.workunit.client.1.smithi135.stdout:6/838: symlink d5/d1e/d35/l10d 0 2024-09-10T09:36:31.310 INFO:tasks.workunit.client.1.smithi135.stdout:6/839: chown d5/d15/fb6 2027 1 2024-09-10T09:36:31.315 INFO:tasks.workunit.client.1.smithi135.stdout:6/840: unlink d5/d1e/d3b/d42/d2d/d55/d5b/c75 0 2024-09-10T09:36:31.316 INFO:tasks.workunit.client.1.smithi135.stdout:6/841: truncate d5/d58/de5/ffc 962592 0 2024-09-10T09:36:31.319 INFO:tasks.workunit.client.1.smithi135.stdout:2/652: rmdir df/d13/d4f/d95 39 2024-09-10T09:36:31.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/682: truncate d8/dd/d1e/f49 1711 0 2024-09-10T09:36:31.325 INFO:tasks.workunit.client.1.smithi135.stdout:0/683: symlink d8/dd/d11/d17/le5 0 2024-09-10T09:36:31.326 INFO:tasks.workunit.client.1.smithi135.stdout:0/684: rmdir d8/dd/d18/d3d/dc3/d37 39 2024-09-10T09:36:31.329 INFO:tasks.workunit.client.1.smithi135.stdout:2/653: write df/d13/d4f/d95/fc1 [852724,87797] 0 2024-09-10T09:36:31.329 INFO:tasks.workunit.client.1.smithi135.stdout:2/654: dread - df/d1b/d23/f8a zero size 2024-09-10T09:36:31.331 INFO:tasks.workunit.client.1.smithi135.stdout:2/655: creat df/d13/d4f/fd2 x:0 0 0 2024-09-10T09:36:31.331 INFO:tasks.workunit.client.1.smithi135.stdout:6/842: dwrite d5/d15/ddf/f10a [0,4194304] 0 2024-09-10T09:36:31.331 INFO:tasks.workunit.client.1.smithi135.stdout:6/843: creat d5/dd/d50/d86/dcd/f10e x:0 0 0 2024-09-10T09:36:31.331 INFO:tasks.workunit.client.1.smithi135.stdout:6/844: chown d5/dd/d50/d54/c5a 714594 1 2024-09-10T09:36:31.333 INFO:tasks.workunit.client.1.smithi135.stdout:2/656: rmdir df/d13/d52/d8f 39 2024-09-10T09:36:31.343 INFO:tasks.workunit.client.1.smithi135.stdout:6/845: mknod d5/dd/d50/d54/dc1/c10f 0 2024-09-10T09:36:31.343 INFO:tasks.workunit.client.1.smithi135.stdout:6/846: chown d5/d1e/d3b/d42/d2d/d8f/d9c 190 1 2024-09-10T09:36:31.345 INFO:tasks.workunit.client.1.smithi135.stdout:2/657: creat df/d1b/d23/d98/d5f/fd3 x:0 0 0 2024-09-10T09:36:31.345 INFO:tasks.workunit.client.1.smithi135.stdout:6/847: mkdir d5/d1e/d3b/d42/d2d/d110 0 2024-09-10T09:36:31.347 INFO:tasks.workunit.client.1.smithi135.stdout:2/658: creat df/d13/d4f/d95/d97/fd4 x:0 0 0 2024-09-10T09:36:31.348 INFO:tasks.workunit.client.1.smithi135.stdout:6/848: truncate d5/f6 732990 0 2024-09-10T09:36:31.348 INFO:tasks.workunit.client.1.smithi135.stdout:6/849: write d5/d1e/d35/d65/f84 [275302,71638] 0 2024-09-10T09:36:31.349 INFO:tasks.workunit.client.1.smithi135.stdout:2/659: mknod df/d1b/d23/d98/d5f/d3d/cd5 0 2024-09-10T09:36:31.349 INFO:tasks.workunit.client.1.smithi135.stdout:2/660: fsync df/d1b/d23/d98/f73 0 2024-09-10T09:36:31.350 INFO:tasks.workunit.client.1.smithi135.stdout:2/661: getdents df/d1b/d23/d42 0 2024-09-10T09:36:31.354 INFO:tasks.workunit.client.1.smithi135.stdout:0/685: dwrite d8/dd/d1e/f49 [0,4194304] 0 2024-09-10T09:36:31.354 INFO:tasks.workunit.client.1.smithi135.stdout:0/686: readlink d8/dd/d4a/d50/l6d 0 2024-09-10T09:36:31.358 INFO:tasks.workunit.client.1.smithi135.stdout:2/662: read df/f17 [728610,45900] 0 2024-09-10T09:36:31.358 INFO:tasks.workunit.client.1.smithi135.stdout:0/687: unlink d8/dd/d11/l39 0 2024-09-10T09:36:31.361 INFO:tasks.workunit.client.1.smithi135.stdout:0/688: mknod d8/dd/d18/d3d/dc3/d37/ce6 0 2024-09-10T09:36:31.362 INFO:tasks.workunit.client.1.smithi135.stdout:2/663: getdents df/d1b/d23/db6 0 2024-09-10T09:36:31.364 INFO:tasks.workunit.client.1.smithi135.stdout:6/850: truncate d5/f7 930070 0 2024-09-10T09:36:31.367 INFO:tasks.workunit.client.1.smithi135.stdout:6/851: rename d5/d1e/d3b/d42/d3c/d44/dca/fde to d5/d1e/d62/f111 0 2024-09-10T09:36:31.369 INFO:tasks.workunit.client.1.smithi135.stdout:0/689: write d8/fc [2351996,74403] 0 2024-09-10T09:36:31.370 INFO:tasks.workunit.client.1.smithi135.stdout:6/852: rename d5/d15/l1a to d5/d1e/d3b/dd0/l112 0 2024-09-10T09:36:31.372 INFO:tasks.workunit.client.1.smithi135.stdout:0/690: mkdir d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/de7 0 2024-09-10T09:36:31.372 INFO:tasks.workunit.client.1.smithi135.stdout:0/691: fdatasync d8/f26 0 2024-09-10T09:36:31.373 INFO:tasks.workunit.client.1.smithi135.stdout:6/853: rmdir d5/dd/d50/d54/da9/de4/d108 0 2024-09-10T09:36:31.376 INFO:tasks.workunit.client.1.smithi135.stdout:0/692: rename d8/dd/d18/d3d/dc3/d37/f65 to d8/dd/d18/d3d/dc3/d37/fe8 0 2024-09-10T09:36:31.376 INFO:tasks.workunit.client.1.smithi135.stdout:0/693: creat d8/dd/d11/d90/dc4/fe9 x:0 0 0 2024-09-10T09:36:31.385 INFO:tasks.workunit.client.1.smithi135.stdout:0/694: creat d8/dd/d18/d3d/dc3/d61/fea x:0 0 0 2024-09-10T09:36:31.390 INFO:tasks.workunit.client.1.smithi135.stdout:0/695: getdents d8/dd/d18/d3d/dc3/d37/d73/d88 0 2024-09-10T09:36:31.390 INFO:tasks.workunit.client.1.smithi135.stdout:6/854: dwrite d5/d15/fb6 [0,4194304] 0 2024-09-10T09:36:31.391 INFO:tasks.workunit.client.1.smithi135.stdout:6/855: write d5/dd/d50/db3/fdc [653160,6904] 0 2024-09-10T09:36:31.413 INFO:tasks.workunit.client.1.smithi135.stdout:6/856: dwrite d5/d15/f1c [0,4194304] 0 2024-09-10T09:36:31.413 INFO:tasks.workunit.client.1.smithi135.stdout:6/857: chown d5/d1e/d3b/d42/d2d/d8f/f97 913527 1 2024-09-10T09:36:31.414 INFO:tasks.workunit.client.1.smithi135.stdout:6/858: symlink d5/d58/l113 0 2024-09-10T09:36:31.415 INFO:tasks.workunit.client.1.smithi135.stdout:6/859: rename d5/d58/l113 to d5/d1e/d3b/d42/d2d/d110/l114 0 2024-09-10T09:36:31.416 INFO:tasks.workunit.client.1.smithi135.stdout:0/696: dwrite d8/dd/d18/d3d/dc3/d37/f58 [0,4194304] 0 2024-09-10T09:36:31.416 INFO:tasks.workunit.client.1.smithi135.stdout:0/697: write d8/dd/d4a/d50/d54/d5f/f7d [540183,14192] 0 2024-09-10T09:36:31.418 INFO:tasks.workunit.client.1.smithi135.stdout:6/860: symlink d5/de8/l115 0 2024-09-10T09:36:31.418 INFO:tasks.workunit.client.1.smithi135.stdout:6/861: fdatasync d5/fbb 0 2024-09-10T09:36:31.418 INFO:tasks.workunit.client.1.smithi135.stdout:6/862: dread - d5/dd/d50/d86/dcd/f10c zero size 2024-09-10T09:36:31.418 INFO:tasks.workunit.client.1.smithi135.stdout:6/863: fdatasync d5/d15/fb6 0 2024-09-10T09:36:31.418 INFO:tasks.workunit.client.1.smithi135.stdout:6/864: creat d5/dd/d50/d86/dcd/f116 x:0 0 0 2024-09-10T09:36:31.419 INFO:tasks.workunit.client.1.smithi135.stdout:0/698: creat d8/de/feb x:0 0 0 2024-09-10T09:36:31.419 INFO:tasks.workunit.client.1.smithi135.stdout:0/699: fdatasync d8/dd/d4a/d50/d54/d5f/f30 0 2024-09-10T09:36:31.422 INFO:tasks.workunit.client.1.smithi135.stdout:6/865: dread d5/d15/d27/f3d [0,4194304] 0 2024-09-10T09:36:31.431 INFO:tasks.workunit.client.1.smithi135.stdout:6/866: dread d5/d1e/d3b/d42/d2d/fc2 [0,4194304] 0 2024-09-10T09:36:31.433 INFO:tasks.workunit.client.1.smithi135.stdout:6/867: unlink d5/d15/c39 0 2024-09-10T09:36:31.433 INFO:tasks.workunit.client.1.smithi135.stdout:6/868: write d5/d1e/d35/d65/f84 [1200273,19738] 0 2024-09-10T09:36:31.434 INFO:tasks.workunit.client.1.smithi135.stdout:6/869: creat d5/dd/d50/d54/db9/f117 x:0 0 0 2024-09-10T09:36:31.436 INFO:tasks.workunit.client.1.smithi135.stdout:6/870: mkdir d5/d1e/d3b/d42/d2d/d64/d118 0 2024-09-10T09:36:31.436 INFO:tasks.workunit.client.1.smithi135.stdout:6/871: dread - d5/d1e/d3b/d42/d2d/d8f/f97 zero size 2024-09-10T09:36:31.436 INFO:tasks.workunit.client.1.smithi135.stdout:6/872: chown d5/d1e/d3b/d42/d3c/de2/lf6 1657 1 2024-09-10T09:36:31.445 INFO:tasks.workunit.client.1.smithi135.stdout:6/873: dread d5/d15/ddf/ffa [0,4194304] 0 2024-09-10T09:36:31.462 INFO:tasks.workunit.client.1.smithi135.stdout:6/874: dwrite d5/d15/f25 [0,4194304] 0 2024-09-10T09:36:31.462 INFO:tasks.workunit.client.1.smithi135.stdout:6/875: write d5/fbf [26890,128282] 0 2024-09-10T09:36:31.477 INFO:tasks.workunit.client.1.smithi135.stdout:6/876: dwrite d5/d1e/d3b/d42/d2d/d8f/fbd [0,4194304] 0 2024-09-10T09:36:31.479 INFO:tasks.workunit.client.1.smithi135.stdout:6/877: getdents d5/dd/d50/d54/db9/dd9 0 2024-09-10T09:36:31.479 INFO:tasks.workunit.client.1.smithi135.stdout:6/878: chown d5/d58/c102 9039 1 2024-09-10T09:36:31.481 INFO:tasks.workunit.client.1.smithi135.stdout:6/879: read d5/f73 [325115,125905] 0 2024-09-10T09:36:31.483 INFO:tasks.workunit.client.1.smithi135.stdout:6/880: creat d5/d1e/d35/d65/f119 x:0 0 0 2024-09-10T09:36:31.483 INFO:tasks.workunit.client.1.smithi135.stdout:6/881: write d5/dd/fdd [2043830,110415] 0 2024-09-10T09:36:31.492 INFO:tasks.workunit.client.1.smithi135.stdout:6/882: write d5/d1e/d62/d8a/fc3 [1899119,66973] 0 2024-09-10T09:36:31.500 INFO:tasks.workunit.client.1.smithi135.stdout:6/883: read d5/d15/f1c [1641555,96152] 0 2024-09-10T09:36:31.500 INFO:tasks.workunit.client.1.smithi135.stdout:6/884: stat d5/d1e/d35/c3e 0 2024-09-10T09:36:31.522 INFO:tasks.workunit.client.1.smithi135.stdout:6/885: dwrite d5/d15/f22 [0,4194304] 0 2024-09-10T09:36:31.538 INFO:tasks.workunit.client.1.smithi135.stdout:6/886: dwrite d5/d15/d56/f90 [0,4194304] 0 2024-09-10T09:36:31.553 INFO:tasks.workunit.client.1.smithi135.stdout:6/887: dwrite d5/d1e/d35/f3a [0,4194304] 0 2024-09-10T09:36:31.554 INFO:tasks.workunit.client.1.smithi135.stdout:6/888: dread - d5/dd/d50/ffb zero size 2024-09-10T09:36:31.563 INFO:tasks.workunit.client.1.smithi135.stdout:6/889: dread d5/d15/ddf/f10a [0,4194304] 0 2024-09-10T09:36:31.568 INFO:tasks.workunit.client.1.smithi135.stdout:6/890: truncate d5/d1e/d3b/f77 8879984 0 2024-09-10T09:36:31.589 INFO:tasks.workunit.client.1.smithi135.stdout:6/891: symlink d5/dd/d50/d54/da9/de4/l11a 0 2024-09-10T09:36:31.593 INFO:tasks.workunit.client.1.smithi135.stdout:6/892: mkdir d5/d1e/d3b/d42/d2d/d55/d5b/d11b 0 2024-09-10T09:36:31.603 INFO:tasks.workunit.client.1.smithi135.stdout:6/893: write d5/d15/f25 [1392439,100522] 0 2024-09-10T09:36:31.604 INFO:tasks.workunit.client.1.smithi135.stdout:6/894: mkdir d5/d1e/d35/d11c 0 2024-09-10T09:36:31.620 INFO:tasks.workunit.client.1.smithi135.stdout:6/895: dwrite d5/d1e/d35/f4b [0,4194304] 0 2024-09-10T09:36:31.621 INFO:tasks.workunit.client.1.smithi135.stdout:6/896: dread d5/f73 [0,4194304] 0 2024-09-10T09:36:31.623 INFO:tasks.workunit.client.1.smithi135.stdout:6/897: symlink d5/dd/l11d 0 2024-09-10T09:36:31.638 INFO:tasks.workunit.client.1.smithi135.stdout:6/898: dwrite d5/d1e/d3b/d42/f2a [4194304,4194304] 0 2024-09-10T09:36:31.638 INFO:tasks.workunit.client.1.smithi135.stdout:6/899: chown d5/d58/l107 499173 1 2024-09-10T09:36:31.638 INFO:tasks.workunit.client.1.smithi135.stdout:6/900: fdatasync d5/d15/f22 0 2024-09-10T09:36:31.638 INFO:tasks.workunit.client.1.smithi135.stdout:6/901: read d5/d15/f25 [2331884,99072] 0 2024-09-10T09:36:31.641 INFO:tasks.workunit.client.1.smithi135.stdout:6/902: creat d5/d1e/d3b/d42/d2d/d55/d5b/f11e x:0 0 0 2024-09-10T09:36:31.650 INFO:tasks.workunit.client.1.smithi135.stdout:6/903: dread d5/f6b [0,4194304] 0 2024-09-10T09:36:31.651 INFO:tasks.workunit.client.1.smithi135.stdout:6/904: mknod d5/d1e/d35/d11c/c11f 0 2024-09-10T09:36:31.674 INFO:tasks.workunit.client.1.smithi135.stdout:6/905: dwrite d5/dd/fdd [0,4194304] 0 2024-09-10T09:36:31.674 INFO:tasks.workunit.client.1.smithi135.stdout:6/906: chown d5/d1e/d3b/d42/d2d/d64 906862 1 2024-09-10T09:36:31.674 INFO:tasks.workunit.client.1.smithi135.stdout:6/907: truncate d5/d15/d27/f52 2026174 0 2024-09-10T09:36:31.679 INFO:tasks.workunit.client.1.smithi135.stdout:6/908: dread d5/d1e/d3b/d42/d2d/fc2 [0,4194304] 0 2024-09-10T09:36:31.681 INFO:tasks.workunit.client.1.smithi135.stdout:6/909: unlink d5/d1e/d3b/d42/d3c/de2/lf6 0 2024-09-10T09:36:31.684 INFO:tasks.workunit.client.1.smithi135.stdout:6/910: mkdir d5/d58/d120 0 2024-09-10T09:36:31.686 INFO:tasks.workunit.client.1.smithi135.stdout:6/911: symlink d5/d1e/d35/l121 0 2024-09-10T09:36:31.687 INFO:tasks.workunit.client.1.smithi135.stdout:6/912: rename d5/d1e/d62/d8a/def to d5/d1e/d3b/d42/d3c/de2/d122 0 2024-09-10T09:36:31.694 INFO:tasks.workunit.client.1.smithi135.stdout:6/913: dread d5/d1e/d35/f4b [0,4194304] 0 2024-09-10T09:36:31.694 INFO:tasks.workunit.client.1.smithi135.stdout:6/914: read d5/f73 [361521,22569] 0 2024-09-10T09:36:31.694 INFO:tasks.workunit.client.1.smithi135.stdout:6/915: dread - d5/d15/f100 zero size 2024-09-10T09:36:31.695 INFO:tasks.workunit.client.1.smithi135.stdout:6/916: rmdir d5/dd/d50/d57/d81 39 2024-09-10T09:36:31.709 INFO:tasks.workunit.client.1.smithi135.stdout:6/917: dwrite d5/d1e/d3b/d42/f7d [8388608,4194304] 0 2024-09-10T09:36:31.724 INFO:tasks.workunit.client.1.smithi135.stdout:6/918: dwrite d5/fbf [0,4194304] 0 2024-09-10T09:36:31.729 INFO:tasks.workunit.client.1.smithi135.stdout:6/919: write d5/d1e/d35/f9b [3372200,111589] 0 2024-09-10T09:36:31.730 INFO:tasks.workunit.client.1.smithi135.stdout:6/920: symlink d5/d1e/d35/d11c/l123 0 2024-09-10T09:36:31.743 INFO:tasks.workunit.client.1.smithi135.stdout:3/503: sync 2024-09-10T09:36:31.743 INFO:tasks.workunit.client.1.smithi135.stdout:5/719: sync 2024-09-10T09:36:31.743 INFO:tasks.workunit.client.1.smithi135.stdout:1/733: sync 2024-09-10T09:36:31.743 INFO:tasks.workunit.client.1.smithi135.stdout:5/720: chown d3/dc/d69/f73 2 1 2024-09-10T09:36:31.745 INFO:tasks.workunit.client.1.smithi135.stdout:1/734: symlink d1d/d20/d42/dd3/led 0 2024-09-10T09:36:31.745 INFO:tasks.workunit.client.1.smithi135.stdout:1/735: stat d1d/d20/d52/d8a/cb6 0 2024-09-10T09:36:31.747 INFO:tasks.workunit.client.1.smithi135.stdout:1/736: rename d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/fac to d1d/d20/d52/d8a/dc2/dca/d2b/d4c/dea/fee 0 2024-09-10T09:36:31.750 INFO:tasks.workunit.client.1.smithi135.stdout:3/504: dread d4/d55/d5d/d5b/f8d [0,4194304] 0 2024-09-10T09:36:31.751 INFO:tasks.workunit.client.1.smithi135.stdout:6/921: dwrite d5/d1e/d3b/d42/d3c/f47 [4194304,4194304] 0 2024-09-10T09:36:31.755 INFO:tasks.workunit.client.1.smithi135.stdout:6/922: dread d5/d1e/d35/d65/f84 [0,4194304] 0 2024-09-10T09:36:31.757 INFO:tasks.workunit.client.1.smithi135.stdout:5/721: dread d3/f31 [0,4194304] 0 2024-09-10T09:36:31.760 INFO:tasks.workunit.client.1.smithi135.stdout:1/737: write d1d/d20/d5d/fba [1277738,98825] 0 2024-09-10T09:36:31.760 INFO:tasks.workunit.client.1.smithi135.stdout:1/738: dread - d1d/d28/d4b/fa0 zero size 2024-09-10T09:36:31.760 INFO:tasks.workunit.client.1.smithi135.stdout:1/739: write d1d/f27 [2191000,3591] 0 2024-09-10T09:36:31.764 INFO:tasks.workunit.client.1.smithi135.stdout:8/634: sync 2024-09-10T09:36:31.764 INFO:tasks.workunit.client.1.smithi135.stdout:2/664: sync 2024-09-10T09:36:31.764 INFO:tasks.workunit.client.1.smithi135.stdout:7/602: sync 2024-09-10T09:36:31.765 INFO:tasks.workunit.client.1.smithi135.stdout:9/678: sync 2024-09-10T09:36:31.765 INFO:tasks.workunit.client.1.smithi135.stdout:4/860: sync 2024-09-10T09:36:31.765 INFO:tasks.workunit.client.1.smithi135.stdout:0/700: sync 2024-09-10T09:36:31.766 INFO:tasks.workunit.client.1.smithi135.stdout:6/923: dread d5/d1e/d35/f9b [0,4194304] 0 2024-09-10T09:36:31.766 INFO:tasks.workunit.client.1.smithi135.stdout:6/924: fdatasync d5/d1e/d3b/d42/f38 0 2024-09-10T09:36:31.767 INFO:tasks.workunit.client.1.smithi135.stdout:4/861: dread d1/db/d9/d55/d70/da4/fd2 [0,4194304] 0 2024-09-10T09:36:31.767 INFO:tasks.workunit.client.1.smithi135.stdout:4/862: creat d1/db/d9/d55/d7b/f10c x:0 0 0 2024-09-10T09:36:31.772 INFO:tasks.workunit.client.1.smithi135.stdout:5/722: symlink d3/dc/d69/d65/lfd 0 2024-09-10T09:36:31.772 INFO:tasks.workunit.client.1.smithi135.stdout:5/723: dread - d3/dc/dba/d48/d57/da9/fd4 zero size 2024-09-10T09:36:31.772 INFO:tasks.workunit.client.1.smithi135.stdout:5/724: write d3/dc/f8c [1893878,7535] 0 2024-09-10T09:36:31.776 INFO:tasks.workunit.client.1.smithi135.stdout:1/740: creat d1d/d20/d52/d8a/dc2/dca/d2b/fef x:0 0 0 2024-09-10T09:36:31.778 INFO:tasks.workunit.client.1.smithi135.stdout:8/635: truncate d1/d15/d24/f7e 5281295 0 2024-09-10T09:36:31.779 INFO:tasks.workunit.client.1.smithi135.stdout:8/636: fsync d1/d15/d16/d33/d45/d6f/fb4 0 2024-09-10T09:36:31.780 INFO:tasks.workunit.client.1.smithi135.stdout:8/637: dread d1/d15/d16/f61 [0,4194304] 0 2024-09-10T09:36:31.781 INFO:tasks.workunit.client.1.smithi135.stdout:9/679: link de/df/d1d/d23/d25/c90 de/df/d1d/d62/ce5 0 2024-09-10T09:36:31.793 INFO:tasks.workunit.client.1.smithi135.stdout:0/701: link d8/dd/d18/d3d/fb2 d8/dd/d4a/d50/d67/fec 0 2024-09-10T09:36:31.793 INFO:tasks.workunit.client.1.smithi135.stdout:0/702: write d8/dd/f13 [3846319,99147] 0 2024-09-10T09:36:31.795 INFO:tasks.workunit.client.1.smithi135.stdout:2/665: mknod df/d1b/d23/d98/d5f/d2c/d7d/cd6 0 2024-09-10T09:36:31.796 INFO:tasks.workunit.client.1.smithi135.stdout:2/666: dread df/d1b/d23/d98/f73 [0,4194304] 0 2024-09-10T09:36:31.796 INFO:tasks.workunit.client.1.smithi135.stdout:2/667: readlink df/d13/l47 0 2024-09-10T09:36:31.796 INFO:tasks.workunit.client.1.smithi135.stdout:2/668: fdatasync df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf 0 2024-09-10T09:36:31.801 INFO:tasks.workunit.client.1.smithi135.stdout:4/863: symlink d1/db/d9/d55/d70/da4/l10d 0 2024-09-10T09:36:31.801 INFO:tasks.workunit.client.1.smithi135.stdout:4/864: write d1/d33/d40/def/ff1 [763816,60572] 0 2024-09-10T09:36:31.801 INFO:tasks.workunit.client.1.smithi135.stdout:4/865: write d1/db/d9/d55/d7b/f10c [495463,32746] 0 2024-09-10T09:36:31.801 INFO:tasks.workunit.client.1.smithi135.stdout:9/680: dwrite de/df/d1d/d1e/db5/d88/f93 [4194304,4194304] 0 2024-09-10T09:36:31.805 INFO:tasks.workunit.client.1.smithi135.stdout:7/603: dwrite d2/d15/f2f [0,4194304] 0 2024-09-10T09:36:31.805 INFO:tasks.workunit.client.1.smithi135.stdout:1/741: rmdir d1d/d20/d52/d8a/dc2/dca/d37/d6d 39 2024-09-10T09:36:31.805 INFO:tasks.workunit.client.1.smithi135.stdout:1/742: dread - d1d/d20/d52/d8a/dc2/dca/d37/d6d/fc7 zero size 2024-09-10T09:36:31.808 INFO:tasks.workunit.client.1.smithi135.stdout:0/703: dread d8/de/d2e/f91 [0,4194304] 0 2024-09-10T09:36:31.808 INFO:tasks.workunit.client.1.smithi135.stdout:6/925: dwrite d5/d1e/d3b/d42/d3c/f59 [0,4194304] 0 2024-09-10T09:36:31.808 INFO:tasks.workunit.client.1.smithi135.stdout:8/638: mkdir d1/d27/d3d/dd3 0 2024-09-10T09:36:31.814 INFO:tasks.workunit.client.1.smithi135.stdout:4/866: symlink d1/d85/dc4/df7/l10e 0 2024-09-10T09:36:31.818 INFO:tasks.workunit.client.1.smithi135.stdout:9/681: mknod de/df/d1d/d6b/ce6 0 2024-09-10T09:36:31.823 INFO:tasks.workunit.client.1.smithi135.stdout:7/604: creat d2/d15/d39/d53/fbc x:0 0 0 2024-09-10T09:36:31.823 INFO:tasks.workunit.client.1.smithi135.stdout:7/605: chown d2/d15/d39 125234 1 2024-09-10T09:36:31.823 INFO:tasks.workunit.client.1.smithi135.stdout:7/606: truncate d2/d15/d41/d49/d60/d30/f35 4441935 0 2024-09-10T09:36:31.824 INFO:tasks.workunit.client.1.smithi135.stdout:4/867: dread d1/db/f46 [0,4194304] 0 2024-09-10T09:36:31.826 INFO:tasks.workunit.client.1.smithi135.stdout:4/868: dread d1/db/d9/d55/d70/da4/fd2 [0,4194304] 0 2024-09-10T09:36:31.826 INFO:tasks.workunit.client.1.smithi135.stdout:4/869: fsync d1/fdb 0 2024-09-10T09:36:31.827 INFO:tasks.workunit.client.1.smithi135.stdout:1/743: symlink d1d/d20/d42/lf0 0 2024-09-10T09:36:31.827 INFO:tasks.workunit.client.1.smithi135.stdout:1/744: read - d1d/d20/d52/d8a/dc2/dca/fbe zero size 2024-09-10T09:36:31.828 INFO:tasks.workunit.client.1.smithi135.stdout:0/704: mknod d8/dd/d4a/d50/d54/d5f/d4b/ced 0 2024-09-10T09:36:31.831 INFO:tasks.workunit.client.1.smithi135.stdout:6/926: link d5/dd/d50/d54/da9/de4/l11a d5/dd/d50/d57/l124 0 2024-09-10T09:36:31.831 INFO:tasks.workunit.client.1.smithi135.stdout:6/927: dread - d5/d1e/d3b/d42/d2d/d8f/d9c/ffe zero size 2024-09-10T09:36:31.831 INFO:tasks.workunit.client.1.smithi135.stdout:6/928: write d5/f60 [603124,92546] 0 2024-09-10T09:36:31.831 INFO:tasks.workunit.client.1.smithi135.stdout:6/929: chown d5/d1e/d35/f9b 22607837 1 2024-09-10T09:36:31.833 INFO:tasks.workunit.client.1.smithi135.stdout:4/870: dread d1/db/d9/f6a [0,4194304] 0 2024-09-10T09:36:31.833 INFO:tasks.workunit.client.1.smithi135.stdout:4/871: chown d1/db/d23/f3e 109 1 2024-09-10T09:36:31.833 INFO:tasks.workunit.client.1.smithi135.stdout:8/639: link d1/d15/d24/ca3 d1/d13/cd4 0 2024-09-10T09:36:31.836 INFO:tasks.workunit.client.1.smithi135.stdout:9/682: dwrite de/df/d1d/d1e/d52/fe4 [0,4194304] 0 2024-09-10T09:36:31.840 INFO:tasks.workunit.client.1.smithi135.stdout:2/669: rmdir df/d1b/d23 39 2024-09-10T09:36:31.842 INFO:tasks.workunit.client.1.smithi135.stdout:1/745: mkdir d1d/d20/d52/d8a/dc2/dca/d2b/df1 0 2024-09-10T09:36:31.846 INFO:tasks.workunit.client.1.smithi135.stdout:0/705: creat d8/dd/d18/d3d/dc3/d37/d73/fee x:0 0 0 2024-09-10T09:36:31.850 INFO:tasks.workunit.client.1.smithi135.stdout:6/930: mkdir d5/d1e/d62/d125 0 2024-09-10T09:36:31.855 INFO:tasks.workunit.client.1.smithi135.stdout:2/670: truncate df/d1b/d23/d98/d5f/d2c/f2e 4174310 0 2024-09-10T09:36:31.855 INFO:tasks.workunit.client.1.smithi135.stdout:2/671: fdatasync df/f79 0 2024-09-10T09:36:31.856 INFO:tasks.workunit.client.1.smithi135.stdout:1/746: creat d1d/d71/ff2 x:0 0 0 2024-09-10T09:36:31.861 INFO:tasks.workunit.client.1.smithi135.stdout:7/607: dwrite d2/d15/d5c/d62/da5/d5e/fa6 [0,4194304] 0 2024-09-10T09:36:31.861 INFO:tasks.workunit.client.1.smithi135.stdout:7/608: chown d2/d26/f8b 106 1 2024-09-10T09:36:31.861 INFO:tasks.workunit.client.1.smithi135.stdout:0/706: rename d8/dd/d18/d3d/dc3/d61/l6f to d8/dd/d11/lef 0 2024-09-10T09:36:31.862 INFO:tasks.workunit.client.1.smithi135.stdout:6/931: creat d5/d1e/d3b/d42/d3c/de2/d122/f126 x:0 0 0 2024-09-10T09:36:31.863 INFO:tasks.workunit.client.1.smithi135.stdout:6/932: read d5/d1e/d3b/d42/d2d/f31 [2486180,7134] 0 2024-09-10T09:36:31.865 INFO:tasks.workunit.client.1.smithi135.stdout:8/640: dwrite d1/d27/f68 [4194304,4194304] 0 2024-09-10T09:36:31.866 INFO:tasks.workunit.client.1.smithi135.stdout:7/609: dread d2/d15/d41/fb9 [0,4194304] 0 2024-09-10T09:36:31.866 INFO:tasks.workunit.client.1.smithi135.stdout:4/872: dwrite d1/db/d23/f3e [0,4194304] 0 2024-09-10T09:36:31.869 INFO:tasks.workunit.client.1.smithi135.stdout:1/747: unlink d1d/d71/d9e/fe7 0 2024-09-10T09:36:31.873 INFO:tasks.workunit.client.1.smithi135.stdout:6/933: mknod d5/d58/c127 0 2024-09-10T09:36:31.873 INFO:tasks.workunit.client.1.smithi135.stdout:6/934: creat d5/f128 x:0 0 0 2024-09-10T09:36:31.873 INFO:tasks.workunit.client.1.smithi135.stdout:6/935: dread - d5/dd/d50/d86/dcd/f10c zero size 2024-09-10T09:36:31.875 INFO:tasks.workunit.client.1.smithi135.stdout:7/610: truncate d2/d15/d4a/f12 1155140 0 2024-09-10T09:36:31.875 INFO:tasks.workunit.client.1.smithi135.stdout:8/641: symlink d1/d15/d16/d33/d45/d70/ld5 0 2024-09-10T09:36:31.876 INFO:tasks.workunit.client.1.smithi135.stdout:0/707: read d8/fb [3316888,41178] 0 2024-09-10T09:36:31.879 INFO:tasks.workunit.client.1.smithi135.stdout:2/672: dwrite df/d1b/d23/d98/d5f/d3d/d87/fa3 [4194304,4194304] 0 2024-09-10T09:36:31.879 INFO:tasks.workunit.client.1.smithi135.stdout:4/873: stat d1/db/d9/d55/l107 0 2024-09-10T09:36:31.879 INFO:tasks.workunit.client.1.smithi135.stdout:9/683: dwrite de/df/d1d/d23/f67 [0,4194304] 0 2024-09-10T09:36:31.882 INFO:tasks.workunit.client.1.smithi135.stdout:1/748: unlink d1d/d71/lab 0 2024-09-10T09:36:31.886 INFO:tasks.workunit.client.1.smithi135.stdout:7/611: getdents d2/d25/daa 0 2024-09-10T09:36:31.894 INFO:tasks.workunit.client.1.smithi135.stdout:2/673: mkdir df/d1b/d23/d98/d5f/d3d/dd7 0 2024-09-10T09:36:31.894 INFO:tasks.workunit.client.1.smithi135.stdout:2/674: write df/d13/d4f/d95/d97/fc8 [473516,80201] 0 2024-09-10T09:36:31.897 INFO:tasks.workunit.client.1.smithi135.stdout:6/936: dwrite d5/d1e/d62/d8a/f8d [0,4194304] 0 2024-09-10T09:36:31.897 INFO:tasks.workunit.client.1.smithi135.stdout:6/937: dread - d5/d1e/d3b/d42/d2d/d55/d5b/f11e zero size 2024-09-10T09:36:31.900 INFO:tasks.workunit.client.1.smithi135.stdout:9/684: mknod de/df/d1d/d1e/db5/ce7 0 2024-09-10T09:36:31.900 INFO:tasks.workunit.client.1.smithi135.stdout:9/685: dread - de/df/d1d/d1e/db5/d88/fd6 zero size 2024-09-10T09:36:31.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/612: dwrite d2/d15/d39/f7e [0,4194304] 0 2024-09-10T09:36:31.910 INFO:tasks.workunit.client.1.smithi135.stdout:1/749: mkdir d1d/d20/d6c/df3 0 2024-09-10T09:36:31.911 INFO:tasks.workunit.client.1.smithi135.stdout:0/708: rmdir d8/de/d2e 39 2024-09-10T09:36:31.911 INFO:tasks.workunit.client.1.smithi135.stdout:0/709: chown d8/dd/d18/d3d/dc3/d37/l6b 124128 1 2024-09-10T09:36:31.916 INFO:tasks.workunit.client.1.smithi135.stdout:2/675: mknod df/d15/cd8 0 2024-09-10T09:36:31.917 INFO:tasks.workunit.client.1.smithi135.stdout:2/676: fsync df/d1b/d31/fc5 0 2024-09-10T09:36:31.917 INFO:tasks.workunit.client.1.smithi135.stdout:2/677: write df/d1b/d23/db6/fcd [669172,55385] 0 2024-09-10T09:36:31.920 INFO:tasks.workunit.client.1.smithi135.stdout:4/874: mknod d1/de/d16/df9/c10f 0 2024-09-10T09:36:31.921 INFO:tasks.workunit.client.1.smithi135.stdout:9/686: fdatasync de/df/d1d/d23/f26 0 2024-09-10T09:36:31.921 INFO:tasks.workunit.client.1.smithi135.stdout:9/687: stat de/df/d1d/d1e/d52/fd9 0 2024-09-10T09:36:31.921 INFO:tasks.workunit.client.1.smithi135.stdout:9/688: readlink de/df/d1d/d1e/laa 0 2024-09-10T09:36:31.924 INFO:tasks.workunit.client.1.smithi135.stdout:1/750: mknod d1d/d20/d42/cf4 0 2024-09-10T09:36:31.925 INFO:tasks.workunit.client.1.smithi135.stdout:7/613: dwrite d2/d15/d4a/d36/f5b [0,4194304] 0 2024-09-10T09:36:31.925 INFO:tasks.workunit.client.1.smithi135.stdout:7/614: getdents d2/d15/d4a/d36/d84 0 2024-09-10T09:36:31.925 INFO:tasks.workunit.client.1.smithi135.stdout:0/710: write d8/dd/d11/d90/dc4/fdb [26827,40203] 0 2024-09-10T09:36:31.927 INFO:tasks.workunit.client.1.smithi135.stdout:2/678: getdents df/d1b/d23/d98/d5f/d2c 0 2024-09-10T09:36:31.928 INFO:tasks.workunit.client.1.smithi135.stdout:2/679: write df/d1b/d23/d98/d5f/d2c/f83 [724996,100852] 0 2024-09-10T09:36:31.930 INFO:tasks.workunit.client.1.smithi135.stdout:6/938: mkdir d5/d1e/d3b/d74/d129 0 2024-09-10T09:36:31.935 INFO:tasks.workunit.client.1.smithi135.stdout:9/689: symlink de/df/d1d/d1e/db5/d88/le8 0 2024-09-10T09:36:31.937 INFO:tasks.workunit.client.1.smithi135.stdout:2/680: dread df/f16 [0,4194304] 0 2024-09-10T09:36:31.937 INFO:tasks.workunit.client.1.smithi135.stdout:2/681: write df/d1b/d23/d98/d5f/d2c/f83 [1232005,99836] 0 2024-09-10T09:36:31.937 INFO:tasks.workunit.client.1.smithi135.stdout:2/682: fsync df/f17 0 2024-09-10T09:36:31.940 INFO:tasks.workunit.client.1.smithi135.stdout:6/939: link d5/d1e/d62/d8a/la1 d5/d15/ddf/l12a 0 2024-09-10T09:36:31.944 INFO:tasks.workunit.client.1.smithi135.stdout:4/875: rmdir d1/de/d16/d95 39 2024-09-10T09:36:31.944 INFO:tasks.workunit.client.1.smithi135.stdout:4/876: stat d1/db/d9/f32 0 2024-09-10T09:36:31.946 INFO:tasks.workunit.client.1.smithi135.stdout:6/940: dread d5/dd/d50/f7b [4194304,4194304] 0 2024-09-10T09:36:31.946 INFO:tasks.workunit.client.1.smithi135.stdout:9/690: mkdir de/df/d1d/d1e/d52/de9 0 2024-09-10T09:36:31.946 INFO:tasks.workunit.client.1.smithi135.stdout:9/691: stat de/df/d1d/d1e/d3f/dbb/fc2 0 2024-09-10T09:36:31.946 INFO:tasks.workunit.client.1.smithi135.stdout:0/711: dwrite d8/dd/db0/fd1 [0,4194304] 0 2024-09-10T09:36:31.946 INFO:tasks.workunit.client.1.smithi135.stdout:6/941: write d5/d1e/d35/d65/f84 [1720827,120191] 0 2024-09-10T09:36:31.998 INFO:tasks.workunit.client.1.smithi135.stdout:9/692: link cc de/df/d1d/d1e/db5/d88/dc6/cea 0 2024-09-10T09:36:31.998 INFO:tasks.workunit.client.1.smithi135.stdout:9/693: chown de/df/f5a 426425 1 2024-09-10T09:36:31.999 INFO:tasks.workunit.client.1.smithi135.stdout:6/942: creat d5/dd/d50/d54/dc1/f12b x:0 0 0 2024-09-10T09:36:31.999 INFO:tasks.workunit.client.1.smithi135.stdout:6/943: write d5/d1e/d35/f21 [1523467,59298] 0 2024-09-10T09:36:32.001 INFO:tasks.workunit.client.1.smithi135.stdout:1/751: rename d1d/d20/d5d to d1d/d20/d42/dd3/df5 0 2024-09-10T09:36:32.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/694: mkdir de/df/d1d/d1e/db5/d88/dc6/deb 0 2024-09-10T09:36:32.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/695: fdatasync de/df/d1d/d1e/d3f/f58 0 2024-09-10T09:36:32.003 INFO:tasks.workunit.client.1.smithi135.stdout:0/712: mkdir d8/dd/d11/d90/df0 0 2024-09-10T09:36:32.006 INFO:tasks.workunit.client.1.smithi135.stdout:7/615: rename d2/d15/da1 to d2/d25/d5d/dbd 0 2024-09-10T09:36:32.008 INFO:tasks.workunit.client.1.smithi135.stdout:1/752: read d1d/f3f [1706675,65324] 0 2024-09-10T09:36:32.008 INFO:tasks.workunit.client.1.smithi135.stdout:1/753: chown d1d/d20/d52/d8a/dc2/dca/d2b/f3a 1 1 2024-09-10T09:36:32.009 INFO:tasks.workunit.client.1.smithi135.stdout:9/696: mkdir de/df/d1d/d23/d25/d78/dec 0 2024-09-10T09:36:32.009 INFO:tasks.workunit.client.1.smithi135.stdout:6/944: write d5/d15/d27/f71 [4166246,21037] 0 2024-09-10T09:36:32.010 INFO:tasks.workunit.client.1.smithi135.stdout:0/713: dread d8/dd/d18/d3d/dc3/f57 [0,4194304] 0 2024-09-10T09:36:32.010 INFO:tasks.workunit.client.1.smithi135.stdout:0/714: creat d8/dd/d4a/d50/d67/ff1 x:0 0 0 2024-09-10T09:36:32.010 INFO:tasks.workunit.client.1.smithi135.stdout:0/715: fdatasync d8/dd/d4a/d50/d54/d5f/d4b/f75 0 2024-09-10T09:36:32.012 INFO:tasks.workunit.client.1.smithi135.stdout:2/683: rename df/d13/d4f/d95/d97/fd4 to df/d1b/d23/d98/d5f/d3d/d87/fd9 0 2024-09-10T09:36:32.012 INFO:tasks.workunit.client.1.smithi135.stdout:2/684: write df/d1b/d31/fc5 [60539,20401] 0 2024-09-10T09:36:32.012 INFO:tasks.workunit.client.1.smithi135.stdout:2/685: chown df/d1b/d23/d98/d5f/d3d/fb3 203877 1 2024-09-10T09:36:32.014 INFO:tasks.workunit.client.1.smithi135.stdout:7/616: link d2/d15/d41/d49/d60/d16/l33 d2/d15/d5c/d62/da5/d5e/lbe 0 2024-09-10T09:36:32.018 INFO:tasks.workunit.client.1.smithi135.stdout:6/945: symlink d5/d15/d56/d106/l12c 0 2024-09-10T09:36:32.018 INFO:tasks.workunit.client.1.smithi135.stdout:6/946: write d5/d1e/d3b/d42/d2d/d8f/fbd [4295961,57920] 0 2024-09-10T09:36:32.018 INFO:tasks.workunit.client.1.smithi135.stdout:6/947: stat d5/d1e/d3b/d42/d2d/d55/d5b/l88 0 2024-09-10T09:36:32.018 INFO:tasks.workunit.client.1.smithi135.stdout:6/948: read - d5/d15/fcb zero size 2024-09-10T09:36:32.018 INFO:tasks.workunit.client.1.smithi135.stdout:6/949: write d5/d1e/d3b/d42/d3c/de2/d122/f126 [314643,110841] 0 2024-09-10T09:36:32.018 INFO:tasks.workunit.client.1.smithi135.stdout:6/950: write d5/d1e/d35/f9b [12647743,37870] 0 2024-09-10T09:36:32.022 INFO:tasks.workunit.client.1.smithi135.stdout:0/716: creat d8/dd/d18/d3d/dc3/d37/d73/dc5/ff2 x:0 0 0 2024-09-10T09:36:32.024 INFO:tasks.workunit.client.1.smithi135.stdout:9/697: dwrite de/df/f3e [4194304,4194304] 0 2024-09-10T09:36:32.025 INFO:tasks.workunit.client.1.smithi135.stdout:7/617: dread d2/d15/d41/d49/d60/f43 [0,4194304] 0 2024-09-10T09:36:32.025 INFO:tasks.workunit.client.1.smithi135.stdout:7/618: chown d2/d15/d5c/d62/da5/la2 86 1 2024-09-10T09:36:32.028 INFO:tasks.workunit.client.1.smithi135.stdout:4/877: rename d1/db/da0/cbe to d1/db/c110 0 2024-09-10T09:36:32.028 INFO:tasks.workunit.client.1.smithi135.stdout:4/878: chown d1/db/d9/d55/d76/ffa 788 1 2024-09-10T09:36:32.030 INFO:tasks.workunit.client.1.smithi135.stdout:2/686: unlink df/d1b/d23/f88 0 2024-09-10T09:36:32.032 INFO:tasks.workunit.client.1.smithi135.stdout:6/951: truncate d5/dd/f6e 395399 0 2024-09-10T09:36:32.032 INFO:tasks.workunit.client.1.smithi135.stdout:6/952: stat d5/de8/l115 0 2024-09-10T09:36:32.034 INFO:tasks.workunit.client.1.smithi135.stdout:0/717: unlink d8/dd/d11/d17/fa6 0 2024-09-10T09:36:32.036 INFO:tasks.workunit.client.1.smithi135.stdout:4/879: mkdir d1/db/d9/d55/d70/d111 0 2024-09-10T09:36:32.040 INFO:tasks.workunit.client.1.smithi135.stdout:0/718: rename d8/dd/d4a/d50/d67/ff1 to d8/dd/d11/ff3 0 2024-09-10T09:36:32.040 INFO:tasks.workunit.client.1.smithi135.stdout:4/880: write d1/de/d16/f67 [398156,78715] 0 2024-09-10T09:36:32.042 INFO:tasks.workunit.client.1.smithi135.stdout:7/619: dwrite d2/d25/f3f [4194304,4194304] 0 2024-09-10T09:36:32.042 INFO:tasks.workunit.client.1.smithi135.stdout:7/620: chown d2/d26/f8b 0 1 2024-09-10T09:36:32.043 INFO:tasks.workunit.client.1.smithi135.stdout:6/953: getdents d5/dd/d50/db3 0 2024-09-10T09:36:32.043 INFO:tasks.workunit.client.1.smithi135.stdout:6/954: write d5/f17 [356982,67843] 0 2024-09-10T09:36:32.045 INFO:tasks.workunit.client.1.smithi135.stdout:0/719: creat d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1/ff4 x:0 0 0 2024-09-10T09:36:32.052 INFO:tasks.workunit.client.1.smithi135.stdout:9/698: dread de/df/f40 [0,4194304] 0 2024-09-10T09:36:32.052 INFO:tasks.workunit.client.1.smithi135.stdout:9/699: truncate de/f15 5126654 0 2024-09-10T09:36:32.054 INFO:tasks.workunit.client.1.smithi135.stdout:7/621: write d2/f10 [886450,44129] 0 2024-09-10T09:36:32.056 INFO:tasks.workunit.client.1.smithi135.stdout:4/881: mknod d1/d85/c112 0 2024-09-10T09:36:32.067 INFO:tasks.workunit.client.1.smithi135.stdout:6/955: mknod d5/d1e/d3b/d42/c12d 0 2024-09-10T09:36:32.067 INFO:tasks.workunit.client.1.smithi135.stdout:6/956: write d5/d1e/d3b/d49/f94 [1960415,103899] 0 2024-09-10T09:36:32.068 INFO:tasks.workunit.client.1.smithi135.stdout:6/957: readlink d5/dd/l11d 0 2024-09-10T09:36:32.069 INFO:tasks.workunit.client.1.smithi135.stdout:0/720: creat d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/de7/ff5 x:0 0 0 2024-09-10T09:36:32.078 INFO:tasks.workunit.client.1.smithi135.stdout:9/700: dwrite de/df/d1d/d1e/d52/fe1 [0,4194304] 0 2024-09-10T09:36:32.078 INFO:tasks.workunit.client.1.smithi135.stdout:9/701: creat de/df/d1d/fed x:0 0 0 2024-09-10T09:36:32.090 INFO:tasks.workunit.client.1.smithi135.stdout:7/622: truncate d2/d15/d4a/fe 3337428 0 2024-09-10T09:36:32.095 INFO:tasks.workunit.client.1.smithi135.stdout:4/882: dwrite d1/db/ff [0,4194304] 0 2024-09-10T09:36:32.107 INFO:tasks.workunit.client.1.smithi135.stdout:6/958: dwrite d5/d15/d56/f95 [0,4194304] 0 2024-09-10T09:36:32.108 INFO:tasks.workunit.client.1.smithi135.stdout:0/721: dwrite d8/dd/d18/d3d/dc3/d37/fc0 [0,4194304] 0 2024-09-10T09:36:32.108 INFO:tasks.workunit.client.1.smithi135.stdout:0/722: fdatasync d8/dd/d11/d17/fa3 0 2024-09-10T09:36:32.109 INFO:tasks.workunit.client.1.smithi135.stdout:9/702: symlink de/df/d1d/d1e/lee 0 2024-09-10T09:36:32.109 INFO:tasks.workunit.client.1.smithi135.stdout:9/703: truncate de/df/d1d/d1e/db5/d88/f93 8942323 0 2024-09-10T09:36:32.109 INFO:tasks.workunit.client.1.smithi135.stdout:9/704: creat de/df/d1d/fef x:0 0 0 2024-09-10T09:36:32.109 INFO:tasks.workunit.client.1.smithi135.stdout:9/705: dread - de/df/d1d/d23/d25/fc1 zero size 2024-09-10T09:36:32.113 INFO:tasks.workunit.client.1.smithi135.stdout:7/623: mkdir d2/d15/d5c/d62/da5/d5e/d8c/dbf 0 2024-09-10T09:36:32.113 INFO:tasks.workunit.client.1.smithi135.stdout:7/624: dread - d2/d15/d4a/d36/f6a zero size 2024-09-10T09:36:32.117 INFO:tasks.workunit.client.1.smithi135.stdout:4/883: mknod d1/db/d9/d55/db5/c113 0 2024-09-10T09:36:32.117 INFO:tasks.workunit.client.1.smithi135.stdout:4/884: write d1/d33/d40/def/ff1 [1069369,127638] 0 2024-09-10T09:36:32.117 INFO:tasks.workunit.client.1.smithi135.stdout:4/885: write d1/d8a/fbf [1154486,15156] 0 2024-09-10T09:36:32.119 INFO:tasks.workunit.client.1.smithi135.stdout:6/959: read d5/d1e/d3b/f41 [1400082,13518] 0 2024-09-10T09:36:32.130 INFO:tasks.workunit.client.1.smithi135.stdout:0/723: truncate d8/dd/d11/d90/fb8 114979 0 2024-09-10T09:36:32.131 INFO:tasks.workunit.client.1.smithi135.stdout:4/886: dread d1/db/ff [0,4194304] 0 2024-09-10T09:36:32.136 INFO:tasks.workunit.client.1.smithi135.stdout:9/706: symlink de/df/d1d/d62/lf0 0 2024-09-10T09:36:32.139 INFO:tasks.workunit.client.1.smithi135.stdout:7/625: rename d2/d15/f3d to d2/d25/d9d/daf/fc0 0 2024-09-10T09:36:32.140 INFO:tasks.workunit.client.1.smithi135.stdout:7/626: chown d2/d15/d41/d49/d60/d16/f28 109 1 2024-09-10T09:36:32.140 INFO:tasks.workunit.client.1.smithi135.stdout:7/627: dread - d2/d15/d4a/d36/f6a zero size 2024-09-10T09:36:32.140 INFO:tasks.workunit.client.1.smithi135.stdout:7/628: chown d2/d15/d5c/d62/da5 3611223 1 2024-09-10T09:36:32.140 INFO:tasks.workunit.client.1.smithi135.stdout:7/629: creat d2/d15/d5c/fc1 x:0 0 0 2024-09-10T09:36:32.142 INFO:tasks.workunit.client.1.smithi135.stdout:6/960: symlink d5/d1e/d3b/d42/d2d/l12e 0 2024-09-10T09:36:32.144 INFO:tasks.workunit.client.1.smithi135.stdout:4/887: write d1/f90 [109531,90846] 0 2024-09-10T09:36:32.144 INFO:tasks.workunit.client.1.smithi135.stdout:4/888: creat d1/db/d9/d55/d70/da4/f114 x:0 0 0 2024-09-10T09:36:32.149 INFO:tasks.workunit.client.1.smithi135.stdout:9/707: write de/df/d1d/d23/f27 [3635405,73129] 0 2024-09-10T09:36:32.150 INFO:tasks.workunit.client.1.smithi135.stdout:9/708: write de/df/d1d/d62/fdc [115961,124177] 0 2024-09-10T09:36:32.151 INFO:tasks.workunit.client.1.smithi135.stdout:0/724: mkdir d8/dd/d11/d17/df6 0 2024-09-10T09:36:32.160 INFO:tasks.workunit.client.1.smithi135.stdout:7/630: truncate d2/d15/d4a/d36/d84/f91 3640039 0 2024-09-10T09:36:32.161 INFO:tasks.workunit.client.1.smithi135.stdout:6/961: mkdir d5/d58/d12f 0 2024-09-10T09:36:32.161 INFO:tasks.workunit.client.1.smithi135.stdout:6/962: chown d5/d1e/d3b/d42/d2d/d55/l103 443279 1 2024-09-10T09:36:32.164 INFO:tasks.workunit.client.1.smithi135.stdout:0/725: dread d8/dd/f13 [0,4194304] 0 2024-09-10T09:36:32.167 INFO:tasks.workunit.client.1.smithi135.stdout:4/889: truncate d1/db/d23/f30 4598557 0 2024-09-10T09:36:32.168 INFO:tasks.workunit.client.1.smithi135.stdout:7/631: mknod d2/d15/d4a/d36/cc2 0 2024-09-10T09:36:32.171 INFO:tasks.workunit.client.1.smithi135.stdout:6/963: creat d5/d1e/d3b/d42/f130 x:0 0 0 2024-09-10T09:36:32.172 INFO:tasks.workunit.client.1.smithi135.stdout:0/726: creat d8/dd/d11/d17/df6/ff7 x:0 0 0 2024-09-10T09:36:32.176 INFO:tasks.workunit.client.1.smithi135.stdout:6/964: link d5/d58/l96 d5/d15/l131 0 2024-09-10T09:36:32.177 INFO:tasks.workunit.client.1.smithi135.stdout:9/709: dwrite de/df/d1d/d1e/db5/d88/fd2 [0,4194304] 0 2024-09-10T09:36:32.177 INFO:tasks.workunit.client.1.smithi135.stdout:9/710: chown de/df/d1d/d23/d25/c76 1006082 1 2024-09-10T09:36:32.178 INFO:tasks.workunit.client.1.smithi135.stdout:0/727: creat d8/dd/d11/ff8 x:0 0 0 2024-09-10T09:36:32.180 INFO:tasks.workunit.client.1.smithi135.stdout:6/965: creat d5/d1e/d3b/d42/d2d/d8f/f132 x:0 0 0 2024-09-10T09:36:32.180 INFO:tasks.workunit.client.1.smithi135.stdout:6/966: chown d5/d1e/d3b/d42/d2d/l33 1 1 2024-09-10T09:36:32.180 INFO:tasks.workunit.client.1.smithi135.stdout:4/890: dread d1/de/d16/f109 [0,4194304] 0 2024-09-10T09:36:32.180 INFO:tasks.workunit.client.1.smithi135.stdout:4/891: chown d1/d33/le8 2483 1 2024-09-10T09:36:32.180 INFO:tasks.workunit.client.1.smithi135.stdout:6/967: chown d5/d1e/d3b/d42/d2d/d55/d5b/fba 261698038 1 2024-09-10T09:36:32.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/632: write d2/d15/d41/d49/d60/d30/d71/f92 [2153776,122340] 0 2024-09-10T09:36:32.191 INFO:tasks.workunit.client.1.smithi135.stdout:9/711: rename de/df/d1d/fef to de/df/d1d/d62/ff1 0 2024-09-10T09:36:32.192 INFO:tasks.workunit.client.1.smithi135.stdout:0/728: mkdir d8/dd/d18/d3d/dc3/d61/df9 0 2024-09-10T09:36:32.193 INFO:tasks.workunit.client.1.smithi135.stdout:6/968: symlink d5/d1e/d3b/d42/d2d/d55/d5b/d11b/l133 0 2024-09-10T09:36:32.193 INFO:tasks.workunit.client.1.smithi135.stdout:6/969: stat d5/dd/d50/d86/dcd/ldb 0 2024-09-10T09:36:32.194 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:31 smithi079 ceph-mon[27592]: pgmap v270: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 145 MiB/s rd, 151 MiB/s wr, 308 op/s 2024-09-10T09:36:32.203 INFO:tasks.workunit.client.1.smithi135.stdout:9/712: creat de/df/d1d/d23/d25/d28/d7b/ff2 x:0 0 0 2024-09-10T09:36:32.205 INFO:tasks.workunit.client.1.smithi135.stdout:7/633: dread d2/d25/d9d/daf/fc0 [0,4194304] 0 2024-09-10T09:36:32.208 INFO:tasks.workunit.client.1.smithi135.stdout:0/729: symlink d8/dd/d18/d3d/dc3/d37/d73/dc5/lfa 0 2024-09-10T09:36:32.211 INFO:tasks.workunit.client.1.smithi135.stdout:6/970: mknod d5/dd/d50/db3/c134 0 2024-09-10T09:36:32.211 INFO:tasks.workunit.client.1.smithi135.stdout:6/971: dread - d5/d1e/d35/d65/f119 zero size 2024-09-10T09:36:32.215 INFO:tasks.workunit.client.1.smithi135.stdout:4/892: dwrite d1/db/ff [4194304,4194304] 0 2024-09-10T09:36:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:31 smithi135 ceph-mon[33411]: pgmap v270: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 145 MiB/s rd, 151 MiB/s wr, 308 op/s 2024-09-10T09:36:32.221 INFO:tasks.workunit.client.1.smithi135.stdout:0/730: read d8/dd/d4a/d50/d54/f9a [2409298,1702] 0 2024-09-10T09:36:32.223 INFO:tasks.workunit.client.1.smithi135.stdout:6/972: creat d5/dd/d50/db3/f135 x:0 0 0 2024-09-10T09:36:32.223 INFO:tasks.workunit.client.1.smithi135.stdout:6/973: creat d5/d15/d27/f136 x:0 0 0 2024-09-10T09:36:32.223 INFO:tasks.workunit.client.1.smithi135.stdout:6/974: readlink d5/dd/d50/d54/db9/dd9/dd7/le3 0 2024-09-10T09:36:32.226 INFO:tasks.workunit.client.1.smithi135.stdout:4/893: unlink d1/d33/le8 0 2024-09-10T09:36:32.226 INFO:tasks.workunit.client.1.smithi135.stdout:4/894: chown d1/de/d16/d8b/fcc 311 1 2024-09-10T09:36:32.226 INFO:tasks.workunit.client.1.smithi135.stdout:9/713: dwrite de/df/d1d/d23/d25/f48 [0,4194304] 0 2024-09-10T09:36:32.229 INFO:tasks.workunit.client.1.smithi135.stdout:7/634: getdents d2/d15/d5c/d62/da5 0 2024-09-10T09:36:32.229 INFO:tasks.workunit.client.1.smithi135.stdout:7/635: creat d2/d15/d39/d9f/fc3 x:0 0 0 2024-09-10T09:36:32.230 INFO:tasks.workunit.client.1.smithi135.stdout:7/636: stat d2/d15/d81 0 2024-09-10T09:36:32.233 INFO:tasks.workunit.client.1.smithi135.stdout:0/731: mknod d8/dd/d18/d3d/dc3/cfb 0 2024-09-10T09:36:32.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/687: write df/d1b/d23/d42/f6e [1127327,118624] 0 2024-09-10T09:36:32.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/688: dread - df/d1b/d23/d98/d5f/fd3 zero size 2024-09-10T09:36:32.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/689: write df/d1b/f9e [106910,105374] 0 2024-09-10T09:36:32.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/690: write df/d1b/d23/d98/d5f/d3d/d87/fd9 [759973,87913] 0 2024-09-10T09:36:32.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/691: fsync df/f10 0 2024-09-10T09:36:32.239 INFO:tasks.workunit.client.1.smithi135.stdout:2/692: creat df/d1b/d70/fda x:0 0 0 2024-09-10T09:36:32.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/714: symlink de/df/d1d/d1e/db5/lf3 0 2024-09-10T09:36:32.244 INFO:tasks.workunit.client.1.smithi135.stdout:4/895: dwrite d1/d33/f3d [0,4194304] 0 2024-09-10T09:36:32.245 INFO:tasks.workunit.client.1.smithi135.stdout:7/637: unlink d2/d15/d4a/f48 0 2024-09-10T09:36:32.247 INFO:tasks.workunit.client.1.smithi135.stdout:0/732: truncate d8/dd/d4a/d50/d67/fec 37658 0 2024-09-10T09:36:32.249 INFO:tasks.workunit.client.1.smithi135.stdout:9/715: symlink de/df/d1d/d1e/db5/d88/dc6/lf4 0 2024-09-10T09:36:32.251 INFO:tasks.workunit.client.1.smithi135.stdout:4/896: symlink d1/de/d16/db8/dfe/l115 0 2024-09-10T09:36:32.253 INFO:tasks.workunit.client.1.smithi135.stdout:0/733: symlink d8/dd/d4a/d50/d54/lfc 0 2024-09-10T09:36:32.256 INFO:tasks.workunit.client.1.smithi135.stdout:9/716: unlink de/df/f1b 0 2024-09-10T09:36:32.257 INFO:tasks.workunit.client.1.smithi135.stdout:4/897: rename d1/db/d9/d55/d70/d111 to d1/db/d9/d55/db5/d116 0 2024-09-10T09:36:32.259 INFO:tasks.workunit.client.1.smithi135.stdout:0/734: mkdir d8/d80/dfd 0 2024-09-10T09:36:32.260 INFO:tasks.workunit.client.1.smithi135.stdout:9/717: mkdir de/df/d1d/d1e/db5/d83/df5 0 2024-09-10T09:36:32.260 INFO:tasks.workunit.client.1.smithi135.stdout:9/718: truncate de/df/d1d/d1e/db5/d88/fd6 291914 0 2024-09-10T09:36:32.262 INFO:tasks.workunit.client.1.smithi135.stdout:0/735: mknod d8/dd/d11/d90/df0/cfe 0 2024-09-10T09:36:32.265 INFO:tasks.workunit.client.1.smithi135.stdout:7/638: dwrite d2/d25/f3f [4194304,4194304] 0 2024-09-10T09:36:32.266 INFO:tasks.workunit.client.1.smithi135.stdout:9/719: rename de/df/d1d/d1e/db5/f6d to de/df/d7e/ff6 0 2024-09-10T09:36:32.267 INFO:tasks.workunit.client.1.smithi135.stdout:0/736: symlink d8/dd/d18/d3d/dc3/d61/db1/lff 0 2024-09-10T09:36:32.268 INFO:tasks.workunit.client.1.smithi135.stdout:7/639: mknod d2/d15/d39/d6f/cc4 0 2024-09-10T09:36:32.271 INFO:tasks.workunit.client.1.smithi135.stdout:9/720: rename de/f21 to de/df/dac/db7/ff7 0 2024-09-10T09:36:32.272 INFO:tasks.workunit.client.1.smithi135.stdout:4/898: read d1/de/f59 [300904,99300] 0 2024-09-10T09:36:32.272 INFO:tasks.workunit.client.1.smithi135.stdout:4/899: write d1/db/d9/d55/d7b/fe2 [1026170,81186] 0 2024-09-10T09:36:32.272 INFO:tasks.workunit.client.1.smithi135.stdout:2/693: dwrite df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf [0,4194304] 0 2024-09-10T09:36:32.272 INFO:tasks.workunit.client.1.smithi135.stdout:2/694: dread - df/d1b/d70/fda zero size 2024-09-10T09:36:32.272 INFO:tasks.workunit.client.1.smithi135.stdout:2/695: chown df/d1b/d30/f6a 209 1 2024-09-10T09:36:32.273 INFO:tasks.workunit.client.1.smithi135.stdout:0/737: symlink d8/dd/d11/d90/dc4/l100 0 2024-09-10T09:36:32.273 INFO:tasks.workunit.client.1.smithi135.stdout:7/640: link d2/d15/d4a/l32 d2/d15/d41/d49/d60/d16/lc5 0 2024-09-10T09:36:32.275 INFO:tasks.workunit.client.1.smithi135.stdout:9/721: symlink de/df/d1d/d1e/d52/de9/lf8 0 2024-09-10T09:36:32.275 INFO:tasks.workunit.client.1.smithi135.stdout:9/722: write de/df/d1d/d23/d25/fcc [166376,39392] 0 2024-09-10T09:36:32.278 INFO:tasks.workunit.client.1.smithi135.stdout:4/900: creat d1/d85/f117 x:0 0 0 2024-09-10T09:36:32.279 INFO:tasks.workunit.client.1.smithi135.stdout:4/901: write d1/d4a/d9d/da1/ff6 [989358,6179] 0 2024-09-10T09:36:32.279 INFO:tasks.workunit.client.1.smithi135.stdout:4/902: fsync d1/de/d16/d98/ff8 0 2024-09-10T09:36:32.283 INFO:tasks.workunit.client.1.smithi135.stdout:0/738: unlink d8/dd/d4a/d50/d67/f71 0 2024-09-10T09:36:32.283 INFO:tasks.workunit.client.1.smithi135.stdout:0/739: chown d8/dd/d11/d17/df6 7194 1 2024-09-10T09:36:32.290 INFO:tasks.workunit.client.1.smithi135.stdout:0/740: rmdir d8/dd/d18/d3d/dc3/d37/d73/d88/db6 39 2024-09-10T09:36:32.290 INFO:tasks.workunit.client.1.smithi135.stdout:4/903: read d1/f77 [1788675,106288] 0 2024-09-10T09:36:32.291 INFO:tasks.workunit.client.1.smithi135.stdout:7/641: write d2/d15/d41/d49/d60/d30/f35 [2949459,62590] 0 2024-09-10T09:36:32.297 INFO:tasks.workunit.client.1.smithi135.stdout:7/642: creat d2/d15/d41/fc6 x:0 0 0 2024-09-10T09:36:32.300 INFO:tasks.workunit.client.1.smithi135.stdout:2/696: dwrite df/d1b/d23/fc3 [0,4194304] 0 2024-09-10T09:36:32.300 INFO:tasks.workunit.client.1.smithi135.stdout:2/697: truncate df/d1b/d30/f37 559765 0 2024-09-10T09:36:32.300 INFO:tasks.workunit.client.1.smithi135.stdout:2/698: readlink df/d13/l47 0 2024-09-10T09:36:32.301 INFO:tasks.workunit.client.1.smithi135.stdout:2/699: write df/d13/f7a [417267,15970] 0 2024-09-10T09:36:32.301 INFO:tasks.workunit.client.1.smithi135.stdout:2/700: write df/d1b/f1c [217330,28328] 0 2024-09-10T09:36:32.303 INFO:tasks.workunit.client.1.smithi135.stdout:9/723: dwrite de/df/d1d/d1e/d68/f6f [0,4194304] 0 2024-09-10T09:36:32.306 INFO:tasks.workunit.client.1.smithi135.stdout:9/724: dread de/df/d7e/ff6 [0,4194304] 0 2024-09-10T09:36:32.308 INFO:tasks.workunit.client.1.smithi135.stdout:9/725: dread de/df/d1d/d1e/db5/d88/f98 [0,4194304] 0 2024-09-10T09:36:32.308 INFO:tasks.workunit.client.1.smithi135.stdout:9/726: creat de/df/ff9 x:0 0 0 2024-09-10T09:36:32.309 INFO:tasks.workunit.client.1.smithi135.stdout:0/741: dread d8/dd/d18/d3d/dc3/d61/f8a [0,4194304] 0 2024-09-10T09:36:32.318 INFO:tasks.workunit.client.1.smithi135.stdout:5/725: sync 2024-09-10T09:36:32.318 INFO:tasks.workunit.client.1.smithi135.stdout:3/505: sync 2024-09-10T09:36:32.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/742: unlink d8/dd/d18/d3d/dc3/d37/d73/d7f/fa1 0 2024-09-10T09:36:32.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/743: fsync d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1/ff4 0 2024-09-10T09:36:32.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/744: creat d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/de7/f101 x:0 0 0 2024-09-10T09:36:32.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/745: fsync d8/dd/d18/d3d/dc3/d61/fea 0 2024-09-10T09:36:32.321 INFO:tasks.workunit.client.1.smithi135.stdout:0/746: fsync d8/dd/d18/d3d/dc3/d61/fd0 0 2024-09-10T09:36:32.325 INFO:tasks.workunit.client.1.smithi135.stdout:8/642: sync 2024-09-10T09:36:32.327 INFO:tasks.workunit.client.1.smithi135.stdout:1/754: sync 2024-09-10T09:36:32.327 INFO:tasks.workunit.client.1.smithi135.stdout:1/755: readlink d1d/d20/d42/dd3/df5/l82 0 2024-09-10T09:36:32.327 INFO:tasks.workunit.client.1.smithi135.stdout:2/701: rename df/d1b/d23/d98/l69 to df/d1b/d23/d98/d5f/ldb 0 2024-09-10T09:36:32.327 INFO:tasks.workunit.client.1.smithi135.stdout:7/643: dwrite d2/d25/d9d/daf/fc0 [4194304,4194304] 0 2024-09-10T09:36:32.333 INFO:tasks.workunit.client.1.smithi135.stdout:2/702: dread df/f12 [0,4194304] 0 2024-09-10T09:36:32.345 INFO:tasks.workunit.client.1.smithi135.stdout:3/506: unlink d4/d5/db/c16 0 2024-09-10T09:36:32.345 INFO:tasks.workunit.client.1.smithi135.stdout:3/507: readlink d4/d55/d5d/d5b/l61 0 2024-09-10T09:36:32.345 INFO:tasks.workunit.client.1.smithi135.stdout:3/508: readlink d4/d55/d5d/l5a 0 2024-09-10T09:36:32.345 INFO:tasks.workunit.client.1.smithi135.stdout:3/509: write d4/d55/d5d/d5b/f8d [3021781,79559] 0 2024-09-10T09:36:32.349 INFO:tasks.workunit.client.1.smithi135.stdout:8/643: unlink d1/d15/d16/d71/f8d 0 2024-09-10T09:36:32.349 INFO:tasks.workunit.client.1.smithi135.stdout:0/747: dwrite d8/dd/d4a/fc9 [0,4194304] 0 2024-09-10T09:36:32.349 INFO:tasks.workunit.client.1.smithi135.stdout:5/726: dwrite d3/d44/fbe [0,4194304] 0 2024-09-10T09:36:32.349 INFO:tasks.workunit.client.1.smithi135.stdout:5/727: stat d3/dc/dba/d88/fa1 0 2024-09-10T09:36:32.349 INFO:tasks.workunit.client.1.smithi135.stdout:5/728: write d3/dc/dba/d48/d57/da3/f62 [4774436,51735] 0 2024-09-10T09:36:32.350 INFO:tasks.workunit.client.1.smithi135.stdout:1/756: mkdir d1d/d71/d9e/df6 0 2024-09-10T09:36:32.356 INFO:tasks.workunit.client.1.smithi135.stdout:3/510: mknod d4/c94 0 2024-09-10T09:36:32.356 INFO:tasks.workunit.client.1.smithi135.stdout:3/511: creat d4/d5/dc/f95 x:0 0 0 2024-09-10T09:36:32.359 INFO:tasks.workunit.client.1.smithi135.stdout:8/644: truncate d1/d15/d16/d33/d45/f5d 5923872 0 2024-09-10T09:36:32.360 INFO:tasks.workunit.client.1.smithi135.stdout:8/645: read d1/d27/d3d/d94/da7/fbb [31938,7373] 0 2024-09-10T09:36:32.363 INFO:tasks.workunit.client.1.smithi135.stdout:0/748: symlink d8/dd/d18/d3d/dc3/d61/l102 0 2024-09-10T09:36:32.363 INFO:tasks.workunit.client.1.smithi135.stdout:0/749: fdatasync d8/dd/d11/d90/fb8 0 2024-09-10T09:36:32.368 INFO:tasks.workunit.client.1.smithi135.stdout:1/757: link d1d/d20/d42/cd9 d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/dd2/cf7 0 2024-09-10T09:36:32.370 INFO:tasks.workunit.client.1.smithi135.stdout:5/729: dwrite d3/dc/f8c [0,4194304] 0 2024-09-10T09:36:32.376 INFO:tasks.workunit.client.1.smithi135.stdout:8/646: dread d1/d15/fcc [0,4194304] 0 2024-09-10T09:36:32.383 INFO:tasks.workunit.client.1.smithi135.stdout:5/730: creat d3/dc/d69/d65/ffe x:0 0 0 2024-09-10T09:36:32.385 INFO:tasks.workunit.client.1.smithi135.stdout:0/750: link d8/dd/d11/d90/ldf d8/dd/d4a/d50/d54/d5f/d4b/l103 0 2024-09-10T09:36:32.388 INFO:tasks.workunit.client.1.smithi135.stdout:8/647: unlink d1/d15/d49/d7c/c5b 0 2024-09-10T09:36:32.388 INFO:tasks.workunit.client.1.smithi135.stdout:8/648: chown d1/d15/d16/d33/d45/f50 102357 1 2024-09-10T09:36:32.388 INFO:tasks.workunit.client.1.smithi135.stdout:8/649: fdatasync d1/d15/d16/d33/f97 0 2024-09-10T09:36:32.393 INFO:tasks.workunit.client.1.smithi135.stdout:3/512: dwrite d4/f4d [0,4194304] 0 2024-09-10T09:36:32.393 INFO:tasks.workunit.client.1.smithi135.stdout:8/650: dread d1/d15/f4d [0,4194304] 0 2024-09-10T09:36:32.394 INFO:tasks.workunit.client.1.smithi135.stdout:1/758: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/f32 [4194304,4194304] 0 2024-09-10T09:36:32.396 INFO:tasks.workunit.client.1.smithi135.stdout:1/759: dread d1d/d20/d3c/d6a/f79 [0,4194304] 0 2024-09-10T09:36:32.396 INFO:tasks.workunit.client.1.smithi135.stdout:1/760: fdatasync d1d/d20/f31 0 2024-09-10T09:36:32.396 INFO:tasks.workunit.client.1.smithi135.stdout:1/761: chown d1d/d20/d42/f91 1 1 2024-09-10T09:36:32.401 INFO:tasks.workunit.client.1.smithi135.stdout:5/731: rename d3/dc/dba/l78 to d3/d71/lff 0 2024-09-10T09:36:32.402 INFO:tasks.workunit.client.1.smithi135.stdout:0/751: mknod d8/dd/d11/d17/c104 0 2024-09-10T09:36:32.407 INFO:tasks.workunit.client.1.smithi135.stdout:3/513: link d4/d55/f60 d4/f96 0 2024-09-10T09:36:32.417 INFO:tasks.workunit.client.1.smithi135.stdout:1/762: getdents d1d/d20/d52/d8a/dc2/dca/d2b/d4c 0 2024-09-10T09:36:32.418 INFO:tasks.workunit.client.1.smithi135.stdout:1/763: fsync d1d/f27 0 2024-09-10T09:36:32.418 INFO:tasks.workunit.client.1.smithi135.stdout:5/732: mknod d3/d44/c100 0 2024-09-10T09:36:32.423 INFO:tasks.workunit.client.1.smithi135.stdout:1/764: link d1d/f2a d1d/d20/d3c/d4e/ff8 0 2024-09-10T09:36:32.425 INFO:tasks.workunit.client.1.smithi135.stdout:5/733: symlink d3/dc/d69/d65/d6c/l101 0 2024-09-10T09:36:32.426 INFO:tasks.workunit.client.1.smithi135.stdout:9/727: rmdir de/df/d1d/d1e 39 2024-09-10T09:36:32.430 INFO:tasks.workunit.client.1.smithi135.stdout:5/734: dread d3/dc/dba/d4e/dd0/f96 [0,4194304] 0 2024-09-10T09:36:32.434 INFO:tasks.workunit.client.1.smithi135.stdout:3/514: dwrite d4/d5/d51/f86 [0,4194304] 0 2024-09-10T09:36:32.435 INFO:tasks.workunit.client.1.smithi135.stdout:5/735: mknod d3/d44/c102 0 2024-09-10T09:36:32.437 INFO:tasks.workunit.client.1.smithi135.stdout:0/752: dwrite d8/dd/d18/f43 [0,4194304] 0 2024-09-10T09:36:32.441 INFO:tasks.workunit.client.1.smithi135.stdout:8/651: dwrite d1/d15/d16/d33/f97 [0,4194304] 0 2024-09-10T09:36:32.441 INFO:tasks.workunit.client.1.smithi135.stdout:1/765: dread d1d/d20/f77 [0,4194304] 0 2024-09-10T09:36:32.444 INFO:tasks.workunit.client.1.smithi135.stdout:0/753: mkdir d8/de/d105 0 2024-09-10T09:36:32.445 INFO:tasks.workunit.client.1.smithi135.stdout:3/515: unlink d4/d5/db/dd/d79/l35 0 2024-09-10T09:36:32.447 INFO:tasks.workunit.client.1.smithi135.stdout:0/754: dread d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/db9/dc1/f7b [0,4194304] 0 2024-09-10T09:36:32.447 INFO:tasks.workunit.client.1.smithi135.stdout:0/755: write d8/dd/d18/d3d/dc3/d61/fea [1019410,9523] 0 2024-09-10T09:36:32.449 INFO:tasks.workunit.client.1.smithi135.stdout:8/652: rename d1/d13/f95 to d1/d15/fd6 0 2024-09-10T09:36:32.452 INFO:tasks.workunit.client.1.smithi135.stdout:3/516: creat d4/d5/db/d44/f97 x:0 0 0 2024-09-10T09:36:32.452 INFO:tasks.workunit.client.1.smithi135.stdout:3/517: chown d4/d5/db/dd/f5f 0 1 2024-09-10T09:36:32.452 INFO:tasks.workunit.client.1.smithi135.stdout:9/728: dwrite de/df/ff9 [0,4194304] 0 2024-09-10T09:36:32.453 INFO:tasks.workunit.client.1.smithi135.stdout:0/756: creat d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/f106 x:0 0 0 2024-09-10T09:36:32.453 INFO:tasks.workunit.client.1.smithi135.stdout:0/757: write d8/dd/d11/d90/dc4/fe9 [973555,9503] 0 2024-09-10T09:36:32.457 INFO:tasks.workunit.client.1.smithi135.stdout:3/518: dread d4/d5/db/dd/f5f [0,4194304] 0 2024-09-10T09:36:32.462 INFO:tasks.workunit.client.1.smithi135.stdout:0/758: getdents d8/dd/d4a 0 2024-09-10T09:36:32.465 INFO:tasks.workunit.client.1.smithi135.stdout:3/519: symlink d4/d5/l98 0 2024-09-10T09:36:32.470 INFO:tasks.workunit.client.1.smithi135.stdout:3/520: mknod d4/d5/db/dd/d79/c99 0 2024-09-10T09:36:32.470 INFO:tasks.workunit.client.1.smithi135.stdout:3/521: chown d4/d5/d56/l6d 8 1 2024-09-10T09:36:32.470 INFO:tasks.workunit.client.1.smithi135.stdout:3/522: chown d4/d5/db/d36/d43/d87 91303 1 2024-09-10T09:36:32.471 INFO:tasks.workunit.client.1.smithi135.stdout:8/653: write d1/d15/d16/d33/d45/d6f/f92 [1081433,36927] 0 2024-09-10T09:36:32.472 INFO:tasks.workunit.client.1.smithi135.stdout:1/766: dwrite d1d/d20/f43 [0,4194304] 0 2024-09-10T09:36:32.472 INFO:tasks.workunit.client.1.smithi135.stdout:1/767: dread - d1d/d20/d52/d8a/dc2/dca/d37/d6d/fb2 zero size 2024-09-10T09:36:32.475 INFO:tasks.workunit.client.1.smithi135.stdout:5/736: dwrite d3/f9 [0,4194304] 0 2024-09-10T09:36:32.476 INFO:tasks.workunit.client.1.smithi135.stdout:5/737: chown d3/dc/dba/d48/d57/dca/cd9 46815253 1 2024-09-10T09:36:32.476 INFO:tasks.workunit.client.1.smithi135.stdout:8/654: symlink d1/d15/d16/d71/ld7 0 2024-09-10T09:36:32.476 INFO:tasks.workunit.client.1.smithi135.stdout:8/655: stat d1/d15/d24/f35 0 2024-09-10T09:36:32.487 INFO:tasks.workunit.client.1.smithi135.stdout:3/523: dread d4/f9 [0,4194304] 0 2024-09-10T09:36:32.487 INFO:tasks.workunit.client.1.smithi135.stdout:9/729: dwrite de/df/ff9 [0,4194304] 0 2024-09-10T09:36:32.487 INFO:tasks.workunit.client.1.smithi135.stdout:9/730: fdatasync de/df/d1d/d23/d25/f5b 0 2024-09-10T09:36:32.487 INFO:tasks.workunit.client.1.smithi135.stdout:9/731: write de/df/d1d/d23/d25/d28/d4e/fdf [109261,106564] 0 2024-09-10T09:36:32.488 INFO:tasks.workunit.client.1.smithi135.stdout:5/738: creat d3/dc/dba/d48/d57/da3/f103 x:0 0 0 2024-09-10T09:36:32.490 INFO:tasks.workunit.client.1.smithi135.stdout:1/768: write d1d/d20/d3c/d4e/fa3 [3960494,10534] 0 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:8/656: creat d1/d15/d16/d33/d45/fd8 x:0 0 0 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:1/769: dread - d1d/d28/fe8 zero size 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:8/657: fdatasync d1/d15/d16/d33/d39/f9a 0 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:1/770: chown d1d/d20/d52/d8a/dc2/dca/d2b/df1 15753 1 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:8/658: write d1/d15/d16/d96/fbe [916857,102619] 0 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:8/659: write d1/fad [73905,84911] 0 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:0/759: dwrite d8/fc [4194304,4194304] 0 2024-09-10T09:36:32.491 INFO:tasks.workunit.client.1.smithi135.stdout:0/760: readlink d8/dd/d18/d3d/dc3/d37/l6b 0 2024-09-10T09:36:32.496 INFO:tasks.workunit.client.1.smithi135.stdout:1/771: symlink d1d/d20/d52/d8a/dc2/dca/db4/lf9 0 2024-09-10T09:36:32.496 INFO:tasks.workunit.client.1.smithi135.stdout:9/732: dread de/df/d1d/d1e/d52/f53 [0,4194304] 0 2024-09-10T09:36:32.496 INFO:tasks.workunit.client.1.smithi135.stdout:9/733: write f6 [1924153,49532] 0 2024-09-10T09:36:32.498 INFO:tasks.workunit.client.1.smithi135.stdout:5/739: read d3/dc/dba/f68 [499298,101350] 0 2024-09-10T09:36:32.501 INFO:tasks.workunit.client.1.smithi135.stdout:8/660: mkdir d1/d8f/da0/dd9 0 2024-09-10T09:36:32.501 INFO:tasks.workunit.client.1.smithi135.stdout:8/661: write d1/d15/d16/d33/d39/fb9 [284771,57446] 0 2024-09-10T09:36:32.509 INFO:tasks.workunit.client.1.smithi135.stdout:9/734: write de/df/d1d/d23/f57 [1488370,95351] 0 2024-09-10T09:36:32.509 INFO:tasks.workunit.client.1.smithi135.stdout:9/735: fsync de/df/d1d/d23/d25/d28/d4e/f7a 0 2024-09-10T09:36:32.509 INFO:tasks.workunit.client.1.smithi135.stdout:9/736: write de/df/fda [888622,66925] 0 2024-09-10T09:36:32.512 INFO:tasks.workunit.client.1.smithi135.stdout:5/740: mknod d3/dc/d69/d65/de7/c104 0 2024-09-10T09:36:32.512 INFO:tasks.workunit.client.1.smithi135.stdout:5/741: write d3/dc/d69/d65/d6c/ff5 [756115,4030] 0 2024-09-10T09:36:32.515 INFO:tasks.workunit.client.1.smithi135.stdout:1/772: dread d1d/d20/d3c/d4e/ff8 [0,4194304] 0 2024-09-10T09:36:32.519 INFO:tasks.workunit.client.1.smithi135.stdout:5/742: rmdir d3/d91 39 2024-09-10T09:36:32.519 INFO:tasks.workunit.client.1.smithi135.stdout:5/743: fdatasync d3/ff 0 2024-09-10T09:36:32.520 INFO:tasks.workunit.client.1.smithi135.stdout:9/737: dread de/df/d1d/d1e/db5/d88/fd2 [0,4194304] 0 2024-09-10T09:36:32.520 INFO:tasks.workunit.client.1.smithi135.stdout:9/738: fdatasync de/df/d1d/d23/d25/fcc 0 2024-09-10T09:36:32.522 INFO:tasks.workunit.client.1.smithi135.stdout:1/773: dread d1d/d20/d52/d8a/dc2/dca/d2b/f81 [0,4194304] 0 2024-09-10T09:36:32.523 INFO:tasks.workunit.client.1.smithi135.stdout:5/744: mknod d3/dc/dba/d48/c105 0 2024-09-10T09:36:32.532 INFO:tasks.workunit.client.1.smithi135.stdout:0/761: dwrite d8/dd/f77 [0,4194304] 0 2024-09-10T09:36:32.542 INFO:tasks.workunit.client.1.smithi135.stdout:8/662: dwrite d1/d15/d24/f7e [4194304,4194304] 0 2024-09-10T09:36:32.543 INFO:tasks.workunit.client.1.smithi135.stdout:0/762: mknod d8/dd/d18/d3d/dc3/d37/d9c/c107 0 2024-09-10T09:36:32.546 INFO:tasks.workunit.client.1.smithi135.stdout:8/663: unlink d1/d15/d16/d33/f97 0 2024-09-10T09:36:32.549 INFO:tasks.workunit.client.1.smithi135.stdout:0/763: rename d8/dd/d18/d3d/dc3/d37/d73/dc8/fce to d8/d80/f108 0 2024-09-10T09:36:32.555 INFO:tasks.workunit.client.1.smithi135.stdout:9/739: dwrite de/df/d1d/fb2 [0,4194304] 0 2024-09-10T09:36:32.555 INFO:tasks.workunit.client.1.smithi135.stdout:8/664: dread d1/d15/f9d [0,4194304] 0 2024-09-10T09:36:32.559 INFO:tasks.workunit.client.1.smithi135.stdout:5/745: dwrite d3/d44/f9a [0,4194304] 0 2024-09-10T09:36:32.563 INFO:tasks.workunit.client.1.smithi135.stdout:1/774: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/d4c/dea/fee [0,4194304] 0 2024-09-10T09:36:32.564 INFO:tasks.workunit.client.1.smithi135.stdout:1/775: fdatasync d1d/d20/d3c/d4e/ff8 0 2024-09-10T09:36:32.564 INFO:tasks.workunit.client.1.smithi135.stdout:1/776: fdatasync d1d/d20/d52/d8a/dc2/dca/d37/fc9 0 2024-09-10T09:36:32.564 INFO:tasks.workunit.client.1.smithi135.stdout:1/777: write d1d/d20/d52/d8a/dc2/dca/d37/fc9 [1016357,97246] 0 2024-09-10T09:36:32.568 INFO:tasks.workunit.client.1.smithi135.stdout:9/740: rmdir de/dad 0 2024-09-10T09:36:32.568 INFO:tasks.workunit.client.1.smithi135.stdout:9/741: read de/df/d1d/d23/d25/d28/f37 [3205118,2666] 0 2024-09-10T09:36:32.568 INFO:tasks.workunit.client.1.smithi135.stdout:9/742: chown de/df/d1d/d1e/d68/d9f/fd5 44331 1 2024-09-10T09:36:32.569 INFO:tasks.workunit.client.1.smithi135.stdout:8/665: mkdir d1/d15/d16/d33/d45/dda 0 2024-09-10T09:36:32.573 INFO:tasks.workunit.client.1.smithi135.stdout:0/764: dwrite d8/dd/d11/d90/fb8 [0,4194304] 0 2024-09-10T09:36:32.573 INFO:tasks.workunit.client.1.smithi135.stdout:0/765: creat d8/dd/d18/d3d/dc3/d37/d73/d7f/d8c/da8/de7/f109 x:0 0 0 2024-09-10T09:36:32.582 INFO:tasks.workunit.client.1.smithi135.stdout:8/666: truncate d1/d27/f40 2111 0 2024-09-10T09:36:32.582 INFO:tasks.workunit.client.1.smithi135.stdout:8/667: dread - d1/d15/d16/d99/fb6 zero size 2024-09-10T09:36:32.582 INFO:tasks.workunit.client.1.smithi135.stdout:8/668: stat d1/d27/f68 0 2024-09-10T09:36:32.583 INFO:tasks.workunit.client.1.smithi135.stdout:9/743: dread de/df/d1d/d1e/db5/d88/f93 [0,4194304] 0 2024-09-10T09:36:32.586 INFO:tasks.workunit.client.1.smithi135.stdout:5/746: dwrite d3/dc/f9b [0,4194304] 0 2024-09-10T09:36:32.593 INFO:tasks.workunit.client.1.smithi135.stdout:3/524: dwrite d4/d5/d51/f86 [4194304,4194304] 0 2024-09-10T09:36:32.593 INFO:tasks.workunit.client.1.smithi135.stdout:3/525: chown d4/d5/db/d36/d6a 3472763 1 2024-09-10T09:36:32.597 INFO:tasks.workunit.client.1.smithi135.stdout:8/669: dread d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:32.597 INFO:tasks.workunit.client.1.smithi135.stdout:8/670: write d1/d15/f9d [2642995,37960] 0 2024-09-10T09:36:32.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/766: truncate d8/dd/d4a/d50/d54/d5f/f30 2218795 0 2024-09-10T09:36:32.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/767: chown d8/dd/d4a/d50/d54/d5f/d4b/la5 73 1 2024-09-10T09:36:32.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/768: fsync d8/dd/d18/d3d/dc3/d8f/daa/fcc 0 2024-09-10T09:36:32.603 INFO:tasks.workunit.client.1.smithi135.stdout:0/769: chown d8/dd/d18/f43 10 1 2024-09-10T09:36:32.608 INFO:tasks.workunit.client.1.smithi135.stdout:5/747: dwrite d3/dc/dba/dae/fce [0,4194304] 0 2024-09-10T09:36:32.612 INFO:tasks.workunit.client.1.smithi135.stdout:1/778: getdents d1d/d20/d3c/d6a 0 2024-09-10T09:36:32.612 INFO:tasks.workunit.client.1.smithi135.stdout:1/779: fsync d1d/d20/d6c/fc6 0 2024-09-10T09:36:32.612 INFO:tasks.workunit.client.1.smithi135.stdout:1/780: fsync d1d/d20/f2e 0 2024-09-10T09:36:32.612 INFO:tasks.workunit.client.1.smithi135.stdout:1/781: dread - d1d/d28/d4b/fdd zero size 2024-09-10T09:36:32.624 INFO:tasks.workunit.client.1.smithi135.stdout:3/526: mknod d4/d5/db/d36/d43/d87/c9a 0 2024-09-10T09:36:32.626 INFO:tasks.workunit.client.1.smithi135.stdout:8/671: creat d1/d8f/fdb x:0 0 0 2024-09-10T09:36:32.633 INFO:tasks.workunit.client.1.smithi135.stdout:8/672: read d1/d15/d24/f2c [2103996,26304] 0 2024-09-10T09:36:32.634 INFO:tasks.workunit.client.1.smithi135.stdout:0/770: truncate d8/dd/d4a/f84 243144 0 2024-09-10T09:36:32.634 INFO:tasks.workunit.client.1.smithi135.stdout:0/771: write d8/dd/d18/d3d/dc3/d37/d73/fee [780927,57959] 0 2024-09-10T09:36:32.637 INFO:tasks.workunit.client.1.smithi135.stdout:5/748: mkdir d3/dc/d69/d65/d6c/d106 0 2024-09-10T09:36:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:3/527: symlink d4/d5/d51/l9b 0 2024-09-10T09:36:32.640 INFO:tasks.workunit.client.1.smithi135.stdout:8/673: mknod d1/d27/d3d/dd3/cdc 0 2024-09-10T09:36:32.641 INFO:tasks.workunit.client.1.smithi135.stdout:8/674: dread - d1/d15/d16/d99/fb6 zero size 2024-09-10T09:36:32.641 INFO:tasks.workunit.client.1.smithi135.stdout:8/675: readlink d1/l10 0 2024-09-10T09:36:32.641 INFO:tasks.workunit.client.1.smithi135.stdout:8/676: creat d1/fdd x:0 0 0 2024-09-10T09:36:32.644 INFO:tasks.workunit.client.1.smithi135.stdout:5/749: rename d3/dc/dba/d48/lc9 to d3/d81/l107 0 2024-09-10T09:36:32.654 INFO:tasks.workunit.client.1.smithi135.stdout:1/782: dwrite d1d/d20/d3c/d4e/f68 [0,4194304] 0 2024-09-10T09:36:32.654 INFO:tasks.workunit.client.1.smithi135.stdout:3/528: mknod d4/d5/dc/c9c 0 2024-09-10T09:36:32.654 INFO:tasks.workunit.client.1.smithi135.stdout:3/529: fsync d4/d5/dc/f69 0 2024-09-10T09:36:32.654 INFO:tasks.workunit.client.1.smithi135.stdout:8/677: symlink d1/d15/lde 0 2024-09-10T09:36:32.654 INFO:tasks.workunit.client.1.smithi135.stdout:8/678: chown d1/d15/d49/d7c/l7f 1 1 2024-09-10T09:36:32.655 INFO:tasks.workunit.client.1.smithi135.stdout:5/750: rename d3/dc/d7a/db9 to d3/dc/d69/d65/d6c/d108 0 2024-09-10T09:36:32.655 INFO:tasks.workunit.client.1.smithi135.stdout:5/751: creat d3/dc/d69/d65/f109 x:0 0 0 2024-09-10T09:36:32.666 INFO:tasks.workunit.client.1.smithi135.stdout:9/744: truncate de/df/ff9 3378112 0 2024-09-10T09:36:32.666 INFO:tasks.workunit.client.1.smithi135.stdout:9/745: chown de/df/d1d/d23/d25/d28/d7b/ff2 43 1 2024-09-10T09:36:32.666 INFO:tasks.workunit.client.1.smithi135.stdout:9/746: readlink de/df/d1d/d62/lf0 0 2024-09-10T09:36:32.666 INFO:tasks.workunit.client.1.smithi135.stdout:9/747: write de/df/d1d/d23/f67 [4858607,24012] 0 2024-09-10T09:36:32.675 INFO:tasks.workunit.client.1.smithi135.stdout:8/679: dwrite d1/f5 [0,4194304] 0 2024-09-10T09:36:32.686 INFO:tasks.workunit.client.1.smithi135.stdout:1/783: mknod d1d/d20/d42/dd3/df5/cfa 0 2024-09-10T09:36:32.686 INFO:tasks.workunit.client.1.smithi135.stdout:1/784: fdatasync d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/fd5 0 2024-09-10T09:36:32.686 INFO:tasks.workunit.client.1.smithi135.stdout:1/785: chown d1d/d20/d6c/df3 359479 1 2024-09-10T09:36:32.689 INFO:tasks.workunit.client.1.smithi135.stdout:3/530: mknod d4/d5/dc/c9d 0 2024-09-10T09:36:32.692 INFO:tasks.workunit.client.1.smithi135.stdout:5/752: symlink d3/dc/d69/d72/l10a 0 2024-09-10T09:36:32.721 INFO:tasks.workunit.client.1.smithi135.stdout:9/748: symlink de/df/dac/db7/lfa 0 2024-09-10T09:36:32.724 INFO:tasks.workunit.client.1.smithi135.stdout:6/975: sync 2024-09-10T09:36:32.724 INFO:tasks.workunit.client.1.smithi135.stdout:6/976: chown d5/d1e/d3b/d49/c4c 28620575 1 2024-09-10T09:36:32.724 INFO:tasks.workunit.client.1.smithi135.stdout:4/904: sync 2024-09-10T09:36:32.726 INFO:tasks.workunit.client.1.smithi135.stdout:4/905: dread d1/d8a/fae [0,4194304] 0 2024-09-10T09:36:32.726 INFO:tasks.workunit.client.1.smithi135.stdout:4/906: fsync d1/d85/d89/f91 0 2024-09-10T09:36:32.726 INFO:tasks.workunit.client.1.smithi135.stdout:8/680: unlink d1/d15/fd6 0 2024-09-10T09:36:32.726 INFO:tasks.workunit.client.1.smithi135.stdout:1/786: getdents d1d/d20/d52/d8a/dc2/dca/db4 0 2024-09-10T09:36:32.726 INFO:tasks.workunit.client.1.smithi135.stdout:8/681: chown d1/f14 96317 1 2024-09-10T09:36:32.730 INFO:tasks.workunit.client.1.smithi135.stdout:5/753: mknod d3/dc/d69/d65/d6c/d108/c10b 0 2024-09-10T09:36:32.730 INFO:tasks.workunit.client.1.smithi135.stdout:5/754: truncate d3/dc/dba/d88/fee 329116 0 2024-09-10T09:36:32.730 INFO:tasks.workunit.client.1.smithi135.stdout:5/755: read - d3/d71/d61/ffb zero size 2024-09-10T09:36:32.734 INFO:tasks.workunit.client.1.smithi135.stdout:6/977: creat d5/d1e/d3b/d42/d2d/d55/d5b/d11b/f137 x:0 0 0 2024-09-10T09:36:32.735 INFO:tasks.workunit.client.1.smithi135.stdout:6/978: write d5/fbb [541331,109942] 0 2024-09-10T09:36:32.735 INFO:tasks.workunit.client.1.smithi135.stdout:6/979: stat d5/d1e/d3b/d42/d2d/d110 0 2024-09-10T09:36:32.735 INFO:tasks.workunit.client.1.smithi135.stdout:6/980: write d5/f128 [744723,82894] 0 2024-09-10T09:36:32.736 INFO:tasks.workunit.client.1.smithi135.stdout:6/981: fsync d5/dd/d50/d54/fad 0 2024-09-10T09:36:32.736 INFO:tasks.workunit.client.1.smithi135.stdout:4/907: rmdir d1/d85/d89 39 2024-09-10T09:36:32.738 INFO:tasks.workunit.client.1.smithi135.stdout:1/787: mkdir d1d/d71/dfb 0 2024-09-10T09:36:32.741 INFO:tasks.workunit.client.1.smithi135.stdout:3/531: getdents d4/d5/db/d36 0 2024-09-10T09:36:32.742 INFO:tasks.workunit.client.1.smithi135.stdout:9/749: dwrite de/df/d1d/d23/d25/f50 [0,4194304] 0 2024-09-10T09:36:32.744 INFO:tasks.workunit.client.1.smithi135.stdout:6/982: dread d5/dd/d50/d86/dcd/fee [0,4194304] 0 2024-09-10T09:36:32.744 INFO:tasks.workunit.client.1.smithi135.stdout:6/983: chown d5/dd/c1b 0 1 2024-09-10T09:36:32.745 INFO:tasks.workunit.client.1.smithi135.stdout:5/756: rename d3/d71/l56 to d3/dc/d69/d72/dec/l10c 0 2024-09-10T09:36:32.753 INFO:tasks.workunit.client.1.smithi135.stdout:4/908: write d1/de/d16/f44 [2208896,79442] 0 2024-09-10T09:36:32.759 INFO:tasks.workunit.client.1.smithi135.stdout:1/788: mkdir d1d/d71/dfc 0 2024-09-10T09:36:32.765 INFO:tasks.workunit.client.1.smithi135.stdout:5/757: truncate d3/dc/d16/dc0/fc5 1459562 0 2024-09-10T09:36:32.768 INFO:tasks.workunit.client.1.smithi135.stdout:9/750: rename de/df/d1d/f8b to de/df/dac/ffb 0 2024-09-10T09:36:32.768 INFO:tasks.workunit.client.1.smithi135.stdout:9/751: write de/df/d1d/d1e/db5/d88/fd6 [1327923,8507] 0 2024-09-10T09:36:32.768 INFO:tasks.workunit.client.1.smithi135.stdout:9/752: truncate de/df/d1d/d1e/d68/d9f/fab 1018831 0 2024-09-10T09:36:32.768 INFO:tasks.workunit.client.1.smithi135.stdout:9/753: fsync de/df/d1d/fc7 0 2024-09-10T09:36:32.769 INFO:tasks.workunit.client.1.smithi135.stdout:9/754: read - de/df/d1d/d1e/d3f/dbb/fc2 zero size 2024-09-10T09:36:32.769 INFO:tasks.workunit.client.1.smithi135.stdout:9/755: fsync de/df/f3e 0 2024-09-10T09:36:32.770 INFO:tasks.workunit.client.1.smithi135.stdout:4/909: mknod d1/db/d9/d55/c118 0 2024-09-10T09:36:32.770 INFO:tasks.workunit.client.1.smithi135.stdout:4/910: getdents d1/db/d9/d55/d70/da4/dac/dd7 0 2024-09-10T09:36:32.770 INFO:tasks.workunit.client.1.smithi135.stdout:4/911: dread - d1/db/d9/d55/fe3 zero size 2024-09-10T09:36:32.772 INFO:tasks.workunit.client.1.smithi135.stdout:5/758: mknod d3/dc/dba/d48/dfc/c10d 0 2024-09-10T09:36:32.774 INFO:tasks.workunit.client.1.smithi135.stdout:3/532: dwrite d4/d5/dc/f49 [0,4194304] 0 2024-09-10T09:36:32.774 INFO:tasks.workunit.client.1.smithi135.stdout:6/984: dwrite d5/d15/fb6 [0,4194304] 0 2024-09-10T09:36:32.775 INFO:tasks.workunit.client.1.smithi135.stdout:6/985: chown d5/d1e/d3b/d42/d2d/d55/fb0 55708 1 2024-09-10T09:36:32.778 INFO:tasks.workunit.client.1.smithi135.stdout:9/756: rmdir de/df/d1d/d23/d25/d28/d7b/dcf 39 2024-09-10T09:36:32.778 INFO:tasks.workunit.client.1.smithi135.stdout:9/757: dread - de/df/d1d/d62/ff1 zero size 2024-09-10T09:36:32.780 INFO:tasks.workunit.client.1.smithi135.stdout:4/912: mknod d1/d33/c119 0 2024-09-10T09:36:32.780 INFO:tasks.workunit.client.1.smithi135.stdout:4/913: write d1/db/d9/d55/d76/ffa [178823,70901] 0 2024-09-10T09:36:32.784 INFO:tasks.workunit.client.1.smithi135.stdout:1/789: dwrite d1d/d20/d52/d8a/dc2/dca/f4d [0,4194304] 0 2024-09-10T09:36:32.786 INFO:tasks.workunit.client.1.smithi135.stdout:9/758: symlink de/df/d7e/lfc 0 2024-09-10T09:36:32.786 INFO:tasks.workunit.client.1.smithi135.stdout:4/914: mkdir d1/db/d9/d55/d70/da4/dac/dd7/d11a 0 2024-09-10T09:36:32.786 INFO:tasks.workunit.client.1.smithi135.stdout:4/915: chown d1/db/d9/f38 27 1 2024-09-10T09:36:32.791 INFO:tasks.workunit.client.1.smithi135.stdout:3/533: dread d4/d5/dc/f10 [0,4194304] 0 2024-09-10T09:36:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:4/916: symlink d1/d85/d89/l11b 0 2024-09-10T09:36:32.793 INFO:tasks.workunit.client.1.smithi135.stdout:4/917: creat d1/db/d9/d55/d7b/f11c x:0 0 0 2024-09-10T09:36:32.797 INFO:tasks.workunit.client.1.smithi135.stdout:9/759: dread de/df/d1d/d1e/d52/f53 [0,4194304] 0 2024-09-10T09:36:32.797 INFO:tasks.workunit.client.1.smithi135.stdout:5/759: dwrite d3/d44/f4c [0,4194304] 0 2024-09-10T09:36:32.804 INFO:tasks.workunit.client.1.smithi135.stdout:6/986: dwrite d5/d1e/d3b/d42/f104 [0,4194304] 0 2024-09-10T09:36:32.806 INFO:tasks.workunit.client.1.smithi135.stdout:3/534: creat d4/d5/dc/d71/f9e x:0 0 0 2024-09-10T09:36:32.811 INFO:tasks.workunit.client.1.smithi135.stdout:3/535: dread d4/f32 [0,4194304] 0 2024-09-10T09:36:32.813 INFO:tasks.workunit.client.1.smithi135.stdout:9/760: creat de/df/d1d/d1e/db5/d88/dde/ffd x:0 0 0 2024-09-10T09:36:32.813 INFO:tasks.workunit.client.1.smithi135.stdout:4/918: dread d1/d85/d89/f91 [0,4194304] 0 2024-09-10T09:36:32.818 INFO:tasks.workunit.client.1.smithi135.stdout:5/760: mknod d3/dc/d16/c10e 0 2024-09-10T09:36:32.820 INFO:tasks.workunit.client.1.smithi135.stdout:1/790: dwrite d1d/d20/f30 [0,4194304] 0 2024-09-10T09:36:32.824 INFO:tasks.workunit.client.1.smithi135.stdout:6/987: creat d5/d15/d56/f138 x:0 0 0 2024-09-10T09:36:32.826 INFO:tasks.workunit.client.1.smithi135.stdout:3/536: link d4/d55/d5d/d5b/f6c d4/d5/db/d44/d68/f9f 0 2024-09-10T09:36:32.826 INFO:tasks.workunit.client.1.smithi135.stdout:3/537: dread - d4/d5/db/d36/f90 zero size 2024-09-10T09:36:32.826 INFO:tasks.workunit.client.1.smithi135.stdout:3/538: chown d4/d5/db/d44/d68 384186317 1 2024-09-10T09:36:32.828 INFO:tasks.workunit.client.1.smithi135.stdout:9/761: creat de/df/d1d/d1e/d52/d86/ffe x:0 0 0 2024-09-10T09:36:32.834 INFO:tasks.workunit.client.1.smithi135.stdout:5/761: mkdir d3/dc/dba/d48/d57/da3/d10f 0 2024-09-10T09:36:32.839 INFO:tasks.workunit.client.1.smithi135.stdout:1/791: rename d1d/d20/d52/d8a/dc2/dca/f7d to d1d/d20/d6c/de9/ffd 0 2024-09-10T09:36:32.842 INFO:tasks.workunit.client.1.smithi135.stdout:3/539: mkdir d4/d5/d76/da0 0 2024-09-10T09:36:32.845 INFO:tasks.workunit.client.1.smithi135.stdout:4/919: rmdir d1/d33/d40/def 39 2024-09-10T09:36:32.848 INFO:tasks.workunit.client.1.smithi135.stdout:5/762: truncate d3/dc/dba/dae/fce 2753996 0 2024-09-10T09:36:32.854 INFO:tasks.workunit.client.1.smithi135.stdout:1/792: mkdir d1d/d71/dfc/dfe 0 2024-09-10T09:36:32.854 INFO:tasks.workunit.client.1.smithi135.stdout:1/793: getdents d1d/d20/d6c/df3 0 2024-09-10T09:36:32.857 INFO:tasks.workunit.client.1.smithi135.stdout:3/540: link d4/f47 d4/d5/d51/fa1 0 2024-09-10T09:36:32.860 INFO:tasks.workunit.client.1.smithi135.stdout:9/762: unlink de/df/d1d/d23/c4d 0 2024-09-10T09:36:32.860 INFO:tasks.workunit.client.1.smithi135.stdout:9/763: chown de/df/d7e 220000 1 2024-09-10T09:36:32.860 INFO:tasks.workunit.client.1.smithi135.stdout:9/764: truncate de/df/dac/db7/fcb 4489512 0 2024-09-10T09:36:32.863 INFO:tasks.workunit.client.1.smithi135.stdout:4/920: getdents d1/d33/d40/def 0 2024-09-10T09:36:32.868 INFO:tasks.workunit.client.1.smithi135.stdout:1/794: mkdir d1d/d20/d9a/dff 0 2024-09-10T09:36:32.869 INFO:tasks.workunit.client.1.smithi135.stdout:3/541: mknod d4/d55/d5d/ca2 0 2024-09-10T09:36:32.874 INFO:tasks.workunit.client.1.smithi135.stdout:5/763: dread d3/fb [0,4194304] 0 2024-09-10T09:36:32.875 INFO:tasks.workunit.client.1.smithi135.stdout:5/764: readlink d3/dc/dba/d4e/lc2 0 2024-09-10T09:36:32.875 INFO:tasks.workunit.client.1.smithi135.stdout:5/765: write d3/dc/d69/f73 [756766,107071] 0 2024-09-10T09:36:32.892 INFO:tasks.workunit.client.1.smithi135.stdout:6/988: rename d5/d15/ddf to d5/d1e/d3b/d42/d2d/d55/d5b/d11b/d139 0 2024-09-10T09:36:32.894 INFO:tasks.workunit.client.1.smithi135.stdout:3/542: mkdir d4/d5/d51/da3 0 2024-09-10T09:36:32.897 INFO:tasks.workunit.client.1.smithi135.stdout:3/543: truncate d4/d55/f60 2284181 0 2024-09-10T09:36:32.901 INFO:tasks.workunit.client.1.smithi135.stdout:1/795: dwrite d1d/d20/d52/d8a/dc2/dca/fbe [0,4194304] 0 2024-09-10T09:36:32.903 INFO:tasks.workunit.client.1.smithi135.stdout:5/766: dwrite d3/dc/d69/f73 [0,4194304] 0 2024-09-10T09:36:32.917 INFO:tasks.workunit.client.1.smithi135.stdout:1/796: creat d1d/d20/d42/dd3/df5/f100 x:0 0 0 2024-09-10T09:36:32.917 INFO:tasks.workunit.client.1.smithi135.stdout:1/797: write d1d/d71/ff2 [975994,92573] 0 2024-09-10T09:36:32.917 INFO:tasks.workunit.client.1.smithi135.stdout:1/798: creat d1d/d20/d52/d8a/f101 x:0 0 0 2024-09-10T09:36:32.918 INFO:tasks.workunit.client.1.smithi135.stdout:6/989: dwrite d5/d1e/d35/f4b [0,4194304] 0 2024-09-10T09:36:32.926 INFO:tasks.workunit.client.1.smithi135.stdout:1/799: creat d1d/d20/d3c/f102 x:0 0 0 2024-09-10T09:36:32.929 INFO:tasks.workunit.client.1.smithi135.stdout:3/544: dwrite d4/d5/db/f2f [0,4194304] 0 2024-09-10T09:36:32.930 INFO:tasks.workunit.client.1.smithi135.stdout:3/545: fsync d4/f47 0 2024-09-10T09:36:32.930 INFO:tasks.workunit.client.1.smithi135.stdout:3/546: chown d4/d55/d5d/d5b/f8d 1758 1 2024-09-10T09:36:32.930 INFO:tasks.workunit.client.1.smithi135.stdout:3/547: fsync d4/d5/db/dd/d79/f41 0 2024-09-10T09:36:32.930 INFO:tasks.workunit.client.1.smithi135.stdout:3/548: write d4/d5/dc/d71/f9e [565573,11355] 0 2024-09-10T09:36:32.930 INFO:tasks.workunit.client.1.smithi135.stdout:5/767: dwrite d3/dc/dba/d48/d57/da9/fe0 [0,4194304] 0 2024-09-10T09:36:32.931 INFO:tasks.workunit.client.1.smithi135.stdout:5/768: write d3/dc/dba/f6a [4808589,84391] 0 2024-09-10T09:36:32.932 INFO:tasks.workunit.client.1.smithi135.stdout:5/769: dread d3/dc/dba/d4e/dd0/faa [0,4194304] 0 2024-09-10T09:36:32.937 INFO:tasks.workunit.client.1.smithi135.stdout:6/990: unlink d5/f7 0 2024-09-10T09:36:32.938 INFO:tasks.workunit.client.1.smithi135.stdout:1/800: mkdir d1d/d103 0 2024-09-10T09:36:32.940 INFO:tasks.workunit.client.1.smithi135.stdout:1/801: dread d1d/d20/d3c/d6a/f93 [0,4194304] 0 2024-09-10T09:36:32.940 INFO:tasks.workunit.client.1.smithi135.stdout:1/802: dread - d1d/d20/d42/dd3/df5/f100 zero size 2024-09-10T09:36:32.942 INFO:tasks.workunit.client.1.smithi135.stdout:1/803: read d1d/d28/f7c [1170731,51890] 0 2024-09-10T09:36:32.942 INFO:tasks.workunit.client.1.smithi135.stdout:6/991: read d5/d1e/d3b/d42/d2d/d55/d5b/d11b/d139/f10a [3488390,89430] 0 2024-09-10T09:36:32.942 INFO:tasks.workunit.client.1.smithi135.stdout:1/804: truncate d1d/d20/d52/d8a/dc2/dca/d37/d6d/fb2 244413 0 2024-09-10T09:36:32.943 INFO:tasks.workunit.client.1.smithi135.stdout:3/549: rename d4/d5/db/d44/f97 to d4/d55/d5d/fa4 0 2024-09-10T09:36:32.944 INFO:tasks.workunit.client.1.smithi135.stdout:6/992: dread d5/d15/d27/f3d [0,4194304] 0 2024-09-10T09:36:32.948 INFO:tasks.workunit.client.1.smithi135.stdout:5/770: mknod d3/dc/dba/d48/d57/da3/d10f/c110 0 2024-09-10T09:36:32.951 INFO:tasks.workunit.client.1.smithi135.stdout:6/993: stat d5/d1e/d62/d8a/la1 0 2024-09-10T09:36:32.953 INFO:tasks.workunit.client.1.smithi135.stdout:5/771: mknod d3/dc/d69/d72/dec/c111 0 2024-09-10T09:36:32.953 INFO:tasks.workunit.client.1.smithi135.stdout:5/772: creat d3/d71/d61/f112 x:0 0 0 2024-09-10T09:36:32.953 INFO:tasks.workunit.client.1.smithi135.stdout:1/805: read d1d/d20/d52/d8a/dc2/dca/fbe [659097,102844] 0 2024-09-10T09:36:32.953 INFO:tasks.workunit.client.1.smithi135.stdout:1/806: chown d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/f66 0 1 2024-09-10T09:36:32.954 INFO:tasks.workunit.client.1.smithi135.stdout:6/994: symlink d5/d1e/d3b/d42/d2d/d8f/d9c/l13a 0 2024-09-10T09:36:32.956 INFO:tasks.workunit.client.1.smithi135.stdout:5/773: symlink d3/d91/l113 0 2024-09-10T09:36:32.956 INFO:tasks.workunit.client.1.smithi135.stdout:5/774: chown d3/dc/dba/d4e 22407 1 2024-09-10T09:36:32.957 INFO:tasks.workunit.client.1.smithi135.stdout:1/807: creat d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/f104 x:0 0 0 2024-09-10T09:36:32.959 INFO:tasks.workunit.client.1.smithi135.stdout:6/995: symlink d5/dd/d50/d54/db9/l13b 0 2024-09-10T09:36:32.962 INFO:tasks.workunit.client.1.smithi135.stdout:3/550: dwrite d4/d5/dc/f95 [0,4194304] 0 2024-09-10T09:36:32.962 INFO:tasks.workunit.client.1.smithi135.stdout:3/551: creat d4/d5/db/d44/d68/fa5 x:0 0 0 2024-09-10T09:36:32.965 INFO:tasks.workunit.client.1.smithi135.stdout:5/775: rename d3/dc/dba/d48/d57/dca/cd9 to d3/dc/dba/d4e/dd0/c114 0 2024-09-10T09:36:32.966 INFO:tasks.workunit.client.1.smithi135.stdout:5/776: stat d3/dc/d69/d65/de7 0 2024-09-10T09:36:32.973 INFO:tasks.workunit.client.1.smithi135.stdout:5/777: rename d3/d44/c42 to d3/dc/d7a/c115 0 2024-09-10T09:36:32.974 INFO:tasks.workunit.client.1.smithi135.stdout:6/996: getdents d5/dd/d50/d86/dcd 0 2024-09-10T09:36:32.976 INFO:tasks.workunit.client.1.smithi135.stdout:5/778: mknod d3/d81/d8d/c116 0 2024-09-10T09:36:32.977 INFO:tasks.workunit.client.1.smithi135.stdout:6/997: mkdir d5/d1e/d62/d13c 0 2024-09-10T09:36:32.979 INFO:tasks.workunit.client.1.smithi135.stdout:6/998: creat d5/d58/f13d x:0 0 0 2024-09-10T09:36:32.979 INFO:tasks.workunit.client.1.smithi135.stdout:1/808: dwrite d1d/d20/d3c/d4e/fa3 [4194304,4194304] 0 2024-09-10T09:36:32.980 INFO:tasks.workunit.client.1.smithi135.stdout:6/999: creat d5/dd/d50/d57/f13e x:0 0 0 2024-09-10T09:36:32.983 INFO:tasks.workunit.client.1.smithi135.stdout:1/809: mknod d1d/d71/dfb/c105 0 2024-09-10T09:36:32.984 INFO:tasks.workunit.client.1.smithi135.stdout:1/810: truncate d1d/d71/ff2 1845361 0 2024-09-10T09:36:32.984 INFO:tasks.workunit.client.1.smithi135.stdout:3/552: dwrite d4/d55/d5d/d5b/f75 [0,4194304] 0 2024-09-10T09:36:32.984 INFO:tasks.workunit.client.1.smithi135.stdout:3/553: chown d4/d5/d56/l83 1975410 1 2024-09-10T09:36:32.984 INFO:tasks.workunit.client.1.smithi135.stdout:3/554: dread - d4/d5/db/d44/d68/f9f zero size 2024-09-10T09:36:32.986 INFO:tasks.workunit.client.1.smithi135.stdout:1/811: dread d1d/d20/d3c/f5f [0,4194304] 0 2024-09-10T09:36:32.986 INFO:tasks.workunit.client.1.smithi135.stdout:1/812: write d1d/d20/d52/d8a/dc2/dca/d37/db8/fbc [669366,123715] 0 2024-09-10T09:36:32.986 INFO:tasks.workunit.client.1.smithi135.stdout:1/813: write d1d/d20/fa6 [614239,60893] 0 2024-09-10T09:36:32.993 INFO:tasks.workunit.client.1.smithi135.stdout:5/779: dread d3/dc/d69/f73 [0,4194304] 0 2024-09-10T09:36:32.999 INFO:tasks.workunit.client.1.smithi135.stdout:3/555: fsync d4/f96 0 2024-09-10T09:36:32.999 INFO:tasks.workunit.client.1.smithi135.stdout:3/556: fdatasync d4/d55/d5d/d5b/f75 0 2024-09-10T09:36:33.006 INFO:tasks.workunit.client.1.smithi135.stdout:3/557: truncate d4/d5/d51/f86 5076200 0 2024-09-10T09:36:33.007 INFO:tasks.workunit.client.1.smithi135.stdout:3/558: write d4/f7b [995534,15310] 0 2024-09-10T09:36:33.007 INFO:tasks.workunit.client.1.smithi135.stdout:3/559: chown d4/d5/db/d36/d43/d87/c9a 785387956 1 2024-09-10T09:36:33.007 INFO:tasks.workunit.client.1.smithi135.stdout:3/560: fdatasync d4/d55/d5d/f1e 0 2024-09-10T09:36:33.020 INFO:tasks.workunit.client.1.smithi135.stdout:1/814: dwrite d1d/f58 [0,4194304] 0 2024-09-10T09:36:33.022 INFO:tasks.workunit.client.1.smithi135.stdout:5/780: dwrite d3/dc/dba/d48/d57/da3/fc6 [0,4194304] 0 2024-09-10T09:36:33.028 INFO:tasks.workunit.client.1.smithi135.stdout:3/561: dread d4/d55/f60 [0,4194304] 0 2024-09-10T09:36:33.041 INFO:tasks.workunit.client.1.smithi135.stdout:2/703: sync 2024-09-10T09:36:33.047 INFO:tasks.workunit.client.1.smithi135.stdout:5/781: write d3/f31 [493655,75755] 0 2024-09-10T09:36:33.047 INFO:tasks.workunit.client.1.smithi135.stdout:5/782: write d3/d91/db5/fd8 [851372,19427] 0 2024-09-10T09:36:33.047 INFO:tasks.workunit.client.1.smithi135.stdout:2/704: write df/d1b/d23/d98/d5f/f89 [108270,46566] 0 2024-09-10T09:36:33.047 INFO:tasks.workunit.client.1.smithi135.stdout:5/783: write d3/f12 [5695871,16655] 0 2024-09-10T09:36:33.047 INFO:tasks.workunit.client.1.smithi135.stdout:2/705: chown df/d13/d4f/lb9 102 1 2024-09-10T09:36:33.050 INFO:tasks.workunit.client.1.smithi135.stdout:1/815: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/f81 [0,4194304] 0 2024-09-10T09:36:33.054 INFO:tasks.workunit.client.1.smithi135.stdout:5/784: creat d3/dc/dba/d48/f117 x:0 0 0 2024-09-10T09:36:33.056 INFO:tasks.workunit.client.1.smithi135.stdout:2/706: truncate df/fb1 432002 0 2024-09-10T09:36:33.071 INFO:tasks.workunit.client.1.smithi135.stdout:1/816: rename d1d/d20/d52/d8a/dc2/dca/d2b/f7b to d1d/d20/d52/d8a/dc2/dca/d37/db8/f106 0 2024-09-10T09:36:33.077 INFO:tasks.workunit.client.1.smithi135.stdout:5/785: mknod d3/d71/c118 0 2024-09-10T09:36:33.080 INFO:tasks.workunit.client.1.smithi135.stdout:2/707: symlink df/ldc 0 2024-09-10T09:36:33.083 INFO:tasks.workunit.client.1.smithi135.stdout:7/644: sync 2024-09-10T09:36:33.083 INFO:tasks.workunit.client.1.smithi135.stdout:0/772: sync 2024-09-10T09:36:33.084 INFO:tasks.workunit.client.1.smithi135.stdout:0/773: stat d8/dd/d18/d3d/dc3/f98 0 2024-09-10T09:36:33.084 INFO:tasks.workunit.client.1.smithi135.stdout:7/645: dread - d2/d15/d4a/d36/f6a zero size 2024-09-10T09:36:33.089 INFO:tasks.workunit.client.1.smithi135.stdout:5/786: mknod d3/dc/dba/d48/dfc/c119 0 2024-09-10T09:36:33.089 INFO:tasks.workunit.client.1.smithi135.stdout:5/787: readlink d3/dc/l3d 0 2024-09-10T09:36:33.089 INFO:tasks.workunit.client.1.smithi135.stdout:5/788: stat d3/dc/dba/f5f 0 2024-09-10T09:36:33.090 INFO:tasks.workunit.client.1.smithi135.stdout:5/789: truncate d3/dc/dba/d4e/dd0/f96 810818 0 2024-09-10T09:36:33.090 INFO:tasks.workunit.client.1.smithi135.stdout:5/790: creat d3/dc/dba/d48/d57/dc4/f11a x:0 0 0 2024-09-10T09:36:33.094 INFO:tasks.workunit.client.1.smithi135.stdout:3/562: rmdir d4/d5/db/d44/d68 39 2024-09-10T09:36:33.094 INFO:tasks.workunit.client.1.smithi135.stdout:3/563: read - d4/d5/d56/f7e zero size 2024-09-10T09:36:33.094 INFO:tasks.workunit.client.1.smithi135.stdout:3/564: write d4/d5/d51/fa1 [4678920,9247] 0 2024-09-10T09:36:33.100 INFO:tasks.workunit.client.1.smithi135.stdout:2/708: rename df/f79 to df/d1b/d23/d98/d5f/d2c/d7d/fdd 0 2024-09-10T09:36:33.104 INFO:tasks.workunit.client.1.smithi135.stdout:7/646: mkdir d2/d15/dc7 0 2024-09-10T09:36:33.107 INFO:tasks.workunit.client.1.smithi135.stdout:1/817: dwrite d1d/d20/d52/d8a/fc3 [0,4194304] 0 2024-09-10T09:36:33.110 INFO:tasks.workunit.client.1.smithi135.stdout:5/791: truncate d3/f5 552758 0 2024-09-10T09:36:33.112 INFO:tasks.workunit.client.1.smithi135.stdout:0/774: dwrite d8/dd/d18/d3d/dc3/d37/d9c/f9d [0,4194304] 0 2024-09-10T09:36:33.114 INFO:tasks.workunit.client.1.smithi135.stdout:3/565: mkdir d4/d5/dc/d8b/da6 0 2024-09-10T09:36:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:7/647: mkdir d2/d15/d41/d49/d60/dc8 0 2024-09-10T09:36:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:7/648: fsync d2/d15/d39/d6f/f76 0 2024-09-10T09:36:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:7/649: write d2/d15/d41/d49/d60/d30/f7a [1131279,92342] 0 2024-09-10T09:36:33.124 INFO:tasks.workunit.client.1.smithi135.stdout:7/650: write d2/d15/d41/f44 [506500,50627] 0 2024-09-10T09:36:33.125 INFO:tasks.workunit.client.1.smithi135.stdout:2/709: dwrite df/d1b/d23/d98/fbb [0,4194304] 0 2024-09-10T09:36:33.135 INFO:tasks.workunit.client.1.smithi135.stdout:1/818: symlink d1d/d28/d4b/l107 0 2024-09-10T09:36:33.135 INFO:tasks.workunit.client.1.smithi135.stdout:1/819: fsync d1d/d20/d52/d8a/dc2/dca/d37/db8/fbc 0 2024-09-10T09:36:33.140 INFO:tasks.workunit.client.1.smithi135.stdout:8/682: sync 2024-09-10T09:36:33.143 INFO:tasks.workunit.client.1.smithi135.stdout:3/566: dwrite d4/d5/d56/f7e [0,4194304] 0 2024-09-10T09:36:33.149 INFO:tasks.workunit.client.1.smithi135.stdout:5/792: dwrite d3/f12 [4194304,4194304] 0 2024-09-10T09:36:33.152 INFO:tasks.workunit.client.1.smithi135.stdout:1/820: dread d1d/d20/d52/d8a/dc2/dca/d2b/f3a [0,4194304] 0 2024-09-10T09:36:33.152 INFO:tasks.workunit.client.1.smithi135.stdout:1/821: dread - d1d/d71/d9e/fa9 zero size 2024-09-10T09:36:33.154 INFO:tasks.workunit.client.1.smithi135.stdout:3/567: dread d4/f25 [0,4194304] 0 2024-09-10T09:36:33.154 INFO:tasks.workunit.client.1.smithi135.stdout:3/568: fdatasync d4/f32 0 2024-09-10T09:36:33.158 INFO:tasks.workunit.client.1.smithi135.stdout:7/651: creat d2/d15/d5c/d62/da5/fc9 x:0 0 0 2024-09-10T09:36:33.169 INFO:tasks.workunit.client.1.smithi135.stdout:2/710: mkdir df/dde 0 2024-09-10T09:36:33.174 INFO:tasks.workunit.client.1.smithi135.stdout:5/793: dwrite d3/f31 [0,4194304] 0 2024-09-10T09:36:33.185 INFO:tasks.workunit.client.1.smithi135.stdout:8/683: rmdir d1/d27/d3d/dd3 39 2024-09-10T09:36:33.190 INFO:tasks.workunit.client.1.smithi135.stdout:1/822: creat d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/f108 x:0 0 0 2024-09-10T09:36:33.192 INFO:tasks.workunit.client.1.smithi135.stdout:3/569: mknod d4/d5/db/d44/ca7 0 2024-09-10T09:36:33.194 INFO:tasks.workunit.client.1.smithi135.stdout:8/684: dread d1/f7 [0,4194304] 0 2024-09-10T09:36:33.194 INFO:tasks.workunit.client.1.smithi135.stdout:8/685: readlink d1/d15/d24/l8a 0 2024-09-10T09:36:33.204 INFO:tasks.workunit.client.1.smithi135.stdout:3/570: dread f1 [0,4194304] 0 2024-09-10T09:36:33.204 INFO:tasks.workunit.client.1.smithi135.stdout:8/686: read d1/d15/d49/fbd [3462564,117637] 0 2024-09-10T09:36:33.206 INFO:tasks.workunit.client.1.smithi135.stdout:0/775: rename d8/dd/d18/d3d/dc3/d37 to d8/d80/d10a 0 2024-09-10T09:36:33.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/776: fdatasync d8/dd/d4a/d50/d54/d5f/f85 0 2024-09-10T09:36:33.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/777: chown d8/dd/d18/d3d/dc3/d61/db1/lff 27391236 1 2024-09-10T09:36:33.207 INFO:tasks.workunit.client.1.smithi135.stdout:0/778: dread - d8/d80/d10a/d73/dc5/ff2 zero size 2024-09-10T09:36:33.207 INFO:tasks.workunit.client.1.smithi135.stdout:2/711: mknod df/d1b/d23/d98/d5f/d2c/d7d/d8c/cdf 0 2024-09-10T09:36:33.208 INFO:tasks.workunit.client.1.smithi135.stdout:2/712: creat df/d1b/d30/fe0 x:0 0 0 2024-09-10T09:36:33.208 INFO:tasks.workunit.client.1.smithi135.stdout:2/713: creat df/d13/d4f/fe1 x:0 0 0 2024-09-10T09:36:33.208 INFO:tasks.workunit.client.1.smithi135.stdout:2/714: write df/d1b/f85 [2379201,51027] 0 2024-09-10T09:36:33.208 INFO:tasks.workunit.client.1.smithi135.stdout:2/715: creat df/fe2 x:0 0 0 2024-09-10T09:36:33.209 INFO:tasks.workunit.client.1.smithi135.stdout:1/823: mkdir d1d/d20/d9a/dff/d109 0 2024-09-10T09:36:33.209 INFO:tasks.workunit.client.1.smithi135.stdout:3/571: mknod d4/d5/db/d36/ca8 0 2024-09-10T09:36:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr fail", "who": "smithi079.mhirny"}]: dispatch 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: osdmap e48: 6 total, 6 up, 6 in 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "mgr fail", "who": "smithi079.mhirny"}]': finished 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: mgrmap e21: smithi135.lbhjof(active, starting, since 0.0178017s) 2024-09-10T09:36:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:36:33.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:36:33.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:36:33.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:36:33.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:36:33.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:36:33.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:36:33.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: Manager daemon smithi135.lbhjof is now available 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:33.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/trash_purge_schedule"}]: dispatch 2024-09-10T09:36:33.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:32 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/trash_purge_schedule"}]: dispatch 2024-09-10T09:36:33.216 INFO:tasks.workunit.client.1.smithi135.stdout:3/572: dread d4/d5/dc/f69 [0,4194304] 0 2024-09-10T09:36:33.216 INFO:tasks.workunit.client.1.smithi135.stdout:7/652: rename d2/d15/f2f to d2/d25/d5d/d83/fca 0 2024-09-10T09:36:33.218 INFO:tasks.workunit.client.1.smithi135.stdout:0/779: symlink d8/dd/d18/l10b 0 2024-09-10T09:36:33.218 INFO:tasks.workunit.client.1.smithi135.stdout:0/780: read - d8/dd/d4a/d50/fac zero size 2024-09-10T09:36:33.219 INFO:tasks.workunit.client.1.smithi135.stdout:1/824: dread d1d/d20/d52/d8a/dc2/dca/d2b/d4c/faa [0,4194304] 0 2024-09-10T09:36:33.223 INFO:tasks.workunit.client.1.smithi135.stdout:4/921: sync 2024-09-10T09:36:33.223 INFO:tasks.workunit.client.1.smithi135.stdout:9/765: sync 2024-09-10T09:36:33.223 INFO:tasks.workunit.client.1.smithi135.stdout:9/766: chown de/df/d1d/d23/f26 128805825 1 2024-09-10T09:36:33.224 INFO:tasks.workunit.client.1.smithi135.stdout:3/573: dread d4/d5/d51/f86 [0,4194304] 0 2024-09-10T09:36:33.228 INFO:tasks.workunit.client.1.smithi135.stdout:0/781: dread d8/dd/d1e/f49 [0,4194304] 0 2024-09-10T09:36:33.230 INFO:tasks.workunit.client.1.smithi135.stdout:2/716: creat df/d1b/d23/d98/d5f/fe3 x:0 0 0 2024-09-10T09:36:33.231 INFO:tasks.workunit.client.1.smithi135.stdout:8/687: getdents d1/d15/d16/d33 0 2024-09-10T09:36:33.233 INFO:tasks.workunit.client.1.smithi135.stdout:7/653: symlink d2/d25/d5d/lcb 0 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr fail", "who": "smithi079.mhirny"}]: dispatch 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: osdmap e48: 6 total, 6 up, 6 in 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.14213 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "mgr fail", "who": "smithi079.mhirny"}]': finished 2024-09-10T09:36:33.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: mgrmap e21: smithi135.lbhjof(active, starting, since 0.0178017s) 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:36:33.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: Manager daemon smithi135.lbhjof is now available 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/trash_purge_schedule"}]: dispatch 2024-09-10T09:36:33.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:32 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi135.lbhjof/trash_purge_schedule"}]: dispatch 2024-09-10T09:36:33.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/767: unlink de/df/d1d/d1e/db5/d88/le8 0 2024-09-10T09:36:33.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/768: truncate de/df/f13 4952045 0 2024-09-10T09:36:33.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/769: readlink de/df/l19 0 2024-09-10T09:36:33.239 INFO:tasks.workunit.client.1.smithi135.stdout:9/770: chown de/df/d1d/d1e/db5/lf3 179978 1 2024-09-10T09:36:33.240 INFO:tasks.workunit.client.1.smithi135.stdout:0/782: creat d8/d80/d10a/d73/d7f/d8c/f10c x:0 0 0 2024-09-10T09:36:33.243 INFO:tasks.workunit.client.1.smithi135.stdout:2/717: mknod df/dde/ce4 0 2024-09-10T09:36:33.246 INFO:tasks.workunit.client.1.smithi135.stdout:8/688: rename d1/d15/d16/d33/d45/dda to d1/d8f/ddf 0 2024-09-10T09:36:33.247 INFO:tasks.workunit.client.1.smithi135.stdout:4/922: truncate d1/de/d16/fbc 1179166 0 2024-09-10T09:36:33.247 INFO:tasks.workunit.client.1.smithi135.stdout:4/923: write d1/de/d16/d95/ffb [414891,12970] 0 2024-09-10T09:36:33.248 INFO:tasks.workunit.client.1.smithi135.stdout:9/771: fdatasync de/df/d1d/d23/f8d 0 2024-09-10T09:36:33.250 INFO:tasks.workunit.client.1.smithi135.stdout:3/574: getdents d4/d5/db/dd/d79 0 2024-09-10T09:36:33.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/689: mkdir d1/d8f/da0/de0 0 2024-09-10T09:36:33.257 INFO:tasks.workunit.client.1.smithi135.stdout:0/783: dwrite d8/dd/d18/d3d/dc3/d61/f94 [0,4194304] 0 2024-09-10T09:36:33.258 INFO:tasks.workunit.client.1.smithi135.stdout:9/772: unlink de/df/c2a 0 2024-09-10T09:36:33.262 INFO:tasks.workunit.client.1.smithi135.stdout:3/575: write d4/d5/db/f2f [905827,110648] 0 2024-09-10T09:36:33.270 INFO:tasks.workunit.client.1.smithi135.stdout:0/784: symlink d8/d80/dfd/l10d 0 2024-09-10T09:36:33.270 INFO:tasks.workunit.client.1.smithi135.stdout:0/785: getdents d8/d80/d10a/d73/d88 0 2024-09-10T09:36:33.270 INFO:tasks.workunit.client.1.smithi135.stdout:0/786: fdatasync d8/fe1 0 2024-09-10T09:36:33.271 INFO:tasks.workunit.client.1.smithi135.stdout:9/773: truncate de/df/dac/db7/ff7 1180351 0 2024-09-10T09:36:33.272 INFO:tasks.workunit.client.1.smithi135.stdout:8/690: dwrite d1/d15/d16/d33/d39/f7d [0,4194304] 0 2024-09-10T09:36:33.273 INFO:tasks.workunit.client.1.smithi135.stdout:9/774: dread de/df/d1d/fc7 [0,4194304] 0 2024-09-10T09:36:33.273 INFO:tasks.workunit.client.1.smithi135.stdout:9/775: dread - de/df/d1d/d23/f8d zero size 2024-09-10T09:36:33.274 INFO:tasks.workunit.client.1.smithi135.stdout:9/776: write de/df/d1d/d23/d25/fc1 [117447,118916] 0 2024-09-10T09:36:33.275 INFO:tasks.workunit.client.1.smithi135.stdout:3/576: mkdir d4/d5/db/d44/da9 0 2024-09-10T09:36:33.277 INFO:tasks.workunit.client.1.smithi135.stdout:7/654: rename d2/d15/d41 to d2/d15/d39/d9f/db2/dcc 0 2024-09-10T09:36:33.278 INFO:tasks.workunit.client.1.smithi135.stdout:7/655: dread - d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f86 zero size 2024-09-10T09:36:33.278 INFO:tasks.workunit.client.1.smithi135.stdout:7/656: write d2/d15/f21 [4482195,36006] 0 2024-09-10T09:36:33.278 INFO:tasks.workunit.client.1.smithi135.stdout:7/657: dread - d2/d15/d5c/d62/da5/fbb zero size 2024-09-10T09:36:33.284 INFO:tasks.workunit.client.1.smithi135.stdout:9/777: dread de/df/d1d/d1e/d52/fe4 [0,4194304] 0 2024-09-10T09:36:33.284 INFO:tasks.workunit.client.1.smithi135.stdout:9/778: chown de/df/d1d/d23/d25/d28/d7b 2137 1 2024-09-10T09:36:33.285 INFO:tasks.workunit.client.1.smithi135.stdout:3/577: unlink d4/d5/db/f3a 0 2024-09-10T09:36:33.287 INFO:tasks.workunit.client.1.smithi135.stdout:9/779: read de/df/d1d/d1e/db5/d88/fd6 [213109,64154] 0 2024-09-10T09:36:33.290 INFO:tasks.workunit.client.1.smithi135.stdout:2/718: rename df/d1b/d30/c57 to df/dde/ce5 0 2024-09-10T09:36:33.290 INFO:tasks.workunit.client.1.smithi135.stdout:0/787: dwrite d8/d80/d10a/fe8 [0,4194304] 0 2024-09-10T09:36:33.290 INFO:tasks.workunit.client.1.smithi135.stdout:2/719: dread df/d1b/d30/f37 [0,4194304] 0 2024-09-10T09:36:33.294 INFO:tasks.workunit.client.1.smithi135.stdout:3/578: symlink d4/d5/db/d36/d6a/laa 0 2024-09-10T09:36:33.294 INFO:tasks.workunit.client.1.smithi135.stdout:3/579: chown d4/d5/f80 418604296 1 2024-09-10T09:36:33.294 INFO:tasks.workunit.client.1.smithi135.stdout:3/580: chown d4/f47 3 1 2024-09-10T09:36:33.294 INFO:tasks.workunit.client.1.smithi135.stdout:2/720: dread df/d13/d4f/d95/d97/fc9 [0,4194304] 0 2024-09-10T09:36:33.294 INFO:tasks.workunit.client.1.smithi135.stdout:2/721: write df/d1b/fb8 [760941,9675] 0 2024-09-10T09:36:33.296 INFO:tasks.workunit.client.1.smithi135.stdout:4/924: rename d1/l6c to d1/db/d9/d55/d70/da4/dac/dd7/d11a/l11d 0 2024-09-10T09:36:33.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/788: symlink d8/d80/d10a/d73/d88/l10e 0 2024-09-10T09:36:33.308 INFO:tasks.workunit.client.1.smithi135.stdout:0/789: write d8/dd/d18/d3d/fb2 [575383,113260] 0 2024-09-10T09:36:33.310 INFO:tasks.workunit.client.1.smithi135.stdout:9/780: dwrite de/df/d1d/d1e/d68/fa4 [0,4194304] 0 2024-09-10T09:36:33.310 INFO:tasks.workunit.client.1.smithi135.stdout:9/781: chown de/df/c3b 1 1 2024-09-10T09:36:33.310 INFO:tasks.workunit.client.1.smithi135.stdout:9/782: write de/df/d1d/d1e/fe2 [17662,110647] 0 2024-09-10T09:36:33.312 INFO:tasks.workunit.client.1.smithi135.stdout:7/658: rmdir d2/d25 39 2024-09-10T09:36:33.312 INFO:tasks.workunit.client.1.smithi135.stdout:3/581: write d4/f47 [428799,102907] 0 2024-09-10T09:36:33.319 INFO:tasks.workunit.client.1.smithi135.stdout:9/783: mknod de/df/d1d/d23/d25/cff 0 2024-09-10T09:36:33.319 INFO:tasks.workunit.client.1.smithi135.stdout:9/784: readlink de/df/d7e/lfc 0 2024-09-10T09:36:33.320 INFO:tasks.workunit.client.1.smithi135.stdout:9/785: chown de/df/d7e/lb8 89484441 1 2024-09-10T09:36:33.321 INFO:tasks.workunit.client.1.smithi135.stdout:7/659: rmdir d2/d15/d4a/d36/d84 39 2024-09-10T09:36:33.324 INFO:tasks.workunit.client.1.smithi135.stdout:3/582: rename d4/d55/d5d/ca2 to d4/d5/db/d36/d43/cab 0 2024-09-10T09:36:33.325 INFO:tasks.workunit.client.1.smithi135.stdout:3/583: fdatasync d4/d5/db/f3f 0 2024-09-10T09:36:33.326 INFO:tasks.workunit.client.1.smithi135.stdout:0/790: write d8/d80/d10a/d73/fb7 [3112798,129820] 0 2024-09-10T09:36:33.328 INFO:tasks.workunit.client.1.smithi135.stdout:9/786: truncate de/df/dac/db7/fcb 1578583 0 2024-09-10T09:36:33.330 INFO:tasks.workunit.client.1.smithi135.stdout:7/660: mkdir d2/d25/d5d/d83/dcd 0 2024-09-10T09:36:33.331 INFO:tasks.workunit.client.1.smithi135.stdout:2/722: dwrite df/d1b/d23/db6/fbd [4194304,4194304] 0 2024-09-10T09:36:33.331 INFO:tasks.workunit.client.1.smithi135.stdout:2/723: creat df/d15/fe6 x:0 0 0 2024-09-10T09:36:33.331 INFO:tasks.workunit.client.1.smithi135.stdout:2/724: chown df/d1b/d23/d98/d5f/d2c 4806484 1 2024-09-10T09:36:33.331 INFO:tasks.workunit.client.1.smithi135.stdout:4/925: dwrite d1/db/da0/ff0 [0,4194304] 0 2024-09-10T09:36:33.332 INFO:tasks.workunit.client.1.smithi135.stdout:3/584: getdents d4/d55 0 2024-09-10T09:36:33.338 INFO:tasks.workunit.client.1.smithi135.stdout:9/787: creat de/df/d1d/d23/d25/d28/f100 x:0 0 0 2024-09-10T09:36:33.338 INFO:tasks.workunit.client.1.smithi135.stdout:9/788: fsync de/df/d1d/d1e/d68/d9f/fab 0 2024-09-10T09:36:33.341 INFO:tasks.workunit.client.1.smithi135.stdout:7/661: mknod d2/d15/d5c/cce 0 2024-09-10T09:36:33.353 INFO:tasks.workunit.client.1.smithi135.stdout:4/926: rename d1/db/d9/l10 to d1/de/d16/db8/dfe/l11e 0 2024-09-10T09:36:33.353 INFO:tasks.workunit.client.1.smithi135.stdout:4/927: readlink d1/db/la7 0 2024-09-10T09:36:33.353 INFO:tasks.workunit.client.1.smithi135.stdout:0/791: dwrite d8/de/d2e/f91 [4194304,4194304] 0 2024-09-10T09:36:33.356 INFO:tasks.workunit.client.1.smithi135.stdout:4/928: symlink d1/d33/d40/def/l11f 0 2024-09-10T09:36:33.359 INFO:tasks.workunit.client.1.smithi135.stdout:0/792: creat d8/d80/d10a/d73/d88/db6/f10f x:0 0 0 2024-09-10T09:36:33.362 INFO:tasks.workunit.client.1.smithi135.stdout:0/793: unlink d8/fe1 0 2024-09-10T09:36:33.362 INFO:tasks.workunit.client.1.smithi135.stdout:0/794: dread - d8/f9f zero size 2024-09-10T09:36:33.363 INFO:tasks.workunit.client.1.smithi135.stdout:4/929: getdents d1/de/d16/d98 0 2024-09-10T09:36:33.366 INFO:tasks.workunit.client.1.smithi135.stdout:4/930: creat d1/db/d9/d55/d70/da4/dac/f120 x:0 0 0 2024-09-10T09:36:33.366 INFO:tasks.workunit.client.1.smithi135.stdout:4/931: creat d1/d33/d40/f121 x:0 0 0 2024-09-10T09:36:33.369 INFO:tasks.workunit.client.1.smithi135.stdout:4/932: truncate d1/db/d83/fb6 48589 0 2024-09-10T09:36:33.370 INFO:tasks.workunit.client.1.smithi135.stdout:4/933: creat d1/d85/dc4/df7/f122 x:0 0 0 2024-09-10T09:36:33.372 INFO:tasks.workunit.client.1.smithi135.stdout:4/934: mkdir d1/d8a/d123 0 2024-09-10T09:36:33.373 INFO:tasks.workunit.client.1.smithi135.stdout:2/725: dwrite df/d1b/d23/d98/d5f/d2c/d7d/d8c/f99 [0,4194304] 0 2024-09-10T09:36:33.373 INFO:tasks.workunit.client.1.smithi135.stdout:2/726: chown df/f16 245644969 1 2024-09-10T09:36:33.377 INFO:tasks.workunit.client.1.smithi135.stdout:3/585: dwrite d4/d5/db/d36/d43/f46 [4194304,4194304] 0 2024-09-10T09:36:33.379 INFO:tasks.workunit.client.1.smithi135.stdout:7/662: dwrite d2/d25/d5d/f8d [0,4194304] 0 2024-09-10T09:36:33.379 INFO:tasks.workunit.client.1.smithi135.stdout:2/727: creat df/d13/d52/d8f/fe7 x:0 0 0 2024-09-10T09:36:33.379 INFO:tasks.workunit.client.1.smithi135.stdout:2/728: creat df/d1b/d31/fe8 x:0 0 0 2024-09-10T09:36:33.379 INFO:tasks.workunit.client.1.smithi135.stdout:9/789: dwrite de/df/d1d/d23/d25/d28/f37 [0,4194304] 0 2024-09-10T09:36:33.379 INFO:tasks.workunit.client.1.smithi135.stdout:9/790: chown de/df/d1d/d1e/db5/d88/f94 65387998 1 2024-09-10T09:36:33.386 INFO:tasks.workunit.client.1.smithi135.stdout:4/935: write d1/d33/f3d [3629032,85587] 0 2024-09-10T09:36:33.393 INFO:tasks.workunit.client.1.smithi135.stdout:7/663: rmdir d2/d15/d4a/d36 39 2024-09-10T09:36:33.398 INFO:tasks.workunit.client.1.smithi135.stdout:2/729: mknod df/d1b/d30/ce9 0 2024-09-10T09:36:33.417 INFO:tasks.workunit.client.1.smithi135.stdout:9/791: mkdir de/df/d1d/d23/d25/d28/d101 0 2024-09-10T09:36:33.418 INFO:tasks.workunit.client.1.smithi135.stdout:9/792: read - de/df/d1d/d23/f8e zero size 2024-09-10T09:36:33.420 INFO:tasks.workunit.client.1.smithi135.stdout:7/664: rename d2/d15/d81 to d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf 0 2024-09-10T09:36:33.422 INFO:tasks.workunit.client.1.smithi135.stdout:2/730: getdents df/d1b/d23/d98/d5f/d2c/d7d 0 2024-09-10T09:36:33.422 INFO:tasks.workunit.client.1.smithi135.stdout:2/731: stat df/d1b/d23/l4c 0 2024-09-10T09:36:33.424 INFO:tasks.workunit.client.1.smithi135.stdout:4/936: truncate d1/db/da0/ff0 3252250 0 2024-09-10T09:36:33.424 INFO:tasks.workunit.client.1.smithi135.stdout:4/937: creat d1/db/d9/d55/d70/da4/dac/f124 x:0 0 0 2024-09-10T09:36:33.428 INFO:tasks.workunit.client.1.smithi135.stdout:9/793: rename de/f15 to de/df/f102 0 2024-09-10T09:36:33.431 INFO:tasks.workunit.client.1.smithi135.stdout:7/665: write d2/d15/f2d [3024559,61385] 0 2024-09-10T09:36:33.432 INFO:tasks.workunit.client.1.smithi135.stdout:4/938: truncate d1/f90 3702538 0 2024-09-10T09:36:33.438 INFO:tasks.workunit.client.1.smithi135.stdout:4/939: mkdir d1/db/d23/d125 0 2024-09-10T09:36:33.443 INFO:tasks.workunit.client.1.smithi135.stdout:4/940: link d1/db/d9/d55/d70/da4/cb2 d1/db/d9/d55/d70/da4/dac/dd7/d11a/c126 0 2024-09-10T09:36:33.447 INFO:tasks.workunit.client.1.smithi135.stdout:4/941: dread d1/db/d9/f6a [0,4194304] 0 2024-09-10T09:36:33.447 INFO:tasks.workunit.client.1.smithi135.stdout:4/942: chown d1 47422 1 2024-09-10T09:36:33.447 INFO:tasks.workunit.client.1.smithi135.stdout:4/943: rename d1 to d1/db/d9/d127 22 2024-09-10T09:36:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:4/944: mknod d1/db/d23/d125/c128 0 2024-09-10T09:36:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:4/945: chown d1/d4a/c65 10855 1 2024-09-10T09:36:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:2/732: dwrite df/d15/f67 [0,4194304] 0 2024-09-10T09:36:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:2/733: write df/d1b/d31/f86 [409067,105039] 0 2024-09-10T09:36:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:2/734: readlink df/d13/d4f/la8 0 2024-09-10T09:36:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:2/735: write df/f10 [4403039,12159] 0 2024-09-10T09:36:33.452 INFO:tasks.workunit.client.1.smithi135.stdout:2/736: dread - df/d1b/d23/d98/d5f/d3d/fb3 zero size 2024-09-10T09:36:33.455 INFO:tasks.workunit.client.1.smithi135.stdout:4/946: rename d1/d8a/fae to d1/de/d16/d8b/dc6/f129 0 2024-09-10T09:36:33.458 INFO:tasks.workunit.client.1.smithi135.stdout:4/947: dread d1/d8a/fbf [0,4194304] 0 2024-09-10T09:36:33.458 INFO:tasks.workunit.client.1.smithi135.stdout:2/737: mknod df/d13/d4f/cea 0 2024-09-10T09:36:33.458 INFO:tasks.workunit.client.1.smithi135.stdout:2/738: readlink df/d13/d4f/lb9 0 2024-09-10T09:36:33.459 INFO:tasks.workunit.client.1.smithi135.stdout:9/794: dwrite de/df/d1d/d1e/db5/d83/fb0 [0,4194304] 0 2024-09-10T09:36:33.459 INFO:tasks.workunit.client.1.smithi135.stdout:9/795: truncate de/df/d1d/d1e/d3f/f58 137123 0 2024-09-10T09:36:33.459 INFO:tasks.workunit.client.1.smithi135.stdout:9/796: fsync de/df/d1d/d23/d25/d28/d7b/ff2 0 2024-09-10T09:36:33.459 INFO:tasks.workunit.client.1.smithi135.stdout:7/666: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f86 [0,4194304] 0 2024-09-10T09:36:33.461 INFO:tasks.workunit.client.1.smithi135.stdout:9/797: dread de/df/d1d/d23/d25/fc1 [0,4194304] 0 2024-09-10T09:36:33.464 INFO:tasks.workunit.client.1.smithi135.stdout:2/739: write df/f16 [3282619,3993] 0 2024-09-10T09:36:33.475 INFO:tasks.workunit.client.1.smithi135.stdout:7/667: getdents d2/d25/d9d 0 2024-09-10T09:36:33.475 INFO:tasks.workunit.client.1.smithi135.stdout:7/668: readlink d2/d25/l50 0 2024-09-10T09:36:33.477 INFO:tasks.workunit.client.1.smithi135.stdout:9/798: mknod de/df/d1d/d1e/d3f/c103 0 2024-09-10T09:36:33.478 INFO:tasks.workunit.client.1.smithi135.stdout:7/669: getdents d2/d15/d39/d9f/db2/dcc/d49/d60/d30 0 2024-09-10T09:36:33.480 INFO:tasks.workunit.client.1.smithi135.stdout:2/740: dwrite df/d1b/d23/d98/d5f/f89 [0,4194304] 0 2024-09-10T09:36:33.481 INFO:tasks.workunit.client.1.smithi135.stdout:9/799: getdents de 0 2024-09-10T09:36:33.482 INFO:tasks.workunit.client.1.smithi135.stdout:2/741: dread df/d1b/fb8 [0,4194304] 0 2024-09-10T09:36:33.483 INFO:tasks.workunit.client.1.smithi135.stdout:4/948: rename d1/d4a to d1/de/d16/d12a 0 2024-09-10T09:36:33.489 INFO:tasks.workunit.client.1.smithi135.stdout:7/670: link d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71/c8e d2/cd0 0 2024-09-10T09:36:33.489 INFO:tasks.workunit.client.1.smithi135.stdout:7/671: chown d2/d26/f8b 90919 1 2024-09-10T09:36:33.489 INFO:tasks.workunit.client.1.smithi135.stdout:7/672: chown d2/d15/d39/d9f/db2/dcc/d49/d60/d30 123110 1 2024-09-10T09:36:33.489 INFO:tasks.workunit.client.1.smithi135.stdout:7/673: chown d2/d25/d5d/f8d 249 1 2024-09-10T09:36:33.489 INFO:tasks.workunit.client.1.smithi135.stdout:7/674: fsync d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71/f92 0 2024-09-10T09:36:33.491 INFO:tasks.workunit.client.1.smithi135.stdout:4/949: mkdir d1/d33/d12b 0 2024-09-10T09:36:33.496 INFO:tasks.workunit.client.1.smithi135.stdout:4/950: dread d1/de/d16/fbc [0,4194304] 0 2024-09-10T09:36:33.501 INFO:tasks.workunit.client.1.smithi135.stdout:7/675: creat d2/d25/d5d/dbd/fd1 x:0 0 0 2024-09-10T09:36:33.501 INFO:tasks.workunit.client.1.smithi135.stdout:7/676: write d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f34 [3613590,60079] 0 2024-09-10T09:36:33.501 INFO:tasks.workunit.client.1.smithi135.stdout:9/800: dwrite de/df/d1d/d23/d25/f48 [0,4194304] 0 2024-09-10T09:36:33.501 INFO:tasks.workunit.client.1.smithi135.stdout:9/801: chown de/df/d1d/d23/f8e 18 1 2024-09-10T09:36:33.503 INFO:tasks.workunit.client.1.smithi135.stdout:4/951: write d1/de/d16/f68 [159896,51] 0 2024-09-10T09:36:33.503 INFO:tasks.workunit.client.1.smithi135.stdout:4/952: readlink d1/db/d9/l4e 0 2024-09-10T09:36:33.503 INFO:tasks.workunit.client.1.smithi135.stdout:4/953: creat d1/db/d9/d55/f12c x:0 0 0 2024-09-10T09:36:33.506 INFO:tasks.workunit.client.1.smithi135.stdout:7/677: symlink d2/d15/d39/d6f/ld2 0 2024-09-10T09:36:33.506 INFO:tasks.workunit.client.1.smithi135.stdout:7/678: fdatasync d2/d26/f94 0 2024-09-10T09:36:33.506 INFO:tasks.workunit.client.1.smithi135.stdout:7/679: write d2/d15/d39/f55 [150877,30583] 0 2024-09-10T09:36:33.512 INFO:tasks.workunit.client.1.smithi135.stdout:9/802: rmdir de/df/d1d/d1e/db5 39 2024-09-10T09:36:33.516 INFO:tasks.workunit.client.1.smithi135.stdout:4/954: symlink d1/db/d9/d55/d70/da4/dac/l12d 0 2024-09-10T09:36:33.523 INFO:tasks.workunit.client.1.smithi135.stdout:9/803: stat de/c29 0 2024-09-10T09:36:33.525 INFO:tasks.workunit.client.1.smithi135.stdout:9/804: symlink de/df/dac/l104 0 2024-09-10T09:36:33.527 INFO:tasks.workunit.client.1.smithi135.stdout:9/805: readlink de/df/d1d/d23/l4b 0 2024-09-10T09:36:33.527 INFO:tasks.workunit.client.1.smithi135.stdout:9/806: creat de/df/dac/db7/f105 x:0 0 0 2024-09-10T09:36:33.530 INFO:tasks.workunit.client.1.smithi135.stdout:9/807: symlink de/l106 0 2024-09-10T09:36:33.530 INFO:tasks.workunit.client.1.smithi135.stdout:9/808: chown de/f80 32844880 1 2024-09-10T09:36:33.531 INFO:tasks.workunit.client.1.smithi135.stdout:9/809: rmdir de/df/d1d/d1e/d52 39 2024-09-10T09:36:33.534 INFO:tasks.workunit.client.1.smithi135.stdout:9/810: creat de/df/d7e/f107 x:0 0 0 2024-09-10T09:36:33.534 INFO:tasks.workunit.client.1.smithi135.stdout:9/811: creat de/df/d1d/d23/d25/d28/d7b/f108 x:0 0 0 2024-09-10T09:36:33.534 INFO:tasks.workunit.client.1.smithi135.stdout:9/812: write de/df/dac/db7/ff7 [2081025,34562] 0 2024-09-10T09:36:33.536 INFO:tasks.workunit.client.1.smithi135.stdout:4/955: dwrite d1/d33/d40/def/ff1 [0,4194304] 0 2024-09-10T09:36:33.538 INFO:tasks.workunit.client.1.smithi135.stdout:9/813: creat de/df/d1d/d23/d25/d78/dec/f109 x:0 0 0 2024-09-10T09:36:33.538 INFO:tasks.workunit.client.1.smithi135.stdout:9/814: read - de/df/d1d/d23/d25/d78/dec/f109 zero size 2024-09-10T09:36:33.542 INFO:tasks.workunit.client.1.smithi135.stdout:9/815: mknod de/df/d1d/d1e/d68/c10a 0 2024-09-10T09:36:33.547 INFO:tasks.workunit.client.1.smithi135.stdout:4/956: dread d1/d85/db3/f103 [0,4194304] 0 2024-09-10T09:36:33.547 INFO:tasks.workunit.client.1.smithi135.stdout:4/957: getdents d1/d33/d12b 0 2024-09-10T09:36:33.547 INFO:tasks.workunit.client.1.smithi135.stdout:4/958: chown d1/d85/ldf 5 1 2024-09-10T09:36:33.553 INFO:tasks.workunit.client.1.smithi135.stdout:4/959: unlink d1/d33/f6e 0 2024-09-10T09:36:33.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/960: rename d1/de/d16/d12a/d9d/da1/ff6 to d1/db/d9/d55/d70/da4/dac/dd7/f12e 0 2024-09-10T09:36:33.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/961: chown d1/de/d16/f68 35059 1 2024-09-10T09:36:33.558 INFO:tasks.workunit.client.1.smithi135.stdout:4/962: write d1/de/d16/fbc [2053351,94298] 0 2024-09-10T09:36:33.559 INFO:tasks.workunit.client.1.smithi135.stdout:9/816: dwrite de/df/d1d/d62/ff1 [0,4194304] 0 2024-09-10T09:36:33.563 INFO:tasks.workunit.client.1.smithi135.stdout:4/963: mkdir d1/db/d9/d55/db5/d116/d12f 0 2024-09-10T09:36:33.568 INFO:tasks.workunit.client.1.smithi135.stdout:9/817: dread de/df/d1d/d23/d25/f48 [0,4194304] 0 2024-09-10T09:36:33.574 INFO:tasks.workunit.client.1.smithi135.stdout:9/818: dread de/f18 [0,4194304] 0 2024-09-10T09:36:33.625 INFO:tasks.workunit.client.1.smithi135.stdout:4/964: truncate d1/de/d16/f21 4304525 0 2024-09-10T09:36:33.626 INFO:tasks.workunit.client.1.smithi135.stdout:9/819: creat de/df/d1d/d1e/d3f/ddb/f10b x:0 0 0 2024-09-10T09:36:33.630 INFO:tasks.workunit.client.1.smithi135.stdout:4/965: mknod d1/db/da0/c130 0 2024-09-10T09:36:33.645 INFO:tasks.workunit.client.1.smithi135.stdout:4/966: dwrite d1/db/d9/d55/d76/ffd [0,4194304] 0 2024-09-10T09:36:33.647 INFO:tasks.workunit.client.1.smithi135.stdout:4/967: read d1/f22 [34130,130695] 0 2024-09-10T09:36:33.648 INFO:tasks.workunit.client.1.smithi135.stdout:4/968: write d1/db/d9/d55/d70/fc2 [2923245,31679] 0 2024-09-10T09:36:33.649 INFO:tasks.workunit.client.1.smithi135.stdout:4/969: write d1/d8a/fbf [488017,101014] 0 2024-09-10T09:36:33.651 INFO:tasks.workunit.client.1.smithi135.stdout:4/970: dread d1/de/d16/d8b/dc6/f129 [0,4194304] 0 2024-09-10T09:36:33.654 INFO:tasks.workunit.client.1.smithi135.stdout:4/971: truncate d1/db/d23/f30 550903 0 2024-09-10T09:36:33.679 INFO:tasks.workunit.client.1.smithi135.stdout:4/972: dwrite d1/db/d9/d55/d70/fc2 [0,4194304] 0 2024-09-10T09:36:33.679 INFO:tasks.workunit.client.1.smithi135.stdout:4/973: fdatasync d1/de/d16/d12a/f87 0 2024-09-10T09:36:33.680 INFO:tasks.workunit.client.1.smithi135.stdout:4/974: chown d1/de/d16/f67 17765537 1 2024-09-10T09:36:33.681 INFO:tasks.workunit.client.1.smithi135.stdout:4/975: rename d1/db/d9/d55/db5/d116/d12f to d1/de/d16/d12a/d131 0 2024-09-10T09:36:33.700 INFO:tasks.workunit.client.1.smithi135.stdout:4/976: dwrite d1/de/f13 [0,4194304] 0 2024-09-10T09:36:33.700 INFO:tasks.workunit.client.1.smithi135.stdout:4/977: truncate d1/db/d9/d55/d76/ffa 1286747 0 2024-09-10T09:36:33.809 INFO:tasks.workunit.client.1.smithi135.stdout:4/978: creat d1/d85/dc4/f132 x:0 0 0 2024-09-10T09:36:33.809 INFO:tasks.workunit.client.1.smithi135.stdout:4/979: dread - d1/db/d9/d55/f12c zero size 2024-09-10T09:36:33.809 INFO:tasks.workunit.client.1.smithi135.stdout:8/691: sync 2024-09-10T09:36:33.809 INFO:tasks.workunit.client.1.smithi135.stdout:5/794: sync 2024-09-10T09:36:33.809 INFO:tasks.workunit.client.1.smithi135.stdout:1/825: sync 2024-09-10T09:36:33.810 INFO:tasks.workunit.client.1.smithi135.stdout:8/692: dread - d1/d8f/fdb zero size 2024-09-10T09:36:33.810 INFO:tasks.workunit.client.1.smithi135.stdout:1/826: chown d1d/d20/d3c/d4e 200 1 2024-09-10T09:36:33.810 INFO:tasks.workunit.client.1.smithi135.stdout:5/795: dread - d3/dc/dba/d48/d57/dc4/f11a zero size 2024-09-10T09:36:33.813 INFO:tasks.workunit.client.1.smithi135.stdout:1/827: truncate d1d/d20/d42/dd3/df5/fba 4073499 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:5/796: dwrite d3/dc/dba/d48/d57/f67 [0,4194304] 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:8/693: dwrite d1/fdd [0,4194304] 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:8/694: fsync d1/f7 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:8/695: truncate d1/d15/d49/f81 642712 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:8/696: stat d1/d27/d3d/d94/da7 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:1/828: dwrite d1d/d20/d3c/f9f [0,4194304] 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:4/980: dwrite d1/f22 [0,4194304] 0 2024-09-10T09:36:33.846 INFO:tasks.workunit.client.1.smithi135.stdout:4/981: fdatasync d1/de/d16/d8b/dc6/fcd 0 2024-09-10T09:36:33.853 INFO:tasks.workunit.client.1.smithi135.stdout:5/797: symlink d3/dc/dba/d48/d57/l11b 0 2024-09-10T09:36:33.857 INFO:tasks.workunit.client.1.smithi135.stdout:4/982: write d1/db/d9/d55/d70/fc2 [1954656,56738] 0 2024-09-10T09:36:33.857 INFO:tasks.workunit.client.1.smithi135.stdout:4/983: fdatasync d1/db/d9/fd0 0 2024-09-10T09:36:33.858 INFO:tasks.workunit.client.1.smithi135.stdout:8/697: creat d1/d27/fe1 x:0 0 0 2024-09-10T09:36:33.858 INFO:tasks.workunit.client.1.smithi135.stdout:8/698: write d1/d15/d16/fcb [441236,51516] 0 2024-09-10T09:36:33.858 INFO:tasks.workunit.client.1.smithi135.stdout:8/699: truncate d1/d8f/fdb 111270 0 2024-09-10T09:36:33.858 INFO:tasks.workunit.client.1.smithi135.stdout:8/700: creat d1/d15/d16/d96/fe2 x:0 0 0 2024-09-10T09:36:33.862 INFO:tasks.workunit.client.1.smithi135.stdout:1/829: rmdir d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/dd2 39 2024-09-10T09:36:33.876 INFO:tasks.workunit.client.1.smithi135.stdout:5/798: mknod d3/d81/c11c 0 2024-09-10T09:36:33.879 INFO:tasks.workunit.client.1.smithi135.stdout:4/984: truncate d1/db/d23/f42 2566553 0 2024-09-10T09:36:33.882 INFO:tasks.workunit.client.1.smithi135.stdout:5/799: mkdir d3/dc/dba/d4e/d87/d11d 0 2024-09-10T09:36:33.884 INFO:tasks.workunit.client.1.smithi135.stdout:4/985: creat d1/db/d9/d55/db5/f133 x:0 0 0 2024-09-10T09:36:33.885 INFO:tasks.workunit.client.1.smithi135.stdout:5/800: symlink d3/dc/dba/dae/l11e 0 2024-09-10T09:36:33.886 INFO:tasks.workunit.client.1.smithi135.stdout:4/986: truncate d1/f77 1383298 0 2024-09-10T09:36:33.886 INFO:tasks.workunit.client.1.smithi135.stdout:8/701: dwrite d1/d15/d16/d33/d45/fd8 [0,4194304] 0 2024-09-10T09:36:33.887 INFO:tasks.workunit.client.1.smithi135.stdout:1/830: dwrite d1d/d20/d52/f5a [0,4194304] 0 2024-09-10T09:36:33.887 INFO:tasks.workunit.client.1.smithi135.stdout:1/831: write d1d/d20/d52/d8a/dc2/dca/d2b/fef [1001021,57434] 0 2024-09-10T09:36:33.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/801: truncate d3/d44/f30 276212 0 2024-09-10T09:36:33.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/802: chown d3/d81/c11c 33 1 2024-09-10T09:36:33.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/803: chown d3/d71/d61/ff3 18 1 2024-09-10T09:36:33.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/804: creat d3/dc/dba/d48/d57/da9/f11f x:0 0 0 2024-09-10T09:36:33.891 INFO:tasks.workunit.client.1.smithi135.stdout:4/987: truncate d1/de/d16/d8b/fcc 486963 0 2024-09-10T09:36:33.894 INFO:tasks.workunit.client.1.smithi135.stdout:0/795: sync 2024-09-10T09:36:33.894 INFO:tasks.workunit.client.1.smithi135.stdout:3/586: sync 2024-09-10T09:36:33.894 INFO:tasks.workunit.client.1.smithi135.stdout:2/742: sync 2024-09-10T09:36:33.894 INFO:tasks.workunit.client.1.smithi135.stdout:2/743: readlink df/d1b/d23/d98/d5f/d2c/d7d/la2 0 2024-09-10T09:36:33.898 INFO:tasks.workunit.client.1.smithi135.stdout:8/702: rename d1/d15/l30 to d1/d8f/da0/de0/le3 0 2024-09-10T09:36:33.902 INFO:tasks.workunit.client.1.smithi135.stdout:8/703: dread d1/d8f/fb8 [0,4194304] 0 2024-09-10T09:36:33.902 INFO:tasks.workunit.client.1.smithi135.stdout:8/704: creat d1/d15/d16/d33/d39/fe4 x:0 0 0 2024-09-10T09:36:33.909 INFO:tasks.workunit.client.1.smithi135.stdout:1/832: unlink d1d/d20/d52/d8a/dc2/dca/d37/d6d/fb2 0 2024-09-10T09:36:33.915 INFO:tasks.workunit.client.1.smithi135.stdout:5/805: mkdir d3/d81/d120 0 2024-09-10T09:36:33.916 INFO:tasks.workunit.client.1.smithi135.stdout:3/587: creat d4/d5/dc/d8b/fac x:0 0 0 2024-09-10T09:36:33.920 INFO:tasks.workunit.client.1.smithi135.stdout:0/796: creat d8/d80/d10a/d73/d7f/d8c/da8/de7/f110 x:0 0 0 2024-09-10T09:36:33.921 INFO:tasks.workunit.client.1.smithi135.stdout:2/744: mknod df/d13/d96/ceb 0 2024-09-10T09:36:33.921 INFO:tasks.workunit.client.1.smithi135.stdout:9/820: sync 2024-09-10T09:36:33.922 INFO:tasks.workunit.client.1.smithi135.stdout:7/680: sync 2024-09-10T09:36:33.922 INFO:tasks.workunit.client.1.smithi135.stdout:8/705: dwrite d1/fdd [0,4194304] 0 2024-09-10T09:36:33.922 INFO:tasks.workunit.client.1.smithi135.stdout:5/806: dread d3/dc/dba/d88/fdd [0,4194304] 0 2024-09-10T09:36:33.922 INFO:tasks.workunit.client.1.smithi135.stdout:5/807: chown d3/dc/dba/d88/fa1 2938140 1 2024-09-10T09:36:33.924 INFO:tasks.workunit.client.1.smithi135.stdout:2/745: dread df/d1b/d23/d98/d5f/d3d/f5b [0,4194304] 0 2024-09-10T09:36:33.927 INFO:tasks.workunit.client.1.smithi135.stdout:4/988: rename d1/db/d83/f104 to d1/de/d16/db8/dfe/f134 0 2024-09-10T09:36:33.927 INFO:tasks.workunit.client.1.smithi135.stdout:4/989: write d1/d85/dc4/f132 [570805,62729] 0 2024-09-10T09:36:33.932 INFO:tasks.workunit.client.1.smithi135.stdout:0/797: dread d8/d80/d10a/fc0 [0,4194304] 0 2024-09-10T09:36:33.935 INFO:tasks.workunit.client.1.smithi135.stdout:4/990: dread d1/d85/d89/f91 [0,4194304] 0 2024-09-10T09:36:33.938 INFO:tasks.workunit.client.1.smithi135.stdout:1/833: unlink d1d/d20/d3c/d6a/l85 0 2024-09-10T09:36:33.940 INFO:tasks.workunit.client.1.smithi135.stdout:3/588: mknod d4/d5/d51/da3/cad 0 2024-09-10T09:36:33.945 INFO:tasks.workunit.client.1.smithi135.stdout:9/821: symlink de/df/d7e/l10c 0 2024-09-10T09:36:33.945 INFO:tasks.workunit.client.1.smithi135.stdout:9/822: chown de/df/d1d/d1e/db5/d88/dc6/deb 1928475 1 2024-09-10T09:36:33.945 INFO:tasks.workunit.client.1.smithi135.stdout:9/823: chown cc 0 1 2024-09-10T09:36:33.945 INFO:tasks.workunit.client.1.smithi135.stdout:9/824: chown de/df/d1d/d1e/d52 102 1 2024-09-10T09:36:33.953 INFO:tasks.workunit.client.1.smithi135.stdout:7/681: symlink d2/d15/d39/d9f/ld3 0 2024-09-10T09:36:33.953 INFO:tasks.workunit.client.1.smithi135.stdout:7/682: read - d2/d15/d39/d9f/fc3 zero size 2024-09-10T09:36:33.953 INFO:tasks.workunit.client.1.smithi135.stdout:7/683: chown d2/d15/d39/d6f 31280 1 2024-09-10T09:36:33.957 INFO:tasks.workunit.client.1.smithi135.stdout:5/808: link d3/d81/d8d/fa8 d3/d71/d61/f121 0 2024-09-10T09:36:33.957 INFO:tasks.workunit.client.1.smithi135.stdout:5/809: write d3/d71/d61/f112 [515231,118424] 0 2024-09-10T09:36:33.962 INFO:tasks.workunit.client.1.smithi135.stdout:0/798: mknod d8/dd/d11/d90/dc4/c111 0 2024-09-10T09:36:33.962 INFO:tasks.workunit.client.1.smithi135.stdout:0/799: write d8/dd/d11/d17/df6/ff7 [17778,100425] 0 2024-09-10T09:36:33.962 INFO:tasks.workunit.client.1.smithi135.stdout:0/800: truncate d8/dd/d11/d90/dc4/fe9 1452689 0 2024-09-10T09:36:33.962 INFO:tasks.workunit.client.1.smithi135.stdout:0/801: chown d8/d80/f8b 33063289 1 2024-09-10T09:36:33.963 INFO:tasks.workunit.client.1.smithi135.stdout:0/802: read - d8/d80/d10a/d73/dc5/ff2 zero size 2024-09-10T09:36:33.964 INFO:tasks.workunit.client.1.smithi135.stdout:3/589: dwrite d4/d5/dc/d8b/fac [0,4194304] 0 2024-09-10T09:36:33.964 INFO:tasks.workunit.client.1.smithi135.stdout:1/834: dwrite d1d/d20/d3c/f102 [0,4194304] 0 2024-09-10T09:36:33.965 INFO:tasks.workunit.client.1.smithi135.stdout:1/835: write d1d/d28/d4b/fdd [646316,30276] 0 2024-09-10T09:36:33.966 INFO:tasks.workunit.client.1.smithi135.stdout:9/825: mknod de/c10d 0 2024-09-10T09:36:33.968 INFO:tasks.workunit.client.1.smithi135.stdout:1/836: dread d1d/d20/f2e [0,4194304] 0 2024-09-10T09:36:33.968 INFO:tasks.workunit.client.1.smithi135.stdout:3/590: dread d4/f25 [0,4194304] 0 2024-09-10T09:36:33.969 INFO:tasks.workunit.client.1.smithi135.stdout:3/591: fdatasync d4/d5/db/d36/f53 0 2024-09-10T09:36:33.969 INFO:tasks.workunit.client.1.smithi135.stdout:3/592: chown d4/d5/db/dd/l2d 39 1 2024-09-10T09:36:33.972 INFO:tasks.workunit.client.1.smithi135.stdout:5/810: unlink d3/dc/dba/d4e/d87/c92 0 2024-09-10T09:36:33.972 INFO:tasks.workunit.client.1.smithi135.stdout:5/811: creat d3/d71/d61/f122 x:0 0 0 2024-09-10T09:36:33.973 INFO:tasks.workunit.client.1.smithi135.stdout:0/803: symlink d8/dd/d4a/d50/d54/d5f/l112 0 2024-09-10T09:36:33.983 INFO:tasks.workunit.client.1.smithi135.stdout:9/826: creat de/df/d1d/d6b/f10e x:0 0 0 2024-09-10T09:36:33.984 INFO:tasks.workunit.client.1.smithi135.stdout:1/837: symlink d1d/d71/d9e/l10a 0 2024-09-10T09:36:33.984 INFO:tasks.workunit.client.1.smithi135.stdout:1/838: chown d1d/d20/d3c/d4e 178475466 1 2024-09-10T09:36:33.986 INFO:tasks.workunit.client.1.smithi135.stdout:3/593: truncate d4/d5/db/f3f 1966810 0 2024-09-10T09:36:33.990 INFO:tasks.workunit.client.1.smithi135.stdout:5/812: mknod d3/dc/d69/d65/c123 0 2024-09-10T09:36:33.991 INFO:tasks.workunit.client.1.smithi135.stdout:5/813: chown d3/dc/dba/d48/d57/dca/lf1 67 1 2024-09-10T09:36:33.991 INFO:tasks.workunit.client.1.smithi135.stdout:5/814: chown d3/dc/dba/d93 7169034 1 2024-09-10T09:36:33.991 INFO:tasks.workunit.client.1.smithi135.stdout:5/815: write d3/dc/d69/d65/d6c/ff8 [677451,71114] 0 2024-09-10T09:36:33.997 INFO:tasks.workunit.client.1.smithi135.stdout:0/804: rename d8/de/l3f to d8/d80/l113 0 2024-09-10T09:36:34.003 INFO:tasks.workunit.client.1.smithi135.stdout:1/839: mkdir d1d/d20/d52/d8a/dc2/dca/d37/d10b 0 2024-09-10T09:36:34.003 INFO:tasks.workunit.client.1.smithi135.stdout:1/840: chown d1d/d20/d52/d8a/dc2/dca/d37/db8/cd7 1618963 1 2024-09-10T09:36:34.004 INFO:tasks.workunit.client.1.smithi135.stdout:3/594: truncate d4/f25 2047527 0 2024-09-10T09:36:34.004 INFO:tasks.workunit.client.1.smithi135.stdout:3/595: truncate d4/d5/db/dd/d79/f85 741925 0 2024-09-10T09:36:34.004 INFO:tasks.workunit.client.1.smithi135.stdout:3/596: fsync d4/f47 0 2024-09-10T09:36:34.004 INFO:tasks.workunit.client.1.smithi135.stdout:3/597: readlink d4/d5/dc/d71/l72 0 2024-09-10T09:36:34.007 INFO:tasks.workunit.client.1.smithi135.stdout:9/827: rename de/df/d1d/d62/ce5 to de/df/c10f 0 2024-09-10T09:36:34.009 INFO:tasks.workunit.client.1.smithi135.stdout:0/805: creat d8/dd/d18/d3d/dc3/d61/db1/f114 x:0 0 0 2024-09-10T09:36:34.009 INFO:tasks.workunit.client.1.smithi135.stdout:1/841: symlink d1d/d20/d52/l10c 0 2024-09-10T09:36:34.012 INFO:tasks.workunit.client.1.smithi135.stdout:5/816: mknod d3/d91/db5/c124 0 2024-09-10T09:36:34.013 INFO:tasks.workunit.client.1.smithi135.stdout:9/828: mknod de/df/d1d/d6b/c110 0 2024-09-10T09:36:34.013 INFO:tasks.workunit.client.1.smithi135.stdout:9/829: write de/df/d1d/d23/d25/d28/d7b/ff2 [714873,71740] 0 2024-09-10T09:36:34.014 INFO:tasks.workunit.client.1.smithi135.stdout:3/598: dread d4/d55/d5d/d5b/f75 [0,4194304] 0 2024-09-10T09:36:34.017 INFO:tasks.workunit.client.1.smithi135.stdout:1/842: truncate d1d/d20/f77 2692338 0 2024-09-10T09:36:34.017 INFO:tasks.workunit.client.1.smithi135.stdout:1/843: truncate d1d/d20/d3c/f75 159604 0 2024-09-10T09:36:34.017 INFO:tasks.workunit.client.1.smithi135.stdout:1/844: creat d1d/d28/d4b/f10d x:0 0 0 2024-09-10T09:36:34.018 INFO:tasks.workunit.client.1.smithi135.stdout:5/817: creat d3/dc/d69/de9/f125 x:0 0 0 2024-09-10T09:36:34.021 INFO:tasks.workunit.client.1.smithi135.stdout:3/599: mknod d4/d5/dc/d71/cae 0 2024-09-10T09:36:34.021 INFO:tasks.workunit.client.1.smithi135.stdout:3/600: chown d4/d5/db/d36/f53 747 1 2024-09-10T09:36:34.022 INFO:tasks.workunit.client.1.smithi135.stdout:9/830: dread de/df/d1d/d23/f67 [0,4194304] 0 2024-09-10T09:36:34.023 INFO:tasks.workunit.client.1.smithi135.stdout:9/831: write de/df/d1d/d1e/d52/fe4 [4416701,129644] 0 2024-09-10T09:36:34.023 INFO:tasks.workunit.client.1.smithi135.stdout:9/832: creat de/df/d1d/d23/d25/d78/dec/f111 x:0 0 0 2024-09-10T09:36:34.023 INFO:tasks.workunit.client.1.smithi135.stdout:9/833: readlink de/df/d1d/d23/l4b 0 2024-09-10T09:36:34.027 INFO:tasks.workunit.client.1.smithi135.stdout:1/845: rmdir d1d/d20/d52/d8a/dc2/dca/d2b/df1 0 2024-09-10T09:36:34.029 INFO:tasks.workunit.client.1.smithi135.stdout:5/818: unlink d3/dc/d16/fab 0 2024-09-10T09:36:34.032 INFO:tasks.workunit.client.1.smithi135.stdout:3/601: write d4/d5/db/d36/d43/f46 [7936012,112685] 0 2024-09-10T09:36:34.037 INFO:tasks.workunit.client.1.smithi135.stdout:1/846: symlink d1d/d20/d52/l10e 0 2024-09-10T09:36:34.041 INFO:tasks.workunit.client.1.smithi135.stdout:3/602: mkdir d4/d5/db/d36/d6a/daf 0 2024-09-10T09:36:34.041 INFO:tasks.workunit.client.1.smithi135.stdout:3/603: fsync d4/d5/db/d44/d68/f73 0 2024-09-10T09:36:34.048 INFO:tasks.workunit.client.1.smithi135.stdout:1/847: dread f11 [0,4194304] 0 2024-09-10T09:36:34.049 INFO:tasks.workunit.client.1.smithi135.stdout:3/604: getdents d4/d5/d51 0 2024-09-10T09:36:34.050 INFO:tasks.workunit.client.1.smithi135.stdout:9/834: dwrite de/df/fda [0,4194304] 0 2024-09-10T09:36:34.050 INFO:tasks.workunit.client.1.smithi135.stdout:5/819: dwrite d3/fb0 [0,4194304] 0 2024-09-10T09:36:34.050 INFO:tasks.workunit.client.1.smithi135.stdout:5/820: chown d3/fb0 4 1 2024-09-10T09:36:34.051 INFO:tasks.workunit.client.1.smithi135.stdout:9/835: write de/f80 [50435,63339] 0 2024-09-10T09:36:34.053 INFO:tasks.workunit.client.1.smithi135.stdout:1/848: symlink d1d/d20/d42/dd3/l10f 0 2024-09-10T09:36:34.053 INFO:tasks.workunit.client.1.smithi135.stdout:1/849: readlink d1d/d20/d52/d8a/dc2/dca/d2b/l6b 0 2024-09-10T09:36:34.053 INFO:tasks.workunit.client.1.smithi135.stdout:1/850: rename d1d/d20 to d1d/d20/d6c/de9/d110 22 2024-09-10T09:36:34.057 INFO:tasks.workunit.client.1.smithi135.stdout:0/806: write d8/dd/d4a/f84 [618701,71216] 0 2024-09-10T09:36:34.057 INFO:tasks.workunit.client.1.smithi135.stdout:3/605: dread d4/f4d [0,4194304] 0 2024-09-10T09:36:34.057 INFO:tasks.workunit.client.1.smithi135.stdout:3/606: chown d4/d5/dc/f17 3 1 2024-09-10T09:36:34.061 INFO:tasks.workunit.client.1.smithi135.stdout:5/821: dread d3/dc/d7a/fa4 [4194304,4194304] 0 2024-09-10T09:36:34.064 INFO:tasks.workunit.client.1.smithi135.stdout:9/836: creat de/df/d1d/d1e/d68/f112 x:0 0 0 2024-09-10T09:36:34.070 INFO:tasks.workunit.client.1.smithi135.stdout:0/807: symlink d8/de/d8e/l115 0 2024-09-10T09:36:34.070 INFO:tasks.workunit.client.1.smithi135.stdout:0/808: stat d8/d80/d10a/f5d 0 2024-09-10T09:36:34.075 INFO:tasks.workunit.client.1.smithi135.stdout:5/822: rmdir d3/dc/d69/d72/dec 39 2024-09-10T09:36:34.075 INFO:tasks.workunit.client.1.smithi135.stdout:5/823: write d3/dc/d69/d65/d6c/ff7 [1397135,24943] 0 2024-09-10T09:36:34.075 INFO:tasks.workunit.client.1.smithi135.stdout:5/824: chown d3/dc/dba/d48/l7b 1977 1 2024-09-10T09:36:34.082 INFO:tasks.workunit.client.1.smithi135.stdout:1/851: getdents d1d/d20/d52/d8a 0 2024-09-10T09:36:34.083 INFO:tasks.workunit.client.1.smithi135.stdout:3/607: rmdir d4/d5/dc/d8b 39 2024-09-10T09:36:34.088 INFO:tasks.workunit.client.1.smithi135.stdout:0/809: dwrite d8/d80/d10a/d73/d7f/d8c/da8/de7/f109 [0,4194304] 0 2024-09-10T09:36:34.089 INFO:tasks.workunit.client.1.smithi135.stdout:0/810: chown d8/dd/d4a/d50/d54/lfc 163467 1 2024-09-10T09:36:34.089 INFO:tasks.workunit.client.1.smithi135.stdout:5/825: rename d3/dc/dba/d48/c75 to d3/dc/d69/de9/c126 0 2024-09-10T09:36:34.092 INFO:tasks.workunit.client.1.smithi135.stdout:9/837: link de/df/d1d/d23/d25/d78/dec/f111 de/df/f113 0 2024-09-10T09:36:34.092 INFO:tasks.workunit.client.1.smithi135.stdout:9/838: write de/df/d1d/d1e/db5/d88/f89 [1395075,66340] 0 2024-09-10T09:36:34.095 INFO:tasks.workunit.client.1.smithi135.stdout:1/852: creat d1d/d28/d4b/d53/f111 x:0 0 0 2024-09-10T09:36:34.096 INFO:tasks.workunit.client.1.smithi135.stdout:3/608: mknod d4/cb0 0 2024-09-10T09:36:34.098 INFO:tasks.workunit.client.1.smithi135.stdout:5/826: dread d3/dc/dba/d88/fa1 [0,4194304] 0 2024-09-10T09:36:34.104 INFO:tasks.workunit.client.1.smithi135.stdout:0/811: unlink d8/f9f 0 2024-09-10T09:36:34.104 INFO:tasks.workunit.client.1.smithi135.stdout:0/812: truncate d8/de/f38 1467023 0 2024-09-10T09:36:34.115 INFO:tasks.workunit.client.1.smithi135.stdout:0/813: read d8/de/f68 [1925270,129082] 0 2024-09-10T09:36:34.117 INFO:tasks.workunit.client.1.smithi135.stdout:9/839: unlink de/df/d1d/d1e/db5/d88/fd6 0 2024-09-10T09:36:34.117 INFO:tasks.workunit.client.1.smithi135.stdout:9/840: creat de/df/f114 x:0 0 0 2024-09-10T09:36:34.120 INFO:tasks.workunit.client.1.smithi135.stdout:5/827: dwrite d3/d71/d61/f121 [0,4194304] 0 2024-09-10T09:36:34.121 INFO:tasks.workunit.client.1.smithi135.stdout:3/609: dwrite d4/f3b [4194304,4194304] 0 2024-09-10T09:36:34.121 INFO:tasks.workunit.client.1.smithi135.stdout:3/610: readlink d4/d55/d5d/d5b/l61 0 2024-09-10T09:36:34.121 INFO:tasks.workunit.client.1.smithi135.stdout:1/853: rename d1d/d20/d42/dd3/df5/l82 to d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/l112 0 2024-09-10T09:36:34.121 INFO:tasks.workunit.client.1.smithi135.stdout:1/854: dread - d1d/d20/d52/d8a/dc2/dca/d2b/d4c/fb7 zero size 2024-09-10T09:36:34.128 INFO:tasks.workunit.client.1.smithi135.stdout:9/841: creat de/df/d1d/d1e/d3f/dbb/f115 x:0 0 0 2024-09-10T09:36:34.128 INFO:tasks.workunit.client.1.smithi135.stdout:5/828: dread d3/dc/d16/dc0/fc5 [0,4194304] 0 2024-09-10T09:36:34.128 INFO:tasks.workunit.client.1.smithi135.stdout:5/829: write d3/d91/db5/fd8 [1564950,87743] 0 2024-09-10T09:36:34.137 INFO:tasks.workunit.client.1.smithi135.stdout:5/830: write d3/d99/fbb [59832,9876] 0 2024-09-10T09:36:34.139 INFO:tasks.workunit.client.1.smithi135.stdout:3/611: truncate d4/d5/dc/d71/f9e 204475 0 2024-09-10T09:36:34.140 INFO:tasks.workunit.client.1.smithi135.stdout:7/684: sync 2024-09-10T09:36:34.140 INFO:tasks.workunit.client.1.smithi135.stdout:8/706: sync 2024-09-10T09:36:34.140 INFO:tasks.workunit.client.1.smithi135.stdout:2/746: sync 2024-09-10T09:36:34.140 INFO:tasks.workunit.client.1.smithi135.stdout:4/991: sync 2024-09-10T09:36:34.140 INFO:tasks.workunit.client.1.smithi135.stdout:4/992: readlink d1/db/d9/d55/d70/lca 0 2024-09-10T09:36:34.140 INFO:tasks.workunit.client.1.smithi135.stdout:2/747: stat df/d1b/d23/d98/d5f/d3d/d87/cc6 0 2024-09-10T09:36:34.141 INFO:tasks.workunit.client.1.smithi135.stdout:0/814: rename d8/dd/d1e/c82 to d8/d80/d10a/d73/d7f/d8c/c116 0 2024-09-10T09:36:34.143 INFO:tasks.workunit.client.1.smithi135.stdout:1/855: getdents d1d/d71/dfc 0 2024-09-10T09:36:34.143 INFO:tasks.workunit.client.1.smithi135.stdout:1/856: dread - d1d/d20/d42/f91 zero size 2024-09-10T09:36:34.143 INFO:tasks.workunit.client.1.smithi135.stdout:1/857: fdatasync d1d/d20/d52/d8a/dc2/dca/db4/fcd 0 2024-09-10T09:36:34.143 INFO:tasks.workunit.client.1.smithi135.stdout:5/831: dread d3/dc/dba/d48/fbc [0,4194304] 0 2024-09-10T09:36:34.144 INFO:tasks.workunit.client.1.smithi135.stdout:0/815: dread d8/dd/d18/d3d/dc3/d61/fd0 [0,4194304] 0 2024-09-10T09:36:34.144 INFO:tasks.workunit.client.1.smithi135.stdout:0/816: stat d8/d80/d10a/d73 0 2024-09-10T09:36:34.145 INFO:tasks.workunit.client.1.smithi135.stdout:9/842: mknod de/df/dac/c116 0 2024-09-10T09:36:34.145 INFO:tasks.workunit.client.1.smithi135.stdout:9/843: fsync de/df/d1d/d23/d25/d28/d4e/f7a 0 2024-09-10T09:36:34.145 INFO:tasks.workunit.client.1.smithi135.stdout:9/844: dread - de/df/d7e/f107 zero size 2024-09-10T09:36:34.149 INFO:tasks.workunit.client.1.smithi135.stdout:3/612: symlink d4/d5/d56/lb1 0 2024-09-10T09:36:34.150 INFO:tasks.workunit.client.1.smithi135.stdout:2/748: read df/d1b/d23/d98/d5f/d2c/d7d/d8c/f99 [305133,54177] 0 2024-09-10T09:36:34.152 INFO:tasks.workunit.client.1.smithi135.stdout:7/685: unlink d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71/c8e 0 2024-09-10T09:36:34.152 INFO:tasks.workunit.client.1.smithi135.stdout:8/707: dread d1/f5 [0,4194304] 0 2024-09-10T09:36:34.153 INFO:tasks.workunit.client.1.smithi135.stdout:8/708: write d1/d15/d49/fbd [4504115,70788] 0 2024-09-10T09:36:34.153 INFO:tasks.workunit.client.1.smithi135.stdout:8/709: truncate d1/d15/d16/d96/fbe 2032821 0 2024-09-10T09:36:34.154 INFO:tasks.workunit.client.1.smithi135.stdout:4/993: creat d1/de/d16/d12a/d6d/dee/f135 x:0 0 0 2024-09-10T09:36:34.155 INFO:tasks.workunit.client.1.smithi135.stdout:5/832: symlink d3/dc/dba/d4e/l127 0 2024-09-10T09:36:34.155 INFO:tasks.workunit.client.1.smithi135.stdout:5/833: creat d3/f128 x:0 0 0 2024-09-10T09:36:34.155 INFO:tasks.workunit.client.1.smithi135.stdout:5/834: chown d3/dc/dba/d4e/d87/cf4 29418 1 2024-09-10T09:36:34.161 INFO:tasks.workunit.client.1.smithi135.stdout:3/613: dread d4/d5/db/f4c [4194304,4194304] 0 2024-09-10T09:36:34.161 INFO:tasks.workunit.client.1.smithi135.stdout:3/614: read - d4/d55/d5d/fa4 zero size 2024-09-10T09:36:34.162 INFO:tasks.workunit.client.1.smithi135.stdout:0/817: mknod d8/d80/d10a/d9c/c117 0 2024-09-10T09:36:34.162 INFO:tasks.workunit.client.1.smithi135.stdout:9/845: unlink de/df/d1d/d1e/db5/d88/dde/ffd 0 2024-09-10T09:36:34.162 INFO:tasks.workunit.client.1.smithi135.stdout:0/818: truncate d8/dd/d11/ff8 338747 0 2024-09-10T09:36:34.164 INFO:tasks.workunit.client.1.smithi135.stdout:2/749: unlink df/d13/d4f/cea 0 2024-09-10T09:36:34.171 INFO:tasks.workunit.client.1.smithi135.stdout:8/710: mkdir d1/d15/d16/d96/de5 0 2024-09-10T09:36:34.171 INFO:tasks.workunit.client.1.smithi135.stdout:8/711: chown d1/d15/d49/l60 734338 1 2024-09-10T09:36:34.171 INFO:tasks.workunit.client.1.smithi135.stdout:4/994: mknod d1/d33/d40/def/c136 0 2024-09-10T09:36:34.171 INFO:tasks.workunit.client.1.smithi135.stdout:3/615: dread d4/d5/db/f4c [0,4194304] 0 2024-09-10T09:36:34.172 INFO:tasks.workunit.client.1.smithi135.stdout:3/616: fdatasync d4/d5/db/dd/d79/f85 0 2024-09-10T09:36:34.172 INFO:tasks.workunit.client.1.smithi135.stdout:3/617: stat d4/d5/d51/fa1 0 2024-09-10T09:36:34.174 INFO:tasks.workunit.client.1.smithi135.stdout:5/835: symlink d3/dc/dba/d48/d57/dca/l129 0 2024-09-10T09:36:34.178 INFO:tasks.workunit.client.1.smithi135.stdout:2/750: dread df/fb1 [0,4194304] 0 2024-09-10T09:36:34.179 INFO:tasks.workunit.client.1.smithi135.stdout:8/712: creat d1/d15/d16/d33/fe6 x:0 0 0 2024-09-10T09:36:34.180 INFO:tasks.workunit.client.1.smithi135.stdout:8/713: dread d1/d27/f40 [0,4194304] 0 2024-09-10T09:36:34.180 INFO:tasks.workunit.client.1.smithi135.stdout:8/714: fdatasync d1/d15/d24/f35 0 2024-09-10T09:36:34.181 INFO:tasks.workunit.client.1.smithi135.stdout:1/858: dwrite d1d/d20/d3c/f9f [0,4194304] 0 2024-09-10T09:36:34.183 INFO:tasks.workunit.client.1.smithi135.stdout:0/819: dwrite d8/d80/d10a/d73/fb7 [0,4194304] 0 2024-09-10T09:36:34.183 INFO:tasks.workunit.client.1.smithi135.stdout:4/995: dread d1/db/da0/ff0 [0,4194304] 0 2024-09-10T09:36:34.183 INFO:tasks.workunit.client.1.smithi135.stdout:3/618: rmdir d4/d5/dc/d8b 39 2024-09-10T09:36:34.183 INFO:tasks.workunit.client.1.smithi135.stdout:3/619: chown d4/d5/db/dd/c12 61124 1 2024-09-10T09:36:34.184 INFO:tasks.workunit.client.1.smithi135.stdout:7/686: dwrite d2/d15/d4a/d36/d84/f91 [0,4194304] 0 2024-09-10T09:36:34.185 INFO:tasks.workunit.client.1.smithi135.stdout:5/836: rename d3/f5 to d3/dc/d69/d72/f12a 0 2024-09-10T09:36:34.187 INFO:tasks.workunit.client.1.smithi135.stdout:2/751: truncate f6 3798049 0 2024-09-10T09:36:34.188 INFO:tasks.workunit.client.1.smithi135.stdout:8/715: symlink d1/d27/d3d/le7 0 2024-09-10T09:36:34.192 INFO:tasks.workunit.client.1.smithi135.stdout:1/859: symlink d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/l113 0 2024-09-10T09:36:34.199 INFO:tasks.workunit.client.1.smithi135.stdout:4/996: mkdir d1/db/d9/d55/d137 0 2024-09-10T09:36:34.199 INFO:tasks.workunit.client.1.smithi135.stdout:4/997: creat d1/de/d16/d12a/d6d/dee/f138 x:0 0 0 2024-09-10T09:36:34.201 INFO:tasks.workunit.client.1.smithi135.stdout:3/620: link d4/d5/dc/f49 d4/d5/d76/fb2 0 2024-09-10T09:36:34.201 INFO:tasks.workunit.client.1.smithi135.stdout:3/621: stat d4/d55/f60 0 2024-09-10T09:36:34.201 INFO:tasks.workunit.client.1.smithi135.stdout:3/622: truncate d4/d5/db/d44/d68/fa5 370750 0 2024-09-10T09:36:34.203 INFO:tasks.workunit.client.1.smithi135.stdout:7/687: symlink d2/d25/d5d/dbd/ld4 0 2024-09-10T09:36:34.208 INFO:tasks.workunit.client.1.smithi135.stdout:5/837: unlink d3/dc/f8c 0 2024-09-10T09:36:34.208 INFO:tasks.workunit.client.1.smithi135.stdout:5/838: write d3/dc/dba/d48/f117 [484920,103070] 0 2024-09-10T09:36:34.208 INFO:tasks.workunit.client.1.smithi135.stdout:5/839: fdatasync d3/dc/dba/f8b 0 2024-09-10T09:36:34.209 INFO:tasks.workunit.client.1.smithi135.stdout:2/752: mknod df/d13/d4f/cec 0 2024-09-10T09:36:34.209 INFO:tasks.workunit.client.1.smithi135.stdout:2/753: write df/d1b/d23/d98/d5f/d2c/d7d/fce [2792233,95788] 0 2024-09-10T09:36:34.212 INFO:tasks.workunit.client.1.smithi135.stdout:0/820: dwrite d8/dd/d4a/d50/fac [0,4194304] 0 2024-09-10T09:36:34.212 INFO:tasks.workunit.client.1.smithi135.stdout:0/821: write d8/dd/d11/f1f [3128723,73537] 0 2024-09-10T09:36:34.213 INFO:tasks.workunit.client.1.smithi135.stdout:0/822: truncate d8/dd/d18/f1a 2388085 0 2024-09-10T09:36:34.213 INFO:tasks.workunit.client.1.smithi135.stdout:8/716: rmdir d1/d8f/ddf 0 2024-09-10T09:36:34.213 INFO:tasks.workunit.client.1.smithi135.stdout:8/717: readlink d1/d15/d49/d69/la8 0 2024-09-10T09:36:34.215 INFO:tasks.workunit.client.1.smithi135.stdout:1/860: mkdir d1d/d20/d9a/dff/d109/d114 0 2024-09-10T09:36:34.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/823: dread d8/d80/d10a/f5d [0,4194304] 0 2024-09-10T09:36:34.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/824: write d8/d80/d10a/d73/d7f/d8c/f10c [440860,37775] 0 2024-09-10T09:36:34.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/825: chown d8/dd/d33/ldc 25 1 2024-09-10T09:36:34.220 INFO:tasks.workunit.client.1.smithi135.stdout:0/826: chown d8/d80/d10a/l87 255 1 2024-09-10T09:36:34.224 INFO:tasks.workunit.client.1.smithi135.stdout:4/998: link d1/db/d9/d55/d76/ffa d1/d85/d89/f139 0 2024-09-10T09:36:34.225 INFO:tasks.workunit.client.1.smithi135.stdout:3/623: getdents d4/d55/d5d 0 2024-09-10T09:36:34.225 INFO:tasks.workunit.client.1.smithi135.stdout:3/624: truncate d4/d5/db/d36/d6a/f82 372701 0 2024-09-10T09:36:34.227 INFO:tasks.workunit.client.1.smithi135.stdout:5/840: mkdir d3/d99/d12b 0 2024-09-10T09:36:34.228 INFO:tasks.workunit.client.1.smithi135.stdout:2/754: fdatasync df/d1b/d23/d98/f9b 0 2024-09-10T09:36:34.230 INFO:tasks.workunit.client.1.smithi135.stdout:5/841: dread d3/dc/d69/d65/d6c/ff5 [0,4194304] 0 2024-09-10T09:36:34.233 INFO:tasks.workunit.client.1.smithi135.stdout:8/718: creat d1/d15/d16/d33/d45/d70/fe8 x:0 0 0 2024-09-10T09:36:34.233 INFO:tasks.workunit.client.1.smithi135.stdout:2/755: dread df/d13/d4f/d95/fc1 [0,4194304] 0 2024-09-10T09:36:34.233 INFO:tasks.workunit.client.1.smithi135.stdout:2/756: dread - df/d1b/d70/fda zero size 2024-09-10T09:36:34.236 INFO:tasks.workunit.client.1.smithi135.stdout:1/861: mknod d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/c115 0 2024-09-10T09:36:34.236 INFO:tasks.workunit.client.1.smithi135.stdout:1/862: readlink d1d/d20/d52/d8a/dc2/dca/d37/l41 0 2024-09-10T09:36:34.236 INFO:tasks.workunit.client.1.smithi135.stdout:1/863: write d1d/f27 [1819402,61362] 0 2024-09-10T09:36:34.238 INFO:tasks.workunit.client.1.smithi135.stdout:0/827: symlink d8/de/d105/l118 0 2024-09-10T09:36:34.241 INFO:tasks.workunit.client.1.smithi135.stdout:4/999: symlink d1/d85/l13a 0 2024-09-10T09:36:34.242 INFO:tasks.workunit.client.1.smithi135.stdout:5/842: dread d3/dc/dba/d48/d57/f5e [0,4194304] 0 2024-09-10T09:36:34.242 INFO:tasks.workunit.client.1.smithi135.stdout:5/843: fdatasync d3/dc/dba/d48/d57/dc4/ff6 0 2024-09-10T09:36:34.245 INFO:tasks.workunit.client.1.smithi135.stdout:3/625: creat d4/d5/dc/d8b/da6/fb3 x:0 0 0 2024-09-10T09:36:34.248 INFO:tasks.workunit.client.1.smithi135.stdout:7/688: mknod d2/d15/d5c/d62/cd5 0 2024-09-10T09:36:34.251 INFO:tasks.workunit.client.1.smithi135.stdout:2/757: creat df/d1b/db7/fed x:0 0 0 2024-09-10T09:36:34.255 INFO:tasks.workunit.client.1.smithi135.stdout:0/828: getdents d8/dd/d1e 0 2024-09-10T09:36:34.261 INFO:tasks.workunit.client.1.smithi135.stdout:0/829: creat d8/d80/d10a/d73/d7f/d8c/da8/f119 x:0 0 0 2024-09-10T09:36:34.261 INFO:tasks.workunit.client.1.smithi135.stdout:0/830: chown d8/dd/d18/d3d/dc3/d8f/daa/fcc 0 1 2024-09-10T09:36:34.263 INFO:tasks.workunit.client.1.smithi135.stdout:3/626: getdents d4/d5/db/d44 0 2024-09-10T09:36:34.263 INFO:tasks.workunit.client.1.smithi135.stdout:3/627: fsync d4/f32 0 2024-09-10T09:36:34.263 INFO:tasks.workunit.client.1.smithi135.stdout:3/628: getdents d4/d5/db/d44 0 2024-09-10T09:36:34.264 INFO:tasks.workunit.client.1.smithi135.stdout:0/831: creat d8/de/d105/f11a x:0 0 0 2024-09-10T09:36:34.264 INFO:tasks.workunit.client.1.smithi135.stdout:0/832: write d8/de/f68 [154743,113506] 0 2024-09-10T09:36:34.265 INFO:tasks.workunit.client.1.smithi135.stdout:3/629: mkdir d4/d55/d5d/d5b/db4 0 2024-09-10T09:36:34.268 INFO:tasks.workunit.client.1.smithi135.stdout:0/833: stat d8/dd/d4a/d50/d54/d5f/d4b/la5 0 2024-09-10T09:36:34.268 INFO:tasks.workunit.client.1.smithi135.stdout:0/834: readlink d8/dd/d11/l25 0 2024-09-10T09:36:34.272 INFO:tasks.workunit.client.1.smithi135.stdout:3/630: dread d4/d5/db/f2f [0,4194304] 0 2024-09-10T09:36:34.272 INFO:tasks.workunit.client.1.smithi135.stdout:0/835: dread d8/dd/d11/d90/dc4/fdb [0,4194304] 0 2024-09-10T09:36:34.272 INFO:tasks.workunit.client.1.smithi135.stdout:0/836: chown d8/dd/d18/d3d/dc3/d61/l102 3152 1 2024-09-10T09:36:34.273 INFO:tasks.workunit.client.1.smithi135.stdout:8/719: dwrite d1/d27/d3d/d94/fc0 [0,4194304] 0 2024-09-10T09:36:34.273 INFO:tasks.workunit.client.1.smithi135.stdout:1/864: dwrite d1d/f58 [0,4194304] 0 2024-09-10T09:36:34.274 INFO:tasks.workunit.client.1.smithi135.stdout:7/689: write d2/d25/d5d/d83/fca [356241,66414] 0 2024-09-10T09:36:34.275 INFO:tasks.workunit.client.1.smithi135.stdout:7/690: rename d2/d15/d39/d9f/db2/dcc to d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71/dd6 22 2024-09-10T09:36:34.276 INFO:tasks.workunit.client.1.smithi135.stdout:3/631: symlink d4/d5/db/d36/lb5 0 2024-09-10T09:36:34.276 INFO:tasks.workunit.client.1.smithi135.stdout:3/632: write d4/d5/db/d44/d68/f9f [934143,23279] 0 2024-09-10T09:36:34.278 INFO:tasks.workunit.client.1.smithi135.stdout:8/720: write d1/f14 [2641124,93588] 0 2024-09-10T09:36:34.278 INFO:tasks.workunit.client.1.smithi135.stdout:8/721: write d1/d15/d16/d33/d45/d6f/fac [482556,58759] 0 2024-09-10T09:36:34.278 INFO:tasks.workunit.client.1.smithi135.stdout:8/722: readlink d1/d15/d24/l8a 0 2024-09-10T09:36:34.279 INFO:tasks.workunit.client.1.smithi135.stdout:8/723: chown d1/d15/d16/d33/d39/l62 5398326 1 2024-09-10T09:36:34.279 INFO:tasks.workunit.client.1.smithi135.stdout:8/724: write d1/d15/d49/f81 [1554606,59587] 0 2024-09-10T09:36:34.279 INFO:tasks.workunit.client.1.smithi135.stdout:8/725: write d1/d15/d49/fbd [4162302,68506] 0 2024-09-10T09:36:34.279 INFO:tasks.workunit.client.1.smithi135.stdout:8/726: read d1/d8f/fdb [90660,89763] 0 2024-09-10T09:36:34.279 INFO:tasks.workunit.client.1.smithi135.stdout:2/758: dwrite df/f17 [0,4194304] 0 2024-09-10T09:36:34.279 INFO:tasks.workunit.client.1.smithi135.stdout:5/844: dwrite d3/dc/dba/d48/fbc [0,4194304] 0 2024-09-10T09:36:34.290 INFO:tasks.workunit.client.1.smithi135.stdout:1/865: rmdir d1d/d20/d9a/dff/d109 39 2024-09-10T09:36:34.296 INFO:tasks.workunit.client.1.smithi135.stdout:3/633: write d4/d5/dc/d8b/fac [1495956,119694] 0 2024-09-10T09:36:34.303 INFO:tasks.workunit.client.1.smithi135.stdout:8/727: dwrite d1/f23 [0,4194304] 0 2024-09-10T09:36:34.303 INFO:tasks.workunit.client.1.smithi135.stdout:8/728: chown d1/d15/d49/d7c/lbf 10 1 2024-09-10T09:36:34.312 INFO:tasks.workunit.client.1.smithi135.stdout:5/845: dwrite d3/dc/dba/d88/fc1 [0,4194304] 0 2024-09-10T09:36:34.312 INFO:tasks.workunit.client.1.smithi135.stdout:5/846: getdents d3/dc/dba/d93 0 2024-09-10T09:36:34.314 INFO:tasks.workunit.client.1.smithi135.stdout:1/866: dwrite d1d/d20/d52/d8a/f101 [0,4194304] 0 2024-09-10T09:36:34.314 INFO:tasks.workunit.client.1.smithi135.stdout:1/867: chown d1d/d20/d52/d8a/dc2/dca/d2b/d4c/dea/fee 3631 1 2024-09-10T09:36:34.315 INFO:tasks.workunit.client.1.smithi135.stdout:8/729: read d1/d15/d16/d33/d45/f50 [123312,58843] 0 2024-09-10T09:36:34.320 INFO:tasks.workunit.client.1.smithi135.stdout:7/691: getdents d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b 0 2024-09-10T09:36:34.320 INFO:tasks.workunit.client.1.smithi135.stdout:7/692: write d2/d15/d39/d9f/db2/dcc/d49/d60/f22 [680553,58049] 0 2024-09-10T09:36:34.320 INFO:tasks.workunit.client.1.smithi135.stdout:7/693: fsync d2/d25/f3f 0 2024-09-10T09:36:34.326 INFO:tasks.workunit.client.1.smithi135.stdout:0/837: mknod d8/dd/d11/d90/c11b 0 2024-09-10T09:36:34.326 INFO:tasks.workunit.client.1.smithi135.stdout:0/838: write d8/dd/d11/d17/f42 [891030,11112] 0 2024-09-10T09:36:34.326 INFO:tasks.workunit.client.1.smithi135.stdout:0/839: fdatasync d8/dd/d11/f1f 0 2024-09-10T09:36:34.331 INFO:tasks.workunit.client.1.smithi135.stdout:3/634: symlink d4/d5/db/dd/lb6 0 2024-09-10T09:36:34.332 INFO:tasks.workunit.client.1.smithi135.stdout:1/868: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/fd5 [0,4194304] 0 2024-09-10T09:36:34.334 INFO:tasks.workunit.client.1.smithi135.stdout:1/869: dread d1d/d28/d4b/d53/f8d [0,4194304] 0 2024-09-10T09:36:34.336 INFO:tasks.workunit.client.1.smithi135.stdout:5/847: chown d3/d91/db5/c32 1961568058 1 2024-09-10T09:36:34.345 INFO:tasks.workunit.client.1.smithi135.stdout:8/730: rmdir d1/d15/d16/d96/de5 0 2024-09-10T09:36:34.345 INFO:tasks.workunit.client.1.smithi135.stdout:8/731: write d1/d15/d16/f75 [1952264,116313] 0 2024-09-10T09:36:34.345 INFO:tasks.workunit.client.1.smithi135.stdout:8/732: creat d1/d15/fe9 x:0 0 0 2024-09-10T09:36:34.347 INFO:tasks.workunit.client.1.smithi135.stdout:7/694: rename d2/d15/d4a/c19 to d2/d25/d5d/d83/cd7 0 2024-09-10T09:36:34.348 INFO:tasks.workunit.client.1.smithi135.stdout:2/759: mkdir df/d1b/d23/d98/dee 0 2024-09-10T09:36:34.349 INFO:tasks.workunit.client.1.smithi135.stdout:3/635: truncate d4/d5/db/d36/d43/f6e 662216 0 2024-09-10T09:36:34.349 INFO:tasks.workunit.client.1.smithi135.stdout:3/636: chown d4/d5/d56/l83 3200 1 2024-09-10T09:36:34.358 INFO:tasks.workunit.client.1.smithi135.stdout:5/848: rename d3/d71/d61/lb7 to d3/dc/d69/d65/de7/l12c 0 2024-09-10T09:36:34.358 INFO:tasks.workunit.client.1.smithi135.stdout:5/849: readlink d3/dc/d16/l2e 0 2024-09-10T09:36:34.358 INFO:tasks.workunit.client.1.smithi135.stdout:7/695: mknod d2/d15/d39/d9f/db8/cd8 0 2024-09-10T09:36:34.359 INFO:tasks.workunit.client.1.smithi135.stdout:0/840: dwrite d8/dd/d4a/d50/d67/fbd [4194304,4194304] 0 2024-09-10T09:36:34.359 INFO:tasks.workunit.client.1.smithi135.stdout:0/841: chown d8/d80/d10a/fc0 1068810355 1 2024-09-10T09:36:34.359 INFO:tasks.workunit.client.1.smithi135.stdout:1/870: dwrite d1d/d20/d52/d8a/dc2/dca/d37/fc9 [0,4194304] 0 2024-09-10T09:36:34.362 INFO:tasks.workunit.client.1.smithi135.stdout:8/733: dread d1/d15/d24/f7e [0,4194304] 0 2024-09-10T09:36:34.362 INFO:tasks.workunit.client.1.smithi135.stdout:8/734: truncate d1/d15/d16/d33/d45/f87 665092 0 2024-09-10T09:36:34.363 INFO:tasks.workunit.client.1.smithi135.stdout:8/735: write d1/d15/d16/f29 [8656974,99530] 0 2024-09-10T09:36:34.363 INFO:tasks.workunit.client.1.smithi135.stdout:8/736: write d1/d15/d16/d33/d45/d6f/f92 [3425638,23789] 0 2024-09-10T09:36:34.363 INFO:tasks.workunit.client.1.smithi135.stdout:8/737: chown d1/d15/d16/d33/d45/d6f/f92 710 1 2024-09-10T09:36:34.363 INFO:tasks.workunit.client.1.smithi135.stdout:7/696: truncate d2/d25/d5d/f4f 3137742 0 2024-09-10T09:36:34.363 INFO:tasks.workunit.client.1.smithi135.stdout:7/697: chown d2/d15/c23 243638385 1 2024-09-10T09:36:34.368 INFO:tasks.workunit.client.1.smithi135.stdout:5/850: write d3/d81/d8d/fa8 [728854,12962] 0 2024-09-10T09:36:34.368 INFO:tasks.workunit.client.1.smithi135.stdout:5/851: chown d3/d81 496 1 2024-09-10T09:36:34.368 INFO:tasks.workunit.client.1.smithi135.stdout:0/842: truncate d8/de/d2e/f91 1689175 0 2024-09-10T09:36:34.369 INFO:tasks.workunit.client.1.smithi135.stdout:0/843: write d8/dd/d4a/d50/d54/d5f/f7d [14102,51878] 0 2024-09-10T09:36:34.369 INFO:tasks.workunit.client.1.smithi135.stdout:0/844: truncate d8/d80/d10a/d73/d7f/d8c/da8/f106 1025554 0 2024-09-10T09:36:34.370 INFO:tasks.workunit.client.1.smithi135.stdout:1/871: getdents d1d/d71/dfb 0 2024-09-10T09:36:34.373 INFO:tasks.workunit.client.1.smithi135.stdout:3/637: dwrite d4/d5/db/dd/f5f [0,4194304] 0 2024-09-10T09:36:34.374 INFO:tasks.workunit.client.1.smithi135.stdout:7/698: truncate d2/d15/d39/d9f/db2/dcc/f44 230501 0 2024-09-10T09:36:34.376 INFO:tasks.workunit.client.1.smithi135.stdout:2/760: dwrite df/d13/d52/fc0 [0,4194304] 0 2024-09-10T09:36:34.376 INFO:tasks.workunit.client.1.smithi135.stdout:2/761: chown df/d15 25733417 1 2024-09-10T09:36:34.376 INFO:tasks.workunit.client.1.smithi135.stdout:8/738: read d1/f3 [2363599,25529] 0 2024-09-10T09:36:34.382 INFO:tasks.workunit.client.1.smithi135.stdout:5/852: symlink d3/dc/d69/d72/dec/l12d 0 2024-09-10T09:36:34.382 INFO:tasks.workunit.client.1.smithi135.stdout:5/853: fdatasync d3/dc/dba/d88/fc1 0 2024-09-10T09:36:34.384 INFO:tasks.workunit.client.1.smithi135.stdout:0/845: mkdir d8/dd/d4a/d50/d54/d5f/d11c 0 2024-09-10T09:36:34.388 INFO:tasks.workunit.client.1.smithi135.stdout:1/872: mknod d1d/d20/d52/d8a/dc2/dca/d37/d10b/c116 0 2024-09-10T09:36:34.388 INFO:tasks.workunit.client.1.smithi135.stdout:1/873: chown d1d/d20/d6c 201232 1 2024-09-10T09:36:34.388 INFO:tasks.workunit.client.1.smithi135.stdout:1/874: readlink d1d/d20/d52/l10c 0 2024-09-10T09:36:34.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/699: creat d2/d25/da8/fd9 x:0 0 0 2024-09-10T09:36:34.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/700: creat d2/d15/d5c/d62/da5/fda x:0 0 0 2024-09-10T09:36:34.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/701: getdents d2/d25/daa 0 2024-09-10T09:36:34.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/702: chown d2/d25/d9d 0 1 2024-09-10T09:36:34.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/703: dread - d2/d15/d39/d9f/db2/dcc/fc6 zero size 2024-09-10T09:36:34.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/704: stat d2/d15/d39/d9f/db8/cd8 0 2024-09-10T09:36:34.392 INFO:tasks.workunit.client.1.smithi135.stdout:7/705: dread d2/d15/d39/d9f/db2/dcc/d49/d60/f75 [0,4194304] 0 2024-09-10T09:36:34.449 INFO:tasks.workunit.client.1.smithi135.stdout:2/762: symlink df/d1b/d23/d98/d5f/d2c/d7d/d8c/lef 0 2024-09-10T09:36:34.450 INFO:tasks.workunit.client.1.smithi135.stdout:2/763: fdatasync df/d1b/d31/f86 0 2024-09-10T09:36:34.450 INFO:tasks.workunit.client.1.smithi135.stdout:8/739: mknod d1/d15/d16/d99/da9/cea 0 2024-09-10T09:36:34.451 INFO:tasks.workunit.client.1.smithi135.stdout:5/854: symlink d3/dc/dba/dbf/l12e 0 2024-09-10T09:36:34.457 INFO:tasks.workunit.client.1.smithi135.stdout:5/855: dread d3/d81/d8d/fa8 [0,4194304] 0 2024-09-10T09:36:34.460 INFO:tasks.workunit.client.1.smithi135.stdout:1/875: mknod d1d/d71/d9e/df6/c117 0 2024-09-10T09:36:34.460 INFO:tasks.workunit.client.1.smithi135.stdout:1/876: truncate d1d/d20/d52/d8a/dc2/dca/fb9 333811 0 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: Migrating agent root cert to cert store 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: Migrating agent root key to cert store 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: Checking for cert/key for grafana.smithi079 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: Migrating grafana.smithi079 cert to cert store 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: Migrating grafana.smithi079 key to cert store 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: mgrmap e22: smithi135.lbhjof(active, since 1.01284s) 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: pgmap v3: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-09-10T09:36:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:34 smithi079 ceph-mon[27592]: Deploying cephadm binary to smithi079 2024-09-10T09:36:34.462 INFO:tasks.workunit.client.1.smithi135.stdout:7/706: getdents d2/d25 0 2024-09-10T09:36:34.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: Migrating agent root cert to cert store 2024-09-10T09:36:34.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: Migrating agent root key to cert store 2024-09-10T09:36:34.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: Checking for cert/key for grafana.smithi079 2024-09-10T09:36:34.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: Migrating grafana.smithi079 cert to cert store 2024-09-10T09:36:34.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: Migrating grafana.smithi079 key to cert store 2024-09-10T09:36:34.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: mgrmap e22: smithi135.lbhjof(active, since 1.01284s) 2024-09-10T09:36:34.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: pgmap v3: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-09-10T09:36:34.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:34 smithi135 ceph-mon[33411]: Deploying cephadm binary to smithi079 2024-09-10T09:36:34.485 INFO:tasks.workunit.client.1.smithi135.stdout:5/856: dwrite d3/dc/dba/d48/d57/f67 [4194304,4194304] 0 2024-09-10T09:36:34.491 INFO:tasks.workunit.client.1.smithi135.stdout:0/846: dwrite d8/dd/d11/d90/fd8 [0,4194304] 0 2024-09-10T09:36:34.498 INFO:tasks.workunit.client.1.smithi135.stdout:1/877: dwrite d1d/d20/f77 [0,4194304] 0 2024-09-10T09:36:34.498 INFO:tasks.workunit.client.1.smithi135.stdout:7/707: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f86 [0,4194304] 0 2024-09-10T09:36:34.532 INFO:tasks.workunit.client.1.smithi135.stdout:9/846: sync 2024-09-10T09:36:34.591 INFO:tasks.workunit.client.1.smithi135.stdout:2/764: unlink df/d13/d4f/d95/fc4 0 2024-09-10T09:36:34.593 INFO:tasks.workunit.client.1.smithi135.stdout:8/740: truncate d1/f3 4113552 0 2024-09-10T09:36:34.604 INFO:tasks.workunit.client.1.smithi135.stdout:0/847: mkdir d8/dd/db0/d11d 0 2024-09-10T09:36:34.607 INFO:tasks.workunit.client.1.smithi135.stdout:1/878: rmdir d1d/d20/d42/dd3 39 2024-09-10T09:36:34.608 INFO:tasks.workunit.client.1.smithi135.stdout:5/857: rename d3/d44/f30 to d3/dc/dba/d48/d57/da3/d10f/f12f 0 2024-09-10T09:36:34.610 INFO:tasks.workunit.client.1.smithi135.stdout:8/741: dwrite d1/d15/d16/d33/d45/d70/fe8 [0,4194304] 0 2024-09-10T09:36:34.611 INFO:tasks.workunit.client.1.smithi135.stdout:7/708: creat d2/d15/d39/d9f/db2/dcc/d49/d60/d16/fdb x:0 0 0 2024-09-10T09:36:34.611 INFO:tasks.workunit.client.1.smithi135.stdout:7/709: chown d2/d15/d39/d9f/db2/dcc/d49/d60/f22 370 1 2024-09-10T09:36:34.611 INFO:tasks.workunit.client.1.smithi135.stdout:7/710: chown d2/d15/d5c/d62/da5/d5e/lbe 125943 1 2024-09-10T09:36:34.622 INFO:tasks.workunit.client.1.smithi135.stdout:9/847: link de/df/d1d/d1e/d52/fd9 de/f117 0 2024-09-10T09:36:34.623 INFO:tasks.workunit.client.1.smithi135.stdout:9/848: dread - de/df/d1d/d23/d25/d28/d7b/f108 zero size 2024-09-10T09:36:34.623 INFO:tasks.workunit.client.1.smithi135.stdout:9/849: truncate de/df/d1d/d23/d25/f5b 1280156 0 2024-09-10T09:36:34.623 INFO:tasks.workunit.client.1.smithi135.stdout:9/850: write de/df/d1d/fed [672908,64728] 0 2024-09-10T09:36:34.625 INFO:tasks.workunit.client.1.smithi135.stdout:2/765: creat df/d1b/d23/d98/d5f/d3d/d87/db0/ff0 x:0 0 0 2024-09-10T09:36:34.627 INFO:tasks.workunit.client.1.smithi135.stdout:5/858: creat d3/dc/d16/f130 x:0 0 0 2024-09-10T09:36:34.630 INFO:tasks.workunit.client.1.smithi135.stdout:8/742: creat d1/d27/d3d/dd3/feb x:0 0 0 2024-09-10T09:36:34.633 INFO:tasks.workunit.client.1.smithi135.stdout:7/711: link d2/d15/d39/d9f/db2/dcc/d49/fa0 d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/fdc 0 2024-09-10T09:36:34.633 INFO:tasks.workunit.client.1.smithi135.stdout:7/712: write d2/d15/d39/d53/fbc [844085,120298] 0 2024-09-10T09:36:34.634 INFO:tasks.workunit.client.1.smithi135.stdout:9/851: symlink de/df/d1d/d23/d25/d28/l118 0 2024-09-10T09:36:34.635 INFO:tasks.workunit.client.1.smithi135.stdout:9/852: read de/df/d1d/d23/f57 [1081096,48552] 0 2024-09-10T09:36:34.636 INFO:tasks.workunit.client.1.smithi135.stdout:5/859: creat d3/dc/d69/d72/dec/f131 x:0 0 0 2024-09-10T09:36:34.637 INFO:tasks.workunit.client.1.smithi135.stdout:7/713: truncate d2/d15/f1c 831663 0 2024-09-10T09:36:34.638 INFO:tasks.workunit.client.1.smithi135.stdout:0/848: dwrite d8/dd/d18/d3d/dc3/f98 [0,4194304] 0 2024-09-10T09:36:34.638 INFO:tasks.workunit.client.1.smithi135.stdout:0/849: chown d8/dd/d4a/d50/l6d 877201 1 2024-09-10T09:36:34.639 INFO:tasks.workunit.client.1.smithi135.stdout:1/879: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/f104 [0,4194304] 0 2024-09-10T09:36:34.639 INFO:tasks.workunit.client.1.smithi135.stdout:1/880: stat d1d/d20/d52/d8a/dc2/dca/d37/db8/fbc 0 2024-09-10T09:36:34.640 INFO:tasks.workunit.client.1.smithi135.stdout:9/853: creat de/df/d1d/d23/d25/d78/f119 x:0 0 0 2024-09-10T09:36:34.640 INFO:tasks.workunit.client.1.smithi135.stdout:0/850: read d8/dd/d4a/f84 [202575,111216] 0 2024-09-10T09:36:34.641 INFO:tasks.workunit.client.1.smithi135.stdout:5/860: rmdir d3/dc/dba/d4e/d87/d11d 0 2024-09-10T09:36:34.642 INFO:tasks.workunit.client.1.smithi135.stdout:5/861: write d3/dc/dba/d48/d57/da3/db1/ff2 [132469,54289] 0 2024-09-10T09:36:34.642 INFO:tasks.workunit.client.1.smithi135.stdout:5/862: readlink d3/dc/dba/d48/d57/da3/laf 0 2024-09-10T09:36:34.642 INFO:tasks.workunit.client.1.smithi135.stdout:5/863: creat d3/dc/dba/d48/d57/dc4/f132 x:0 0 0 2024-09-10T09:36:34.644 INFO:tasks.workunit.client.1.smithi135.stdout:7/714: unlink d2/d15/d39/d9f/db2/dcc/d49/d60/c17 0 2024-09-10T09:36:34.645 INFO:tasks.workunit.client.1.smithi135.stdout:8/743: write d1/d15/d16/d96/f9f [1118702,15295] 0 2024-09-10T09:36:34.645 INFO:tasks.workunit.client.1.smithi135.stdout:5/864: read d3/dc/dba/d4e/dd0/f96 [659646,93048] 0 2024-09-10T09:36:34.645 INFO:tasks.workunit.client.1.smithi135.stdout:7/715: read d2/d25/d9d/fa7 [79953,46895] 0 2024-09-10T09:36:34.648 INFO:tasks.workunit.client.1.smithi135.stdout:0/851: mkdir d8/de/d2e/d11e 0 2024-09-10T09:36:34.652 INFO:tasks.workunit.client.1.smithi135.stdout:5/865: creat d3/d81/d120/f133 x:0 0 0 2024-09-10T09:36:34.655 INFO:tasks.workunit.client.1.smithi135.stdout:1/881: dread d1d/f22 [4194304,4194304] 0 2024-09-10T09:36:34.657 INFO:tasks.workunit.client.1.smithi135.stdout:5/866: link d3/dc/dba/f6a d3/dc/dba/dbf/f134 0 2024-09-10T09:36:34.657 INFO:tasks.workunit.client.1.smithi135.stdout:5/867: chown d3/d71/d61/ffb 40864223 1 2024-09-10T09:36:34.657 INFO:tasks.workunit.client.1.smithi135.stdout:5/868: chown d3/dc/d69/d72/c89 58491463 1 2024-09-10T09:36:34.657 INFO:tasks.workunit.client.1.smithi135.stdout:7/716: dread d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f7a [0,4194304] 0 2024-09-10T09:36:34.659 INFO:tasks.workunit.client.1.smithi135.stdout:5/869: truncate d3/dc/d69/d65/d6c/ff8 508620 0 2024-09-10T09:36:34.659 INFO:tasks.workunit.client.1.smithi135.stdout:5/870: truncate d3/d81/d120/f133 283258 0 2024-09-10T09:36:34.663 INFO:tasks.workunit.client.1.smithi135.stdout:5/871: symlink d3/d71/l135 0 2024-09-10T09:36:34.663 INFO:tasks.workunit.client.1.smithi135.stdout:5/872: write d3/dc/f37 [8710613,96160] 0 2024-09-10T09:36:34.663 INFO:tasks.workunit.client.1.smithi135.stdout:5/873: fdatasync d3/dc/dba/f68 0 2024-09-10T09:36:34.668 INFO:tasks.workunit.client.1.smithi135.stdout:0/852: write d8/dd/d4a/d50/d67/fd6 [1245789,97969] 0 2024-09-10T09:36:34.675 INFO:tasks.workunit.client.1.smithi135.stdout:9/854: dwrite de/df/dac/db7/ff7 [0,4194304] 0 2024-09-10T09:36:34.675 INFO:tasks.workunit.client.1.smithi135.stdout:9/855: read de/df/d1d/d23/d25/d28/d4e/fdf [119406,122933] 0 2024-09-10T09:36:34.684 INFO:tasks.workunit.client.1.smithi135.stdout:8/744: dwrite d1/f20 [0,4194304] 0 2024-09-10T09:36:34.699 INFO:tasks.workunit.client.1.smithi135.stdout:2/766: rename df/d1b/d23/d98/f3a to df/d13/ff1 0 2024-09-10T09:36:34.702 INFO:tasks.workunit.client.1.smithi135.stdout:8/745: read d1/d15/d49/fc8 [2684476,875] 0 2024-09-10T09:36:34.702 INFO:tasks.workunit.client.1.smithi135.stdout:8/746: read d1/d15/d16/d33/d39/f7d [1447962,40001] 0 2024-09-10T09:36:34.702 INFO:tasks.workunit.client.1.smithi135.stdout:9/856: dwrite de/df/d1d/d23/d25/d28/d7b/f108 [0,4194304] 0 2024-09-10T09:36:34.702 INFO:tasks.workunit.client.1.smithi135.stdout:9/857: stat de/df/dac/l104 0 2024-09-10T09:36:34.703 INFO:tasks.workunit.client.1.smithi135.stdout:1/882: dwrite d1d/d71/d9e/fa9 [0,4194304] 0 2024-09-10T09:36:34.703 INFO:tasks.workunit.client.1.smithi135.stdout:8/747: rmdir d1/d8f/da2 39 2024-09-10T09:36:34.703 INFO:tasks.workunit.client.1.smithi135.stdout:8/748: chown d1/d15/l34 60 1 2024-09-10T09:36:34.705 INFO:tasks.workunit.client.1.smithi135.stdout:7/717: dwrite d2/d25/d5d/d83/f89 [0,4194304] 0 2024-09-10T09:36:34.706 INFO:tasks.workunit.client.1.smithi135.stdout:3/638: sync 2024-09-10T09:36:34.707 INFO:tasks.workunit.client.1.smithi135.stdout:3/639: write d4/d5/f39 [5145991,83400] 0 2024-09-10T09:36:34.707 INFO:tasks.workunit.client.1.smithi135.stdout:3/640: fdatasync d4/d5/f8c 0 2024-09-10T09:36:34.707 INFO:tasks.workunit.client.1.smithi135.stdout:0/853: dwrite d8/d80/d10a/d73/d7f/d8c/f10c [0,4194304] 0 2024-09-10T09:36:34.711 INFO:tasks.workunit.client.1.smithi135.stdout:9/858: link de/df/d1d/d1e/d3f/c103 de/df/d1d/d23/d25/d28/c11a 0 2024-09-10T09:36:34.712 INFO:tasks.workunit.client.1.smithi135.stdout:9/859: chown de/df/d1d/d23/d25/d28/c85 48438320 1 2024-09-10T09:36:34.715 INFO:tasks.workunit.client.1.smithi135.stdout:1/883: creat d1d/d20/d9a/dff/f118 x:0 0 0 2024-09-10T09:36:34.720 INFO:tasks.workunit.client.1.smithi135.stdout:8/749: rename d1/d15/d49/d7c/c65 to d1/d8f/cec 0 2024-09-10T09:36:34.727 INFO:tasks.workunit.client.1.smithi135.stdout:2/767: dwrite df/d1b/f3c [0,4194304] 0 2024-09-10T09:36:34.728 INFO:tasks.workunit.client.1.smithi135.stdout:9/860: dwrite de/df/d1d/d23/f8d [0,4194304] 0 2024-09-10T09:36:34.732 INFO:tasks.workunit.client.1.smithi135.stdout:7/718: symlink d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b/ldd 0 2024-09-10T09:36:34.741 INFO:tasks.workunit.client.1.smithi135.stdout:0/854: symlink d8/dd/d4a/d50/d54/d5f/l11f 0 2024-09-10T09:36:34.742 INFO:tasks.workunit.client.1.smithi135.stdout:7/719: dread d2/d15/f2d [0,4194304] 0 2024-09-10T09:36:34.742 INFO:tasks.workunit.client.1.smithi135.stdout:7/720: write d2/d15/d5c/d85/f9b [318161,65328] 0 2024-09-10T09:36:34.746 INFO:tasks.workunit.client.1.smithi135.stdout:1/884: truncate d1d/d20/d52/d8a/fc3 2172063 0 2024-09-10T09:36:34.749 INFO:tasks.workunit.client.1.smithi135.stdout:8/750: symlink d1/d15/d16/d99/da9/led 0 2024-09-10T09:36:34.752 INFO:tasks.workunit.client.1.smithi135.stdout:8/751: write d1/d15/f9d [2005498,14647] 0 2024-09-10T09:36:34.754 INFO:tasks.workunit.client.1.smithi135.stdout:2/768: link df/d13/c2d df/d1b/d23/d98/d5f/d3d/dd7/cf2 0 2024-09-10T09:36:34.759 INFO:tasks.workunit.client.1.smithi135.stdout:9/861: creat de/df/d1d/d1e/db5/d88/f11b x:0 0 0 2024-09-10T09:36:34.759 INFO:tasks.workunit.client.1.smithi135.stdout:9/862: chown de/df/c3b 52842 1 2024-09-10T09:36:34.760 INFO:tasks.workunit.client.1.smithi135.stdout:0/855: dwrite d8/dd/d11/ff3 [0,4194304] 0 2024-09-10T09:36:34.760 INFO:tasks.workunit.client.1.smithi135.stdout:0/856: dread - d8/d80/d10a/d73/dc5/ff2 zero size 2024-09-10T09:36:34.763 INFO:tasks.workunit.client.1.smithi135.stdout:7/721: creat d2/d15/d39/d9f/db2/dcc/d49/fde x:0 0 0 2024-09-10T09:36:34.763 INFO:tasks.workunit.client.1.smithi135.stdout:7/722: fsync d2/d25/f3f 0 2024-09-10T09:36:34.765 INFO:tasks.workunit.client.1.smithi135.stdout:1/885: mknod d1d/d20/d52/d8a/dc2/dca/d37/db8/c119 0 2024-09-10T09:36:34.765 INFO:tasks.workunit.client.1.smithi135.stdout:1/886: write d1d/d20/d3c/f9f [5228868,97461] 0 2024-09-10T09:36:34.765 INFO:tasks.workunit.client.1.smithi135.stdout:1/887: chown d1d/d28/f7c 44142 1 2024-09-10T09:36:34.768 INFO:tasks.workunit.client.1.smithi135.stdout:2/769: stat df/d1b/d23/d42/l56 0 2024-09-10T09:36:34.774 INFO:tasks.workunit.client.1.smithi135.stdout:9/863: symlink de/df/d7e/l11c 0 2024-09-10T09:36:34.782 INFO:tasks.workunit.client.1.smithi135.stdout:0/857: truncate d8/de/f68 3788667 0 2024-09-10T09:36:34.786 INFO:tasks.workunit.client.1.smithi135.stdout:2/770: symlink df/d13/d4f/d95/d97/d9a/lf3 0 2024-09-10T09:36:34.787 INFO:tasks.workunit.client.1.smithi135.stdout:9/864: creat de/df/d1d/d23/d25/d28/dbe/f11d x:0 0 0 2024-09-10T09:36:34.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/858: rename d8/dd/d1e to d8/de/d2e/d11e/d120 0 2024-09-10T09:36:34.789 INFO:tasks.workunit.client.1.smithi135.stdout:0/859: stat d8/dd/c72 0 2024-09-10T09:36:34.791 INFO:tasks.workunit.client.1.smithi135.stdout:7/723: truncate d2/f10 3370710 0 2024-09-10T09:36:34.792 INFO:tasks.workunit.client.1.smithi135.stdout:7/724: dread d2/d15/d39/d9f/db2/dcc/f44 [0,4194304] 0 2024-09-10T09:36:34.793 INFO:tasks.workunit.client.1.smithi135.stdout:2/771: mknod df/d15/cf4 0 2024-09-10T09:36:34.794 INFO:tasks.workunit.client.1.smithi135.stdout:9/865: write de/df/f10 [1605894,22769] 0 2024-09-10T09:36:34.794 INFO:tasks.workunit.client.1.smithi135.stdout:9/866: write de/df/dac/ffb [1479335,125292] 0 2024-09-10T09:36:34.795 INFO:tasks.workunit.client.1.smithi135.stdout:9/867: chown de/df/d1d/c55 17675 1 2024-09-10T09:36:34.795 INFO:tasks.workunit.client.1.smithi135.stdout:9/868: chown de/df/d1d/d23/d25/d28/l59 2 1 2024-09-10T09:36:34.795 INFO:tasks.workunit.client.1.smithi135.stdout:9/869: write de/df/d1d/d1e/d52/d86/ffe [947907,66919] 0 2024-09-10T09:36:34.796 INFO:tasks.workunit.client.1.smithi135.stdout:0/860: creat d8/dd/d11/d90/f121 x:0 0 0 2024-09-10T09:36:34.796 INFO:tasks.workunit.client.1.smithi135.stdout:0/861: truncate d8/d80/d10a/d73/d7f/d8c/da8/db9/dc1/ff4 666963 0 2024-09-10T09:36:34.802 INFO:tasks.workunit.client.1.smithi135.stdout:2/772: rename df/d1b/d23/fc3 to df/d1b/db7/ff5 0 2024-09-10T09:36:34.804 INFO:tasks.workunit.client.1.smithi135.stdout:0/862: creat d8/d80/d10a/d9c/de2/f122 x:0 0 0 2024-09-10T09:36:34.813 INFO:tasks.workunit.client.1.smithi135.stdout:7/725: dread d2/f1e [0,4194304] 0 2024-09-10T09:36:34.813 INFO:tasks.workunit.client.1.smithi135.stdout:7/726: write d2/d15/d5c/fc1 [214417,31655] 0 2024-09-10T09:36:34.813 INFO:tasks.workunit.client.1.smithi135.stdout:7/727: write d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71/f92 [2708626,83788] 0 2024-09-10T09:36:34.824 INFO:tasks.workunit.client.1.smithi135.stdout:7/728: mknod d2/d15/d5c/cdf 0 2024-09-10T09:36:34.825 INFO:tasks.workunit.client.1.smithi135.stdout:0/863: dwrite d8/dd/d18/d3d/dc3/d8f/fb5 [0,4194304] 0 2024-09-10T09:36:34.832 INFO:tasks.workunit.client.1.smithi135.stdout:7/729: read d2/d15/f1c [391981,114987] 0 2024-09-10T09:36:34.832 INFO:tasks.workunit.client.1.smithi135.stdout:7/730: stat d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/fdc 0 2024-09-10T09:36:34.836 INFO:tasks.workunit.client.1.smithi135.stdout:0/864: dread d8/dd/d11/ff3 [0,4194304] 0 2024-09-10T09:36:34.837 INFO:tasks.workunit.client.1.smithi135.stdout:7/731: creat d2/d15/d5c/fe0 x:0 0 0 2024-09-10T09:36:34.837 INFO:tasks.workunit.client.1.smithi135.stdout:0/865: dread d8/dd/d18/d3d/dc3/d61/fd0 [0,4194304] 0 2024-09-10T09:36:34.837 INFO:tasks.workunit.client.1.smithi135.stdout:0/866: write d8/dd/d18/d3d/dc3/d61/db1/f114 [94843,88877] 0 2024-09-10T09:36:34.854 INFO:tasks.workunit.client.1.smithi135.stdout:7/732: rename d2/d15/d5c/d62/da5/d5e/dac to d2/d15/d5c/d62/da5/d5e/d8c/de1 0 2024-09-10T09:36:34.854 INFO:tasks.workunit.client.1.smithi135.stdout:7/733: chown d2/d25/d5d/c82 0 1 2024-09-10T09:36:34.875 INFO:tasks.workunit.client.1.smithi135.stdout:0/867: rename d8/d80/d10a/d73/d7f/d8c to d8/d80/dfd/d123 0 2024-09-10T09:36:34.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/868: symlink d8/d80/d10a/d9c/de2/l124 0 2024-09-10T09:36:34.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/869: chown d8/d80/d10a/d73/dc8/cd4 247276 1 2024-09-10T09:36:34.887 INFO:tasks.workunit.client.1.smithi135.stdout:7/734: dwrite d2/d15/d5c/fc1 [0,4194304] 0 2024-09-10T09:36:34.889 INFO:tasks.workunit.client.1.smithi135.stdout:2/773: dwrite df/fb1 [0,4194304] 0 2024-09-10T09:36:34.890 INFO:tasks.workunit.client.1.smithi135.stdout:7/735: creat d2/d15/d4a/fe2 x:0 0 0 2024-09-10T09:36:34.890 INFO:tasks.workunit.client.1.smithi135.stdout:7/736: chown d2/d15/d5c/d62/da5/c72 22 1 2024-09-10T09:36:34.902 INFO:tasks.workunit.client.1.smithi135.stdout:0/870: dwrite d8/dd/d18/d3d/dc3/d61/db1/f114 [0,4194304] 0 2024-09-10T09:36:34.903 INFO:tasks.workunit.client.1.smithi135.stdout:2/774: dread df/d1b/d30/f4b [0,4194304] 0 2024-09-10T09:36:34.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/737: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/f27 [0,4194304] 0 2024-09-10T09:36:34.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/738: dread - d2/d15/d39/d9f/fba zero size 2024-09-10T09:36:34.908 INFO:tasks.workunit.client.1.smithi135.stdout:0/871: rename d8/d80/dfd/d123/da8 to d8/d80/d10a/d73/d125 0 2024-09-10T09:36:34.908 INFO:tasks.workunit.client.1.smithi135.stdout:0/872: write d8/d80/d10a/f64 [2256565,115238] 0 2024-09-10T09:36:34.908 INFO:tasks.workunit.client.1.smithi135.stdout:0/873: rename d8/dd/d11/d17 to d8/dd/d11/d17/df6/d126 22 2024-09-10T09:36:34.908 INFO:tasks.workunit.client.1.smithi135.stdout:0/874: readlink d8/dd/d4a/d50/d54/lbf 0 2024-09-10T09:36:34.908 INFO:tasks.workunit.client.1.smithi135.stdout:0/875: write d8/dd/d4a/f84 [1265323,11501] 0 2024-09-10T09:36:34.909 INFO:tasks.workunit.client.1.smithi135.stdout:2/775: mkdir df/d1b/d23/d98/df6 0 2024-09-10T09:36:34.915 INFO:tasks.workunit.client.1.smithi135.stdout:0/876: symlink d8/d80/d10a/d9c/dcf/l127 0 2024-09-10T09:36:34.915 INFO:tasks.workunit.client.1.smithi135.stdout:0/877: write d8/dd/d4a/d50/fac [5006109,83584] 0 2024-09-10T09:36:34.915 INFO:tasks.workunit.client.1.smithi135.stdout:2/776: creat df/d13/d96/ff7 x:0 0 0 2024-09-10T09:36:34.917 INFO:tasks.workunit.client.1.smithi135.stdout:7/739: symlink d2/d26/le3 0 2024-09-10T09:36:34.922 INFO:tasks.workunit.client.1.smithi135.stdout:0/878: link d8/dd/d18/d3d/dc3/d61/f69 d8/d80/d10a/d73/d125/db9/dc1/f128 0 2024-09-10T09:36:34.924 INFO:tasks.workunit.client.1.smithi135.stdout:7/740: dread d2/d15/d39/f6d [0,4194304] 0 2024-09-10T09:36:34.924 INFO:tasks.workunit.client.1.smithi135.stdout:7/741: chown d2/d25/d5d/d83 0 1 2024-09-10T09:36:34.924 INFO:tasks.workunit.client.1.smithi135.stdout:7/742: write d2/d15/f2d [3495730,93190] 0 2024-09-10T09:36:34.925 INFO:tasks.workunit.client.1.smithi135.stdout:2/777: creat df/d1b/d23/d98/d5f/d3d/d87/ff8 x:0 0 0 2024-09-10T09:36:34.929 INFO:tasks.workunit.client.1.smithi135.stdout:0/879: creat d8/d80/d10a/d9c/dcf/f129 x:0 0 0 2024-09-10T09:36:34.931 INFO:tasks.workunit.client.1.smithi135.stdout:7/743: mkdir d2/d15/d39/d9f/db2/dcc/d49/d60/de4 0 2024-09-10T09:36:34.931 INFO:tasks.workunit.client.1.smithi135.stdout:7/744: stat d2/d26/f8b 0 2024-09-10T09:36:34.937 INFO:tasks.workunit.client.1.smithi135.stdout:0/880: rename d8/dd/d33 to d8/de/d2e/d11e/d12a 0 2024-09-10T09:36:34.937 INFO:tasks.workunit.client.1.smithi135.stdout:0/881: read d8/fc [1735361,37783] 0 2024-09-10T09:36:34.937 INFO:tasks.workunit.client.1.smithi135.stdout:0/882: fdatasync d8/dd/d4a/d50/d54/f9a 0 2024-09-10T09:36:34.939 INFO:tasks.workunit.client.1.smithi135.stdout:7/745: mknod d2/d25/daa/ce5 0 2024-09-10T09:36:34.939 INFO:tasks.workunit.client.1.smithi135.stdout:7/746: creat d2/d15/d39/d9f/db2/dcc/d49/d60/d16/fe6 x:0 0 0 2024-09-10T09:36:34.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/747: mkdir d2/d15/d5c/d62/da5/d5e/de7 0 2024-09-10T09:36:34.943 INFO:tasks.workunit.client.1.smithi135.stdout:7/748: dread - d2/d15/d39/d9f/db2/dcc/fc6 zero size 2024-09-10T09:36:34.944 INFO:tasks.workunit.client.1.smithi135.stdout:7/749: dread d2/d15/d5c/d85/f9b [0,4194304] 0 2024-09-10T09:36:34.947 INFO:tasks.workunit.client.1.smithi135.stdout:0/883: getdents d8/dd/d18/d3d/dc3/d61 0 2024-09-10T09:36:34.947 INFO:tasks.workunit.client.1.smithi135.stdout:0/884: write d8/de/f68 [1547728,23270] 0 2024-09-10T09:36:34.951 INFO:tasks.workunit.client.1.smithi135.stdout:0/885: mkdir d8/dd/d4a/d50/d54/d5f/d12b 0 2024-09-10T09:36:34.954 INFO:tasks.workunit.client.1.smithi135.stdout:7/750: dread d2/d15/d39/d9f/db2/dcc/d49/d60/f43 [0,4194304] 0 2024-09-10T09:36:34.954 INFO:tasks.workunit.client.1.smithi135.stdout:0/886: creat d8/dd/d4a/d50/d54/d5f/d11c/f12c x:0 0 0 2024-09-10T09:36:34.954 INFO:tasks.workunit.client.1.smithi135.stdout:7/751: stat d2/d15/d5c/d62/da5/d5e/c73 0 2024-09-10T09:36:34.954 INFO:tasks.workunit.client.1.smithi135.stdout:7/752: write d2/d15/d39/d9f/fc3 [303269,11846] 0 2024-09-10T09:36:34.954 INFO:tasks.workunit.client.1.smithi135.stdout:7/753: fdatasync d2/d15/f20 0 2024-09-10T09:36:34.955 INFO:tasks.workunit.client.1.smithi135.stdout:7/754: fdatasync d2/d15/d5c/d62/da5/d5e/d8c/f97 0 2024-09-10T09:36:34.956 INFO:tasks.workunit.client.1.smithi135.stdout:0/887: mkdir d8/de/d2e/d11e/d12a/d12d 0 2024-09-10T09:36:34.975 INFO:tasks.workunit.client.1.smithi135.stdout:7/755: dwrite d2/d15/d39/d9f/fba [0,4194304] 0 2024-09-10T09:36:34.981 INFO:tasks.workunit.client.1.smithi135.stdout:0/888: dwrite d8/dd/d11/f92 [0,4194304] 0 2024-09-10T09:36:35.021 INFO:tasks.workunit.client.1.smithi135.stdout:7/756: rename d2/d15/d5c/d62/da5 to d2/d15/d39/d9f/db2/dcc/d49/de8 0 2024-09-10T09:36:35.022 INFO:tasks.workunit.client.1.smithi135.stdout:7/757: read - d2/d15/d39/d6f/f76 zero size 2024-09-10T09:36:35.034 INFO:tasks.workunit.client.1.smithi135.stdout:7/758: rename d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71/fa9 to d2/d15/d39/d9f/db2/dcc/d49/d60/fe9 0 2024-09-10T09:36:35.036 INFO:tasks.workunit.client.1.smithi135.stdout:7/759: stat d2/d15/d4a/l32 0 2024-09-10T09:36:35.046 INFO:tasks.workunit.client.1.smithi135.stdout:7/760: dread d2/d15/d39/d9f/db2/dcc/d49/d60/f27 [0,4194304] 0 2024-09-10T09:36:35.059 INFO:tasks.workunit.client.1.smithi135.stdout:0/889: rename d8/dd/d11/le3 to d8/d80/d10a/d73/l12e 0 2024-09-10T09:36:35.061 INFO:tasks.workunit.client.1.smithi135.stdout:5/874: sync 2024-09-10T09:36:35.064 INFO:tasks.workunit.client.1.smithi135.stdout:7/761: creat d2/d15/d39/d9f/db2/dcc/d49/d60/de4/fea x:0 0 0 2024-09-10T09:36:35.068 INFO:tasks.workunit.client.1.smithi135.stdout:5/875: creat d3/d44/f136 x:0 0 0 2024-09-10T09:36:35.068 INFO:tasks.workunit.client.1.smithi135.stdout:5/876: write d3/dc/d16/f130 [491207,38385] 0 2024-09-10T09:36:35.069 INFO:tasks.workunit.client.1.smithi135.stdout:3/641: sync 2024-09-10T09:36:35.070 INFO:tasks.workunit.client.1.smithi135.stdout:8/752: sync 2024-09-10T09:36:35.070 INFO:tasks.workunit.client.1.smithi135.stdout:3/642: dread - d4/d5/f8c zero size 2024-09-10T09:36:35.070 INFO:tasks.workunit.client.1.smithi135.stdout:9/870: sync 2024-09-10T09:36:35.070 INFO:tasks.workunit.client.1.smithi135.stdout:1/888: sync 2024-09-10T09:36:35.072 INFO:tasks.workunit.client.1.smithi135.stdout:7/762: mkdir d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/deb 0 2024-09-10T09:36:35.072 INFO:tasks.workunit.client.1.smithi135.stdout:7/763: chown d2/d15/d39/d6f/c93 403615832 1 2024-09-10T09:36:35.072 INFO:tasks.workunit.client.1.smithi135.stdout:7/764: creat d2/d15/d5c/fec x:0 0 0 2024-09-10T09:36:35.078 INFO:tasks.workunit.client.1.smithi135.stdout:8/753: link d1/f3 d1/d15/d16/d33/d45/dc4/fee 0 2024-09-10T09:36:35.080 INFO:tasks.workunit.client.1.smithi135.stdout:0/890: dwrite d8/d80/dfd/d123/f10c [0,4194304] 0 2024-09-10T09:36:35.080 INFO:tasks.workunit.client.1.smithi135.stdout:0/891: fsync d8/d80/d10a/d73/d125/de7/ff5 0 2024-09-10T09:36:35.080 INFO:tasks.workunit.client.1.smithi135.stdout:0/892: read d8/d80/d10a/d73/d125/db9/dc1/ff4 [237981,6005] 0 2024-09-10T09:36:35.081 INFO:tasks.workunit.client.1.smithi135.stdout:3/643: rename d4/d5/db/l14 to d4/d5/dc/d8b/da6/lb7 0 2024-09-10T09:36:35.081 INFO:tasks.workunit.client.1.smithi135.stdout:2/778: sync 2024-09-10T09:36:35.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/779: fdatasync df/d1b/d31/fe8 0 2024-09-10T09:36:35.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/780: creat df/d13/d52/d8f/ff9 x:0 0 0 2024-09-10T09:36:35.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/781: write df/d1b/d30/f92 [1683,81628] 0 2024-09-10T09:36:35.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/871: rmdir de/df/d1d/d1e/d52 39 2024-09-10T09:36:35.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/872: fsync de/df/d1d/d1e/d52/d86/ffe 0 2024-09-10T09:36:35.084 INFO:tasks.workunit.client.1.smithi135.stdout:1/889: creat d1d/f11a x:0 0 0 2024-09-10T09:36:35.085 INFO:tasks.workunit.client.1.smithi135.stdout:1/890: write d1d/d28/d4b/fdd [7889,101063] 0 2024-09-10T09:36:35.089 INFO:tasks.workunit.client.1.smithi135.stdout:8/754: dread d1/d15/d16/d96/f9f [0,4194304] 0 2024-09-10T09:36:35.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/644: link d4/d5/db/d44/d68/l91 d4/d5/db/d36/d6a/lb8 0 2024-09-10T09:36:35.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/645: chown d4/d5/db/dd/l21 31183779 1 2024-09-10T09:36:35.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/646: stat d4 0 2024-09-10T09:36:35.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/647: read - d4/d5/d51/f7d zero size 2024-09-10T09:36:35.090 INFO:tasks.workunit.client.1.smithi135.stdout:3/648: stat d4/d5/db/dd/lb6 0 2024-09-10T09:36:35.090 INFO:tasks.workunit.client.1.smithi135.stdout:0/893: dread d8/fc [4194304,4194304] 0 2024-09-10T09:36:35.092 INFO:tasks.workunit.client.1.smithi135.stdout:7/765: dwrite d2/d26/f94 [0,4194304] 0 2024-09-10T09:36:35.092 INFO:tasks.workunit.client.1.smithi135.stdout:7/766: chown d2/d15/d5c/d62/cab 6 1 2024-09-10T09:36:35.092 INFO:tasks.workunit.client.1.smithi135.stdout:7/767: chown d2/d25/d5d/f4f 15135484 1 2024-09-10T09:36:35.092 INFO:tasks.workunit.client.1.smithi135.stdout:7/768: dread - d2/d15/d39/d6f/f76 zero size 2024-09-10T09:36:35.093 INFO:tasks.workunit.client.1.smithi135.stdout:7/769: dread d2/d15/d39/d9f/db2/dcc/f6c [0,4194304] 0 2024-09-10T09:36:35.099 INFO:tasks.workunit.client.1.smithi135.stdout:2/782: symlink df/d1b/d23/d98/d5f/d3d/d87/lfa 0 2024-09-10T09:36:35.099 INFO:tasks.workunit.client.1.smithi135.stdout:2/783: stat df/d1b/d23/fbe 0 2024-09-10T09:36:35.103 INFO:tasks.workunit.client.1.smithi135.stdout:9/873: creat de/df/d1d/d1e/d52/f11e x:0 0 0 2024-09-10T09:36:35.106 INFO:tasks.workunit.client.1.smithi135.stdout:1/891: creat d1d/d20/d9a/dff/d109/d114/f11b x:0 0 0 2024-09-10T09:36:35.106 INFO:tasks.workunit.client.1.smithi135.stdout:1/892: dread - d1d/d28/d4b/dda/fe6 zero size 2024-09-10T09:36:35.111 INFO:tasks.workunit.client.1.smithi135.stdout:2/784: rename df/f54 to df/d1b/db7/ffb 0 2024-09-10T09:36:35.114 INFO:tasks.workunit.client.1.smithi135.stdout:2/785: dread df/d1b/d31/fc5 [0,4194304] 0 2024-09-10T09:36:35.114 INFO:tasks.workunit.client.1.smithi135.stdout:2/786: chown df/d13/d4f/la8 6 1 2024-09-10T09:36:35.114 INFO:tasks.workunit.client.1.smithi135.stdout:2/787: chown df/d1b/d23/d42/f65 7383914 1 2024-09-10T09:36:35.114 INFO:tasks.workunit.client.1.smithi135.stdout:2/788: write df/d1b/faf [579092,31758] 0 2024-09-10T09:36:35.120 INFO:tasks.workunit.client.1.smithi135.stdout:9/874: read de/df/d1d/d23/d25/d28/f37 [2287901,58926] 0 2024-09-10T09:36:35.120 INFO:tasks.workunit.client.1.smithi135.stdout:1/893: rename d1d/d28/d4b/l99 to d1d/d71/l11c 0 2024-09-10T09:36:35.124 INFO:tasks.workunit.client.1.smithi135.stdout:1/894: mkdir d1d/d71/dfc/d11d 0 2024-09-10T09:36:35.128 INFO:tasks.workunit.client.1.smithi135.stdout:1/895: link d1d/f11a d1d/d20/d52/d8a/dc2/dca/d2b/f11e 0 2024-09-10T09:36:35.133 INFO:tasks.workunit.client.1.smithi135.stdout:8/755: dwrite d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:35.133 INFO:tasks.workunit.client.1.smithi135.stdout:3/649: dwrite d4/d5/f39 [0,4194304] 0 2024-09-10T09:36:35.134 INFO:tasks.workunit.client.1.smithi135.stdout:8/756: creat d1/d8f/da2/fef x:0 0 0 2024-09-10T09:36:35.134 INFO:tasks.workunit.client.1.smithi135.stdout:0/894: dwrite d8/d80/d10a/d73/d88/db6/f10f [0,4194304] 0 2024-09-10T09:36:35.137 INFO:tasks.workunit.client.1.smithi135.stdout:7/770: dwrite d2/d25/d5d/dbd/fd1 [0,4194304] 0 2024-09-10T09:36:35.137 INFO:tasks.workunit.client.1.smithi135.stdout:7/771: truncate d2/d15/d39/d9f/db2/dcc/d49/d60/d16/fe6 828312 0 2024-09-10T09:36:35.137 INFO:tasks.workunit.client.1.smithi135.stdout:7/772: dread - d2/d15/d39/d9f/db2/dcc/d49/de8/fc9 zero size 2024-09-10T09:36:35.137 INFO:tasks.workunit.client.1.smithi135.stdout:7/773: dread - d2/d15/d39/d9f/db2/dcc/d49/d60/de4/fea zero size 2024-09-10T09:36:35.140 INFO:tasks.workunit.client.1.smithi135.stdout:3/650: mkdir d4/d5/db/d36/d43/db9 0 2024-09-10T09:36:35.140 INFO:tasks.workunit.client.1.smithi135.stdout:3/651: stat d4/d5/db/d44/d68/fa5 0 2024-09-10T09:36:35.155 INFO:tasks.workunit.client.1.smithi135.stdout:8/757: dread d1/d15/f19 [0,4194304] 0 2024-09-10T09:36:35.156 INFO:tasks.workunit.client.1.smithi135.stdout:3/652: read d4/f4d [1801081,112752] 0 2024-09-10T09:36:35.157 INFO:tasks.workunit.client.1.smithi135.stdout:8/758: read d1/d15/d16/d33/d45/f87 [205964,97079] 0 2024-09-10T09:36:35.157 INFO:tasks.workunit.client.1.smithi135.stdout:3/653: symlink d4/d5/dc/d8b/lba 0 2024-09-10T09:36:35.160 INFO:tasks.workunit.client.1.smithi135.stdout:3/654: rename d4/d5/db/d44/d68 to d4/d5/db/d36/d43/dbb 0 2024-09-10T09:36:35.161 INFO:tasks.workunit.client.1.smithi135.stdout:3/655: creat d4/d5/db/d36/d43/dbb/fbc x:0 0 0 2024-09-10T09:36:35.163 INFO:tasks.workunit.client.1.smithi135.stdout:3/656: creat d4/d5/dc/fbd x:0 0 0 2024-09-10T09:36:35.173 INFO:tasks.workunit.client.1.smithi135.stdout:9/875: dwrite de/df/d1d/fc7 [0,4194304] 0 2024-09-10T09:36:35.175 INFO:tasks.workunit.client.1.smithi135.stdout:9/876: getdents de/df/d1d/d1e/d52/de9 0 2024-09-10T09:36:35.184 INFO:tasks.workunit.client.1.smithi135.stdout:2/789: dwrite df/d1b/d23/d42/f6e [0,4194304] 0 2024-09-10T09:36:35.184 INFO:tasks.workunit.client.1.smithi135.stdout:1/896: dwrite d1d/f58 [0,4194304] 0 2024-09-10T09:36:35.184 INFO:tasks.workunit.client.1.smithi135.stdout:7/774: dwrite d2/d15/d39/d9f/db2/dcc/fb9 [0,4194304] 0 2024-09-10T09:36:35.190 INFO:tasks.workunit.client.1.smithi135.stdout:2/790: creat df/d13/d4f/d95/ffc x:0 0 0 2024-09-10T09:36:35.191 INFO:tasks.workunit.client.1.smithi135.stdout:2/791: creat df/d1b/d31/ffd x:0 0 0 2024-09-10T09:36:35.191 INFO:tasks.workunit.client.1.smithi135.stdout:2/792: readlink df/d1b/d23/d98/d5f/d2c/l4d 0 2024-09-10T09:36:35.191 INFO:tasks.workunit.client.1.smithi135.stdout:1/897: mkdir d1d/d20/d6c/d11f 0 2024-09-10T09:36:35.191 INFO:tasks.workunit.client.1.smithi135.stdout:1/898: write f6 [1390100,28941] 0 2024-09-10T09:36:35.193 INFO:tasks.workunit.client.1.smithi135.stdout:3/657: dwrite d4/f47 [4194304,4194304] 0 2024-09-10T09:36:35.194 INFO:tasks.workunit.client.1.smithi135.stdout:9/877: dwrite de/df/dac/db7/f105 [0,4194304] 0 2024-09-10T09:36:35.198 INFO:tasks.workunit.client.1.smithi135.stdout:7/775: rmdir d2/d15/d39 39 2024-09-10T09:36:35.199 INFO:tasks.workunit.client.1.smithi135.stdout:8/759: getdents d1/d8f/da2 0 2024-09-10T09:36:35.210 INFO:tasks.workunit.client.1.smithi135.stdout:1/899: creat d1d/d20/d52/d8a/dc2/dca/d37/f120 x:0 0 0 2024-09-10T09:36:35.214 INFO:tasks.workunit.client.1.smithi135.stdout:3/658: creat d4/d5/db/dd/fbe x:0 0 0 2024-09-10T09:36:35.218 INFO:tasks.workunit.client.1.smithi135.stdout:8/760: rename d1/d8f/da0/de0/le3 to d1/d8f/lf0 0 2024-09-10T09:36:35.218 INFO:tasks.workunit.client.1.smithi135.stdout:2/793: dwrite df/d1b/d23/d42/f65 [0,4194304] 0 2024-09-10T09:36:35.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/878: truncate de/df/d1d/d23/f2d 1077274 0 2024-09-10T09:36:35.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/879: creat de/df/d1d/d1e/db5/d88/f11f x:0 0 0 2024-09-10T09:36:35.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/880: write de/df/d1d/f43 [1388754,51554] 0 2024-09-10T09:36:35.219 INFO:tasks.workunit.client.1.smithi135.stdout:7/776: dwrite d2/d25/da8/fd9 [0,4194304] 0 2024-09-10T09:36:35.222 INFO:tasks.workunit.client.1.smithi135.stdout:3/659: rename d4/d5/dc/d71/l72 to d4/d55/d5d/d5b/lbf 0 2024-09-10T09:36:35.223 INFO:tasks.workunit.client.1.smithi135.stdout:8/761: creat d1/ff1 x:0 0 0 2024-09-10T09:36:35.225 INFO:tasks.workunit.client.1.smithi135.stdout:1/900: dread f1b [0,4194304] 0 2024-09-10T09:36:35.226 INFO:tasks.workunit.client.1.smithi135.stdout:9/881: mknod de/df/d1d/d1e/d52/c120 0 2024-09-10T09:36:35.226 INFO:tasks.workunit.client.1.smithi135.stdout:9/882: write de/df/f40 [1969088,69486] 0 2024-09-10T09:36:35.231 INFO:tasks.workunit.client.1.smithi135.stdout:2/794: write df/d15/f67 [695395,5409] 0 2024-09-10T09:36:35.231 INFO:tasks.workunit.client.1.smithi135.stdout:9/883: dread de/df/d1d/d1e/fe2 [0,4194304] 0 2024-09-10T09:36:35.234 INFO:tasks.workunit.client.1.smithi135.stdout:3/660: symlink d4/d5/db/d36/d6a/lc0 0 2024-09-10T09:36:35.234 INFO:tasks.workunit.client.1.smithi135.stdout:3/661: stat d4/d5/db/dd/d79/c74 0 2024-09-10T09:36:35.234 INFO:tasks.workunit.client.1.smithi135.stdout:3/662: readlink d4/d5/db/l1a 0 2024-09-10T09:36:35.236 INFO:tasks.workunit.client.1.smithi135.stdout:7/777: dread d2/ff [0,4194304] 0 2024-09-10T09:36:35.237 INFO:tasks.workunit.client.1.smithi135.stdout:8/762: creat d1/d15/d16/d99/da9/dce/ff2 x:0 0 0 2024-09-10T09:36:35.237 INFO:tasks.workunit.client.1.smithi135.stdout:8/763: creat d1/d15/d16/d99/da9/dce/ff3 x:0 0 0 2024-09-10T09:36:35.238 INFO:tasks.workunit.client.1.smithi135.stdout:8/764: truncate d1/d27/d3d/dd3/feb 324551 0 2024-09-10T09:36:35.238 INFO:tasks.workunit.client.1.smithi135.stdout:2/795: symlink df/d1b/d70/lfe 0 2024-09-10T09:36:35.241 INFO:tasks.workunit.client.1.smithi135.stdout:3/663: link d4/d5/dc/d71/f9e d4/d5/d76/fc1 0 2024-09-10T09:36:35.244 INFO:tasks.workunit.client.1.smithi135.stdout:1/901: dwrite d1d/d28/d4b/d53/f7a [0,4194304] 0 2024-09-10T09:36:35.247 INFO:tasks.workunit.client.1.smithi135.stdout:7/778: mkdir d2/d25/d5d/d83/ded 0 2024-09-10T09:36:35.249 INFO:tasks.workunit.client.1.smithi135.stdout:1/902: dread d1d/d20/d3c/d6a/f93 [0,4194304] 0 2024-09-10T09:36:35.250 INFO:tasks.workunit.client.1.smithi135.stdout:7/779: dread d2/d15/d39/d9f/db2/dcc/d49/d60/f75 [0,4194304] 0 2024-09-10T09:36:35.250 INFO:tasks.workunit.client.1.smithi135.stdout:7/780: read d2/d15/d4a/f5a [1338803,77065] 0 2024-09-10T09:36:35.254 INFO:tasks.workunit.client.1.smithi135.stdout:8/765: symlink d1/d15/d16/d33/d45/dc4/dd2/lf4 0 2024-09-10T09:36:35.259 INFO:tasks.workunit.client.1.smithi135.stdout:2/796: mkdir df/d13/d4f/dff 0 2024-09-10T09:36:35.263 INFO:tasks.workunit.client.1.smithi135.stdout:8/766: dread d1/d15/d24/f3f [0,4194304] 0 2024-09-10T09:36:35.264 INFO:tasks.workunit.client.1.smithi135.stdout:3/664: mknod d4/d55/cc2 0 2024-09-10T09:36:35.271 INFO:tasks.workunit.client.1.smithi135.stdout:1/903: mknod d1d/d20/d9a/dff/c121 0 2024-09-10T09:36:35.271 INFO:tasks.workunit.client.1.smithi135.stdout:1/904: stat d1d/d20/d52/d8a/fbd 0 2024-09-10T09:36:35.272 INFO:tasks.workunit.client.1.smithi135.stdout:7/781: truncate d2/d26/f94 1346268 0 2024-09-10T09:36:35.272 INFO:tasks.workunit.client.1.smithi135.stdout:7/782: stat d2/d15/d39/d9f/db2/dcc/f44 0 2024-09-10T09:36:35.277 INFO:tasks.workunit.client.1.smithi135.stdout:2/797: rmdir df/d1b/d23/d98/df6 0 2024-09-10T09:36:35.277 INFO:tasks.workunit.client.1.smithi135.stdout:2/798: creat df/d1b/d23/d98/d5f/d3d/d87/db0/f100 x:0 0 0 2024-09-10T09:36:35.281 INFO:tasks.workunit.client.1.smithi135.stdout:3/665: link d4/d5/dc/l30 d4/d5/lc3 0 2024-09-10T09:36:35.281 INFO:tasks.workunit.client.1.smithi135.stdout:8/767: dwrite d1/d27/f40 [0,4194304] 0 2024-09-10T09:36:35.281 INFO:tasks.workunit.client.1.smithi135.stdout:8/768: write d1/d15/d49/d69/f84 [2147686,121029] 0 2024-09-10T09:36:35.281 INFO:tasks.workunit.client.1.smithi135.stdout:1/905: link d1d/d71/l11c d1d/d20/d9a/dff/d109/d114/l122 0 2024-09-10T09:36:35.282 INFO:tasks.workunit.client.1.smithi135.stdout:7/783: creat d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/de7/fee x:0 0 0 2024-09-10T09:36:35.286 INFO:tasks.workunit.client.1.smithi135.stdout:2/799: mknod df/d1b/c101 0 2024-09-10T09:36:35.286 INFO:tasks.workunit.client.1.smithi135.stdout:2/800: fsync df/d1b/d23/db6/fbd 0 2024-09-10T09:36:35.286 INFO:tasks.workunit.client.1.smithi135.stdout:2/801: chown df/d1b/d30/f6a 107 1 2024-09-10T09:36:35.286 INFO:tasks.workunit.client.1.smithi135.stdout:3/666: rmdir d4/d55 39 2024-09-10T09:36:35.294 INFO:tasks.workunit.client.1.smithi135.stdout:8/769: symlink d1/d13/lf5 0 2024-09-10T09:36:35.296 INFO:tasks.workunit.client.1.smithi135.stdout:1/906: rename d1d/d20/d52/d8a/dc2/dca/d2b/d4c/faa to d1d/d20/d6c/f123 0 2024-09-10T09:36:35.297 INFO:tasks.workunit.client.1.smithi135.stdout:7/784: rmdir d2/d15/d39/d6f 39 2024-09-10T09:36:35.297 INFO:tasks.workunit.client.1.smithi135.stdout:7/785: stat d2/d15/d39/d6f/ld2 0 2024-09-10T09:36:35.297 INFO:tasks.workunit.client.1.smithi135.stdout:7/786: read - d2/d25/fb5 zero size 2024-09-10T09:36:35.299 INFO:tasks.workunit.client.1.smithi135.stdout:3/667: creat d4/d55/d5d/fc4 x:0 0 0 2024-09-10T09:36:35.299 INFO:tasks.workunit.client.1.smithi135.stdout:3/668: truncate d4/d5/d51/f7d 260056 0 2024-09-10T09:36:35.302 INFO:tasks.workunit.client.1.smithi135.stdout:2/802: dwrite df/d13/d4f/d95/fb4 [0,4194304] 0 2024-09-10T09:36:35.303 INFO:tasks.workunit.client.1.smithi135.stdout:8/770: unlink d1/d15/d16/d33/c46 0 2024-09-10T09:36:35.308 INFO:tasks.workunit.client.1.smithi135.stdout:7/787: rename d2/d15/d39/d9f/db2/dcc/d49/d60/dc8 to d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def 0 2024-09-10T09:36:35.308 INFO:tasks.workunit.client.1.smithi135.stdout:7/788: creat d2/d15/d39/d53/ff0 x:0 0 0 2024-09-10T09:36:35.310 INFO:tasks.workunit.client.1.smithi135.stdout:1/907: dwrite d1d/d20/d42/f91 [0,4194304] 0 2024-09-10T09:36:35.310 INFO:tasks.workunit.client.1.smithi135.stdout:1/908: readlink d1d/d28/d4b/d53/dc5/lcc 0 2024-09-10T09:36:35.319 INFO:tasks.workunit.client.1.smithi135.stdout:3/669: rename d4/d5/db/d36/ca8 to d4/d5/db/dd/cc5 0 2024-09-10T09:36:35.320 INFO:tasks.workunit.client.1.smithi135.stdout:2/803: dread df/d1b/d23/d98/fbb [0,4194304] 0 2024-09-10T09:36:35.328 INFO:tasks.workunit.client.1.smithi135.stdout:1/909: mknod d1d/d71/d9e/c124 0 2024-09-10T09:36:35.328 INFO:tasks.workunit.client.1.smithi135.stdout:1/910: write d1d/d28/d4b/d53/f8d [323670,80947] 0 2024-09-10T09:36:35.329 INFO:tasks.workunit.client.1.smithi135.stdout:7/789: rename d2/d15/d39/d9f/db8 to d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/df1 0 2024-09-10T09:36:35.335 INFO:tasks.workunit.client.1.smithi135.stdout:8/771: dwrite d1/d15/d49/fb2 [0,4194304] 0 2024-09-10T09:36:35.335 INFO:tasks.workunit.client.1.smithi135.stdout:2/804: unlink df/c11 0 2024-09-10T09:36:35.342 INFO:tasks.workunit.client.1.smithi135.stdout:8/772: mkdir d1/d8f/da0/de0/df6 0 2024-09-10T09:36:35.344 INFO:tasks.workunit.client.1.smithi135.stdout:2/805: rename df/d1b/d23/db6 to df/d13/d102 0 2024-09-10T09:36:35.346 INFO:tasks.workunit.client.1.smithi135.stdout:7/790: rmdir d2/d25/d5d/dbd 39 2024-09-10T09:36:35.346 INFO:tasks.workunit.client.1.smithi135.stdout:7/791: chown d2/d15/d39/d53/cb0 14313 1 2024-09-10T09:36:35.347 INFO:tasks.workunit.client.1.smithi135.stdout:1/911: dwrite d1d/d20/d42/dd3/df5/f88 [0,4194304] 0 2024-09-10T09:36:35.347 INFO:tasks.workunit.client.1.smithi135.stdout:8/773: dread d1/d15/d16/d33/d45/d6f/f92 [0,4194304] 0 2024-09-10T09:36:35.348 INFO:tasks.workunit.client.1.smithi135.stdout:2/806: rename df/d1b/d23/d98/d5f/f89 to df/d13/d4f/f103 0 2024-09-10T09:36:35.349 INFO:tasks.workunit.client.1.smithi135.stdout:7/792: creat d2/d25/ff2 x:0 0 0 2024-09-10T09:36:35.356 INFO:tasks.workunit.client.1.smithi135.stdout:1/912: rmdir d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/dd2 39 2024-09-10T09:36:35.361 INFO:tasks.workunit.client.1.smithi135.stdout:2/807: creat df/d13/d4f/d95/d97/d9a/f104 x:0 0 0 2024-09-10T09:36:35.364 INFO:tasks.workunit.client.1.smithi135.stdout:8/774: truncate d1/d15/d49/d69/f84 3362843 0 2024-09-10T09:36:35.364 INFO:tasks.workunit.client.1.smithi135.stdout:8/775: creat d1/ff7 x:0 0 0 2024-09-10T09:36:35.364 INFO:tasks.workunit.client.1.smithi135.stdout:8/776: readlink d1/d15/d49/d7c/lbf 0 2024-09-10T09:36:35.371 INFO:tasks.workunit.client.1.smithi135.stdout:8/777: rename d1/d15/d16/d33/ccd to d1/d15/d16/d33/d45/cf8 0 2024-09-10T09:36:35.373 INFO:tasks.workunit.client.1.smithi135.stdout:8/778: symlink d1/d8f/da0/dd9/lf9 0 2024-09-10T09:36:35.374 INFO:tasks.workunit.client.1.smithi135.stdout:7/793: dwrite d2/d25/d9d/fa7 [0,4194304] 0 2024-09-10T09:36:35.374 INFO:tasks.workunit.client.1.smithi135.stdout:7/794: truncate d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/fdc 568545 0 2024-09-10T09:36:35.380 INFO:tasks.workunit.client.1.smithi135.stdout:7/795: rmdir d2/d15/d39/d9f/db2 39 2024-09-10T09:36:35.380 INFO:tasks.workunit.client.1.smithi135.stdout:7/796: stat d2/d15/d39/d9f 0 2024-09-10T09:36:35.385 INFO:tasks.workunit.client.1.smithi135.stdout:8/779: dread d1/d15/d16/d33/d45/fd8 [0,4194304] 0 2024-09-10T09:36:35.386 INFO:tasks.workunit.client.1.smithi135.stdout:7/797: dread d2/d15/d39/d53/fbc [0,4194304] 0 2024-09-10T09:36:35.386 INFO:tasks.workunit.client.1.smithi135.stdout:1/913: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/fce [0,4194304] 0 2024-09-10T09:36:35.387 INFO:tasks.workunit.client.1.smithi135.stdout:2/808: dwrite df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf [4194304,4194304] 0 2024-09-10T09:36:35.389 INFO:tasks.workunit.client.1.smithi135.stdout:8/780: rename d1/d15/d16/d33/fe6 to d1/d15/d49/ffa 0 2024-09-10T09:36:35.396 INFO:tasks.workunit.client.1.smithi135.stdout:8/781: dread d1/d15/d16/d33/d45/f50 [0,4194304] 0 2024-09-10T09:36:35.399 INFO:tasks.workunit.client.1.smithi135.stdout:2/809: unlink df/d1b/d30/l63 0 2024-09-10T09:36:35.399 INFO:tasks.workunit.client.1.smithi135.stdout:2/810: fsync df/d1b/d23/d98/d5f/d2c/d7d/fce 0 2024-09-10T09:36:35.399 INFO:tasks.workunit.client.1.smithi135.stdout:2/811: creat df/d1b/d23/d98/d5f/d3d/d87/db0/f105 x:0 0 0 2024-09-10T09:36:35.401 INFO:tasks.workunit.client.1.smithi135.stdout:7/798: rename d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/fdc to d2/d15/d39/ff3 0 2024-09-10T09:36:35.403 INFO:tasks.workunit.client.1.smithi135.stdout:2/812: dread df/d1b/d23/d98/d5f/d3d/f5b [0,4194304] 0 2024-09-10T09:36:35.403 INFO:tasks.workunit.client.1.smithi135.stdout:1/914: dwrite d1d/d20/d52/d8a/dc2/dca/db4/fcd [0,4194304] 0 2024-09-10T09:36:35.404 INFO:tasks.workunit.client.1.smithi135.stdout:8/782: mkdir d1/d15/d16/d33/dfb 0 2024-09-10T09:36:35.409 INFO:tasks.workunit.client.1.smithi135.stdout:7/799: link d2/d15/d39/d9f/db2/dcc/l58 d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/de1/lf4 0 2024-09-10T09:36:35.413 INFO:tasks.workunit.client.1.smithi135.stdout:8/783: link d1/d15/d49/d7c/l7f d1/d15/d16/lfc 0 2024-09-10T09:36:35.438 INFO:tasks.workunit.client.1.smithi135.stdout:1/915: dwrite d1d/d20/d6c/f87 [0,4194304] 0 2024-09-10T09:36:35.438 INFO:tasks.workunit.client.1.smithi135.stdout:1/916: creat d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/f125 x:0 0 0 2024-09-10T09:36:35.438 INFO:tasks.workunit.client.1.smithi135.stdout:2/813: dwrite df/d1b/d23/d98/f73 [0,4194304] 0 2024-09-10T09:36:35.438 INFO:tasks.workunit.client.1.smithi135.stdout:8/784: dwrite d1/d27/f68 [4194304,4194304] 0 2024-09-10T09:36:35.449 INFO:tasks.workunit.client.1.smithi135.stdout:1/917: unlink d1d/d20/d3c/d6a/f79 0 2024-09-10T09:36:35.453 INFO:tasks.workunit.client.1.smithi135.stdout:8/785: creat d1/d15/d16/d33/ffd x:0 0 0 2024-09-10T09:36:35.455 INFO:tasks.workunit.client.1.smithi135.stdout:2/814: dwrite df/d13/d52/d8f/fe7 [0,4194304] 0 2024-09-10T09:36:35.457 INFO:tasks.workunit.client.1.smithi135.stdout:8/786: symlink d1/d15/d16/d96/lfe 0 2024-09-10T09:36:35.462 INFO:tasks.workunit.client.1.smithi135.stdout:1/918: dread d1d/d20/d52/d8a/f101 [0,4194304] 0 2024-09-10T09:36:35.463 INFO:tasks.workunit.client.1.smithi135.stdout:1/919: truncate d1d/d20/d9a/dff/d109/d114/f11b 251607 0 2024-09-10T09:36:35.463 INFO:tasks.workunit.client.1.smithi135.stdout:1/920: fdatasync d1d/d28/d4b/fdd 0 2024-09-10T09:36:35.467 INFO:tasks.workunit.client.1.smithi135.stdout:8/787: mkdir d1/d27/d3d/d94/dff 0 2024-09-10T09:36:35.467 INFO:tasks.workunit.client.1.smithi135.stdout:8/788: readlink d1/l77 0 2024-09-10T09:36:35.467 INFO:tasks.workunit.client.1.smithi135.stdout:8/789: fsync d1/d15/d16/d33/d39/fb9 0 2024-09-10T09:36:35.470 INFO:tasks.workunit.client.1.smithi135.stdout:1/921: unlink d1d/d20/d52/d8a/dc2/dca/d2b/d4c/fb7 0 2024-09-10T09:36:35.470 INFO:tasks.workunit.client.1.smithi135.stdout:1/922: truncate d1d/d28/f7c 2606119 0 2024-09-10T09:36:35.471 INFO:tasks.workunit.client.1.smithi135.stdout:2/815: dwrite df/d1b/d23/d98/d5f/d2c/d7d/fdd [0,4194304] 0 2024-09-10T09:36:35.473 INFO:tasks.workunit.client.1.smithi135.stdout:1/923: creat d1d/d20/d52/f126 x:0 0 0 2024-09-10T09:36:35.473 INFO:tasks.workunit.client.1.smithi135.stdout:1/924: write d1d/d20/d52/d8a/dc2/dca/d2b/fce [4525063,81996] 0 2024-09-10T09:36:35.473 INFO:tasks.workunit.client.1.smithi135.stdout:8/790: dread d1/d15/d49/fbd [0,4194304] 0 2024-09-10T09:36:35.475 INFO:tasks.workunit.client.1.smithi135.stdout:8/791: dread d1/d15/d16/d33/d45/f87 [0,4194304] 0 2024-09-10T09:36:35.495 INFO:tasks.workunit.client.1.smithi135.stdout:2/816: creat df/d1b/d23/d98/d5f/d3d/f106 x:0 0 0 2024-09-10T09:36:35.500 INFO:tasks.workunit.client.1.smithi135.stdout:8/792: dwrite d1/d15/d16/d99/da9/dce/ff2 [0,4194304] 0 2024-09-10T09:36:35.500 INFO:tasks.workunit.client.1.smithi135.stdout:1/925: dwrite d1d/d20/d52/d8a/dc2/dca/d37/f89 [0,4194304] 0 2024-09-10T09:36:35.500 INFO:tasks.workunit.client.1.smithi135.stdout:1/926: fdatasync d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/fd5 0 2024-09-10T09:36:35.503 INFO:tasks.workunit.client.1.smithi135.stdout:2/817: dread df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf [0,4194304] 0 2024-09-10T09:36:35.503 INFO:tasks.workunit.client.1.smithi135.stdout:2/818: readlink la 0 2024-09-10T09:36:35.505 INFO:tasks.workunit.client.1.smithi135.stdout:8/793: link d1/d15/d16/d99/da9/led d1/d15/d24/l100 0 2024-09-10T09:36:35.505 INFO:tasks.workunit.client.1.smithi135.stdout:8/794: read d1/d27/d3d/d94/da7/fbb [296366,119273] 0 2024-09-10T09:36:35.508 INFO:tasks.workunit.client.1.smithi135.stdout:5/877: sync 2024-09-10T09:36:35.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/819: getdents df/d1b/db7 0 2024-09-10T09:36:35.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/820: write df/d1b/f85 [734056,98346] 0 2024-09-10T09:36:35.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/821: getdents df/d1b/d23/d98/d5f/d2c 0 2024-09-10T09:36:35.513 INFO:tasks.workunit.client.1.smithi135.stdout:1/927: write d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/f104 [1552654,88531] 0 2024-09-10T09:36:35.513 INFO:tasks.workunit.client.1.smithi135.stdout:5/878: dread d3/dc/dba/f5f [0,4194304] 0 2024-09-10T09:36:35.515 INFO:tasks.workunit.client.1.smithi135.stdout:8/795: write d1/f23 [5542888,100993] 0 2024-09-10T09:36:35.515 INFO:tasks.workunit.client.1.smithi135.stdout:8/796: chown d1/d15/lc3 3799 1 2024-09-10T09:36:35.516 INFO:tasks.workunit.client.1.smithi135.stdout:1/928: symlink d1d/d20/d52/d8a/l127 0 2024-09-10T09:36:35.519 INFO:tasks.workunit.client.1.smithi135.stdout:5/879: rmdir d3/d81/d120 39 2024-09-10T09:36:35.526 INFO:tasks.workunit.client.1.smithi135.stdout:5/880: dread d3/dc/d7a/fa4 [4194304,4194304] 0 2024-09-10T09:36:35.526 INFO:tasks.workunit.client.1.smithi135.stdout:5/881: write d3/dc/dba/d48/d57/da9/fe0 [4492224,46688] 0 2024-09-10T09:36:35.526 INFO:tasks.workunit.client.1.smithi135.stdout:5/882: creat d3/dc/dba/d88/f137 x:0 0 0 2024-09-10T09:36:35.531 INFO:tasks.workunit.client.1.smithi135.stdout:1/929: write d1d/d20/d52/d8a/dc2/dca/d37/f89 [1684523,36229] 0 2024-09-10T09:36:35.536 INFO:tasks.workunit.client.1.smithi135.stdout:5/883: rmdir d3/dc/d16/dc0 39 2024-09-10T09:36:35.538 INFO:tasks.workunit.client.1.smithi135.stdout:5/884: link d3/f14 d3/dc/d69/d65/de7/f138 0 2024-09-10T09:36:35.539 INFO:tasks.workunit.client.1.smithi135.stdout:5/885: creat d3/dc/dba/dbf/f139 x:0 0 0 2024-09-10T09:36:35.540 INFO:tasks.workunit.client.1.smithi135.stdout:5/886: chown d3/d44/fbe 850022015 1 2024-09-10T09:36:35.540 INFO:tasks.workunit.client.1.smithi135.stdout:5/887: fsync d3/dc/f80 0 2024-09-10T09:36:35.541 INFO:tasks.workunit.client.1.smithi135.stdout:5/888: rename d3/dc/dba/d48/d57/da9/f11f to d3/dc/dba/d48/d57/dc4/f13a 0 2024-09-10T09:36:35.542 INFO:tasks.workunit.client.1.smithi135.stdout:5/889: truncate d3/dc/dba/d88/fe8 3866417 0 2024-09-10T09:36:35.544 INFO:tasks.workunit.client.1.smithi135.stdout:5/890: mkdir d3/d99/d13b 0 2024-09-10T09:36:35.544 INFO:tasks.workunit.client.1.smithi135.stdout:1/930: read d1d/d20/f30 [32558,28397] 0 2024-09-10T09:36:35.544 INFO:tasks.workunit.client.1.smithi135.stdout:2/822: dwrite df/d1b/d23/fbe [0,4194304] 0 2024-09-10T09:36:35.545 INFO:tasks.workunit.client.1.smithi135.stdout:8/797: dwrite d1/ff1 [0,4194304] 0 2024-09-10T09:36:35.545 INFO:tasks.workunit.client.1.smithi135.stdout:8/798: fsync d1/d15/d16/d33/d45/f87 0 2024-09-10T09:36:35.545 INFO:tasks.workunit.client.1.smithi135.stdout:2/823: write df/d13/f7a [71565,13808] 0 2024-09-10T09:36:35.549 INFO:tasks.workunit.client.1.smithi135.stdout:5/891: link d3/dc/d69/de9/lef d3/dc/dba/d88/l13c 0 2024-09-10T09:36:35.550 INFO:tasks.workunit.client.1.smithi135.stdout:1/931: truncate d1d/d20/d3c/d4e/fa5 434917 0 2024-09-10T09:36:35.550 INFO:tasks.workunit.client.1.smithi135.stdout:1/932: getdents d1d/d20/d6c/df3 0 2024-09-10T09:36:35.560 INFO:tasks.workunit.client.1.smithi135.stdout:8/799: rename d1/d15/d24/c3e to d1/d8f/da0/dd9/c101 0 2024-09-10T09:36:35.560 INFO:tasks.workunit.client.1.smithi135.stdout:8/800: chown d1/d15/d16/d96/f9f 157496 1 2024-09-10T09:36:35.560 INFO:tasks.workunit.client.1.smithi135.stdout:8/801: chown d1/d15/d16/d96/l9c 1803 1 2024-09-10T09:36:35.561 INFO:tasks.workunit.client.1.smithi135.stdout:2/824: mkdir df/d13/d102/d107 0 2024-09-10T09:36:35.565 INFO:tasks.workunit.client.1.smithi135.stdout:1/933: truncate d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/f66 1348667 0 2024-09-10T09:36:35.565 INFO:tasks.workunit.client.1.smithi135.stdout:1/934: truncate d1d/d20/d52/d8a/dc2/dca/d2b/d4c/f62 2323368 0 2024-09-10T09:36:35.571 INFO:tasks.workunit.client.1.smithi135.stdout:8/802: symlink d1/d15/d16/d99/l102 0 2024-09-10T09:36:35.571 INFO:tasks.workunit.client.1.smithi135.stdout:8/803: truncate d1/d8f/da2/fef 253381 0 2024-09-10T09:36:35.571 INFO:tasks.workunit.client.1.smithi135.stdout:8/804: write d1/f3 [498979,84156] 0 2024-09-10T09:36:35.573 INFO:tasks.workunit.client.1.smithi135.stdout:1/935: mkdir d1d/d20/d6c/df3/d128 0 2024-09-10T09:36:35.574 INFO:tasks.workunit.client.1.smithi135.stdout:1/936: truncate d1d/d20/d52/d8a/dc2/dca/d37/f120 539208 0 2024-09-10T09:36:35.577 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T09:36:35.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T09:36:35.578 INFO:tasks.workunit.client.1.smithi135.stdout:8/805: truncate d1/d15/d16/d33/d45/fd8 3371440 0 2024-09-10T09:36:35.578 INFO:tasks.workunit.client.1.smithi135.stdout:8/806: read - d1/d15/d16/d99/da9/dce/ff3 zero size 2024-09-10T09:36:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:2/825: dwrite df/d1b/d23/d98/d5f/d3d/d87/ff8 [0,4194304] 0 2024-09-10T09:36:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:1/937: rename d1d/d28/d4b/d53/f7a to d1d/d20/d52/f129 0 2024-09-10T09:36:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:1/938: fdatasync d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/f125 0 2024-09-10T09:36:35.579 INFO:tasks.workunit.client.1.smithi135.stdout:1/939: rename d1d/d20 to d1d/d20/d52/d8a/dc2/dca/d37/d12a 22 2024-09-10T09:36:35.581 INFO:tasks.workunit.client.1.smithi135.stdout:8/807: mkdir d1/d8f/da0/dd9/d103 0 2024-09-10T09:36:35.584 INFO:tasks.workunit.client.1.smithi135.stdout:2/826: mknod df/dde/c108 0 2024-09-10T09:36:35.587 INFO:tasks.workunit.client.1.smithi135.stdout:2/827: mkdir df/d1b/d23/d98/d5f/d3d/d109 0 2024-09-10T09:36:35.587 INFO:tasks.workunit.client.1.smithi135.stdout:2/828: truncate df/d1b/d23/d98/d5f/d3d/f106 814535 0 2024-09-10T09:36:35.588 INFO:tasks.workunit.client.1.smithi135.stdout:1/940: getdents d1d/d20/d52/d8a/dc2/dca/d2b/d4c 0 2024-09-10T09:36:35.589 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:35 smithi079 ceph-mon[27592]: Deploying cephadm binary to smithi135 2024-09-10T09:36:35.589 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:35 smithi079 ceph-mon[27592]: pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-09-10T09:36:35.589 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:35 smithi079 ceph-mon[27592]: mgrmap e23: smithi135.lbhjof(active, since 2s) 2024-09-10T09:36:35.592 INFO:tasks.workunit.client.1.smithi135.stdout:1/941: rename d1d/d20/d3c/d4e to d1d/d20/d52/d8a/dc2/dca/d2b/d12b 0 2024-09-10T09:36:35.592 INFO:tasks.workunit.client.1.smithi135.stdout:1/942: truncate d1d/d20/d9a/f9b 5200060 0 2024-09-10T09:36:35.604 INFO:tasks.workunit.client.1.smithi135.stdout:1/943: dread d1d/f2a [0,4194304] 0 2024-09-10T09:36:35.607 INFO:tasks.workunit.client.1.smithi135.stdout:2/829: dwrite df/d1b/d30/f92 [0,4194304] 0 2024-09-10T09:36:35.609 INFO:tasks.workunit.client.1.smithi135.stdout:2/830: mkdir df/d13/d96/d10a 0 2024-09-10T09:36:35.610 INFO:tasks.workunit.client.1.smithi135.stdout:2/831: fdatasync df/d1b/d23/d98/fbb 0 2024-09-10T09:36:35.612 INFO:tasks.workunit.client.1.smithi135.stdout:2/832: dread df/d13/ff1 [0,4194304] 0 2024-09-10T09:36:35.612 INFO:tasks.workunit.client.1.smithi135.stdout:2/833: dread - df/d1b/d23/d98/d5f/d3d/d87/db0/f100 zero size 2024-09-10T09:36:35.614 INFO:tasks.workunit.client.1.smithi135.stdout:1/944: write d1d/d20/d42/f91 [2630016,124453] 0 2024-09-10T09:36:35.614 INFO:tasks.workunit.client.1.smithi135.stdout:1/945: write d1d/d20/fa6 [1470455,125193] 0 2024-09-10T09:36:35.618 INFO:tasks.workunit.client.1.smithi135.stdout:1/946: symlink d1d/d20/d52/d8a/dc2/dca/d37/l12c 0 2024-09-10T09:36:35.618 INFO:tasks.workunit.client.1.smithi135.stdout:1/947: truncate d1d/d20/d52/d8a/dc2/dca/d2b/f11e 998588 0 2024-09-10T09:36:35.618 INFO:tasks.workunit.client.1.smithi135.stdout:1/948: creat d1d/d20/d42/dd3/f12d x:0 0 0 2024-09-10T09:36:35.621 INFO:tasks.workunit.client.1.smithi135.stdout:2/834: write df/d1b/d23/d42/f6e [45302,101845] 0 2024-09-10T09:36:35.621 INFO:tasks.workunit.client.1.smithi135.stdout:2/835: chown df/ldc 0 1 2024-09-10T09:36:35.624 INFO:tasks.workunit.client.1.smithi135.stdout:2/836: link df/d1b/f1c df/d1b/f10b 0 2024-09-10T09:36:35.625 INFO:tasks.workunit.client.1.smithi135.stdout:2/837: creat df/d1b/f10c x:0 0 0 2024-09-10T09:36:35.627 INFO:tasks.workunit.client.1.smithi135.stdout:2/838: mkdir df/d13/d96/d10a/d10d 0 2024-09-10T09:36:35.628 INFO:tasks.workunit.client.1.smithi135.stdout:2/839: mkdir df/d1b/d23/d98/d5f/d10e 0 2024-09-10T09:36:35.628 INFO:tasks.workunit.client.1.smithi135.stdout:2/840: fdatasync df/d13/d4f/d95/d97/d9a/f104 0 2024-09-10T09:36:35.644 INFO:tasks.workunit.client.1.smithi135.stdout:2/841: dwrite df/d15/f7c [0,4194304] 0 2024-09-10T09:36:35.644 INFO:tasks.workunit.client.1.smithi135.stdout:2/842: chown df/d1b/f5c 421557 1 2024-09-10T09:36:35.649 INFO:tasks.workunit.client.1.smithi135.stdout:2/843: rename df/ca4 to df/d1b/d23/d98/dee/c10f 0 2024-09-10T09:36:35.649 INFO:tasks.workunit.client.1.smithi135.stdout:2/844: creat df/d1b/d30/f110 x:0 0 0 2024-09-10T09:36:35.652 INFO:tasks.workunit.client.1.smithi135.stdout:2/845: mkdir df/d13/d4f/d95/d97/d9a/d111 0 2024-09-10T09:36:35.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/846: dwrite df/fb1 [4194304,4194304] 0 2024-09-10T09:36:35.674 INFO:tasks.workunit.client.1.smithi135.stdout:2/847: read df/d1b/f5c [2016261,103576] 0 2024-09-10T09:36:35.681 INFO:tasks.workunit.client.1.smithi135.stdout:2/848: dread df/d1b/f10b [4194304,4194304] 0 2024-09-10T09:36:35.697 INFO:tasks.workunit.client.1.smithi135.stdout:2/849: dwrite df/d1b/d23/d98/f9b [0,4194304] 0 2024-09-10T09:36:35.697 INFO:tasks.workunit.client.1.smithi135.stdout:2/850: chown df/d1b/d23/d98/d5f/d2c/d7d/d8c/fbf 28702557 1 2024-09-10T09:36:35.698 INFO:tasks.workunit.client.1.smithi135.stdout:2/851: chown df/d15/fe6 46011 1 2024-09-10T09:36:35.706 INFO:tasks.workunit.client.1.smithi135.stdout:2/852: dread df/d1b/f3c [0,4194304] 0 2024-09-10T09:36:35.707 INFO:tasks.workunit.client.1.smithi135.stdout:2/853: dread df/d1b/faf [0,4194304] 0 2024-09-10T09:36:35.707 INFO:tasks.workunit.client.1.smithi135.stdout:2/854: read - df/d1b/d23/d98/d5f/d3d/d87/db0/f105 zero size 2024-09-10T09:36:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:35 smithi135 ceph-mon[33411]: Deploying cephadm binary to smithi135 2024-09-10T09:36:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:35 smithi135 ceph-mon[33411]: pgmap v4: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-09-10T09:36:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:35 smithi135 ceph-mon[33411]: mgrmap e23: smithi135.lbhjof(active, since 2s) 2024-09-10T09:36:35.737 INFO:tasks.workunit.client.1.smithi135.stdout:0/895: sync 2024-09-10T09:36:35.745 INFO:tasks.workunit.client.1.smithi135.stdout:0/896: write d8/dd/d4a/d50/d67/fbd [3053023,84666] 0 2024-09-10T09:36:35.745 INFO:tasks.workunit.client.1.smithi135.stdout:0/897: getdents d8/dd/d4a 0 2024-09-10T09:36:35.747 INFO:tasks.workunit.client.1.smithi135.stdout:0/898: unlink d8/de/d2e/d11e/d12a/lad 0 2024-09-10T09:36:35.747 INFO:tasks.workunit.client.1.smithi135.stdout:0/899: fsync d8/d80/d10a/d73/d125/db9/fd9 0 2024-09-10T09:36:35.747 INFO:tasks.workunit.client.1.smithi135.stdout:0/900: chown d8/de/d2e/f91 65173 1 2024-09-10T09:36:35.773 INFO:tasks.workunit.client.1.smithi135.stdout:0/901: dwrite d8/dd/d4a/d50/d67/fd6 [0,4194304] 0 2024-09-10T09:36:35.773 INFO:tasks.workunit.client.1.smithi135.stdout:0/902: write d8/d80/d10a/d9c/de2/f122 [26607,5093] 0 2024-09-10T09:36:35.774 INFO:tasks.workunit.client.1.smithi135.stdout:0/903: getdents d8/de/d2e/d11e/d120 0 2024-09-10T09:36:35.776 INFO:tasks.workunit.client.1.smithi135.stdout:0/904: mknod d8/d80/d10a/d73/d88/de4/c12f 0 2024-09-10T09:36:35.784 INFO:tasks.workunit.client.1.smithi135.stdout:0/905: dread d8/dd/d11/d17/f42 [0,4194304] 0 2024-09-10T09:36:35.793 INFO:tasks.workunit.client.1.smithi135.stdout:0/906: write d8/dd/d18/f43 [2924513,69506] 0 2024-09-10T09:36:35.801 INFO:tasks.workunit.client.1.smithi135.stdout:0/907: write d8/de/d2e/d11e/d120/f6e [855439,99806] 0 2024-09-10T09:36:35.804 INFO:tasks.workunit.client.1.smithi135.stdout:0/908: symlink d8/de/d2e/l130 0 2024-09-10T09:36:35.804 INFO:tasks.workunit.client.1.smithi135.stdout:0/909: creat d8/d80/d10a/d9c/de2/f131 x:0 0 0 2024-09-10T09:36:35.804 INFO:tasks.workunit.client.1.smithi135.stdout:0/910: dread - d8/dd/d4a/d50/d54/d5f/fcd zero size 2024-09-10T09:36:35.807 INFO:tasks.workunit.client.1.smithi135.stdout:0/911: creat d8/dd/f132 x:0 0 0 2024-09-10T09:36:35.817 INFO:tasks.workunit.client.1.smithi135.stdout:0/912: dread d8/d80/d10a/d73/d88/db6/f10f [0,4194304] 0 2024-09-10T09:36:35.820 INFO:tasks.workunit.client.1.smithi135.stdout:0/913: rename d8/dd/d11/d17/le5 to d8/dd/l133 0 2024-09-10T09:36:35.830 INFO:tasks.workunit.client.1.smithi135.stdout:0/914: write d8/dd/f77 [1993530,54515] 0 2024-09-10T09:36:35.830 INFO:tasks.workunit.client.1.smithi135.stdout:0/915: truncate d8/de/d2e/d11e/d120/fa2 87778 0 2024-09-10T09:36:35.836 INFO:tasks.workunit.client.1.smithi135.stdout:0/916: write d8/d80/d10a/d73/d88/db6/f10f [2464421,1680] 0 2024-09-10T09:36:35.839 INFO:tasks.workunit.client.1.smithi135.stdout:0/917: mknod d8/d80/d10a/d73/dc8/c134 0 2024-09-10T09:36:35.840 INFO:tasks.workunit.client.1.smithi135.stdout:0/918: mknod d8/dd/d4a/d50/d54/d5f/d11c/c135 0 2024-09-10T09:36:35.842 INFO:tasks.workunit.client.1.smithi135.stdout:0/919: creat d8/dd/d4a/d50/f136 x:0 0 0 2024-09-10T09:36:35.843 INFO:tasks.workunit.client.1.smithi135.stdout:0/920: creat d8/de/d2e/d11e/f137 x:0 0 0 2024-09-10T09:36:35.843 INFO:tasks.workunit.client.1.smithi135.stdout:0/921: write d8/fc [505253,64515] 0 2024-09-10T09:36:35.844 INFO:tasks.workunit.client.1.smithi135.stdout:0/922: symlink d8/d80/d10a/d73/dc8/l138 0 2024-09-10T09:36:35.852 INFO:tasks.workunit.client.1.smithi135.stdout:0/923: write d8/dd/d18/d3d/dc3/d8f/daa/fcc [1447813,81137] 0 2024-09-10T09:36:35.856 INFO:tasks.workunit.client.1.smithi135.stdout:0/924: write d8/dd/d11/ff3 [2700162,112074] 0 2024-09-10T09:36:35.875 INFO:tasks.workunit.client.1.smithi135.stdout:0/925: dwrite d8/dd/d18/d3d/dc3/d61/f8a [0,4194304] 0 2024-09-10T09:36:35.876 INFO:tasks.workunit.client.1.smithi135.stdout:0/926: fdatasync d8/de/d2e/f91 0 2024-09-10T09:36:35.877 INFO:tasks.workunit.client.1.smithi135.stdout:0/927: unlink d8/dd/d18/d3d/fb2 0 2024-09-10T09:36:35.878 INFO:tasks.workunit.client.1.smithi135.stdout:0/928: mkdir d8/dd/d18/d3d/dc3/d139 0 2024-09-10T09:36:35.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/929: dread d8/d80/d10a/d73/d125/f106 [0,4194304] 0 2024-09-10T09:36:35.879 INFO:tasks.workunit.client.1.smithi135.stdout:0/930: write d8/dd/d11/d17/fa3 [932774,43129] 0 2024-09-10T09:36:35.883 INFO:tasks.workunit.client.1.smithi135.stdout:0/931: creat d8/d80/d10a/d73/d7f/f13a x:0 0 0 2024-09-10T09:36:35.886 INFO:tasks.workunit.client.1.smithi135.stdout:0/932: rename d8/dd/d4a/d50/d54/d5f/l112 to d8/d80/d10a/d73/d7f/l13b 0 2024-09-10T09:36:35.904 INFO:tasks.workunit.client.1.smithi135.stdout:0/933: dwrite d8/d80/d10a/fe8 [0,4194304] 0 2024-09-10T09:36:35.904 INFO:tasks.workunit.client.1.smithi135.stdout:0/934: write d8/dd/d11/d17/f42 [3654155,127837] 0 2024-09-10T09:36:35.907 INFO:tasks.workunit.client.1.smithi135.stdout:0/935: rename d8/dd/d4a/d50/d54/d5f/d12b to d8/d80/d10a/d73/d13c 0 2024-09-10T09:36:35.910 INFO:tasks.workunit.client.1.smithi135.stdout:0/936: getdents d8 0 2024-09-10T09:36:35.910 INFO:tasks.workunit.client.1.smithi135.stdout:0/937: chown d8/dd/d11/d17/fa3 5 1 2024-09-10T09:36:35.915 INFO:tasks.workunit.client.1.smithi135.stdout:0/938: rename d8/de/d2e/f91 to d8/d80/d10a/d73/d125/de7/f13d 0 2024-09-10T09:36:35.917 INFO:tasks.workunit.client.1.smithi135.stdout:0/939: unlink d8/d80/d10a/f5d 0 2024-09-10T09:36:35.923 INFO:tasks.workunit.client.1.smithi135.stdout:0/940: mkdir d8/dd/d11/d90/d13e 0 2024-09-10T09:36:35.925 INFO:tasks.workunit.client.1.smithi135.stdout:0/941: unlink d8/d80/dfd/d123/f10c 0 2024-09-10T09:36:35.925 INFO:tasks.workunit.client.1.smithi135.stdout:0/942: getdents d8/d80/d10a/d73/d125/db9/dc1/dde 0 2024-09-10T09:36:35.926 INFO:tasks.workunit.client.1.smithi135.stdout:0/943: write d8/dd/d18/d3d/dc3/d61/db1/f114 [4979292,36551] 0 2024-09-10T09:36:35.928 INFO:tasks.workunit.client.1.smithi135.stdout:0/944: rmdir d8/d80/d10a/d73/d88/db6 39 2024-09-10T09:36:35.947 INFO:tasks.workunit.client.1.smithi135.stdout:0/945: dwrite d8/dd/d11/f59 [0,4194304] 0 2024-09-10T09:36:35.947 INFO:tasks.workunit.client.1.smithi135.stdout:0/946: write d8/d80/d10a/d73/d125/f119 [571311,60005] 0 2024-09-10T09:36:35.947 INFO:tasks.workunit.client.1.smithi135.stdout:0/947: getdents d8/d80/d10a/d73/d13c 0 2024-09-10T09:36:35.950 INFO:tasks.workunit.client.1.smithi135.stdout:0/948: dread d8/dd/d11/d90/dc4/fe9 [0,4194304] 0 2024-09-10T09:36:35.969 INFO:tasks.workunit.client.1.smithi135.stdout:0/949: dwrite d8/d80/d10a/d73/fb7 [0,4194304] 0 2024-09-10T09:36:35.971 INFO:tasks.workunit.client.1.smithi135.stdout:0/950: rename d8/d80/d10a/d9c/dcf/l127 to d8/dd/db0/l13f 0 2024-09-10T09:36:35.971 INFO:tasks.workunit.client.1.smithi135.stdout:0/951: creat d8/dd/d11/d17/df6/f140 x:0 0 0 2024-09-10T09:36:35.971 INFO:tasks.workunit.client.1.smithi135.stdout:0/952: fsync d8/fc 0 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:9/884: sync 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/670: sync 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/671: fdatasync d4/d55/d5d/fa4 0 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:9/885: dread - de/df/d1d/d1e/d52/f11e zero size 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/672: stat d4/d5/d56/l83 0 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:9/886: chown de/df/l60 31085400 1 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/673: stat d4/d5/db/d36/d6a/lc0 0 2024-09-10T09:36:35.975 INFO:tasks.workunit.client.1.smithi135.stdout:3/674: read d4/d5/dc/f50 [498579,5351] 0 2024-09-10T09:36:35.976 INFO:tasks.workunit.client.1.smithi135.stdout:9/887: write de/df/d7e/ff6 [470361,34184] 0 2024-09-10T09:36:35.976 INFO:tasks.workunit.client.1.smithi135.stdout:9/888: read - de/df/d1d/d1e/db5/d88/f11f zero size 2024-09-10T09:36:35.976 INFO:tasks.workunit.client.1.smithi135.stdout:9/889: dread - de/df/d1d/d1e/d52/fd9 zero size 2024-09-10T09:36:35.976 INFO:tasks.workunit.client.1.smithi135.stdout:3/675: creat d4/d5/d76/fc6 x:0 0 0 2024-09-10T09:36:35.979 INFO:tasks.workunit.client.1.smithi135.stdout:3/676: creat d4/d5/db/d44/da9/fc7 x:0 0 0 2024-09-10T09:36:35.979 INFO:tasks.workunit.client.1.smithi135.stdout:9/890: rmdir de/df/d1d/d23/d25/d28/dbe 39 2024-09-10T09:36:35.980 INFO:tasks.workunit.client.1.smithi135.stdout:3/677: dread d4/d5/d76/fc1 [0,4194304] 0 2024-09-10T09:36:35.980 INFO:tasks.workunit.client.1.smithi135.stdout:3/678: fdatasync d4/d5/d76/fc1 0 2024-09-10T09:36:35.980 INFO:tasks.workunit.client.1.smithi135.stdout:3/679: fsync d4/d5/db/d36/d43/f6e 0 2024-09-10T09:36:35.981 INFO:tasks.workunit.client.1.smithi135.stdout:9/891: link de/df/d1d/d1e/db5/d88/fd2 de/df/f121 0 2024-09-10T09:36:35.998 INFO:tasks.workunit.client.1.smithi135.stdout:9/892: dwrite de/df/d1d/d1e/fe2 [0,4194304] 0 2024-09-10T09:36:36.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/893: read de/df/d1d/f3a [1300147,54359] 0 2024-09-10T09:36:36.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/894: chown de/df/d7e/ff6 0 1 2024-09-10T09:36:36.003 INFO:tasks.workunit.client.1.smithi135.stdout:9/895: truncate de/df/d1d/d23/d25/f48 4565521 0 2024-09-10T09:36:36.054 INFO:tasks.workunit.client.1.smithi135.stdout:3/680: symlink d4/d5/d51/lc8 0 2024-09-10T09:36:36.054 INFO:tasks.workunit.client.1.smithi135.stdout:3/681: truncate d4/d5/dc/d71/f9e 1173080 0 2024-09-10T09:36:36.054 INFO:tasks.workunit.client.1.smithi135.stdout:3/682: fdatasync d4/f32 0 2024-09-10T09:36:36.058 INFO:tasks.workunit.client.1.smithi135.stdout:9/896: unlink de/df/dac/db7/fcb 0 2024-09-10T09:36:36.062 INFO:tasks.workunit.client.1.smithi135.stdout:3/683: creat d4/d55/fc9 x:0 0 0 2024-09-10T09:36:36.066 INFO:tasks.workunit.client.1.smithi135.stdout:9/897: mknod de/df/d1d/d23/d25/d28/d7b/c122 0 2024-09-10T09:36:36.066 INFO:tasks.workunit.client.1.smithi135.stdout:9/898: creat de/df/d1d/d62/f123 x:0 0 0 2024-09-10T09:36:36.067 INFO:tasks.workunit.client.1.smithi135.stdout:3/684: truncate d4/d5/d76/fb2 1064504 0 2024-09-10T09:36:36.068 INFO:tasks.workunit.client.1.smithi135.stdout:3/685: read f1 [5261862,69162] 0 2024-09-10T09:36:36.071 INFO:tasks.workunit.client.1.smithi135.stdout:9/899: getdents de/df/dac 0 2024-09-10T09:36:36.071 INFO:tasks.workunit.client.1.smithi135.stdout:9/900: chown de/df/f3e 243379849 1 2024-09-10T09:36:36.073 INFO:tasks.workunit.client.1.smithi135.stdout:3/686: creat d4/d5/d51/fca x:0 0 0 2024-09-10T09:36:36.074 INFO:tasks.workunit.client.1.smithi135.stdout:9/901: link de/df/d7e/lfc de/df/d1d/d23/d25/d28/d7b/dcf/l124 0 2024-09-10T09:36:36.074 INFO:tasks.workunit.client.1.smithi135.stdout:9/902: fsync de/df/d7e/ff6 0 2024-09-10T09:36:36.076 INFO:tasks.workunit.client.1.smithi135.stdout:3/687: symlink d4/d55/lcb 0 2024-09-10T09:36:36.077 INFO:tasks.workunit.client.1.smithi135.stdout:9/903: mknod de/df/d1d/d62/c125 0 2024-09-10T09:36:36.077 INFO:tasks.workunit.client.1.smithi135.stdout:9/904: creat de/df/d1d/d62/f126 x:0 0 0 2024-09-10T09:36:36.077 INFO:tasks.workunit.client.1.smithi135.stdout:9/905: write de/df/f40 [4640169,19638] 0 2024-09-10T09:36:36.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/906: rmdir de/df/d1d/d1e/db5 39 2024-09-10T09:36:36.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/907: write de/df/d1d/fca [367758,8101] 0 2024-09-10T09:36:36.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/908: dread - de/df/d1d/d1e/d3f/dbb/fc2 zero size 2024-09-10T09:36:36.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/909: creat de/df/d7e/f127 x:0 0 0 2024-09-10T09:36:36.083 INFO:tasks.workunit.client.1.smithi135.stdout:9/910: dread - de/df/d1d/d1e/d52/f11e zero size 2024-09-10T09:36:36.085 INFO:tasks.workunit.client.1.smithi135.stdout:3/688: getdents d4/d5/dc 0 2024-09-10T09:36:36.107 INFO:tasks.workunit.client.1.smithi135.stdout:9/911: dwrite de/df/d1d/d23/d25/d28/d7b/ff2 [0,4194304] 0 2024-09-10T09:36:36.108 INFO:tasks.workunit.client.1.smithi135.stdout:9/912: dread de/f4a [0,4194304] 0 2024-09-10T09:36:36.108 INFO:tasks.workunit.client.1.smithi135.stdout:3/689: dwrite d4/d5/dc/f50 [0,4194304] 0 2024-09-10T09:36:36.108 INFO:tasks.workunit.client.1.smithi135.stdout:9/913: readlink de/df/d1d/d1e/db5/lf3 0 2024-09-10T09:36:36.114 INFO:tasks.workunit.client.1.smithi135.stdout:3/690: dread d4/f96 [0,4194304] 0 2024-09-10T09:36:36.114 INFO:tasks.workunit.client.1.smithi135.stdout:3/691: truncate d4/d55/fc9 433251 0 2024-09-10T09:36:36.115 INFO:tasks.workunit.client.1.smithi135.stdout:9/914: link de/f117 de/df/d1d/d23/d25/d28/d7b/f128 0 2024-09-10T09:36:36.115 INFO:tasks.workunit.client.1.smithi135.stdout:9/915: chown de/df/dac 1928264 1 2024-09-10T09:36:36.115 INFO:tasks.workunit.client.1.smithi135.stdout:9/916: chown de/df/dac/l104 2 1 2024-09-10T09:36:36.119 INFO:tasks.workunit.client.1.smithi135.stdout:3/692: rename d4/d5/d56/c7c to d4/d5/dc/ccc 0 2024-09-10T09:36:36.119 INFO:tasks.workunit.client.1.smithi135.stdout:3/693: write d4/d5/dc/f19 [6483512,42854] 0 2024-09-10T09:36:36.121 INFO:tasks.workunit.client.1.smithi135.stdout:9/917: mknod de/df/dac/c129 0 2024-09-10T09:36:36.124 INFO:tasks.workunit.client.1.smithi135.stdout:3/694: creat d4/d5/db/dd/d79/fcd x:0 0 0 2024-09-10T09:36:36.125 INFO:tasks.workunit.client.1.smithi135.stdout:9/918: rename de/df/c3b to de/df/d1d/d23/d25/d28/d7b/dcf/c12a 0 2024-09-10T09:36:36.127 INFO:tasks.workunit.client.1.smithi135.stdout:3/695: mkdir d4/d5/dc/dce 0 2024-09-10T09:36:36.127 INFO:tasks.workunit.client.1.smithi135.stdout:3/696: read d4/d5/dc/f10 [155003,26509] 0 2024-09-10T09:36:36.127 INFO:tasks.workunit.client.1.smithi135.stdout:3/697: fdatasync d4/f25 0 2024-09-10T09:36:36.132 INFO:tasks.workunit.client.1.smithi135.stdout:2/855: sync 2024-09-10T09:36:36.132 INFO:tasks.workunit.client.1.smithi135.stdout:1/949: sync 2024-09-10T09:36:36.132 INFO:tasks.workunit.client.1.smithi135.stdout:7/800: sync 2024-09-10T09:36:36.132 INFO:tasks.workunit.client.1.smithi135.stdout:8/808: sync 2024-09-10T09:36:36.132 INFO:tasks.workunit.client.1.smithi135.stdout:8/809: write d1/f7 [3008090,57598] 0 2024-09-10T09:36:36.132 INFO:tasks.workunit.client.1.smithi135.stdout:8/810: chown d1/d8f/da0/dd9/d103 8 1 2024-09-10T09:36:36.133 INFO:tasks.workunit.client.1.smithi135.stdout:8/811: truncate d1/d15/d49/d7c/fd0 947999 0 2024-09-10T09:36:36.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/892: sync 2024-09-10T09:36:36.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/893: chown d3/dc/dba/d48/d57/da3/d10f/c110 1991 1 2024-09-10T09:36:36.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/894: chown d3/dc/dba/d88/fcf 416157344 1 2024-09-10T09:36:36.134 INFO:tasks.workunit.client.1.smithi135.stdout:9/919: write de/df/d1d/d1e/db5/d88/f93 [8121909,74901] 0 2024-09-10T09:36:36.134 INFO:tasks.workunit.client.1.smithi135.stdout:9/920: dread - de/df/d1d/d1e/d3f/f65 zero size 2024-09-10T09:36:36.134 INFO:tasks.workunit.client.1.smithi135.stdout:9/921: dread - de/df/d1d/d1e/d3f/dbb/f115 zero size 2024-09-10T09:36:36.141 INFO:tasks.workunit.client.1.smithi135.stdout:3/698: rmdir d4/d5/db/d36/d43 39 2024-09-10T09:36:36.141 INFO:tasks.workunit.client.1.smithi135.stdout:8/812: dread d1/d27/f40 [0,4194304] 0 2024-09-10T09:36:36.143 INFO:tasks.workunit.client.1.smithi135.stdout:1/950: truncate d1d/d20/d52/d8a/f101 1633983 0 2024-09-10T09:36:36.143 INFO:tasks.workunit.client.1.smithi135.stdout:1/951: dread - d1d/d20/d52/d8a/fbd zero size 2024-09-10T09:36:36.146 INFO:tasks.workunit.client.1.smithi135.stdout:0/953: sync 2024-09-10T09:36:36.147 INFO:tasks.workunit.client.1.smithi135.stdout:7/801: symlink d2/d15/lf5 0 2024-09-10T09:36:36.147 INFO:tasks.workunit.client.1.smithi135.stdout:7/802: write d2/d15/d4a/f5a [419368,28014] 0 2024-09-10T09:36:36.148 INFO:tasks.workunit.client.1.smithi135.stdout:2/856: mkdir df/d1b/d23/d98/d5f/d3d/d87/db0/d112 0 2024-09-10T09:36:36.150 INFO:tasks.workunit.client.1.smithi135.stdout:5/895: mknod d3/c13d 0 2024-09-10T09:36:36.151 INFO:tasks.workunit.client.1.smithi135.stdout:9/922: mkdir de/df/d1d/d1e/db5/d88/dde/d12b 0 2024-09-10T09:36:36.152 INFO:tasks.workunit.client.1.smithi135.stdout:5/896: dread d3/dc/dba/d4e/dd0/faa [0,4194304] 0 2024-09-10T09:36:36.154 INFO:tasks.workunit.client.1.smithi135.stdout:3/699: mkdir d4/d5/d51/dcf 0 2024-09-10T09:36:36.154 INFO:tasks.workunit.client.1.smithi135.stdout:3/700: write d4/d5/db/f2f [521786,65518] 0 2024-09-10T09:36:36.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/813: link d1/d15/d49/c83 d1/d15/c104 0 2024-09-10T09:36:36.156 INFO:tasks.workunit.client.1.smithi135.stdout:8/814: chown d1/d27/c53 441002538 1 2024-09-10T09:36:36.158 INFO:tasks.workunit.client.1.smithi135.stdout:0/954: chown d8/dd/f4c 14670 1 2024-09-10T09:36:36.159 INFO:tasks.workunit.client.1.smithi135.stdout:0/955: creat d8/dd/d11/d17/df6/f141 x:0 0 0 2024-09-10T09:36:36.161 INFO:tasks.workunit.client.1.smithi135.stdout:7/803: symlink d2/d25/daa/lf6 0 2024-09-10T09:36:36.162 INFO:tasks.workunit.client.1.smithi135.stdout:2/857: creat df/d1b/d23/d42/f113 x:0 0 0 2024-09-10T09:36:36.165 INFO:tasks.workunit.client.1.smithi135.stdout:8/815: write d1/d15/fcc [326035,81763] 0 2024-09-10T09:36:36.165 INFO:tasks.workunit.client.1.smithi135.stdout:8/816: chown d1/d15/d49/c90 1004 1 2024-09-10T09:36:36.165 INFO:tasks.workunit.client.1.smithi135.stdout:9/923: symlink de/df/dac/l12c 0 2024-09-10T09:36:36.165 INFO:tasks.workunit.client.1.smithi135.stdout:9/924: dread - de/df/d1d/d23/d25/d28/d4e/f7a zero size 2024-09-10T09:36:36.166 INFO:tasks.workunit.client.1.smithi135.stdout:5/897: link d3/dc/dba/d4e/dd0/faa d3/dc/dba/d4e/f13e 0 2024-09-10T09:36:36.166 INFO:tasks.workunit.client.1.smithi135.stdout:5/898: fdatasync d3/d91/f98 0 2024-09-10T09:36:36.168 INFO:tasks.workunit.client.1.smithi135.stdout:3/701: mknod d4/d5/d56/cd0 0 2024-09-10T09:36:36.169 INFO:tasks.workunit.client.1.smithi135.stdout:1/952: rmdir d1d/d20/d9a/dff/d109/d114 39 2024-09-10T09:36:36.169 INFO:tasks.workunit.client.1.smithi135.stdout:3/702: write d4/d5/dc/d71/f9e [799149,100794] 0 2024-09-10T09:36:36.172 INFO:tasks.workunit.client.1.smithi135.stdout:0/956: rename d8/d80/d10a/d73/l12e to d8/dd/d18/d3d/dc3/d61/db1/l142 0 2024-09-10T09:36:36.173 INFO:tasks.workunit.client.1.smithi135.stdout:3/703: rename d4 to d4/d5/d76/dd1 22 2024-09-10T09:36:36.173 INFO:tasks.workunit.client.1.smithi135.stdout:3/704: chown d4/d5/db/dd/d79/fcd 906 1 2024-09-10T09:36:36.173 INFO:tasks.workunit.client.1.smithi135.stdout:7/804: symlink d2/d15/d39/d9f/db2/dcc/d49/d60/de4/lf7 0 2024-09-10T09:36:36.173 INFO:tasks.workunit.client.1.smithi135.stdout:7/805: getdents d2/d15/d4a/d36/d84 0 2024-09-10T09:36:36.173 INFO:tasks.workunit.client.1.smithi135.stdout:7/806: write d2/d15/d39/d9f/db2/dcc/d49/fde [223592,5566] 0 2024-09-10T09:36:36.175 INFO:tasks.workunit.client.1.smithi135.stdout:2/858: creat df/d13/d102/d107/f114 x:0 0 0 2024-09-10T09:36:36.178 INFO:tasks.workunit.client.1.smithi135.stdout:8/817: truncate d1/d15/d16/f61 252161 0 2024-09-10T09:36:36.179 INFO:tasks.workunit.client.1.smithi135.stdout:9/925: symlink de/df/d1d/d1e/d52/d86/l12d 0 2024-09-10T09:36:36.183 INFO:tasks.workunit.client.1.smithi135.stdout:5/899: symlink d3/dc/dba/d48/d57/dca/l13f 0 2024-09-10T09:36:36.188 INFO:tasks.workunit.client.1.smithi135.stdout:1/953: link d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/f66 d1d/d71/d9e/f12e 0 2024-09-10T09:36:36.191 INFO:tasks.workunit.client.1.smithi135.stdout:0/957: unlink d8/de/f38 0 2024-09-10T09:36:36.191 INFO:tasks.workunit.client.1.smithi135.stdout:0/958: readlink d8/d80/d10a/l6b 0 2024-09-10T09:36:36.197 INFO:tasks.workunit.client.1.smithi135.stdout:3/705: rename d4/d5/d51/da3 to d4/d5/db/d44/da9/dd2 0 2024-09-10T09:36:36.197 INFO:tasks.workunit.client.1.smithi135.stdout:9/926: dwrite de/df/d1d/d1e/db5/d88/f98 [0,4194304] 0 2024-09-10T09:36:36.197 INFO:tasks.workunit.client.1.smithi135.stdout:9/927: fdatasync de/df/d7e/f107 0 2024-09-10T09:36:36.203 INFO:tasks.workunit.client.1.smithi135.stdout:7/807: mkdir d2/d15/d39/d9f/db2/dcc/d49/d60/d16/df8 0 2024-09-10T09:36:36.203 INFO:tasks.workunit.client.1.smithi135.stdout:7/808: write d2/d15/f47 [1271297,27838] 0 2024-09-10T09:36:36.209 INFO:tasks.workunit.client.1.smithi135.stdout:8/818: symlink d1/d15/d49/l105 0 2024-09-10T09:36:36.209 INFO:tasks.workunit.client.1.smithi135.stdout:8/819: chown d1/cc 3917136 1 2024-09-10T09:36:36.210 INFO:tasks.workunit.client.1.smithi135.stdout:5/900: mknod d3/dc/d16/dc0/c140 0 2024-09-10T09:36:36.213 INFO:tasks.workunit.client.1.smithi135.stdout:1/954: dwrite d1d/f2a [0,4194304] 0 2024-09-10T09:36:36.213 INFO:tasks.workunit.client.1.smithi135.stdout:1/955: truncate d1d/d20/d52/d8a/dc2/dca/d2b/d4c/f55 4862958 0 2024-09-10T09:36:36.213 INFO:tasks.workunit.client.1.smithi135.stdout:0/959: creat d8/d80/d10a/d73/dc5/f143 x:0 0 0 2024-09-10T09:36:36.215 INFO:tasks.workunit.client.1.smithi135.stdout:3/706: rename f1 to d4/d5/dc/d71/fd3 0 2024-09-10T09:36:36.226 INFO:tasks.workunit.client.1.smithi135.stdout:2/859: rmdir df/d13/d96 39 2024-09-10T09:36:36.230 INFO:tasks.workunit.client.1.smithi135.stdout:8/820: unlink d1/d8f/da2/cba 0 2024-09-10T09:36:36.234 INFO:tasks.workunit.client.1.smithi135.stdout:5/901: unlink d3/dc/f37 0 2024-09-10T09:36:36.239 INFO:tasks.workunit.client.1.smithi135.stdout:0/960: creat d8/d80/d10a/d73/d125/de7/f144 x:0 0 0 2024-09-10T09:36:36.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/809: rename d2/d15/d39/d9f/db2/dcc/d49/d60/fe9 to d2/d15/d39/d9f/db2/dcc/d49/ff9 0 2024-09-10T09:36:36.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/810: fdatasync d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/de7/fee 0 2024-09-10T09:36:36.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/811: chown d2/d15/d39/d9f/db2/dcc/fb9 1 1 2024-09-10T09:36:36.243 INFO:tasks.workunit.client.1.smithi135.stdout:7/812: write d2/d15/d39/d9f/db2/dcc/d49/de8/fda [55537,49771] 0 2024-09-10T09:36:36.248 INFO:tasks.workunit.client.1.smithi135.stdout:2/860: mknod df/d13/d4f/d95/d97/d9a/c115 0 2024-09-10T09:36:36.248 INFO:tasks.workunit.client.1.smithi135.stdout:2/861: readlink df/d13/l66 0 2024-09-10T09:36:36.253 INFO:tasks.workunit.client.1.smithi135.stdout:8/821: mkdir d1/d15/d24/d106 0 2024-09-10T09:36:36.253 INFO:tasks.workunit.client.1.smithi135.stdout:8/822: chown d1/d15/d16/d33/d39/l82 133 1 2024-09-10T09:36:36.254 INFO:tasks.workunit.client.1.smithi135.stdout:2/862: dread df/f12 [0,4194304] 0 2024-09-10T09:36:36.254 INFO:tasks.workunit.client.1.smithi135.stdout:2/863: dread - df/d1b/d23/d98/d5f/d3d/d87/db0/f100 zero size 2024-09-10T09:36:36.254 INFO:tasks.workunit.client.1.smithi135.stdout:7/813: dread d2/d25/da8/fd9 [0,4194304] 0 2024-09-10T09:36:36.254 INFO:tasks.workunit.client.1.smithi135.stdout:0/961: mknod d8/d80/d10a/d73/d125/de7/c145 0 2024-09-10T09:36:36.255 INFO:tasks.workunit.client.1.smithi135.stdout:0/962: chown d8/d80/d10a/ce6 176688 1 2024-09-10T09:36:36.256 INFO:tasks.workunit.client.1.smithi135.stdout:8/823: mknod d1/d15/d49/d7c/c107 0 2024-09-10T09:36:36.257 INFO:tasks.workunit.client.1.smithi135.stdout:8/824: write d1/d15/f19 [1209070,122347] 0 2024-09-10T09:36:36.260 INFO:tasks.workunit.client.1.smithi135.stdout:7/814: symlink d2/d25/d5d/d83/dcd/lfa 0 2024-09-10T09:36:36.260 INFO:tasks.workunit.client.1.smithi135.stdout:7/815: fdatasync d2/d15/d39/d53/fbc 0 2024-09-10T09:36:36.274 INFO:tasks.workunit.client.1.smithi135.stdout:7/816: mkdir d2/d25/daa/dfb 0 2024-09-10T09:36:36.280 INFO:tasks.workunit.client.1.smithi135.stdout:0/963: dwrite d8/dd/d4a/d50/d54/d5f/d11c/f12c [0,4194304] 0 2024-09-10T09:36:36.282 INFO:tasks.workunit.client.1.smithi135.stdout:8/825: getdents d1/d15/d16/d33/d45/d70 0 2024-09-10T09:36:36.286 INFO:tasks.workunit.client.1.smithi135.stdout:2/864: rename df/d1b/d30 to df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116 0 2024-09-10T09:36:36.288 INFO:tasks.workunit.client.1.smithi135.stdout:0/964: dread d8/dd/db0/fd1 [0,4194304] 0 2024-09-10T09:36:36.289 INFO:tasks.workunit.client.1.smithi135.stdout:7/817: mknod d2/d15/d39/d9f/db2/dcc/d49/d60/de4/cfc 0 2024-09-10T09:36:36.298 INFO:tasks.workunit.client.1.smithi135.stdout:8/826: mkdir d1/d27/d3d/d94/da7/d108 0 2024-09-10T09:36:36.299 INFO:tasks.workunit.client.1.smithi135.stdout:2/865: mknod df/d13/d102/d107/c117 0 2024-09-10T09:36:36.301 INFO:tasks.workunit.client.1.smithi135.stdout:0/965: mkdir d8/de/d2e/d11e/d146 0 2024-09-10T09:36:36.301 INFO:tasks.workunit.client.1.smithi135.stdout:0/966: write d8/dd/d11/ff3 [4069273,60267] 0 2024-09-10T09:36:36.304 INFO:tasks.workunit.client.1.smithi135.stdout:0/967: link d8/d80/d10a/d73/d125/db9/dc1/ff4 d8/d80/dfd/d123/f147 0 2024-09-10T09:36:36.304 INFO:tasks.workunit.client.1.smithi135.stdout:0/968: dread - d8/d80/d10a/d73/d125/db9/dc1/f128 zero size 2024-09-10T09:36:36.305 INFO:tasks.workunit.client.1.smithi135.stdout:0/969: mkdir d8/de/d2e/d11e/d12a/d12d/d148 0 2024-09-10T09:36:36.309 INFO:tasks.workunit.client.1.smithi135.stdout:7/818: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/d16/fdb [0,4194304] 0 2024-09-10T09:36:36.312 INFO:tasks.workunit.client.1.smithi135.stdout:8/827: dread d1/d15/d16/d33/d45/d6f/f92 [0,4194304] 0 2024-09-10T09:36:36.312 INFO:tasks.workunit.client.1.smithi135.stdout:7/819: mkdir d2/d15/d39/d9f/db2/dcc/d49/d60/d16/df8/dfd 0 2024-09-10T09:36:36.313 INFO:tasks.workunit.client.1.smithi135.stdout:8/828: symlink d1/d15/d16/d33/d45/l109 0 2024-09-10T09:36:36.315 INFO:tasks.workunit.client.1.smithi135.stdout:2/866: write df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/f92 [2351295,90315] 0 2024-09-10T09:36:36.316 INFO:tasks.workunit.client.1.smithi135.stdout:2/867: creat df/d1b/d23/d98/d5f/d3d/f118 x:0 0 0 2024-09-10T09:36:36.317 INFO:tasks.workunit.client.1.smithi135.stdout:8/829: mknod d1/d15/d16/d33/d39/c10a 0 2024-09-10T09:36:36.317 INFO:tasks.workunit.client.1.smithi135.stdout:8/830: creat d1/d15/d16/d99/da9/dce/f10b x:0 0 0 2024-09-10T09:36:36.326 INFO:tasks.workunit.client.1.smithi135.stdout:0/970: dwrite d8/d80/d10a/d73/d125/de7/f109 [0,4194304] 0 2024-09-10T09:36:36.332 INFO:tasks.workunit.client.1.smithi135.stdout:0/971: getdents d8/dd/d18/d3d/dc3/d61/db1 0 2024-09-10T09:36:36.337 INFO:tasks.workunit.client.1.smithi135.stdout:7/820: write d2/d15/d39/d9f/db2/dcc/d49/fa0 [701297,64655] 0 2024-09-10T09:36:36.340 INFO:tasks.workunit.client.1.smithi135.stdout:8/831: dwrite d1/d15/d16/d33/d39/f9a [0,4194304] 0 2024-09-10T09:36:36.341 INFO:tasks.workunit.client.1.smithi135.stdout:8/832: write d1/d13/fae [390755,94715] 0 2024-09-10T09:36:36.350 INFO:tasks.workunit.client.1.smithi135.stdout:8/833: dread d1/d15/d16/d33/d45/dc4/fee [0,4194304] 0 2024-09-10T09:36:36.355 INFO:tasks.workunit.client.1.smithi135.stdout:0/972: dwrite d8/dd/d11/d17/df6/f141 [0,4194304] 0 2024-09-10T09:36:36.366 INFO:tasks.workunit.client.1.smithi135.stdout:7/821: dwrite d2/d15/d39/f7e [0,4194304] 0 2024-09-10T09:36:36.368 INFO:tasks.workunit.client.1.smithi135.stdout:0/973: read d8/f86 [3752364,66526] 0 2024-09-10T09:36:36.369 INFO:tasks.workunit.client.1.smithi135.stdout:7/822: truncate d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/f64 693660 0 2024-09-10T09:36:36.371 INFO:tasks.workunit.client.1.smithi135.stdout:7/823: rename d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f70 to d2/d15/d39/d9f/db2/ffe 0 2024-09-10T09:36:36.373 INFO:tasks.workunit.client.1.smithi135.stdout:0/974: dread d8/dd/db0/fd1 [0,4194304] 0 2024-09-10T09:36:36.376 INFO:tasks.workunit.client.1.smithi135.stdout:0/975: rename d8/d80/d10a/cc2 to d8/de/d105/c149 0 2024-09-10T09:36:36.377 INFO:tasks.workunit.client.1.smithi135.stdout:7/824: rmdir d2/d15/d39/d9f/db2/dcc/d49/d60/d16 39 2024-09-10T09:36:36.379 INFO:tasks.workunit.client.1.smithi135.stdout:7/825: mkdir d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def/dff 0 2024-09-10T09:36:36.402 INFO:tasks.workunit.client.1.smithi135.stdout:8/834: dwrite d1/d15/d49/d7c/fd0 [0,4194304] 0 2024-09-10T09:36:36.402 INFO:tasks.workunit.client.1.smithi135.stdout:0/976: dwrite d8/d80/d10a/d73/d125/de7/f109 [0,4194304] 0 2024-09-10T09:36:36.411 INFO:tasks.workunit.client.1.smithi135.stdout:8/835: truncate d1/f25 781496 0 2024-09-10T09:36:36.417 INFO:tasks.workunit.client.1.smithi135.stdout:8/836: dread d1/d15/d24/f7e [4194304,4194304] 0 2024-09-10T09:36:36.417 INFO:tasks.workunit.client.1.smithi135.stdout:8/837: chown d1/d15/d16/d33/d45/d6f/fb4 2192 1 2024-09-10T09:36:36.417 INFO:tasks.workunit.client.1.smithi135.stdout:8/838: stat d1/d13/l98 0 2024-09-10T09:36:36.417 INFO:tasks.workunit.client.1.smithi135.stdout:8/839: chown d1/d8f/da2 10533537 1 2024-09-10T09:36:36.418 INFO:tasks.workunit.client.1.smithi135.stdout:0/977: dwrite d8/d80/d10a/d73/d125/db9/dc1/f7b [0,4194304] 0 2024-09-10T09:36:36.418 INFO:tasks.workunit.client.1.smithi135.stdout:0/978: write d8/dd/db0/fd1 [4981689,45093] 0 2024-09-10T09:36:36.418 INFO:tasks.workunit.client.1.smithi135.stdout:8/840: read d1/d15/d16/d33/d39/fb9 [142355,100498] 0 2024-09-10T09:36:36.419 INFO:tasks.workunit.client.1.smithi135.stdout:0/979: truncate d8/d80/f8b 1236210 0 2024-09-10T09:36:36.420 INFO:tasks.workunit.client.1.smithi135.stdout:8/841: dread d1/d15/d49/fbd [4194304,4194304] 0 2024-09-10T09:36:36.423 INFO:tasks.workunit.client.1.smithi135.stdout:8/842: symlink d1/d27/l10c 0 2024-09-10T09:36:36.427 INFO:tasks.workunit.client.1.smithi135.stdout:0/980: write d8/dd/d11/d17/df6/f141 [1043447,1668] 0 2024-09-10T09:36:36.431 INFO:tasks.workunit.client.1.smithi135.stdout:8/843: dread d1/d15/f9d [0,4194304] 0 2024-09-10T09:36:36.433 INFO:tasks.workunit.client.1.smithi135.stdout:8/844: link d1/d27/f40 d1/f10d 0 2024-09-10T09:36:36.436 INFO:tasks.workunit.client.1.smithi135.stdout:0/981: dread d8/d80/d10a/d73/d125/db9/fd9 [0,4194304] 0 2024-09-10T09:36:36.437 INFO:tasks.workunit.client.1.smithi135.stdout:0/982: readlink d8/de/l3c 0 2024-09-10T09:36:36.437 INFO:tasks.workunit.client.1.smithi135.stdout:8/845: dread d1/d15/d16/d96/fbe [0,4194304] 0 2024-09-10T09:36:36.438 INFO:tasks.workunit.client.1.smithi135.stdout:8/846: chown d1/d27/d3d 37 1 2024-09-10T09:36:36.438 INFO:tasks.workunit.client.1.smithi135.stdout:8/847: stat d1/d15/d16/d33/d45/d6f/caf 0 2024-09-10T09:36:36.438 INFO:tasks.workunit.client.1.smithi135.stdout:8/848: read d1/d8f/fdb [87379,92762] 0 2024-09-10T09:36:36.439 INFO:tasks.workunit.client.1.smithi135.stdout:8/849: mkdir d1/d27/d10e 0 2024-09-10T09:36:36.439 INFO:tasks.workunit.client.1.smithi135.stdout:8/850: write d1/d8f/fb8 [1012031,85429] 0 2024-09-10T09:36:36.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/851: mknod d1/d15/d16/d96/c10f 0 2024-09-10T09:36:36.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/852: read d1/fad [48386,76336] 0 2024-09-10T09:36:36.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/853: chown d1/l77 533 1 2024-09-10T09:36:36.440 INFO:tasks.workunit.client.1.smithi135.stdout:8/854: fdatasync d1/f10d 0 2024-09-10T09:36:36.451 INFO:tasks.workunit.client.1.smithi135.stdout:0/983: dread d8/de/f4d [0,4194304] 0 2024-09-10T09:36:36.452 INFO:tasks.workunit.client.1.smithi135.stdout:0/984: write d8/dd/d4a/f84 [952607,17727] 0 2024-09-10T09:36:36.452 INFO:tasks.workunit.client.1.smithi135.stdout:0/985: chown d8/d80/d10a/d73/dc8/caf 2790 1 2024-09-10T09:36:36.458 INFO:tasks.workunit.client.1.smithi135.stdout:8/855: dwrite d1/d27/f68 [0,4194304] 0 2024-09-10T09:36:36.458 INFO:tasks.workunit.client.1.smithi135.stdout:8/856: readlink d1/d8f/da0/dd9/lf9 0 2024-09-10T09:36:36.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/986: dread d8/de/f68 [0,4194304] 0 2024-09-10T09:36:36.459 INFO:tasks.workunit.client.1.smithi135.stdout:0/987: creat d8/de/d105/f14a x:0 0 0 2024-09-10T09:36:36.466 INFO:tasks.workunit.client.1.smithi135.stdout:8/857: mkdir d1/d15/d16/d99/da9/d110 0 2024-09-10T09:36:36.468 INFO:tasks.workunit.client.1.smithi135.stdout:0/988: creat d8/d80/d10a/d73/d88/de4/f14b x:0 0 0 2024-09-10T09:36:36.470 INFO:tasks.workunit.client.1.smithi135.stdout:8/858: mkdir d1/d8f/da0/de0/d111 0 2024-09-10T09:36:36.472 INFO:tasks.workunit.client.1.smithi135.stdout:0/989: getdents d8/dd/d11/d90/df0 0 2024-09-10T09:36:36.472 INFO:tasks.workunit.client.1.smithi135.stdout:0/990: dread - d8/d80/d10a/d9c/dcf/f129 zero size 2024-09-10T09:36:36.473 INFO:tasks.workunit.client.1.smithi135.stdout:8/859: creat d1/d15/d16/d33/dfb/f112 x:0 0 0 2024-09-10T09:36:36.475 INFO:tasks.workunit.client.1.smithi135.stdout:0/991: mkdir d8/d80/d10a/d9c/dcf/d14c 0 2024-09-10T09:36:36.476 INFO:tasks.workunit.client.1.smithi135.stdout:8/860: symlink d1/d8f/da0/l113 0 2024-09-10T09:36:36.498 INFO:tasks.workunit.client.1.smithi135.stdout:9/928: sync 2024-09-10T09:36:36.498 INFO:tasks.workunit.client.1.smithi135.stdout:9/929: write de/df/f114 [361892,20516] 0 2024-09-10T09:36:36.498 INFO:tasks.workunit.client.1.smithi135.stdout:9/930: write de/df/d1d/d1e/d68/f112 [200520,106385] 0 2024-09-10T09:36:36.498 INFO:tasks.workunit.client.1.smithi135.stdout:9/931: chown de/df/d1d/d23/d25/d28/d7b/c122 1856886 1 2024-09-10T09:36:36.499 INFO:tasks.workunit.client.1.smithi135.stdout:8/861: dread d1/d15/d16/d33/d45/d6f/fb4 [0,4194304] 0 2024-09-10T09:36:36.499 INFO:tasks.workunit.client.1.smithi135.stdout:8/862: chown d1/d15/d16/d71 250360801 1 2024-09-10T09:36:36.499 INFO:tasks.workunit.client.1.smithi135.stdout:0/992: dwrite d8/fb [4194304,4194304] 0 2024-09-10T09:36:36.499 INFO:tasks.workunit.client.1.smithi135.stdout:8/863: write d1/d15/d16/d33/dfb/f112 [318274,101098] 0 2024-09-10T09:36:36.500 INFO:tasks.workunit.client.1.smithi135.stdout:0/993: link d8/d80/d10a/d73/d7f/l13b d8/dd/db0/l14d 0 2024-09-10T09:36:36.501 INFO:tasks.workunit.client.1.smithi135.stdout:8/864: unlink d1/d15/d24/f7e 0 2024-09-10T09:36:36.505 INFO:tasks.workunit.client.1.smithi135.stdout:0/994: getdents d8/dd/d18/d3d 0 2024-09-10T09:36:36.507 INFO:tasks.workunit.client.1.smithi135.stdout:9/932: dread de/df/d1d/d62/ff1 [0,4194304] 0 2024-09-10T09:36:36.515 INFO:tasks.workunit.client.1.smithi135.stdout:0/995: write d8/dd/d11/d90/fb8 [2801619,4310] 0 2024-09-10T09:36:36.515 INFO:tasks.workunit.client.1.smithi135.stdout:0/996: write d8/d80/d10a/d73/d125/db9/fd7 [7859,119770] 0 2024-09-10T09:36:36.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/933: write de/df/d1d/d1e/db5/d88/f98 [1061999,35796] 0 2024-09-10T09:36:36.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/934: truncate de/df/d1d/d23/d25/d28/dbe/f11d 161474 0 2024-09-10T09:36:36.516 INFO:tasks.workunit.client.1.smithi135.stdout:9/935: stat de/df/f10 0 2024-09-10T09:36:36.516 INFO:tasks.workunit.client.1.smithi135.stdout:0/997: mknod d8/dd/d18/d3d/dc3/c14e 0 2024-09-10T09:36:36.534 INFO:tasks.workunit.client.1.smithi135.stdout:0/998: dread d8/d80/d10a/d73/d125/de7/f109 [0,4194304] 0 2024-09-10T09:36:36.534 INFO:tasks.workunit.client.1.smithi135.stdout:9/936: dwrite de/df/d1d/d1e/db5/d88/f11b [0,4194304] 0 2024-09-10T09:36:36.540 INFO:tasks.workunit.client.1.smithi135.stdout:0/999: link d8/d80/d10a/d73/d125/f106 d8/dd/d18/d3d/dc3/d61/df9/f14f 0 2024-09-10T09:36:36.550 INFO:tasks.workunit.client.1.smithi135.stdout:9/937: dwrite de/df/d1d/d1e/d52/fc8 [0,4194304] 0 2024-09-10T09:36:36.552 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:36 smithi079 ceph-mon[27592]: [10/Sep/2024:09:36:34] ENGINE Bus STARTING 2024-09-10T09:36:36.552 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:36 smithi079 ceph-mon[27592]: [10/Sep/2024:09:36:34] ENGINE Serving on https://172.21.15.135:7150 2024-09-10T09:36:36.552 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:36 smithi079 ceph-mon[27592]: [10/Sep/2024:09:36:34] ENGINE Error in HTTPServer.serve 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Traceback (most recent call last): 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._run(expiration_interval) 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: s = self.context.wrap_socket( 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:36:36.553 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: return self.sslsocket_class._create( 2024-09-10T09:36:36.554 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:36:36.554 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self.do_handshake() 2024-09-10T09:36:36.554 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:36:36.554 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._sslobj.do_handshake() 2024-09-10T09:36:36.554 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:36:36.554 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:36 smithi079 ceph-mon[27592]: [10/Sep/2024:09:36:34] ENGINE Serving on http://172.21.15.135:8765 2024-09-10T09:36:36.554 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:36 smithi079 ceph-mon[27592]: [10/Sep/2024:09:36:34] ENGINE Bus STARTED 2024-09-10T09:36:36.574 INFO:tasks.workunit.client.1.smithi135.stdout:9/938: dwrite de/df/d1d/d23/d25/fc1 [0,4194304] 0 2024-09-10T09:36:36.579 INFO:tasks.workunit.client.1.smithi135.stdout:9/939: getdents de/df/d1d/d23/d25/d78/dec 0 2024-09-10T09:36:36.588 INFO:tasks.workunit.client.1.smithi135.stdout:9/940: dread de/df/d1d/fc7 [0,4194304] 0 2024-09-10T09:36:36.588 INFO:tasks.workunit.client.1.smithi135.stdout:9/941: write de/df/d1d/d23/f26 [1886538,89322] 0 2024-09-10T09:36:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.599+0000 7ff2e54ea700 1 -- 172.21.15.79:0/2744798560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2e01018a0 msgr2=0x7ff2e0101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.599+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/2744798560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2e01018a0 0x7ff2e0101cb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009910 tx=0x7ff2d0009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.599+0000 7ff2e54ea700 1 -- 172.21.15.79:0/2744798560 shutdown_connections 2024-09-10T09:36:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.599+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/2744798560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 0x7ff2e00fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.599+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/2744798560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2e01018a0 0x7ff2e0101cb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:36.602 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.599+0000 7ff2e54ea700 1 -- 172.21.15.79:0/2744798560 >> 172.21.15.79:0/2744798560 conn(0x7ff2e00f9f10 msgr2=0x7ff2e00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.600+0000 7ff2e54ea700 1 -- 172.21.15.79:0/2744798560 shutdown_connections 2024-09-10T09:36:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.600+0000 7ff2e54ea700 1 -- 172.21.15.79:0/2744798560 wait complete. 2024-09-10T09:36:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.601+0000 7ff2e54ea700 1 Processor -- start 2024-09-10T09:36:36.603 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.601+0000 7ff2e54ea700 1 -- start start 2024-09-10T09:36:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.601+0000 7ff2e54ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2e01018a0 0x7ff2e0100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.601+0000 7ff2e54ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 0x7ff2e00ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.601+0000 7ff2e54ea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00ffb30 con 0x7ff2e01018a0 2024-09-10T09:36:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.601+0000 7ff2e54ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00ffc70 con 0x7ff2e01021f0 2024-09-10T09:36:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2de7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 0x7ff2e00ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2de7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 0x7ff2e00ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:44772/0 (socket says 172.21.15.79:44772) 2024-09-10T09:36:36.604 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2de7fc700 1 -- 172.21.15.79:0/3673890834 learned_addr learned my addr 172.21.15.79:0/3673890834 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2de7fc700 1 -- 172.21.15.79:0/3673890834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2e01018a0 msgr2=0x7ff2e0100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2de7fc700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2e01018a0 0x7ff2e0100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2de7fc700 1 -- 172.21.15.79:0/3673890834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00095f0 con 0x7ff2e01021f0 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2de7fc700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 0x7ff2e00ff5f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400e970 tx=0x7ff2d400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2c7fff700 1 -- 172.21.15.79:0/3673890834 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2d4009750 con 0x7ff2e01021f0 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2c7fff700 1 -- 172.21.15.79:0/3673890834 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff2d4004ce0 con 0x7ff2e01021f0 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2c7fff700 1 -- 172.21.15.79:0/3673890834 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2d4005690 con 0x7ff2e01021f0 2024-09-10T09:36:36.606 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.602+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00fff50 con 0x7ff2e01021f0 2024-09-10T09:36:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.603+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e0100440 con 0x7ff2e01021f0 2024-09-10T09:36:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.604+0000 7ff2c7fff700 1 -- 172.21.15.79:0/3673890834 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 46428+0+0 (secure 0 0 0) 0x7ff2d4021440 con 0x7ff2e01021f0 2024-09-10T09:36:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.604+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e0108d50 con 0x7ff2e01021f0 2024-09-10T09:36:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.604+0000 7ff2c7fff700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff2c8039360 0x7ff2c803b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.604+0000 7ff2c7fff700 1 -- 172.21.15.79:0/3673890834 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff2d4014070 con 0x7ff2e01021f0 2024-09-10T09:36:36.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.604+0000 7ff2deffd700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff2c8039360 0x7ff2c803b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:36.607 INFO:tasks.workunit.client.1.smithi135.stdout:9/942: dwrite de/df/d1d/d1e/d68/d9f/fab [0,4194304] 0 2024-09-10T09:36:36.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.605+0000 7ff2deffd700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff2c8039360 0x7ff2c803b810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009fd0 tx=0x7ff2d0000bc0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:36.609 INFO:tasks.workunit.client.1.smithi135.stdout:9/943: truncate de/df/f40 3102852 0 2024-09-10T09:36:36.609 INFO:tasks.workunit.client.1.smithi135.stdout:9/944: mknod de/df/d1d/d23/d25/d28/d7b/dcf/c12e 0 2024-09-10T09:36:36.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.612+0000 7ff2c7fff700 1 -- 172.21.15.79:0/3673890834 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff2d4016330 con 0x7ff2e01021f0 2024-09-10T09:36:36.618 INFO:tasks.workunit.client.1.smithi135.stdout:9/945: dread de/df/d1d/d23/d25/d28/d7b/f108 [0,4194304] 0 2024-09-10T09:36:36.620 INFO:tasks.workunit.client.1.smithi135.stdout:9/946: mknod de/df/d1d/d62/c12f 0 2024-09-10T09:36:36.624 INFO:tasks.workunit.client.1.smithi135.stdout:9/947: rename de/df/d1d/d1e/db5/ce7 to de/df/d1d/d23/d25/d28/d4e/c130 0 2024-09-10T09:36:36.624 INFO:tasks.workunit.client.1.smithi135.stdout:9/948: write de/df/d1d/d1e/d52/f11e [822680,33636] 0 2024-09-10T09:36:36.625 INFO:tasks.workunit.client.1.smithi135.stdout:9/949: symlink de/df/d1d/d23/d25/d78/dec/l131 0 2024-09-10T09:36:36.642 INFO:tasks.workunit.client.1.smithi135.stdout:9/950: dwrite de/df/d1d/d1e/d3f/dbb/f115 [0,4194304] 0 2024-09-10T09:36:36.643 INFO:tasks.workunit.client.1.smithi135.stdout:9/951: chown de/df/d1d/d1e/lee 3199 1 2024-09-10T09:36:36.643 INFO:tasks.workunit.client.1.smithi135.stdout:9/952: write f6 [2081616,103335] 0 2024-09-10T09:36:36.643 INFO:tasks.workunit.client.1.smithi135.stdout:9/953: fsync de/df/dac/ffb 0 2024-09-10T09:36:36.643 INFO:tasks.workunit.client.1.smithi135.stdout:1/956: sync 2024-09-10T09:36:36.643 INFO:tasks.workunit.client.1.smithi135.stdout:9/954: readlink de/df/d1d/d1e/d52/d86/l12d 0 2024-09-10T09:36:36.646 INFO:tasks.workunit.client.1.smithi135.stdout:1/957: symlink d1d/d20/l12f 0 2024-09-10T09:36:36.647 INFO:tasks.workunit.client.1.smithi135.stdout:9/955: symlink de/l132 0 2024-09-10T09:36:36.649 INFO:tasks.workunit.client.1.smithi135.stdout:9/956: getdents de/df/d1d/d23/d25/d28/d4e 0 2024-09-10T09:36:36.657 INFO:tasks.workunit.client.1.smithi135.stdout:9/957: dread de/df/d1d/d23/d25/d28/d7b/f108 [0,4194304] 0 2024-09-10T09:36:36.659 INFO:tasks.workunit.client.1.smithi135.stdout:9/958: unlink de/df/d1d/d1e/d68/d9f/cb4 0 2024-09-10T09:36:36.667 INFO:tasks.workunit.client.1.smithi135.stdout:1/958: dwrite d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/f66 [0,4194304] 0 2024-09-10T09:36:36.667 INFO:tasks.workunit.client.1.smithi135.stdout:9/959: dread de/df/d1d/d1e/d52/fc8 [0,4194304] 0 2024-09-10T09:36:36.668 INFO:tasks.workunit.client.1.smithi135.stdout:9/960: rmdir de/df/d1d/d1e/db5/d88/dc6 39 2024-09-10T09:36:36.670 INFO:tasks.workunit.client.1.smithi135.stdout:1/959: dread d1d/d28/f7c [0,4194304] 0 2024-09-10T09:36:36.670 INFO:tasks.workunit.client.1.smithi135.stdout:9/961: rmdir de/df/d1d/d23/d25/d28/d101 0 2024-09-10T09:36:36.670 INFO:tasks.workunit.client.1.smithi135.stdout:9/962: stat de/df/d1d/d23/d25/fcc 0 2024-09-10T09:36:36.670 INFO:tasks.workunit.client.1.smithi135.stdout:9/963: write de/df/f10 [3161626,49276] 0 2024-09-10T09:36:36.672 INFO:tasks.workunit.client.1.smithi135.stdout:1/960: mknod d1d/d20/d52/d8a/dc2/dca/d2b/da8/c130 0 2024-09-10T09:36:36.673 INFO:tasks.workunit.client.1.smithi135.stdout:1/961: rmdir d1d/d28/d4b/d53 39 2024-09-10T09:36:36.676 INFO:tasks.workunit.client.1.smithi135.stdout:9/964: rmdir de/df/d1d/d6b 39 2024-09-10T09:36:36.687 INFO:tasks.workunit.client.1.smithi135.stdout:9/965: read de/df/d1d/d23/f67 [1074230,24881] 0 2024-09-10T09:36:36.688 INFO:tasks.workunit.client.1.smithi135.stdout:9/966: creat de/df/f133 x:0 0 0 2024-09-10T09:36:36.703 INFO:tasks.workunit.client.1.smithi135.stdout:9/967: dwrite de/df/d1d/d23/d25/d28/d7b/ff2 [4194304,4194304] 0 2024-09-10T09:36:36.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:36:34] ENGINE Bus STARTING 2024-09-10T09:36:36.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:36:34] ENGINE Serving on https://172.21.15.135:7150 2024-09-10T09:36:36.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:36:34] ENGINE Error in HTTPServer.serve 2024-09-10T09:36:36.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Traceback (most recent call last): 2024-09-10T09:36:36.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._run(expiration_interval) 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: s = self.context.wrap_socket( 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: return self.sslsocket_class._create( 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self.do_handshake() 2024-09-10T09:36:36.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:36:36.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._sslobj.do_handshake() 2024-09-10T09:36:36.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:36:36.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:36:34] ENGINE Serving on http://172.21.15.135:8765 2024-09-10T09:36:36.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:36:34] ENGINE Bus STARTED 2024-09-10T09:36:36.725 INFO:tasks.workunit.client.1.smithi135.stdout:9/968: dwrite de/f18 [0,4194304] 0 2024-09-10T09:36:36.746 INFO:tasks.workunit.client.1.smithi135.stdout:9/969: dwrite de/df/fda [0,4194304] 0 2024-09-10T09:36:36.749 INFO:tasks.workunit.client.1.smithi135.stdout:9/970: symlink de/df/dac/l134 0 2024-09-10T09:36:36.749 INFO:tasks.workunit.client.1.smithi135.stdout:9/971: write de/df/d1d/f3a [36197,47733] 0 2024-09-10T09:36:36.752 INFO:tasks.workunit.client.1.smithi135.stdout:9/972: link de/df/d1d/d23/d25/d28/d7b/dcf/c12a de/df/d1d/d23/d25/d28/d7b/dcf/c135 0 2024-09-10T09:36:36.752 INFO:tasks.workunit.client.1.smithi135.stdout:9/973: read - de/df/d1d/d23/d25/d28/d7b/f128 zero size 2024-09-10T09:36:36.754 INFO:tasks.workunit.client.1.smithi135.stdout:9/974: mkdir de/df/d1d/d23/d25/d78/dec/d136 0 2024-09-10T09:36:36.754 INFO:tasks.workunit.client.1.smithi135.stdout:9/975: dread - de/df/d1d/d1e/fa2 zero size 2024-09-10T09:36:36.754 INFO:tasks.workunit.client.1.smithi135.stdout:9/976: readlink de/df/d1d/d23/d25/d28/l118 0 2024-09-10T09:36:36.762 INFO:tasks.workunit.client.1.smithi135.stdout:9/977: read de/df/d1d/d1e/d3f/f97 [437774,54327] 0 2024-09-10T09:36:36.762 INFO:tasks.workunit.client.1.smithi135.stdout:9/978: dread - de/df/d1d/d23/d25/d28/d7b/f128 zero size 2024-09-10T09:36:36.778 INFO:tasks.workunit.client.1.smithi135.stdout:9/979: dwrite f9 [4194304,4194304] 0 2024-09-10T09:36:36.790 INFO:tasks.workunit.client.1.smithi135.stdout:9/980: dread de/df/d1d/d23/f42 [0,4194304] 0 2024-09-10T09:36:36.800 INFO:tasks.workunit.client.1.smithi135.stdout:9/981: write de/df/d1d/d1e/d68/d9f/fd5 [5315627,37953] 0 2024-09-10T09:36:36.808 INFO:tasks.workunit.client.1.smithi135.stdout:9/982: dread de/df/d1d/d1e/db5/d88/fd2 [0,4194304] 0 2024-09-10T09:36:36.809 INFO:tasks.workunit.client.1.smithi135.stdout:9/983: mknod de/df/c137 0 2024-09-10T09:36:36.811 INFO:tasks.workunit.client.1.smithi135.stdout:9/984: symlink de/df/l138 0 2024-09-10T09:36:36.811 INFO:tasks.workunit.client.1.smithi135.stdout:9/985: write de/df/d1d/d1e/d52/f11e [1699604,101258] 0 2024-09-10T09:36:36.827 INFO:tasks.workunit.client.1.smithi135.stdout:5/902: sync 2024-09-10T09:36:36.827 INFO:tasks.workunit.client.1.smithi135.stdout:2/868: sync 2024-09-10T09:36:36.827 INFO:tasks.workunit.client.1.smithi135.stdout:3/707: sync 2024-09-10T09:36:36.827 INFO:tasks.workunit.client.1.smithi135.stdout:7/826: sync 2024-09-10T09:36:36.827 INFO:tasks.workunit.client.1.smithi135.stdout:3/708: fsync d4/d5/f8c 0 2024-09-10T09:36:36.829 INFO:tasks.workunit.client.1.smithi135.stdout:9/986: dwrite de/df/d1d/f43 [0,4194304] 0 2024-09-10T09:36:36.829 INFO:tasks.workunit.client.1.smithi135.stdout:3/709: dread d4/d55/d5d/d5b/f6c [0,4194304] 0 2024-09-10T09:36:36.833 INFO:tasks.workunit.client.1.smithi135.stdout:2/869: rename df/d1b/d23/d98/d5f/d2c/d7d/d8c/f99 to df/d13/d4f/f119 0 2024-09-10T09:36:36.834 INFO:tasks.workunit.client.1.smithi135.stdout:2/870: getdents df/d1b/d23/d98/d5f/d2c/d7d 0 2024-09-10T09:36:36.834 INFO:tasks.workunit.client.1.smithi135.stdout:9/987: dread de/df/d7e/ff6 [0,4194304] 0 2024-09-10T09:36:36.835 INFO:tasks.workunit.client.1.smithi135.stdout:5/903: mkdir d3/dc/dba/d48/d141 0 2024-09-10T09:36:36.835 INFO:tasks.workunit.client.1.smithi135.stdout:9/988: truncate de/df/f113 320297 0 2024-09-10T09:36:36.836 INFO:tasks.workunit.client.1.smithi135.stdout:7/827: creat d2/d15/d4a/d36/f100 x:0 0 0 2024-09-10T09:36:36.837 INFO:tasks.workunit.client.1.smithi135.stdout:5/904: rename d3/dc/dba/d48/d57/f5e to d3/dc/dba/d93/f142 0 2024-09-10T09:36:36.837 INFO:tasks.workunit.client.1.smithi135.stdout:5/905: readlink d3/dc/d16/l82 0 2024-09-10T09:36:36.839 INFO:tasks.workunit.client.1.smithi135.stdout:7/828: symlink d2/d15/d39/d9f/db2/dcc/d49/d60/d16/df8/l101 0 2024-09-10T09:36:36.839 INFO:tasks.workunit.client.1.smithi135.stdout:7/829: chown d2/d15/d39/d9f/db2/c7d 7652268 1 2024-09-10T09:36:36.840 INFO:tasks.workunit.client.1.smithi135.stdout:7/830: fdatasync d2/d25/f38 0 2024-09-10T09:36:36.842 INFO:tasks.workunit.client.1.smithi135.stdout:7/831: rename d2/d15/d5c/d62/cab to d2/d25/da8/c102 0 2024-09-10T09:36:36.843 INFO:tasks.workunit.client.1.smithi135.stdout:3/710: dread d4/d55/d5d/d5b/f8d [4194304,4194304] 0 2024-09-10T09:36:36.844 INFO:tasks.workunit.client.1.smithi135.stdout:7/832: truncate d2/d15/d39/f6d 3140622 0 2024-09-10T09:36:36.846 INFO:tasks.workunit.client.1.smithi135.stdout:3/711: link d4/d5/db/d44/c63 d4/d5/d76/cd4 0 2024-09-10T09:36:36.847 INFO:tasks.workunit.client.1.smithi135.stdout:3/712: fdatasync d4/d5/dc/f19 0 2024-09-10T09:36:36.849 INFO:tasks.workunit.client.1.smithi135.stdout:7/833: truncate d2/d25/d9d/daf/fc0 1322720 0 2024-09-10T09:36:36.851 INFO:tasks.workunit.client.1.smithi135.stdout:2/871: read df/d1b/db7/ff5 [3046671,98286] 0 2024-09-10T09:36:36.855 INFO:tasks.workunit.client.1.smithi135.stdout:7/834: creat d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def/f103 x:0 0 0 2024-09-10T09:36:36.861 INFO:tasks.workunit.client.1.smithi135.stdout:5/906: dwrite d3/d44/f74 [0,4194304] 0 2024-09-10T09:36:36.861 INFO:tasks.workunit.client.1.smithi135.stdout:5/907: write d3/d71/d61/ffb [974351,90450] 0 2024-09-10T09:36:36.861 INFO:tasks.workunit.client.1.smithi135.stdout:5/908: write d3/d71/d61/f121 [5091692,4698] 0 2024-09-10T09:36:36.864 INFO:tasks.workunit.client.1.smithi135.stdout:3/713: rmdir d4/d55 39 2024-09-10T09:36:36.864 INFO:tasks.workunit.client.1.smithi135.stdout:3/714: read d4/d5/db/f4c [616283,12167] 0 2024-09-10T09:36:36.868 INFO:tasks.workunit.client.1.smithi135.stdout:3/715: dread d4/d5/db/d36/d43/f6e [0,4194304] 0 2024-09-10T09:36:36.868 INFO:tasks.workunit.client.1.smithi135.stdout:3/716: creat d4/d5/d51/fd5 x:0 0 0 2024-09-10T09:36:36.868 INFO:tasks.workunit.client.1.smithi135.stdout:3/717: write d4/d5/dc/f69 [665693,109725] 0 2024-09-10T09:36:36.868 INFO:tasks.workunit.client.1.smithi135.stdout:3/718: truncate d4/f4d 4499826 0 2024-09-10T09:36:36.872 INFO:tasks.workunit.client.1.smithi135.stdout:2/872: dwrite df/d13/d52/fae [4194304,4194304] 0 2024-09-10T09:36:36.873 INFO:tasks.workunit.client.1.smithi135.stdout:5/909: dread d3/dc/dba/dae/fce [0,4194304] 0 2024-09-10T09:36:36.880 INFO:tasks.workunit.client.1.smithi135.stdout:7/835: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/f75 [0,4194304] 0 2024-09-10T09:36:36.882 INFO:tasks.workunit.client.1.smithi135.stdout:2/873: mknod df/d13/d96/d10a/c11a 0 2024-09-10T09:36:36.882 INFO:tasks.workunit.client.1.smithi135.stdout:2/874: dread - df/d15/fe6 zero size 2024-09-10T09:36:36.883 INFO:tasks.workunit.client.1.smithi135.stdout:5/910: getdents d3/dc/dba 0 2024-09-10T09:36:36.883 INFO:tasks.workunit.client.1.smithi135.stdout:5/911: chown d3/d91/db5/cc7 505 1 2024-09-10T09:36:36.883 INFO:tasks.workunit.client.1.smithi135.stdout:2/875: dread df/d1b/faf [0,4194304] 0 2024-09-10T09:36:36.886 INFO:tasks.workunit.client.1.smithi135.stdout:5/912: rmdir d3/dc/d69/de9 39 2024-09-10T09:36:36.888 INFO:tasks.workunit.client.1.smithi135.stdout:5/913: creat d3/dc/dba/d93/f143 x:0 0 0 2024-09-10T09:36:36.890 INFO:tasks.workunit.client.1.smithi135.stdout:5/914: mknod d3/dc/dba/d4e/dd0/c144 0 2024-09-10T09:36:36.890 INFO:tasks.workunit.client.1.smithi135.stdout:2/876: dread f8 [0,4194304] 0 2024-09-10T09:36:36.891 INFO:tasks.workunit.client.1.smithi135.stdout:5/915: mkdir d3/dc/dba/d93/d145 0 2024-09-10T09:36:36.891 INFO:tasks.workunit.client.1.smithi135.stdout:5/916: creat d3/dc/dba/dbf/f146 x:0 0 0 2024-09-10T09:36:36.893 INFO:tasks.workunit.client.1.smithi135.stdout:2/877: unlink df/d1b/d23/f8a 0 2024-09-10T09:36:36.893 INFO:tasks.workunit.client.1.smithi135.stdout:2/878: write df/d1b/d31/f8d [1607679,119322] 0 2024-09-10T09:36:36.894 INFO:tasks.workunit.client.1.smithi135.stdout:2/879: truncate df/d1b/d70/f78 937381 0 2024-09-10T09:36:36.898 INFO:tasks.workunit.client.1.smithi135.stdout:2/880: dread df/f12 [0,4194304] 0 2024-09-10T09:36:36.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.903+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2e0105f90 con 0x7ff2c8039360 2024-09-10T09:36:36.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.905+0000 7ff2c7fff700 1 -- 172.21.15.79:0/3673890834 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff2e0105f90 con 0x7ff2c8039360 2024-09-10T09:36:36.908 INFO:tasks.workunit.client.1.smithi135.stdout:7/836: dwrite d2/d25/da8/fd9 [0,4194304] 0 2024-09-10T09:36:36.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff2c8039360 msgr2=0x7ff2c803b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:36.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff2c8039360 0x7ff2c803b810 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009fd0 tx=0x7ff2d0000bc0 comp rx=0 tx=0).stop 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 msgr2=0x7ff2e00ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 0x7ff2e00ff5f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400e970 tx=0x7ff2d400ed30 comp rx=0 tx=0).stop 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 shutdown_connections 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff2c8039360 0x7ff2c803b810 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2e01018a0 0x7ff2e0100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 --2- 172.21.15.79:0/3673890834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2e01021f0 0x7ff2e00ff5f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 >> 172.21.15.79:0/3673890834 conn(0x7ff2e00f9f10 msgr2=0x7ff2e0104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 shutdown_connections 2024-09-10T09:36:36.911 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:36.908+0000 7ff2e54ea700 1 -- 172.21.15.79:0/3673890834 wait complete. 2024-09-10T09:36:36.912 INFO:tasks.workunit.client.1.smithi135.stdout:5/917: dwrite d3/dc/dba/d48/d57/dc4/f13a [0,4194304] 0 2024-09-10T09:36:36.915 INFO:tasks.workunit.client.1.smithi135.stdout:5/918: symlink d3/d99/l147 0 2024-09-10T09:36:36.917 INFO:tasks.workunit.client.1.smithi135.stdout:5/919: mknod d3/dc/dba/d88/c148 0 2024-09-10T09:36:36.921 INFO:tasks.workunit.client.1.smithi135.stdout:5/920: getdents d3/d71/d61 0 2024-09-10T09:36:36.921 INFO:tasks.workunit.client.1.smithi135.stdout:5/921: dread - d3/dc/dba/d93/f143 zero size 2024-09-10T09:36:36.921 INFO:tasks.workunit.client.1.smithi135.stdout:5/922: chown d3/d44/c102 32975583 1 2024-09-10T09:36:36.924 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:36:36.937 INFO:tasks.workunit.client.1.smithi135.stdout:5/923: dwrite d3/f14 [0,4194304] 0 2024-09-10T09:36:36.937 INFO:tasks.workunit.client.1.smithi135.stdout:5/924: write d3/d81/d8d/fa8 [1654516,47824] 0 2024-09-10T09:36:36.941 INFO:tasks.workunit.client.1.smithi135.stdout:5/925: dread d3/dc/d69/d72/f12a [0,4194304] 0 2024-09-10T09:36:36.942 INFO:tasks.workunit.client.1.smithi135.stdout:5/926: mkdir d3/dc/dba/d4e/d149 0 2024-09-10T09:36:36.946 INFO:tasks.workunit.client.1.smithi135.stdout:5/927: link d3/d71/d61/l6b d3/d91/db5/l14a 0 2024-09-10T09:36:36.949 INFO:tasks.workunit.client.1.smithi135.stdout:5/928: rename d3/dc/d69/d65/d6c/d108/c10b to d3/d99/d13b/c14b 0 2024-09-10T09:36:36.951 INFO:tasks.workunit.client.1.smithi135.stdout:5/929: creat d3/dc/dba/d48/d57/da3/f14c x:0 0 0 2024-09-10T09:36:36.959 INFO:tasks.workunit.client.1.smithi135.stdout:8/865: sync 2024-09-10T09:36:36.959 INFO:tasks.workunit.client.1.smithi135.stdout:8/866: chown d1/d27/l10c 1073 1 2024-09-10T09:36:36.962 INFO:tasks.workunit.client.1.smithi135.stdout:2/881: dwrite df/d1b/d23/fbe [0,4194304] 0 2024-09-10T09:36:36.963 INFO:tasks.workunit.client.1.smithi135.stdout:8/867: mkdir d1/d15/d24/d106/d114 0 2024-09-10T09:36:36.963 INFO:tasks.workunit.client.1.smithi135.stdout:5/930: dread d3/d99/fc8 [0,4194304] 0 2024-09-10T09:36:36.967 INFO:tasks.workunit.client.1.smithi135.stdout:5/931: creat d3/d81/d120/f14d x:0 0 0 2024-09-10T09:36:36.970 INFO:tasks.workunit.client.1.smithi135.stdout:5/932: write d3/dc/d16/dc0/fc5 [790715,40484] 0 2024-09-10T09:36:36.971 INFO:tasks.workunit.client.1.smithi135.stdout:5/933: write d3/dc/dba/d48/d57/dc4/f11a [591084,86061] 0 2024-09-10T09:36:36.971 INFO:tasks.workunit.client.1.smithi135.stdout:5/934: write d3/dc/d69/d65/d6c/ff8 [897238,74035] 0 2024-09-10T09:36:36.977 INFO:tasks.workunit.client.1.smithi135.stdout:8/868: dread d1/d27/f68 [0,4194304] 0 2024-09-10T09:36:36.980 INFO:tasks.workunit.client.1.smithi135.stdout:8/869: mknod d1/d8f/c115 0 2024-09-10T09:36:36.980 INFO:tasks.workunit.client.1.smithi135.stdout:8/870: fsync d1/f23 0 2024-09-10T09:36:36.980 INFO:tasks.workunit.client.1.smithi135.stdout:8/871: readlink d1/lc5 0 2024-09-10T09:36:36.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/872: creat d1/d15/d49/f116 x:0 0 0 2024-09-10T09:36:36.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/873: dread - d1/d15/d49/ffa zero size 2024-09-10T09:36:36.982 INFO:tasks.workunit.client.1.smithi135.stdout:8/874: write d1/d15/d16/d33/d39/fe4 [639347,68482] 0 2024-09-10T09:36:36.988 INFO:tasks.workunit.client.1.smithi135.stdout:8/875: dread d1/d15/d49/f4e [0,4194304] 0 2024-09-10T09:36:36.991 INFO:tasks.workunit.client.1.smithi135.stdout:8/876: creat d1/d27/d3d/d94/da7/f117 x:0 0 0 2024-09-10T09:36:37.002 INFO:tasks.workunit.client.1.smithi135.stdout:2/882: dwrite df/d13/d102/fbd [0,4194304] 0 2024-09-10T09:36:37.004 INFO:tasks.workunit.client.1.smithi135.stdout:5/935: dwrite d3/d81/d8d/fa8 [0,4194304] 0 2024-09-10T09:36:37.008 INFO:tasks.workunit.client.1.smithi135.stdout:5/936: unlink d3/d71/c51 0 2024-09-10T09:36:37.008 INFO:tasks.workunit.client.1.smithi135.stdout:5/937: chown d3/d81/d120 479 1 2024-09-10T09:36:37.011 INFO:tasks.workunit.client.1.smithi135.stdout:8/877: dread d1/f20 [0,4194304] 0 2024-09-10T09:36:37.012 INFO:tasks.workunit.client.1.smithi135.stdout:5/938: rename d3/dc/dba/d48/dd2 to d3/dc/d69/d14e 0 2024-09-10T09:36:37.014 INFO:tasks.workunit.client.1.smithi135.stdout:5/939: symlink d3/d81/d8d/l14f 0 2024-09-10T09:36:37.020 INFO:tasks.workunit.client.1.smithi135.stdout:8/878: dread d1/d15/d16/d33/d45/d6f/f92 [0,4194304] 0 2024-09-10T09:36:37.021 INFO:tasks.workunit.client.1.smithi135.stdout:8/879: write d1/d15/d16/d33/d39/f7d [2459469,113100] 0 2024-09-10T09:36:37.023 INFO:tasks.workunit.client.1.smithi135.stdout:5/940: rename d3/d44 to d3/d99/d150 0 2024-09-10T09:36:37.025 INFO:tasks.workunit.client.1.smithi135.stdout:8/880: symlink d1/d27/d3d/d94/da7/l118 0 2024-09-10T09:36:37.025 INFO:tasks.workunit.client.1.smithi135.stdout:8/881: fsync d1/d15/d16/f29 0 2024-09-10T09:36:37.025 INFO:tasks.workunit.client.1.smithi135.stdout:5/941: dread d3/dc/d16/f130 [0,4194304] 0 2024-09-10T09:36:37.032 INFO:tasks.workunit.client.1.smithi135.stdout:8/882: dread d1/d15/d16/d33/d45/d6f/f92 [0,4194304] 0 2024-09-10T09:36:37.043 INFO:tasks.workunit.client.1.smithi135.stdout:2/883: dwrite df/d1b/d23/d98/d5f/d3d/f106 [0,4194304] 0 2024-09-10T09:36:37.043 INFO:tasks.workunit.client.1.smithi135.stdout:2/884: getdents df/d1b/db7 0 2024-09-10T09:36:37.043 INFO:tasks.workunit.client.1.smithi135.stdout:2/885: truncate df/d1b/d23/d98/d5f/d3d/f118 181268 0 2024-09-10T09:36:37.043 INFO:tasks.workunit.client.1.smithi135.stdout:2/886: chown df/d1b/d23/d98/f73 770631178 1 2024-09-10T09:36:37.043 INFO:tasks.workunit.client.1.smithi135.stdout:5/942: dread d3/dc/dba/d48/d57/da3/fc6 [0,4194304] 0 2024-09-10T09:36:37.058 INFO:tasks.workunit.client.1.smithi135.stdout:2/887: mkdir df/d1b/d31/d11b 0 2024-09-10T09:36:37.058 INFO:tasks.workunit.client.1.smithi135.stdout:2/888: write df/d1b/d23/d98/d5f/d3d/d87/fd9 [1859712,2466] 0 2024-09-10T09:36:37.058 INFO:tasks.workunit.client.1.smithi135.stdout:2/889: fdatasync df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/fe0 0 2024-09-10T09:36:37.059 INFO:tasks.workunit.client.1.smithi135.stdout:2/890: mknod df/d1b/d23/d98/d5f/d3d/d87/c11c 0 2024-09-10T09:36:37.061 INFO:tasks.workunit.client.1.smithi135.stdout:2/891: rmdir df/d13/d96 39 2024-09-10T09:36:37.064 INFO:tasks.workunit.client.1.smithi135.stdout:2/892: getdents df/d13/d4f/d95/d97/d9a 0 2024-09-10T09:36:37.064 INFO:tasks.workunit.client.1.smithi135.stdout:2/893: write df/f12 [1705862,124978] 0 2024-09-10T09:36:37.066 INFO:tasks.workunit.client.1.smithi135.stdout:8/883: dwrite d1/fdd [4194304,4194304] 0 2024-09-10T09:36:37.066 INFO:tasks.workunit.client.1.smithi135.stdout:8/884: read - d1/d15/fe9 zero size 2024-09-10T09:36:37.066 INFO:tasks.workunit.client.1.smithi135.stdout:5/943: dwrite d3/dc/d69/d65/d6c/ff7 [0,4194304] 0 2024-09-10T09:36:37.067 INFO:tasks.workunit.client.1.smithi135.stdout:2/894: creat df/d1b/d31/d11b/f11d x:0 0 0 2024-09-10T09:36:37.067 INFO:tasks.workunit.client.1.smithi135.stdout:2/895: chown df/d13 724 1 2024-09-10T09:36:37.067 INFO:tasks.workunit.client.1.smithi135.stdout:2/896: read - df/d1b/d23/d98/d5f/fe3 zero size 2024-09-10T09:36:37.079 INFO:tasks.workunit.client.1.smithi135.stdout:5/944: rename d3/dc/d69/d65/d6c/l101 to d3/dc/d7a/l151 0 2024-09-10T09:36:37.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/897: unlink df/d15/l20 0 2024-09-10T09:36:37.082 INFO:tasks.workunit.client.1.smithi135.stdout:2/898: write df/d15/fe6 [1035630,119557] 0 2024-09-10T09:36:37.084 INFO:tasks.workunit.client.1.smithi135.stdout:5/945: rename d3/d91/db5/fe3 to d3/d81/f152 0 2024-09-10T09:36:37.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.085+0000 7fdf3b14b700 1 -- 172.21.15.79:0/884496208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 msgr2=0x7fdf341018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.085+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/884496208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 0x7fdf341018a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009910 tx=0x7fdf28009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:37.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.085+0000 7fdf3b14b700 1 -- 172.21.15.79:0/884496208 shutdown_connections 2024-09-10T09:36:37.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.085+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/884496208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 0x7fdf341018a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.085+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/884496208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 0x7fdf34100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.085+0000 7fdf3b14b700 1 -- 172.21.15.79:0/884496208 >> 172.21.15.79:0/884496208 conn(0x7fdf340fb7e0 msgr2=0x7fdf340fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:37.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.086+0000 7fdf3b14b700 1 -- 172.21.15.79:0/884496208 shutdown_connections 2024-09-10T09:36:37.088 INFO:tasks.workunit.client.1.smithi135.stdout:2/899: rename df/d13/f7a to df/d1b/d23/f11e 0 2024-09-10T09:36:37.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.086+0000 7fdf3b14b700 1 -- 172.21.15.79:0/884496208 wait complete. 2024-09-10T09:36:37.089 INFO:tasks.workunit.client.1.smithi135.stdout:8/885: dwrite d1/d15/d24/f3f [4194304,4194304] 0 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.087+0000 7fdf3b14b700 1 Processor -- start 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.087+0000 7fdf3b14b700 1 -- start start 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.087+0000 7fdf3b14b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 0x7fdf34074b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.087+0000 7fdf3b14b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 0x7fdf340731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.087+0000 7fdf3b14b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34199690 con 0x7fdf34101450 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.087+0000 7fdf3b14b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf341997d0 con 0x7fdf34100250 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.088+0000 7fdf38ee7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 0x7fdf34074b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.088+0000 7fdf38ee7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 0x7fdf34074b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:44790/0 (socket says 172.21.15.79:44790) 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.088+0000 7fdf38ee7700 1 -- 172.21.15.79:0/1010433587 learned_addr learned my addr 172.21.15.79:0/1010433587 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:37.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.088+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 0x7fdf340731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:37.091 INFO:tasks.workunit.client.1.smithi135.stdout:5/946: creat d3/d91/db5/f153 x:0 0 0 2024-09-10T09:36:37.091 INFO:tasks.workunit.client.1.smithi135.stdout:5/947: write d3/d71/d61/f112 [1346938,124200] 0 2024-09-10T09:36:37.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/900: symlink df/d1b/d31/l11f 0 2024-09-10T09:36:37.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/901: dread - df/d13/d4f/d95/ffc zero size 2024-09-10T09:36:37.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/902: creat df/d1b/d70/f120 x:0 0 0 2024-09-10T09:36:37.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/903: dread - df/d1b/d23/d98/d5f/d3d/d87/db0/f100 zero size 2024-09-10T09:36:37.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/904: creat df/d13/d4f/d95/d97/f121 x:0 0 0 2024-09-10T09:36:37.092 INFO:tasks.workunit.client.1.smithi135.stdout:2/905: fdatasync df/d13/d52/d8f/fe7 0 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.088+0000 7fdf38ee7700 1 -- 172.21.15.79:0/1010433587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 msgr2=0x7fdf340731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.088+0000 7fdf38ee7700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 0x7fdf340731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.088+0000 7fdf38ee7700 1 -- 172.21.15.79:0/1010433587 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280095f0 con 0x7fdf34100250 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.089+0000 7fdf38ee7700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 0x7fdf34074b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400d900 tx=0x7fdf2400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.089+0000 7fdf31ffb700 1 -- 172.21.15.79:0/1010433587 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf240041f0 con 0x7fdf34100250 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.089+0000 7fdf31ffb700 1 -- 172.21.15.79:0/1010433587 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf24004350 con 0x7fdf34100250 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.089+0000 7fdf31ffb700 1 -- 172.21.15.79:0/1010433587 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf24003cf0 con 0x7fdf34100250 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.089+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf34073740 con 0x7fdf34100250 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.089+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf34073c60 con 0x7fdf34100250 2024-09-10T09:36:37.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.091+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf34073f40 con 0x7fdf34100250 2024-09-10T09:36:37.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.091+0000 7fdf31ffb700 1 -- 172.21.15.79:0/1010433587 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 46428+0+0 (secure 0 0 0) 0x7fdf24009730 con 0x7fdf34100250 2024-09-10T09:36:37.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.092+0000 7fdf31ffb700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fdf1c039400 0x7fdf1c03b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:37.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.092+0000 7fdf31ffb700 1 -- 172.21.15.79:0/1010433587 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdf2404cfe0 con 0x7fdf34100250 2024-09-10T09:36:37.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.092+0000 7fdf33fff700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fdf1c039400 0x7fdf1c03b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:37.096 INFO:tasks.workunit.client.1.smithi135.stdout:8/886: rmdir d1/d27/d3d 39 2024-09-10T09:36:37.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.095+0000 7fdf33fff700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fdf1c039400 0x7fdf1c03b8b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800b5c0 tx=0x7fdf28005ee0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:37.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.105+0000 7fdf31ffb700 1 -- 172.21.15.79:0/1010433587 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fdf24003e50 con 0x7fdf34100250 2024-09-10T09:36:37.108 INFO:tasks.workunit.client.1.smithi135.stdout:1/962: sync 2024-09-10T09:36:37.108 INFO:tasks.workunit.client.1.smithi135.stdout:1/963: stat d1d/l61 0 2024-09-10T09:36:37.109 INFO:tasks.workunit.client.1.smithi135.stdout:8/887: creat d1/d8f/da0/de0/f119 x:0 0 0 2024-09-10T09:36:37.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/888: rename d1/d15/fcc to d1/d8f/da0/dd9/f11a 0 2024-09-10T09:36:37.113 INFO:tasks.workunit.client.1.smithi135.stdout:8/889: stat d1/d15/d24/d106/d114 0 2024-09-10T09:36:37.116 INFO:tasks.workunit.client.1.smithi135.stdout:8/890: unlink d1/d8f/da0/dd9/c101 0 2024-09-10T09:36:37.116 INFO:tasks.workunit.client.1.smithi135.stdout:8/891: stat d1/d15/d16/d33/d45/d6f/f92 0 2024-09-10T09:36:37.116 INFO:tasks.workunit.client.1.smithi135.stdout:8/892: creat d1/d15/d49/f11b x:0 0 0 2024-09-10T09:36:37.121 INFO:tasks.workunit.client.1.smithi135.stdout:2/906: dwrite df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/f37 [0,4194304] 0 2024-09-10T09:36:37.122 INFO:tasks.workunit.client.1.smithi135.stdout:5/948: dwrite d3/d91/db5/fd8 [0,4194304] 0 2024-09-10T09:36:37.123 INFO:tasks.workunit.client.1.smithi135.stdout:2/907: mkdir df/d1b/d23/d98/d5f/d3d/d87/db0/d122 0 2024-09-10T09:36:37.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/949: truncate d3/d71/d61/f121 3538659 0 2024-09-10T09:36:37.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/950: chown d3/d71/d61/f121 138 1 2024-09-10T09:36:37.133 INFO:tasks.workunit.client.1.smithi135.stdout:5/951: chown d3/dc/d16/c84 179114 1 2024-09-10T09:36:37.133 INFO:tasks.workunit.client.1.smithi135.stdout:1/964: dwrite d1d/d28/d4b/d53/f8d [0,4194304] 0 2024-09-10T09:36:37.136 INFO:tasks.workunit.client.1.smithi135.stdout:8/893: dwrite d1/d15/d16/d33/d45/fd8 [0,4194304] 0 2024-09-10T09:36:37.137 INFO:tasks.workunit.client.1.smithi135.stdout:1/965: dread d1d/d20/d52/d8a/dc2/dca/d2b/fef [0,4194304] 0 2024-09-10T09:36:37.137 INFO:tasks.workunit.client.1.smithi135.stdout:1/966: chown d1d/d20/d52/d8a 0 1 2024-09-10T09:36:37.137 INFO:tasks.workunit.client.1.smithi135.stdout:1/967: readlink d1d/d20/d42/dd3/df5/lbb 0 2024-09-10T09:36:37.137 INFO:tasks.workunit.client.1.smithi135.stdout:1/968: write d1d/f27 [2352230,33119] 0 2024-09-10T09:36:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:2/908: rename df/d13/l49 to df/dde/l123 0 2024-09-10T09:36:37.138 INFO:tasks.workunit.client.1.smithi135.stdout:1/969: dread d1d/d20/f2e [0,4194304] 0 2024-09-10T09:36:37.141 INFO:tasks.workunit.client.1.smithi135.stdout:5/952: mkdir d3/dc/dba/d4e/d154 0 2024-09-10T09:36:37.148 INFO:tasks.workunit.client.1.smithi135.stdout:5/953: write d3/dc/d69/f73 [3733602,122469] 0 2024-09-10T09:36:37.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/894: link d1/d15/d49/d7c/lbf d1/d27/d3d/l11c 0 2024-09-10T09:36:37.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/895: chown d1/d13/l58 1 1 2024-09-10T09:36:37.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/896: chown d1/d15/l8b 11282 1 2024-09-10T09:36:37.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/897: truncate d1/d15/d24/f2d 564840 0 2024-09-10T09:36:37.154 INFO:tasks.workunit.client.1.smithi135.stdout:2/909: rename df/d13/d96 to df/d13/d52/d124 0 2024-09-10T09:36:37.159 INFO:tasks.workunit.client.1.smithi135.stdout:1/970: rmdir d1d/d20/d9a/dff/d109/d114 39 2024-09-10T09:36:37.163 INFO:tasks.workunit.client.1.smithi135.stdout:5/954: link d3/f12 d3/dc/d7a/f155 0 2024-09-10T09:36:37.167 INFO:tasks.workunit.client.1.smithi135.stdout:8/898: creat d1/d27/d3d/d94/da7/d108/f11d x:0 0 0 2024-09-10T09:36:37.168 INFO:tasks.workunit.client.1.smithi135.stdout:1/971: symlink d1d/l131 0 2024-09-10T09:36:37.170 INFO:tasks.workunit.client.1.smithi135.stdout:5/955: rename d3/dc/dba/d48/l60 to d3/dc/dba/d88/l156 0 2024-09-10T09:36:37.171 INFO:tasks.workunit.client.1.smithi135.stdout:8/899: symlink d1/d15/d16/d33/dfb/l11e 0 2024-09-10T09:36:37.173 INFO:tasks.workunit.client.1.smithi135.stdout:1/972: symlink d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/l132 0 2024-09-10T09:36:37.173 INFO:tasks.workunit.client.1.smithi135.stdout:1/973: fdatasync d1d/d28/d4b/dda/fe6 0 2024-09-10T09:36:37.175 INFO:tasks.workunit.client.1.smithi135.stdout:8/900: rename d1/d15/d16/d33/d39/f7d to d1/d27/d10e/f11f 0 2024-09-10T09:36:37.175 INFO:tasks.workunit.client.1.smithi135.stdout:8/901: write d1/d27/d3d/d94/da7/fbb [589439,126363] 0 2024-09-10T09:36:37.175 INFO:tasks.workunit.client.1.smithi135.stdout:8/902: read - d1/d8f/da0/de0/f119 zero size 2024-09-10T09:36:37.176 INFO:tasks.workunit.client.1.smithi135.stdout:1/974: mkdir d1d/d20/d6c/df3/d128/d133 0 2024-09-10T09:36:37.176 INFO:tasks.workunit.client.1.smithi135.stdout:9/989: sync 2024-09-10T09:36:37.178 INFO:tasks.workunit.client.1.smithi135.stdout:2/910: dwrite df/d1b/d23/d42/f113 [0,4194304] 0 2024-09-10T09:36:37.178 INFO:tasks.workunit.client.1.smithi135.stdout:2/911: getdents df/d1b/d23/d98/d5f/d3d/d109 0 2024-09-10T09:36:37.178 INFO:tasks.workunit.client.1.smithi135.stdout:2/912: stat df/d1b/d23/d98/d5f/d3d/dd7 0 2024-09-10T09:36:37.178 INFO:tasks.workunit.client.1.smithi135.stdout:2/913: chown df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/f92 212 1 2024-09-10T09:36:37.180 INFO:tasks.workunit.client.1.smithi135.stdout:1/975: mkdir d1d/d20/d6c/d134 0 2024-09-10T09:36:37.180 INFO:tasks.workunit.client.1.smithi135.stdout:1/976: write d1d/d20/d52/d8a/dc2/dca/d37/f120 [923077,63155] 0 2024-09-10T09:36:37.181 INFO:tasks.workunit.client.1.smithi135.stdout:9/990: truncate de/df/ff9 978696 0 2024-09-10T09:36:37.181 INFO:tasks.workunit.client.1.smithi135.stdout:7/837: sync 2024-09-10T09:36:37.182 INFO:tasks.workunit.client.1.smithi135.stdout:7/838: getdents d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/deb 0 2024-09-10T09:36:37.182 INFO:tasks.workunit.client.1.smithi135.stdout:3/719: sync 2024-09-10T09:36:37.184 INFO:tasks.workunit.client.1.smithi135.stdout:8/903: truncate d1/d15/d16/d33/d45/fd8 2060143 0 2024-09-10T09:36:37.184 INFO:tasks.workunit.client.1.smithi135.stdout:8/904: chown d1/f14 0 1 2024-09-10T09:36:37.185 INFO:tasks.workunit.client.1.smithi135.stdout:5/956: dread d3/d99/d150/f74 [0,4194304] 0 2024-09-10T09:36:37.187 INFO:tasks.workunit.client.1.smithi135.stdout:1/977: fsync d1d/d20/d52/d8a/dc2/dca/d37/f120 0 2024-09-10T09:36:37.187 INFO:tasks.workunit.client.1.smithi135.stdout:1/978: chown d1d/d20/d52/d8a/dc2/dca/d2b/d12b/fa5 29889 1 2024-09-10T09:36:37.187 INFO:tasks.workunit.client.1.smithi135.stdout:1/979: stat d1d/d20/d52/d8a/dc2/dca/d2b/d4c 0 2024-09-10T09:36:37.194 INFO:tasks.workunit.client.1.smithi135.stdout:7/839: dread d2/f10 [0,4194304] 0 2024-09-10T09:36:37.194 INFO:tasks.workunit.client.1.smithi135.stdout:8/905: dread d1/d15/d16/d33/d45/d6f/f92 [0,4194304] 0 2024-09-10T09:36:37.195 INFO:tasks.workunit.client.1.smithi135.stdout:2/914: getdents df/d13/d52/d124 0 2024-09-10T09:36:37.201 INFO:tasks.workunit.client.1.smithi135.stdout:3/720: rmdir d4/d5/db/d44 39 2024-09-10T09:36:37.201 INFO:tasks.workunit.client.1.smithi135.stdout:3/721: write d4/d5/db/f4c [503746,114212] 0 2024-09-10T09:36:37.203 INFO:tasks.workunit.client.1.smithi135.stdout:5/957: write d3/dc/dba/d48/d57/f67 [404435,88447] 0 2024-09-10T09:36:37.206 INFO:tasks.workunit.client.1.smithi135.stdout:7/840: rename d2/d15/d4a/d36/d84/f91 to d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b/f104 0 2024-09-10T09:36:37.208 INFO:tasks.workunit.client.1.smithi135.stdout:8/906: rmdir d1/d27/d3d/d94/dff 0 2024-09-10T09:36:37.208 INFO:tasks.workunit.client.1.smithi135.stdout:8/907: write d1/f3 [424301,48087] 0 2024-09-10T09:36:37.211 INFO:tasks.workunit.client.1.smithi135.stdout:2/915: creat df/d1b/d23/d98/d5f/d10e/f125 x:0 0 0 2024-09-10T09:36:37.211 INFO:tasks.workunit.client.1.smithi135.stdout:2/916: creat df/d1b/d23/d98/d5f/d3d/d87/db0/f126 x:0 0 0 2024-09-10T09:36:37.214 INFO:tasks.workunit.client.1.smithi135.stdout:3/722: symlink d4/d5/db/d36/d43/d87/ld6 0 2024-09-10T09:36:37.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/991: dwrite de/df/d1d/d23/f26 [0,4194304] 0 2024-09-10T09:36:37.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/992: truncate de/df/d1d/d23/d25/d28/d4e/f7a 407568 0 2024-09-10T09:36:37.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/993: fdatasync de/df/d1d/d1e/d52/fe1 0 2024-09-10T09:36:37.219 INFO:tasks.workunit.client.1.smithi135.stdout:9/994: stat de/df/d7e/lb8 0 2024-09-10T09:36:37.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/958: mkdir d3/dc/dba/d48/d57/da3/db1/d157 0 2024-09-10T09:36:37.221 INFO:tasks.workunit.client.1.smithi135.stdout:5/959: dread - d3/dc/dba/d93/f143 zero size 2024-09-10T09:36:37.224 INFO:tasks.workunit.client.1.smithi135.stdout:2/917: dread df/f16 [0,4194304] 0 2024-09-10T09:36:37.227 INFO:tasks.workunit.client.1.smithi135.stdout:9/995: creat de/df/d1d/d1e/d3f/f139 x:0 0 0 2024-09-10T09:36:37.228 INFO:tasks.workunit.client.1.smithi135.stdout:9/996: chown de/df/d1d/d1e/db5/d88/dc6/cea 6115878 1 2024-09-10T09:36:37.228 INFO:tasks.workunit.client.1.smithi135.stdout:9/997: creat de/df/d1d/d1e/d3f/dbb/f13a x:0 0 0 2024-09-10T09:36:37.229 INFO:tasks.workunit.client.1.smithi135.stdout:1/980: dwrite d1d/d20/d52/d8a/dc2/dca/d37/f120 [0,4194304] 0 2024-09-10T09:36:37.230 INFO:tasks.workunit.client.1.smithi135.stdout:2/918: stat df/d13/l47 0 2024-09-10T09:36:37.230 INFO:tasks.workunit.client.1.smithi135.stdout:2/919: chown df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/ce9 10 1 2024-09-10T09:36:37.235 INFO:tasks.workunit.client.1.smithi135.stdout:9/998: creat de/f13b x:0 0 0 2024-09-10T09:36:37.235 INFO:tasks.workunit.client.1.smithi135.stdout:5/960: dread d3/dc/dba/f6a [0,4194304] 0 2024-09-10T09:36:37.239 INFO:tasks.workunit.client.1.smithi135.stdout:5/961: dread d3/dc/dba/dae/fce [0,4194304] 0 2024-09-10T09:36:37.240 INFO:tasks.workunit.client.1.smithi135.stdout:5/962: mkdir d3/dc/d16/d158 0 2024-09-10T09:36:37.241 INFO:tasks.workunit.client.1.smithi135.stdout:8/908: dwrite d1/d15/d49/fc8 [0,4194304] 0 2024-09-10T09:36:37.242 INFO:tasks.workunit.client.1.smithi135.stdout:7/841: dwrite d2/d25/da8/fd9 [0,4194304] 0 2024-09-10T09:36:37.242 INFO:tasks.workunit.client.1.smithi135.stdout:1/981: dread d1d/f22 [0,4194304] 0 2024-09-10T09:36:37.243 INFO:tasks.workunit.client.1.smithi135.stdout:5/963: mkdir d3/d99/d159 0 2024-09-10T09:36:37.249 INFO:tasks.workunit.client.1.smithi135.stdout:8/909: link d1/d15/d16/d33/d45/d6f/fb5 d1/d8f/da0/de0/d111/f120 0 2024-09-10T09:36:37.249 INFO:tasks.workunit.client.1.smithi135.stdout:8/910: chown d1/d8f/da0/de0/d111/f120 171 1 2024-09-10T09:36:37.249 INFO:tasks.workunit.client.1.smithi135.stdout:8/911: stat d1/d15/d16/d96/fbe 0 2024-09-10T09:36:37.252 INFO:tasks.workunit.client.1.smithi135.stdout:7/842: mkdir d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/dbf/d105 0 2024-09-10T09:36:37.255 INFO:tasks.workunit.client.1.smithi135.stdout:1/982: creat d1d/d20/d6c/d134/f135 x:0 0 0 2024-09-10T09:36:37.255 INFO:tasks.workunit.client.1.smithi135.stdout:3/723: dwrite d4/d5/dc/f49 [0,4194304] 0 2024-09-10T09:36:37.257 INFO:tasks.workunit.client.1.smithi135.stdout:9/999: dwrite de/df/d1d/d1e/d68/d9f/fd5 [4194304,4194304] 0 2024-09-10T09:36:37.259 INFO:tasks.workunit.client.1.smithi135.stdout:7/843: link d2/d15/f1c d2/d15/d39/d9f/db2/dcc/d49/de8/f106 0 2024-09-10T09:36:37.260 INFO:tasks.workunit.client.1.smithi135.stdout:1/983: mkdir d1d/d28/d4b/d53/dc5/d136 0 2024-09-10T09:36:37.261 INFO:tasks.workunit.client.1.smithi135.stdout:5/964: rmdir d3/d71 39 2024-09-10T09:36:37.262 INFO:tasks.workunit.client.1.smithi135.stdout:5/965: chown d3/dc/dba/d4e/dd0/c114 2 1 2024-09-10T09:36:37.262 INFO:tasks.workunit.client.1.smithi135.stdout:5/966: dread - d3/dc/dba/d48/d57/dc4/f132 zero size 2024-09-10T09:36:37.262 INFO:tasks.workunit.client.1.smithi135.stdout:8/912: getdents d1/d15/d16/d99/da9/dce 0 2024-09-10T09:36:37.266 INFO:tasks.workunit.client.1.smithi135.stdout:1/984: mknod d1d/d20/d52/d8a/dc2/c137 0 2024-09-10T09:36:37.267 INFO:tasks.workunit.client.1.smithi135.stdout:3/724: write d4/f32 [1359918,62669] 0 2024-09-10T09:36:37.267 INFO:tasks.workunit.client.1.smithi135.stdout:5/967: truncate d3/fd6 304633 0 2024-09-10T09:36:37.269 INFO:tasks.workunit.client.1.smithi135.stdout:3/725: write d4/f9 [4253220,75308] 0 2024-09-10T09:36:37.270 INFO:tasks.workunit.client.1.smithi135.stdout:3/726: creat d4/d5/db/dd/d79/fd7 x:0 0 0 2024-09-10T09:36:37.271 INFO:tasks.workunit.client.1.smithi135.stdout:5/968: write d3/dc/dba/dae/fce [605540,2276] 0 2024-09-10T09:36:37.271 INFO:tasks.workunit.client.1.smithi135.stdout:1/985: mknod d1d/d20/d3c/d6a/c138 0 2024-09-10T09:36:37.273 INFO:tasks.workunit.client.1.smithi135.stdout:8/913: rename d1/d27/d3d/d94 to d1/d15/d49/d121 0 2024-09-10T09:36:37.276 INFO:tasks.workunit.client.1.smithi135.stdout:3/727: unlink d4/d5/dc/d8b/fac 0 2024-09-10T09:36:37.279 INFO:tasks.workunit.client.1.smithi135.stdout:5/969: unlink d3/d71/f5a 0 2024-09-10T09:36:37.280 INFO:tasks.workunit.client.1.smithi135.stdout:1/986: truncate d1d/d20/d52/d8a/dc2/dca/d37/fc9 3497740 0 2024-09-10T09:36:37.282 INFO:tasks.workunit.client.1.smithi135.stdout:7/844: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f35 [4194304,4194304] 0 2024-09-10T09:36:37.283 INFO:tasks.workunit.client.1.smithi135.stdout:7/845: getdents d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/deb 0 2024-09-10T09:36:37.284 INFO:tasks.workunit.client.1.smithi135.stdout:8/914: rename d1/d8f/fb8 to d1/d15/d49/d69/f122 0 2024-09-10T09:36:37.287 INFO:tasks.workunit.client.1.smithi135.stdout:3/728: link d4/d55/fc9 d4/d5/db/d36/d43/d87/fd8 0 2024-09-10T09:36:37.290 INFO:tasks.workunit.client.1.smithi135.stdout:5/970: truncate d3/f95 1471871 0 2024-09-10T09:36:37.290 INFO:tasks.workunit.client.1.smithi135.stdout:5/971: creat d3/d81/d120/f15a x:0 0 0 2024-09-10T09:36:37.291 INFO:tasks.workunit.client.1.smithi135.stdout:1/987: dread d1d/d20/d52/d8a/dc2/dca/d2b/f81 [0,4194304] 0 2024-09-10T09:36:37.291 INFO:tasks.workunit.client.1.smithi135.stdout:1/988: chown d1d/d20/d52/d8a/dc2/dca/d2b/fef 4 1 2024-09-10T09:36:37.298 INFO:tasks.workunit.client.1.smithi135.stdout:3/729: link d4/d5/dc/f17 d4/d5/d51/fd9 0 2024-09-10T09:36:37.308 INFO:tasks.workunit.client.1.smithi135.stdout:5/972: rename d3/c47 to d3/d81/d120/c15b 0 2024-09-10T09:36:37.308 INFO:tasks.workunit.client.1.smithi135.stdout:5/973: stat d3/d91/db5/c32 0 2024-09-10T09:36:37.308 INFO:tasks.workunit.client.1.smithi135.stdout:5/974: truncate d3/dc/dba/d48/d57/da3/db1/fb4 268403 0 2024-09-10T09:36:37.311 INFO:tasks.workunit.client.1.smithi135.stdout:3/730: truncate d4/f47 691892 0 2024-09-10T09:36:37.312 INFO:tasks.workunit.client.1.smithi135.stdout:5/975: creat d3/dc/dba/d4e/f15c x:0 0 0 2024-09-10T09:36:37.314 INFO:tasks.workunit.client.1.smithi135.stdout:8/915: dwrite d1/d15/d49/d7c/fd0 [4194304,4194304] 0 2024-09-10T09:36:37.314 INFO:tasks.workunit.client.1.smithi135.stdout:8/916: truncate d1/d27/d3d/dd3/feb 779022 0 2024-09-10T09:36:37.314 INFO:tasks.workunit.client.1.smithi135.stdout:3/731: link d4/d5/db/dd/d79/f8a d4/d5/db/d36/d6a/daf/fda 0 2024-09-10T09:36:37.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/732: fdatasync d4/d5/db/f4c 0 2024-09-10T09:36:37.315 INFO:tasks.workunit.client.1.smithi135.stdout:3/733: truncate d4/d5/d51/fd5 772310 0 2024-09-10T09:36:37.315 INFO:tasks.workunit.client.1.smithi135.stdout:1/989: dwrite d1d/d20/d3c/f9f [0,4194304] 0 2024-09-10T09:36:37.328 INFO:tasks.workunit.client.1.smithi135.stdout:8/917: symlink d1/d15/d49/d69/l123 0 2024-09-10T09:36:37.330 INFO:tasks.workunit.client.1.smithi135.stdout:3/734: mknod d4/d5/dc/d8b/da6/cdb 0 2024-09-10T09:36:37.331 INFO:tasks.workunit.client.1.smithi135.stdout:1/990: dwrite d1d/d20/f30 [4194304,4194304] 0 2024-09-10T09:36:37.337 INFO:tasks.workunit.client.1.smithi135.stdout:5/976: rmdir d3/d71 39 2024-09-10T09:36:37.340 INFO:tasks.workunit.client.1.smithi135.stdout:8/918: dread d1/d15/d24/f2c [0,4194304] 0 2024-09-10T09:36:37.340 INFO:tasks.workunit.client.1.smithi135.stdout:8/919: fdatasync d1/d27/f40 0 2024-09-10T09:36:37.341 INFO:tasks.workunit.client.1.smithi135.stdout:1/991: mknod d1d/d20/d6c/df3/d128/c139 0 2024-09-10T09:36:37.341 INFO:tasks.workunit.client.1.smithi135.stdout:1/992: chown d1d/d20/d3c/f75 114 1 2024-09-10T09:36:37.346 INFO:tasks.workunit.client.1.smithi135.stdout:8/920: rename d1/d15/d16/d99/da9/dce/ff2 to d1/f124 0 2024-09-10T09:36:37.346 INFO:tasks.workunit.client.1.smithi135.stdout:8/921: chown d1/d15/d49/d121/da7/d108 3515 1 2024-09-10T09:36:37.348 INFO:tasks.workunit.client.1.smithi135.stdout:8/922: stat d1/c51 0 2024-09-10T09:36:37.355 INFO:tasks.workunit.client.1.smithi135.stdout:1/993: dread d1d/f58 [0,4194304] 0 2024-09-10T09:36:37.361 INFO:tasks.workunit.client.1.smithi135.stdout:3/735: dwrite d4/d5/db/f2f [0,4194304] 0 2024-09-10T09:36:37.362 INFO:tasks.workunit.client.1.smithi135.stdout:5/977: dwrite d3/d71/d61/f112 [0,4194304] 0 2024-09-10T09:36:37.363 INFO:tasks.workunit.client.1.smithi135.stdout:3/736: truncate d4/d5/dc/f17 928737 0 2024-09-10T09:36:37.366 INFO:tasks.workunit.client.1.smithi135.stdout:5/978: link d3/d81/d120/f14d d3/d81/d8d/f15d 0 2024-09-10T09:36:37.367 INFO:tasks.workunit.client.1.smithi135.stdout:3/737: symlink d4/d5/db/d44/da9/ldc 0 2024-09-10T09:36:37.369 INFO:tasks.workunit.client.1.smithi135.stdout:3/738: creat d4/d5/fdd x:0 0 0 2024-09-10T09:36:37.386 INFO:tasks.workunit.client.1.smithi135.stdout:1/994: write d1d/d20/d52/d8a/dc2/dca/d2b/d4c/f55 [1728968,507] 0 2024-09-10T09:36:37.386 INFO:tasks.workunit.client.1.smithi135.stdout:3/739: dread d4/d5/dc/f50 [0,4194304] 0 2024-09-10T09:36:37.386 INFO:tasks.workunit.client.1.smithi135.stdout:1/995: chown d1d/d20/d52/d8a/dc2/dca/d2b/da8/dc1/dd1/dd2/cf7 95611 1 2024-09-10T09:36:37.386 INFO:tasks.workunit.client.1.smithi135.stdout:1/996: chown d1d/d20/d52/d8a/dc2/dca/d2b/d4c/d63/l112 106 1 2024-09-10T09:36:37.386 INFO:tasks.workunit.client.1.smithi135.stdout:1/997: write d1d/d20/d52/d8a/dc2/dca/d2b/fce [4976883,17961] 0 2024-09-10T09:36:37.390 INFO:tasks.workunit.client.1.smithi135.stdout:1/998: link d1d/d20/d52/d8a/dc2/dca/d2b/da8/le3 d1d/d28/d4b/d53/dc5/d136/l13a 0 2024-09-10T09:36:37.395 INFO:tasks.workunit.client.1.smithi135.stdout:3/740: dread d4/d5/db/f2f [0,4194304] 0 2024-09-10T09:36:37.395 INFO:tasks.workunit.client.1.smithi135.stdout:3/741: fsync d4/f3b 0 2024-09-10T09:36:37.395 INFO:tasks.workunit.client.1.smithi135.stdout:3/742: chown d4/d5/d76 2789 1 2024-09-10T09:36:37.396 INFO:tasks.workunit.client.1.smithi135.stdout:3/743: chown d4/d5/dc/d8b/lba 110 1 2024-09-10T09:36:37.396 INFO:tasks.workunit.client.1.smithi135.stdout:1/999: link d1d/d20/d52/d8a/dc2/dca/d37/d10b/c116 d1d/d20/d52/d8a/dc2/dca/d37/d6d/c13b 0 2024-09-10T09:36:37.397 INFO:tasks.workunit.client.1.smithi135.stdout:3/744: rename d4/d55/d5d to d4/d5/db/d36/d43/d87/dde 0 2024-09-10T09:36:37.397 INFO:tasks.workunit.client.1.smithi135.stdout:5/979: dwrite d3/fb [0,4194304] 0 2024-09-10T09:36:37.400 INFO:tasks.workunit.client.1.smithi135.stdout:5/980: dread d3/d99/fed [0,4194304] 0 2024-09-10T09:36:37.403 INFO:tasks.workunit.client.1.smithi135.stdout:5/981: rmdir d3/dc/dba/d4e/d149 0 2024-09-10T09:36:37.403 INFO:tasks.workunit.client.1.smithi135.stdout:5/982: chown d3/dc/d69/d65/ffe 66497364 1 2024-09-10T09:36:37.420 INFO:tasks.workunit.client.1.smithi135.stdout:5/983: dwrite d3/dc/f80 [0,4194304] 0 2024-09-10T09:36:37.420 INFO:tasks.workunit.client.1.smithi135.stdout:5/984: creat d3/dc/d69/d65/f15e x:0 0 0 2024-09-10T09:36:37.423 INFO:tasks.workunit.client.1.smithi135.stdout:5/985: symlink d3/dc/dba/l15f 0 2024-09-10T09:36:37.423 INFO:tasks.workunit.client.1.smithi135.stdout:5/986: chown d3/dc/dba/d48/d57/da3/f103 5 1 2024-09-10T09:36:37.425 INFO:tasks.workunit.client.1.smithi135.stdout:5/987: unlink d3/dc/dba/d88/fcf 0 2024-09-10T09:36:37.444 INFO:tasks.workunit.client.1.smithi135.stdout:5/988: mkdir d3/dc/d16/d158/d160 0 2024-09-10T09:36:37.444 INFO:tasks.workunit.client.1.smithi135.stdout:5/989: write d3/dc/dba/d88/fc3 [3414177,41071] 0 2024-09-10T09:36:37.446 INFO:tasks.workunit.client.1.smithi135.stdout:5/990: truncate d3/dc/dba/d48/d57/da9/fe0 1808348 0 2024-09-10T09:36:37.454 INFO:tasks.workunit.client.1.smithi135.stdout:5/991: dread d3/dc/f80 [0,4194304] 0 2024-09-10T09:36:37.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.453+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf34105da0 con 0x7fdf1c039400 2024-09-10T09:36:37.455 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:37 smithi079 ceph-mon[27592]: pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-09-10T09:36:37.455 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:37 smithi079 ceph-mon[27592]: mgrmap e24: smithi135.lbhjof(active, since 4s) 2024-09-10T09:36:37.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.455+0000 7fdf31ffb700 1 -- 172.21.15.79:0/1010433587 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fdf34105da0 con 0x7fdf1c039400 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fdf1c039400 msgr2=0x7fdf1c03b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fdf1c039400 0x7fdf1c03b8b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800b5c0 tx=0x7fdf28005ee0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 msgr2=0x7fdf34074b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 0x7fdf34074b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400d900 tx=0x7fdf2400dc10 comp rx=0 tx=0).stop 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 shutdown_connections 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf34100250 0x7fdf34074b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fdf1c039400 0x7fdf1c03b8b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 --2- 172.21.15.79:0/1010433587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf34101450 0x7fdf340731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 >> 172.21.15.79:0/1010433587 conn(0x7fdf340fb7e0 msgr2=0x7fdf34104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:37.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 shutdown_connections 2024-09-10T09:36:37.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.458+0000 7fdf3b14b700 1 -- 172.21.15.79:0/1010433587 wait complete. 2024-09-10T09:36:37.470 INFO:tasks.workunit.client.1.smithi135.stdout:5/992: dwrite d3/dc/dba/dbf/f146 [0,4194304] 0 2024-09-10T09:36:37.470 INFO:tasks.workunit.client.1.smithi135.stdout:5/993: fdatasync d3/dc/dba/f8b 0 2024-09-10T09:36:37.472 INFO:tasks.workunit.client.1.smithi135.stdout:5/994: symlink d3/dc/d69/d65/d6c/d106/l161 0 2024-09-10T09:36:37.473 INFO:tasks.workunit.client.1.smithi135.stdout:5/995: unlink d3/dc/dba/d48/d57/dc4/ff6 0 2024-09-10T09:36:37.491 INFO:tasks.workunit.client.1.smithi135.stdout:5/996: dwrite d3/d71/d61/f121 [0,4194304] 0 2024-09-10T09:36:37.498 INFO:tasks.workunit.client.1.smithi135.stdout:5/997: dread d3/dc/d69/d65/f85 [0,4194304] 0 2024-09-10T09:36:37.501 INFO:tasks.workunit.client.1.smithi135.stdout:5/998: symlink d3/l162 0 2024-09-10T09:36:37.504 INFO:tasks.workunit.client.1.smithi135.stdout:5/999: rmdir d3/dc/dba/d88 39 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.577+0000 7f42f13db700 1 -- 172.21.15.79:0/2912635437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec101070 msgr2=0x7f42ec0ff470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.577+0000 7f42f13db700 1 --2- 172.21.15.79:0/2912635437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec101070 0x7f42ec0ff470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009910 tx=0x7f42e0009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.577+0000 7f42f13db700 1 -- 172.21.15.79:0/2912635437 shutdown_connections 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.577+0000 7f42f13db700 1 --2- 172.21.15.79:0/2912635437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec101070 0x7f42ec0ff470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.577+0000 7f42f13db700 1 --2- 172.21.15.79:0/2912635437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec100720 0x7f42ec100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.577+0000 7f42f13db700 1 -- 172.21.15.79:0/2912635437 >> 172.21.15.79:0/2912635437 conn(0x7f42ec0f9f10 msgr2=0x7f42ec0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.578+0000 7f42f13db700 1 -- 172.21.15.79:0/2912635437 shutdown_connections 2024-09-10T09:36:37.580 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.578+0000 7f42f13db700 1 -- 172.21.15.79:0/2912635437 wait complete. 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.578+0000 7f42f13db700 1 Processor -- start 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42f13db700 1 -- start start 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42f13db700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec100720 0x7f42ec0feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42f13db700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec101070 0x7f42ec19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42f13db700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec19ae10 con 0x7f42ec100720 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42f13db700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec19af50 con 0x7f42ec101070 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42ea7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec101070 0x7f42ec19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42eaffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec100720 0x7f42ec0feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42ea7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec101070 0x7f42ec19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:44806/0 (socket says 172.21.15.79:44806) 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42ea7fc700 1 -- 172.21.15.79:0/67868805 learned_addr learned my addr 172.21.15.79:0/67868805 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:37.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42ea7fc700 1 -- 172.21.15.79:0/67868805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec100720 msgr2=0x7f42ec0feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42ea7fc700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec100720 0x7f42ec0feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.579+0000 7f42ea7fc700 1 -- 172.21.15.79:0/67868805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e00095f0 con 0x7f42ec101070 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.580+0000 7f42ea7fc700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec101070 0x7f42ec19a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42e0006010 tx=0x7f42e000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.580+0000 7f42d3fff700 1 -- 172.21.15.79:0/67868805 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42e001d070 con 0x7f42ec101070 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.580+0000 7f42d3fff700 1 -- 172.21.15.79:0/67868805 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f42e0005dc0 con 0x7f42ec101070 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.580+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec19b1d0 con 0x7f42ec101070 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.580+0000 7f42d3fff700 1 -- 172.21.15.79:0/67868805 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42e0017400 con 0x7f42ec101070 2024-09-10T09:36:37.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.580+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec19b6c0 con 0x7f42ec101070 2024-09-10T09:36:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.581+0000 7f42d3fff700 1 -- 172.21.15.79:0/67868805 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) v1 ==== 46428+0+0 (secure 0 0 0) 0x7f42e0017680 con 0x7f42ec101070 2024-09-10T09:36:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.581+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec107c10 con 0x7f42ec101070 2024-09-10T09:36:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.581+0000 7f42d3fff700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f42d4039360 0x7f42d403b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.581+0000 7f42d3fff700 1 -- 172.21.15.79:0/67868805 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f42e004e940 con 0x7f42ec101070 2024-09-10T09:36:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.582+0000 7f42eaffd700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f42d4039360 0x7f42d403b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.582+0000 7f42eaffd700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f42d4039360 0x7f42d403b810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009c60 tx=0x7f42dc009260 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:37.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.586+0000 7f42d3fff700 1 -- 172.21.15.79:0/67868805 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f42e0016770 con 0x7f42ec101070 2024-09-10T09:36:37.639 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:37 smithi135 ceph-mon[33411]: pgmap v5: 65 pgs: 65 active+clean; 1.9 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail 2024-09-10T09:36:37.639 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:37 smithi135 ceph-mon[33411]: mgrmap e24: smithi135.lbhjof(active, since 4s) 2024-09-10T09:36:37.660 INFO:tasks.workunit.client.1.smithi135.stdout:2/920: sync 2024-09-10T09:36:37.661 INFO:tasks.workunit.client.1.smithi135.stdout:2/921: dread - df/fd1 zero size 2024-09-10T09:36:37.662 INFO:tasks.workunit.client.1.smithi135.stdout:2/922: link df/d1b/d23/d98/d5f/d2c/c53 df/d1b/d31/d11b/c127 0 2024-09-10T09:36:37.663 INFO:tasks.workunit.client.1.smithi135.stdout:2/923: unlink df/d13/d52/f58 0 2024-09-10T09:36:37.663 INFO:tasks.workunit.client.1.smithi135.stdout:2/924: chown df/fd1 76 1 2024-09-10T09:36:37.663 INFO:tasks.workunit.client.1.smithi135.stdout:2/925: readlink df/d13/d4f/l64 0 2024-09-10T09:36:37.663 INFO:tasks.workunit.client.1.smithi135.stdout:2/926: chown df/d1b/d23/d42 249535 1 2024-09-10T09:36:37.665 INFO:tasks.workunit.client.1.smithi135.stdout:2/927: rename df/d1b/d23/d98/d5f/d3d/d87/fa3 to df/d13/d52/f128 0 2024-09-10T09:36:37.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/928: symlink df/d1b/d23/d98/d5f/d3d/d87/db0/d122/l129 0 2024-09-10T09:36:37.666 INFO:tasks.workunit.client.1.smithi135.stdout:2/929: dread - df/d1b/d23/d98/d5f/d3d/d87/db0/f126 zero size 2024-09-10T09:36:37.668 INFO:tasks.workunit.client.1.smithi135.stdout:2/930: unlink df/d1b/d23/c72 0 2024-09-10T09:36:37.668 INFO:tasks.workunit.client.1.smithi135.stdout:2/931: creat df/f12a x:0 0 0 2024-09-10T09:36:37.669 INFO:tasks.workunit.client.1.smithi135.stdout:2/932: mknod df/d1b/d23/d98/dcb/c12b 0 2024-09-10T09:36:37.669 INFO:tasks.workunit.client.1.smithi135.stdout:2/933: chown df/c93 5031972 1 2024-09-10T09:36:37.693 INFO:tasks.workunit.client.1.smithi135.stdout:2/934: dwrite df/d1b/d23/d42/f6e [0,4194304] 0 2024-09-10T09:36:37.693 INFO:tasks.workunit.client.1.smithi135.stdout:2/935: creat df/d1b/d23/d98/d5f/d10e/f12c x:0 0 0 2024-09-10T09:36:37.695 INFO:tasks.workunit.client.1.smithi135.stdout:2/936: link df/d1b/fb8 df/d13/d52/d124/d10a/d10d/f12d 0 2024-09-10T09:36:37.695 INFO:tasks.workunit.client.1.smithi135.stdout:2/937: write df/d1b/d31/ffd [303661,79269] 0 2024-09-10T09:36:37.695 INFO:tasks.workunit.client.1.smithi135.stdout:2/938: read df/f16 [4382078,29995] 0 2024-09-10T09:36:37.696 INFO:tasks.workunit.client.1.smithi135.stdout:2/939: fdatasync df/d13/d52/fae 0 2024-09-10T09:36:37.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.836+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f42ec104dd0 con 0x7f42d4039360 2024-09-10T09:36:37.842 INFO:tasks.workunit.client.1.smithi135.stdout:8/923: sync 2024-09-10T09:36:37.842 INFO:tasks.workunit.client.1.smithi135.stdout:7/846: sync 2024-09-10T09:36:37.843 INFO:tasks.workunit.client.1.smithi135.stdout:8/924: mknod d1/d15/d24/d106/c125 0 2024-09-10T09:36:37.844 INFO:tasks.workunit.client.1.smithi135.stdout:7/847: mknod d2/d15/d5c/d85/c107 0 2024-09-10T09:36:37.846 INFO:tasks.workunit.client.1.smithi135.stdout:7/848: dread d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f7a [0,4194304] 0 2024-09-10T09:36:37.846 INFO:tasks.workunit.client.1.smithi135.stdout:8/925: creat d1/d15/d16/d99/da9/dce/f126 x:0 0 0 2024-09-10T09:36:37.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.852+0000 7f42d3fff700 1 -- 172.21.15.79:0/67868805 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f42ec104dd0 con 0x7f42d4039360 2024-09-10T09:36:37.854 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:36:37.854 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (7m) 2m ago 8m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:36:37.854 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (8m) 2m ago 8m 7398k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (7m) 24s ago 7m 7528k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (8m) 2m ago 8m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (7m) 24s ago 7m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (6m) 2m ago 8m 83.2M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (3m) 2m ago 3m 11.5M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (2m) 2m ago 2m 14.4M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (3m) 24s ago 3m 204M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (2m) 24s ago 2m 16.5M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:9283,8765,8443 running (9m) 2m ago 9m 487M - 18.2.0 dc2bc1663786 3bc55a447267 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (41s) 24s ago 7m 109M - 19.1.1-305-g1cf819b7 41d671128357 7790a1959164 2024-09-10T09:36:37.855 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (9m) 2m ago 10m 45.0M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (7m) 24s ago 7m 36.0M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (8m) 2m ago 8m 14.5M - 1.5.0 0da6a335fe13 2d43514669a8 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (7m) 24s ago 7m 15.1M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (6m) 2m ago 6m 49.1M 3946M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (6m) 2m ago 6m 48.2M 3946M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (5m) 2m ago 5m 46.4M 3946M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (5m) 24s ago 5m 228M 1213M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (5m) 24s ago 5m 191M 1213M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (4m) 24s ago 4m 221M 1213M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:36:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (6m) 2m ago 8m 61.5M - 2.43.0 a07b618ecd1d 960dc8481947 2024-09-10T09:36:37.857 INFO:tasks.workunit.client.1.smithi135.stdout:7/849: read d2/d25/f65 [774810,52855] 0 2024-09-10T09:36:37.858 INFO:tasks.workunit.client.1.smithi135.stdout:7/850: chown d2/d15/d4a 78904 1 2024-09-10T09:36:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f42d4039360 msgr2=0x7f42d403b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f42d4039360 0x7f42d403b810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009c60 tx=0x7f42dc009260 comp rx=0 tx=0).stop 2024-09-10T09:36:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec101070 msgr2=0x7f42ec19a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec101070 0x7f42ec19a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42e0006010 tx=0x7f42e000f690 comp rx=0 tx=0).stop 2024-09-10T09:36:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 shutdown_connections 2024-09-10T09:36:37.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f42d4039360 0x7f42d403b810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42ec100720 0x7f42ec0feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 --2- 172.21.15.79:0/67868805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec101070 0x7f42ec19a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 >> 172.21.15.79:0/67868805 conn(0x7f42ec0f9f10 msgr2=0x7f42ec1036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 shutdown_connections 2024-09-10T09:36:37.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:37.854+0000 7f42f13db700 1 -- 172.21.15.79:0/67868805 wait complete. 2024-09-10T09:36:37.876 INFO:tasks.workunit.client.1.smithi135.stdout:8/926: dwrite d1/fdd [4194304,4194304] 0 2024-09-10T09:36:37.876 INFO:tasks.workunit.client.1.smithi135.stdout:8/927: readlink d1/d15/d49/d7c/lbc 0 2024-09-10T09:36:37.877 INFO:tasks.workunit.client.1.smithi135.stdout:8/928: fsync d1/f5 0 2024-09-10T09:36:37.878 INFO:tasks.workunit.client.1.smithi135.stdout:7/851: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def/f103 [0,4194304] 0 2024-09-10T09:36:37.885 INFO:tasks.workunit.client.1.smithi135.stdout:7/852: rename d2/d15/d39/d6f/f76 to d2/d15/d39/f108 0 2024-09-10T09:36:37.889 INFO:tasks.workunit.client.1.smithi135.stdout:7/853: link d2/d15/d39/d9f/db2/dcc/d49/d60/de4/fea d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def/f109 0 2024-09-10T09:36:37.891 INFO:tasks.workunit.client.1.smithi135.stdout:7/854: rename d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def/f103 to d2/d15/d39/d9f/f10a 0 2024-09-10T09:36:37.894 INFO:tasks.workunit.client.1.smithi135.stdout:7/855: link d2/d15/d4a/fe d2/d25/f10b 0 2024-09-10T09:36:37.894 INFO:tasks.workunit.client.1.smithi135.stdout:7/856: getdents d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dae 0 2024-09-10T09:36:37.894 INFO:tasks.workunit.client.1.smithi135.stdout:7/857: write d2/d15/d39/d9f/db2/dcc/d49/de8/fbb [987793,17822] 0 2024-09-10T09:36:37.894 INFO:tasks.workunit.client.1.smithi135.stdout:7/858: fdatasync d2/d15/d39/d9f/db2/dcc/d49/d60/f22 0 2024-09-10T09:36:37.895 INFO:tasks.workunit.client.1.smithi135.stdout:8/929: dwrite d1/d15/f4d [0,4194304] 0 2024-09-10T09:36:37.902 INFO:tasks.workunit.client.1.smithi135.stdout:8/930: mknod d1/d15/d24/d106/c127 0 2024-09-10T09:36:37.911 INFO:tasks.workunit.client.1.smithi135.stdout:7/859: dread d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f34 [0,4194304] 0 2024-09-10T09:36:37.911 INFO:tasks.workunit.client.1.smithi135.stdout:7/860: chown d2/d15/f2d 0 1 2024-09-10T09:36:37.911 INFO:tasks.workunit.client.1.smithi135.stdout:7/861: chown d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f35 3600803 1 2024-09-10T09:36:37.927 INFO:tasks.workunit.client.1.smithi135.stdout:8/931: dwrite d1/d27/f36 [0,4194304] 0 2024-09-10T09:36:37.936 INFO:tasks.workunit.client.1.smithi135.stdout:8/932: link d1/ff7 d1/d15/d49/d121/da7/f128 0 2024-09-10T09:36:37.940 INFO:tasks.workunit.client.1.smithi135.stdout:8/933: mkdir d1/d15/d49/d121/da7/d129 0 2024-09-10T09:36:37.949 INFO:tasks.workunit.client.1.smithi135.stdout:8/934: unlink d1/d15/d16/d71/ld7 0 2024-09-10T09:36:37.950 INFO:tasks.workunit.client.1.smithi135.stdout:8/935: creat d1/d15/d16/d99/f12a x:0 0 0 2024-09-10T09:36:37.956 INFO:tasks.workunit.client.1.smithi135.stdout:8/936: mknod d1/d15/d24/c12b 0 2024-09-10T09:36:37.961 INFO:tasks.workunit.client.1.smithi135.stdout:8/937: rmdir d1/d8f/da0/de0/d111 39 2024-09-10T09:36:37.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/940: sync 2024-09-10T09:36:37.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/941: creat df/d13/d4f/d95/d97/f12e x:0 0 0 2024-09-10T09:36:37.984 INFO:tasks.workunit.client.1.smithi135.stdout:2/942: readlink df/d13/d4f/d95/d97/d9a/lf3 0 2024-09-10T09:36:37.985 INFO:tasks.workunit.client.1.smithi135.stdout:3/745: sync 2024-09-10T09:36:37.985 INFO:tasks.workunit.client.1.smithi135.stdout:3/746: chown d4/d5/d76/fc6 3349 1 2024-09-10T09:36:37.985 INFO:tasks.workunit.client.1.smithi135.stdout:3/747: creat d4/d5/dc/dce/fdf x:0 0 0 2024-09-10T09:36:37.986 INFO:tasks.workunit.client.1.smithi135.stdout:3/748: dread - d4/d5/db/d44/da9/fc7 zero size 2024-09-10T09:36:37.987 INFO:tasks.workunit.client.1.smithi135.stdout:3/749: mkdir d4/d5/db/d44/da9/de0 0 2024-09-10T09:36:37.993 INFO:tasks.workunit.client.1.smithi135.stdout:3/750: write d4/d5/dc/f50 [777990,124843] 0 2024-09-10T09:36:37.994 INFO:tasks.workunit.client.1.smithi135.stdout:3/751: mkdir d4/d5/db/d36/d43/d87/de1 0 2024-09-10T09:36:37.998 INFO:tasks.workunit.client.1.smithi135.stdout:8/938: rmdir d1 39 2024-09-10T09:36:38.001 INFO:tasks.workunit.client.1.smithi135.stdout:8/939: mknod d1/d27/d3d/dd3/c12c 0 2024-09-10T09:36:38.001 INFO:tasks.workunit.client.1.smithi135.stdout:8/940: mkdir d1/d15/d24/d106/d12d 0 2024-09-10T09:36:38.002 INFO:tasks.workunit.client.1.smithi135.stdout:8/941: chown d1/d8f/c115 0 1 2024-09-10T09:36:38.004 INFO:tasks.workunit.client.1.smithi135.stdout:8/942: mknod d1/d15/d16/d33/d45/c12e 0 2024-09-10T09:36:38.004 INFO:tasks.workunit.client.1.smithi135.stdout:8/943: fsync d1/d27/fe1 0 2024-09-10T09:36:38.005 INFO:tasks.workunit.client.1.smithi135.stdout:8/944: symlink d1/d15/d16/d99/da9/l12f 0 2024-09-10T09:36:38.008 INFO:tasks.workunit.client.1.smithi135.stdout:8/945: getdents d1/d15/d16/d33/d45/dc4/dd2 0 2024-09-10T09:36:38.008 INFO:tasks.workunit.client.1.smithi135.stdout:8/946: fdatasync d1/d15/d16/fcb 0 2024-09-10T09:36:38.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.009+0000 7f60f9ffb700 1 -- 172.21.15.79:0/2284611048 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ec004a00 con 0x7f60fc0ff150 2024-09-10T09:36:38.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 -- 172.21.15.79:0/2284611048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc0ff150 msgr2=0x7f60fc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 --2- 172.21.15.79:0/2284611048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc0ff150 0x7f60fc0ff560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009910 tx=0x7f60ec009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:38.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 -- 172.21.15.79:0/2284611048 shutdown_connections 2024-09-10T09:36:38.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 --2- 172.21.15.79:0/2284611048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60fc100350 0x7f60fc1007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 --2- 172.21.15.79:0/2284611048 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc0ff150 0x7f60fc0ff560 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 -- 172.21.15.79:0/2284611048 >> 172.21.15.79:0/2284611048 conn(0x7f60fc0fa700 msgr2=0x7f60fc0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:38.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 -- 172.21.15.79:0/2284611048 shutdown_connections 2024-09-10T09:36:38.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.010+0000 7f6101397700 1 -- 172.21.15.79:0/2284611048 wait complete. 2024-09-10T09:36:38.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.011+0000 7f6101397700 1 Processor -- start 2024-09-10T09:36:38.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.011+0000 7f6101397700 1 -- start start 2024-09-10T09:36:38.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.011+0000 7f6101397700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60fc0ff150 0x7f60fc190d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:38.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.011+0000 7f6101397700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc100350 0x7f60fc191290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:38.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f6101397700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc18d840 con 0x7f60fc100350 2024-09-10T09:36:38.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f6101397700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc18d9b0 con 0x7f60fc0ff150 2024-09-10T09:36:38.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f60fa7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc100350 0x7f60fc191290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:38.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f60fa7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc100350 0x7f60fc191290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42884/0 (socket says 172.21.15.79:42884) 2024-09-10T09:36:38.014 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f60fa7fc700 1 -- 172.21.15.79:0/1080531916 learned_addr learned my addr 172.21.15.79:0/1080531916 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:38.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f60faffd700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60fc0ff150 0x7f60fc190d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:38.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f60fa7fc700 1 -- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60fc0ff150 msgr2=0x7f60fc190d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f60fa7fc700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60fc0ff150 0x7f60fc190d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.012+0000 7f60fa7fc700 1 -- 172.21.15.79:0/1080531916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0095f0 con 0x7f60fc100350 2024-09-10T09:36:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.013+0000 7f60fa7fc700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc100350 0x7f60fc191290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e920 tx=0x7f60f000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.013+0000 7f60e3fff700 1 -- 172.21.15.79:0/1080531916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60f0009790 con 0x7f60fc100350 2024-09-10T09:36:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.013+0000 7f60e3fff700 1 -- 172.21.15.79:0/1080531916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60f000cba0 con 0x7f60fc100350 2024-09-10T09:36:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.013+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc18dc90 con 0x7f60fc100350 2024-09-10T09:36:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.013+0000 7f60e3fff700 1 -- 172.21.15.79:0/1080531916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60f0018630 con 0x7f60fc100350 2024-09-10T09:36:38.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.013+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc18e1e0 con 0x7f60fc100350 2024-09-10T09:36:38.017 INFO:tasks.workunit.client.1.smithi135.stdout:3/752: dwrite d4/f7b [0,4194304] 0 2024-09-10T09:36:38.017 INFO:tasks.workunit.client.1.smithi135.stdout:3/753: chown d4/d5/db/d36/d43/d87/dde/d5b/f75 3233 1 2024-09-10T09:36:38.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.014+0000 7f60e3fff700 1 -- 172.21.15.79:0/1080531916 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 46428+0+0 (secure 0 0 0) 0x7f60f0018790 con 0x7f60fc100350 2024-09-10T09:36:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.014+0000 7f60e3fff700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f60e40393b0 0x7f60e403b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.015+0000 7f60e3fff700 1 -- 172.21.15.79:0/1080531916 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f60f0014070 con 0x7f60fc100350 2024-09-10T09:36:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.015+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc107ca0 con 0x7f60fc100350 2024-09-10T09:36:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.015+0000 7f60faffd700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f60e40393b0 0x7f60e403b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:38.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.016+0000 7f60faffd700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f60e40393b0 0x7f60e403b860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b600 tx=0x7f60ec009f70 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:38.022 INFO:tasks.workunit.client.1.smithi135.stdout:3/754: rename d4/d5/db/d36/d43/d87/dde/d5b/c7a to d4/d5/db/d44/da9/ce2 0 2024-09-10T09:36:38.022 INFO:tasks.workunit.client.1.smithi135.stdout:3/755: dread - d4/d5/db/d36/d43/dbb/f73 zero size 2024-09-10T09:36:38.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.023+0000 7f60e3fff700 1 -- 172.21.15.79:0/1080531916 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f60f001fdf0 con 0x7f60fc100350 2024-09-10T09:36:38.025 INFO:tasks.workunit.client.1.smithi135.stdout:3/756: rename d4/f47 to d4/d5/db/d36/d43/d87/dde/d5b/db4/fe3 0 2024-09-10T09:36:38.027 INFO:tasks.workunit.client.1.smithi135.stdout:8/947: dwrite d1/d8f/da0/de0/d111/f120 [0,4194304] 0 2024-09-10T09:36:38.030 INFO:tasks.workunit.client.1.smithi135.stdout:3/757: rename d4/d5/d56/lb1 to d4/d5/dc/le4 0 2024-09-10T09:36:38.032 INFO:tasks.workunit.client.1.smithi135.stdout:3/758: mknod d4/d5/d51/ce5 0 2024-09-10T09:36:38.050 INFO:tasks.workunit.client.1.smithi135.stdout:3/759: dwrite d4/d55/f60 [0,4194304] 0 2024-09-10T09:36:38.051 INFO:tasks.workunit.client.1.smithi135.stdout:3/760: mknod d4/d5/db/d44/da9/dd2/ce6 0 2024-09-10T09:36:38.057 INFO:tasks.workunit.client.1.smithi135.stdout:3/761: rename d4/d5/dc/d8b/da6 to d4/d5/db/d36/d6a/daf/de7 0 2024-09-10T09:36:38.058 INFO:tasks.workunit.client.1.smithi135.stdout:3/762: creat d4/d55/fe8 x:0 0 0 2024-09-10T09:36:38.079 INFO:tasks.workunit.client.1.smithi135.stdout:3/763: dwrite d4/d5/db/d36/d6a/f82 [0,4194304] 0 2024-09-10T09:36:38.079 INFO:tasks.workunit.client.1.smithi135.stdout:3/764: stat d4/d5/db/d36 0 2024-09-10T09:36:38.079 INFO:tasks.workunit.client.1.smithi135.stdout:3/765: dread - d4/d5/db/d36/d6a/daf/de7/fb3 zero size 2024-09-10T09:36:38.079 INFO:tasks.workunit.client.1.smithi135.stdout:3/766: read - d4/d5/db/d36/d43/d87/dde/fc4 zero size 2024-09-10T09:36:38.079 INFO:tasks.workunit.client.1.smithi135.stdout:3/767: chown d4/d5/db/dd/d79/c65 6442206 1 2024-09-10T09:36:38.080 INFO:tasks.workunit.client.1.smithi135.stdout:3/768: creat d4/d55/fe9 x:0 0 0 2024-09-10T09:36:38.080 INFO:tasks.workunit.client.1.smithi135.stdout:3/769: write d4/d5/db/d36/d43/d87/fd8 [171714,17669] 0 2024-09-10T09:36:38.088 INFO:tasks.workunit.client.1.smithi135.stdout:3/770: dread d4/d5/db/dd/f5f [0,4194304] 0 2024-09-10T09:36:38.091 INFO:tasks.workunit.client.1.smithi135.stdout:3/771: truncate d4/f7b 2915151 0 2024-09-10T09:36:38.091 INFO:tasks.workunit.client.1.smithi135.stdout:3/772: fsync d4/f25 0 2024-09-10T09:36:38.093 INFO:tasks.workunit.client.1.smithi135.stdout:3/773: creat d4/d5/d51/dcf/fea x:0 0 0 2024-09-10T09:36:38.302 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:38 smithi079 ceph-mon[27592]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:38.302 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:38 smithi079 ceph-mon[27592]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.344+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f60fc1a2710 con 0x7f60fc100350 2024-09-10T09:36:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.344+0000 7f60e3fff700 1 -- 172.21.15.79:0/1080531916 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f60f001f310 con 0x7f60fc100350 2024-09-10T09:36:38.346 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:36:38.346 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:36:38.347 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:36:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-10T09:36:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T09:36:38.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:36:38.348 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:36:38.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f60e40393b0 msgr2=0x7f60e403b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f60e40393b0 0x7f60e403b860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00b600 tx=0x7f60ec009f70 comp rx=0 tx=0).stop 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc100350 msgr2=0x7f60fc191290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc100350 0x7f60fc191290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e920 tx=0x7f60f000ece0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 shutdown_connections 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60fc0ff150 0x7f60fc190d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f60e40393b0 0x7f60e403b860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 --2- 172.21.15.79:0/1080531916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60fc100350 0x7f60fc191290 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.346+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 >> 172.21.15.79:0/1080531916 conn(0x7f60fc0fa700 msgr2=0x7f60fc068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.347+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 shutdown_connections 2024-09-10T09:36:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.347+0000 7f6101397700 1 -- 172.21.15.79:0/1080531916 wait complete. 2024-09-10T09:36:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 -- 172.21.15.79:0/1695614980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638101450 msgr2=0x7ff6381018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 --2- 172.21.15.79:0/1695614980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638101450 0x7ff6381018a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff624009910 tx=0x7ff624009c20 comp rx=0 tx=0).stop 2024-09-10T09:36:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 -- 172.21.15.79:0/1695614980 shutdown_connections 2024-09-10T09:36:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 --2- 172.21.15.79:0/1695614980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638101450 0x7ff6381018a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 --2- 172.21.15.79:0/1695614980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff638100250 0x7ff638100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 -- 172.21.15.79:0/1695614980 >> 172.21.15.79:0/1695614980 conn(0x7ff6380fb7e0 msgr2=0x7ff6380fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 -- 172.21.15.79:0/1695614980 shutdown_connections 2024-09-10T09:36:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.459+0000 7ff63f175700 1 -- 172.21.15.79:0/1695614980 wait complete. 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63f175700 1 Processor -- start 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63f175700 1 -- start start 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63f175700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638100250 0x7ff638195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63f175700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff638101450 0x7ff638195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63f175700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638196600 con 0x7ff638100250 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63f175700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638196740 con 0x7ff638101450 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63cf11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638100250 0x7ff638195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63cf11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638100250 0x7ff638195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42902/0 (socket says 172.21.15.79:42902) 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff63cf11700 1 -- 172.21.15.79:0/2171082042 learned_addr learned my addr 172.21.15.79:0/2171082042 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.460+0000 7ff637fff700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff638101450 0x7ff638195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff63cf11700 1 -- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff638101450 msgr2=0x7ff638195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff63cf11700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff638101450 0x7ff638195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff63cf11700 1 -- 172.21.15.79:0/2171082042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6240095f0 con 0x7ff638100250 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff63cf11700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638100250 0x7ff638195aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00d900 tx=0x7ff62c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff635ffb700 1 -- 172.21.15.79:0/2171082042 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c0041f0 con 0x7ff638100250 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff635ffb700 1 -- 172.21.15.79:0/2171082042 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff62c004350 con 0x7ff638100250 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff635ffb700 1 -- 172.21.15.79:0/2171082042 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c003d20 con 0x7ff638100250 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63819b1f0 con 0x7ff638100250 2024-09-10T09:36:38.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.461+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63819b740 con 0x7ff638100250 2024-09-10T09:36:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.462+0000 7ff635ffb700 1 -- 172.21.15.79:0/2171082042 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) v1 ==== 46428+0+0 (secure 0 0 0) 0x7ff62c010460 con 0x7ff638100250 2024-09-10T09:36:38.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.462+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff638108da0 con 0x7ff638100250 2024-09-10T09:36:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.462+0000 7ff635ffb700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff628039360 0x7ff62803b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:36:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.463+0000 7ff635ffb700 1 -- 172.21.15.79:0/2171082042 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff62c04d330 con 0x7ff638100250 2024-09-10T09:36:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.463+0000 7ff637fff700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff628039360 0x7ff62803b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:36:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.463+0000 7ff637fff700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff628039360 0x7ff62803b810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff62400b5c0 tx=0x7ff624005ee0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:36:38.469 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.468+0000 7ff635ffb700 1 -- 172.21.15.79:0/2171082042 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff62c01a930 con 0x7ff638100250 2024-09-10T09:36:38.489 INFO:tasks.workunit.client.1.smithi135.stdout:7/862: sync 2024-09-10T09:36:38.489 INFO:tasks.workunit.client.1.smithi135.stdout:2/943: sync 2024-09-10T09:36:38.489 INFO:tasks.workunit.client.1.smithi135.stdout:8/948: sync 2024-09-10T09:36:38.489 INFO:tasks.workunit.client.1.smithi135.stdout:2/944: write df/d1b/d23/d98/d5f/d2c/d7d/fa5 [949048,10625] 0 2024-09-10T09:36:38.491 INFO:tasks.workunit.client.1.smithi135.stdout:7/863: creat d2/d15/d4a/d36/d84/f10c x:0 0 0 2024-09-10T09:36:38.492 INFO:tasks.workunit.client.1.smithi135.stdout:8/949: creat d1/d15/d49/d121/da7/d129/f130 x:0 0 0 2024-09-10T09:36:38.492 INFO:tasks.workunit.client.1.smithi135.stdout:8/950: readlink d1/d15/d49/d69/l6c 0 2024-09-10T09:36:38.494 INFO:tasks.workunit.client.1.smithi135.stdout:2/945: truncate df/d13/d102/fcd 232506 0 2024-09-10T09:36:38.497 INFO:tasks.workunit.client.1.smithi135.stdout:8/951: mknod d1/d15/d49/d121/da7/d129/c131 0 2024-09-10T09:36:38.501 INFO:tasks.workunit.client.1.smithi135.stdout:2/946: getdents df/d1b/d23/d98 0 2024-09-10T09:36:38.501 INFO:tasks.workunit.client.1.smithi135.stdout:2/947: chown la 898 1 2024-09-10T09:36:38.503 INFO:tasks.workunit.client.1.smithi135.stdout:7/864: mknod d2/c10d 0 2024-09-10T09:36:38.505 INFO:tasks.workunit.client.1.smithi135.stdout:8/952: mknod d1/d27/d3d/dd3/c132 0 2024-09-10T09:36:38.507 INFO:tasks.workunit.client.1.smithi135.stdout:2/948: creat df/d1b/d23/d98/d5f/d3d/d87/db0/d122/f12f x:0 0 0 2024-09-10T09:36:38.509 INFO:tasks.workunit.client.1.smithi135.stdout:8/953: rename d1/d15/d16/d99/l102 to d1/d15/d49/d7c/l133 0 2024-09-10T09:36:38.510 INFO:tasks.workunit.client.1.smithi135.stdout:2/949: creat df/d1b/d23/d98/dee/f130 x:0 0 0 2024-09-10T09:36:38.512 INFO:tasks.workunit.client.1.smithi135.stdout:8/954: rename d1/d15/f19 to d1/d8f/da0/dd9/d103/f134 0 2024-09-10T09:36:38.512 INFO:tasks.workunit.client.1.smithi135.stdout:8/955: write d1/d15/d16/d33/d39/fe4 [828486,98216] 0 2024-09-10T09:36:38.516 INFO:tasks.workunit.client.1.smithi135.stdout:2/950: rename df/d13/l14 to df/d1b/d23/d98/d5f/d2c/d7d/l131 0 2024-09-10T09:36:38.520 INFO:tasks.workunit.client.1.smithi135.stdout:8/956: rename d1/f3 to d1/d15/d24/d106/d114/f135 0 2024-09-10T09:36:38.523 INFO:tasks.workunit.client.1.smithi135.stdout:7/865: dwrite d2/d25/da8/fd9 [0,4194304] 0 2024-09-10T09:36:38.528 INFO:tasks.workunit.client.1.smithi135.stdout:2/951: write df/f17 [443030,60317] 0 2024-09-10T09:36:38.531 INFO:tasks.workunit.client.1.smithi135.stdout:2/952: creat df/d13/f132 x:0 0 0 2024-09-10T09:36:38.531 INFO:tasks.workunit.client.1.smithi135.stdout:2/953: readlink df/d1b/d23/d42/l56 0 2024-09-10T09:36:38.531 INFO:tasks.workunit.client.1.smithi135.stdout:2/954: truncate df/fb1 8808326 0 2024-09-10T09:36:38.531 INFO:tasks.workunit.client.1.smithi135.stdout:7/866: dread d2/d15/d4a/d36/f5b [0,4194304] 0 2024-09-10T09:36:38.533 INFO:tasks.workunit.client.1.smithi135.stdout:2/955: symlink df/d13/d4f/d95/d97/l133 0 2024-09-10T09:36:38.533 INFO:tasks.workunit.client.1.smithi135.stdout:2/956: dread - df/d13/d52/d8f/ff9 zero size 2024-09-10T09:36:38.533 INFO:tasks.workunit.client.1.smithi135.stdout:2/957: chown df/d1b/d23/d98/d5f/fe3 2186 1 2024-09-10T09:36:38.533 INFO:tasks.workunit.client.1.smithi135.stdout:2/958: chown df/d1b/d23/d98/d5f/d3d/d87/ca0 450930 1 2024-09-10T09:36:38.568 INFO:tasks.workunit.client.1.smithi135.stdout:7/867: write d2/d15/d4a/d36/f59 [281926,71864] 0 2024-09-10T09:36:38.570 INFO:tasks.workunit.client.1.smithi135.stdout:7/868: symlink d2/d25/daa/dfb/l10e 0 2024-09-10T09:36:38.571 INFO:tasks.workunit.client.1.smithi135.stdout:7/869: rename d2/d15/d39/d9f/db2/c7d to d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dae/c10f 0 2024-09-10T09:36:38.573 INFO:tasks.workunit.client.1.smithi135.stdout:7/870: getdents d2/d15/d39/d9f/db2/dcc/d49/de8 0 2024-09-10T09:36:38.577 INFO:tasks.workunit.client.1.smithi135.stdout:3/774: sync 2024-09-10T09:36:38.577 INFO:tasks.workunit.client.1.smithi135.stdout:3/775: write d4/d5/db/dd/d79/fd7 [1035960,41993] 0 2024-09-10T09:36:38.577 INFO:tasks.workunit.client.1.smithi135.stdout:3/776: dread - d4/d5/d51/fca zero size 2024-09-10T09:36:38.578 INFO:tasks.workunit.client.1.smithi135.stdout:3/777: truncate d4/f96 1400928 0 2024-09-10T09:36:38.604 INFO:tasks.workunit.client.1.smithi135.stdout:3/778: dwrite d4/d5/dc/f10 [0,4194304] 0 2024-09-10T09:36:38.606 INFO:tasks.workunit.client.1.smithi135.stdout:3/779: creat d4/d5/d76/da0/feb x:0 0 0 2024-09-10T09:36:38.606 INFO:tasks.workunit.client.1.smithi135.stdout:3/780: dread - d4/d5/db/d36/d43/d87/dde/fa4 zero size 2024-09-10T09:36:38.609 INFO:tasks.workunit.client.1.smithi135.stdout:3/781: truncate d4/d5/dc/f50 1093972 0 2024-09-10T09:36:38.619 INFO:tasks.workunit.client.1.smithi135.stdout:3/782: dread d4/d5/f39 [0,4194304] 0 2024-09-10T09:36:38.621 INFO:tasks.workunit.client.1.smithi135.stdout:3/783: creat d4/d5/db/d36/d6a/daf/de7/fec x:0 0 0 2024-09-10T09:36:38.640 INFO:tasks.workunit.client.1.smithi135.stdout:3/784: dwrite d4/d5/d51/fa1 [0,4194304] 0 2024-09-10T09:36:38.640 INFO:tasks.workunit.client.1.smithi135.stdout:3/785: fsync d4/d55/fe8 0 2024-09-10T09:36:38.644 INFO:tasks.workunit.client.1.smithi135.stdout:3/786: creat d4/d5/db/d36/fed x:0 0 0 2024-09-10T09:36:38.653 INFO:tasks.workunit.client.1.smithi135.stdout:3/787: dread d4/d5/db/d44/f4e [0,4194304] 0 2024-09-10T09:36:38.653 INFO:tasks.workunit.client.1.smithi135.stdout:3/788: chown d4/d5/db/d36/d43/d87/dde/d5b/lbf 55 1 2024-09-10T09:36:38.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/789: dread d4/d5/d51/fa1 [0,4194304] 0 2024-09-10T09:36:38.661 INFO:tasks.workunit.client.1.smithi135.stdout:3/790: creat d4/d5/db/d36/d6a/daf/de7/fee x:0 0 0 2024-09-10T09:36:38.664 INFO:tasks.workunit.client.1.smithi135.stdout:3/791: unlink d4/d5/dc/f17 0 2024-09-10T09:36:38.666 INFO:tasks.workunit.client.1.smithi135.stdout:3/792: dread d4/d5/db/d36/d43/d87/dde/f1e [0,4194304] 0 2024-09-10T09:36:38.667 INFO:tasks.workunit.client.1.smithi135.stdout:3/793: write d4/d55/fe9 [863460,86868] 0 2024-09-10T09:36:38.667 INFO:tasks.workunit.client.1.smithi135.stdout:3/794: write d4/f25 [756501,119627] 0 2024-09-10T09:36:38.667 INFO:tasks.workunit.client.1.smithi135.stdout:3/795: creat d4/d5/db/d36/fef x:0 0 0 2024-09-10T09:36:38.673 INFO:tasks.workunit.client.1.smithi135.stdout:3/796: dread d4/f7b [0,4194304] 0 2024-09-10T09:36:38.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:38 smithi135 ceph-mon[33411]: from='client.24399 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:38.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:38 smithi135 ceph-mon[33411]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:38.723 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.721+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff638105da0 con 0x7ff628039360 2024-09-10T09:36:38.725 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.723+0000 7ff635ffb700 1 -- 172.21.15.79:0/2171082042 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff638105da0 con 0x7ff628039360 2024-09-10T09:36:38.725 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:36:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:36:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:36:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:36:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [], 2024-09-10T09:36:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "1/2 daemons upgraded", 2024-09-10T09:36:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "", 2024-09-10T09:36:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:36:38.727 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.725+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff628039360 msgr2=0x7ff62803b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.725+0000 7ff63f175700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff628039360 0x7ff62803b810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff62400b5c0 tx=0x7ff624005ee0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638100250 msgr2=0x7ff638195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638100250 0x7ff638195aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00d900 tx=0x7ff62c00dc10 comp rx=0 tx=0).stop 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 shutdown_connections 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7ff628039360 0x7ff62803b810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff638100250 0x7ff638195aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 --2- 172.21.15.79:0/2171082042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff638101450 0x7ff638195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 >> 172.21.15.79:0/2171082042 conn(0x7ff6380fb7e0 msgr2=0x7ff638104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 shutdown_connections 2024-09-10T09:36:38.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:36:38.726+0000 7ff63f175700 1 -- 172.21.15.79:0/2171082042 wait complete. 2024-09-10T09:36:38.893 INFO:tasks.workunit.client.1.smithi135.stdout:8/957: sync 2024-09-10T09:36:38.894 INFO:tasks.workunit.client.1.smithi135.stdout:8/958: rename d1/d15/d16/d99/f12a to d1/d27/d3d/db7/f136 0 2024-09-10T09:36:38.896 INFO:tasks.workunit.client.1.smithi135.stdout:8/959: symlink d1/d15/d16/d99/da9/d110/l137 0 2024-09-10T09:36:38.898 INFO:tasks.workunit.client.1.smithi135.stdout:8/960: link d1/d15/d16/d33/d39/f9a d1/d15/d49/f138 0 2024-09-10T09:36:38.900 INFO:tasks.workunit.client.1.smithi135.stdout:8/961: creat d1/d15/d16/d99/da9/d110/f139 x:0 0 0 2024-09-10T09:36:38.902 INFO:tasks.workunit.client.1.smithi135.stdout:8/962: dread d1/fad [0,4194304] 0 2024-09-10T09:36:38.904 INFO:tasks.workunit.client.1.smithi135.stdout:8/963: symlink d1/d15/d49/d121/da7/l13a 0 2024-09-10T09:36:38.904 INFO:tasks.workunit.client.1.smithi135.stdout:8/964: fsync d1/d15/d16/f61 0 2024-09-10T09:36:38.905 INFO:tasks.workunit.client.1.smithi135.stdout:8/965: write d1/d15/d16/d33/d45/d6f/fac [281576,55501] 0 2024-09-10T09:36:38.932 INFO:tasks.workunit.client.1.smithi135.stdout:8/966: dwrite d1/d15/d16/fcb [0,4194304] 0 2024-09-10T09:36:38.957 INFO:tasks.workunit.client.1.smithi135.stdout:8/967: dwrite d1/ff7 [0,4194304] 0 2024-09-10T09:36:38.957 INFO:tasks.workunit.client.1.smithi135.stdout:8/968: fsync d1/d27/f40 0 2024-09-10T09:36:38.957 INFO:tasks.workunit.client.1.smithi135.stdout:8/969: fsync d1/f20 0 2024-09-10T09:36:38.961 INFO:tasks.workunit.client.1.smithi135.stdout:8/970: creat d1/d15/d49/d121/da7/d108/f13b x:0 0 0 2024-09-10T09:36:38.990 INFO:tasks.workunit.client.1.smithi135.stdout:8/971: dwrite d1/d15/d49/d121/da7/fbb [0,4194304] 0 2024-09-10T09:36:38.990 INFO:tasks.workunit.client.1.smithi135.stdout:8/972: chown d1/d15/d16/d99 31 1 2024-09-10T09:36:38.991 INFO:tasks.workunit.client.1.smithi135.stdout:8/973: fdatasync d1/d15/d49/d121/da7/f117 0 2024-09-10T09:36:38.997 INFO:tasks.workunit.client.1.smithi135.stdout:8/974: creat d1/d15/d16/d99/f13c x:0 0 0 2024-09-10T09:36:38.999 INFO:tasks.workunit.client.1.smithi135.stdout:8/975: truncate d1/d13/f6e 1875207 0 2024-09-10T09:36:39.003 INFO:tasks.workunit.client.1.smithi135.stdout:8/976: creat d1/d15/d16/d33/d39/f13d x:0 0 0 2024-09-10T09:36:39.007 INFO:tasks.workunit.client.1.smithi135.stdout:8/977: getdents d1/d15/d24 0 2024-09-10T09:36:39.007 INFO:tasks.workunit.client.1.smithi135.stdout:8/978: chown d1/d13 424291310 1 2024-09-10T09:36:39.010 INFO:tasks.workunit.client.1.smithi135.stdout:8/979: mkdir d1/d15/d16/d33/d13e 0 2024-09-10T09:36:39.015 INFO:tasks.workunit.client.1.smithi135.stdout:8/980: truncate d1/d15/d16/d33/d45/f5d 2695641 0 2024-09-10T09:36:39.015 INFO:tasks.workunit.client.1.smithi135.stdout:8/981: write d1/d15/d16/d96/fbe [2669632,32015] 0 2024-09-10T09:36:39.020 INFO:tasks.workunit.client.1.smithi135.stdout:8/982: creat d1/d27/f13f x:0 0 0 2024-09-10T09:36:39.031 INFO:tasks.workunit.client.1.smithi135.stdout:8/983: dread d1/f10d [0,4194304] 0 2024-09-10T09:36:39.031 INFO:tasks.workunit.client.1.smithi135.stdout:8/984: truncate d1/d15/d49/f116 344290 0 2024-09-10T09:36:39.049 INFO:tasks.workunit.client.1.smithi135.stdout:8/985: dread d1/d15/d49/fc8 [0,4194304] 0 2024-09-10T09:36:39.053 INFO:tasks.workunit.client.1.smithi135.stdout:8/986: dread d1/d15/f9d [0,4194304] 0 2024-09-10T09:36:39.055 INFO:tasks.workunit.client.1.smithi135.stdout:8/987: creat d1/d15/d16/d33/f140 x:0 0 0 2024-09-10T09:36:39.055 INFO:tasks.workunit.client.1.smithi135.stdout:8/988: readlink d1/d15/d16/d33/d45/d70/l8c 0 2024-09-10T09:36:39.055 INFO:tasks.workunit.client.1.smithi135.stdout:8/989: chown d1/d13/cd4 10869376 1 2024-09-10T09:36:39.056 INFO:tasks.workunit.client.1.smithi135.stdout:8/990: write d1/d15/d16/d99/fb6 [95727,111229] 0 2024-09-10T09:36:39.057 INFO:tasks.workunit.client.1.smithi135.stdout:8/991: symlink d1/d15/d49/d7c/l141 0 2024-09-10T09:36:39.058 INFO:tasks.workunit.client.1.smithi135.stdout:8/992: mknod d1/d15/d16/d96/c142 0 2024-09-10T09:36:39.075 INFO:tasks.workunit.client.1.smithi135.stdout:2/959: sync 2024-09-10T09:36:39.075 INFO:tasks.workunit.client.1.smithi135.stdout:7/871: sync 2024-09-10T09:36:39.076 INFO:tasks.workunit.client.1.smithi135.stdout:3/797: sync 2024-09-10T09:36:39.080 INFO:tasks.workunit.client.1.smithi135.stdout:2/960: rename df/d1b/d31/ffd to df/d1b/d23/d98/d5f/d2c/d7d/f134 0 2024-09-10T09:36:39.080 INFO:tasks.workunit.client.1.smithi135.stdout:2/961: readlink df/d1b/d23/d98/d5f/d2c/lcf 0 2024-09-10T09:36:39.081 INFO:tasks.workunit.client.1.smithi135.stdout:3/798: symlink d4/d5/lf0 0 2024-09-10T09:36:39.081 INFO:tasks.workunit.client.1.smithi135.stdout:8/993: dwrite d1/d15/d16/d99/da9/d110/f139 [0,4194304] 0 2024-09-10T09:36:39.083 INFO:tasks.workunit.client.1.smithi135.stdout:2/962: mknod df/d1b/d23/c135 0 2024-09-10T09:36:39.084 INFO:tasks.workunit.client.1.smithi135.stdout:3/799: truncate d4/d5/dc/d71/fd3 1557361 0 2024-09-10T09:36:39.090 INFO:tasks.workunit.client.1.smithi135.stdout:8/994: unlink d1/d15/d16/d33/d45/d70/l88 0 2024-09-10T09:36:39.091 INFO:tasks.workunit.client.1.smithi135.stdout:7/872: dread d2/d15/d39/d9f/fba [0,4194304] 0 2024-09-10T09:36:39.091 INFO:tasks.workunit.client.1.smithi135.stdout:7/873: write d2/d15/d4a/d36/f5b [4851055,62788] 0 2024-09-10T09:36:39.093 INFO:tasks.workunit.client.1.smithi135.stdout:7/874: dread d2/d15/d39/d9f/db2/dcc/d49/de8/f106 [0,4194304] 0 2024-09-10T09:36:39.093 INFO:tasks.workunit.client.1.smithi135.stdout:7/875: fdatasync d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/f97 0 2024-09-10T09:36:39.093 INFO:tasks.workunit.client.1.smithi135.stdout:7/876: chown d2/d25/da8/fd9 456440 1 2024-09-10T09:36:39.093 INFO:tasks.workunit.client.1.smithi135.stdout:2/963: mknod df/d1b/c136 0 2024-09-10T09:36:39.093 INFO:tasks.workunit.client.1.smithi135.stdout:2/964: read - df/fe2 zero size 2024-09-10T09:36:39.094 INFO:tasks.workunit.client.1.smithi135.stdout:2/965: chown df/d1b/d23/d98/d5f/d3d/d87/db0/ff0 6728681 1 2024-09-10T09:36:39.094 INFO:tasks.workunit.client.1.smithi135.stdout:3/800: rename d4/d5/db/dd/c8e to d4/d5/dc/cf1 0 2024-09-10T09:36:39.094 INFO:tasks.workunit.client.1.smithi135.stdout:3/801: truncate d4/d5/db/d36/d6a/daf/de7/fb3 972843 0 2024-09-10T09:36:39.100 INFO:tasks.workunit.client.1.smithi135.stdout:8/995: read d1/d27/f36 [3170216,60937] 0 2024-09-10T09:36:39.101 INFO:tasks.workunit.client.1.smithi135.stdout:7/877: mknod d2/d15/d39/d6f/c110 0 2024-09-10T09:36:39.104 INFO:tasks.workunit.client.1.smithi135.stdout:2/966: symlink df/d1b/d23/d98/d5f/d3d/l137 0 2024-09-10T09:36:39.107 INFO:tasks.workunit.client.1.smithi135.stdout:3/802: mkdir d4/d5/db/df2 0 2024-09-10T09:36:39.117 INFO:tasks.workunit.client.1.smithi135.stdout:7/878: link d2/d15/d39/d9f/db2/dcc/d49/d60/f43 d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/de1/f111 0 2024-09-10T09:36:39.117 INFO:tasks.workunit.client.1.smithi135.stdout:7/879: creat d2/d25/da8/f112 x:0 0 0 2024-09-10T09:36:39.117 INFO:tasks.workunit.client.1.smithi135.stdout:7/880: dread - d2/d15/d4a/fe2 zero size 2024-09-10T09:36:39.118 INFO:tasks.workunit.client.1.smithi135.stdout:7/881: creat d2/d15/d4a/d36/f113 x:0 0 0 2024-09-10T09:36:39.133 INFO:tasks.workunit.client.1.smithi135.stdout:7/882: dread d2/d15/d39/d9f/db2/dcc/d49/d60/f27 [0,4194304] 0 2024-09-10T09:36:39.133 INFO:tasks.workunit.client.1.smithi135.stdout:7/883: read d2/f10 [3176854,94727] 0 2024-09-10T09:36:39.145 INFO:tasks.workunit.client.1.smithi135.stdout:8/996: dwrite d1/d8f/da2/fef [0,4194304] 0 2024-09-10T09:36:39.148 INFO:tasks.workunit.client.1.smithi135.stdout:8/997: mkdir d1/d8f/da0/dd9/d103/d143 0 2024-09-10T09:36:39.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/998: creat d1/d15/d24/d106/d12d/f144 x:0 0 0 2024-09-10T09:36:39.150 INFO:tasks.workunit.client.1.smithi135.stdout:8/999: write d1/d15/d24/f2c [5632620,35106] 0 2024-09-10T09:36:39.151 INFO:tasks.workunit.client.1.smithi135.stdout:2/967: dwrite df/d13/d52/d124/ff7 [0,4194304] 0 2024-09-10T09:36:39.151 INFO:tasks.workunit.client.1.smithi135.stdout:2/968: stat df/d15/f67 0 2024-09-10T09:36:39.153 INFO:tasks.workunit.client.1.smithi135.stdout:2/969: creat df/d1b/d23/f138 x:0 0 0 2024-09-10T09:36:39.154 INFO:tasks.workunit.client.1.smithi135.stdout:2/970: creat df/d13/d52/f139 x:0 0 0 2024-09-10T09:36:39.157 INFO:tasks.workunit.client.1.smithi135.stdout:2/971: read f8 [1269584,117165] 0 2024-09-10T09:36:39.159 INFO:tasks.workunit.client.1.smithi135.stdout:3/803: dwrite d4/d5/db/d36/fef [0,4194304] 0 2024-09-10T09:36:39.159 INFO:tasks.workunit.client.1.smithi135.stdout:7/884: dwrite d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/de1/f111 [0,4194304] 0 2024-09-10T09:36:39.159 INFO:tasks.workunit.client.1.smithi135.stdout:2/972: creat df/d1b/d23/d98/dcb/f13a x:0 0 0 2024-09-10T09:36:39.159 INFO:tasks.workunit.client.1.smithi135.stdout:2/973: write df/d13/d52/d8f/ff9 [575692,51177] 0 2024-09-10T09:36:39.159 INFO:tasks.workunit.client.1.smithi135.stdout:2/974: write df/d15/f67 [4569546,30565] 0 2024-09-10T09:36:39.163 INFO:tasks.workunit.client.1.smithi135.stdout:7/885: mknod d2/d25/daa/c114 0 2024-09-10T09:36:39.163 INFO:tasks.workunit.client.1.smithi135.stdout:7/886: fdatasync d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/f97 0 2024-09-10T09:36:39.166 INFO:tasks.workunit.client.1.smithi135.stdout:7/887: unlink d2/d15/d39/d9f/db2/dcc/d49/cb3 0 2024-09-10T09:36:39.166 INFO:tasks.workunit.client.1.smithi135.stdout:7/888: truncate d2/d15/d39/d53/ff0 94195 0 2024-09-10T09:36:39.166 INFO:tasks.workunit.client.1.smithi135.stdout:7/889: write d2/d25/f3f [9397495,98098] 0 2024-09-10T09:36:39.166 INFO:tasks.workunit.client.1.smithi135.stdout:7/890: write d2/d15/d4a/f5a [1047556,31242] 0 2024-09-10T09:36:39.176 INFO:tasks.workunit.client.1.smithi135.stdout:7/891: dread d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/de1/f111 [0,4194304] 0 2024-09-10T09:36:39.179 INFO:tasks.workunit.client.1.smithi135.stdout:7/892: creat d2/d25/d5d/dbd/f115 x:0 0 0 2024-09-10T09:36:39.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/893: creat d2/d25/daa/dfb/f116 x:0 0 0 2024-09-10T09:36:39.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/894: mknod d2/d15/d4a/c117 0 2024-09-10T09:36:39.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/895: stat d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f7a 0 2024-09-10T09:36:39.185 INFO:tasks.workunit.client.1.smithi135.stdout:7/896: mknod d2/d15/d4a/d36/d84/c118 0 2024-09-10T09:36:39.189 INFO:tasks.workunit.client.1.smithi135.stdout:7/897: rename d2/d15/d39/d9f/db2/dcc/d49/d60/d16/df8/dfd to d2/d25/da8/d119 0 2024-09-10T09:36:39.189 INFO:tasks.workunit.client.1.smithi135.stdout:7/898: stat d2/d25/d9d/daf/fc0 0 2024-09-10T09:36:39.189 INFO:tasks.workunit.client.1.smithi135.stdout:7/899: write d2/d15/d39/d9f/db2/dcc/d49/d60/de4/fea [772297,1112] 0 2024-09-10T09:36:39.189 INFO:tasks.workunit.client.1.smithi135.stdout:3/804: dwrite d4/f9 [0,4194304] 0 2024-09-10T09:36:39.189 INFO:tasks.workunit.client.1.smithi135.stdout:3/805: write d4/d5/d51/fca [746485,4974] 0 2024-09-10T09:36:39.189 INFO:tasks.workunit.client.1.smithi135.stdout:3/806: rmdir d4/d5/db/d36/d43/d87/dde/d5b 39 2024-09-10T09:36:39.191 INFO:tasks.workunit.client.1.smithi135.stdout:7/900: truncate d2/f1f 673349 0 2024-09-10T09:36:39.192 INFO:tasks.workunit.client.1.smithi135.stdout:3/807: mknod d4/d5/db/dd/d79/cf3 0 2024-09-10T09:36:39.193 INFO:tasks.workunit.client.1.smithi135.stdout:3/808: creat d4/ff4 x:0 0 0 2024-09-10T09:36:39.195 INFO:tasks.workunit.client.1.smithi135.stdout:7/901: dread d2/d15/d39/d9f/db2/dcc/d49/d60/f43 [0,4194304] 0 2024-09-10T09:36:39.197 INFO:tasks.workunit.client.1.smithi135.stdout:7/902: dread d2/d15/d39/d9f/db2/dcc/f6c [0,4194304] 0 2024-09-10T09:36:39.203 INFO:tasks.workunit.client.1.smithi135.stdout:3/809: dread d4/d5/db/d36/d43/f46 [4194304,4194304] 0 2024-09-10T09:36:39.209 INFO:tasks.workunit.client.1.smithi135.stdout:3/810: mknod d4/d5/db/d36/d43/dbb/cf5 0 2024-09-10T09:36:39.212 INFO:tasks.workunit.client.1.smithi135.stdout:3/811: mkdir d4/d5/dc/df6 0 2024-09-10T09:36:39.213 INFO:tasks.workunit.client.1.smithi135.stdout:3/812: mknod d4/d55/cf7 0 2024-09-10T09:36:39.217 INFO:tasks.workunit.client.1.smithi135.stdout:3/813: write d4/f7b [812302,88297] 0 2024-09-10T09:36:39.218 INFO:tasks.workunit.client.1.smithi135.stdout:3/814: creat d4/d5/db/dd/ff8 x:0 0 0 2024-09-10T09:36:39.218 INFO:tasks.workunit.client.1.smithi135.stdout:3/815: write d4/d5/db/d36/d43/dbb/f73 [726740,46125] 0 2024-09-10T09:36:39.237 INFO:tasks.workunit.client.1.smithi135.stdout:3/816: dwrite d4/d5/db/d44/f4e [4194304,4194304] 0 2024-09-10T09:36:39.240 INFO:tasks.workunit.client.1.smithi135.stdout:3/817: creat d4/d5/db/d36/d6a/daf/ff9 x:0 0 0 2024-09-10T09:36:39.240 INFO:tasks.workunit.client.1.smithi135.stdout:3/818: truncate d4/d5/db/d36/d6a/daf/de7/fb3 1232481 0 2024-09-10T09:36:39.242 INFO:tasks.workunit.client.1.smithi135.stdout:3/819: mkdir d4/d5/db/d36/d43/d87/dde/d5b/db4/dfa 0 2024-09-10T09:36:39.248 INFO:tasks.workunit.client.1.smithi135.stdout:3/820: dread d4/f4d [0,4194304] 0 2024-09-10T09:36:39.248 INFO:tasks.workunit.client.1.smithi135.stdout:3/821: chown d4/d5/db/d36/d43/d87/dde/fc4 10444814 1 2024-09-10T09:36:39.252 INFO:tasks.workunit.client.1.smithi135.stdout:3/822: truncate d4/d5/db/f2f 1370971 0 2024-09-10T09:36:39.270 INFO:tasks.workunit.client.1.smithi135.stdout:3/823: dwrite d4/d5/db/dd/d79/f85 [0,4194304] 0 2024-09-10T09:36:39.287 INFO:tasks.workunit.client.1.smithi135.stdout:3/824: dwrite d4/d5/f8c [0,4194304] 0 2024-09-10T09:36:39.289 INFO:tasks.workunit.client.1.smithi135.stdout:3/825: getdents d4/d5/db/dd/d79 0 2024-09-10T09:36:39.303 INFO:tasks.workunit.client.1.smithi135.stdout:3/826: dwrite d4/d5/d51/f7d [0,4194304] 0 2024-09-10T09:36:39.303 INFO:tasks.workunit.client.1.smithi135.stdout:3/827: truncate d4/d5/db/d44/da9/fc7 144081 0 2024-09-10T09:36:39.303 INFO:tasks.workunit.client.1.smithi135.stdout:3/828: stat d4/d55/fc9 0 2024-09-10T09:36:39.311 INFO:tasks.workunit.client.1.smithi135.stdout:3/829: rmdir d4/d5/d76 39 2024-09-10T09:36:39.311 INFO:tasks.workunit.client.1.smithi135.stdout:3/830: fdatasync d4/d5/db/f2f 0 2024-09-10T09:36:39.325 INFO:tasks.workunit.client.1.smithi135.stdout:3/831: dwrite d4/d5/db/d36/d6a/daf/de7/fb3 [0,4194304] 0 2024-09-10T09:36:39.328 INFO:tasks.workunit.client.1.smithi135.stdout:3/832: symlink d4/d5/db/d36/d43/d87/dde/d5b/db4/dfa/lfb 0 2024-09-10T09:36:39.329 INFO:tasks.workunit.client.1.smithi135.stdout:3/833: mknod d4/d5/dc/d8b/cfc 0 2024-09-10T09:36:39.330 INFO:tasks.workunit.client.1.smithi135.stdout:3/834: mknod d4/d5/db/d36/cfd 0 2024-09-10T09:36:39.332 INFO:tasks.workunit.client.1.smithi135.stdout:3/835: rename d4/d5/db/d44/ca7 to d4/d5/db/d36/d43/dbb/cfe 0 2024-09-10T09:36:39.333 INFO:tasks.workunit.client.1.smithi135.stdout:3/836: symlink d4/d5/lff 0 2024-09-10T09:36:39.335 INFO:tasks.workunit.client.1.smithi135.stdout:3/837: getdents d4/d5/dc 0 2024-09-10T09:36:39.336 INFO:tasks.workunit.client.1.smithi135.stdout:3/838: mknod d4/d5/d76/da0/c100 0 2024-09-10T09:36:39.339 INFO:tasks.workunit.client.1.smithi135.stdout:3/839: rmdir d4/d5/db/d36/d43/d87 39 2024-09-10T09:36:39.339 INFO:tasks.workunit.client.1.smithi135.stdout:3/840: write d4/f25 [1433389,12653] 0 2024-09-10T09:36:39.339 INFO:tasks.workunit.client.1.smithi135.stdout:3/841: fsync d4/d55/f60 0 2024-09-10T09:36:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:3/842: rename d4/d5/dc/d71/fd3 to d4/d5/db/d36/d43/db9/f101 0 2024-09-10T09:36:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:3/843: write d4/d5/dc/fbd [971405,90020] 0 2024-09-10T09:36:39.342 INFO:tasks.workunit.client.1.smithi135.stdout:3/844: creat d4/d5/db/d36/f102 x:0 0 0 2024-09-10T09:36:39.346 INFO:tasks.workunit.client.1.smithi135.stdout:3/845: rename d4/d5/db/d36/d43/d87/dde/fa4 to d4/d5/db/d44/da9/de0/f103 0 2024-09-10T09:36:39.346 INFO:tasks.workunit.client.1.smithi135.stdout:3/846: fdatasync d4/d5/db/d36/f90 0 2024-09-10T09:36:39.347 INFO:tasks.workunit.client.1.smithi135.stdout:3/847: mkdir d4/d5/db/d44/da9/de0/d104 0 2024-09-10T09:36:39.349 INFO:tasks.workunit.client.1.smithi135.stdout:3/848: unlink d4/d5/d76/fc6 0 2024-09-10T09:36:39.351 INFO:tasks.workunit.client.1.smithi135.stdout:3/849: mknod d4/d5/d76/c105 0 2024-09-10T09:36:39.351 INFO:tasks.workunit.client.1.smithi135.stdout:3/850: write d4/d5/d51/fd5 [76466,125691] 0 2024-09-10T09:36:39.352 INFO:tasks.workunit.client.1.smithi135.stdout:3/851: mknod d4/d5/db/dd/c106 0 2024-09-10T09:36:39.353 INFO:tasks.workunit.client.1.smithi135.stdout:3/852: symlink d4/d5/d51/l107 0 2024-09-10T09:36:39.354 INFO:tasks.workunit.client.1.smithi135.stdout:3/853: fsync d4/d5/db/f3f 0 2024-09-10T09:36:39.363 INFO:tasks.workunit.client.1.smithi135.stdout:3/854: write d4/d5/db/dd/d79/f85 [1638071,115257] 0 2024-09-10T09:36:39.363 INFO:tasks.workunit.client.1.smithi135.stdout:3/855: fsync d4/d5/d76/da0/feb 0 2024-09-10T09:36:39.364 INFO:tasks.workunit.client.1.smithi135.stdout:3/856: symlink d4/d55/l108 0 2024-09-10T09:36:39.595 INFO:tasks.workunit.client.1.smithi135.stdout:7/903: sync 2024-09-10T09:36:39.595 INFO:tasks.workunit.client.1.smithi135.stdout:3/857: sync 2024-09-10T09:36:39.595 INFO:tasks.workunit.client.1.smithi135.stdout:2/975: sync 2024-09-10T09:36:39.596 INFO:tasks.workunit.client.1.smithi135.stdout:7/904: read d2/d15/d39/d9f/db2/dcc/d49/fa0 [597262,72128] 0 2024-09-10T09:36:39.597 INFO:tasks.workunit.client.1.smithi135.stdout:7/905: fdatasync d2/d15/f1c 0 2024-09-10T09:36:39.602 INFO:tasks.workunit.client.1.smithi135.stdout:7/906: link d2/d15/d4a/d36/f5b d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/f11a 0 2024-09-10T09:36:39.606 INFO:tasks.workunit.client.1.smithi135.stdout:7/907: link d2/d15/d39/d9f/db2/dcc/d49/d60/de4/fea d2/d15/d39/d9f/db2/f11b 0 2024-09-10T09:36:39.613 INFO:tasks.workunit.client.1.smithi135.stdout:2/976: dwrite df/d1b/d70/f120 [0,4194304] 0 2024-09-10T09:36:39.616 INFO:tasks.workunit.client.1.smithi135.stdout:7/908: write d2/d15/d39/f6d [1445084,20660] 0 2024-09-10T09:36:39.617 INFO:tasks.workunit.client.1.smithi135.stdout:2/977: mknod df/d1b/d23/d98/dcb/c13b 0 2024-09-10T09:36:39.619 INFO:tasks.workunit.client.1.smithi135.stdout:7/909: link d2/d26/le3 d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/dbf/d105/l11c 0 2024-09-10T09:36:39.619 INFO:tasks.workunit.client.1.smithi135.stdout:7/910: fsync d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b/f104 0 2024-09-10T09:36:39.621 INFO:tasks.workunit.client.1.smithi135.stdout:2/978: creat df/d13/d52/d124/d10a/d10d/f13c x:0 0 0 2024-09-10T09:36:39.622 INFO:tasks.workunit.client.1.smithi135.stdout:2/979: dread df/d1b/d31/fc5 [0,4194304] 0 2024-09-10T09:36:39.629 INFO:tasks.workunit.client.1.smithi135.stdout:7/911: write d2/d15/d39/d9f/db2/dcc/fb9 [3518351,119803] 0 2024-09-10T09:36:39.630 INFO:tasks.workunit.client.1.smithi135.stdout:2/980: rmdir df/d13/d4f/d95/d97/d9a/d111 0 2024-09-10T09:36:39.630 INFO:tasks.workunit.client.1.smithi135.stdout:2/981: readlink df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/lb2 0 2024-09-10T09:36:39.633 INFO:tasks.workunit.client.1.smithi135.stdout:7/912: creat d2/d15/d39/d9f/db2/dcc/d49/de8/f11d x:0 0 0 2024-09-10T09:36:39.654 INFO:tasks.workunit.client.1.smithi135.stdout:7/913: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def/f109 [0,4194304] 0 2024-09-10T09:36:39.658 INFO:tasks.workunit.client.1.smithi135.stdout:2/982: dwrite df/d13/d52/f60 [0,4194304] 0 2024-09-10T09:36:39.658 INFO:tasks.workunit.client.1.smithi135.stdout:7/914: symlink d2/d25/d5d/d83/ded/l11e 0 2024-09-10T09:36:39.662 INFO:tasks.workunit.client.1.smithi135.stdout:2/983: rename df/d1b/d70/l7b to df/d1b/d70/l13d 0 2024-09-10T09:36:39.666 INFO:tasks.workunit.client.1.smithi135.stdout:7/915: dread d2/d15/d39/d9f/db2/dcc/d49/d60/f75 [0,4194304] 0 2024-09-10T09:36:39.666 INFO:tasks.workunit.client.1.smithi135.stdout:7/916: fsync d2/d15/d39/d9f/db2/dcc/d49/d60/f27 0 2024-09-10T09:36:39.666 INFO:tasks.workunit.client.1.smithi135.stdout:7/917: stat d2/d15/d39/d9f/db2/dcc/d49/d60/d30 0 2024-09-10T09:36:39.669 INFO:tasks.workunit.client.1.smithi135.stdout:7/918: creat d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71/f11f x:0 0 0 2024-09-10T09:36:39.674 INFO:tasks.workunit.client.1.smithi135.stdout:2/984: rename df/d1b/d23/d98/dee to df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/d13e 0 2024-09-10T09:36:39.684 INFO:tasks.workunit.client.1.smithi135.stdout:2/985: dread df/d1b/d23/d98/d5f/d3d/f106 [0,4194304] 0 2024-09-10T09:36:39.688 INFO:tasks.workunit.client.1.smithi135.stdout:7/919: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/f27 [0,4194304] 0 2024-09-10T09:36:39.689 INFO:tasks.workunit.client.1.smithi135.stdout:7/920: dread d2/ff [0,4194304] 0 2024-09-10T09:36:39.689 INFO:tasks.workunit.client.1.smithi135.stdout:7/921: chown d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/dbf/d105 1925029210 1 2024-09-10T09:36:39.690 INFO:tasks.workunit.client.1.smithi135.stdout:7/922: readlink d2/d15/d39/d9f/db2/dcc/d49/d60/d16/lc5 0 2024-09-10T09:36:39.693 INFO:tasks.workunit.client.1.smithi135.stdout:7/923: link d2/d15/d39/d9f/f10a d2/d25/da8/f120 0 2024-09-10T09:36:39.693 INFO:tasks.workunit.client.1.smithi135.stdout:7/924: truncate d2/d15/d39/d9f/db2/dcc/f44 910063 0 2024-09-10T09:36:39.696 INFO:tasks.workunit.client.1.smithi135.stdout:7/925: rmdir d2/d25/daa/dfb 39 2024-09-10T09:36:39.696 INFO:tasks.workunit.client.1.smithi135.stdout:7/926: stat d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/fa6 0 2024-09-10T09:36:39.697 INFO:tasks.workunit.client.1.smithi135.stdout:7/927: creat d2/d15/d39/d9f/db2/dcc/d49/d60/d30/f121 x:0 0 0 2024-09-10T09:36:39.698 INFO:tasks.workunit.client.1.smithi135.stdout:7/928: write d2/d15/f47 [572060,55758] 0 2024-09-10T09:36:39.700 INFO:tasks.workunit.client.1.smithi135.stdout:7/929: dread d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b/f104 [0,4194304] 0 2024-09-10T09:36:39.701 INFO:tasks.workunit.client.1.smithi135.stdout:7/930: symlink d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/df1/l122 0 2024-09-10T09:36:39.702 INFO:tasks.workunit.client.1.smithi135.stdout:7/931: getdents d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b 0 2024-09-10T09:36:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:2/986: dwrite df/d1b/d23/d98/d5f/d2c/d7d/d8c/d116/f110 [0,4194304] 0 2024-09-10T09:36:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:7/932: creat d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/df1/f123 x:0 0 0 2024-09-10T09:36:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:7/933: write d2/d15/d39/f6d [615611,54466] 0 2024-09-10T09:36:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:7/934: creat d2/d15/d4a/d36/d84/f124 x:0 0 0 2024-09-10T09:36:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:7/935: fsync d2/d15/d39/d9f/db2/dcc/d49/fa0 0 2024-09-10T09:36:39.704 INFO:tasks.workunit.client.1.smithi135.stdout:7/936: fsync d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b/f104 0 2024-09-10T09:36:39.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:39 smithi079 ceph-mon[27592]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:39.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:39 smithi079 ceph-mon[27592]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 26 op/s 2024-09-10T09:36:39.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:39 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1080531916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:36:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:39 smithi135 ceph-mon[33411]: from='client.24407 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:39 smithi135 ceph-mon[33411]: pgmap v6: 65 pgs: 65 active+clean; 2.0 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 12 MiB/s rd, 19 MiB/s wr, 26 op/s 2024-09-10T09:36:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:39 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1080531916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:36:39.722 INFO:tasks.workunit.client.1.smithi135.stdout:7/937: dwrite d2/d25/d5d/d83/f9a [0,4194304] 0 2024-09-10T09:36:39.722 INFO:tasks.workunit.client.1.smithi135.stdout:7/938: dread - d2/d15/d4a/d36/f6a zero size 2024-09-10T09:36:39.722 INFO:tasks.workunit.client.1.smithi135.stdout:7/939: chown d2/d15/c3e 6 1 2024-09-10T09:36:39.772 INFO:tasks.workunit.client.1.smithi135.stdout:7/940: creat d2/d25/d5d/f125 x:0 0 0 2024-09-10T09:36:39.773 INFO:tasks.workunit.client.1.smithi135.stdout:7/941: chown d2/d15/d5c/d85/c107 667322 1 2024-09-10T09:36:39.776 INFO:tasks.workunit.client.1.smithi135.stdout:7/942: write d2/d15/d4a/d36/f5b [3460151,71387] 0 2024-09-10T09:36:39.779 INFO:tasks.workunit.client.1.smithi135.stdout:7/943: creat d2/d15/d39/d9f/db2/dcc/d49/d60/d16/f126 x:0 0 0 2024-09-10T09:36:39.780 INFO:tasks.workunit.client.1.smithi135.stdout:7/944: rename d2/d15/d39/d9f/db2/dcc/d49 to d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dcf/d127 22 2024-09-10T09:36:39.781 INFO:tasks.workunit.client.1.smithi135.stdout:7/945: creat d2/d15/d39/d9f/db2/f128 x:0 0 0 2024-09-10T09:36:39.784 INFO:tasks.workunit.client.1.smithi135.stdout:7/946: rename d2/d15/d4a/f5a to d2/d15/dc7/f129 0 2024-09-10T09:36:39.786 INFO:tasks.workunit.client.1.smithi135.stdout:7/947: unlink d2/d15/d39/d9f/db2/dcc/d49/d60/d30/dae/c10f 0 2024-09-10T09:36:39.788 INFO:tasks.workunit.client.1.smithi135.stdout:7/948: creat d2/d25/d9d/f12a x:0 0 0 2024-09-10T09:36:39.807 INFO:tasks.workunit.client.1.smithi135.stdout:7/949: dwrite d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/de1/f111 [0,4194304] 0 2024-09-10T09:36:39.822 INFO:tasks.workunit.client.1.smithi135.stdout:7/950: dwrite d2/d25/f10b [0,4194304] 0 2024-09-10T09:36:39.823 INFO:tasks.workunit.client.1.smithi135.stdout:7/951: truncate d2/d25/d5d/d83/f9a 1126955 0 2024-09-10T09:36:39.825 INFO:tasks.workunit.client.1.smithi135.stdout:7/952: symlink d2/d15/d39/d53/l12b 0 2024-09-10T09:36:39.825 INFO:tasks.workunit.client.1.smithi135.stdout:7/953: read - d2/d25/d9d/f12a zero size 2024-09-10T09:36:39.844 INFO:tasks.workunit.client.1.smithi135.stdout:7/954: dwrite d2/d15/d39/d53/fbc [0,4194304] 0 2024-09-10T09:36:39.847 INFO:tasks.workunit.client.1.smithi135.stdout:7/955: dread d2/d15/f47 [0,4194304] 0 2024-09-10T09:36:39.858 INFO:tasks.workunit.client.1.smithi135.stdout:7/956: creat d2/d15/d39/d9f/db2/dcc/d49/d60/de4/def/f12c x:0 0 0 2024-09-10T09:36:39.880 INFO:tasks.workunit.client.1.smithi135.stdout:7/957: dwrite d2/d15/dc7/f129 [0,4194304] 0 2024-09-10T09:36:39.880 INFO:tasks.workunit.client.1.smithi135.stdout:7/958: read d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/f11a [3883572,88590] 0 2024-09-10T09:36:39.890 INFO:tasks.workunit.client.1.smithi135.stdout:7/959: dread d2/d25/d5d/f8d [0,4194304] 0 2024-09-10T09:36:40.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/987: sync 2024-09-10T09:36:40.077 INFO:tasks.workunit.client.1.smithi135.stdout:3/858: sync 2024-09-10T09:36:40.077 INFO:tasks.workunit.client.1.smithi135.stdout:2/988: chown df/d13/d52/d8f/fe7 720482 1 2024-09-10T09:36:40.077 INFO:tasks.workunit.client.1.smithi135.stdout:3/859: chown d4/d5/dc/d8b/cfc 61966 1 2024-09-10T09:36:40.078 INFO:tasks.workunit.client.1.smithi135.stdout:2/989: rmdir df/d13/d52/d124 39 2024-09-10T09:36:40.079 INFO:tasks.workunit.client.1.smithi135.stdout:3/860: mknod d4/d5/db/d36/d43/d87/c109 0 2024-09-10T09:36:40.081 INFO:tasks.workunit.client.1.smithi135.stdout:2/990: rename df/d1b/d23/d98/d5f/d3d/l137 to df/d1b/d23/d42/l13f 0 2024-09-10T09:36:40.081 INFO:tasks.workunit.client.1.smithi135.stdout:2/991: write df/d1b/d23/d98/d5f/d3d/f5b [1398018,70443] 0 2024-09-10T09:36:40.086 INFO:tasks.workunit.client.1.smithi135.stdout:2/992: getdents df/d1b/d23/d98/dcb 0 2024-09-10T09:36:40.097 INFO:tasks.workunit.client.1.smithi135.stdout:3/861: dwrite d4/f32 [0,4194304] 0 2024-09-10T09:36:40.097 INFO:tasks.workunit.client.1.smithi135.stdout:3/862: chown d4/d5/db/l66 0 1 2024-09-10T09:36:40.112 INFO:tasks.workunit.client.1.smithi135.stdout:3/863: dwrite d4/d5/db/f3f [0,4194304] 0 2024-09-10T09:36:40.117 INFO:tasks.workunit.client.1.smithi135.stdout:3/864: write d4/f96 [1293092,105615] 0 2024-09-10T09:36:40.132 INFO:tasks.workunit.client.1.smithi135.stdout:3/865: dwrite d4/d5/dc/dce/fdf [0,4194304] 0 2024-09-10T09:36:40.135 INFO:tasks.workunit.client.1.smithi135.stdout:3/866: creat d4/d5/dc/d8b/f10a x:0 0 0 2024-09-10T09:36:40.135 INFO:tasks.workunit.client.1.smithi135.stdout:3/867: creat d4/d5/db/d36/d6a/daf/f10b x:0 0 0 2024-09-10T09:36:40.141 INFO:tasks.workunit.client.1.smithi135.stdout:3/868: dread d4/d5/d51/f7d [0,4194304] 0 2024-09-10T09:36:40.142 INFO:tasks.workunit.client.1.smithi135.stdout:3/869: creat d4/d5/db/d44/da9/de0/f10c x:0 0 0 2024-09-10T09:36:40.143 INFO:tasks.workunit.client.1.smithi135.stdout:3/870: symlink d4/d5/db/d36/d43/db9/l10d 0 2024-09-10T09:36:40.144 INFO:tasks.workunit.client.1.smithi135.stdout:3/871: stat d4/d5/d76/fc1 0 2024-09-10T09:36:40.145 INFO:tasks.workunit.client.1.smithi135.stdout:3/872: creat d4/d5/d76/da0/f10e x:0 0 0 2024-09-10T09:36:40.145 INFO:tasks.workunit.client.1.smithi135.stdout:3/873: fdatasync d4/f25 0 2024-09-10T09:36:40.148 INFO:tasks.workunit.client.1.smithi135.stdout:3/874: getdents d4 0 2024-09-10T09:36:40.150 INFO:tasks.workunit.client.1.smithi135.stdout:3/875: mkdir d4/d5/dc/d8b/d10f 0 2024-09-10T09:36:40.158 INFO:tasks.workunit.client.1.smithi135.stdout:3/876: dread d4/d5/db/dd/d79/f41 [4194304,4194304] 0 2024-09-10T09:36:40.158 INFO:tasks.workunit.client.1.smithi135.stdout:3/877: write d4/d5/db/d36/d43/f6e [1195611,50627] 0 2024-09-10T09:36:40.188 INFO:tasks.workunit.client.1.smithi135.stdout:3/878: dwrite d4/d55/fe9 [0,4194304] 0 2024-09-10T09:36:40.188 INFO:tasks.workunit.client.1.smithi135.stdout:3/879: stat d4/d5/dc/d8b/cfc 0 2024-09-10T09:36:40.188 INFO:tasks.workunit.client.1.smithi135.stdout:3/880: readlink d4/d5/db/d36/d43/db9/l10d 0 2024-09-10T09:36:40.189 INFO:tasks.workunit.client.1.smithi135.stdout:3/881: mknod d4/d5/dc/d8b/d10f/c110 0 2024-09-10T09:36:40.197 INFO:tasks.workunit.client.1.smithi135.stdout:3/882: write d4/d5/db/d36/fef [2292711,19069] 0 2024-09-10T09:36:40.197 INFO:tasks.workunit.client.1.smithi135.stdout:3/883: chown d4/d55/l108 1179 1 2024-09-10T09:36:40.198 INFO:tasks.workunit.client.1.smithi135.stdout:3/884: truncate d4/d5/db/d36/d43/d87/dde/f1e 1775920 0 2024-09-10T09:36:40.199 INFO:tasks.workunit.client.1.smithi135.stdout:3/885: write d4/d5/db/dd/d79/fd7 [191053,127042] 0 2024-09-10T09:36:40.199 INFO:tasks.workunit.client.1.smithi135.stdout:3/886: fsync d4/d5/dc/f49 0 2024-09-10T09:36:40.199 INFO:tasks.workunit.client.1.smithi135.stdout:3/887: write d4/d5/db/d36/d43/dbb/f9f [325271,117067] 0 2024-09-10T09:36:40.202 INFO:tasks.workunit.client.1.smithi135.stdout:3/888: unlink d4/d5/db/d36/d6a/daf/de7/lb7 0 2024-09-10T09:36:40.202 INFO:tasks.workunit.client.1.smithi135.stdout:3/889: dread - d4/d5/db/d36/d6a/daf/de7/fee zero size 2024-09-10T09:36:40.203 INFO:tasks.workunit.client.1.smithi135.stdout:3/890: symlink d4/d5/db/df2/l111 0 2024-09-10T09:36:40.204 INFO:tasks.workunit.client.1.smithi135.stdout:3/891: rmdir d4/d5/db/d36/d43/d87/dde 39 2024-09-10T09:36:40.207 INFO:tasks.workunit.client.1.smithi135.stdout:3/892: rename d4/d5/db/dd/d79 to d4/d5/d51/d112 0 2024-09-10T09:36:40.208 INFO:tasks.workunit.client.1.smithi135.stdout:3/893: symlink d4/d5/d51/dcf/l113 0 2024-09-10T09:36:40.209 INFO:tasks.workunit.client.1.smithi135.stdout:3/894: read d4/f4d [3387405,85956] 0 2024-09-10T09:36:40.209 INFO:tasks.workunit.client.1.smithi135.stdout:3/895: creat d4/d5/dc/d71/f114 x:0 0 0 2024-09-10T09:36:40.210 INFO:tasks.workunit.client.1.smithi135.stdout:3/896: symlink d4/d5/db/d44/da9/dd2/l115 0 2024-09-10T09:36:40.212 INFO:tasks.workunit.client.1.smithi135.stdout:3/897: rename d4/d5/db/dd/lb6 to d4/d5/db/df2/l116 0 2024-09-10T09:36:40.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/960: sync 2024-09-10T09:36:40.391 INFO:tasks.workunit.client.1.smithi135.stdout:7/961: write d2/d15/d4a/d36/f59 [592814,18038] 0 2024-09-10T09:36:40.392 INFO:tasks.workunit.client.1.smithi135.stdout:7/962: symlink d2/d15/d39/d53/l12d 0 2024-09-10T09:36:40.395 INFO:tasks.workunit.client.1.smithi135.stdout:7/963: write d2/f1e [626608,77345] 0 2024-09-10T09:36:40.550 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:40 smithi079 ceph-mon[27592]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:40.566 INFO:tasks.workunit.client.1.smithi135.stdout:2/993: sync 2024-09-10T09:36:40.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/994: readlink df/d1b/d31/l11f 0 2024-09-10T09:36:40.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/995: truncate df/d13/d52/d124/d10a/d10d/f13c 388775 0 2024-09-10T09:36:40.567 INFO:tasks.workunit.client.1.smithi135.stdout:2/996: rename df/d13/d4f/dff to df/d13/d102/d107/d140 0 2024-09-10T09:36:40.570 INFO:tasks.workunit.client.1.smithi135.stdout:2/997: dread df/d13/f44 [0,4194304] 0 2024-09-10T09:36:40.578 INFO:tasks.workunit.client.1.smithi135.stdout:2/998: read df/d13/d52/d8f/fe7 [3926585,33751] 0 2024-09-10T09:36:40.579 INFO:tasks.workunit.client.1.smithi135.stdout:2/999: readlink df/d1b/d23/d98/d5f/d3d/d87/lfa 0 2024-09-10T09:36:40.603 INFO:tasks.workunit.client.1.smithi135.stdout:3/898: sync 2024-09-10T09:36:40.603 INFO:tasks.workunit.client.1.smithi135.stdout:7/964: sync 2024-09-10T09:36:40.609 INFO:tasks.workunit.client.1.smithi135.stdout:3/899: getdents d4/d5/d56 0 2024-09-10T09:36:40.612 INFO:tasks.workunit.client.1.smithi135.stdout:3/900: dread - d4/d5/db/d36/d6a/daf/fda zero size 2024-09-10T09:36:40.615 INFO:tasks.workunit.client.1.smithi135.stdout:3/901: creat d4/d5/db/df2/f117 x:0 0 0 2024-09-10T09:36:40.615 INFO:tasks.workunit.client.1.smithi135.stdout:3/902: readlink d4/d5/d51/lc8 0 2024-09-10T09:36:40.616 INFO:tasks.workunit.client.1.smithi135.stdout:3/903: creat d4/d5/d76/f118 x:0 0 0 2024-09-10T09:36:40.618 INFO:tasks.workunit.client.1.smithi135.stdout:3/904: mkdir d4/d5/dc/d8b/d10f/d119 0 2024-09-10T09:36:40.620 INFO:tasks.workunit.client.1.smithi135.stdout:3/905: mkdir d4/d5/d76/d11a 0 2024-09-10T09:36:40.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/965: dwrite d2/d15/d4a/d36/d84/f124 [0,4194304] 0 2024-09-10T09:36:40.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/966: stat d2/d15/d39/d9f/db2/dcc/d49/d60/f67 0 2024-09-10T09:36:40.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/967: chown d2/d15/d39/ff3 1 1 2024-09-10T09:36:40.620 INFO:tasks.workunit.client.1.smithi135.stdout:7/968: read d2/d15/f1c [256722,50859] 0 2024-09-10T09:36:40.620 INFO:tasks.workunit.client.1.smithi135.stdout:3/906: getdents d4/d5/db/d36/d43/d87/dde/d5b 0 2024-09-10T09:36:40.646 INFO:tasks.workunit.client.1.smithi135.stdout:7/969: dwrite d2/d15/d39/d9f/db2/dcc/d49/d60/de4/fea [0,4194304] 0 2024-09-10T09:36:40.646 INFO:tasks.workunit.client.1.smithi135.stdout:3/907: dwrite d4/d5/dc/f19 [0,4194304] 0 2024-09-10T09:36:40.647 INFO:tasks.workunit.client.1.smithi135.stdout:3/908: link d4/f3b d4/d5/db/d36/d6a/f11b 0 2024-09-10T09:36:40.647 INFO:tasks.workunit.client.1.smithi135.stdout:3/909: chown d4/d5/dc/d8b/lba 121180 1 2024-09-10T09:36:40.662 INFO:tasks.workunit.client.1.smithi135.stdout:3/910: dread d4/d55/fe9 [0,4194304] 0 2024-09-10T09:36:40.673 INFO:tasks.workunit.client.1.smithi135.stdout:7/970: dwrite d2/d15/d5c/fc1 [0,4194304] 0 2024-09-10T09:36:40.673 INFO:tasks.workunit.client.1.smithi135.stdout:7/971: chown d2/d15/d39/d9f/db2/dcc/d49/d60/de4/lf7 16426055 1 2024-09-10T09:36:40.673 INFO:tasks.workunit.client.1.smithi135.stdout:7/972: write d2/d25/d9d/daf/fc0 [1354994,3391] 0 2024-09-10T09:36:40.674 INFO:tasks.workunit.client.1.smithi135.stdout:7/973: fsync d2/d25/d5d/f125 0 2024-09-10T09:36:40.674 INFO:tasks.workunit.client.1.smithi135.stdout:7/974: creat d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/f12e x:0 0 0 2024-09-10T09:36:40.677 INFO:tasks.workunit.client.1.smithi135.stdout:7/975: rename d2/d15/d39/d9f/db2/dcc/d49/d60/d30/l9e to d2/d15/d5c/d85/l12f 0 2024-09-10T09:36:40.679 INFO:tasks.workunit.client.1.smithi135.stdout:7/976: write d2/d15/d39/d9f/db2/dcc/d49/de8/fbb [365888,114085] 0 2024-09-10T09:36:40.680 INFO:tasks.workunit.client.1.smithi135.stdout:7/977: mknod d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b/c130 0 2024-09-10T09:36:40.680 INFO:tasks.workunit.client.1.smithi135.stdout:7/978: chown d2/d15/d5c/d62/cd5 157 1 2024-09-10T09:36:40.680 INFO:tasks.workunit.client.1.smithi135.stdout:7/979: dread - d2/d15/d39/d9f/db2/f128 zero size 2024-09-10T09:36:40.681 INFO:tasks.workunit.client.1.smithi135.stdout:7/980: rmdir d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/dbf/d105 39 2024-09-10T09:36:40.682 INFO:tasks.workunit.client.1.smithi135.stdout:7/981: write d2/d15/d39/d9f/db2/dcc/d49/de8/fda [531425,57009] 0 2024-09-10T09:36:40.682 INFO:tasks.workunit.client.1.smithi135.stdout:7/982: write d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/d8c/f97 [5151759,53837] 0 2024-09-10T09:36:40.683 INFO:tasks.workunit.client.1.smithi135.stdout:3/911: dwrite d4/d5/db/d44/da9/fc7 [0,4194304] 0 2024-09-10T09:36:40.683 INFO:tasks.workunit.client.1.smithi135.stdout:3/912: dread - d4/d5/d51/d112/f8a zero size 2024-09-10T09:36:40.684 INFO:tasks.workunit.client.1.smithi135.stdout:7/983: truncate d2/d15/d39/d9f/f10a 1129351 0 2024-09-10T09:36:40.686 INFO:tasks.workunit.client.1.smithi135.stdout:3/913: rename d4/f3b to d4/d5/db/d36/d6a/f11c 0 2024-09-10T09:36:40.686 INFO:tasks.workunit.client.1.smithi135.stdout:3/914: write d4/d5/d76/fc1 [1727203,100048] 0 2024-09-10T09:36:40.686 INFO:tasks.workunit.client.1.smithi135.stdout:3/915: chown d4/d5/db/df2 18 1 2024-09-10T09:36:40.688 INFO:tasks.workunit.client.1.smithi135.stdout:7/984: rename d2/d25/daa/cb7 to d2/d15/d39/d9f/db2/dcc/d49/de8/d5e/deb/c131 0 2024-09-10T09:36:40.688 INFO:tasks.workunit.client.1.smithi135.stdout:7/985: readlink d2/d15/d39/d9f/db2/dcc/d49/d60/d16/df8/l101 0 2024-09-10T09:36:40.689 INFO:tasks.workunit.client.1.smithi135.stdout:3/916: mknod d4/d5/db/df2/c11d 0 2024-09-10T09:36:40.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:40 smithi135 ceph-mon[33411]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:36:40.723 INFO:tasks.workunit.client.1.smithi135.stdout:3/917: dwrite d4/f25 [0,4194304] 0 2024-09-10T09:36:40.723 INFO:tasks.workunit.client.1.smithi135.stdout:7/986: dwrite d2/d25/d5d/f8d [0,4194304] 0 2024-09-10T09:36:40.725 INFO:tasks.workunit.client.1.smithi135.stdout:3/918: rename d4/d5/dc/d8b/lba to d4/d5/db/d36/d43/d87/dde/d5b/l11e 0 2024-09-10T09:36:40.725 INFO:tasks.workunit.client.1.smithi135.stdout:3/919: creat d4/d5/d51/dcf/f11f x:0 0 0 2024-09-10T09:36:40.725 INFO:tasks.workunit.client.1.smithi135.stdout:3/920: readlink d4/d5/db/d36/d43/d87/dde/d5b/l61 0 2024-09-10T09:36:40.725 INFO:tasks.workunit.client.1.smithi135.stdout:3/921: creat d4/d5/db/d44/da9/de0/f120 x:0 0 0 2024-09-10T09:36:40.725 INFO:tasks.workunit.client.1.smithi135.stdout:3/922: fsync d4/d5/d51/dcf/fea 0 2024-09-10T09:36:40.726 INFO:tasks.workunit.client.1.smithi135.stdout:3/923: chown d4/d5/dc/l8f 10 1 2024-09-10T09:36:40.729 INFO:tasks.workunit.client.1.smithi135.stdout:3/924: link d4/d5/db/d36/d43/d87/dde/d5b/c5e d4/d5/db/d44/c121 0 2024-09-10T09:36:40.729 INFO:tasks.workunit.client.1.smithi135.stdout:3/925: dread - d4/d5/db/d36/d6a/daf/de7/fec zero size 2024-09-10T09:36:40.730 INFO:tasks.workunit.client.1.smithi135.stdout:7/987: rmdir d2/d15/d4a/d36/d84 39 2024-09-10T09:36:40.731 INFO:tasks.workunit.client.1.smithi135.stdout:7/988: symlink d2/d15/d5c/l132 0 2024-09-10T09:36:40.733 INFO:tasks.workunit.client.1.smithi135.stdout:7/989: link d2/d15/d39/d9f/db2/dcc/d49/de8/f11d d2/d15/d39/d9f/f133 0 2024-09-10T09:36:40.734 INFO:tasks.workunit.client.1.smithi135.stdout:7/990: link d2/f1f d2/d25/d5d/d83/dcd/f134 0 2024-09-10T09:36:40.735 INFO:tasks.workunit.client.1.smithi135.stdout:7/991: fdatasync d2/f1f 0 2024-09-10T09:36:40.735 INFO:tasks.workunit.client.1.smithi135.stdout:7/992: chown d2/d15/d4a 518929 1 2024-09-10T09:36:40.736 INFO:tasks.workunit.client.1.smithi135.stdout:3/926: write d4/d5/dc/f95 [4105282,30971] 0 2024-09-10T09:36:40.737 INFO:tasks.workunit.client.1.smithi135.stdout:7/993: rename d2/d15/d4a/l32 to d2/d15/d5c/d62/l135 0 2024-09-10T09:36:40.739 INFO:tasks.workunit.client.1.smithi135.stdout:3/927: creat d4/f122 x:0 0 0 2024-09-10T09:36:40.741 INFO:tasks.workunit.client.1.smithi135.stdout:7/994: unlink d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d6b/c7c 0 2024-09-10T09:36:40.742 INFO:tasks.workunit.client.1.smithi135.stdout:3/928: unlink d4/d5/db/d36/d43/dbb/l91 0 2024-09-10T09:36:40.743 INFO:tasks.workunit.client.1.smithi135.stdout:7/995: link d2/d25/d5d/dbd/cb4 d2/d15/d39/d9f/db2/dcc/d49/d60/d30/c136 0 2024-09-10T09:36:40.745 INFO:tasks.workunit.client.1.smithi135.stdout:3/929: truncate d4/d5/db/d36/d6a/f11b 1322612 0 2024-09-10T09:36:40.746 INFO:tasks.workunit.client.1.smithi135.stdout:3/930: link d4/d5/d51/lc8 d4/d5/db/d44/l123 0 2024-09-10T09:36:40.751 INFO:tasks.workunit.client.1.smithi135.stdout:7/996: rmdir d2/d15/d39/d9f/db2/dcc/d49/d60/d30/d71 39 2024-09-10T09:36:40.759 INFO:tasks.workunit.client.1.smithi135.stdout:7/997: creat d2/d15/d39/d9f/db2/dcc/d49/f137 x:0 0 0 2024-09-10T09:36:40.759 INFO:tasks.workunit.client.1.smithi135.stdout:7/998: fsync d2/d15/d39/d9f/db2/dcc/f44 0 2024-09-10T09:36:40.759 INFO:tasks.workunit.client.1.smithi135.stdout:7/999: readlink d2/d25/daa/dfb/l10e 0 2024-09-10T09:36:41.063 INFO:tasks.workunit.client.1.smithi135.stdout:3/931: sync 2024-09-10T09:36:41.091 INFO:tasks.workunit.client.1.smithi135.stdout:3/932: dwrite d4/d5/db/d36/d6a/daf/ff9 [0,4194304] 0 2024-09-10T09:36:41.120 INFO:tasks.workunit.client.1.smithi135.stdout:3/933: dwrite d4/d5/d76/da0/feb [0,4194304] 0 2024-09-10T09:36:41.120 INFO:tasks.workunit.client.1.smithi135.stdout:3/934: creat d4/d5/db/d36/d6a/daf/f124 x:0 0 0 2024-09-10T09:36:41.129 INFO:tasks.workunit.client.1.smithi135.stdout:3/935: getdents d4/d5/db/df2 0 2024-09-10T09:36:41.131 INFO:tasks.workunit.client.1.smithi135.stdout:3/936: getdents d4/d5/dc/dce 0 2024-09-10T09:36:41.131 INFO:tasks.workunit.client.1.smithi135.stdout:3/937: dread - d4/d5/d51/d112/f8a zero size 2024-09-10T09:36:41.134 INFO:tasks.workunit.client.1.smithi135.stdout:3/938: dread d4/d5/dc/f50 [0,4194304] 0 2024-09-10T09:36:41.413 INFO:tasks.workunit.client.1.smithi135.stdout:3/939: sync 2024-09-10T09:36:41.419 INFO:tasks.workunit.client.1.smithi135.stdout:3/940: dread d4/d5/db/d36/d43/f46 [0,4194304] 0 2024-09-10T09:36:41.420 INFO:tasks.workunit.client.1.smithi135.stdout:3/941: creat d4/d5/db/d44/da9/de0/d104/f125 x:0 0 0 2024-09-10T09:36:41.420 INFO:tasks.workunit.client.1.smithi135.stdout:3/942: chown d4/d5/d51/d112/f8a 0 1 2024-09-10T09:36:41.420 INFO:tasks.workunit.client.1.smithi135.stdout:3/943: rmdir d4/d5/db/d36/d43/d87 39 2024-09-10T09:36:41.423 INFO:tasks.workunit.client.1.smithi135.stdout:3/944: unlink d4/d5/db/d36/d43/f46 0 2024-09-10T09:36:41.423 INFO:tasks.workunit.client.1.smithi135.stdout:3/945: fsync d4/f32 0 2024-09-10T09:36:41.438 INFO:tasks.workunit.client.1.smithi135.stdout:3/946: dwrite d4/d5/dc/d8b/f10a [0,4194304] 0 2024-09-10T09:36:41.440 INFO:tasks.workunit.client.1.smithi135.stdout:3/947: symlink d4/d5/l126 0 2024-09-10T09:36:41.440 INFO:tasks.workunit.client.1.smithi135.stdout:3/948: truncate d4/d5/d56/f7e 4408939 0 2024-09-10T09:36:41.442 INFO:tasks.workunit.client.1.smithi135.stdout:3/949: creat d4/d5/db/dd/f127 x:0 0 0 2024-09-10T09:36:41.444 INFO:tasks.workunit.client.1.smithi135.stdout:3/950: rmdir d4/d5/db/d44 39 2024-09-10T09:36:41.444 INFO:tasks.workunit.client.1.smithi135.stdout:3/951: write d4/d5/db/df2/f117 [776508,64247] 0 2024-09-10T09:36:41.444 INFO:tasks.workunit.client.1.smithi135.stdout:3/952: write d4/d5/dc/f50 [853015,118006] 0 2024-09-10T09:36:41.445 INFO:tasks.workunit.client.1.smithi135.stdout:3/953: readlink d4/d5/db/d36/d6a/lb8 0 2024-09-10T09:36:41.447 INFO:tasks.workunit.client.1.smithi135.stdout:3/954: creat d4/d5/db/d36/d43/d87/f128 x:0 0 0 2024-09-10T09:36:41.447 INFO:tasks.workunit.client.1.smithi135.stdout:3/955: write d4/ff4 [234051,21830] 0 2024-09-10T09:36:41.450 INFO:tasks.workunit.client.1.smithi135.stdout:3/956: dread d4/d5/d51/fd5 [0,4194304] 0 2024-09-10T09:36:41.450 INFO:tasks.workunit.client.1.smithi135.stdout:3/957: read d4/d5/db/d36/d43/d87/fd8 [355810,105827] 0 2024-09-10T09:36:41.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/958: rmdir d4/d5/db/d44/da9/de0/d104 39 2024-09-10T09:36:41.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/959: chown d4/d5/d51/d112/fcd 125489 1 2024-09-10T09:36:41.453 INFO:tasks.workunit.client.1.smithi135.stdout:3/960: chown d4/d5/dc/cf1 1612621848 1 2024-09-10T09:36:41.455 INFO:tasks.workunit.client.1.smithi135.stdout:3/961: rename d4/d5/dc/d8b/cfc to d4/d5/db/d36/d43/d87/c129 0 2024-09-10T09:36:41.458 INFO:tasks.workunit.client.1.smithi135.stdout:3/962: unlink d4/d5/db/dd/fbe 0 2024-09-10T09:36:41.461 INFO:tasks.workunit.client.1.smithi135.stdout:3/963: mkdir d4/d5/dc/d8b/d10f/d119/d12a 0 2024-09-10T09:36:41.461 INFO:tasks.workunit.client.1.smithi135.stdout:3/964: dread - d4/d5/db/d36/d6a/daf/fda zero size 2024-09-10T09:36:41.461 INFO:tasks.workunit.client.1.smithi135.stdout:3/965: chown d4/d5/db/df2/l111 3 1 2024-09-10T09:36:41.462 INFO:tasks.workunit.client.1.smithi135.stdout:3/966: write d4/f96 [1555191,78386] 0 2024-09-10T09:36:41.462 INFO:tasks.workunit.client.1.smithi135.stdout:3/967: chown d4/d5/db/d44/da9/de0/d104/f125 4116372 1 2024-09-10T09:36:41.462 INFO:tasks.workunit.client.1.smithi135.stdout:3/968: symlink d4/d5/db/d44/da9/de0/l12b 0 2024-09-10T09:36:41.469 INFO:tasks.workunit.client.1.smithi135.stdout:3/969: dread d4/d5/db/d44/da9/fc7 [0,4194304] 0 2024-09-10T09:36:41.469 INFO:tasks.workunit.client.1.smithi135.stdout:3/970: write d4/d5/db/d36/fed [782245,13604] 0 2024-09-10T09:36:41.471 INFO:tasks.workunit.client.1.smithi135.stdout:3/971: truncate d4/d5/db/d36/d6a/daf/ff9 982455 0 2024-09-10T09:36:41.471 INFO:tasks.workunit.client.1.smithi135.stdout:3/972: chown d4/f32 1849777906 1 2024-09-10T09:36:41.472 INFO:tasks.workunit.client.1.smithi135.stdout:3/973: creat d4/d5/dc/d8b/d10f/f12c x:0 0 0 2024-09-10T09:36:41.474 INFO:tasks.workunit.client.1.smithi135.stdout:3/974: truncate d4/d5/db/f2f 1479419 0 2024-09-10T09:36:41.479 INFO:tasks.workunit.client.1.smithi135.stdout:3/975: rename d4/c94 to d4/d5/db/d36/d6a/c12d 0 2024-09-10T09:36:41.481 INFO:tasks.workunit.client.1.smithi135.stdout:3/976: creat d4/d5/db/d36/d43/f12e x:0 0 0 2024-09-10T09:36:41.483 INFO:tasks.workunit.client.1.smithi135.stdout:3/977: creat d4/d5/dc/dce/f12f x:0 0 0 2024-09-10T09:36:41.484 INFO:tasks.workunit.client.1.smithi135.stdout:3/978: fsync d4/d5/d51/f7d 0 2024-09-10T09:36:41.486 INFO:tasks.workunit.client.1.smithi135.stdout:3/979: dread d4/d5/d51/d112/f41 [0,4194304] 0 2024-09-10T09:36:41.486 INFO:tasks.workunit.client.1.smithi135.stdout:3/980: fdatasync d4/d5/db/dd/f127 0 2024-09-10T09:36:41.489 INFO:tasks.workunit.client.1.smithi135.stdout:3/981: unlink d4/d5/lc3 0 2024-09-10T09:36:41.506 INFO:tasks.workunit.client.1.smithi135.stdout:3/982: dwrite d4/d5/dc/f95 [0,4194304] 0 2024-09-10T09:36:41.507 INFO:tasks.workunit.client.1.smithi135.stdout:3/983: fsync d4/d5/d51/fa1 0 2024-09-10T09:36:41.507 INFO:tasks.workunit.client.1.smithi135.stdout:3/984: truncate d4/d5/d51/d112/f8a 154612 0 2024-09-10T09:36:41.523 INFO:tasks.workunit.client.1.smithi135.stdout:3/985: dwrite d4/d5/d56/f7e [0,4194304] 0 2024-09-10T09:36:41.524 INFO:tasks.workunit.client.1.smithi135.stdout:3/986: read d4/d5/db/df2/f117 [642396,2827] 0 2024-09-10T09:36:41.524 INFO:tasks.workunit.client.1.smithi135.stdout:3/987: fdatasync d4/d5/d76/fb2 0 2024-09-10T09:36:41.525 INFO:tasks.workunit.client.1.smithi135.stdout:3/988: mkdir d4/d5/db/d36/d43/dbb/d130 0 2024-09-10T09:36:41.525 INFO:tasks.workunit.client.1.smithi135.stdout:3/989: write d4/f122 [772126,22760] 0 2024-09-10T09:36:41.529 INFO:tasks.workunit.client.1.smithi135.stdout:3/990: dread d4/d5/d76/fc1 [0,4194304] 0 2024-09-10T09:36:41.530 INFO:tasks.workunit.client.1.smithi135.stdout:3/991: creat d4/d5/d51/f131 x:0 0 0 2024-09-10T09:36:41.531 INFO:tasks.workunit.client.1.smithi135.stdout:3/992: mkdir d4/d5/d76/d11a/d132 0 2024-09-10T09:36:41.532 INFO:tasks.workunit.client.1.smithi135.stdout:3/993: dread - d4/d5/db/d44/da9/de0/f120 zero size 2024-09-10T09:36:41.533 INFO:tasks.workunit.client.1.smithi135.stdout:3/994: symlink d4/d55/l133 0 2024-09-10T09:36:41.535 INFO:tasks.workunit.client.1.smithi135.stdout:3/995: dread d4/f9 [4194304,4194304] 0 2024-09-10T09:36:41.536 INFO:tasks.workunit.client.1.smithi135.stdout:3/996: getdents d4/d5/db/d36/d6a 0 2024-09-10T09:36:41.537 INFO:tasks.workunit.client.1.smithi135.stdout:3/997: rmdir d4/d5/d51/dcf 39 2024-09-10T09:36:41.539 INFO:tasks.workunit.client.1.smithi135.stdout:3/998: link d4/d5/db/d44/c121 d4/d5/db/df2/c134 0 2024-09-10T09:36:41.553 INFO:tasks.workunit.client.1.smithi135.stdout:3/999: dwrite d4/d5/db/d36/f102 [0,4194304] 0 2024-09-10T09:36:41.557 INFO:tasks.workunit.client.1.smithi135.stderr:+ rm -rf -- ./tmp.YrXYl0gCxK 2024-09-10T09:36:41.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:41 smithi135 ceph-mon[33411]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 92 MiB/s rd, 110 MiB/s wr, 257 op/s 2024-09-10T09:36:41.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:41 smithi135 ceph-mon[33411]: Standby manager daemon smithi079.mhirny started 2024-09-10T09:36:41.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:41 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/crt"}]: dispatch 2024-09-10T09:36:41.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:41 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:36:41.662 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:41 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/key"}]: dispatch 2024-09-10T09:36:41.663 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:41 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:36:41.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:41 smithi079 ceph-mon[27592]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 92 MiB/s rd, 110 MiB/s wr, 257 op/s 2024-09-10T09:36:41.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:41 smithi079 ceph-mon[27592]: Standby manager daemon smithi079.mhirny started 2024-09-10T09:36:41.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:41 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/crt"}]: dispatch 2024-09-10T09:36:41.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:41 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:36:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:41 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/key"}]: dispatch 2024-09-10T09:36:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:41 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/2' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:36:42.564 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:42 smithi135 ceph-mon[33411]: mgrmap e25: smithi135.lbhjof(active, since 9s), standbys: smithi079.mhirny 2024-09-10T09:36:42.564 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:42 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:36:42.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:42 smithi079 ceph-mon[27592]: mgrmap e25: smithi135.lbhjof(active, since 9s), standbys: smithi079.mhirny 2024-09-10T09:36:42.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:42 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:36:43.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:43 smithi079 ceph-mon[27592]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 72 MiB/s rd, 85 MiB/s wr, 199 op/s 2024-09-10T09:36:43.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:43 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:43.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:43 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:43.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:43 smithi135 ceph-mon[33411]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 72 MiB/s rd, 85 MiB/s wr, 199 op/s 2024-09-10T09:36:43.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:43 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:43.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:43 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.623 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.623 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.623 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.623 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.623 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:44 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:44 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:45.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:45 smithi135 ceph-mon[33411]: Adjusting osd_memory_target on smithi079 to 1216M 2024-09-10T09:36:45.681 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:45 smithi135 ceph-mon[33411]: pgmap v9: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 87 MiB/s wr, 328 op/s 2024-09-10T09:36:45.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:45 smithi079 ceph-mon[27592]: Adjusting osd_memory_target on smithi079 to 1216M 2024-09-10T09:36:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:45 smithi079 ceph-mon[27592]: pgmap v9: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 87 MiB/s wr, 328 op/s 2024-09-10T09:36:47.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:47 smithi135 ceph-mon[33411]: pgmap v10: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 67 MiB/s rd, 80 MiB/s wr, 300 op/s 2024-09-10T09:36:47.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:47 smithi079 ceph-mon[27592]: pgmap v10: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 67 MiB/s rd, 80 MiB/s wr, 300 op/s 2024-09-10T09:36:48.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:48 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:48.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:48 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:36:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:49 smithi079 ceph-mon[27592]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 67 MiB/s rd, 80 MiB/s wr, 311 op/s 2024-09-10T09:36:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:49 smithi135 ceph-mon[33411]: pgmap v11: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 67 MiB/s rd, 80 MiB/s wr, 311 op/s 2024-09-10T09:36:51.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:51 smithi135 ceph-mon[33411]: pgmap v12: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 72 MiB/s wr, 415 op/s 2024-09-10T09:36:51.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:51 smithi079 ceph-mon[27592]: pgmap v12: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 62 MiB/s rd, 72 MiB/s wr, 415 op/s 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:36:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:36:53.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:36:53.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: pgmap v13: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 14 MiB/s rd, 16 MiB/s wr, 277 op/s 2024-09-10T09:36:53.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:36:53.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:36:53.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:36:53.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:52 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:53.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:53.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:53.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: pgmap v13: 65 pgs: 65 active+clean; 1.6 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 14 MiB/s rd, 16 MiB/s wr, 277 op/s 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:36:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:52 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.144 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:36:54.144 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.144 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:36:54.144 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.144 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: Reconfiguring prometheus.smithi079 (dependencies changed)... 2024-09-10T09:36:54.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:53 smithi079 ceph-mon[27592]: Reconfiguring daemon prometheus.smithi079 on smithi079 2024-09-10T09:36:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:36:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: Reconfiguring prometheus.smithi079 (dependencies changed)... 2024-09-10T09:36:54.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:53 smithi135 ceph-mon[33411]: Reconfiguring daemon prometheus.smithi079 on smithi079 2024-09-10T09:36:55.088 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:54 smithi079 ceph-mon[27592]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 14 MiB/s rd, 17 MiB/s wr, 400 op/s 2024-09-10T09:36:55.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:54 smithi135 ceph-mon[33411]: pgmap v14: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 14 MiB/s rd, 17 MiB/s wr, 400 op/s 2024-09-10T09:36:57.428 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:57 smithi079 ceph-mon[27592]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2024-09-10T09:36:57.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:57 smithi135 ceph-mon[33411]: pgmap v15: 65 pgs: 65 active+clean; 1.3 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2024-09-10T09:36:59.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:59 smithi079 ceph-mon[27592]: pgmap v16: 65 pgs: 65 active+clean; 1.2 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-09-10T09:36:59.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:59 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:59.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:59 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:59.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:59 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:36:59.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:36:59 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:36:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:59 smithi135 ceph-mon[33411]: pgmap v16: 65 pgs: 65 active+clean; 1.2 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2024-09-10T09:36:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:59 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:59 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:36:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:59 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:36:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:36:59 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:00.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:37:00.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: Upgrade: Need to upgrade myself (mgr.smithi135.lbhjof) 2024-09-10T09:37:00.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: Upgrade: Need to upgrade myself (mgr.smithi135.lbhjof) 2024-09-10T09:37:00.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:00.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:37:00.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:37:00.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:37:00.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:00 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:00.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:37:00.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: Upgrade: Need to upgrade myself (mgr.smithi135.lbhjof) 2024-09-10T09:37:00.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: Upgrade: Need to upgrade myself (mgr.smithi135.lbhjof) 2024-09-10T09:37:00.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:00.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:37:00.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:37:00.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:37:00.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:00 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:01.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:01 smithi079 ceph-mon[27592]: Upgrade: Updating mgr.smithi079.mhirny 2024-09-10T09:37:01.585 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:01 smithi079 ceph-mon[27592]: Deploying daemon mgr.smithi079.mhirny on smithi079 2024-09-10T09:37:01.585 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:01 smithi079 ceph-mon[27592]: pgmap v17: 65 pgs: 65 active+clean; 633 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 372 op/s 2024-09-10T09:37:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:01 smithi135 ceph-mon[33411]: Upgrade: Updating mgr.smithi079.mhirny 2024-09-10T09:37:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:01 smithi135 ceph-mon[33411]: Deploying daemon mgr.smithi079.mhirny on smithi079 2024-09-10T09:37:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:01 smithi135 ceph-mon[33411]: pgmap v17: 65 pgs: 65 active+clean; 633 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 372 op/s 2024-09-10T09:37:02.724 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T09:37:02.724 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-10T09:37:03.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:03 smithi079 ceph-mon[27592]: pgmap v18: 65 pgs: 65 active+clean; 633 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 257 op/s 2024-09-10T09:37:03.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:03 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:03 smithi135 ceph-mon[33411]: pgmap v18: 65 pgs: 65 active+clean; 633 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 257 op/s 2024-09-10T09:37:03.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:03 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:05.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:05 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:05.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:05 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:05.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:05 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:05.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:05 smithi079 ceph-mon[27592]: pgmap v19: 65 pgs: 65 active+clean; 460 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 360 op/s 2024-09-10T09:37:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:05 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:05 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:05 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:05 smithi135 ceph-mon[33411]: pgmap v19: 65 pgs: 65 active+clean; 460 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 360 op/s 2024-09-10T09:37:07.415 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:07 smithi079 ceph-mon[27592]: pgmap v20: 65 pgs: 65 active+clean; 460 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 237 op/s 2024-09-10T09:37:07.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:07 smithi135 ceph-mon[33411]: pgmap v20: 65 pgs: 65 active+clean; 460 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 237 op/s 2024-09-10T09:37:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.850+0000 7f393c245700 1 -- 172.21.15.79:0/1050523397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 msgr2=0x7f39340fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.851+0000 7f393c245700 1 --2- 172.21.15.79:0/1050523397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f39340fe320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3924009910 tx=0x7f3924009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:08.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.851+0000 7f393c245700 1 -- 172.21.15.79:0/1050523397 shutdown_connections 2024-09-10T09:37:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.851+0000 7f393c245700 1 --2- 172.21.15.79:0/1050523397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f39340fe320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.851+0000 7f393c245700 1 --2- 172.21.15.79:0/1050523397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39341018a0 0x7f3934101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.851+0000 7f393c245700 1 -- 172.21.15.79:0/1050523397 >> 172.21.15.79:0/1050523397 conn(0x7f39340f9f10 msgr2=0x7f39340fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.851+0000 7f393c245700 1 -- 172.21.15.79:0/1050523397 shutdown_connections 2024-09-10T09:37:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.851+0000 7f393c245700 1 -- 172.21.15.79:0/1050523397 wait complete. 2024-09-10T09:37:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f393c245700 1 Processor -- start 2024-09-10T09:37:08.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f393c245700 1 -- start start 2024-09-10T09:37:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f393c245700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39341018a0 0x7f3934197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f393c245700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f3934198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f393c245700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3934198850 con 0x7f39341021f0 2024-09-10T09:37:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f393c245700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393419d260 con 0x7f39341018a0 2024-09-10T09:37:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f39397e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f3934198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:08.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f3939fe1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39341018a0 0x7f3934197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f39397e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f3934198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38014/0 (socket says 172.21.15.79:38014) 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f3939fe1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39341018a0 0x7f3934197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:44344/0 (socket says 172.21.15.79:44344) 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f39397e0700 1 -- 172.21.15.79:0/2379412915 learned_addr learned my addr 172.21.15.79:0/2379412915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f39397e0700 1 -- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39341018a0 msgr2=0x7f3934197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f39397e0700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39341018a0 0x7f3934197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.852+0000 7f39397e0700 1 -- 172.21.15.79:0/2379412915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240095f0 con 0x7f39341021f0 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.853+0000 7f39397e0700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f3934198230 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f392400bda0 tx=0x7f392400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.853+0000 7f392affd700 1 -- 172.21.15.79:0/2379412915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f392401d070 con 0x7f39341021f0 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.853+0000 7f392affd700 1 -- 172.21.15.79:0/2379412915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f392400f460 con 0x7f39341021f0 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.853+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393419d400 con 0x7f39341021f0 2024-09-10T09:37:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.853+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393419d8c0 con 0x7f39341021f0 2024-09-10T09:37:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.853+0000 7f392affd700 1 -- 172.21.15.79:0/2379412915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3924021640 con 0x7f39341021f0 2024-09-10T09:37:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.854+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3934100550 con 0x7f39341021f0 2024-09-10T09:37:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.855+0000 7f392affd700 1 -- 172.21.15.79:0/2379412915 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f392402b440 con 0x7f39341021f0 2024-09-10T09:37:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.855+0000 7f392affd700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f392006d410 0x7f392006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.855+0000 7f392affd700 1 -- 172.21.15.79:0/2379412915 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f392408de50 con 0x7f39341021f0 2024-09-10T09:37:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.855+0000 7f3939fe1700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f392006d410 0x7f392006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:08.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.856+0000 7f3939fe1700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f392006d410 0x7f392006f8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f39341991d0 tx=0x7f393000b410 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:08.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:08.864+0000 7f392affd700 1 -- 172.21.15.79:0/2379412915 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3924057750 con 0x7f39341021f0 2024-09-10T09:37:09.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.102+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f393419df20 con 0x7f392006d410 2024-09-10T09:37:09.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.104+0000 7f392affd700 1 -- 172.21.15.79:0/2379412915 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f393419df20 con 0x7f392006d410 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f392006d410 msgr2=0x7f392006f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f392006d410 0x7f392006f8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f39341991d0 tx=0x7f393000b410 comp rx=0 tx=0).stop 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 msgr2=0x7f3934198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f3934198230 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f392400bda0 tx=0x7f392400bdd0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 shutdown_connections 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39341018a0 0x7f3934197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f392006d410 0x7f392006f8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 --2- 172.21.15.79:0/2379412915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39341021f0 0x7f3934198230 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 >> 172.21.15.79:0/2379412915 conn(0x7f39340f9f10 msgr2=0x7f39340fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:09.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 shutdown_connections 2024-09-10T09:37:09.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.106+0000 7f393c245700 1 -- 172.21.15.79:0/2379412915 wait complete. 2024-09-10T09:37:09.120 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:37:09.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.221+0000 7f597be46700 1 -- 172.21.15.79:0/3750440291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 msgr2=0x7f5974105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.221+0000 7f597be46700 1 --2- 172.21.15.79:0/3750440291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974105790 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5968009910 tx=0x7f5968009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:09.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.221+0000 7f597be46700 1 -- 172.21.15.79:0/3750440291 shutdown_connections 2024-09-10T09:37:09.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.221+0000 7f597be46700 1 --2- 172.21.15.79:0/3750440291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974105790 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.221+0000 7f597be46700 1 --2- 172.21.15.79:0/3750440291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5974069270 0x7f5974102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.221+0000 7f597be46700 1 -- 172.21.15.79:0/3750440291 >> 172.21.15.79:0/3750440291 conn(0x7f59740fa780 msgr2=0x7f59740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:09.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 -- 172.21.15.79:0/3750440291 shutdown_connections 2024-09-10T09:37:09.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 -- 172.21.15.79:0/3750440291 wait complete. 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 Processor -- start 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 -- start start 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5974196010 0x7f597419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974196510 con 0x7f5974103310 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f597be46700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974196680 con 0x7f5974196010 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.222+0000 7f5979be2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5979be2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974195ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38044/0 (socket says 172.21.15.79:38044) 2024-09-10T09:37:09.225 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5979be2700 1 -- 172.21.15.79:0/2828365484 learned_addr learned my addr 172.21.15.79:0/2828365484 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f59793e1700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5974196010 0x7f597419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5979be2700 1 -- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5974196010 msgr2=0x7f597419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5979be2700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5974196010 0x7f597419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5979be2700 1 -- 172.21.15.79:0/2828365484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680095f0 con 0x7f5974103310 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5979be2700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974195ad0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f596c00efc0 tx=0x7f596c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5972ffd700 1 -- 172.21.15.79:0/2828365484 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596c00c9f0 con 0x7f5974103310 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5972ffd700 1 -- 172.21.15.79:0/2828365484 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f596c00f040 con 0x7f5974103310 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597419b5c0 con 0x7f5974103310 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f5972ffd700 1 -- 172.21.15.79:0/2828365484 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596c014480 con 0x7f5974103310 2024-09-10T09:37:09.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.223+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597419bae0 con 0x7f5974103310 2024-09-10T09:37:09.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.224+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597418fbf0 con 0x7f5974103310 2024-09-10T09:37:09.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.225+0000 7f5972ffd700 1 -- 172.21.15.79:0/2828365484 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7f596c007500 con 0x7f5974103310 2024-09-10T09:37:09.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.226+0000 7f5972ffd700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f595c06d3c0 0x7f595c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:09.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.226+0000 7f5972ffd700 1 -- 172.21.15.79:0/2828365484 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f596c08cf60 con 0x7f5974103310 2024-09-10T09:37:09.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.226+0000 7f59793e1700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f595c06d3c0 0x7f595c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:09.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.226+0000 7f59793e1700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f595c06d3c0 0x7f595c06f870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5968009fd0 tx=0x7f5968005940 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:09.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.230+0000 7f5972ffd700 1 -- 172.21.15.79:0/2828365484 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f596c05a2d0 con 0x7f5974103310 2024-09-10T09:37:09.383 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:09 smithi079 ceph-mon[27592]: pgmap v21: 65 pgs: 65 active+clean; 445 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2024-09-10T09:37:09.511 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.510+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59740694e0 con 0x7f595c06d3c0 2024-09-10T09:37:09.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.512+0000 7f5972ffd700 1 -- 172.21.15.79:0/2828365484 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f59740694e0 con 0x7f595c06d3c0 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.514+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f595c06d3c0 msgr2=0x7f595c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.514+0000 7f597be46700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f595c06d3c0 0x7f595c06f870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5968009fd0 tx=0x7f5968005940 comp rx=0 tx=0).stop 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.514+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 msgr2=0x7f5974195ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.514+0000 7f597be46700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974195ad0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f596c00efc0 tx=0x7f596c00c3a0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.515+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 shutdown_connections 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.515+0000 7f597be46700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7f595c06d3c0 0x7f595c06f870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.515+0000 7f597be46700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5974103310 0x7f5974195ad0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.515+0000 7f597be46700 1 --2- 172.21.15.79:0/2828365484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5974196010 0x7f597419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.515+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 >> 172.21.15.79:0/2828365484 conn(0x7f59740fa780 msgr2=0x7f59740fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.515+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 shutdown_connections 2024-09-10T09:37:09.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.515+0000 7f597be46700 1 -- 172.21.15.79:0/2828365484 wait complete. 2024-09-10T09:37:09.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.623+0000 7fa3f598f700 1 -- 172.21.15.79:0/3855245193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 msgr2=0x7fa3f01007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.623+0000 7fa3f598f700 1 --2- 172.21.15.79:0/3855245193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f01007a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009910 tx=0x7fa3e4009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.623+0000 7fa3f598f700 1 -- 172.21.15.79:0/3855245193 shutdown_connections 2024-09-10T09:37:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.623+0000 7fa3f598f700 1 --2- 172.21.15.79:0/3855245193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f01007a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.623+0000 7fa3f598f700 1 --2- 172.21.15.79:0/3855245193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f00ff150 0x7fa3f00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.623+0000 7fa3f598f700 1 -- 172.21.15.79:0/3855245193 >> 172.21.15.79:0/3855245193 conn(0x7fa3f00fa700 msgr2=0x7fa3f00fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.624+0000 7fa3f598f700 1 -- 172.21.15.79:0/3855245193 shutdown_connections 2024-09-10T09:37:09.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.624+0000 7fa3f598f700 1 -- 172.21.15.79:0/3855245193 wait complete. 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.624+0000 7fa3f598f700 1 Processor -- start 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.624+0000 7fa3f598f700 1 -- start start 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3f598f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f00ff150 0x7fa3f0069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3f598f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3f598f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f019add0 con 0x7fa3f0100350 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3f598f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f019af10 con 0x7fa3f00ff150 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3ee7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3ee7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f019a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38076/0 (socket says 172.21.15.79:38076) 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3ee7fc700 1 -- 172.21.15.79:0/2379267805 learned_addr learned my addr 172.21.15.79:0/2379267805 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3eeffd700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f00ff150 0x7fa3f0069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:09.627 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3ee7fc700 1 -- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f00ff150 msgr2=0x7fa3f0069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3ee7fc700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f00ff150 0x7fa3f0069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3ee7fc700 1 -- 172.21.15.79:0/2379267805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40095f0 con 0x7fa3f0100350 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3ee7fc700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f019a800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4006010 tx=0x7fa3e400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.625+0000 7fa3f498d700 1 -- 172.21.15.79:0/2379267805 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e401d070 con 0x7fa3f0100350 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.626+0000 7fa3f498d700 1 -- 172.21.15.79:0/2379267805 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa3e400f460 con 0x7fa3f0100350 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.626+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f019b190 con 0x7fa3f0100350 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.626+0000 7fa3f498d700 1 -- 172.21.15.79:0/2379267805 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e4021640 con 0x7fa3f0100350 2024-09-10T09:37:09.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.626+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f019b680 con 0x7fa3f0100350 2024-09-10T09:37:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.627+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f0107ca0 con 0x7fa3f0100350 2024-09-10T09:37:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.627+0000 7fa3f498d700 1 -- 172.21.15.79:0/2379267805 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7fa3e400f5d0 con 0x7fa3f0100350 2024-09-10T09:37:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.628+0000 7fa3f498d700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fa3d806d3c0 0x7fa3d806f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.628+0000 7fa3f498d700 1 -- 172.21.15.79:0/2379267805 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa3e408dd10 con 0x7fa3f0100350 2024-09-10T09:37:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.628+0000 7fa3eeffd700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fa3d806d3c0 0x7fa3d806f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:09.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.628+0000 7fa3eeffd700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fa3d806d3c0 0x7fa3d806f870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa3f01001b0 tx=0x7fa3e0007400 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:09.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.633+0000 7fa3f498d700 1 -- 172.21.15.79:0/2379267805 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fa3e405b100 con 0x7fa3f0100350 2024-09-10T09:37:09.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:09 smithi135 ceph-mon[33411]: pgmap v21: 65 pgs: 65 active+clean; 445 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 270 op/s 2024-09-10T09:37:09.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.895+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3f0104ca0 con 0x7fa3d806d3c0 2024-09-10T09:37:09.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.904+0000 7fa3f498d700 1 -- 172.21.15.79:0/2379267805 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa3f0104ca0 con 0x7fa3d806d3c0 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (7m) 0s ago 9m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (9m) 0s ago 9m 7675k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (8m) 26s ago 8m 7604k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (9m) 0s ago 9m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (8m) 26s ago 8m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (7m) 0s ago 8m 85.5M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (3m) 0s ago 3m 13.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (3m) 0s ago 3m 147M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:37:09.906 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (3m) 26s ago 3m 226M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (3m) 26s ago 3m 17.2M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (6s) 0s ago 10m 68.6M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (73s) 26s ago 8m 480M - 19.1.1-305-g1cf819b7 41d671128357 7790a1959164 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (10m) 0s ago 10m 49.3M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (8m) 26s ago 8m 40.5M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (9m) 0s ago 9m 14.4M - 1.5.0 0da6a335fe13 2d43514669a8 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (8m) 26s ago 8m 15.3M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (7m) 0s ago 7m 208M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (6m) 0s ago 6m 216M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (6m) 0s ago 6m 177M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (5m) 26s ago 5m 273M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:37:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (5m) 26s ago 5m 222M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:37:09.908 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (5m) 26s ago 5m 263M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:37:09.908 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (11s) 0s ago 8m 46.4M - 2.43.0 a07b618ecd1d c0e6ac80a0b7 2024-09-10T09:37:09.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fa3d806d3c0 msgr2=0x7fa3d806f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fa3d806d3c0 0x7fa3d806f870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa3f01001b0 tx=0x7fa3e0007400 comp rx=0 tx=0).stop 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 msgr2=0x7fa3f019a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f019a800 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4006010 tx=0x7fa3e400bd70 comp rx=0 tx=0).stop 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 shutdown_connections 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3f00ff150 0x7fa3f0069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fa3d806d3c0 0x7fa3d806f870 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 --2- 172.21.15.79:0/2379267805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f0100350 0x7fa3f019a800 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 >> 172.21.15.79:0/2379267805 conn(0x7fa3f00fa700 msgr2=0x7fa3f0103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 shutdown_connections 2024-09-10T09:37:09.909 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:09.907+0000 7fa3f598f700 1 -- 172.21.15.79:0/2379267805 wait complete. 2024-09-10T09:37:10.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 -- 172.21.15.79:0/2069095646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5500ff150 msgr2=0x7fc5500ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2069095646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5500ff150 0x7fc5500ff560 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009910 tx=0x7fc54c009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:10.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 -- 172.21.15.79:0/2069095646 shutdown_connections 2024-09-10T09:37:10.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2069095646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5501003f0 0x7fc550100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2069095646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5500ff150 0x7fc5500ff560 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 -- 172.21.15.79:0/2069095646 >> 172.21.15.79:0/2069095646 conn(0x7fc5500fa7a0 msgr2=0x7fc5500fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 -- 172.21.15.79:0/2069095646 shutdown_connections 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 -- 172.21.15.79:0/2069095646 wait complete. 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 Processor -- start 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.019+0000 7fc5583e4700 1 -- start start 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5583e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5500ff150 0x7fc550195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5583e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5501003f0 0x7fc550196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5583e4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc550196970 con 0x7fc5501003f0 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5583e4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc550196ab0 con 0x7fc5500ff150 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc55597f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5501003f0 0x7fc550196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:10.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc55597f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5501003f0 0x7fc550196350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38090/0 (socket says 172.21.15.79:38090) 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc556180700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5500ff150 0x7fc550195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc55597f700 1 -- 172.21.15.79:0/2059293289 learned_addr learned my addr 172.21.15.79:0/2059293289 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc55597f700 1 -- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5500ff150 msgr2=0x7fc550195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc55597f700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5500ff150 0x7fc550195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc55597f700 1 -- 172.21.15.79:0/2059293289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c0095f0 con 0x7fc5501003f0 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc55597f700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5501003f0 0x7fc550196350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc54000e920 tx=0x7fc54000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc54000c9d0 con 0x7fc5501003f0 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc540010430 con 0x7fc5501003f0 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc550101670 con 0x7fc5501003f0 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc540018650 con 0x7fc5501003f0 2024-09-10T09:37:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.020+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc550101bc0 con 0x7fc5501003f0 2024-09-10T09:37:10.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.021+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc550068ab0 con 0x7fc5501003f0 2024-09-10T09:37:10.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.022+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 25) v1 ==== 91089+0+0 (secure 0 0 0) 0x7fc5400105a0 con 0x7fc5501003f0 2024-09-10T09:37:10.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.022+0000 7fc5477fe700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fc53c06d3c0 0x7fc53c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:10.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.022+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc540014070 con 0x7fc5501003f0 2024-09-10T09:37:10.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.023+0000 7fc556180700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fc53c06d3c0 0x7fc53c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:10.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.023+0000 7fc556180700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fc53c06d3c0 0x7fc53c06f870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009fd0 tx=0x7fc54c005940 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.027+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc5400539d0 con 0x7fc5501003f0 2024-09-10T09:37:10.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.289+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mgrmap(e 26) v1 ==== 92160+0+0 (secure 0 0 0) 0x7fc54008b460 con 0x7fc5501003f0 2024-09-10T09:37:10.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.378+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc550101de0 con 0x7fc5501003f0 2024-09-10T09:37:10.379 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.379+0000 7fc5477fe700 1 -- 172.21.15.79:0/2059293289 <== mon.0 v2:172.21.15.79:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fc5400633a0 con 0x7fc5501003f0 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:10.380 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:37:10.381 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:37:10.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:10.381 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:37:10.381 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-10T09:37:10.381 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:37:10.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:37:10.381 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:37:10.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fc53c06d3c0 msgr2=0x7fc53c06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fc53c06d3c0 0x7fc53c06f870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009fd0 tx=0x7fc54c005940 comp rx=0 tx=0).stop 2024-09-10T09:37:10.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5501003f0 msgr2=0x7fc550196350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5501003f0 0x7fc550196350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc54000e920 tx=0x7fc54000ec30 comp rx=0 tx=0).stop 2024-09-10T09:37:10.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 shutdown_connections 2024-09-10T09:37:10.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5500ff150 0x7fc550195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fc53c06d3c0 0x7fc53c06f870 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 --2- 172.21.15.79:0/2059293289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5501003f0 0x7fc550196350 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.381+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 >> 172.21.15.79:0/2059293289 conn(0x7fc5500fa7a0 msgr2=0x7fc550068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:10.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.382+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 shutdown_connections 2024-09-10T09:37:10.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.382+0000 7fc5583e4700 1 -- 172.21.15.79:0/2059293289 wait complete. 2024-09-10T09:37:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 -- 172.21.15.79:0/3427127116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 msgr2=0x7fe5080ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/3427127116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe5080ff540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009910 tx=0x7fe4f8009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 -- 172.21.15.79:0/3427127116 shutdown_connections 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/3427127116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081003d0 0x7fe508100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/3427127116 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe5080ff540 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 -- 172.21.15.79:0/3427127116 >> 172.21.15.79:0/3427127116 conn(0x7fe5080fa780 msgr2=0x7fe5080fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 -- 172.21.15.79:0/3427127116 shutdown_connections 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.495+0000 7fe50e3b0700 1 -- 172.21.15.79:0/3427127116 wait complete. 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe50e3b0700 1 Processor -- start 2024-09-10T09:37:10.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe50e3b0700 1 -- start start 2024-09-10T09:37:10.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe50e3b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe508103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe50e3b0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081003d0 0x7fe5081017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe50e3b0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508101cf0 con 0x7fe5080ff130 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe50e3b0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508101e30 con 0x7fe5081003d0 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe507fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe508103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe507fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe508103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38104/0 (socket says 172.21.15.79:38104) 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe507fff700 1 -- 172.21.15.79:0/1265977915 learned_addr learned my addr 172.21.15.79:0/1265977915 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.496+0000 7fe5077fe700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081003d0 0x7fe5081017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe507fff700 1 -- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081003d0 msgr2=0x7fe5081017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe507fff700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081003d0 0x7fe5081017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe507fff700 1 -- 172.21.15.79:0/1265977915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80095f0 con 0x7fe5080ff130 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe507fff700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe508103160 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000c00 tx=0x7fe4f800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:10.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe5057fa700 1 -- 172.21.15.79:0/1265977915 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f801d070 con 0x7fe5080ff130 2024-09-10T09:37:10.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe5057fa700 1 -- 172.21.15.79:0/1265977915 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe4f8005dc0 con 0x7fe5080ff130 2024-09-10T09:37:10.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5081020b0 con 0x7fe5080ff130 2024-09-10T09:37:10.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe5057fa700 1 -- 172.21.15.79:0/1265977915 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f80226a0 con 0x7fe5080ff130 2024-09-10T09:37:10.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.497+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5081025a0 con 0x7fe5080ff130 2024-09-10T09:37:10.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.498+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe508107c10 con 0x7fe5080ff130 2024-09-10T09:37:10.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.499+0000 7fe5057fa700 1 -- 172.21.15.79:0/1265977915 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 26) v1 ==== 92160+0+0 (secure 0 0 0) 0x7fe4f80038f0 con 0x7fe5080ff130 2024-09-10T09:37:10.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.499+0000 7fe5057fa700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fe4f406dfc0 0x7fe4f4070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:10.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.500+0000 7fe5057fa700 1 -- 172.21.15.79:0/1265977915 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe4f808f0c0 con 0x7fe5080ff130 2024-09-10T09:37:10.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.500+0000 7fe5077fe700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fe4f406dfc0 0x7fe4f4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:10.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.500+0000 7fe5077fe700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fe4f406dfc0 0x7fe4f4070470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009c60 tx=0x7fe4f0009260 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:10.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.504+0000 7fe5057fa700 1 -- 172.21.15.79:0/1265977915 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fe4f805c430 con 0x7fe5080ff130 2024-09-10T09:37:10.645 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:10.645 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: Standby manager daemon smithi079.mhirny restarted 2024-09-10T09:37:10.646 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: Standby manager daemon smithi079.mhirny started 2024-09-10T09:37:10.646 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/crt"}]: dispatch 2024-09-10T09:37:10.646 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:37:10.646 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/key"}]: dispatch 2024-09-10T09:37:10.646 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:37:10.646 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:10.646 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:10 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:10.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:10.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: Standby manager daemon smithi079.mhirny restarted 2024-09-10T09:37:10.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: Standby manager daemon smithi079.mhirny started 2024-09-10T09:37:10.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/crt"}]: dispatch 2024-09-10T09:37:10.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:37:10.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi079.mhirny/key"}]: dispatch 2024-09-10T09:37:10.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:37:10.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:10.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:10 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:10.746 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.745+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 --> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe508068c50 con 0x7fe4f406dfc0 2024-09-10T09:37:10.747 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.747+0000 7fe5057fa700 1 -- 172.21.15.79:0/1265977915 <== mgr.24357 v2:172.21.15.135:6828/2288780689 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fe508068c50 con 0x7fe4f406dfc0 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr" 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "2/2 daemons upgraded", 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:37:10.748 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fe4f406dfc0 msgr2=0x7fe4f4070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fe4f406dfc0 0x7fe4f4070470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009c60 tx=0x7fe4f0009260 comp rx=0 tx=0).stop 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 msgr2=0x7fe508103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe508103160 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000c00 tx=0x7fe4f800f690 comp rx=0 tx=0).stop 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 shutdown_connections 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:6828/2288780689,v1:172.21.15.135:6829/2288780689] conn(0x7fe4f406dfc0 0x7fe4f4070470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5080ff130 0x7fe508103160 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 --2- 172.21.15.79:0/1265977915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081003d0 0x7fe5081017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:10.750 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 >> 172.21.15.79:0/1265977915 conn(0x7fe5080fa780 msgr2=0x7fe508068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:10.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 shutdown_connections 2024-09-10T09:37:10.751 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:10.749+0000 7fe50e3b0700 1 -- 172.21.15.79:0/1265977915 wait complete. 2024-09-10T09:37:11.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:11 smithi079 ceph-mon[27592]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:11.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:11 smithi079 ceph-mon[27592]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:11.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:11 smithi079 ceph-mon[27592]: pgmap v22: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 377 op/s 2024-09-10T09:37:11.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:11 smithi079 ceph-mon[27592]: mgrmap e26: smithi135.lbhjof(active, since 38s), standbys: smithi079.mhirny 2024-09-10T09:37:11.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:11 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2059293289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:37:11.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:11 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:11.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:11 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:11 smithi135 ceph-mon[33411]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:11 smithi135 ceph-mon[33411]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:11 smithi135 ceph-mon[33411]: pgmap v22: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 377 op/s 2024-09-10T09:37:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:11 smithi135 ceph-mon[33411]: mgrmap e26: smithi135.lbhjof(active, since 38s), standbys: smithi079.mhirny 2024-09-10T09:37:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:11 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2059293289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:37:11.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:11 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:11.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:11 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:12.345 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:12 smithi079 ceph-mon[27592]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:12.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:12 smithi135 ceph-mon[33411]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:13.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:13 smithi079 ceph-mon[27592]: pgmap v23: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 258 op/s 2024-09-10T09:37:13.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:13 smithi135 ceph-mon[33411]: pgmap v23: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 258 op/s 2024-09-10T09:37:14.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:14 smithi079 ceph-mon[27592]: pgmap v24: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 312 op/s 2024-09-10T09:37:14.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:14 smithi135 ceph-mon[33411]: pgmap v24: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 312 op/s 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: pgmap v25: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 209 op/s 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr fail", "who": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:37:17.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr fail", "who": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: osdmap e49: 6 total, 6 up, 6 in 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd='[{"prefix": "mgr fail", "who": "smithi135.lbhjof"}]': finished 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: mgrmap e27: smithi079.mhirny(active, starting, since 0.00595004s) 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:37:17.436 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:37:17.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:37:17.447 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: pgmap v25: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 209 op/s 2024-09-10T09:37:17.447 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:17.447 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 172.21.15.135:0/1384421246' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr fail", "who": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "mgr fail", "who": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: osdmap e49: 6 total, 6 up, 6 in 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.24357 ' entity='mgr.smithi135.lbhjof' cmd='[{"prefix": "mgr fail", "who": "smithi135.lbhjof"}]': finished 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: mgrmap e27: smithi079.mhirny(active, starting, since 0.00595004s) 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:37:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:17.450 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:37:17.450 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:37:18.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:18 smithi135 ceph-mon[33411]: mgrmap e28: smithi079.mhirny(active, since 1.00948s) 2024-09-10T09:37:18.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:18 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:18.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:18 smithi135 ceph-mon[33411]: pgmap v3: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:37:18.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:18 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:19.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:18 smithi079 ceph-mon[27592]: mgrmap e28: smithi079.mhirny(active, since 1.00948s) 2024-09-10T09:37:19.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:18 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:19.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:18 smithi079 ceph-mon[27592]: pgmap v3: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:37:19.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:18 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:20.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:19 smithi079 ceph-mon[27592]: [10/Sep/2024:09:37:18] ENGINE Bus STARTING 2024-09-10T09:37:20.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:19 smithi079 ceph-mon[27592]: [10/Sep/2024:09:37:18] ENGINE Serving on http://172.21.15.79:8765 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:19 smithi079 ceph-mon[27592]: [10/Sep/2024:09:37:18] ENGINE Serving on https://172.21.15.79:7150 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:19 smithi079 ceph-mon[27592]: [10/Sep/2024:09:37:18] ENGINE Bus STARTED 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:19 smithi079 ceph-mon[27592]: [10/Sep/2024:09:37:18] ENGINE Error in HTTPServer.serve 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Traceback (most recent call last): 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._run(expiration_interval) 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:37:20.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: s = self.context.wrap_socket( 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: return self.sslsocket_class._create( 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self.do_handshake() 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._sslobj.do_handshake() 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:37:20.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:19 smithi079 ceph-mon[27592]: pgmap v4: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:37:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:19 smithi135 ceph-mon[33411]: [10/Sep/2024:09:37:18] ENGINE Bus STARTING 2024-09-10T09:37:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:19 smithi135 ceph-mon[33411]: [10/Sep/2024:09:37:18] ENGINE Serving on http://172.21.15.79:8765 2024-09-10T09:37:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:19 smithi135 ceph-mon[33411]: [10/Sep/2024:09:37:18] ENGINE Serving on https://172.21.15.79:7150 2024-09-10T09:37:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:19 smithi135 ceph-mon[33411]: [10/Sep/2024:09:37:18] ENGINE Bus STARTED 2024-09-10T09:37:20.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:19 smithi135 ceph-mon[33411]: [10/Sep/2024:09:37:18] ENGINE Error in HTTPServer.serve 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Traceback (most recent call last): 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._run(expiration_interval) 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: s = self.context.wrap_socket( 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:37:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: return self.sslsocket_class._create( 2024-09-10T09:37:20.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:37:20.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self.do_handshake() 2024-09-10T09:37:20.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:37:20.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._sslobj.do_handshake() 2024-09-10T09:37:20.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:37:20.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:19 smithi135 ceph-mon[33411]: pgmap v4: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:37:20.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:20 smithi079 ceph-mon[27592]: mgrmap e29: smithi079.mhirny(active, since 3s) 2024-09-10T09:37:21.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:20 smithi135 ceph-mon[33411]: mgrmap e29: smithi079.mhirny(active, since 3s) 2024-09-10T09:37:22.138 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:21 smithi079 ceph-mon[27592]: pgmap v5: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:37:22.199 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:21 smithi135 ceph-mon[33411]: pgmap v5: 65 pgs: 65 active+clean; 317 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:37:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:23 smithi079 ceph-mon[27592]: pgmap v6: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 413 KiB/s rd, 413 KiB/s wr, 290 op/s 2024-09-10T09:37:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:23 smithi135 ceph-mon[33411]: pgmap v6: 65 pgs: 65 active+clean; 318 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 413 KiB/s rd, 413 KiB/s wr, 290 op/s 2024-09-10T09:37:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: pgmap v7: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 1.19k op/s 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:25 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: pgmap v7: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 1.19k op/s 2024-09-10T09:37:25.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:37:25.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:37:25.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:37:25.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:37:25.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4022112902' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:37:25.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:25.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:25 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:26.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:26 smithi079 ceph-mon[27592]: mgrmap e30: smithi079.mhirny(active, since 8s), standbys: smithi135.lbhjof 2024-09-10T09:37:26.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:26 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:37:26.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:26 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:26.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:26 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:26.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:26 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:37:26.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:26 smithi135 ceph-mon[33411]: mgrmap e30: smithi079.mhirny(active, since 8s), standbys: smithi135.lbhjof 2024-09-10T09:37:26.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:26 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:37:26.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:26 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:26.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:26 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:26.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:26 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:37:27.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:27 smithi079 ceph-mon[27592]: pgmap v8: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 667 KiB/s rd, 872 KiB/s wr, 923 op/s 2024-09-10T09:37:27.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:27 smithi135 ceph-mon[33411]: pgmap v8: 65 pgs: 65 active+clean; 319 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 667 KiB/s rd, 872 KiB/s wr, 923 op/s 2024-09-10T09:37:28.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:28 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:28.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:28 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:28.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:28 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:28.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:28 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:37:28.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:28 smithi079 ceph-mon[27592]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:37:28.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:28 smithi079 ceph-mon[27592]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:37:28.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:28 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:28.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:28 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:28.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:28 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:28.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:28 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:37:28.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:28 smithi135 ceph-mon[33411]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:37:28.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:28 smithi135 ceph-mon[33411]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:37:29.843 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: pgmap v9: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 1.04k op/s 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.844 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.845 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:29 smithi079 ceph-mon[27592]: Reconfiguring prometheus.smithi079 (dependencies changed)... 2024-09-10T09:37:29.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: pgmap v9: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 1.04k op/s 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:29.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:29 smithi135 ceph-mon[33411]: Reconfiguring prometheus.smithi079 (dependencies changed)... 2024-09-10T09:37:31.063 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:30 smithi079 ceph-mon[27592]: Reconfiguring daemon prometheus.smithi079 on smithi079 2024-09-10T09:37:31.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:30 smithi135 ceph-mon[33411]: Reconfiguring daemon prometheus.smithi079 on smithi079 2024-09-10T09:37:32.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:31 smithi079 ceph-mon[27592]: pgmap v10: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 952 op/s 2024-09-10T09:37:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:31 smithi135 ceph-mon[33411]: pgmap v10: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 952 op/s 2024-09-10T09:37:33.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:32 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:33.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:32 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:33 smithi079 ceph-mon[27592]: pgmap v11: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 952 op/s 2024-09-10T09:37:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:33 smithi135 ceph-mon[33411]: pgmap v11: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 952 op/s 2024-09-10T09:37:35.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:35 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:35.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:35 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:35.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:35 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:37:35.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:35 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:37:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:35 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:35.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:35 smithi079 ceph-mon[27592]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-10T09:37:35.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:35 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:35.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:35 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:35.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:35 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:37:35.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:35 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:37:35.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:35 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:35.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:35 smithi135 ceph-mon[33411]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 1.10k op/s 2024-09-10T09:37:37.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:37 smithi135 ceph-mon[33411]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 525 op/s 2024-09-10T09:37:38.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:37 smithi079 ceph-mon[27592]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 525 op/s 2024-09-10T09:37:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:39 smithi135 ceph-mon[33411]: pgmap v14: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 672 op/s 2024-09-10T09:37:39.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:39 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:37:39.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:39 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:37:39.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:39 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:39 smithi079 ceph-mon[27592]: pgmap v14: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 672 op/s 2024-09-10T09:37:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:39 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:37:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:39 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:37:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:39 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:37:40.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:40 smithi135 ceph-mon[33411]: Upgrade: Updating mgr.smithi135.lbhjof 2024-09-10T09:37:40.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:40 smithi135 ceph-mon[33411]: Deploying daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:37:40.860 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:40 smithi079 ceph-mon[27592]: Upgrade: Updating mgr.smithi135.lbhjof 2024-09-10T09:37:40.860 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:40 smithi079 ceph-mon[27592]: Deploying daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 -- 172.21.15.79:0/4133566098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 msgr2=0x7ff8e40ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 --2- 172.21.15.79:0/4133566098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40ff540 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009910 tx=0x7ff8d8009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 -- 172.21.15.79:0/4133566098 shutdown_connections 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 --2- 172.21.15.79:0/4133566098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8e41003d0 0x7ff8e4100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 --2- 172.21.15.79:0/4133566098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40ff540 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 -- 172.21.15.79:0/4133566098 >> 172.21.15.79:0/4133566098 conn(0x7ff8e40fa780 msgr2=0x7ff8e40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 -- 172.21.15.79:0/4133566098 shutdown_connections 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.858+0000 7ff8eb434700 1 -- 172.21.15.79:0/4133566098 wait complete. 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8eb434700 1 Processor -- start 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8eb434700 1 -- start start 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8eb434700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8eb434700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8e41003d0 0x7ff8e419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:40.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8eb434700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e419ade0 con 0x7ff8e40ff130 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8eb434700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e419af20 con 0x7ff8e41003d0 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8e91d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8e91d0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51402/0 (socket says 172.21.15.79:51402) 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.859+0000 7ff8e91d0700 1 -- 172.21.15.79:0/2060889516 learned_addr learned my addr 172.21.15.79:0/2060889516 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8e89cf700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8e41003d0 0x7ff8e419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8e91d0700 1 -- 172.21.15.79:0/2060889516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8e41003d0 msgr2=0x7ff8e419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8e91d0700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8e41003d0 0x7ff8e419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8e91d0700 1 -- 172.21.15.79:0/2060889516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80095f0 con 0x7ff8e40ff130 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8e91d0700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40690a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8000c00 tx=0x7ff8d800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8d67fc700 1 -- 172.21.15.79:0/2060889516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d801d070 con 0x7ff8e40ff130 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8d67fc700 1 -- 172.21.15.79:0/2060889516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff8d8005dc0 con 0x7ff8e40ff130 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e419b1a0 con 0x7ff8e40ff130 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8d67fc700 1 -- 172.21.15.79:0/2060889516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8d80226a0 con 0x7ff8e40ff130 2024-09-10T09:37:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.860+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e419b690 con 0x7ff8e40ff130 2024-09-10T09:37:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.861+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e4107c10 con 0x7ff8e40ff130 2024-09-10T09:37:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.862+0000 7ff8d67fc700 1 -- 172.21.15.79:0/2060889516 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 30) v1 ==== 92158+0+0 (secure 0 0 0) 0x7ff8d800faf0 con 0x7ff8e40ff130 2024-09-10T09:37:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.862+0000 7ff8d67fc700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff8d006dfc0 0x7ff8d0070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:40.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.862+0000 7ff8d67fc700 1 -- 172.21.15.79:0/2060889516 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff8d808f200 con 0x7ff8e40ff130 2024-09-10T09:37:40.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.862+0000 7ff8e89cf700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff8d006dfc0 0x7ff8d0070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:40.865 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.863+0000 7ff8e89cf700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff8d006dfc0 0x7ff8d0070470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4069620 tx=0x7ff8e0009260 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:40.868 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:40.867+0000 7ff8d67fc700 1 -- 172.21.15.79:0/2060889516 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff8d805c420 con 0x7ff8e40ff130 2024-09-10T09:37:41.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.103+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8e4104d20 con 0x7ff8d006dfc0 2024-09-10T09:37:41.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.105+0000 7ff8d67fc700 1 -- 172.21.15.79:0/2060889516 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7ff8e4104d20 con 0x7ff8d006dfc0 2024-09-10T09:37:41.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff8d006dfc0 msgr2=0x7ff8d0070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff8d006dfc0 0x7ff8d0070470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4069620 tx=0x7ff8e0009260 comp rx=0 tx=0).stop 2024-09-10T09:37:41.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 msgr2=0x7ff8e40690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40690a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8000c00 tx=0x7ff8d800f690 comp rx=0 tx=0).stop 2024-09-10T09:37:41.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 shutdown_connections 2024-09-10T09:37:41.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8e40ff130 0x7ff8e40690a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff8d006dfc0 0x7ff8d0070470 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 --2- 172.21.15.79:0/2060889516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8e41003d0 0x7ff8e419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 >> 172.21.15.79:0/2060889516 conn(0x7ff8e40fa780 msgr2=0x7ff8e4103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:41.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 shutdown_connections 2024-09-10T09:37:41.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.107+0000 7ff8eb434700 1 -- 172.21.15.79:0/2060889516 wait complete. 2024-09-10T09:37:41.118 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:37:41.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.213+0000 7f0d63d3f700 1 -- 172.21.15.79:0/2017684810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 msgr2=0x7f0d5c100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.213+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/2017684810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c100860 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009910 tx=0x7f0d4c009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:41.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.213+0000 7f0d63d3f700 1 -- 172.21.15.79:0/2017684810 shutdown_connections 2024-09-10T09:37:41.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.213+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/2017684810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c100860 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.213+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/2017684810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d5c0ff150 0x7f0d5c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.213+0000 7f0d63d3f700 1 -- 172.21.15.79:0/2017684810 >> 172.21.15.79:0/2017684810 conn(0x7f0d5c0fa7a0 msgr2=0x7f0d5c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 -- 172.21.15.79:0/2017684810 shutdown_connections 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 -- 172.21.15.79:0/2017684810 wait complete. 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 Processor -- start 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 -- start start 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d5c0ff150 0x7f0d5c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19b050 con 0x7f0d5c1003f0 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d63d3f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c19b190 con 0x7f0d5c0ff150 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d612da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d612da700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51408/0 (socket says 172.21.15.79:51408) 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.214+0000 7f0d612da700 1 -- 172.21.15.79:0/1462991358 learned_addr learned my addr 172.21.15.79:0/1462991358 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:41.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d61adb700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d5c0ff150 0x7f0d5c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d612da700 1 -- 172.21.15.79:0/1462991358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d5c0ff150 msgr2=0x7f0d5c069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d612da700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d5c0ff150 0x7f0d5c069930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d612da700 1 -- 172.21.15.79:0/1462991358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0095f0 con 0x7f0d5c1003f0 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d61adb700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d5c0ff150 0x7f0d5c069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d612da700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c19ab10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005b40 tx=0x7f0d4c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d52ffd700 1 -- 172.21.15.79:0/1462991358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c01d070 con 0x7f0d5c1003f0 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d52ffd700 1 -- 172.21.15.79:0/1462991358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0d4c022470 con 0x7f0d5c1003f0 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c19b410 con 0x7f0d5c1003f0 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d52ffd700 1 -- 172.21.15.79:0/1462991358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4c00f670 con 0x7f0d5c1003f0 2024-09-10T09:37:41.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.215+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c19b900 con 0x7f0d5c1003f0 2024-09-10T09:37:41.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.216+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c068ab0 con 0x7f0d5c1003f0 2024-09-10T09:37:41.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.217+0000 7f0d52ffd700 1 -- 172.21.15.79:0/1462991358 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 30) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f0d4c0225e0 con 0x7f0d5c1003f0 2024-09-10T09:37:41.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.217+0000 7f0d52ffd700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0d4806dfb0 0x7f0d48070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.217+0000 7f0d52ffd700 1 -- 172.21.15.79:0/1462991358 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f0d4c08f340 con 0x7f0d5c1003f0 2024-09-10T09:37:41.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.217+0000 7f0d61adb700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0d4806dfb0 0x7f0d48070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.218+0000 7f0d61adb700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0d4806dfb0 0x7f0d48070460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d58005fd0 tx=0x7f0d58005e30 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:41.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.222+0000 7f0d52ffd700 1 -- 172.21.15.79:0/1462991358 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f0d4c05c7b0 con 0x7f0d5c1003f0 2024-09-10T09:37:41.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.453+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d5c104e40 con 0x7f0d4806dfb0 2024-09-10T09:37:41.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.455+0000 7f0d52ffd700 1 -- 172.21.15.79:0/1462991358 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f0d5c104e40 con 0x7f0d4806dfb0 2024-09-10T09:37:41.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0d4806dfb0 msgr2=0x7f0d48070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0d4806dfb0 0x7f0d48070460 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d58005fd0 tx=0x7f0d58005e30 comp rx=0 tx=0).stop 2024-09-10T09:37:41.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 msgr2=0x7f0d5c19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c19ab10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005b40 tx=0x7f0d4c00be20 comp rx=0 tx=0).stop 2024-09-10T09:37:41.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 shutdown_connections 2024-09-10T09:37:41.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0d4806dfb0 0x7f0d48070460 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d5c0ff150 0x7f0d5c069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 --2- 172.21.15.79:0/1462991358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d5c1003f0 0x7f0d5c19ab10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 >> 172.21.15.79:0/1462991358 conn(0x7f0d5c0fa7a0 msgr2=0x7f0d5c103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:41.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 shutdown_connections 2024-09-10T09:37:41.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.457+0000 7f0d63d3f700 1 -- 172.21.15.79:0/1462991358 wait complete. 2024-09-10T09:37:41.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.565+0000 7f0bc1af1700 1 -- 172.21.15.79:0/2149430785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fe500 msgr2=0x7f0bbc0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.565+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/2149430785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fe500 0x7f0bbc0fe910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009910 tx=0x7f0bac009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.565+0000 7f0bc1af1700 1 -- 172.21.15.79:0/2149430785 shutdown_connections 2024-09-10T09:37:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.565+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/2149430785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bbc0fee50 0x7f0bbc101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.565+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/2149430785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fe500 0x7f0bbc0fe910 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.565+0000 7f0bc1af1700 1 -- 172.21.15.79:0/2149430785 >> 172.21.15.79:0/2149430785 conn(0x7f0bbc0f9f10 msgr2=0x7f0bbc0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.566+0000 7f0bc1af1700 1 -- 172.21.15.79:0/2149430785 shutdown_connections 2024-09-10T09:37:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.566+0000 7f0bc1af1700 1 -- 172.21.15.79:0/2149430785 wait complete. 2024-09-10T09:37:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.566+0000 7f0bc1af1700 1 Processor -- start 2024-09-10T09:37:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.566+0000 7f0bc1af1700 1 -- start start 2024-09-10T09:37:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bc1af1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bbc0fe500 0x7f0bbc195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bc1af1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fee50 0x7f0bbc196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bc1af1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc196690 con 0x7f0bbc0fee50 2024-09-10T09:37:41.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bc1af1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1967d0 con 0x7f0bbc0fe500 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbaffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fee50 0x7f0bbc196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbaffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fee50 0x7f0bbc196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51426/0 (socket says 172.21.15.79:51426) 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbaffd700 1 -- 172.21.15.79:0/733605538 learned_addr learned my addr 172.21.15.79:0/733605538 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbb7fe700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bbc0fe500 0x7f0bbc195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbaffd700 1 -- 172.21.15.79:0/733605538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bbc0fe500 msgr2=0x7f0bbc195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbaffd700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bbc0fe500 0x7f0bbc195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbaffd700 1 -- 172.21.15.79:0/733605538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0095f0 con 0x7f0bbc0fee50 2024-09-10T09:37:41.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.567+0000 7f0bbaffd700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fee50 0x7f0bbc196070 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000d8d0 tx=0x7f0bb000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.568+0000 7f0bb8ff9700 1 -- 172.21.15.79:0/733605538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb000f860 con 0x7f0bbc0fee50 2024-09-10T09:37:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.568+0000 7f0bb8ff9700 1 -- 172.21.15.79:0/733605538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0bb000fe70 con 0x7f0bbc0fee50 2024-09-10T09:37:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.568+0000 7f0bb8ff9700 1 -- 172.21.15.79:0/733605538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bb000e5e0 con 0x7f0bbc0fee50 2024-09-10T09:37:41.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.568+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc19b280 con 0x7f0bbc0fee50 2024-09-10T09:37:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.568+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc19b780 con 0x7f0bbc0fee50 2024-09-10T09:37:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.569+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc108d50 con 0x7f0bbc0fee50 2024-09-10T09:37:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.569+0000 7f0bb8ff9700 1 -- 172.21.15.79:0/733605538 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 30) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f0bb0010460 con 0x7f0bbc0fee50 2024-09-10T09:37:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.570+0000 7f0bb8ff9700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0ba406dfc0 0x7f0ba4070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.570+0000 7f0bb8ff9700 1 -- 172.21.15.79:0/733605538 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f0bb008d930 con 0x7f0bbc0fee50 2024-09-10T09:37:41.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.570+0000 7f0bbb7fe700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0ba406dfc0 0x7f0ba4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.570+0000 7f0bbb7fe700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0ba406dfc0 0x7f0ba4070470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bac006010 tx=0x7f0bac00b540 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:41.575 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.575+0000 7f0bb8ff9700 1 -- 172.21.15.79:0/733605538 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f0bb005ab50 con 0x7f0bbc0fee50 2024-09-10T09:37:41.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:41 smithi079 ceph-mon[27592]: pgmap v15: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 411 op/s 2024-09-10T09:37:41.792 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.791+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bbc105ed0 con 0x7f0ba406dfc0 2024-09-10T09:37:41.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.800+0000 7f0bb8ff9700 1 -- 172.21.15.79:0/733605538 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0bbc105ed0 con 0x7f0ba406dfc0 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (8m) 18s ago 9m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (9m) 18s ago 9m 7696k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (8m) 16s ago 8m 7662k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (9m) 18s ago 9m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (8m) 16s ago 8m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (8m) 18s ago 9m 85.5M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (4m) 18s ago 4m 13.8M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (4m) 18s ago 4m 150M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (4m) 16s ago 4m 219M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (4m) 16s ago 4m 17.7M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:37:41.802 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (38s) 18s ago 11m 475M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (105s) 16s ago 8m 54.6M - 19.1.1-305-g1cf819b7 41d671128357 7790a1959164 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (11m) 18s ago 11m 51.8M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (8m) 16s ago 8m 43.1M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (9m) 18s ago 9m 14.3M - 1.5.0 0da6a335fe13 2d43514669a8 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (8m) 16s ago 8m 14.8M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (7m) 18s ago 7m 214M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (7m) 18s ago 7m 219M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (6m) 18s ago 6m 182M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (6m) 16s ago 6m 241M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (6m) 16s ago 6m 214M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (5m) 16s ago 5m 214M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:37:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 starting - - - - 2024-09-10T09:37:41.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0ba406dfc0 msgr2=0x7f0ba4070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0ba406dfc0 0x7f0ba4070470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bac006010 tx=0x7f0bac00b540 comp rx=0 tx=0).stop 2024-09-10T09:37:41.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fee50 msgr2=0x7f0bbc196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fee50 0x7f0bbc196070 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000d8d0 tx=0x7f0bb000dbe0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 shutdown_connections 2024-09-10T09:37:41.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0ba406dfc0 0x7f0ba4070470 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bbc0fe500 0x7f0bbc195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 --2- 172.21.15.79:0/733605538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bbc0fee50 0x7f0bbc196070 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 >> 172.21.15.79:0/733605538 conn(0x7f0bbc0f9f10 msgr2=0x7f0bbc1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:41.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 shutdown_connections 2024-09-10T09:37:41.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.803+0000 7f0bc1af1700 1 -- 172.21.15.79:0/733605538 wait complete. 2024-09-10T09:37:41.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 -- 172.21.15.79:0/2187548517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1390101440 msgr2=0x7f1390101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 --2- 172.21.15.79:0/2187548517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1390101440 0x7f1390101890 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f138c009910 tx=0x7f138c009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:41.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 -- 172.21.15.79:0/2187548517 shutdown_connections 2024-09-10T09:37:41.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 --2- 172.21.15.79:0/2187548517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1390101440 0x7f1390101890 secure :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f138c009910 tx=0x7f138c009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:41.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 --2- 172.21.15.79:0/2187548517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390100240 0x7f1390100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 -- 172.21.15.79:0/2187548517 >> 172.21.15.79:0/2187548517 conn(0x7f13900fb7f0 msgr2=0x7f13900fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:41.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 -- 172.21.15.79:0/2187548517 shutdown_connections 2024-09-10T09:37:41.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.941+0000 7f1397080700 1 -- 172.21.15.79:0/2187548517 wait complete. 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.942+0000 7f1397080700 1 Processor -- start 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.942+0000 7f1397080700 1 -- start start 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1397080700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390100240 0x7f139019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1397080700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139019c990 0x7f13901a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1397080700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139019ce90 con 0x7f139019c990 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1397080700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139019d000 con 0x7f1390100240 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1394e1c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390100240 0x7f139019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1394e1c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390100240 0x7f139019c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:53476/0 (socket says 172.21.15.79:53476) 2024-09-10T09:37:41.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1394e1c700 1 -- 172.21.15.79:0/1955443361 learned_addr learned my addr 172.21.15.79:0/1955443361 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:41.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.943+0000 7f1387fff700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139019c990 0x7f13901a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.944+0000 7f1387fff700 1 -- 172.21.15.79:0/1955443361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390100240 msgr2=0x7f139019c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:41.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.944+0000 7f1387fff700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390100240 0x7f139019c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:41.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.944+0000 7f1387fff700 1 -- 172.21.15.79:0/1955443361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0095f0 con 0x7f139019c990 2024-09-10T09:37:41.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.944+0000 7f1387fff700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139019c990 0x7f13901a1a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f138c008000 tx=0x7f138c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:41.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.945+0000 7f1385ffb700 1 -- 172.21.15.79:0/1955443361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138c003a60 con 0x7f139019c990 2024-09-10T09:37:41.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.945+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13901a1f40 con 0x7f139019c990 2024-09-10T09:37:41.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.945+0000 7f1385ffb700 1 -- 172.21.15.79:0/1955443361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f138c003bc0 con 0x7f139019c990 2024-09-10T09:37:41.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.945+0000 7f1385ffb700 1 -- 172.21.15.79:0/1955443361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138c018670 con 0x7f139019c990 2024-09-10T09:37:41.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.945+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13901a2460 con 0x7f139019c990 2024-09-10T09:37:41.947 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.946+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1390106c60 con 0x7f139019c990 2024-09-10T09:37:41.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.948+0000 7f1385ffb700 1 -- 172.21.15.79:0/1955443361 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 30) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f138c012450 con 0x7f139019c990 2024-09-10T09:37:41.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.948+0000 7f1385ffb700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f137806e110 0x7f13780705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:41.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.949+0000 7f1385ffb700 1 -- 172.21.15.79:0/1955443361 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f138c08fef0 con 0x7f139019c990 2024-09-10T09:37:41.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.949+0000 7f1394e1c700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f137806e110 0x7f13780705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:41.950 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.950+0000 7f1394e1c700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f137806e110 0x7f13780705c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1380009aa0 tx=0x7f1380009240 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:41.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:41.957+0000 7f1385ffb700 1 -- 172.21.15.79:0/1955443361 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f138c05d280 con 0x7f139019c990 2024-09-10T09:37:41.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:41 smithi135 ceph-mon[33411]: pgmap v15: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 411 op/s 2024-09-10T09:37:42.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.285+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1390106e20 con 0x7f139019c990 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.286+0000 7f1385ffb700 1 -- 172.21.15.79:0/1955443361 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f138c003d30 con 0x7f139019c990 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:42.287 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:37:42.288 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:37:42.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f137806e110 msgr2=0x7f13780705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:42.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f137806e110 0x7f13780705c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1380009aa0 tx=0x7f1380009240 comp rx=0 tx=0).stop 2024-09-10T09:37:42.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139019c990 msgr2=0x7f13901a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:42.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139019c990 0x7f13901a1a00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f138c008000 tx=0x7f138c00bd70 comp rx=0 tx=0).stop 2024-09-10T09:37:42.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 shutdown_connections 2024-09-10T09:37:42.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f137806e110 0x7f13780705c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1390100240 0x7f139019c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 --2- 172.21.15.79:0/1955443361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f139019c990 0x7f13901a1a00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 >> 172.21.15.79:0/1955443361 conn(0x7f13900fb7f0 msgr2=0x7f1390104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 shutdown_connections 2024-09-10T09:37:42.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.288+0000 7f1397080700 1 -- 172.21.15.79:0/1955443361 wait complete. 2024-09-10T09:37:42.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 -- 172.21.15.79:0/2734367944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 msgr2=0x7fbb38100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:42.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/2734367944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38100650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009910 tx=0x7fbb28009c20 comp rx=0 tx=0).stop 2024-09-10T09:37:42.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 -- 172.21.15.79:0/2734367944 shutdown_connections 2024-09-10T09:37:42.395 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/2734367944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb38101440 0x7fbb38101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/2734367944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38100650 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 -- 172.21.15.79:0/2734367944 >> 172.21.15.79:0/2734367944 conn(0x7fbb380fb7f0 msgr2=0x7fbb380fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:42.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 -- 172.21.15.79:0/2734367944 shutdown_connections 2024-09-10T09:37:42.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.394+0000 7fbb3ff68700 1 -- 172.21.15.79:0/2734367944 wait complete. 2024-09-10T09:37:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3ff68700 1 Processor -- start 2024-09-10T09:37:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3ff68700 1 -- start start 2024-09-10T09:37:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3ff68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3ff68700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb38101440 0x7fbb38073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:42.397 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3ff68700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38073680 con 0x7fbb38100240 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3ff68700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380737c0 con 0x7fbb38101440 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3dd04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3dd04700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60028/0 (socket says 172.21.15.79:60028) 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3dd04700 1 -- 172.21.15.79:0/4277380998 learned_addr learned my addr 172.21.15.79:0/4277380998 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.395+0000 7fbb3d503700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb38101440 0x7fbb38073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb3dd04700 1 -- 172.21.15.79:0/4277380998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb38101440 msgr2=0x7fbb38073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb3dd04700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb38101440 0x7fbb38073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb3dd04700 1 -- 172.21.15.79:0/4277380998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280095f0 con 0x7fbb38100240 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb3dd04700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38074af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800bda0 tx=0x7fbb2800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb2effd700 1 -- 172.21.15.79:0/4277380998 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb2801d070 con 0x7fbb38100240 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb2effd700 1 -- 172.21.15.79:0/4277380998 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbb2800f460 con 0x7fbb38100240 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb2effd700 1 -- 172.21.15.79:0/4277380998 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb28021620 con 0x7fbb38100240 2024-09-10T09:37:42.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb38073a40 con 0x7fbb38100240 2024-09-10T09:37:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.396+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb38073f30 con 0x7fbb38100240 2024-09-10T09:37:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.397+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb38108d90 con 0x7fbb38100240 2024-09-10T09:37:42.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.397+0000 7fbb2effd700 1 -- 172.21.15.79:0/4277380998 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 30) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fbb2800f5d0 con 0x7fbb38100240 2024-09-10T09:37:42.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.398+0000 7fbb2effd700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbb2406dfc0 0x7fbb24070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:37:42.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.398+0000 7fbb2effd700 1 -- 172.21.15.79:0/4277380998 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fbb2808eef0 con 0x7fbb38100240 2024-09-10T09:37:42.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.398+0000 7fbb3d503700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbb2406dfc0 0x7fbb24070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:37:42.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.398+0000 7fbb3d503700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbb2406dfc0 0x7fbb24070470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005950 tx=0x7fbb3400b410 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:37:42.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.402+0000 7fbb2effd700 1 -- 172.21.15.79:0/4277380998 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fbb2805c190 con 0x7fbb38100240 2024-09-10T09:37:42.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.633+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb38105d90 con 0x7fbb2406dfc0 2024-09-10T09:37:42.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.634+0000 7fbb2effd700 1 -- 172.21.15.79:0/4277380998 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fbb38105d90 con 0x7fbb2406dfc0 2024-09-10T09:37:42.636 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:37:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:37:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:37:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:37:42.636 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:37:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr" 2024-09-10T09:37:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:37:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "2/2 daemons upgraded", 2024-09-10T09:37:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading mgr daemons", 2024-09-10T09:37:42.637 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:37:42.638 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:37:42.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbb2406dfc0 msgr2=0x7fbb24070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbb2406dfc0 0x7fbb24070470 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005950 tx=0x7fbb3400b410 comp rx=0 tx=0).stop 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 msgr2=0x7fbb38074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38074af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800bda0 tx=0x7fbb2800bdd0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 shutdown_connections 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb38100240 0x7fbb38074af0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbb2406dfc0 0x7fbb24070470 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 --2- 172.21.15.79:0/4277380998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb38101440 0x7fbb38073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 >> 172.21.15.79:0/4277380998 conn(0x7fbb380fb7f0 msgr2=0x7fbb38104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 shutdown_connections 2024-09-10T09:37:42.639 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:37:42.637+0000 7fbb3ff68700 1 -- 172.21.15.79:0/4277380998 wait complete. 2024-09-10T09:37:42.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:42 smithi079 ceph-mon[27592]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:42.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:42 smithi079 ceph-mon[27592]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:42.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:42 smithi079 ceph-mon[27592]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:42.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:42 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1955443361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:37:42.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:42 smithi135 ceph-mon[33411]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:42.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:42 smithi135 ceph-mon[33411]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:42.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:42 smithi135 ceph-mon[33411]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:42.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:42 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1955443361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:37:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:43 smithi079 ceph-mon[27592]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:43.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:43 smithi079 ceph-mon[27592]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 411 op/s 2024-09-10T09:37:43.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:43 smithi135 ceph-mon[33411]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:37:43.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:43 smithi135 ceph-mon[33411]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 411 op/s 2024-09-10T09:37:46.193 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:45 smithi135 ceph-mon[33411]: pgmap v17: 65 pgs: 65 active+clean; 265 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 703 op/s 2024-09-10T09:37:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:45 smithi079 ceph-mon[27592]: pgmap v17: 65 pgs: 65 active+clean; 265 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 703 op/s 2024-09-10T09:37:48.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:47 smithi135 ceph-mon[33411]: pgmap v18: 65 pgs: 65 active+clean; 265 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 439 op/s 2024-09-10T09:37:48.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:48.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:48.123 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:48.124 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:48.174 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:47 smithi079 ceph-mon[27592]: pgmap v18: 65 pgs: 65 active+clean; 265 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 439 op/s 2024-09-10T09:37:48.174 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:48.174 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:48.174 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:37:48.174 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:37:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:49 smithi135 ceph-mon[33411]: pgmap v19: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 773 op/s 2024-09-10T09:37:49.891 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:49 smithi079 ceph-mon[27592]: pgmap v19: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 773 op/s 2024-09-10T09:37:52.202 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:51 smithi079 ceph-mon[27592]: pgmap v20: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 626 op/s 2024-09-10T09:37:52.204 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-10T09:37:52.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T09:37:52.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:51 smithi135 ceph-mon[33411]: pgmap v20: 65 pgs: 65 active+clean; 264 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 626 op/s 2024-09-10T09:37:52.632 DEBUG:teuthology.parallel:result is None 2024-09-10T09:37:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:53 smithi079 ceph-mon[27592]: pgmap v21: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 692 op/s 2024-09-10T09:37:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:53 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:53 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:53 smithi135 ceph-mon[33411]: pgmap v21: 65 pgs: 65 active+clean; 258 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 692 op/s 2024-09-10T09:37:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:53 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:53 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:56.167 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:55 smithi135 ceph-mon[33411]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 1.03k op/s 2024-09-10T09:37:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:55 smithi079 ceph-mon[27592]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 1.03k op/s 2024-09-10T09:37:58.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:57 smithi079 ceph-mon[27592]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 737 op/s 2024-09-10T09:37:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:57 smithi135 ceph-mon[33411]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 737 op/s 2024-09-10T09:37:59.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:59 smithi079 ceph-mon[27592]: pgmap v24: 65 pgs: 65 active+clean; 244 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.05k op/s 2024-09-10T09:37:59.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:59 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:59.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:37:59 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:59 smithi135 ceph-mon[33411]: pgmap v24: 65 pgs: 65 active+clean; 244 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.05k op/s 2024-09-10T09:37:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:59 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:37:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:37:59 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:02.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:01 smithi079 ceph-mon[27592]: pgmap v25: 65 pgs: 65 active+clean; 244 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 719 op/s 2024-09-10T09:38:02.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:01 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:02.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:01 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:01 smithi135 ceph-mon[33411]: pgmap v25: 65 pgs: 65 active+clean; 244 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 719 op/s 2024-09-10T09:38:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:01 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:01 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:03.144 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:02 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:03.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:02 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:03 smithi079 ceph-mon[27592]: pgmap v26: 65 pgs: 65 active+clean; 243 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 738 op/s 2024-09-10T09:38:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:03 smithi135 ceph-mon[33411]: pgmap v26: 65 pgs: 65 active+clean; 243 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 738 op/s 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: pgmap v27: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 812 op/s 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:05.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.mhirny"}]: dispatch 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.mhirny"}]': finished 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.lbhjof"}]: dispatch 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.lbhjof"}]': finished 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:05.964 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:05.964 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:05.964 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:05 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: pgmap v27: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 812 op/s 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.mhirny"}]: dispatch 2024-09-10T09:38:06.077 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi079.mhirny"}]': finished 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.lbhjof"}]: dispatch 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi135.lbhjof"}]': finished 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:06.078 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:05 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:07.120 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:06 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all mgr 2024-09-10T09:38:07.120 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:06 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all rgw 2024-09-10T09:38:07.120 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:06 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T09:38:07.120 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:06 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-10T09:38:07.120 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:06 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all iscsi 2024-09-10T09:38:07.120 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:06 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all nfs 2024-09-10T09:38:07.120 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:06 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all nvmeof 2024-09-10T09:38:07.209 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-10T09:38:07.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-10T09:38:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:06 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all mgr 2024-09-10T09:38:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:06 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all rgw 2024-09-10T09:38:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:06 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T09:38:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:06 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-10T09:38:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:06 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all iscsi 2024-09-10T09:38:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:06 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all nfs 2024-09-10T09:38:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:06 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all nvmeof 2024-09-10T09:38:08.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:07 smithi079 ceph-mon[27592]: pgmap v28: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 475 op/s 2024-09-10T09:38:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:07 smithi135 ceph-mon[33411]: pgmap v28: 65 pgs: 65 active+clean; 229 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 475 op/s 2024-09-10T09:38:09.079 DEBUG:teuthology.parallel:result is None 2024-09-10T09:38:09.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T09:38:09.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:08 smithi079 ceph-mon[27592]: Upgrade: Updating node-exporter.smithi079 (1/2) 2024-09-10T09:38:09.106 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:08 smithi079 ceph-mon[27592]: Deploying daemon node-exporter.smithi079 on smithi079 2024-09-10T09:38:09.115 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T09:38:09.115 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T09:38:09.137 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:08 smithi135 ceph-mon[33411]: Upgrade: Updating node-exporter.smithi079 (1/2) 2024-09-10T09:38:09.137 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:08 smithi135 ceph-mon[33411]: Deploying daemon node-exporter.smithi079 on smithi079 2024-09-10T09:38:09.147 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-10T09:38:09.147 DEBUG:teuthology.parallel:result is None 2024-09-10T09:38:10.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:09 smithi079 ceph-mon[27592]: pgmap v29: 65 pgs: 65 active+clean; 218 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2024-09-10T09:38:10.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:09 smithi135 ceph-mon[33411]: pgmap v29: 65 pgs: 65 active+clean; 218 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 646 op/s 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof restarted 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:10.956 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:10 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: Standby manager daemon smithi135.lbhjof restarted 2024-09-10T09:38:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:38:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:38:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:38:11.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:38:11.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: from='mgr.? 172.21.15.135:0/4266059025' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:38:11.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:11.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:10 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:12.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:11 smithi079 ceph-mon[27592]: pgmap v30: 65 pgs: 65 active+clean; 218 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 330 op/s 2024-09-10T09:38:12.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:11 smithi079 ceph-mon[27592]: mgrmap e31: smithi079.mhirny(active, since 54s), standbys: smithi135.lbhjof 2024-09-10T09:38:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:11 smithi135 ceph-mon[33411]: pgmap v30: 65 pgs: 65 active+clean; 218 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 330 op/s 2024-09-10T09:38:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:11 smithi135 ceph-mon[33411]: mgrmap e31: smithi079.mhirny(active, since 54s), standbys: smithi135.lbhjof 2024-09-10T09:38:12.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 -- 172.21.15.79:0/978871170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 msgr2=0x7f24d41018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:12.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 --2- 172.21.15.79:0/978871170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41018a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f24c400b0a0 tx=0x7f24c400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:38:12.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 -- 172.21.15.79:0/978871170 shutdown_connections 2024-09-10T09:38:12.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 --2- 172.21.15.79:0/978871170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41018a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 --2- 172.21.15.79:0/978871170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d4100250 0x7f24d4100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 -- 172.21.15.79:0/978871170 >> 172.21.15.79:0/978871170 conn(0x7f24d40fb7e0 msgr2=0x7f24d40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 -- 172.21.15.79:0/978871170 shutdown_connections 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.757+0000 7f24dab1e700 1 -- 172.21.15.79:0/978871170 wait complete. 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24dab1e700 1 Processor -- start 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24dab1e700 1 -- start start 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24dab1e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d4100250 0x7f24d4197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24dab1e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24dab1e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41987c0 con 0x7f24d4101450 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24dab1e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d4198930 con 0x7f24d4100250 2024-09-10T09:38:12.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24d3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24d3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37086/0 (socket says 172.21.15.79:37086) 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24d3fff700 1 -- 172.21.15.79:0/3922839376 learned_addr learned my addr 172.21.15.79:0/3922839376 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24d88ba700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d4100250 0x7f24d4197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24d3fff700 1 -- 172.21.15.79:0/3922839376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d4100250 msgr2=0x7f24d4197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24d3fff700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d4100250 0x7f24d4197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.758+0000 7f24d3fff700 1 -- 172.21.15.79:0/3922839376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4009d00 con 0x7f24d4101450 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.759+0000 7f24d88ba700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d4100250 0x7f24d4197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.759+0000 7f24d3fff700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41981c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f24c40077b0 tx=0x7f24c4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.759+0000 7f24d1ffb700 1 -- 172.21.15.79:0/3922839376 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c400e040 con 0x7f24d4101450 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.759+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d419d360 con 0x7f24d4101450 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.759+0000 7f24d1ffb700 1 -- 172.21.15.79:0/3922839376 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f24c40044f0 con 0x7f24d4101450 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.759+0000 7f24d1ffb700 1 -- 172.21.15.79:0/3922839376 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c401d9e0 con 0x7f24d4101450 2024-09-10T09:38:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.759+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d419d850 con 0x7f24d4101450 2024-09-10T09:38:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.760+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d4105530 con 0x7f24d4101450 2024-09-10T09:38:12.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.761+0000 7f24d1ffb700 1 -- 172.21.15.79:0/3922839376 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f24c4004040 con 0x7f24d4101450 2024-09-10T09:38:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.761+0000 7f24d1ffb700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f24c006dfc0 0x7f24c0070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.761+0000 7f24d1ffb700 1 -- 172.21.15.79:0/3922839376 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f24c408f7c0 con 0x7f24d4101450 2024-09-10T09:38:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.761+0000 7f24d88ba700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f24c006dfc0 0x7f24c0070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:12.764 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.762+0000 7f24d88ba700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f24c006dfc0 0x7f24c0070470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f24cc005fd0 tx=0x7f24cc005f20 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:12.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.766+0000 7f24d1ffb700 1 -- 172.21.15.79:0/3922839376 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f24c4058eb0 con 0x7f24d4101450 2024-09-10T09:38:12.988 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.987+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24d4061190 con 0x7f24c006dfc0 2024-09-10T09:38:12.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.989+0000 7f24d1ffb700 1 -- 172.21.15.79:0/3922839376 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f24d4061190 con 0x7f24c006dfc0 2024-09-10T09:38:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f24c006dfc0 msgr2=0x7f24c0070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f24c006dfc0 0x7f24c0070470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f24cc005fd0 tx=0x7f24cc005f20 comp rx=0 tx=0).stop 2024-09-10T09:38:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 msgr2=0x7f24d41981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41981c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f24c40077b0 tx=0x7f24c4009810 comp rx=0 tx=0).stop 2024-09-10T09:38:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 shutdown_connections 2024-09-10T09:38:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f24c006dfc0 0x7f24c0070470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:12.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24d4100250 0x7f24d4197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 --2- 172.21.15.79:0/3922839376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24d4101450 0x7f24d41981c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 >> 172.21.15.79:0/3922839376 conn(0x7f24d40fb7e0 msgr2=0x7f24d4102670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 shutdown_connections 2024-09-10T09:38:12.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:12.991+0000 7f24dab1e700 1 -- 172.21.15.79:0/3922839376 wait complete. 2024-09-10T09:38:13.002 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:38:13.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 -- 172.21.15.79:0/3767780121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 msgr2=0x7f687c105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 --2- 172.21.15.79:0/3767780121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c105a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6870009910 tx=0x7f6870009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:13.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 -- 172.21.15.79:0/3767780121 shutdown_connections 2024-09-10T09:38:13.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 --2- 172.21.15.79:0/3767780121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c105a60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 --2- 172.21.15.79:0/3767780121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687c100d60 0x7f687c103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 -- 172.21.15.79:0/3767780121 >> 172.21.15.79:0/3767780121 conn(0x7f687c0fa780 msgr2=0x7f687c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:13.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 -- 172.21.15.79:0/3767780121 shutdown_connections 2024-09-10T09:38:13.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.097+0000 7f6882a48700 1 -- 172.21.15.79:0/3767780121 wait complete. 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f6882a48700 1 Processor -- start 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f6882a48700 1 -- start start 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f6882a48700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687c100d60 0x7f687c1006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f6882a48700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c0fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f6882a48700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0ff250 con 0x7f687c103680 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f6882a48700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0ff390 con 0x7f687c100d60 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f687b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c0fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f687b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c0fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37098/0 (socket says 172.21.15.79:37098) 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f687b7fe700 1 -- 172.21.15.79:0/2103504845 learned_addr learned my addr 172.21.15.79:0/2103504845 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f687bfff700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687c100d60 0x7f687c1006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f687b7fe700 1 -- 172.21.15.79:0/2103504845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687c100d60 msgr2=0x7f687c1006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f687b7fe700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687c100d60 0x7f687c1006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.098+0000 7f687b7fe700 1 -- 172.21.15.79:0/2103504845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700095f0 con 0x7f687c103680 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.099+0000 7f687b7fe700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c0fed10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6870006010 tx=0x7f687000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.099+0000 7f68797fa700 1 -- 172.21.15.79:0/2103504845 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687001d070 con 0x7f687c103680 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.099+0000 7f68797fa700 1 -- 172.21.15.79:0/2103504845 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f687000f460 con 0x7f687c103680 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.099+0000 7f68797fa700 1 -- 172.21.15.79:0/2103504845 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6870021640 con 0x7f687c103680 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.099+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c0ff610 con 0x7f687c103680 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.099+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c0ffab0 con 0x7f687c103680 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.100+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c18fc60 con 0x7f687c103680 2024-09-10T09:38:13.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.100+0000 7f68797fa700 1 -- 172.21.15.79:0/2103504845 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f687000fab0 con 0x7f687c103680 2024-09-10T09:38:13.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.101+0000 7f68797fa700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f686406dfc0 0x7f6864070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.101+0000 7f68797fa700 1 -- 172.21.15.79:0/2103504845 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f687008f260 con 0x7f687c103680 2024-09-10T09:38:13.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.101+0000 7f687bfff700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f686406dfc0 0x7f6864070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.101+0000 7f687bfff700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f686406dfc0 0x7f6864070470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f686c006fd0 tx=0x7f686c008040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:13.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.105+0000 7f68797fa700 1 -- 172.21.15.79:0/2103504845 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f687005c480 con 0x7f687c103680 2024-09-10T09:38:13.329 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.328+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f687c061190 con 0x7f686406dfc0 2024-09-10T09:38:13.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.329+0000 7f68797fa700 1 -- 172.21.15.79:0/2103504845 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f687c061190 con 0x7f686406dfc0 2024-09-10T09:38:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.331+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f686406dfc0 msgr2=0x7f6864070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.331+0000 7f6882a48700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f686406dfc0 0x7f6864070470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f686c006fd0 tx=0x7f686c008040 comp rx=0 tx=0).stop 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.331+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 msgr2=0x7f687c0fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.331+0000 7f6882a48700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c0fed10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6870006010 tx=0x7f687000be20 comp rx=0 tx=0).stop 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.332+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 shutdown_connections 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.332+0000 7f6882a48700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f686406dfc0 0x7f6864070470 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.332+0000 7f6882a48700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f687c100d60 0x7f687c1006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.332+0000 7f6882a48700 1 --2- 172.21.15.79:0/2103504845 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f687c103680 0x7f687c0fed10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.332+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 >> 172.21.15.79:0/2103504845 conn(0x7f687c0fa780 msgr2=0x7f687c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.332+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 shutdown_connections 2024-09-10T09:38:13.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.332+0000 7f6882a48700 1 -- 172.21.15.79:0/2103504845 wait complete. 2024-09-10T09:38:13.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 -- 172.21.15.79:0/2638995655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe000100350 msgr2=0x7fe0001007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 --2- 172.21.15.79:0/2638995655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe000100350 0x7fe0001007a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009910 tx=0x7fdfe8009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:13.439 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 -- 172.21.15.79:0/2638995655 shutdown_connections 2024-09-10T09:38:13.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 --2- 172.21.15.79:0/2638995655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe000100350 0x7fe0001007a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 --2- 172.21.15.79:0/2638995655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0000ff150 0x7fe0000ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 -- 172.21.15.79:0/2638995655 >> 172.21.15.79:0/2638995655 conn(0x7fe0000fa700 msgr2=0x7fe0000fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:13.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 -- 172.21.15.79:0/2638995655 shutdown_connections 2024-09-10T09:38:13.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 -- 172.21.15.79:0/2638995655 wait complete. 2024-09-10T09:38:13.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.438+0000 7fe006873700 1 Processor -- start 2024-09-10T09:38:13.440 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fe006873700 1 -- start start 2024-09-10T09:38:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fe006873700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0000ff150 0x7fe0001030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fe006873700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe000100350 0x7fe000101730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fe006873700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000101c70 con 0x7fe0000ff150 2024-09-10T09:38:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fe006873700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000101db0 con 0x7fe000100350 2024-09-10T09:38:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdffffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0000ff150 0x7fe0001030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.442 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdffffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0000ff150 0x7fe0001030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37108/0 (socket says 172.21.15.79:37108) 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdffffff700 1 -- 172.21.15.79:0/4033684026 learned_addr learned my addr 172.21.15.79:0/4033684026 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdfff7fe700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe000100350 0x7fe000101730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdffffff700 1 -- 172.21.15.79:0/4033684026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe000100350 msgr2=0x7fe000101730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdffffff700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe000100350 0x7fe000101730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdffffff700 1 -- 172.21.15.79:0/4033684026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80095f0 con 0x7fe0000ff150 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.439+0000 7fdffffff700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0000ff150 0x7fe0001030e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdff000c8f0 tx=0x7fdff000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.440+0000 7fdffd7fa700 1 -- 172.21.15.79:0/4033684026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff00078e0 con 0x7fe0000ff150 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.440+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000102090 con 0x7fe0000ff150 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.440+0000 7fdffd7fa700 1 -- 172.21.15.79:0/4033684026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdff000f450 con 0x7fe0000ff150 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.440+0000 7fdffd7fa700 1 -- 172.21.15.79:0/4033684026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff0018610 con 0x7fe0000ff150 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.440+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00019db50 con 0x7fe0000ff150 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.441+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000107ca0 con 0x7fe0000ff150 2024-09-10T09:38:13.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.441+0000 7fdffd7fa700 1 -- 172.21.15.79:0/4033684026 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fdff000f5c0 con 0x7fe0000ff150 2024-09-10T09:38:13.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.442+0000 7fdffd7fa700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdfec06dfc0 0x7fdfec070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.442+0000 7fdffd7fa700 1 -- 172.21.15.79:0/4033684026 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fdff008dc20 con 0x7fe0000ff150 2024-09-10T09:38:13.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.442+0000 7fdfff7fe700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdfec06dfc0 0x7fdfec070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.442+0000 7fdfff7fe700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdfec06dfc0 0x7fdfec070470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8006010 tx=0x7fdfe800b540 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:13.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.446+0000 7fdffd7fa700 1 -- 172.21.15.79:0/4033684026 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fdff005ae40 con 0x7fe0000ff150 2024-09-10T09:38:13.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.657+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe000069500 con 0x7fdfec06dfc0 2024-09-10T09:38:13.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.666+0000 7fdffd7fa700 1 -- 172.21.15.79:0/4033684026 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fe000069500 con 0x7fdfec06dfc0 2024-09-10T09:38:13.667 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:38:13.667 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (8m) 20s ago 10m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:38:13.667 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (10m) 20s ago 10m 7734k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:38:13.667 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (9m) 14s ago 9m 7696k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:38:13.667 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (10m) 20s ago 10m 6665k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:38:13.667 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (9m) 14s ago 9m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (8m) 20s ago 9m 85.6M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (4m) 20s ago 4m 14.0M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (4m) 20s ago 4m 133M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (4m) 14s ago 4m 210M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (4m) 14s ago 4m 18.0M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (70s) 20s ago 11m 492M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (27s) 14s ago 9m 51.9M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (11m) 20s ago 11m 51.2M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (9m) 14s ago 9m 41.7M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 starting - - - - 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (9m) 14s ago 9m 14.7M - 1.5.0 0da6a335fe13 beda4c67e139 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (8m) 20s ago 8m 242M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:38:13.668 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (7m) 20s ago 7m 248M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:38:13.669 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (7m) 20s ago 7m 205M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:38:13.669 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (7m) 14s ago 7m 275M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:38:13.669 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (6m) 14s ago 6m 241M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:38:13.669 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (6m) 14s ago 6m 236M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:38:13.669 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (39s) 20s ago 9m 55.3M - 2.43.0 a07b618ecd1d aaea0dfa8681 2024-09-10T09:38:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdfec06dfc0 msgr2=0x7fdfec070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdfec06dfc0 0x7fdfec070470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8006010 tx=0x7fdfe800b540 comp rx=0 tx=0).stop 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0000ff150 msgr2=0x7fe0001030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0000ff150 0x7fe0001030e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdff000c8f0 tx=0x7fdff000cc00 comp rx=0 tx=0).stop 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 shutdown_connections 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0000ff150 0x7fe0001030e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdfec06dfc0 0x7fdfec070470 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 --2- 172.21.15.79:0/4033684026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe000100350 0x7fe000101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 >> 172.21.15.79:0/4033684026 conn(0x7fe0000fa700 msgr2=0x7fe000068df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 shutdown_connections 2024-09-10T09:38:13.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.668+0000 7fe006873700 1 -- 172.21.15.79:0/4033684026 wait complete. 2024-09-10T09:38:13.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/2310638131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 msgr2=0x7f0db8105210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/2310638131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8105210 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009910 tx=0x7f0da8009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:13.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/2310638131 shutdown_connections 2024-09-10T09:38:13.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/2310638131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db8105750 0x7f0db8107b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/2310638131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8105210 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.775 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/2310638131 >> 172.21.15.79:0/2310638131 conn(0x7f0db80fa7a0 msgr2=0x7f0db80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:13.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/2310638131 shutdown_connections 2024-09-10T09:38:13.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/2310638131 wait complete. 2024-09-10T09:38:13.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 Processor -- start 2024-09-10T09:38:13.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.774+0000 7f0dbd9e3700 1 -- start start 2024-09-10T09:38:13.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0dbd9e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0dbd9e3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db8105750 0x7f0db81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0dbd9e3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8198bd0 con 0x7f0db8069ae0 2024-09-10T09:38:13.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0dbd9e3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8198d10 con 0x7f0db8105750 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0db6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0db6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37124/0 (socket says 172.21.15.79:37124) 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0db6ffd700 1 -- 172.21.15.79:0/4068045227 learned_addr learned my addr 172.21.15.79:0/4068045227 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0dae7fc700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db8105750 0x7f0db81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0db6ffd700 1 -- 172.21.15.79:0/4068045227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db8105750 msgr2=0x7f0db81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0db6ffd700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db8105750 0x7f0db81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0db6ffd700 1 -- 172.21.15.79:0/4068045227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da80095f0 con 0x7f0db8069ae0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.775+0000 7f0db6ffd700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8198070 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0da800bd70 tx=0x7f0da800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.776+0000 7f0dbc9e1700 1 -- 172.21.15.79:0/4068045227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da801d070 con 0x7f0db8069ae0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.776+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db819d760 con 0x7f0db8069ae0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.776+0000 7f0dbc9e1700 1 -- 172.21.15.79:0/4068045227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0da800f460 con 0x7f0db8069ae0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.776+0000 7f0dbc9e1700 1 -- 172.21.15.79:0/4068045227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da8021640 con 0x7f0db8069ae0 2024-09-10T09:38:13.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.776+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db819dc50 con 0x7f0db8069ae0 2024-09-10T09:38:13.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.777+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db8191e70 con 0x7f0db8069ae0 2024-09-10T09:38:13.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.777+0000 7f0dbc9e1700 1 -- 172.21.15.79:0/4068045227 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f0da800fa00 con 0x7f0db8069ae0 2024-09-10T09:38:13.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.778+0000 7f0dbc9e1700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0da406dfc0 0x7f0da4070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:13.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.778+0000 7f0dbc9e1700 1 -- 172.21.15.79:0/4068045227 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f0da808f100 con 0x7f0db8069ae0 2024-09-10T09:38:13.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.778+0000 7f0dae7fc700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0da406dfc0 0x7f0da4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:13.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.778+0000 7f0dae7fc700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0da406dfc0 0x7f0da4070470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009a10 tx=0x7f0da0009190 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:13.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:13.782+0000 7f0dbc9e1700 1 -- 172.21.15.79:0/4068045227 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f0da805c320 con 0x7f0db8069ae0 2024-09-10T09:38:14.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.067+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0db8068ab0 con 0x7f0db8069ae0 2024-09-10T09:38:14.068 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:13 smithi079 ceph-mon[27592]: Upgrade: Updating node-exporter.smithi135 (2/2) 2024-09-10T09:38:14.068 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:13 smithi079 ceph-mon[27592]: Deploying daemon node-exporter.smithi135 on smithi135 2024-09-10T09:38:14.068 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:13 smithi079 ceph-mon[27592]: pgmap v31: 65 pgs: 65 active+clean; 218 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 330 op/s 2024-09-10T09:38:14.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.067+0000 7f0dbc9e1700 1 -- 172.21.15.79:0/4068045227 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f0da800f5d0 con 0x7f0db8069ae0 2024-09-10T09:38:14.069 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:38:14.069 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:38:14.069 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:38:14.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-10T09:38:14.070 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:38:14.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:38:14.071 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:38:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0da406dfc0 msgr2=0x7f0da4070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:14.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0da406dfc0 0x7f0da4070470 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009a10 tx=0x7f0da0009190 comp rx=0 tx=0).stop 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 msgr2=0x7f0db8198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8198070 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0da800bd70 tx=0x7f0da800bda0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 shutdown_connections 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db8069ae0 0x7f0db8198070 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f0da406dfc0 0x7f0da4070470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 --2- 172.21.15.79:0/4068045227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db8105750 0x7f0db81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 >> 172.21.15.79:0/4068045227 conn(0x7f0db80fa7a0 msgr2=0x7f0db80fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 shutdown_connections 2024-09-10T09:38:14.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.069+0000 7f0dbd9e3700 1 -- 172.21.15.79:0/4068045227 wait complete. 2024-09-10T09:38:14.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:13 smithi135 ceph-mon[33411]: Upgrade: Updating node-exporter.smithi135 (2/2) 2024-09-10T09:38:14.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:13 smithi135 ceph-mon[33411]: Deploying daemon node-exporter.smithi135 on smithi135 2024-09-10T09:38:14.131 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:13 smithi135 ceph-mon[33411]: pgmap v31: 65 pgs: 65 active+clean; 218 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 330 op/s 2024-09-10T09:38:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.175+0000 7f3550675700 1 -- 172.21.15.79:0/3476615715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fe500 msgr2=0x7f35480fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:14.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.175+0000 7f3550675700 1 --2- 172.21.15.79:0/3476615715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fe500 0x7f35480fe910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3544009910 tx=0x7f3544009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 -- 172.21.15.79:0/3476615715 shutdown_connections 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 --2- 172.21.15.79:0/3476615715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35480fee50 0x7f3548101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 --2- 172.21.15.79:0/3476615715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fe500 0x7f35480fe910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 -- 172.21.15.79:0/3476615715 >> 172.21.15.79:0/3476615715 conn(0x7f35480f9f10 msgr2=0x7f35480fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 -- 172.21.15.79:0/3476615715 shutdown_connections 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 -- 172.21.15.79:0/3476615715 wait complete. 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 Processor -- start 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 -- start start 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35480fe500 0x7f3548195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fee50 0x7f35481960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481966f0 con 0x7f35480fee50 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f3550675700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3548196830 con 0x7f35480fe500 2024-09-10T09:38:14.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.176+0000 7f354dc10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fee50 0x7f35481960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f354dc10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fee50 0x7f35481960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:37156/0 (socket says 172.21.15.79:37156) 2024-09-10T09:38:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f354dc10700 1 -- 172.21.15.79:0/2462757828 learned_addr learned my addr 172.21.15.79:0/2462757828 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f354e411700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35480fe500 0x7f3548195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f354dc10700 1 -- 172.21.15.79:0/2462757828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35480fe500 msgr2=0x7f3548195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f354dc10700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35480fe500 0x7f3548195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f354dc10700 1 -- 172.21.15.79:0/2462757828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35440095f0 con 0x7f35480fee50 2024-09-10T09:38:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f354dc10700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fee50 0x7f35481960d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f353800b4d0 tx=0x7f353800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f353f7fe700 1 -- 172.21.15.79:0/2462757828 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3538011800 con 0x7f35480fee50 2024-09-10T09:38:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354819b2e0 con 0x7f35480fee50 2024-09-10T09:38:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f353f7fe700 1 -- 172.21.15.79:0/2462757828 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3538011e10 con 0x7f35480fee50 2024-09-10T09:38:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f353f7fe700 1 -- 172.21.15.79:0/2462757828 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353800f2e0 con 0x7f35480fee50 2024-09-10T09:38:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.177+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354819b830 con 0x7f35480fee50 2024-09-10T09:38:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.178+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3548108db0 con 0x7f35480fee50 2024-09-10T09:38:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.179+0000 7f353f7fe700 1 -- 172.21.15.79:0/2462757828 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f3538010380 con 0x7f35480fee50 2024-09-10T09:38:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.179+0000 7f353f7fe700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f353406dfc0 0x7f3534070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.179+0000 7f353f7fe700 1 -- 172.21.15.79:0/2462757828 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f353808d760 con 0x7f35480fee50 2024-09-10T09:38:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.179+0000 7f354e411700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f353406dfc0 0x7f3534070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:14.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.180+0000 7f354e411700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f353406dfc0 0x7f3534070470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3544000c00 tx=0x7f354400b540 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:14.184 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.184+0000 7f353f7fe700 1 -- 172.21.15.79:0/2462757828 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f353805aa90 con 0x7f35480fee50 2024-09-10T09:38:14.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.402+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f354819bed0 con 0x7f353406dfc0 2024-09-10T09:38:14.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.404+0000 7f353f7fe700 1 -- 172.21.15.79:0/2462757828 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f354819bed0 con 0x7f353406dfc0 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr" 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "2/2 daemons upgraded", 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:38:14.405 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f353406dfc0 msgr2=0x7f3534070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f353406dfc0 0x7f3534070470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3544000c00 tx=0x7f354400b540 comp rx=0 tx=0).stop 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fee50 msgr2=0x7f35481960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fee50 0x7f35481960d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f353800b4d0 tx=0x7f353800b7e0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 shutdown_connections 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f353406dfc0 0x7f3534070470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35480fe500 0x7f3548195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 --2- 172.21.15.79:0/2462757828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35480fee50 0x7f35481960d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:14.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 >> 172.21.15.79:0/2462757828 conn(0x7f35480f9f10 msgr2=0x7f35481047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:14.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 shutdown_connections 2024-09-10T09:38:14.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:14.406+0000 7f3550675700 1 -- 172.21.15.79:0/2462757828 wait complete. 2024-09-10T09:38:15.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:14 smithi079 ceph-mon[27592]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:15.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:14 smithi079 ceph-mon[27592]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:15.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:14 smithi079 ceph-mon[27592]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:15.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:14 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/4068045227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:15.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:14 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:15.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:14 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:15.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:14 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:15.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:14 smithi135 ceph-mon[33411]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:15.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:14 smithi135 ceph-mon[33411]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:15.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:14 smithi135 ceph-mon[33411]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:15.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:14 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/4068045227' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:15.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:14 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:15.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:14 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:15.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:14 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:16.148 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:15 smithi135 ceph-mon[33411]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:16.149 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:15 smithi135 ceph-mon[33411]: pgmap v32: 65 pgs: 65 active+clean; 205 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 317 op/s 2024-09-10T09:38:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:15 smithi079 ceph-mon[27592]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:15 smithi079 ceph-mon[27592]: pgmap v32: 65 pgs: 65 active+clean; 205 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 317 op/s 2024-09-10T09:38:18.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:17 smithi079 ceph-mon[27592]: pgmap v33: 65 pgs: 65 active+clean; 205 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 622 KiB/s rd, 590 KiB/s wr, 177 op/s 2024-09-10T09:38:18.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:18.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:18.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:17 smithi135 ceph-mon[33411]: pgmap v33: 65 pgs: 65 active+clean; 205 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 622 KiB/s rd, 590 KiB/s wr, 177 op/s 2024-09-10T09:38:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:18.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:19.410 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:19 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:19.410 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:19 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:19.410 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:19 smithi079 ceph-mon[27592]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 625 KiB/s rd, 592 KiB/s wr, 179 op/s 2024-09-10T09:38:19.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:19 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:19.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:19 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:19.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:19 smithi135 ceph-mon[33411]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 625 KiB/s rd, 592 KiB/s wr, 179 op/s 2024-09-10T09:38:21.132 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:20 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:21.132 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:20 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:21.132 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:20 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:21.132 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:20 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:21.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:20 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:21.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:20 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:21.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:20 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:21.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:20 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:22.154 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:21 smithi079 ceph-mon[27592]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-10T09:38:22.154 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:22.154 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:22.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:21 smithi135 ceph-mon[33411]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-10T09:38:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:24.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:23 smithi079 ceph-mon[27592]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-10T09:38:24.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:24.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:24.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:24.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:24.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:23 smithi135 ceph-mon[33411]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4.6 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-09-10T09:38:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:24.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:24.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:24.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:24.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:25.103 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.104 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:25 smithi079 ceph-mon[27592]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-10T09:38:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:25 smithi135 ceph-mon[33411]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.0 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-09-10T09:38:26.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:26 smithi079 ceph-mon[27592]: Upgrade: Updating prometheus.smithi079 2024-09-10T09:38:26.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:26 smithi079 ceph-mon[27592]: Deploying daemon prometheus.smithi079 on smithi079 2024-09-10T09:38:27.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:26 smithi135 ceph-mon[33411]: Upgrade: Updating prometheus.smithi079 2024-09-10T09:38:27.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:26 smithi135 ceph-mon[33411]: Deploying daemon prometheus.smithi079 on smithi079 2024-09-10T09:38:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:27 smithi079 ceph-mon[27592]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-09-10T09:38:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:27 smithi135 ceph-mon[33411]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-09-10T09:38:29.846 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:29 smithi079 ceph-mon[27592]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 2.5 KiB/s wr, 3 op/s 2024-09-10T09:38:29.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:29 smithi135 ceph-mon[33411]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 2.5 KiB/s wr, 3 op/s 2024-09-10T09:38:32.148 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:31 smithi079 ceph-mon[27592]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:32.148 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:31 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:32.148 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:31 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:32.148 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:31 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:31 smithi135 ceph-mon[33411]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:32.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:31 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:32.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:31 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:32.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:31 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:32 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:33.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:32 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:34.145 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:33 smithi079 ceph-mon[27592]: pgmap v41: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:33 smithi135 ceph-mon[33411]: pgmap v41: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:36.207 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:35 smithi079 ceph-mon[27592]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:38:36.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:35 smithi135 ceph-mon[33411]: pgmap v42: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:38:37.429 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:37 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.429 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:37 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.429 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:37 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.429 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:37 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.429 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:37 smithi079 ceph-mon[27592]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:37.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:37 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:37 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:37 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:37 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:37.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:37 smithi135 ceph-mon[33411]: pgmap v43: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:39.925 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:39 smithi079 ceph-mon[27592]: pgmap v44: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:38:39.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:39 smithi135 ceph-mon[33411]: pgmap v44: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:40 smithi079 ceph-mon[27592]: pgmap v45: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:41.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:40 smithi135 ceph-mon[33411]: pgmap v45: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:42.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:41 smithi079 ceph-mon[27592]: Upgrade: Updating alertmanager.smithi079 2024-09-10T09:38:42.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:41 smithi079 ceph-mon[27592]: Deploying daemon alertmanager.smithi079 on smithi079 2024-09-10T09:38:42.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:41 smithi135 ceph-mon[33411]: Upgrade: Updating alertmanager.smithi079 2024-09-10T09:38:42.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:41 smithi135 ceph-mon[33411]: Deploying daemon alertmanager.smithi079 on smithi079 2024-09-10T09:38:43.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:42 smithi079 ceph-mon[27592]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:43.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:42 smithi135 ceph-mon[33411]: pgmap v46: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 -- 172.21.15.79:0/1395598199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368101440 msgr2=0x7f9368101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 --2- 172.21.15.79:0/1395598199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368101440 0x7f9368101890 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9358009910 tx=0x7f9358009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 -- 172.21.15.79:0/1395598199 shutdown_connections 2024-09-10T09:38:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 --2- 172.21.15.79:0/1395598199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368101440 0x7f9368101890 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 --2- 172.21.15.79:0/1395598199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9368100240 0x7f9368100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 -- 172.21.15.79:0/1395598199 >> 172.21.15.79:0/1395598199 conn(0x7f93680fb7f0 msgr2=0x7f93680fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 -- 172.21.15.79:0/1395598199 shutdown_connections 2024-09-10T09:38:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 -- 172.21.15.79:0/1395598199 wait complete. 2024-09-10T09:38:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 Processor -- start 2024-09-10T09:38:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.521+0000 7f936f64e700 1 -- start start 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936f64e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368100240 0x7f9368195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936f64e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9368101440 0x7f93681960c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936f64e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93681966e0 con 0x7f9368100240 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936f64e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9368196820 con 0x7f9368101440 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936d3ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368100240 0x7f9368195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936d3ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368100240 0x7f9368195b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34898/0 (socket says 172.21.15.79:34898) 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936d3ea700 1 -- 172.21.15.79:0/2645117003 learned_addr learned my addr 172.21.15.79:0/2645117003 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936cbe9700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9368101440 0x7f93681960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936d3ea700 1 -- 172.21.15.79:0/2645117003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9368101440 msgr2=0x7f93681960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936d3ea700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9368101440 0x7f93681960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936d3ea700 1 -- 172.21.15.79:0/2645117003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580095f0 con 0x7f9368100240 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936cbe9700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9368101440 0x7f93681960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936d3ea700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368100240 0x7f9368195b80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f936400b480 tx=0x7f936400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f935e7fc700 1 -- 172.21.15.79:0/2645117003 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93640118c0 con 0x7f9368100240 2024-09-10T09:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f935e7fc700 1 -- 172.21.15.79:0/2645117003 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9364010380 con 0x7f9368100240 2024-09-10T09:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936819b2d0 con 0x7f9368100240 2024-09-10T09:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f935e7fc700 1 -- 172.21.15.79:0/2645117003 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f936400f4f0 con 0x7f9368100240 2024-09-10T09:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.522+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936819b820 con 0x7f9368100240 2024-09-10T09:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.523+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9368108e30 con 0x7f9368100240 2024-09-10T09:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.524+0000 7f935e7fc700 1 -- 172.21.15.79:0/2645117003 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f93640104f0 con 0x7f9368100240 2024-09-10T09:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.524+0000 7f935e7fc700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f935406dfc0 0x7f9354070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.524+0000 7f935e7fc700 1 -- 172.21.15.79:0/2645117003 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f936408d8b0 con 0x7f9368100240 2024-09-10T09:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.524+0000 7f936cbe9700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f935406dfc0 0x7f9354070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.525+0000 7f936cbe9700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f935406dfc0 0x7f9354070470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f935800b5c0 tx=0x7f9358005e20 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:44.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.529+0000 7f935e7fc700 1 -- 172.21.15.79:0/2645117003 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f936405abe0 con 0x7f9368100240 2024-09-10T09:38:44.757 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.755+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9368105d90 con 0x7f935406dfc0 2024-09-10T09:38:44.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.756+0000 7f935e7fc700 1 -- 172.21.15.79:0/2645117003 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9368105d90 con 0x7f935406dfc0 2024-09-10T09:38:44.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.758+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f935406dfc0 msgr2=0x7f9354070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.758+0000 7f936f64e700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f935406dfc0 0x7f9354070470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f935800b5c0 tx=0x7f9358005e20 comp rx=0 tx=0).stop 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.758+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368100240 msgr2=0x7f9368195b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.758+0000 7f936f64e700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368100240 0x7f9368195b80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f936400b480 tx=0x7f936400b840 comp rx=0 tx=0).stop 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.759+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 shutdown_connections 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.759+0000 7f936f64e700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9368100240 0x7f9368195b80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.759+0000 7f936f64e700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f935406dfc0 0x7f9354070470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.759+0000 7f936f64e700 1 --2- 172.21.15.79:0/2645117003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9368101440 0x7f93681960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.759+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 >> 172.21.15.79:0/2645117003 conn(0x7f93680fb7f0 msgr2=0x7f9368104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.759+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 shutdown_connections 2024-09-10T09:38:44.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.759+0000 7f936f64e700 1 -- 172.21.15.79:0/2645117003 wait complete. 2024-09-10T09:38:44.771 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:38:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 -- 172.21.15.79:0/2672523865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e01018c0 msgr2=0x7fd1e0101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 --2- 172.21.15.79:0/2672523865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e01018c0 0x7fd1e0101cd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009910 tx=0x7fd1dc009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 -- 172.21.15.79:0/2672523865 shutdown_connections 2024-09-10T09:38:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 --2- 172.21.15.79:0/2672523865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e0102210 0x7fd1e00fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 --2- 172.21.15.79:0/2672523865 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e01018c0 0x7fd1e0101cd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 -- 172.21.15.79:0/2672523865 >> 172.21.15.79:0/2672523865 conn(0x7fd1e00f9f10 msgr2=0x7fd1e00fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 -- 172.21.15.79:0/2672523865 shutdown_connections 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.866+0000 7fd1e7241700 1 -- 172.21.15.79:0/2672523865 wait complete. 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1e7241700 1 Processor -- start 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1e7241700 1 -- start start 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1e7241700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e01018c0 0x7fd1e0195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1e7241700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0102210 0x7fd1e0196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1e7241700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0196670 con 0x7fd1e0102210 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1e7241700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01967b0 con 0x7fd1e01018c0 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1d7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0102210 0x7fd1e0196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1d7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0102210 0x7fd1e0196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34922/0 (socket says 172.21.15.79:34922) 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1d7fff700 1 -- 172.21.15.79:0/3240050258 learned_addr learned my addr 172.21.15.79:0/3240050258 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1e4fdd700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e01018c0 0x7fd1e0195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1d7fff700 1 -- 172.21.15.79:0/3240050258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e01018c0 msgr2=0x7fd1e0195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1d7fff700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e01018c0 0x7fd1e0195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1d7fff700 1 -- 172.21.15.79:0/3240050258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0095f0 con 0x7fd1e0102210 2024-09-10T09:38:44.871 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.867+0000 7fd1d7fff700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0102210 0x7fd1e0196050 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000d900 tx=0x7fd1d000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:44.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.868+0000 7fd1d5ffb700 1 -- 172.21.15.79:0/3240050258 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1d0009900 con 0x7fd1e0102210 2024-09-10T09:38:44.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.868+0000 7fd1d5ffb700 1 -- 172.21.15.79:0/3240050258 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1d0010460 con 0x7fd1e0102210 2024-09-10T09:38:44.872 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.868+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e019b260 con 0x7fd1e0102210 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.868+0000 7fd1d5ffb700 1 -- 172.21.15.79:0/3240050258 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1d000f5f0 con 0x7fd1e0102210 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.868+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e019b7b0 con 0x7fd1e0102210 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.869+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e0108d50 con 0x7fd1e0102210 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.869+0000 7fd1d5ffb700 1 -- 172.21.15.79:0/3240050258 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fd1d00105d0 con 0x7fd1e0102210 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.870+0000 7fd1d5ffb700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd1c806dfc0 0x7fd1c8070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.870+0000 7fd1d5ffb700 1 -- 172.21.15.79:0/3240050258 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd1d008d920 con 0x7fd1e0102210 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.870+0000 7fd1e4fdd700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd1c806dfc0 0x7fd1c8070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.870+0000 7fd1e4fdd700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd1c806dfc0 0x7fd1c8070470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc006010 tx=0x7fd1dc00b540 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:44.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:44.874+0000 7fd1d5ffb700 1 -- 172.21.15.79:0/3240050258 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fd1d005ab40 con 0x7fd1e0102210 2024-09-10T09:38:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.113+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1e0105fb0 con 0x7fd1c806dfc0 2024-09-10T09:38:45.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.114+0000 7fd1d5ffb700 1 -- 172.21.15.79:0/3240050258 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd1e0105fb0 con 0x7fd1c806dfc0 2024-09-10T09:38:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd1c806dfc0 msgr2=0x7fd1c8070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd1c806dfc0 0x7fd1c8070470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc006010 tx=0x7fd1dc00b540 comp rx=0 tx=0).stop 2024-09-10T09:38:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0102210 msgr2=0x7fd1e0196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0102210 0x7fd1e0196050 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000d900 tx=0x7fd1d000dc10 comp rx=0 tx=0).stop 2024-09-10T09:38:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 shutdown_connections 2024-09-10T09:38:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd1c806dfc0 0x7fd1c8070470 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.119 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1e01018c0 0x7fd1e0195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 --2- 172.21.15.79:0/3240050258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1e0102210 0x7fd1e0196050 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 >> 172.21.15.79:0/3240050258 conn(0x7fd1e00f9f10 msgr2=0x7fd1e0104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 shutdown_connections 2024-09-10T09:38:45.120 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.117+0000 7fd1e7241700 1 -- 172.21.15.79:0/3240050258 wait complete. 2024-09-10T09:38:45.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2937309752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 msgr2=0x7f9d64100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2937309752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64100650 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009910 tx=0x7f9d58009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2937309752 shutdown_connections 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2937309752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101440 0x7f9d64101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2937309752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64100650 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2937309752 >> 172.21.15.79:0/2937309752 conn(0x7f9d640fb7f0 msgr2=0x7f9d640fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2937309752 shutdown_connections 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.231+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2937309752 wait complete. 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d6ae05700 1 Processor -- start 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d6ae05700 1 -- start start 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d6ae05700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64195b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d6ae05700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101440 0x7f9d641960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:45.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d6ae05700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d641966c0 con 0x7f9d64100240 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d6ae05700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d64196800 con 0x7f9d64101440 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d68ba1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64195b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d68ba1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64195b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34944/0 (socket says 172.21.15.79:34944) 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.232+0000 7f9d68ba1700 1 -- 172.21.15.79:0/2603809569 learned_addr learned my addr 172.21.15.79:0/2603809569 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d63fff700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101440 0x7f9d641960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d68ba1700 1 -- 172.21.15.79:0/2603809569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101440 msgr2=0x7f9d641960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d68ba1700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101440 0x7f9d641960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d68ba1700 1 -- 172.21.15.79:0/2603809569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580095f0 con 0x7f9d64100240 2024-09-10T09:38:45.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d68ba1700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64195b60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800bda0 tx=0x7f9d5800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:45.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d61ffb700 1 -- 172.21.15.79:0/2603809569 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d5801d070 con 0x7f9d64100240 2024-09-10T09:38:45.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6419b250 con 0x7f9d64100240 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d61ffb700 1 -- 172.21.15.79:0/2603809569 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d58004c50 con 0x7f9d64100240 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d61ffb700 1 -- 172.21.15.79:0/2603809569 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d5800f690 con 0x7f9d64100240 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.233+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6419b740 con 0x7f9d64100240 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.234+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d64108e10 con 0x7f9d64100240 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.235+0000 7f9d61ffb700 1 -- 172.21.15.79:0/2603809569 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7f9d580229b0 con 0x7f9d64100240 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.235+0000 7f9d61ffb700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f9d5406dfc0 0x7f9d54070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.235+0000 7f9d61ffb700 1 -- 172.21.15.79:0/2603809569 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f9d5808f4a0 con 0x7f9d64100240 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.235+0000 7f9d63fff700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f9d5406dfc0 0x7f9d54070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:45.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.236+0000 7f9d63fff700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f9d5406dfc0 0x7f9d54070470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d50006fd0 tx=0x7f9d50008040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:45.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.240+0000 7f9d61ffb700 1 -- 172.21.15.79:0/2603809569 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f9d5805c770 con 0x7f9d64100240 2024-09-10T09:38:45.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.464+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d64105d90 con 0x7f9d5406dfc0 2024-09-10T09:38:45.475 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.474+0000 7f9d61ffb700 1 -- 172.21.15.79:0/2603809569 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9d64105d90 con 0x7f9d5406dfc0 2024-09-10T09:38:45.475 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:38:45.475 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (9m) 9s ago 10m 25.6M - 0.25.0 c8568f914cd2 d6da231374ea 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (10m) 9s ago 10m 7801k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (9m) 28s ago 9m 7734k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (10m) 9s ago 10m 6669k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (9m) 28s ago 9m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (9m) 9s ago 10m 85.3M - 9.4.7 954c08fa6188 b075a77af59e 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (5m) 9s ago 5m 14.3M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (5m) 9s ago 5m 97.6M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (5m) 28s ago 5m 154M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (5m) 28s ago 5m 18.2M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (102s) 9s ago 12m 497M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (59s) 28s ago 9m 440M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (12m) 9s ago 12m 53.6M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:38:45.476 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (9m) 28s ago 9m 43.6M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (35s) 9s ago 10m 7968k - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (31s) 28s ago 9m 3435k - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (8m) 9s ago 8m 254M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (8m) 9s ago 8m 261M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (7m) 9s ago 7m 223M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (7m) 28s ago 7m 289M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (7m) 28s ago 7m 254M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (6m) 28s ago 6m 251M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:38:45.477 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (14s) 9s ago 10m 45.4M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f9d5406dfc0 msgr2=0x7f9d54070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f9d5406dfc0 0x7f9d54070470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d50006fd0 tx=0x7f9d50008040 comp rx=0 tx=0).stop 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 msgr2=0x7f9d64195b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64195b60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800bda0 tx=0x7f9d5800be80 comp rx=0 tx=0).stop 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 shutdown_connections 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d64100240 0x7f9d64195b60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f9d5406dfc0 0x7f9d54070470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 --2- 172.21.15.79:0/2603809569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101440 0x7f9d641960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 >> 172.21.15.79:0/2603809569 conn(0x7f9d640fb7f0 msgr2=0x7f9d64104670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 shutdown_connections 2024-09-10T09:38:45.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.477+0000 7f9d6ae05700 1 -- 172.21.15.79:0/2603809569 wait complete. 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 -- 172.21.15.79:0/2090832962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 msgr2=0x7ff0d4100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 --2- 172.21.15.79:0/2090832962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4100660 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009910 tx=0x7ff0c4009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 -- 172.21.15.79:0/2090832962 shutdown_connections 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 --2- 172.21.15.79:0/2090832962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d4101450 0x7ff0d41018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 --2- 172.21.15.79:0/2090832962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4100660 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 -- 172.21.15.79:0/2090832962 >> 172.21.15.79:0/2090832962 conn(0x7ff0d40fb7e0 msgr2=0x7ff0d40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 -- 172.21.15.79:0/2090832962 shutdown_connections 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.582+0000 7ff0da189700 1 -- 172.21.15.79:0/2090832962 wait complete. 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0da189700 1 Processor -- start 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0da189700 1 -- start start 2024-09-10T09:38:45.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0da189700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0da189700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d4101450 0x7ff0d4196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0da189700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4196640 con 0x7ff0d4100250 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0da189700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4196780 con 0x7ff0d4101450 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34962/0 (socket says 172.21.15.79:34962) 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d37fe700 1 -- 172.21.15.79:0/2516417105 learned_addr learned my addr 172.21.15.79:0/2516417105 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d2ffd700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d4101450 0x7ff0d4196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d37fe700 1 -- 172.21.15.79:0/2516417105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d4101450 msgr2=0x7ff0d4196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d37fe700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d4101450 0x7ff0d4196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d37fe700 1 -- 172.21.15.79:0/2516417105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40095f0 con 0x7ff0d4100250 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.583+0000 7ff0d37fe700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4195ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400bda0 tx=0x7ff0c400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.584+0000 7ff0d0ff9700 1 -- 172.21.15.79:0/2516417105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c401d070 con 0x7ff0d4100250 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.584+0000 7ff0d0ff9700 1 -- 172.21.15.79:0/2516417105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff0c400f460 con 0x7ff0d4100250 2024-09-10T09:38:45.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.584+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d419b1d0 con 0x7ff0d4100250 2024-09-10T09:38:45.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.584+0000 7ff0d0ff9700 1 -- 172.21.15.79:0/2516417105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c4021620 con 0x7ff0d4100250 2024-09-10T09:38:45.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.584+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d419b6c0 con 0x7ff0d4100250 2024-09-10T09:38:45.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.585+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d4108da0 con 0x7ff0d4100250 2024-09-10T09:38:45.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.585+0000 7ff0d0ff9700 1 -- 172.21.15.79:0/2516417105 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7ff0c400f5d0 con 0x7ff0d4100250 2024-09-10T09:38:45.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.586+0000 7ff0d0ff9700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff0bc06dfc0 0x7ff0bc070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:45.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.586+0000 7ff0d0ff9700 1 -- 172.21.15.79:0/2516417105 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff0c408ef40 con 0x7ff0d4100250 2024-09-10T09:38:45.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.586+0000 7ff0d2ffd700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff0bc06dfc0 0x7ff0bc070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:45.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.586+0000 7ff0d2ffd700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff0bc06dfc0 0x7ff0bc070470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8005950 tx=0x7ff0c800b410 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:45.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.591+0000 7ff0d0ff9700 1 -- 172.21.15.79:0/2516417105 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff0c40c39d0 con 0x7ff0d4100250 2024-09-10T09:38:45.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.884+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff0d419c0a0 con 0x7ff0d4100250 2024-09-10T09:38:45.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.885+0000 7ff0d0ff9700 1 -- 172.21.15.79:0/2516417105 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7ff0c405c1e0 con 0x7ff0d4100250 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:38:45.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:38:45.888 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff0bc06dfc0 msgr2=0x7ff0bc070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff0bc06dfc0 0x7ff0bc070470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8005950 tx=0x7ff0c800b410 comp rx=0 tx=0).stop 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 msgr2=0x7ff0d4195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4195ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400bda0 tx=0x7ff0c400bdd0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 shutdown_connections 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d4100250 0x7ff0d4195ae0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff0bc06dfc0 0x7ff0bc070470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 --2- 172.21.15.79:0/2516417105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0d4101450 0x7ff0d4196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 >> 172.21.15.79:0/2516417105 conn(0x7ff0d40fb7e0 msgr2=0x7ff0d4104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:45.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 shutdown_connections 2024-09-10T09:38:45.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.887+0000 7ff0da189700 1 -- 172.21.15.79:0/2516417105 wait complete. 2024-09-10T09:38:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.999+0000 7fdd388b9700 1 -- 172.21.15.79:0/753796852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 msgr2=0x7fdd34100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.999+0000 7fdd388b9700 1 --2- 172.21.15.79:0/753796852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd34100b30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdd28009910 tx=0x7fdd28009c20 comp rx=0 tx=0).stop 2024-09-10T09:38:46.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.999+0000 7fdd388b9700 1 -- 172.21.15.79:0/753796852 shutdown_connections 2024-09-10T09:38:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.999+0000 7fdd388b9700 1 --2- 172.21.15.79:0/753796852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34101070 0x7fdd340ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.999+0000 7fdd388b9700 1 --2- 172.21.15.79:0/753796852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd34100b30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:45.999+0000 7fdd388b9700 1 -- 172.21.15.79:0/753796852 >> 172.21.15.79:0/753796852 conn(0x7fdd340f9f10 msgr2=0x7fdd340fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.000+0000 7fdd388b9700 1 -- 172.21.15.79:0/753796852 shutdown_connections 2024-09-10T09:38:46.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.000+0000 7fdd388b9700 1 -- 172.21.15.79:0/753796852 wait complete. 2024-09-10T09:38:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd388b9700 1 Processor -- start 2024-09-10T09:38:46.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd388b9700 1 -- start start 2024-09-10T09:38:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd388b9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd340feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd388b9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34101070 0x7fdd3419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd388b9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3419ae10 con 0x7fdd34100720 2024-09-10T09:38:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd388b9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3419af80 con 0x7fdd34101070 2024-09-10T09:38:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd3259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd340feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:46.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd3259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd340feee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34976/0 (socket says 172.21.15.79:34976) 2024-09-10T09:38:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd3259c700 1 -- 172.21.15.79:0/1436684938 learned_addr learned my addr 172.21.15.79:0/1436684938 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:38:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd31d9b700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34101070 0x7fdd3419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd3259c700 1 -- 172.21.15.79:0/1436684938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34101070 msgr2=0x7fdd3419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd3259c700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34101070 0x7fdd3419a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:46.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.001+0000 7fdd3259c700 1 -- 172.21.15.79:0/1436684938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280095f0 con 0x7fdd34100720 2024-09-10T09:38:46.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.002+0000 7fdd3259c700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd340feee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd2800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:46.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.002+0000 7fdd237fe700 1 -- 172.21.15.79:0/1436684938 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2801d070 con 0x7fdd34100720 2024-09-10T09:38:46.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.002+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3419b200 con 0x7fdd34100720 2024-09-10T09:38:46.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.002+0000 7fdd237fe700 1 -- 172.21.15.79:0/1436684938 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdd28005dc0 con 0x7fdd34100720 2024-09-10T09:38:46.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.002+0000 7fdd237fe700 1 -- 172.21.15.79:0/1436684938 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd280226a0 con 0x7fdd34100720 2024-09-10T09:38:46.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.002+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3419b6f0 con 0x7fdd34100720 2024-09-10T09:38:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.003+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd34107c50 con 0x7fdd34100720 2024-09-10T09:38:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.004+0000 7fdd237fe700 1 -- 172.21.15.79:0/1436684938 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 31) v1 ==== 92158+0+0 (secure 0 0 0) 0x7fdd28003680 con 0x7fdd34100720 2024-09-10T09:38:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.004+0000 7fdd237fe700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdd1c06dfc0 0x7fdd1c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:38:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.004+0000 7fdd237fe700 1 -- 172.21.15.79:0/1436684938 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fdd2808f5e0 con 0x7fdd34100720 2024-09-10T09:38:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.004+0000 7fdd31d9b700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdd1c06dfc0 0x7fdd1c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:38:46.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.004+0000 7fdd31d9b700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdd1c06dfc0 0x7fdd1c070470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdd340ff440 tx=0x7fdd24009260 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:38:46.013 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.011+0000 7fdd237fe700 1 -- 172.21.15.79:0/1436684938 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fdd2805c880 con 0x7fdd34100720 2024-09-10T09:38:46.124 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:45 smithi079 ceph-mon[27592]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:46.124 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:45 smithi079 ceph-mon[27592]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:38:46.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:45 smithi135 ceph-mon[33411]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:46.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:45 smithi135 ceph-mon[33411]: pgmap v47: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:38:46.240 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.238+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd34104dd0 con 0x7fdd1c06dfc0 2024-09-10T09:38:46.241 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.240+0000 7fdd237fe700 1 -- 172.21.15.79:0/1436684938 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fdd34104dd0 con 0x7fdd1c06dfc0 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr" 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "2/2 daemons upgraded", 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:38:46.242 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:38:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdd1c06dfc0 msgr2=0x7fdd1c070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdd1c06dfc0 0x7fdd1c070470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdd340ff440 tx=0x7fdd24009260 comp rx=0 tx=0).stop 2024-09-10T09:38:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 msgr2=0x7fdd340feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:38:46.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd340feee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd2800f740 comp rx=0 tx=0).stop 2024-09-10T09:38:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 shutdown_connections 2024-09-10T09:38:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd34100720 0x7fdd340feee0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fdd1c06dfc0 0x7fdd1c070470 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 --2- 172.21.15.79:0/1436684938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34101070 0x7fdd3419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:38:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 >> 172.21.15.79:0/1436684938 conn(0x7fdd340f9f10 msgr2=0x7fdd341036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:38:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 shutdown_connections 2024-09-10T09:38:46.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:38:46.242+0000 7fdd388b9700 1 -- 172.21.15.79:0/1436684938 wait complete. 2024-09-10T09:38:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:46 smithi079 ceph-mon[27592]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:46 smithi079 ceph-mon[27592]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:46 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2516417105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:46 smithi135 ceph-mon[33411]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:46 smithi135 ceph-mon[33411]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:46 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2516417105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:47 smithi079 ceph-mon[27592]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:47 smithi079 ceph-mon[27592]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:48.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:48.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:48.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:48.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:48.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:47 smithi135 ceph-mon[33411]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:38:48.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:47 smithi135 ceph-mon[33411]: pgmap v48: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:38:48.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:38:48.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:48.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:48.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:49.013 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:48 smithi079 ceph-mon[27592]: mgrmap e32: smithi079.mhirny(active, since 91s), standbys: smithi135.lbhjof 2024-09-10T09:38:49.013 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:48 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:49.013 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:48 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:49.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:48 smithi135 ceph-mon[33411]: mgrmap e32: smithi079.mhirny(active, since 91s), standbys: smithi135.lbhjof 2024-09-10T09:38:49.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:48 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:49.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:48 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:50.091 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:49 smithi079 ceph-mon[27592]: pgmap v49: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-10T09:38:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:49 smithi135 ceph-mon[33411]: pgmap v49: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-10T09:38:52.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:51 smithi079 ceph-mon[27592]: pgmap v50: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-10T09:38:52.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:51 smithi135 ceph-mon[33411]: pgmap v50: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-10T09:38:53.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:53 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:53.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:53 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:53.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:53 smithi079 ceph-mon[27592]: pgmap v51: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-10T09:38:53.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:53 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:53.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:53 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:53.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:53 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:53.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:53 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:53.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:53 smithi135 ceph-mon[33411]: pgmap v51: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-10T09:38:53.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:53 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:53.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:53 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:56.202 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:55 smithi079 ceph-mon[27592]: pgmap v52: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-10T09:38:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:55 smithi135 ceph-mon[33411]: pgmap v52: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-10T09:38:57.369 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:57.369 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:57.369 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:57.369 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:57.369 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:57.370 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:38:57.370 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:38:57.370 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:57.370 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.370 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.371 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.371 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.371 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.371 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.371 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.371 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.372 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.372 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.372 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:57 smithi079 ceph-mon[27592]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:38:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:38:57.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:57 smithi135 ceph-mon[33411]: pgmap v53: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-10T09:38:58.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:58 smithi079 ceph-mon[27592]: Upgrade: Updating grafana.smithi079 2024-09-10T09:38:58.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:58 smithi079 ceph-mon[27592]: Deploying daemon grafana.smithi079 on smithi079 2024-09-10T09:38:58.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:58 smithi135 ceph-mon[33411]: Upgrade: Updating grafana.smithi079 2024-09-10T09:38:58.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:58 smithi135 ceph-mon[33411]: Deploying daemon grafana.smithi079 on smithi079 2024-09-10T09:38:59.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:38:59 smithi079 ceph-mon[27592]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-10T09:38:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:38:59 smithi135 ceph-mon[33411]: pgmap v54: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-10T09:39:02.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:01 smithi079 ceph-mon[27592]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-10T09:39:02.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:01 smithi135 ceph-mon[33411]: pgmap v55: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-10T09:39:03.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:02 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:02 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:04.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:03 smithi079 ceph-mon[27592]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-10T09:39:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:03 smithi135 ceph-mon[33411]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-09-10T09:39:06.181 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:05 smithi079 ceph-mon[27592]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T09:39:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:05 smithi135 ceph-mon[33411]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T09:39:08.025 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:07 smithi079 ceph-mon[27592]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:07 smithi135 ceph-mon[33411]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:09.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:09 smithi079 ceph-mon[27592]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:09.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:09 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:09.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:09 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:09.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:09 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:09.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:09 smithi135 ceph-mon[33411]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:09.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:09 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:09.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:09 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:09.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:09 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:12.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:11 smithi079 ceph-mon[27592]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:11 smithi135 ceph-mon[33411]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:14.028 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:13 smithi079 ceph-mon[27592]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:13 smithi135 ceph-mon[33411]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:16.172 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:15 smithi079 ceph-mon[27592]: pgmap v62: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:15 smithi135 ceph-mon[33411]: pgmap v62: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:16.354 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 -- 172.21.15.79:0/1770326188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 msgr2=0x7fcf6c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/1770326188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c100840 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009910 tx=0x7fcf60009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 -- 172.21.15.79:0/1770326188 shutdown_connections 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/1770326188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c100840 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/1770326188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf6c0ff130 0x7fcf6c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 -- 172.21.15.79:0/1770326188 >> 172.21.15.79:0/1770326188 conn(0x7fcf6c0fa780 msgr2=0x7fcf6c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 -- 172.21.15.79:0/1770326188 shutdown_connections 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.353+0000 7fcf71c0b700 1 -- 172.21.15.79:0/1770326188 wait complete. 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf71c0b700 1 Processor -- start 2024-09-10T09:39:16.355 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf71c0b700 1 -- start start 2024-09-10T09:39:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf71c0b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf6c0ff130 0x7fcf6c195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf71c0b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf71c0b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c1965d0 con 0x7fcf6c1003d0 2024-09-10T09:39:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf71c0b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c196710 con 0x7fcf6c0ff130 2024-09-10T09:39:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf6affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf6affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55636/0 (socket says 172.21.15.79:55636) 2024-09-10T09:39:16.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf6affd700 1 -- 172.21.15.79:0/931239208 learned_addr learned my addr 172.21.15.79:0/931239208 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.354+0000 7fcf6b7fe700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf6c0ff130 0x7fcf6c195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf6affd700 1 -- 172.21.15.79:0/931239208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf6c0ff130 msgr2=0x7fcf6c195a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf6affd700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf6c0ff130 0x7fcf6c195a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf6affd700 1 -- 172.21.15.79:0/931239208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600095f0 con 0x7fcf6c1003d0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf6affd700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c195fb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcf60006010 tx=0x7fcf6000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf68ff9700 1 -- 172.21.15.79:0/931239208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6001d070 con 0x7fcf6c1003d0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c19b160 con 0x7fcf6c1003d0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf68ff9700 1 -- 172.21.15.79:0/931239208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcf6000f460 con 0x7fcf6c1003d0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf68ff9700 1 -- 172.21.15.79:0/931239208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf60021640 con 0x7fcf6c1003d0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.355+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c19b650 con 0x7fcf6c1003d0 2024-09-10T09:39:16.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.356+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c107c10 con 0x7fcf6c1003d0 2024-09-10T09:39:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.357+0000 7fcf68ff9700 1 -- 172.21.15.79:0/931239208 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fcf6000fab0 con 0x7fcf6c1003d0 2024-09-10T09:39:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.357+0000 7fcf68ff9700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fcf5406de80 0x7fcf54070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.357+0000 7fcf68ff9700 1 -- 172.21.15.79:0/931239208 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fcf6008ed10 con 0x7fcf6c1003d0 2024-09-10T09:39:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.357+0000 7fcf6b7fe700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fcf5406de80 0x7fcf54070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:16.360 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.358+0000 7fcf6b7fe700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fcf5406de80 0x7fcf54070330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009550 tx=0x7fcf5c0091b0 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:16.364 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.364+0000 7fcf68ff9700 1 -- 172.21.15.79:0/931239208 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fcf6005c130 con 0x7fcf6c1003d0 2024-09-10T09:39:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.610+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf6c068c50 con 0x7fcf5406de80 2024-09-10T09:39:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.611+0000 7fcf68ff9700 1 -- 172.21.15.79:0/931239208 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fcf6c068c50 con 0x7fcf5406de80 2024-09-10T09:39:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fcf5406de80 msgr2=0x7fcf54070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fcf5406de80 0x7fcf54070330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c009550 tx=0x7fcf5c0091b0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 msgr2=0x7fcf6c195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c195fb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcf60006010 tx=0x7fcf6000bd70 comp rx=0 tx=0).stop 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 shutdown_connections 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fcf5406de80 0x7fcf54070330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf6c0ff130 0x7fcf6c195a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 --2- 172.21.15.79:0/931239208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf6c1003d0 0x7fcf6c195fb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.613+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 >> 172.21.15.79:0/931239208 conn(0x7fcf6c0fa780 msgr2=0x7fcf6c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.614+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 shutdown_connections 2024-09-10T09:39:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.614+0000 7fcf71c0b700 1 -- 172.21.15.79:0/931239208 wait complete. 2024-09-10T09:39:16.627 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:39:16.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 -- 172.21.15.79:0/4209069317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 msgr2=0x7f1174101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 --2- 172.21.15.79:0/4209069317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f1174101890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1164009910 tx=0x7f1164009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 -- 172.21.15.79:0/4209069317 shutdown_connections 2024-09-10T09:39:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 --2- 172.21.15.79:0/4209069317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f1174101890 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 --2- 172.21.15.79:0/4209069317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1174100240 0x7f1174100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 -- 172.21.15.79:0/4209069317 >> 172.21.15.79:0/4209069317 conn(0x7f11740fb7f0 msgr2=0x7f11740fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 -- 172.21.15.79:0/4209069317 shutdown_connections 2024-09-10T09:39:16.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.729+0000 7f117b5b6700 1 -- 172.21.15.79:0/4209069317 wait complete. 2024-09-10T09:39:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f117b5b6700 1 Processor -- start 2024-09-10T09:39:16.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f117b5b6700 1 -- start start 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f117b5b6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1174100240 0x7f1174197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f117b5b6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f11741981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f117b5b6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741987d0 con 0x7f1174101440 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f117b5b6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174198940 con 0x7f1174100240 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f1178b51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f11741981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f1178b51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f11741981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55660/0 (socket says 172.21.15.79:55660) 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.730+0000 7f1178b51700 1 -- 172.21.15.79:0/2889975219 learned_addr learned my addr 172.21.15.79:0/2889975219 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f1179352700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1174100240 0x7f1174197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f1178b51700 1 -- 172.21.15.79:0/2889975219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1174100240 msgr2=0x7f1174197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f1178b51700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1174100240 0x7f1174197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f1178b51700 1 -- 172.21.15.79:0/2889975219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640095f0 con 0x7f1174101440 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f1178b51700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f11741981d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f116400bd70 tx=0x7f116400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f116a7fc700 1 -- 172.21.15.79:0/2889975219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116401d070 con 0x7f1174101440 2024-09-10T09:39:16.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f116a7fc700 1 -- 172.21.15.79:0/2889975219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1164022470 con 0x7f1174101440 2024-09-10T09:39:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f116a7fc700 1 -- 172.21.15.79:0/2889975219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116400f670 con 0x7f1174101440 2024-09-10T09:39:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117419d370 con 0x7f1174101440 2024-09-10T09:39:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.731+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117419d860 con 0x7f1174101440 2024-09-10T09:39:16.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.732+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174105520 con 0x7f1174101440 2024-09-10T09:39:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.733+0000 7f116a7fc700 1 -- 172.21.15.79:0/2889975219 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f1164022a50 con 0x7f1174101440 2024-09-10T09:39:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.733+0000 7f116a7fc700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f116006de80 0x7f1160070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.733+0000 7f116a7fc700 1 -- 172.21.15.79:0/2889975219 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f116408f130 con 0x7f1174101440 2024-09-10T09:39:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.733+0000 7f1179352700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f116006de80 0x7f1160070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:16.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.734+0000 7f1179352700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f116006de80 0x7f1160070330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1170005fd0 tx=0x7f1170005dd0 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:16.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.738+0000 7f116a7fc700 1 -- 172.21.15.79:0/2889975219 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f1164058bf0 con 0x7f1174101440 2024-09-10T09:39:16.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.979+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1174061190 con 0x7f116006de80 2024-09-10T09:39:16.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.983+0000 7f116a7fc700 1 -- 172.21.15.79:0/2889975219 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f1174061190 con 0x7f116006de80 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f116006de80 msgr2=0x7f1160070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f116006de80 0x7f1160070330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1170005fd0 tx=0x7f1170005dd0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 msgr2=0x7f11741981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f11741981d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f116400bd70 tx=0x7f116400be50 comp rx=0 tx=0).stop 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 shutdown_connections 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f116006de80 0x7f1160070330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1174100240 0x7f1174197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 --2- 172.21.15.79:0/2889975219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1174101440 0x7f11741981d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:16.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 >> 172.21.15.79:0/2889975219 conn(0x7f11740fb7f0 msgr2=0x7f1174102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:16.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 shutdown_connections 2024-09-10T09:39:16.987 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:16.985+0000 7f117b5b6700 1 -- 172.21.15.79:0/2889975219 wait complete. 2024-09-10T09:39:17.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 -- 172.21.15.79:0/1328938957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 msgr2=0x7f88d8100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1328938957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8100650 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009910 tx=0x7f88c8009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:17.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 -- 172.21.15.79:0/1328938957 shutdown_connections 2024-09-10T09:39:17.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1328938957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8101440 0x7f88d8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1328938957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8100650 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 -- 172.21.15.79:0/1328938957 >> 172.21.15.79:0/1328938957 conn(0x7f88d80fb7f0 msgr2=0x7f88d80fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:17.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 -- 172.21.15.79:0/1328938957 shutdown_connections 2024-09-10T09:39:17.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 -- 172.21.15.79:0/1328938957 wait complete. 2024-09-10T09:39:17.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.095+0000 7f88dd59e700 1 Processor -- start 2024-09-10T09:39:17.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88dd59e700 1 -- start start 2024-09-10T09:39:17.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88dd59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88dd59e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8101440 0x7f88d8198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88dd59e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d8198850 con 0x7f88d8100240 2024-09-10T09:39:17.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88dd59e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d819d260 con 0x7f88d8101440 2024-09-10T09:39:17.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.098 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55692/0 (socket says 172.21.15.79:55692) 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d6ffd700 1 -- 172.21.15.79:0/1105310785 learned_addr learned my addr 172.21.15.79:0/1105310785 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d67fc700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8101440 0x7f88d8198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d6ffd700 1 -- 172.21.15.79:0/1105310785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8101440 msgr2=0x7f88d8198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d6ffd700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8101440 0x7f88d8198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d6ffd700 1 -- 172.21.15.79:0/1105310785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80095f0 con 0x7f88d8100240 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.096+0000 7f88d6ffd700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8197cf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f88c800bda0 tx=0x7f88c800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.097+0000 7f88bffff700 1 -- 172.21.15.79:0/1105310785 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88c801d070 con 0x7f88d8100240 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.097+0000 7f88bffff700 1 -- 172.21.15.79:0/1105310785 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f88c800f460 con 0x7f88d8100240 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.097+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d819d400 con 0x7f88d8100240 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.097+0000 7f88bffff700 1 -- 172.21.15.79:0/1105310785 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88c8021620 con 0x7f88d8100240 2024-09-10T09:39:17.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.097+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d819d8c0 con 0x7f88d8100240 2024-09-10T09:39:17.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.098+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d8105520 con 0x7f88d8100240 2024-09-10T09:39:17.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.098+0000 7f88bffff700 1 -- 172.21.15.79:0/1105310785 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f88c800f5d0 con 0x7f88d8100240 2024-09-10T09:39:17.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.099+0000 7f88bffff700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f88c006de80 0x7f88c0070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.099+0000 7f88bffff700 1 -- 172.21.15.79:0/1105310785 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f88c808ed40 con 0x7f88d8100240 2024-09-10T09:39:17.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.099+0000 7f88d67fc700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f88c006de80 0x7f88c0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.099+0000 7f88d67fc700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f88c006de80 0x7f88c0070330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f88cc005950 tx=0x7f88cc00b410 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:17.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.104+0000 7f88bffff700 1 -- 172.21.15.79:0/1105310785 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f88c8058650 con 0x7f88d8100240 2024-09-10T09:39:17.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.329+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f88d8061190 con 0x7f88c006de80 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.339+0000 7f88bffff700 1 -- 172.21.15.79:0/1105310785 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f88d8061190 con 0x7f88c006de80 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (30s) 0s ago 11m 15.5M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (11m) 0s ago 11m 7852k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (10m) 59s ago 10m 7734k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (11m) 0s ago 11m 6669k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (10m) 59s ago 10m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (8s) 0s ago 10m 45.8M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:39:17.340 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (5m) 0s ago 5m 14.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (5m) 0s ago 5m 97.7M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (5m) 59s ago 5m 154M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (5m) 59s ago 5m 18.2M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (2m) 0s ago 12m 504M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (90s) 59s ago 10m 440M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (12m) 0s ago 12m 55.2M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (10m) 59s ago 10m 43.6M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (67s) 0s ago 11m 8539k - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (63s) 59s ago 10m 3435k - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (9m) 0s ago 9m 254M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (8m) 0s ago 8m 262M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (8m) 0s ago 8m 224M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (8m) 59s ago 8m 289M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:39:17.341 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (7m) 59s ago 7m 254M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:39:17.342 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (7m) 59s ago 7m 251M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:39:17.342 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (46s) 0s ago 10m 64.1M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f88c006de80 msgr2=0x7f88c0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f88c006de80 0x7f88c0070330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f88cc005950 tx=0x7f88cc00b410 comp rx=0 tx=0).stop 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 msgr2=0x7f88d8197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8197cf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f88c800bda0 tx=0x7f88c800bdd0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 shutdown_connections 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88d8100240 0x7f88d8197cf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f88c006de80 0x7f88c0070330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 --2- 172.21.15.79:0/1105310785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88d8101440 0x7f88d8198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 >> 172.21.15.79:0/1105310785 conn(0x7f88d80fb7f0 msgr2=0x7f88d8102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 shutdown_connections 2024-09-10T09:39:17.343 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.342+0000 7f88dd59e700 1 -- 172.21.15.79:0/1105310785 wait complete. 2024-09-10T09:39:17.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 -- 172.21.15.79:0/3486581348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c1003d0 msgr2=0x7f281c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 --2- 172.21.15.79:0/3486581348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c1003d0 0x7f281c100840 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f280c009910 tx=0x7f280c009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:17.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 -- 172.21.15.79:0/3486581348 shutdown_connections 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 --2- 172.21.15.79:0/3486581348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c1003d0 0x7f281c100840 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 --2- 172.21.15.79:0/3486581348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c0ff130 0x7f281c0ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 -- 172.21.15.79:0/3486581348 >> 172.21.15.79:0/3486581348 conn(0x7f281c0fa780 msgr2=0x7f281c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 -- 172.21.15.79:0/3486581348 shutdown_connections 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 -- 172.21.15.79:0/3486581348 wait complete. 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.450+0000 7f2823f34700 1 Processor -- start 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2823f34700 1 -- start start 2024-09-10T09:39:17.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2823f34700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0ff130 0x7f281c0690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2823f34700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c1003d0 0x7f281c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2823f34700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c19ad90 con 0x7f281c0ff130 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2823f34700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c19aed0 con 0x7f281c1003d0 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2821cd0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0ff130 0x7f281c0690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2821cd0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0ff130 0x7f281c0690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55704/0 (socket says 172.21.15.79:55704) 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2821cd0700 1 -- 172.21.15.79:0/2799293533 learned_addr learned my addr 172.21.15.79:0/2799293533 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f28214cf700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c1003d0 0x7f281c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2821cd0700 1 -- 172.21.15.79:0/2799293533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c1003d0 msgr2=0x7f281c19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2821cd0700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c1003d0 0x7f281c19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2821cd0700 1 -- 172.21.15.79:0/2799293533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0095f0 con 0x7f281c0ff130 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.451+0000 7f2821cd0700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0ff130 0x7f281c0690a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f281800d8d0 tx=0x7f281800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.452+0000 7f2812ffd700 1 -- 172.21.15.79:0/2799293533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28180098a0 con 0x7f281c0ff130 2024-09-10T09:39:17.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.452+0000 7f2812ffd700 1 -- 172.21.15.79:0/2799293533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2818010460 con 0x7f281c0ff130 2024-09-10T09:39:17.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.452+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c19b1b0 con 0x7f281c0ff130 2024-09-10T09:39:17.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.452+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c19b6d0 con 0x7f281c0ff130 2024-09-10T09:39:17.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.452+0000 7f2812ffd700 1 -- 172.21.15.79:0/2799293533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f281800f5f0 con 0x7f281c0ff130 2024-09-10T09:39:17.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.453+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c107c10 con 0x7f281c0ff130 2024-09-10T09:39:17.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.453+0000 7f2812ffd700 1 -- 172.21.15.79:0/2799293533 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f2818009a00 con 0x7f281c0ff130 2024-09-10T09:39:17.457 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.454+0000 7f2812ffd700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f280806de80 0x7f2808070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.454+0000 7f2812ffd700 1 -- 172.21.15.79:0/2799293533 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f281808d980 con 0x7f281c0ff130 2024-09-10T09:39:17.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.454+0000 7f28214cf700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f280806de80 0x7f2808070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.454+0000 7f28214cf700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f280806de80 0x7f2808070330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f280c00b5c0 tx=0x7f280c005ee0 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:17.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.458+0000 7f2812ffd700 1 -- 172.21.15.79:0/2799293533 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f281805adc0 con 0x7f281c0ff130 2024-09-10T09:39:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.782+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f281c19bd60 con 0x7f281c0ff130 2024-09-10T09:39:17.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.783+0000 7f2812ffd700 1 -- 172.21.15.79:0/2799293533 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f281805a950 con 0x7f281c0ff130 2024-09-10T09:39:17.784 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:39:17.784 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:39:17.784 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:39:17.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:39:17.784 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:39:17.785 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:39:17.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f280806de80 msgr2=0x7f2808070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f280806de80 0x7f2808070330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f280c00b5c0 tx=0x7f280c005ee0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0ff130 msgr2=0x7f281c0690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0ff130 0x7f281c0690a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f281800d8d0 tx=0x7f281800dbe0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 shutdown_connections 2024-09-10T09:39:17.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f281c0ff130 0x7f281c0690a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f280806de80 0x7f2808070330 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 --2- 172.21.15.79:0/2799293533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c1003d0 0x7f281c19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 >> 172.21.15.79:0/2799293533 conn(0x7f281c0fa780 msgr2=0x7f281c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:17.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 shutdown_connections 2024-09-10T09:39:17.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.785+0000 7f2823f34700 1 -- 172.21.15.79:0/2799293533 wait complete. 2024-09-10T09:39:17.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 -- 172.21.15.79:0/2647022063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde281003f0 msgr2=0x7fde28100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 --2- 172.21.15.79:0/2647022063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde281003f0 0x7fde28100860 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009910 tx=0x7fde1c009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:17.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 -- 172.21.15.79:0/2647022063 shutdown_connections 2024-09-10T09:39:17.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 --2- 172.21.15.79:0/2647022063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde281003f0 0x7fde28100860 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 --2- 172.21.15.79:0/2647022063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde280ff150 0x7fde280ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 -- 172.21.15.79:0/2647022063 >> 172.21.15.79:0/2647022063 conn(0x7fde280fa7a0 msgr2=0x7fde280fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:17.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 -- 172.21.15.79:0/2647022063 shutdown_connections 2024-09-10T09:39:17.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.894+0000 7fde2e40d700 1 -- 172.21.15.79:0/2647022063 wait complete. 2024-09-10T09:39:17.898 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:17.898 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:17 smithi079 ceph-mon[27592]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:17.898 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:17.898 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:17 smithi079 ceph-mon[27592]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:17.898 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:17.899 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:17.899 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:17.902 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.895+0000 7fde2e40d700 1 Processor -- start 2024-09-10T09:39:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.895+0000 7fde2e40d700 1 -- start start 2024-09-10T09:39:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.895+0000 7fde2e40d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde280ff150 0x7fde28103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.895+0000 7fde2e40d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde281003f0 0x7fde281017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.895+0000 7fde2e40d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28101d10 con 0x7fde280ff150 2024-09-10T09:39:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.895+0000 7fde2e40d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28101e50 con 0x7fde281003f0 2024-09-10T09:39:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde280ff150 0x7fde28103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde27fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde280ff150 0x7fde28103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55736/0 (socket says 172.21.15.79:55736) 2024-09-10T09:39:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde27fff700 1 -- 172.21.15.79:0/4131712303 learned_addr learned my addr 172.21.15.79:0/4131712303 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde277fe700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde281003f0 0x7fde281017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde27fff700 1 -- 172.21.15.79:0/4131712303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde281003f0 msgr2=0x7fde281017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:17.904 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde27fff700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde281003f0 0x7fde281017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde27fff700 1 -- 172.21.15.79:0/4131712303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0095f0 con 0x7fde280ff150 2024-09-10T09:39:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde27fff700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde280ff150 0x7fde28103180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fde1800b4b0 tx=0x7fde1800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde257fa700 1 -- 172.21.15.79:0/4131712303 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde18011800 con 0x7fde280ff150 2024-09-10T09:39:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde257fa700 1 -- 172.21.15.79:0/4131712303 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fde18011e10 con 0x7fde280ff150 2024-09-10T09:39:17.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde28102130 con 0x7fde280ff150 2024-09-10T09:39:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde257fa700 1 -- 172.21.15.79:0/4131712303 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde1800f2e0 con 0x7fde280ff150 2024-09-10T09:39:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.896+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2819df30 con 0x7fde280ff150 2024-09-10T09:39:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.897+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde28068ab0 con 0x7fde280ff150 2024-09-10T09:39:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.898+0000 7fde257fa700 1 -- 172.21.15.79:0/4131712303 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fde18011960 con 0x7fde280ff150 2024-09-10T09:39:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.898+0000 7fde257fa700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fde1006de80 0x7fde10070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:17.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.898+0000 7fde257fa700 1 -- 172.21.15.79:0/4131712303 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fde1808d710 con 0x7fde280ff150 2024-09-10T09:39:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.898+0000 7fde277fe700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fde1006de80 0x7fde10070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.899+0000 7fde277fe700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fde1006de80 0x7fde10070330 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00b5c0 tx=0x7fde1c0058e0 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:17.903+0000 7fde257fa700 1 -- 172.21.15.79:0/4131712303 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fde1805ab50 con 0x7fde280ff150 2024-09-10T09:39:17.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:17.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:17 smithi135 ceph-mon[33411]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:17.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:17.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:17 smithi135 ceph-mon[33411]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:17.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:17.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:17.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:18.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.127+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde28069520 con 0x7fde1006de80 2024-09-10T09:39:18.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.129+0000 7fde257fa700 1 -- 172.21.15.79:0/4131712303 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fde28069520 con 0x7fde1006de80 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr" 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "2/2 daemons upgraded", 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading grafana daemons", 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:39:18.130 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fde1006de80 msgr2=0x7fde10070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fde1006de80 0x7fde10070330 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00b5c0 tx=0x7fde1c0058e0 comp rx=0 tx=0).stop 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde280ff150 msgr2=0x7fde28103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde280ff150 0x7fde28103180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fde1800b4b0 tx=0x7fde1800b870 comp rx=0 tx=0).stop 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 shutdown_connections 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde280ff150 0x7fde28103180 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fde1006de80 0x7fde10070330 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 --2- 172.21.15.79:0/4131712303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde281003f0 0x7fde281017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:18.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 >> 172.21.15.79:0/4131712303 conn(0x7fde280fa7a0 msgr2=0x7fde28068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:18.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 shutdown_connections 2024-09-10T09:39:18.133 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:18.131+0000 7fde2e40d700 1 -- 172.21.15.79:0/4131712303 wait complete. 2024-09-10T09:39:18.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:18 smithi079 ceph-mon[27592]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:18.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:18 smithi079 ceph-mon[27592]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:18.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:18 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2799293533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:18.869 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:18 smithi135 ceph-mon[33411]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:18.869 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:18 smithi135 ceph-mon[33411]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:18.869 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:18 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2799293533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:19.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:19 smithi135 ceph-mon[33411]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:19.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:19 smithi135 ceph-mon[33411]: pgmap v64: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:19.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:19 smithi079 ceph-mon[27592]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:19.725 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:19 smithi079 ceph-mon[27592]: pgmap v64: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:21.654 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.654 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.654 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:39:21.654 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:39:21.654 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.654 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.655 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: Upgrade: Finalizing container_image settings 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T09:39:21.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-10T09:39:21.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: Upgrade: Complete! 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:21.658 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: pgmap v65: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:21.659 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:39:21.659 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:39:21.659 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.659 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:21.659 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:39:21.659 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:39:21.659 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:21 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: Upgrade: Finalizing container_image settings 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T09:39:21.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T09:39:21.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: Upgrade: Complete! 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-10T09:39:21.722 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: pgmap v65: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:39:21.723 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:21 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:23 smithi079 ceph-mon[27592]: pgmap v66: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:23.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:39:23.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:23 smithi135 ceph-mon[33411]: pgmap v66: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:25 smithi079 ceph-mon[27592]: pgmap v67: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:25 smithi135 ceph-mon[33411]: pgmap v67: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:27 smithi079 ceph-mon[27592]: pgmap v68: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:28.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:27 smithi135 ceph-mon[33411]: pgmap v68: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:29.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:29 smithi079 ceph-mon[27592]: pgmap v69: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:29.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:29 smithi135 ceph-mon[33411]: pgmap v69: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:32.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:31 smithi079 ceph-mon[27592]: pgmap v70: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:32.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:31 smithi135 ceph-mon[33411]: pgmap v70: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:33.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:32 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:33.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:32 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:34.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:33 smithi079 ceph-mon[27592]: pgmap v71: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:34.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:33 smithi135 ceph-mon[33411]: pgmap v71: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:36.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:35 smithi079 ceph-mon[27592]: pgmap v72: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:36.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:35 smithi135 ceph-mon[33411]: pgmap v72: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:38.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:37 smithi079 ceph-mon[27592]: pgmap v73: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:38.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:37 smithi135 ceph-mon[33411]: pgmap v73: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:39.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:39 smithi079 ceph-mon[27592]: pgmap v74: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:39.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:39 smithi135 ceph-mon[33411]: pgmap v74: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:42.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:41 smithi079 ceph-mon[27592]: pgmap v75: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:41 smithi135 ceph-mon[33411]: pgmap v75: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:44.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:43 smithi079 ceph-mon[27592]: pgmap v76: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:44.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:43 smithi135 ceph-mon[33411]: pgmap v76: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:45 smithi079 ceph-mon[27592]: pgmap v77: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:46.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:45 smithi135 ceph-mon[33411]: pgmap v77: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:47 smithi079 ceph-mon[27592]: pgmap v78: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:48.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:47 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:48.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:47 smithi135 ceph-mon[33411]: pgmap v78: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:48.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:47 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:39:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 -- 172.21.15.79:0/2892440992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c1036a0 msgr2=0x7fd86c105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 --2- 172.21.15.79:0/2892440992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c1036a0 0x7fd86c105a80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009910 tx=0x7fd85c009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 -- 172.21.15.79:0/2892440992 shutdown_connections 2024-09-10T09:39:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 --2- 172.21.15.79:0/2892440992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c1036a0 0x7fd86c105a80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 --2- 172.21.15.79:0/2892440992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd86c100d80 0x7fd86c103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 -- 172.21.15.79:0/2892440992 >> 172.21.15.79:0/2892440992 conn(0x7fd86c0fa7a0 msgr2=0x7fd86c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 -- 172.21.15.79:0/2892440992 shutdown_connections 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.251+0000 7fd8737c8700 1 -- 172.21.15.79:0/2892440992 wait complete. 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd8737c8700 1 Processor -- start 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd8737c8700 1 -- start start 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd8737c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c100d80 0x7fd86c1006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd8737c8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd86c1036a0 0x7fd86c0fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd8737c8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0ff270 con 0x7fd86c100d80 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd8737c8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c0ff3b0 con 0x7fd86c1036a0 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd871564700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c100d80 0x7fd86c1006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd871564700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c100d80 0x7fd86c1006e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52976/0 (socket says 172.21.15.79:52976) 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd871564700 1 -- 172.21.15.79:0/909385363 learned_addr learned my addr 172.21.15.79:0/909385363 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd870d63700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd86c1036a0 0x7fd86c0fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd871564700 1 -- 172.21.15.79:0/909385363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd86c1036a0 msgr2=0x7fd86c0fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd871564700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd86c1036a0 0x7fd86c0fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd871564700 1 -- 172.21.15.79:0/909385363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c0095f0 con 0x7fd86c100d80 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd870d63700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd86c1036a0 0x7fd86c0fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.252+0000 7fd871564700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c100d80 0x7fd86c1006e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd86800b480 tx=0x7fd86800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.253+0000 7fd8627fc700 1 -- 172.21.15.79:0/909385363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8680118c0 con 0x7fd86c100d80 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.253+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c0ff690 con 0x7fd86c100d80 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.253+0000 7fd8627fc700 1 -- 172.21.15.79:0/909385363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd868010380 con 0x7fd86c100d80 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.253+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c19dee0 con 0x7fd86c100d80 2024-09-10T09:39:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.253+0000 7fd8627fc700 1 -- 172.21.15.79:0/909385363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd86801a5d0 con 0x7fd86c100d80 2024-09-10T09:39:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.254+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c18fc80 con 0x7fd86c100d80 2024-09-10T09:39:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.254+0000 7fd8627fc700 1 -- 172.21.15.79:0/909385363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fd8680104f0 con 0x7fd86c100d80 2024-09-10T09:39:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.255+0000 7fd8627fc700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd85806de80 0x7fd858070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.255+0000 7fd8627fc700 1 -- 172.21.15.79:0/909385363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fd86808d6c0 con 0x7fd86c100d80 2024-09-10T09:39:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.255+0000 7fd870d63700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd85806de80 0x7fd858070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.255+0000 7fd870d63700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd85806de80 0x7fd858070330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0059d0 tx=0x7fd85c005960 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:48.260 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.259+0000 7fd8627fc700 1 -- 172.21.15.79:0/909385363 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fd86805ab00 con 0x7fd86c100d80 2024-09-10T09:39:48.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.479+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd86c0ff820 con 0x7fd85806de80 2024-09-10T09:39:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.480+0000 7fd8627fc700 1 -- 172.21.15.79:0/909385363 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fd86c0ff820 con 0x7fd85806de80 2024-09-10T09:39:48.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd85806de80 msgr2=0x7fd858070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:48.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd85806de80 0x7fd858070330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0059d0 tx=0x7fd85c005960 comp rx=0 tx=0).stop 2024-09-10T09:39:48.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c100d80 msgr2=0x7fd86c1006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:48.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c100d80 0x7fd86c1006e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd86800b480 tx=0x7fd86800b840 comp rx=0 tx=0).stop 2024-09-10T09:39:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 shutdown_connections 2024-09-10T09:39:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd86c100d80 0x7fd86c1006e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fd85806de80 0x7fd858070330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 --2- 172.21.15.79:0/909385363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd86c1036a0 0x7fd86c0fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 >> 172.21.15.79:0/909385363 conn(0x7fd86c0fa7a0 msgr2=0x7fd86c0fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 shutdown_connections 2024-09-10T09:39:48.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:48.482+0000 7fd8737c8700 1 -- 172.21.15.79:0/909385363 wait complete. 2024-09-10T09:39:49.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-10T09:39:49.466 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:39:49.947 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:49 smithi079 ceph-mon[27592]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:49.947 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:49 smithi079 ceph-mon[27592]: pgmap v79: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:49 smithi135 ceph-mon[33411]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:39:49.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:49 smithi135 ceph-mon[33411]: pgmap v79: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:51.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 -- 172.21.15.79:0/468083279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100d70 msgr2=0x7fc9301094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 --2- 172.21.15.79:0/468083279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100d70 0x7fc9301094d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc918009910 tx=0x7fc918009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 -- 172.21.15.79:0/468083279 shutdown_connections 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 --2- 172.21.15.79:0/468083279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100d70 0x7fc9301094d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 --2- 172.21.15.79:0/468083279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930100460 0x7fc930100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 -- 172.21.15.79:0/468083279 >> 172.21.15.79:0/468083279 conn(0x7fc9300748b0 msgr2=0x7fc930074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 -- 172.21.15.79:0/468083279 shutdown_connections 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 -- 172.21.15.79:0/468083279 wait complete. 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 Processor -- start 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.196+0000 7fc9368c4700 1 -- start start 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc9368c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100460 0x7fc930195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:51.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc9368c4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930100d70 0x7fc930196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc9368c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc930196a00 con 0x7fc930100460 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc9368c4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93019a790 con 0x7fc930100d70 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100460 0x7fc930195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100460 0x7fc930195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52996/0 (socket says 172.21.15.79:52996) 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92ffff700 1 -- 172.21.15.79:0/139320200 learned_addr learned my addr 172.21.15.79:0/139320200 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc927fff700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930100d70 0x7fc930196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92ffff700 1 -- 172.21.15.79:0/139320200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930100d70 msgr2=0x7fc930196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92ffff700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930100d70 0x7fc930196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92ffff700 1 -- 172.21.15.79:0/139320200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180095f0 con 0x7fc930100460 2024-09-10T09:39:51.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92ffff700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100460 0x7fc930195de0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc92000d8d0 tx=0x7fc92000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92dffb700 1 -- 172.21.15.79:0/139320200 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc920009940 con 0x7fc930100460 2024-09-10T09:39:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92dffb700 1 -- 172.21.15.79:0/139320200 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc920010460 con 0x7fc930100460 2024-09-10T09:39:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93019aa70 con 0x7fc930100460 2024-09-10T09:39:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc92dffb700 1 -- 172.21.15.79:0/139320200 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92000f5f0 con 0x7fc930100460 2024-09-10T09:39:51.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.197+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93019afc0 con 0x7fc930100460 2024-09-10T09:39:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.198+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc930107e40 con 0x7fc930100460 2024-09-10T09:39:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.199+0000 7fc92dffb700 1 -- 172.21.15.79:0/139320200 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fc9200105d0 con 0x7fc930100460 2024-09-10T09:39:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.199+0000 7fc92dffb700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc91c06de80 0x7fc91c070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.200+0000 7fc92dffb700 1 -- 172.21.15.79:0/139320200 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc92008d9d0 con 0x7fc930100460 2024-09-10T09:39:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.200+0000 7fc927fff700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc91c06de80 0x7fc91c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:51.202 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.200+0000 7fc927fff700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc91c06de80 0x7fc91c070330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc918005b40 tx=0x7fc91801a040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:51.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.204+0000 7fc92dffb700 1 -- 172.21.15.79:0/139320200 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc920057360 con 0x7fc930100460 2024-09-10T09:39:51.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.499+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc93019b230 con 0x7fc930100460 2024-09-10T09:39:51.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.500+0000 7fc92dffb700 1 -- 172.21.15.79:0/139320200 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fc9200162c0 con 0x7fc930100460 2024-09-10T09:39:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc91c06de80 msgr2=0x7fc91c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc91c06de80 0x7fc91c070330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc918005b40 tx=0x7fc91801a040 comp rx=0 tx=0).stop 2024-09-10T09:39:51.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100460 msgr2=0x7fc930195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100460 0x7fc930195de0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc92000d8d0 tx=0x7fc92000dc90 comp rx=0 tx=0).stop 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 shutdown_connections 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc930100460 0x7fc930195de0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc91c06de80 0x7fc91c070330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 --2- 172.21.15.79:0/139320200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc930100d70 0x7fc930196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 >> 172.21.15.79:0/139320200 conn(0x7fc9300748b0 msgr2=0x7fc9300ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 shutdown_connections 2024-09-10T09:39:51.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:51.502+0000 7fc9368c4700 1 -- 172.21.15.79:0/139320200 wait complete. 2024-09-10T09:39:51.513 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:39:52.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:51 smithi079 ceph-mon[27592]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:52.134 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:51 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/139320200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:52.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-10T09:39:52.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:51 smithi135 ceph-mon[33411]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:52.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:51 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/139320200' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:52.363 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:39:54.086 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:53 smithi079 ceph-mon[27592]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 -- 172.21.15.79:0/3070442494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c104130 msgr2=0x7f179c104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 --2- 172.21.15.79:0/3070442494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c104130 0x7f179c104500 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1794009910 tx=0x7f1794009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 -- 172.21.15.79:0/3070442494 shutdown_connections 2024-09-10T09:39:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 --2- 172.21.15.79:0/3070442494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179c0ffbd0 0x7f179c100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:54.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 --2- 172.21.15.79:0/3070442494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c104130 0x7f179c104500 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:54.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 -- 172.21.15.79:0/3070442494 >> 172.21.15.79:0/3070442494 conn(0x7f179c075130 msgr2=0x7f179c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:54.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 -- 172.21.15.79:0/3070442494 shutdown_connections 2024-09-10T09:39:54.090 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.088+0000 7f17a0b14700 1 -- 172.21.15.79:0/3070442494 wait complete. 2024-09-10T09:39:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f17a0b14700 1 Processor -- start 2024-09-10T09:39:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f17a0b14700 1 -- start start 2024-09-10T09:39:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f17a0b14700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c0ffbd0 0x7f179c194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f17a0b14700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179c104130 0x7f179c195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f17a0b14700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c1958d0 con 0x7f179c0ffbd0 2024-09-10T09:39:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f17a0b14700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c195a10 con 0x7f179c104130 2024-09-10T09:39:54.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f179a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c0ffbd0 0x7f179c194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f179a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c0ffbd0 0x7f179c194d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46258/0 (socket says 172.21.15.79:46258) 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.089+0000 7f179a59c700 1 -- 172.21.15.79:0/1440863018 learned_addr learned my addr 172.21.15.79:0/1440863018 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f179a59c700 1 -- 172.21.15.79:0/1440863018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179c104130 msgr2=0x7f179c195280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f179a59c700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179c104130 0x7f179c195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f179a59c700 1 -- 172.21.15.79:0/1440863018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940095f0 con 0x7f179c0ffbd0 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f179a59c700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c0ffbd0 0x7f179c194d40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1794006010 tx=0x7f179400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f17937fe700 1 -- 172.21.15.79:0/1440863018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f179401d070 con 0x7f179c0ffbd0 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f17937fe700 1 -- 172.21.15.79:0/1440863018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1794004fb0 con 0x7f179c0ffbd0 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c199800 con 0x7f179c0ffbd0 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f17937fe700 1 -- 172.21.15.79:0/1440863018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f179400f690 con 0x7f179c0ffbd0 2024-09-10T09:39:54.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.090+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c199cf0 con 0x7f179c0ffbd0 2024-09-10T09:39:54.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.091+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c1076a0 con 0x7f179c0ffbd0 2024-09-10T09:39:54.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.091+0000 7f17937fe700 1 -- 172.21.15.79:0/1440863018 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f1794022470 con 0x7f179c0ffbd0 2024-09-10T09:39:54.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.092+0000 7f17937fe700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f178806de80 0x7f1788070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:54.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.092+0000 7f17937fe700 1 -- 172.21.15.79:0/1440863018 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f179408f2b0 con 0x7f179c0ffbd0 2024-09-10T09:39:54.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.092+0000 7f1799d9b700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f178806de80 0x7f1788070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:54.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.092+0000 7f1799d9b700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f178806de80 0x7f1788070330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1784005fd0 tx=0x7f1784005d00 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:54.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.097+0000 7f17937fe700 1 -- 172.21.15.79:0/1440863018 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f1794058d60 con 0x7f179c0ffbd0 2024-09-10T09:39:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:53 smithi135 ceph-mon[33411]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:39:54.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.380+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f179c107080 con 0x7f179c0ffbd0 2024-09-10T09:39:54.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.381+0000 7f17937fe700 1 -- 172.21.15.79:0/1440863018 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f1794022720 con 0x7f179c0ffbd0 2024-09-10T09:39:54.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f178806de80 msgr2=0x7f1788070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:54.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f178806de80 0x7f1788070330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1784005fd0 tx=0x7f1784005d00 comp rx=0 tx=0).stop 2024-09-10T09:39:54.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c0ffbd0 msgr2=0x7f179c194d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:54.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c0ffbd0 0x7f179c194d40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1794006010 tx=0x7f179400be20 comp rx=0 tx=0).stop 2024-09-10T09:39:54.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 shutdown_connections 2024-09-10T09:39:54.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f179c0ffbd0 0x7f179c194d40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:54.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f178806de80 0x7f1788070330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:54.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 --2- 172.21.15.79:0/1440863018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179c104130 0x7f179c195280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:54.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 >> 172.21.15.79:0/1440863018 conn(0x7f179c075130 msgr2=0x7f179c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:54.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 shutdown_connections 2024-09-10T09:39:54.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:54.383+0000 7f17a0b14700 1 -- 172.21.15.79:0/1440863018 wait complete. 2024-09-10T09:39:54.394 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)" 2024-09-10T09:39:54.948 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:54 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1440863018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:54.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:54 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1440863018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:54.971 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-10T09:39:55.173 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:39:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:55 smithi079 ceph-mon[27592]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:55 smithi135 ceph-mon[33411]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:56.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.936+0000 7f6a8dab6700 1 -- 172.21.15.79:0/36817262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 msgr2=0x7f6a88104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.936+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/36817262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88104e50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009910 tx=0x7f6a7c009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.937+0000 7f6a8dab6700 1 -- 172.21.15.79:0/36817262 shutdown_connections 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.937+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/36817262 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88104e50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.937+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/36817262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a881004e0 0x7f6a881008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.937+0000 7f6a8dab6700 1 -- 172.21.15.79:0/36817262 >> 172.21.15.79:0/36817262 conn(0x7f6a880fbda0 msgr2=0x7f6a880fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.937+0000 7f6a8dab6700 1 -- 172.21.15.79:0/36817262 shutdown_connections 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.937+0000 7f6a8dab6700 1 -- 172.21.15.79:0/36817262 wait complete. 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.937+0000 7f6a8dab6700 1 Processor -- start 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a8dab6700 1 -- start start 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a8dab6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a881004e0 0x7f6a88196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a8dab6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:56.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a8dab6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88196c20 con 0x7f6a88100e80 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a8dab6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8819a9b0 con 0x7f6a881004e0 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a86ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88196540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46262/0 (socket says 172.21.15.79:46262) 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a86ffd700 1 -- 172.21.15.79:0/1368264195 learned_addr learned my addr 172.21.15.79:0/1368264195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a877fe700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a881004e0 0x7f6a88196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a86ffd700 1 -- 172.21.15.79:0/1368264195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a881004e0 msgr2=0x7f6a88196000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a86ffd700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a881004e0 0x7f6a88196000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a86ffd700 1 -- 172.21.15.79:0/1368264195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0095f0 con 0x7f6a88100e80 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a86ffd700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88196540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00bda0 tx=0x7f6a7c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.938+0000 7f6a84ff9700 1 -- 172.21.15.79:0/1368264195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c01d070 con 0x7f6a88100e80 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.939+0000 7f6a84ff9700 1 -- 172.21.15.79:0/1368264195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a7c004fb0 con 0x7f6a88100e80 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.939+0000 7f6a84ff9700 1 -- 172.21.15.79:0/1368264195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c00f480 con 0x7f6a88100e80 2024-09-10T09:39:56.941 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.939+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8819ac30 con 0x7f6a88100e80 2024-09-10T09:39:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.939+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8819b120 con 0x7f6a88100e80 2024-09-10T09:39:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.940+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a881087a0 con 0x7f6a88100e80 2024-09-10T09:39:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.940+0000 7f6a84ff9700 1 -- 172.21.15.79:0/1368264195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f6a7c022870 con 0x7f6a88100e80 2024-09-10T09:39:56.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.940+0000 7f6a84ff9700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f6a7006de80 0x7f6a70070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.941+0000 7f6a84ff9700 1 -- 172.21.15.79:0/1368264195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f6a7c08f070 con 0x7f6a88100e80 2024-09-10T09:39:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.941+0000 7f6a877fe700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f6a7006de80 0x7f6a70070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:56.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.941+0000 7f6a877fe700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f6a7006de80 0x7f6a70070330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a78006fd0 tx=0x7f6a78008040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:56.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:56.945+0000 7f6a84ff9700 1 -- 172.21.15.79:0/1368264195 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f6a7c058bd0 con 0x7f6a88100e80 2024-09-10T09:39:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.233+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6a8802cc30 con 0x7f6a88100e80 2024-09-10T09:39:57.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.234+0000 7f6a84ff9700 1 -- 172.21.15.79:0/1368264195 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7f6a7c05c290 con 0x7f6a88100e80 2024-09-10T09:39:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f6a7006de80 msgr2=0x7f6a70070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f6a7006de80 0x7f6a70070330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a78006fd0 tx=0x7f6a78008040 comp rx=0 tx=0).stop 2024-09-10T09:39:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 msgr2=0x7f6a88196540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88196540 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00bda0 tx=0x7f6a7c00be80 comp rx=0 tx=0).stop 2024-09-10T09:39:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 shutdown_connections 2024-09-10T09:39:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f6a7006de80 0x7f6a70070330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6a881004e0 0x7f6a88196000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 --2- 172.21.15.79:0/1368264195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6a88100e80 0x7f6a88196540 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 >> 172.21.15.79:0/1368264195 conn(0x7f6a880fbda0 msgr2=0x7f6a880fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 shutdown_connections 2024-09-10T09:39:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:57.236+0000 7f6a8dab6700 1 -- 172.21.15.79:0/1368264195 wait complete. 2024-09-10T09:39:57.247 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:39:57.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-10T09:39:58.122 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:39:58.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:57 smithi079 ceph-mon[27592]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:58.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:57 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/1368264195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:57 smithi135 ceph-mon[33411]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:39:58.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:57 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/1368264195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:39:59.663 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:39:59 smithi079 ceph-mon[27592]: pgmap v84: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:39:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/2242842988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 msgr2=0x7f7f38103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/2242842988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f38103d30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c009910 tx=0x7f7f2c009c20 comp rx=0 tx=0).stop 2024-09-10T09:39:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/2242842988 shutdown_connections 2024-09-10T09:39:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/2242842988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f38103d30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/2242842988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f380ff3c0 0x7f7f380ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/2242842988 >> 172.21.15.79:0/2242842988 conn(0x7f7f380fac60 msgr2=0x7f7f380fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:39:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/2242842988 shutdown_connections 2024-09-10T09:39:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/2242842988 wait complete. 2024-09-10T09:39:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.887+0000 7f7f3e1d9700 1 Processor -- start 2024-09-10T09:39:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f3e1d9700 1 -- start start 2024-09-10T09:39:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f3e1d9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f380ff3c0 0x7f7f38196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f3e1d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f381972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f3e1d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38197850 con 0x7f7f380ffd60 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f3e1d9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38197990 con 0x7f7f380ff3c0 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f381972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f381972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46282/0 (socket says 172.21.15.79:46282) 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f36ffd700 1 -- 172.21.15.79:0/1086029909 learned_addr learned my addr 172.21.15.79:0/1086029909 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f377fe700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f380ff3c0 0x7f7f38196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f36ffd700 1 -- 172.21.15.79:0/1086029909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f380ff3c0 msgr2=0x7f7f38196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f36ffd700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f380ff3c0 0x7f7f38196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f36ffd700 1 -- 172.21.15.79:0/1086029909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0095f0 con 0x7f7f380ffd60 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.888+0000 7f7f36ffd700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f381972c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00bda0 tx=0x7f7f2c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.889+0000 7f7f34ff9700 1 -- 172.21.15.79:0/1086029909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f2c01d070 con 0x7f7f380ffd60 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.889+0000 7f7f34ff9700 1 -- 172.21.15.79:0/1086029909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f2c00f460 con 0x7f7f380ffd60 2024-09-10T09:39:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.889+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3819fdf0 con 0x7f7f380ffd60 2024-09-10T09:39:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.889+0000 7f7f34ff9700 1 -- 172.21.15.79:0/1086029909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f2c017630 con 0x7f7f380ffd60 2024-09-10T09:39:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.889+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f381a01a0 con 0x7f7f380ffd60 2024-09-10T09:39:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.890+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f38107730 con 0x7f7f380ffd60 2024-09-10T09:39:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.890+0000 7f7f34ff9700 1 -- 172.21.15.79:0/1086029909 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f7f2c00fab0 con 0x7f7f380ffd60 2024-09-10T09:39:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.891+0000 7f7f34ff9700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f7f2006de80 0x7f7f20070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:39:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.891+0000 7f7f34ff9700 1 -- 172.21.15.79:0/1086029909 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f7f2c08eee0 con 0x7f7f380ffd60 2024-09-10T09:39:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.891+0000 7f7f377fe700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f7f2006de80 0x7f7f20070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:39:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.891+0000 7f7f377fe700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f7f2006de80 0x7f7f20070330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800ac50 tx=0x7f7f2800a380 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:39:59.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:39:59.896+0000 7f7f34ff9700 1 -- 172.21.15.79:0/1086029909 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f7f2c058870 con 0x7f7f380ffd60 2024-09-10T09:39:59.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:39:59 smithi135 ceph-mon[33411]: pgmap v84: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:00.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:00.121+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f38061190 con 0x7f7f2006de80 2024-09-10T09:40:00.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:00 smithi079 ceph-mon[27592]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:00.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:00 smithi079 ceph-mon[27592]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:00.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:00 smithi079 ceph-mon[27592]: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:00.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:00 smithi135 ceph-mon[33411]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:00.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:00 smithi135 ceph-mon[33411]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:00.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:00 smithi135 ceph-mon[33411]: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:01.876 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:01 smithi079 ceph-mon[27592]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:01.876 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:01 smithi079 ceph-mon[27592]: pgmap v85: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:01.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.904+0000 7f7f34ff9700 1 -- 172.21.15.79:0/1086029909 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5393 (secure 0 0 0) 0x7f7f38061190 con 0x7f7f2006de80 2024-09-10T09:40:01.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f7f2006de80 msgr2=0x7f7f20070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f7f2006de80 0x7f7f20070330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800ac50 tx=0x7f7f2800a380 comp rx=0 tx=0).stop 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 msgr2=0x7f7f381972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f381972c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00bda0 tx=0x7f7f2c00bdd0 comp rx=0 tx=0).stop 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 shutdown_connections 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f7f2006de80 0x7f7f20070330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f380ff3c0 0x7f7f38196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 --2- 172.21.15.79:0/1086029909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f380ffd60 0x7f7f381972c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 >> 172.21.15.79:0/1086029909 conn(0x7f7f380fac60 msgr2=0x7f7f380fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 shutdown_connections 2024-09-10T09:40:01.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:01.907+0000 7f7f3e1d9700 1 -- 172.21.15.79:0/1086029909 wait complete. 2024-09-10T09:40:01.918 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:40:01.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:01 smithi135 ceph-mon[33411]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:01.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:01 smithi135 ceph-mon[33411]: pgmap v85: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:02.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch ps' 2024-09-10T09:40:02.784 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:40:02.904 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:02 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:40:02.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:02 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:40:03.937 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:03 smithi079 ceph-mon[27592]: pgmap v86: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:03.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:03 smithi135 ceph-mon[33411]: pgmap v86: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:04.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 -- 172.21.15.79:0/3395198771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 msgr2=0x7fca08104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/3395198771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08104500 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009910 tx=0x7fc9fc009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 -- 172.21.15.79:0/3395198771 shutdown_connections 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/3395198771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca080ffbd0 0x7fca08100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/3395198771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08104500 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 -- 172.21.15.79:0/3395198771 >> 172.21.15.79:0/3395198771 conn(0x7fca08075130 msgr2=0x7fca08075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 -- 172.21.15.79:0/3395198771 shutdown_connections 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.607+0000 7fca0e6a3700 1 -- 172.21.15.79:0/3395198771 wait complete. 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.608+0000 7fca0e6a3700 1 Processor -- start 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.608+0000 7fca0e6a3700 1 -- start start 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.608+0000 7fca0e6a3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca080ffbd0 0x7fca08195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.608+0000 7fca0e6a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.608+0000 7fca0e6a3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08196a50 con 0x7fca08104130 2024-09-10T09:40:04.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.608+0000 7fca0e6a3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0819a7e0 con 0x7fca080ffbd0 2024-09-10T09:40:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.608+0000 7fca077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca07fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca080ffbd0 0x7fca08195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca077fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53220/0 (socket says 172.21.15.79:53220) 2024-09-10T09:40:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca077fe700 1 -- 172.21.15.79:0/2647403376 learned_addr learned my addr 172.21.15.79:0/2647403376 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca077fe700 1 -- 172.21.15.79:0/2647403376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca080ffbd0 msgr2=0x7fca08195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca077fe700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca080ffbd0 0x7fca08195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:04.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca077fe700 1 -- 172.21.15.79:0/2647403376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc0095f0 con 0x7fca08104130 2024-09-10T09:40:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca077fe700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08196370 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d8d0 tx=0x7fc9f800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:04.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca057fa700 1 -- 172.21.15.79:0/2647403376 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f80098a0 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca057fa700 1 -- 172.21.15.79:0/2647403376 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9f8010460 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca057fa700 1 -- 172.21.15.79:0/2647403376 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f800f5f0 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0819aac0 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.609+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0819b010 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.610+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0804f2a0 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.611+0000 7fca057fa700 1 -- 172.21.15.79:0/2647403376 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fc9f8009a00 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.611+0000 7fca057fa700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc9f006de80 0x7fc9f0070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.612+0000 7fca07fff700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc9f006de80 0x7fc9f0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.612+0000 7fca057fa700 1 -- 172.21.15.79:0/2647403376 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fc9f808d8b0 con 0x7fca08104130 2024-09-10T09:40:04.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.612+0000 7fca07fff700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc9f006de80 0x7fc9f0070330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc000c00 tx=0x7fc9fc01a040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:04.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.616+0000 7fca057fa700 1 -- 172.21.15.79:0/2647403376 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fc9f8057240 con 0x7fca08104130 2024-09-10T09:40:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.825+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fca0819b360 con 0x7fc9f006de80 2024-09-10T09:40:04.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.834+0000 7fca057fa700 1 -- 172.21.15.79:0/2647403376 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fca0819b360 con 0x7fc9f006de80 2024-09-10T09:40:04.836 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:40:04.836 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (78s) 48s ago 11m 15.5M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (12m) 48s ago 12m 7852k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (11m) 107s ago 11m 7734k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (12m) 48s ago 12m 6669k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (11m) 107s ago 11m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (56s) 48s ago 11m 45.8M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (6m) 48s ago 6m 14.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (6m) 48s ago 6m 97.7M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (6m) 107s ago 6m 154M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (6m) 107s ago 6m 18.2M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (3m) 48s ago 13m 504M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (2m) 107s ago 11m 440M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (13m) 48s ago 13m 55.2M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:40:04.837 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (10m) 107s ago 10m 43.6M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (115s) 48s ago 12m 8539k - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (110s) 107s ago 11m 3435k - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (10m) 48s ago 10m 254M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (9m) 48s ago 9m 262M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (9m) 48s ago 9m 224M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (8m) 107s ago 8m 289M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (8m) 107s ago 8m 254M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (8m) 107s ago 8m 251M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:40:04.838 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (94s) 48s ago 11m 64.1M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:40:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc9f006de80 msgr2=0x7fc9f0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc9f006de80 0x7fc9f0070330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc000c00 tx=0x7fc9fc01a040 comp rx=0 tx=0).stop 2024-09-10T09:40:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 msgr2=0x7fca08196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08196370 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800d8d0 tx=0x7fc9f800dbe0 comp rx=0 tx=0).stop 2024-09-10T09:40:04.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 shutdown_connections 2024-09-10T09:40:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fc9f006de80 0x7fc9f0070330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca080ffbd0 0x7fca08195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 --2- 172.21.15.79:0/2647403376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca08104130 0x7fca08196370 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 >> 172.21.15.79:0/2647403376 conn(0x7fca08075130 msgr2=0x7fca080685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 shutdown_connections 2024-09-10T09:40:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:04.836+0000 7fca0e6a3700 1 -- 172.21.15.79:0/2647403376 wait complete. 2024-09-10T09:40:05.464 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T09:40:05.465 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:40:05.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-10T09:40:05.663 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:40:06.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:05 smithi079 ceph-mon[27592]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:06.114 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:05 smithi079 ceph-mon[27592]: pgmap v87: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:05 smithi135 ceph-mon[33411]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:05 smithi135 ceph-mon[33411]: pgmap v87: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:07.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 -- 172.21.15.79:0/1711168224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ffde0 msgr2=0x7fbadc103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:07.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/1711168224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ffde0 0x7fbadc103db0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009910 tx=0x7fbacc009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:07.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 -- 172.21.15.79:0/1711168224 shutdown_connections 2024-09-10T09:40:07.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/1711168224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ffde0 0x7fbadc103db0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:07.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/1711168224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbadc0ff440 0x7fbadc0ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:07.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 -- 172.21.15.79:0/1711168224 >> 172.21.15.79:0/1711168224 conn(0x7fbadc0face0 msgr2=0x7fbadc0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:07.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 -- 172.21.15.79:0/1711168224 shutdown_connections 2024-09-10T09:40:07.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.334+0000 7fbae0bc4700 1 -- 172.21.15.79:0/1711168224 wait complete. 2024-09-10T09:40:07.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.335+0000 7fbae0bc4700 1 Processor -- start 2024-09-10T09:40:07.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.335+0000 7fbae0bc4700 1 -- start start 2024-09-10T09:40:07.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.335+0000 7fbae0bc4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ff440 0x7fbadc100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:07.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.335+0000 7fbae0bc4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbadc0ffde0 0x7fbadc101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.335+0000 7fbae0bc4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc1018d0 con 0x7fbadc0ff440 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.335+0000 7fbae0bc4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc101a10 con 0x7fbadc0ffde0 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbada59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ff440 0x7fbadc100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbada59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ff440 0x7fbadc100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53242/0 (socket says 172.21.15.79:53242) 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbada59c700 1 -- 172.21.15.79:0/2010443134 learned_addr learned my addr 172.21.15.79:0/2010443134 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbada59c700 1 -- 172.21.15.79:0/2010443134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbadc0ffde0 msgr2=0x7fbadc101390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbada59c700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbadc0ffde0 0x7fbadc101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbada59c700 1 -- 172.21.15.79:0/2010443134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0095f0 con 0x7fbadc0ff440 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbada59c700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ff440 0x7fbadc100e50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbac400b4b0 tx=0x7fbac400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbad37fe700 1 -- 172.21.15.79:0/2010443134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac4011800 con 0x7fbadc0ff440 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbad37fe700 1 -- 172.21.15.79:0/2010443134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbac4011e20 con 0x7fbadc0ff440 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbadc1a2120 con 0x7fbadc0ff440 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbad37fe700 1 -- 172.21.15.79:0/2010443134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbac400f2e0 con 0x7fbadc0ff440 2024-09-10T09:40:07.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.336+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbadc1a2530 con 0x7fbadc0ff440 2024-09-10T09:40:07.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.337+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbadc04f2a0 con 0x7fbadc0ff440 2024-09-10T09:40:07.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.338+0000 7fbad37fe700 1 -- 172.21.15.79:0/2010443134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fbac4010380 con 0x7fbadc0ff440 2024-09-10T09:40:07.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.338+0000 7fbad37fe700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbac806de80 0x7fbac8070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.338+0000 7fbad37fe700 1 -- 172.21.15.79:0/2010443134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fbac408d5e0 con 0x7fbadc0ff440 2024-09-10T09:40:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.338+0000 7fbad9d9b700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbac806de80 0x7fbac8070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:07.341 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.339+0000 7fbad9d9b700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbac806de80 0x7fbac8070330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00b5c0 tx=0x7fbacc005960 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:07.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.343+0000 7fbad37fe700 1 -- 172.21.15.79:0/2010443134 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fbac4057020 con 0x7fbadc0ff440 2024-09-10T09:40:07.541 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.539+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fbadc102380 con 0x7fbadc0ff440 2024-09-10T09:40:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.544+0000 7fbad37fe700 1 -- 172.21.15.79:0/2010443134 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v45)=0 v45) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbadc102380 con 0x7fbadc0ff440 2024-09-10T09:40:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbac806de80 msgr2=0x7fbac8070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbac806de80 0x7fbac8070330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00b5c0 tx=0x7fbacc005960 comp rx=0 tx=0).stop 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ff440 msgr2=0x7fbadc100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ff440 0x7fbadc100e50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbac400b4b0 tx=0x7fbac400b870 comp rx=0 tx=0).stop 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 shutdown_connections 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbadc0ff440 0x7fbadc100e50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fbac806de80 0x7fbac8070330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 --2- 172.21.15.79:0/2010443134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbadc0ffde0 0x7fbadc101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 >> 172.21.15.79:0/2010443134 conn(0x7fbadc0face0 msgr2=0x7fbadc1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 shutdown_connections 2024-09-10T09:40:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:07.546+0000 7fbae0bc4700 1 -- 172.21.15.79:0/2010443134 wait complete. 2024-09-10T09:40:08.192 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:07 smithi079 ceph-mon[27592]: pgmap v88: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:08.193 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:07 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2010443134' entity='client.admin' 2024-09-10T09:40:08.193 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:07 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:08.193 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:07 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:08.193 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:07 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:08.193 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:07 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:08.214 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T09:40:08.216 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:40:08.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-10T09:40:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:07 smithi135 ceph-mon[33411]: pgmap v88: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:07 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2010443134' entity='client.admin' 2024-09-10T09:40:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:07 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:08.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:07 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:08.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:07 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:08.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:07 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:08.416 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:40:09.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:09 smithi079 ceph-mon[27592]: pgmap v89: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:09.864 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:09 smithi135 ceph-mon[33411]: pgmap v89: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:10.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 -- 172.21.15.79:0/3888312084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ff350 msgr2=0x7f34a80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:10.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 --2- 172.21.15.79:0/3888312084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ff350 0x7f34a80ff720 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f349c009910 tx=0x7f349c009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 -- 172.21.15.79:0/3888312084 shutdown_connections 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 --2- 172.21.15.79:0/3888312084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a80ffc60 0x7f34a810a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 --2- 172.21.15.79:0/3888312084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ff350 0x7f34a80ff720 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 -- 172.21.15.79:0/3888312084 >> 172.21.15.79:0/3888312084 conn(0x7f34a80748b0 msgr2=0x7f34a8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 -- 172.21.15.79:0/3888312084 shutdown_connections 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.208+0000 7f34aed57700 1 -- 172.21.15.79:0/3888312084 wait complete. 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34aed57700 1 Processor -- start 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34aed57700 1 -- start start 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34aed57700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a80ff350 0x7f34a8195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34aed57700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ffc60 0x7f34a8196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34aed57700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8196be0 con 0x7f34a80ffc60 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34aed57700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a819a970 con 0x7f34a80ff350 2024-09-10T09:40:10.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ffc60 0x7f34a8196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:10.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34a7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ffc60 0x7f34a8196500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53258/0 (socket says 172.21.15.79:53258) 2024-09-10T09:40:10.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34a7fff700 1 -- 172.21.15.79:0/2106291744 learned_addr learned my addr 172.21.15.79:0/2106291744 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:10.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.209+0000 7f34acaf3700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a80ff350 0x7f34a8195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:10.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34a7fff700 1 -- 172.21.15.79:0/2106291744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a80ff350 msgr2=0x7f34a8195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:10.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34a7fff700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a80ff350 0x7f34a8195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:10.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34a7fff700 1 -- 172.21.15.79:0/2106291744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0095f0 con 0x7f34a80ffc60 2024-09-10T09:40:10.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34a7fff700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ffc60 0x7f34a8196500 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f349400b4b0 tx=0x7f349400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:10.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34a5ffb700 1 -- 172.21.15.79:0/2106291744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3494011800 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a819ac50 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34a5ffb700 1 -- 172.21.15.79:0/2106291744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3494011e20 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34a5ffb700 1 -- 172.21.15.79:0/2106291744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349400f2e0 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.210+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a819b1a0 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.211+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a8107dd0 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.212+0000 7f34a5ffb700 1 -- 172.21.15.79:0/2106291744 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f3494010380 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.212+0000 7f34a5ffb700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f349806de80 0x7f3498070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.212+0000 7f34a5ffb700 1 -- 172.21.15.79:0/2106291744 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f349408d630 con 0x7f34a80ffc60 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.212+0000 7f34acaf3700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f349806de80 0x7f3498070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:10.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.213+0000 7f34acaf3700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f349806de80 0x7f3498070330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f349c006010 tx=0x7f349c01a040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:10.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.217+0000 7f34a5ffb700 1 -- 172.21.15.79:0/2106291744 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f3494056f40 con 0x7f34a80ffc60 2024-09-10T09:40:10.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.419+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f34a804f2a0 con 0x7f34a80ffc60 2024-09-10T09:40:10.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.420+0000 7f34a5ffb700 1 -- 172.21.15.79:0/2106291744 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v45)=0 v45) v1 ==== 155+0+0 (secure 0 0 0) 0x7f349405a600 con 0x7f34a80ffc60 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f349806de80 msgr2=0x7f3498070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f349806de80 0x7f3498070330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f349c006010 tx=0x7f349c01a040 comp rx=0 tx=0).stop 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ffc60 msgr2=0x7f34a8196500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ffc60 0x7f34a8196500 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f349400b4b0 tx=0x7f349400b7c0 comp rx=0 tx=0).stop 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 shutdown_connections 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f349806de80 0x7f3498070330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34a80ff350 0x7f34a8195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 --2- 172.21.15.79:0/2106291744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34a80ffc60 0x7f34a8196500 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.422+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 >> 172.21.15.79:0/2106291744 conn(0x7f34a80748b0 msgr2=0x7f34a8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:10.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.423+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 shutdown_connections 2024-09-10T09:40:10.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:10.423+0000 7f34aed57700 1 -- 172.21.15.79:0/2106291744 wait complete. 2024-09-10T09:40:11.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-10T09:40:11.286 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:40:11.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:11 smithi079 ceph-mon[27592]: pgmap v90: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:12.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:11 smithi135 ceph-mon[33411]: pgmap v90: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 -- 172.21.15.79:0/4208254797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ff3c0 msgr2=0x7f1f080ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/4208254797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ff3c0 0x7f1f080ff790 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009910 tx=0x7f1f04009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 -- 172.21.15.79:0/4208254797 shutdown_connections 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/4208254797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f080ffd60 0x7f1f08103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/4208254797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ff3c0 0x7f1f080ff790 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 -- 172.21.15.79:0/4208254797 >> 172.21.15.79:0/4208254797 conn(0x7f1f080fac60 msgr2=0x7f1f080fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 -- 172.21.15.79:0/4208254797 shutdown_connections 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.933+0000 7f1f0f35a700 1 -- 172.21.15.79:0/4208254797 wait complete. 2024-09-10T09:40:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0f35a700 1 Processor -- start 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0f35a700 1 -- start start 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0f35a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f080ff3c0 0x7f1f08194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0f35a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ffd60 0x7f1f081953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0f35a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08195ab0 con 0x7f1f080ffd60 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0f35a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08199840 con 0x7f1f080ff3c0 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0c8f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ffd60 0x7f1f081953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0c8f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ffd60 0x7f1f081953d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39558/0 (socket says 172.21.15.79:39558) 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0c8f5700 1 -- 172.21.15.79:0/3219428422 learned_addr learned my addr 172.21.15.79:0/3219428422 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0d0f6700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f080ff3c0 0x7f1f08194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0c8f5700 1 -- 172.21.15.79:0/3219428422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f080ff3c0 msgr2=0x7f1f08194e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0c8f5700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f080ff3c0 0x7f1f08194e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.934+0000 7f1f0c8f5700 1 -- 172.21.15.79:0/3219428422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040095f0 con 0x7f1f080ffd60 2024-09-10T09:40:12.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.935+0000 7f1f0c8f5700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ffd60 0x7f1f081953d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b480 tx=0x7f1efc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:12.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.935+0000 7f1efa7fc700 1 -- 172.21.15.79:0/3219428422 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1efc0118c0 con 0x7f1f080ffd60 2024-09-10T09:40:12.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.935+0000 7f1efa7fc700 1 -- 172.21.15.79:0/3219428422 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1efc010380 con 0x7f1f080ffd60 2024-09-10T09:40:12.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.935+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f08199b20 con 0x7f1f080ffd60 2024-09-10T09:40:12.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.935+0000 7f1efa7fc700 1 -- 172.21.15.79:0/3219428422 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1efc00f4f0 con 0x7f1f080ffd60 2024-09-10T09:40:12.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.935+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0819a070 con 0x7f1f080ffd60 2024-09-10T09:40:12.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.936+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f081076d0 con 0x7f1f080ffd60 2024-09-10T09:40:12.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.936+0000 7f1efa7fc700 1 -- 172.21.15.79:0/3219428422 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f1efc0104f0 con 0x7f1f080ffd60 2024-09-10T09:40:12.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.937+0000 7f1efa7fc700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1ef406de80 0x7f1ef4070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:12.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.937+0000 7f1efa7fc700 1 -- 172.21.15.79:0/3219428422 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f1efc08d660 con 0x7f1f080ffd60 2024-09-10T09:40:12.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.937+0000 7f1f0d0f6700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1ef406de80 0x7f1ef4070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:12.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.937+0000 7f1f0d0f6700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1ef406de80 0x7f1ef4070330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f04006010 tx=0x7f1f0401a040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:12.942 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:12.941+0000 7f1efa7fc700 1 -- 172.21.15.79:0/3219428422 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f1efc056ff0 con 0x7f1f080ffd60 2024-09-10T09:40:13.141 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.140+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f1f0804f2a0 con 0x7f1f080ffd60 2024-09-10T09:40:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.141+0000 7f1efa7fc700 1 -- 172.21.15.79:0/3219428422 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v45)=0 v45) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1efc05a6b0 con 0x7f1f080ffd60 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1ef406de80 msgr2=0x7f1ef4070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1ef406de80 0x7f1ef4070330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f04006010 tx=0x7f1f0401a040 comp rx=0 tx=0).stop 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ffd60 msgr2=0x7f1f081953d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ffd60 0x7f1f081953d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b480 tx=0x7f1efc00b840 comp rx=0 tx=0).stop 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 shutdown_connections 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1ef406de80 0x7f1ef4070330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f080ff3c0 0x7f1f08194e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 --2- 172.21.15.79:0/3219428422 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f080ffd60 0x7f1f081953d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:13.144 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 >> 172.21.15.79:0/3219428422 conn(0x7f1f080fac60 msgr2=0x7f1f080fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 shutdown_connections 2024-09-10T09:40:13.145 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:13.143+0000 7f1f0f35a700 1 -- 172.21.15.79:0/3219428422 wait complete. 2024-09-10T09:40:13.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-10T09:40:14.021 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:40:14.141 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:13 smithi079 ceph-mon[27592]: pgmap v91: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:14.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:13 smithi135 ceph-mon[33411]: pgmap v91: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:15.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 -- 172.21.15.79:0/2518365343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ffd60 msgr2=0x7f5ca4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 --2- 172.21.15.79:0/2518365343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ffd60 0x7f5ca4103d30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009910 tx=0x7f5c98009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 -- 172.21.15.79:0/2518365343 shutdown_connections 2024-09-10T09:40:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 --2- 172.21.15.79:0/2518365343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ffd60 0x7f5ca4103d30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 --2- 172.21.15.79:0/2518365343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca40ff3c0 0x7f5ca40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 -- 172.21.15.79:0/2518365343 >> 172.21.15.79:0/2518365343 conn(0x7f5ca40fac80 msgr2=0x7f5ca40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 -- 172.21.15.79:0/2518365343 shutdown_connections 2024-09-10T09:40:15.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.779+0000 7f5caa171700 1 -- 172.21.15.79:0/2518365343 wait complete. 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.780+0000 7f5caa171700 1 Processor -- start 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.780+0000 7f5caa171700 1 -- start start 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5caa171700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ff3c0 0x7f5ca4196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5caa171700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca40ffd60 0x7f5ca41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5caa171700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4197850 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5caa171700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca4197990 con 0x7f5ca40ffd60 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ff3c0 0x7f5ca4196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ff3c0 0x7f5ca4196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39572/0 (socket says 172.21.15.79:39572) 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca37fe700 1 -- 172.21.15.79:0/290993487 learned_addr learned my addr 172.21.15.79:0/290993487 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:15.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca2ffd700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca40ffd60 0x7f5ca41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca37fe700 1 -- 172.21.15.79:0/290993487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca40ffd60 msgr2=0x7f5ca41972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca37fe700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca40ffd60 0x7f5ca41972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca37fe700 1 -- 172.21.15.79:0/290993487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980095f0 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca37fe700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ff3c0 0x7f5ca4196d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c930 tx=0x7f5c9400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca0ff9700 1 -- 172.21.15.79:0/290993487 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c94007ad0 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca0ff9700 1 -- 172.21.15.79:0/290993487 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c94007c30 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca419fdf0 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5ca0ff9700 1 -- 172.21.15.79:0/290993487 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c94018610 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.781+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca41a0200 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.784 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.782+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca4107730 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.783+0000 7f5ca0ff9700 1 -- 172.21.15.79:0/290993487 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f5c9400f450 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.783+0000 7f5ca0ff9700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f5c8c06de80 0x7f5c8c070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.783+0000 7f5ca0ff9700 1 -- 172.21.15.79:0/290993487 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f5c9408dbe0 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.784+0000 7f5ca2ffd700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f5c8c06de80 0x7f5c8c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:15.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.784+0000 7f5ca2ffd700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f5c8c06de80 0x7f5c8c070330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c98006010 tx=0x7f5c9801a040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:15.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.788+0000 7f5ca0ff9700 1 -- 172.21.15.79:0/290993487 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f5c94057570 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.987+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f5ca404f2a0 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.989 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.988+0000 7f5ca0ff9700 1 -- 172.21.15.79:0/290993487 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v45)=0 v45) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5c9405ac30 con 0x7f5ca40ff3c0 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f5c8c06de80 msgr2=0x7f5c8c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f5c8c06de80 0x7f5c8c070330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c98006010 tx=0x7f5c9801a040 comp rx=0 tx=0).stop 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ff3c0 msgr2=0x7f5ca4196d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ff3c0 0x7f5ca4196d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400c930 tx=0x7f5c9400ccf0 comp rx=0 tx=0).stop 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 shutdown_connections 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ca40ff3c0 0x7f5ca4196d80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f5c8c06de80 0x7f5c8c070330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 --2- 172.21.15.79:0/290993487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca40ffd60 0x7f5ca41972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:15.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 >> 172.21.15.79:0/290993487 conn(0x7f5ca40fac80 msgr2=0x7f5ca40fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:15.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 shutdown_connections 2024-09-10T09:40:15.992 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:15.990+0000 7f5caa171700 1 -- 172.21.15.79:0/290993487 wait complete. 2024-09-10T09:40:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:15 smithi079 ceph-mon[27592]: pgmap v92: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:16.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:15 smithi135 ceph-mon[33411]: pgmap v92: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:16.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-10T09:40:16.817 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:40:17.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:17 smithi079 ceph-mon[27592]: pgmap v93: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:17.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:17 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:40:18.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:17 smithi135 ceph-mon[33411]: pgmap v93: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:18.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:17 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:40:18.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 -- 172.21.15.79:0/1012277378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 msgr2=0x7f5170103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:18.544 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 --2- 172.21.15.79:0/1012277378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f5170103d30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5158009910 tx=0x7f5158009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 -- 172.21.15.79:0/1012277378 shutdown_connections 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 --2- 172.21.15.79:0/1012277378 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f5170103d30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 --2- 172.21.15.79:0/1012277378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51700ff3c0 0x7f51700ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 -- 172.21.15.79:0/1012277378 >> 172.21.15.79:0/1012277378 conn(0x7f51700fac60 msgr2=0x7f51700fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 -- 172.21.15.79:0/1012277378 shutdown_connections 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.543+0000 7f51748fe700 1 -- 172.21.15.79:0/1012277378 wait complete. 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.544+0000 7f51748fe700 1 Processor -- start 2024-09-10T09:40:18.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.544+0000 7f51748fe700 1 -- start start 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.544+0000 7f51748fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51700ff3c0 0x7f5170195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.544+0000 7f51748fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f51701964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.544+0000 7f51748fe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5170196bb0 con 0x7f51700ffd60 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.544+0000 7f51748fe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517019a940 con 0x7f51700ff3c0 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.544+0000 7f5165d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f51701964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5165d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f51701964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:39588/0 (socket says 172.21.15.79:39588) 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5165d9b700 1 -- 172.21.15.79:0/3385307902 learned_addr learned my addr 172.21.15.79:0/3385307902 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f516e59c700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51700ff3c0 0x7f5170195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5165d9b700 1 -- 172.21.15.79:0/3385307902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51700ff3c0 msgr2=0x7f5170195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5165d9b700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51700ff3c0 0x7f5170195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5165d9b700 1 -- 172.21.15.79:0/3385307902 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580095f0 con 0x7f51700ffd60 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f516e59c700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51700ff3c0 0x7f5170195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:40:18.547 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5165d9b700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f51701964d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f515800bda0 tx=0x7f515800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:18.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5167fff700 1 -- 172.21.15.79:0/3385307902 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515801d070 con 0x7f51700ffd60 2024-09-10T09:40:18.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517019abc0 con 0x7f51700ffd60 2024-09-10T09:40:18.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5167fff700 1 -- 172.21.15.79:0/3385307902 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5158004fb0 con 0x7f51700ffd60 2024-09-10T09:40:18.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f5167fff700 1 -- 172.21.15.79:0/3385307902 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f515800f480 con 0x7f51700ffd60 2024-09-10T09:40:18.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.545+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517019b0b0 con 0x7f51700ffd60 2024-09-10T09:40:18.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.546+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517004f2a0 con 0x7f51700ffd60 2024-09-10T09:40:18.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.547+0000 7f5167fff700 1 -- 172.21.15.79:0/3385307902 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f5158004af0 con 0x7f51700ffd60 2024-09-10T09:40:18.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.547+0000 7f5167fff700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f515c06de80 0x7f515c070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:18.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.547+0000 7f5167fff700 1 -- 172.21.15.79:0/3385307902 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f515808f030 con 0x7f51700ffd60 2024-09-10T09:40:18.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.548+0000 7f516e59c700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f515c06de80 0x7f515c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:18.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.548+0000 7f516e59c700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f515c06de80 0x7f515c070330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5160007900 tx=0x7f5160008040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:18.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.552+0000 7f5167fff700 1 -- 172.21.15.79:0/3385307902 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f51580589f0 con 0x7f51700ffd60 2024-09-10T09:40:18.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.772+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}) v1 -- 0x7f517019b390 con 0x7f515c06de80 2024-09-10T09:40:18.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.777+0000 7f5167fff700 1 -- 172.21.15.79:0/3385307902 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f517019b390 con 0x7f515c06de80 2024-09-10T09:40:18.778 INFO:teuthology.orchestra.run.smithi079.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f515c06de80 msgr2=0x7f515c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f515c06de80 0x7f515c070330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5160007900 tx=0x7f5160008040 comp rx=0 tx=0).stop 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 msgr2=0x7f51701964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f51701964d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f515800bda0 tx=0x7f515800be80 comp rx=0 tx=0).stop 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 shutdown_connections 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f515c06de80 0x7f515c070330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51700ff3c0 0x7f5170195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 --2- 172.21.15.79:0/3385307902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51700ffd60 0x7f51701964d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.779+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 >> 172.21.15.79:0/3385307902 conn(0x7f51700fac60 msgr2=0x7f5170103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.780+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 shutdown_connections 2024-09-10T09:40:18.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:18.780+0000 7f51748fe700 1 -- 172.21.15.79:0/3385307902 wait complete. 2024-09-10T09:40:19.448 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-10T09:40:19.448 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:40:19.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-10T09:40:19.668 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: pgmap v94: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:20.034 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:19 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: pgmap v94: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:20.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:19 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:21.054 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:20 smithi079 ceph-mon[27592]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:40:21.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:20 smithi135 ceph-mon[33411]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T09:40:21.960 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:21 smithi079 ceph-mon[27592]: pgmap v95: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 -- 172.21.15.79:0/3014123593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101d30 msgr2=0x7ff6e010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/3014123593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101d30 0x7ff6e010a230 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009910 tx=0x7ff6d0009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 -- 172.21.15.79:0/3014123593 shutdown_connections 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/3014123593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101d30 0x7ff6e010a230 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/3014123593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6e0101420 0x7ff6e01017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 -- 172.21.15.79:0/3014123593 >> 172.21.15.79:0/3014123593 conn(0x7ff6e00fac80 msgr2=0x7ff6e00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 -- 172.21.15.79:0/3014123593 shutdown_connections 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.063+0000 7ff6e66f6700 1 -- 172.21.15.79:0/3014123593 wait complete. 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6e66f6700 1 Processor -- start 2024-09-10T09:40:22.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6e66f6700 1 -- start start 2024-09-10T09:40:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6e66f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101420 0x7ff6e0195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6e66f6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6e0101d30 0x7ff6e01963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6e66f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0196a80 con 0x7ff6e0101420 2024-09-10T09:40:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6e66f6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e019a810 con 0x7ff6e0101d30 2024-09-10T09:40:22.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101420 0x7ff6e0195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101420 0x7ff6e0195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40422/0 (socket says 172.21.15.79:40422) 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.064+0000 7ff6dffff700 1 -- 172.21.15.79:0/2342441381 learned_addr learned my addr 172.21.15.79:0/2342441381 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6dffff700 1 -- 172.21.15.79:0/2342441381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6e0101d30 msgr2=0x7ff6e01963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6dffff700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6e0101d30 0x7ff6e01963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6dffff700 1 -- 172.21.15.79:0/2342441381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d00095f0 con 0x7ff6e0101420 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6dffff700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101420 0x7ff6e0195e60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800d8d0 tx=0x7ff6c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6dd7fa700 1 -- 172.21.15.79:0/2342441381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c8009940 con 0x7ff6e0101420 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6dd7fa700 1 -- 172.21.15.79:0/2342441381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6c8010460 con 0x7ff6e0101420 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e019aaf0 con 0x7ff6e0101420 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6dd7fa700 1 -- 172.21.15.79:0/2342441381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c800f5f0 con 0x7ff6e0101420 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.065+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e019b040 con 0x7ff6e0101420 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.066+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e01078a0 con 0x7ff6e0101420 2024-09-10T09:40:22.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.066+0000 7ff6dd7fa700 1 -- 172.21.15.79:0/2342441381 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7ff6c80105d0 con 0x7ff6e0101420 2024-09-10T09:40:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.067+0000 7ff6dd7fa700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff6cc06de80 0x7ff6cc070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.067+0000 7ff6dd7fa700 1 -- 172.21.15.79:0/2342441381 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7ff6c808d9d0 con 0x7ff6e0101420 2024-09-10T09:40:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.067+0000 7ff6df7fe700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff6cc06de80 0x7ff6cc070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.067+0000 7ff6df7fe700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff6cc06de80 0x7ff6cc070330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b5c0 tx=0x7ff6d0005960 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:22.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.072+0000 7ff6dd7fa700 1 -- 172.21.15.79:0/2342441381 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7ff6c8057360 con 0x7ff6e0101420 2024-09-10T09:40:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:21 smithi135 ceph-mon[33411]: pgmap v95: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.312+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6e019b2b0 con 0x7ff6cc06de80 2024-09-10T09:40:22.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.313+0000 7ff6dd7fa700 1 -- 172.21.15.79:0/2342441381 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff6e019b2b0 con 0x7ff6cc06de80 2024-09-10T09:40:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff6cc06de80 msgr2=0x7ff6cc070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff6cc06de80 0x7ff6cc070330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b5c0 tx=0x7ff6d0005960 comp rx=0 tx=0).stop 2024-09-10T09:40:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101420 msgr2=0x7ff6e0195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101420 0x7ff6e0195e60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800d8d0 tx=0x7ff6c800dc90 comp rx=0 tx=0).stop 2024-09-10T09:40:22.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 shutdown_connections 2024-09-10T09:40:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6e0101420 0x7ff6e0195e60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7ff6cc06de80 0x7ff6cc070330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 --2- 172.21.15.79:0/2342441381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6e0101d30 0x7ff6e01963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 >> 172.21.15.79:0/2342441381 conn(0x7ff6e00fac80 msgr2=0x7ff6e01049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 shutdown_connections 2024-09-10T09:40:22.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.315+0000 7ff6e66f6700 1 -- 172.21.15.79:0/2342441381 wait complete. 2024-09-10T09:40:22.326 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:40:22.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 -- 172.21.15.79:0/549456241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 msgr2=0x7fb6bc103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 --2- 172.21.15.79:0/549456241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc103d30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009910 tx=0x7fb6ac009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 -- 172.21.15.79:0/549456241 shutdown_connections 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 --2- 172.21.15.79:0/549456241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc103d30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 --2- 172.21.15.79:0/549456241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6bc0ff3c0 0x7fb6bc0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 -- 172.21.15.79:0/549456241 >> 172.21.15.79:0/549456241 conn(0x7fb6bc0fac80 msgr2=0x7fb6bc0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 -- 172.21.15.79:0/549456241 shutdown_connections 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 -- 172.21.15.79:0/549456241 wait complete. 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.423+0000 7fb6c1949700 1 Processor -- start 2024-09-10T09:40:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c1949700 1 -- start start 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c1949700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6bc0ff3c0 0x7fb6bc195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c1949700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c1949700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc196ab0 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c1949700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc19a840 con 0x7fb6bc0ff3c0 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6ba7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6ba7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc1963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40440/0 (socket says 172.21.15.79:40440) 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6ba7fc700 1 -- 172.21.15.79:0/1029170584 learned_addr learned my addr 172.21.15.79:0/1029170584 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6baffd700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6bc0ff3c0 0x7fb6bc195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6ba7fc700 1 -- 172.21.15.79:0/1029170584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6bc0ff3c0 msgr2=0x7fb6bc195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6ba7fc700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6bc0ff3c0 0x7fb6bc195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6ba7fc700 1 -- 172.21.15.79:0/1029170584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0095f0 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6ba7fc700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc1963d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0092e0 tx=0x7fb6ac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c0947700 1 -- 172.21.15.79:0/1029170584 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6ac01d070 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc19aac0 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.424+0000 7fb6c0947700 1 -- 172.21.15.79:0/1029170584 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6ac005dc0 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.425+0000 7fb6c0947700 1 -- 172.21.15.79:0/1029170584 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6ac017400 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.425+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc19afb0 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.425+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc108740 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.426+0000 7fb6c0947700 1 -- 172.21.15.79:0/1029170584 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fb6ac00f460 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.427+0000 7fb6c0947700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fb6a806de80 0x7fb6a8070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.427+0000 7fb6c0947700 1 -- 172.21.15.79:0/1029170584 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fb6ac08efd0 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.427+0000 7fb6baffd700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fb6a806de80 0x7fb6a8070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.427+0000 7fb6baffd700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fb6a806de80 0x7fb6a8070330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005950 tx=0x7fb6a40058e0 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:22.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.431+0000 7fb6c0947700 1 -- 172.21.15.79:0/1029170584 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fb6ac0588e0 con 0x7fb6bc0ffd60 2024-09-10T09:40:22.662 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.661+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6bc19b290 con 0x7fb6a806de80 2024-09-10T09:40:22.663 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.663+0000 7fb6c0947700 1 -- 172.21.15.79:0/1029170584 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fb6bc19b290 con 0x7fb6a806de80 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fb6a806de80 msgr2=0x7fb6a8070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fb6a806de80 0x7fb6a8070330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4005950 tx=0x7fb6a40058e0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 msgr2=0x7fb6bc1963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc1963d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0092e0 tx=0x7fb6ac00be20 comp rx=0 tx=0).stop 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 shutdown_connections 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fb6a806de80 0x7fb6a8070330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6bc0ff3c0 0x7fb6bc195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 --2- 172.21.15.79:0/1029170584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6bc0ffd60 0x7fb6bc1963d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 >> 172.21.15.79:0/1029170584 conn(0x7fb6bc0fac80 msgr2=0x7fb6bc0690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:22.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 shutdown_connections 2024-09-10T09:40:22.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.665+0000 7fb6c1949700 1 -- 172.21.15.79:0/1029170584 wait complete. 2024-09-10T09:40:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/2675885673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 msgr2=0x7f1fb8068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/2675885673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb8068b70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009910 tx=0x7f1fa8009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/2675885673 shutdown_connections 2024-09-10T09:40:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/2675885673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb8069140 0x7f1fb8104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/2675885673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb8068b70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/2675885673 >> 172.21.15.79:0/2675885673 conn(0x7f1fb8075130 msgr2=0x7f1fb8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/2675885673 shutdown_connections 2024-09-10T09:40:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/2675885673 wait complete. 2024-09-10T09:40:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.776+0000 7f1fbe3cb700 1 Processor -- start 2024-09-10T09:40:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fbe3cb700 1 -- start start 2024-09-10T09:40:22.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fbe3cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb80ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fbe3cb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb8069140 0x7f1fb81001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fbe3cb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8100720 con 0x7f1fb80687a0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fbe3cb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb8100860 con 0x7f1fb8069140 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb80ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fb7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb80ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40456/0 (socket says 172.21.15.79:40456) 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fb7fff700 1 -- 172.21.15.79:0/1225367905 learned_addr learned my addr 172.21.15.79:0/1225367905 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fb77fe700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb8069140 0x7f1fb81001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fb7fff700 1 -- 172.21.15.79:0/1225367905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb8069140 msgr2=0x7f1fb81001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fb7fff700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb8069140 0x7f1fb81001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.777+0000 7f1fb7fff700 1 -- 172.21.15.79:0/1225367905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80095f0 con 0x7f1fb80687a0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.778+0000 7f1fb7fff700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb80ffca0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8006010 tx=0x7f1fa800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.778+0000 7f1fb57fa700 1 -- 172.21.15.79:0/1225367905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa801d070 con 0x7f1fb80687a0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.778+0000 7f1fb57fa700 1 -- 172.21.15.79:0/1225367905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fa8004fb0 con 0x7f1fb80687a0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.778+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb8100ae0 con 0x7f1fb80687a0 2024-09-10T09:40:22.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.778+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb81a2390 con 0x7f1fb80687a0 2024-09-10T09:40:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.778+0000 7f1fb57fa700 1 -- 172.21.15.79:0/1225367905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fa8022ea0 con 0x7f1fb80687a0 2024-09-10T09:40:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.779+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb8108790 con 0x7f1fb80687a0 2024-09-10T09:40:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.780+0000 7f1fb57fa700 1 -- 172.21.15.79:0/1225367905 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f1fa8022470 con 0x7f1fb80687a0 2024-09-10T09:40:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.780+0000 7f1fb57fa700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1fa006de80 0x7f1fa0070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.780+0000 7f1fb57fa700 1 -- 172.21.15.79:0/1225367905 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f1fa808f650 con 0x7f1fb80687a0 2024-09-10T09:40:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.781+0000 7f1fb77fe700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1fa006de80 0x7f1fa0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.781+0000 7f1fb77fe700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1fa006de80 0x7f1fa0070330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005ea0 tx=0x7f1fac005e30 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:22.785+0000 7f1fb57fa700 1 -- 172.21.15.79:0/1225367905 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f1fa80591b0 con 0x7f1fb80687a0 2024-09-10T09:40:23.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.020+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fb81012e0 con 0x7f1fa006de80 2024-09-10T09:40:23.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.032+0000 7f1fb57fa700 1 -- 172.21.15.79:0/1225367905 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1fb81012e0 con 0x7f1fa006de80 2024-09-10T09:40:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:40:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (96s) 66s ago 12m 15.5M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:40:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (12m) 66s ago 12m 7852k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:40:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (11m) 2m ago 11m 7734k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (12m) 66s ago 12m 6669k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (11m) 2m ago 11m 6665k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (74s) 66s ago 12m 45.8M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (6m) 66s ago 6m 14.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (6m) 66s ago 6m 97.7M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (6m) 2m ago 6m 154M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (6m) 2m ago 6m 18.2M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (3m) 66s ago 13m 504M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (2m) 2m ago 11m 440M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (13m) 66s ago 13m 55.2M 2048M 18.2.0 dc2bc1663786 f719abe33353 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (11m) 2m ago 11m 43.6M 2048M 18.2.0 dc2bc1663786 2d2b226b197a 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (2m) 66s ago 12m 8539k - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (2m) 2m ago 11m 3435k - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:40:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (10m) 66s ago 10m 254M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:40:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (10m) 66s ago 10m 262M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:40:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (9m) 66s ago 9m 224M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:40:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (9m) 2m ago 9m 289M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:40:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (8m) 2m ago 8m 254M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:40:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (8m) 2m ago 8m 251M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:40:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (112s) 66s ago 11m 64.1M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:40:23.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1fa006de80 msgr2=0x7f1fa0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.036 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1fa006de80 0x7f1fa0070330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1fac005ea0 tx=0x7f1fac005e30 comp rx=0 tx=0).stop 2024-09-10T09:40:23.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 msgr2=0x7f1fb80ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb80ffca0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8006010 tx=0x7f1fa800be20 comp rx=0 tx=0).stop 2024-09-10T09:40:23.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 shutdown_connections 2024-09-10T09:40:23.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fb80687a0 0x7f1fb80ffca0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.037 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f1fa006de80 0x7f1fa0070330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 --2- 172.21.15.79:0/1225367905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fb8069140 0x7f1fb81001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 >> 172.21.15.79:0/1225367905 conn(0x7f1fb8075130 msgr2=0x7f1fb80fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 shutdown_connections 2024-09-10T09:40:23.038 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.034+0000 7f1fbe3cb700 1 -- 172.21.15.79:0/1225367905 wait complete. 2024-09-10T09:40:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.146+0000 7fe27182b700 1 -- 172.21.15.79:0/3140363516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ff3c0 msgr2=0x7fe26c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.146+0000 7fe27182b700 1 --2- 172.21.15.79:0/3140363516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ff3c0 0x7fe26c0ff790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009910 tx=0x7fe25c009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.146+0000 7fe27182b700 1 -- 172.21.15.79:0/3140363516 shutdown_connections 2024-09-10T09:40:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.146+0000 7fe27182b700 1 --2- 172.21.15.79:0/3140363516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c0ffd60 0x7fe26c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.146+0000 7fe27182b700 1 --2- 172.21.15.79:0/3140363516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ff3c0 0x7fe26c0ff790 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.146+0000 7fe27182b700 1 -- 172.21.15.79:0/3140363516 >> 172.21.15.79:0/3140363516 conn(0x7fe26c0fac80 msgr2=0x7fe26c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:23.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.147+0000 7fe27182b700 1 -- 172.21.15.79:0/3140363516 shutdown_connections 2024-09-10T09:40:23.149 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.147+0000 7fe27182b700 1 -- 172.21.15.79:0/3140363516 wait complete. 2024-09-10T09:40:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.148+0000 7fe27182b700 1 Processor -- start 2024-09-10T09:40:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.148+0000 7fe27182b700 1 -- start start 2024-09-10T09:40:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.148+0000 7fe27182b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ffd60 0x7fe26c196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.148+0000 7fe27182b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c197430 0x7fe26c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.148+0000 7fe27182b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c19fff0 con 0x7fe26c0ffd60 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.148+0000 7fe27182b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c1a0130 con 0x7fe26c197430 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.149+0000 7fe26a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c197430 0x7fe26c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.149+0000 7fe26a7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c197430 0x7fe26c1978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:43046/0 (socket says 172.21.15.79:43046) 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.149+0000 7fe26a7fc700 1 -- 172.21.15.79:0/10842308 learned_addr learned my addr 172.21.15.79:0/10842308 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.149+0000 7fe26affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ffd60 0x7fe26c196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.149+0000 7fe26affd700 1 -- 172.21.15.79:0/10842308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c197430 msgr2=0x7fe26c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.149+0000 7fe26affd700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c197430 0x7fe26c1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.149+0000 7fe26affd700 1 -- 172.21.15.79:0/10842308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c0095f0 con 0x7fe26c0ffd60 2024-09-10T09:40:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.150+0000 7fe26affd700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ffd60 0x7fe26c196ef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe26c1005f0 tx=0x7fe25c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.150+0000 7fe270829700 1 -- 172.21.15.79:0/10842308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c01d070 con 0x7fe26c0ffd60 2024-09-10T09:40:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.150+0000 7fe270829700 1 -- 172.21.15.79:0/10842308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe25c005dc0 con 0x7fe26c0ffd60 2024-09-10T09:40:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.150+0000 7fe270829700 1 -- 172.21.15.79:0/10842308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25c00fe90 con 0x7fe26c0ffd60 2024-09-10T09:40:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.150+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c194ce0 con 0x7fe26c0ffd60 2024-09-10T09:40:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.150+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c195230 con 0x7fe26c0ffd60 2024-09-10T09:40:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.152+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c1076d0 con 0x7fe26c0ffd60 2024-09-10T09:40:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.152+0000 7fe270829700 1 -- 172.21.15.79:0/10842308 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7fe25c00f6b0 con 0x7fe26c0ffd60 2024-09-10T09:40:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.152+0000 7fe270829700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fe2540722e0 0x7fe254074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.152+0000 7fe270829700 1 -- 172.21.15.79:0/10842308 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7fe25c08ec00 con 0x7fe26c0ffd60 2024-09-10T09:40:23.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.153+0000 7fe26a7fc700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fe2540722e0 0x7fe254074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.153+0000 7fe26a7fc700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fe2540722e0 0x7fe254074790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe26000bcd0 tx=0x7fe26000b2c0 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:23.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.157+0000 7fe270829700 1 -- 172.21.15.79:0/10842308 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7fe25c094020 con 0x7fe26c0ffd60 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.475+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe26c04f2a0 con 0x7fe26c0ffd60 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.476+0000 7fe270829700 1 -- 172.21.15.79:0/10842308 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+679 (secure 0 0 0) 0x7fe25c058630 con 0x7fe26c0ffd60 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:40:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 12, 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:40:23.478 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:40:23.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.478+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fe2540722e0 msgr2=0x7fe254074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.478+0000 7fe27182b700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fe2540722e0 0x7fe254074790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe26000bcd0 tx=0x7fe26000b2c0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.479 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.478+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ffd60 msgr2=0x7fe26c196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.478+0000 7fe27182b700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ffd60 0x7fe26c196ef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe26c1005f0 tx=0x7fe25c00be20 comp rx=0 tx=0).stop 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.478+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 shutdown_connections 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.478+0000 7fe27182b700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c0ffd60 0x7fe26c196ef0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.478+0000 7fe27182b700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7fe2540722e0 0x7fe254074790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.479+0000 7fe27182b700 1 --2- 172.21.15.79:0/10842308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe26c197430 0x7fe26c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.479+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 >> 172.21.15.79:0/10842308 conn(0x7fe26c0fac80 msgr2=0x7fe26c0fc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.479+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 shutdown_connections 2024-09-10T09:40:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.479+0000 7fe27182b700 1 -- 172.21.15.79:0/10842308 wait complete. 2024-09-10T09:40:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 -- 172.21.15.79:0/3849760085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 msgr2=0x7f30a0100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/3849760085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0100040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3094009910 tx=0x7f3094009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 -- 172.21.15.79:0/3849760085 shutdown_connections 2024-09-10T09:40:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/3849760085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0100040 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/3849760085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a0104130 0x7f30a0104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.588 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 -- 172.21.15.79:0/3849760085 >> 172.21.15.79:0/3849760085 conn(0x7f30a0075130 msgr2=0x7f30a0075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 -- 172.21.15.79:0/3849760085 shutdown_connections 2024-09-10T09:40:23.589 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.587+0000 7f30a4fb0700 1 -- 172.21.15.79:0/3849760085 wait complete. 2024-09-10T09:40:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f30a4fb0700 1 Processor -- start 2024-09-10T09:40:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f30a4fb0700 1 -- start start 2024-09-10T09:40:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f30a4fb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f30a4fb0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a0104130 0x7f30a01971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f30a4fb0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0197800 con 0x7f30a00ffbd0 2024-09-10T09:40:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f30a4fb0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0197940 con 0x7f30a0104130 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f309e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f309e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40482/0 (socket says 172.21.15.79:40482) 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f309e59c700 1 -- 172.21.15.79:0/2289053662 learned_addr learned my addr 172.21.15.79:0/2289053662 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.588+0000 7f309dd9b700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a0104130 0x7f30a01971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f309e59c700 1 -- 172.21.15.79:0/2289053662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a0104130 msgr2=0x7f30a01971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f309e59c700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a0104130 0x7f30a01971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f309e59c700 1 -- 172.21.15.79:0/2289053662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30940095f0 con 0x7f30a00ffbd0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f309e59c700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0196ca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f309000d8d0 tx=0x7f309000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f308f7fe700 1 -- 172.21.15.79:0/2289053662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30900098a0 con 0x7f30a00ffbd0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a019fd10 con 0x7f30a00ffbd0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f308f7fe700 1 -- 172.21.15.79:0/2289053662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3090010460 con 0x7f30a00ffbd0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f308f7fe700 1 -- 172.21.15.79:0/2289053662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f309000f5f0 con 0x7f30a00ffbd0 2024-09-10T09:40:23.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.589+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a01a01d0 con 0x7f30a00ffbd0 2024-09-10T09:40:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.590+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a004f2a0 con 0x7f30a00ffbd0 2024-09-10T09:40:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.591+0000 7f308f7fe700 1 -- 172.21.15.79:0/2289053662 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f3090009a00 con 0x7f30a00ffbd0 2024-09-10T09:40:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.591+0000 7f308f7fe700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f308806de80 0x7f3088070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.592 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.592+0000 7f308f7fe700 1 -- 172.21.15.79:0/2289053662 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f309008da40 con 0x7f30a00ffbd0 2024-09-10T09:40:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.592+0000 7f309dd9b700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f308806de80 0x7f3088070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.593 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.592+0000 7f309dd9b700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f308806de80 0x7f3088070330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3094009fd0 tx=0x7f309401a040 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:23.598 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.597+0000 7f308f7fe700 1 -- 172.21.15.79:0/2289053662 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f30900572c0 con 0x7f30a00ffbd0 2024-09-10T09:40:23.729 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: Upgrade: Target is version 19.1.1-305-g1cf819b7 (squid) 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559'] 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: Upgrade: Setting container_image for all mgr 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: pgmap v96: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:23.730 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:23 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/10842308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:23.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.854+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f30a01a0500 con 0x7f30a00ffbd0 2024-09-10T09:40:23.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.855+0000 7f308f7fe700 1 -- 172.21.15.79:0/2289053662 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f309005a980 con 0x7f30a00ffbd0 2024-09-10T09:40:23.856 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:40:23.856 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:40:23.856 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:23.856 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:40:23.856 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:40:23.857 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:40:23.858 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:40:23.859 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:23.860 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:23.860 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f308806de80 msgr2=0x7f3088070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f308806de80 0x7f3088070330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3094009fd0 tx=0x7f309401a040 comp rx=0 tx=0).stop 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 msgr2=0x7f30a0196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0196ca0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f309000d8d0 tx=0x7f309000dbe0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 shutdown_connections 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f30a00ffbd0 0x7f30a0196ca0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f308806de80 0x7f3088070330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 --2- 172.21.15.79:0/2289053662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30a0104130 0x7f30a01971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 >> 172.21.15.79:0/2289053662 conn(0x7f30a0075130 msgr2=0x7f30a00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:23.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 shutdown_connections 2024-09-10T09:40:23.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.858+0000 7f30a4fb0700 1 -- 172.21.15.79:0/2289053662 wait complete. 2024-09-10T09:40:23.862 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: Upgrade: Target is version 19.1.1-305-g1cf819b7 (squid) 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559'] 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: Upgrade: Setting container_image for all mgr 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T09:40:23.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:23.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: pgmap v96: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:23.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:23 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/10842308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 -- 172.21.15.79:0/4200157918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 msgr2=0x7f54d0104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 --2- 172.21.15.79:0/4200157918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0104e50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009910 tx=0x7f54b8009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 -- 172.21.15.79:0/4200157918 shutdown_connections 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 --2- 172.21.15.79:0/4200157918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0104e50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 --2- 172.21.15.79:0/4200157918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d01004e0 0x7f54d01008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 -- 172.21.15.79:0/4200157918 >> 172.21.15.79:0/4200157918 conn(0x7f54d00fbda0 msgr2=0x7f54d00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 -- 172.21.15.79:0/4200157918 shutdown_connections 2024-09-10T09:40:23.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.977+0000 7f54d48a0700 1 -- 172.21.15.79:0/4200157918 wait complete. 2024-09-10T09:40:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54d48a0700 1 Processor -- start 2024-09-10T09:40:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54d48a0700 1 -- start start 2024-09-10T09:40:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54d48a0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d01004e0 0x7f54d0195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54d48a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54d48a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d0196b30 con 0x7f54d0100e80 2024-09-10T09:40:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54d48a0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d019a8c0 con 0x7f54d01004e0 2024-09-10T09:40:23.980 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54c7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54c7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40496/0 (socket says 172.21.15.79:40496) 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54c7fff700 1 -- 172.21.15.79:0/3411817674 learned_addr learned my addr 172.21.15.79:0/3411817674 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54ce59c700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d01004e0 0x7f54d0195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54c7fff700 1 -- 172.21.15.79:0/3411817674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d01004e0 msgr2=0x7f54d0195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54c7fff700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d01004e0 0x7f54d0195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.978+0000 7f54c7fff700 1 -- 172.21.15.79:0/3411817674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80095f0 con 0x7f54d0100e80 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.979+0000 7f54c7fff700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0196450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54b80092e0 tx=0x7f54b800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.979+0000 7f54c77fe700 1 -- 172.21.15.79:0/3411817674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b801d070 con 0x7f54d0100e80 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.979+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d019ab40 con 0x7f54d0100e80 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.979+0000 7f54c77fe700 1 -- 172.21.15.79:0/3411817674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54b800f460 con 0x7f54d0100e80 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.979+0000 7f54c77fe700 1 -- 172.21.15.79:0/3411817674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b80175f0 con 0x7f54d0100e80 2024-09-10T09:40:23.981 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.979+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d019b030 con 0x7f54d0100e80 2024-09-10T09:40:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.980+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d0108850 con 0x7f54d0100e80 2024-09-10T09:40:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.980+0000 7f54c77fe700 1 -- 172.21.15.79:0/3411817674 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f54b800f5d0 con 0x7f54d0100e80 2024-09-10T09:40:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.981+0000 7f54c77fe700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f54bc06de80 0x7f54bc070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.981+0000 7f54c77fe700 1 -- 172.21.15.79:0/3411817674 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f54b808eff0 con 0x7f54d0100e80 2024-09-10T09:40:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.981+0000 7f54ce59c700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f54bc06de80 0x7f54bc070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:23.983 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.981+0000 7f54ce59c700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f54bc06de80 0x7f54bc070330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f54c0005fd0 tx=0x7f54c000a560 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:23.986 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:23.985+0000 7f54c77fe700 1 -- 172.21.15.79:0/3411817674 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f54b8058900 con 0x7f54d0100e80 2024-09-10T09:40:24.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.228+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 --> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54d019b250 con 0x7f54bc06de80 2024-09-10T09:40:24.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.230+0000 7f54c77fe700 1 -- 172.21.15.79:0/3411817674 <== mgr.14634 v2:172.21.15.79:6800/484505899 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f54d019b250 con 0x7f54bc06de80 2024-09-10T09:40:24.230 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr" 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "2/23 daemons upgraded", 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading mon daemons", 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:40:24.231 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:40:24.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f54bc06de80 msgr2=0x7f54bc070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:24.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f54bc06de80 0x7f54bc070330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f54c0005fd0 tx=0x7f54c000a560 comp rx=0 tx=0).stop 2024-09-10T09:40:24.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 msgr2=0x7f54d0196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:24.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0196450 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f54b80092e0 tx=0x7f54b800be20 comp rx=0 tx=0).stop 2024-09-10T09:40:24.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 shutdown_connections 2024-09-10T09:40:24.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f54bc06de80 0x7f54bc070330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d01004e0 0x7f54d0195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 --2- 172.21.15.79:0/3411817674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54d0100e80 0x7f54d0196450 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 >> 172.21.15.79:0/3411817674 conn(0x7f54d00fbda0 msgr2=0x7f54d00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:24.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 shutdown_connections 2024-09-10T09:40:24.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.232+0000 7f54d48a0700 1 -- 172.21.15.79:0/3411817674 wait complete. 2024-09-10T09:40:24.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 -- 172.21.15.79:0/1804128960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 msgr2=0x7f92dc1017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:24.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 --2- 172.21.15.79:0/1804128960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc1017f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009910 tx=0x7f92d0009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:24.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 -- 172.21.15.79:0/1804128960 shutdown_connections 2024-09-10T09:40:24.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 --2- 172.21.15.79:0/1804128960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92dc101d30 0x7f92dc10a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 --2- 172.21.15.79:0/1804128960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc1017f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.344 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 -- 172.21.15.79:0/1804128960 >> 172.21.15.79:0/1804128960 conn(0x7f92dc0fac60 msgr2=0x7f92dc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 -- 172.21.15.79:0/1804128960 shutdown_connections 2024-09-10T09:40:24.345 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.343+0000 7f92e180c700 1 -- 172.21.15.79:0/1804128960 wait complete. 2024-09-10T09:40:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92e180c700 1 Processor -- start 2024-09-10T09:40:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92e180c700 1 -- start start 2024-09-10T09:40:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92e180c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:24.346 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92e180c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92dc101d30 0x7f92dc1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92e180c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc196ac0 con 0x7f92dc101420 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92e180c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc19a850 con 0x7f92dc101d30 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92daffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92daffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40516/0 (socket says 172.21.15.79:40516) 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92daffd700 1 -- 172.21.15.79:0/483439986 learned_addr learned my addr 172.21.15.79:0/483439986 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.344+0000 7f92da7fc700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92dc101d30 0x7f92dc1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92daffd700 1 -- 172.21.15.79:0/483439986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92dc101d30 msgr2=0x7f92dc1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92daffd700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92dc101d30 0x7f92dc1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92daffd700 1 -- 172.21.15.79:0/483439986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d00095f0 con 0x7f92dc101420 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92daffd700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc195ea0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f92d0006010 tx=0x7f92d000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92e080a700 1 -- 172.21.15.79:0/483439986 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d001d070 con 0x7f92dc101420 2024-09-10T09:40:24.347 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc19aad0 con 0x7f92dc101420 2024-09-10T09:40:24.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92e080a700 1 -- 172.21.15.79:0/483439986 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92d0004fb0 con 0x7f92dc101420 2024-09-10T09:40:24.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92e080a700 1 -- 172.21.15.79:0/483439986 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92d0022ea0 con 0x7f92dc101420 2024-09-10T09:40:24.348 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.345+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc19afc0 con 0x7f92dc101420 2024-09-10T09:40:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.346+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc107900 con 0x7f92dc101420 2024-09-10T09:40:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.346+0000 7f92e080a700 1 -- 172.21.15.79:0/483439986 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 32) v1 ==== 92056+0+0 (secure 0 0 0) 0x7f92d0022470 con 0x7f92dc101420 2024-09-10T09:40:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.347+0000 7f92e080a700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f92c406de80 0x7f92c4070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.347+0000 7f92e080a700 1 -- 172.21.15.79:0/483439986 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5898+0+0 (secure 0 0 0) 0x7f92d008f050 con 0x7f92dc101420 2024-09-10T09:40:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.347+0000 7f92da7fc700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f92c406de80 0x7f92c4070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:24.349 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.347+0000 7f92da7fc700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f92c406de80 0x7f92c4070330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92cc005fd0 tx=0x7f92cc00a560 comp rx=0 tx=0).ready entity=mgr.14634 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:24.352 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.352+0000 7f92e080a700 1 -- 172.21.15.79:0/483439986 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186811 (secure 0 0 0) 0x7f92d0058a10 con 0x7f92dc101420 2024-09-10T09:40:24.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.648+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f92dc1972d0 con 0x7f92dc101420 2024-09-10T09:40:24.649 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.648+0000 7f92e080a700 1 -- 172.21.15.79:0/483439986 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f92d0022720 con 0x7f92dc101420 2024-09-10T09:40:24.650 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:24.650 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.650+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f92c406de80 msgr2=0x7f92c4070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.650+0000 7f92e180c700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f92c406de80 0x7f92c4070330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92cc005fd0 tx=0x7f92cc00a560 comp rx=0 tx=0).stop 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.650+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 msgr2=0x7f92dc195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.650+0000 7f92e180c700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc195ea0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f92d0006010 tx=0x7f92d000be20 comp rx=0 tx=0).stop 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.651+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 shutdown_connections 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.651+0000 7f92e180c700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92dc101420 0x7f92dc195ea0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.651+0000 7f92e180c700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.79:6800/484505899,v1:172.21.15.79:6801/484505899] conn(0x7f92c406de80 0x7f92c4070330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.651+0000 7f92e180c700 1 --2- 172.21.15.79:0/483439986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92dc101d30 0x7f92dc1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:24.652 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.651+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 >> 172.21.15.79:0/483439986 conn(0x7f92dc0fac60 msgr2=0x7f92dc104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:24.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.651+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 shutdown_connections 2024-09-10T09:40:24.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:24.651+0000 7f92e180c700 1 -- 172.21.15.79:0/483439986 wait complete. 2024-09-10T09:40:24.893 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:24 smithi079 ceph-mon[27592]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:24.893 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:24 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/2289053662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:40:24.893 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:24.893 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:40:24.893 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:40:24.893 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:24 smithi079 ceph-mon[27592]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:24.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:24 smithi135 ceph-mon[33411]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:24.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:24 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/2289053662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:40:24.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:24.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:40:24.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:40:24.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:24 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:25.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:25 smithi079 ceph-mon[27592]: Upgrade: Updating mon.smithi079 2024-09-10T09:40:25.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:25 smithi079 ceph-mon[27592]: Deploying daemon mon.smithi079 on smithi079 2024-09-10T09:40:25.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:25 smithi079 ceph-mon[27592]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:25.792 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:25 smithi079 ceph-mon[27592]: from='client.? 172.21.15.79:0/483439986' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:40:25.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:25 smithi079 ceph-mon[27592]: pgmap v97: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:25.793 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:25 smithi079 systemd[1]: Stopping Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:40:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:25 smithi135 ceph-mon[33411]: Upgrade: Updating mon.smithi079 2024-09-10T09:40:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:25 smithi135 ceph-mon[33411]: Deploying daemon mon.smithi079 on smithi079 2024-09-10T09:40:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:25 smithi135 ceph-mon[33411]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:25 smithi135 ceph-mon[33411]: from='client.? 172.21.15.79:0/483439986' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:40:25.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:25 smithi135 ceph-mon[33411]: pgmap v97: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:26.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:26 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[27588]: 2024-09-10T09:40:26.067+0000 7fe2c48de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi079 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:40:26.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:26 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[27588]: 2024-09-10T09:40:26.067+0000 7fe2c48de700 -1 mon.smithi079@0(leader) e2 *** Got Signal Terminated *** 2024-09-10T09:40:26.343 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:26 smithi079 podman[87038]: 2024-09-10 09:40:26.226918587 +0000 UTC m=+0.290966659 container died f719abe33353aedd50ef63ea381449805830dc7c4016726f20ffbed99803a16f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T09:40:26.896 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:26 smithi079 podman[87038]: 2024-09-10 09:40:26.627835256 +0000 UTC m=+0.691883327 container cleanup f719abe33353aedd50ef63ea381449805830dc7c4016726f20ffbed99803a16f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0) 2024-09-10T09:40:26.896 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:26 smithi079 bash[87038]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079 2024-09-10T09:40:27.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:26 smithi079 podman[87051]: 2024-09-10 09:40:26.895976834 +0000 UTC m=+0.663502347 container remove f719abe33353aedd50ef63ea381449805830dc7c4016726f20ffbed99803a16f (image=quay.io/ceph/ceph:v18.2.0, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-10T09:40:27.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service: Deactivated successfully. 2024-09-10T09:40:27.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 systemd[1]: Stopped Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:40:27.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service: Consumed 13.747s CPU time. 2024-09-10T09:40:27.539 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 systemd[1]: Starting Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:40:27.539 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 podman[87194]: 2024-09-10 09:40:27.404747985 +0000 UTC m=+0.015550320 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:40:27.539 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 podman[87194]: 2024-09-10 09:40:27.539030383 +0000 UTC m=+0.149832713 container create 888aa89ba764f5128ce7f27c26ea862f5e527aced1c555ac7cf4bc7c9dd61fee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T09:40:27.799 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 podman[87194]: 2024-09-10 09:40:27.756081979 +0000 UTC m=+0.366884309 container init 888aa89ba764f5128ce7f27c26ea862f5e527aced1c555ac7cf4bc7c9dd61fee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T09:40:27.799 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 podman[87194]: 2024-09-10 09:40:27.759474924 +0000 UTC m=+0.370277265 container start 888aa89ba764f5128ce7f27c26ea862f5e527aced1c555ac7cf4bc7c9dd61fee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T09:40:27.799 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: pidfile_write: ignore empty --pid-file 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: load: jerasure load: lrc 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: RocksDB version: 7.9.2 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Git sha 0 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: DB SUMMARY 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: DB Session ID: JQ19ZABD3P622QTQN4YC 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: CURRENT file: CURRENT 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1517 Bytes 2024-09-10T09:40:27.800 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi079/store.db dir, Total Num: 1, files: 000032.sst 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi079/store.db: 000030.log size: 4019837 ; 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.error_if_exists: 0 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.create_if_missing: 0 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.paranoid_checks: 1 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.env: 0x55a6e1bf8940 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.info_log: 0x55a6e334f8c0 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.statistics: (nil) 2024-09-10T09:40:27.801 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.use_fsync: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_log_file_size: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.allow_fallocate: 1 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.use_direct_reads: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.db_log_dir: 2024-09-10T09:40:27.802 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.wal_dir: 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.write_buffer_manager: 0x55a6e335edc0 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T09:40:27.803 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.unordered_write: 0 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.row_cache: None 2024-09-10T09:40:27.804 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.wal_filter: None 2024-09-10T09:40:27.805 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T09:40:27.805 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T09:40:27.805 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.two_write_queues: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.wal_compression: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.atomic_flush: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.log_readahead_size: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T09:40:27.806 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_background_jobs: 2 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_background_compactions: -1 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_subcompactions: 1 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_open_files: -1 2024-09-10T09:40:27.807 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_background_flushes: -1 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Compression algorithms supported: 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kZSTD supported: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kXpressCompression supported: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kBZip2Compression supported: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kLZ4Compression supported: 1 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kZlibCompression supported: 1 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: kSnappyCompression supported: 1 2024-09-10T09:40:27.808 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi079/store.db/MANIFEST-000015 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.merge_operator: 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_filter: None 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a6e334f520) 2024-09-10T09:40:27.809 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: cache_index_and_filter_blocks: 1 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: pin_top_level_index_and_filter: 1 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_type: 0 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_block_index_type: 0 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_shortening: 1 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: checksum: 4 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: no_block_cache: 0 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache: 0x55a6e33431f0 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_name: BinnedLRUCache 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_options: 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: capacity : 536870912 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: num_shard_bits : 4 2024-09-10T09:40:27.810 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: strict_capacity_limit : 0 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: high_pri_pool_ratio: 0.000 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_cache_compressed: (nil) 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: persistent_cache: (nil) 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_size: 4096 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_size_deviation: 10 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_restart_interval: 16 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: index_block_restart_interval: 1 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: metadata_block_size: 4096 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: partition_filters: 0 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: use_delta_encoding: 1 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: filter_policy: bloomfilter 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: whole_key_filtering: 1 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: verify_compression: 0 2024-09-10T09:40:27.811 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: read_amp_bytes_per_bit: 0 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: format_version: 5 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: enable_index_compression: 1 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: block_align: 0 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_auto_readahead_size: 262144 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: prepopulate_block_cache: 0 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: initial_auto_readahead_size: 8192 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression: NoCompression 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T09:40:27.812 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.num_levels: 7 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T09:40:27.813 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T09:40:27.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T09:40:27.815 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T09:40:27.816 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.inplace_update_support: 0 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.bloom_locality: 0 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.max_successive_merges: 0 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T09:40:27.817 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.ttl: 2592000 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.enable_blob_files: false 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.min_blob_size: 0 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T09:40:27.818 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi079/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12060, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ac76676b-5f81-4abc-ac2b-f20b2488af04 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725961227785444, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725961227798606, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 3497194, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12061, "largest_seqno": 15257, "table_properties": {"data_size": 3484899, "index_size": 7664, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3589, "raw_key_size": 31297, "raw_average_key_size": 21, "raw_value_size": 3456954, "raw_average_value_size": 2424, "num_data_blocks": 348, "num_entries": 1426, "num_filter_entries": 1426, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725961227, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ac76676b-5f81-4abc-ac2b-f20b2488af04", "db_session_id": "JQ19ZABD3P622QTQN4YC", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725961227798736, "job": 1, "event": "recovery_finished"} 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi079/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a6e3370e00 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: DB pointer 0x55a6e346c000 2024-09-10T09:40:27.819 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** DB Stats ** 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** Compaction Stats [default] ** 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T09:40:27.820 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: L0 1/0 3.34 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 477.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: L6 1/0 5.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Sum 2/0 8.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 477.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 477.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** Compaction Stats [default] ** 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 477.1 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:40:27.821 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Cumulative compaction: 0.00 GB write, 209.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Interval compaction: 0.00 GB write, 209.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Block cache BinnedLRUCache@0x55a6e33431f0#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T09:40:27.822 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: starting mon.smithi079 rank 0 at public addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] at bind addrs [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi079 fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:28.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???) e2 preinit fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???).mds e16 new map 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???).mds e16 print_map 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: e16 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: legacy client fscid: 1 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Filesystem 'cephfs' (1) 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: fs_name cephfs 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: epoch 16 2024-09-10T09:40:28.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: tableserver 0 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: root 0 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: session_timeout 60 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: session_autoclose 300 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_file_size 1099511627776 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_xattr_size 65536 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: required_client_features {} 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: last_failure 0 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: last_failure_osd_epoch 47 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:28.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: max_mds 1 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: in 0 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: up {0=24281} 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: failed 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: damaged 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: stopped 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: data_pools [3] 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: metadata_pool 2 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: inline_data enabled 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: balancer 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: bal_rank_mask -1 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: standby_count_wanted 1 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: qdb_cluster leader: 0 members: 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:28.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Standby daemons: 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: [mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 ceph-mon[87213]: mon.smithi079@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 bash[87194]: 888aa89ba764f5128ce7f27c26ea862f5e527aced1c555ac7cf4bc7c9dd61fee 2024-09-10T09:40:28.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:27 smithi079 systemd[1]: Started Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:40:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:40:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:40:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: pgmap v98: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: pgmap v99: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: mon.smithi079 calling monitor election 2024-09-10T09:40:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: mon.smithi079 is new leader, mons smithi079,smithi135 in quorum (ranks 0,1) 2024-09-10T09:40:29.594 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: monmap epoch 2 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: last_changed 2024-09-10T09:29:06.901918+0000 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: created 2024-09-10T09:26:30.512309+0000 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: min_mon_release 18 (reef) 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: election_strategy: 1 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.smithi135 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: osdmap e49: 6 total, 6 up, 6 in 2024-09-10T09:40:29.595 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: mgrmap e32: smithi079.mhirny(active, since 3m), standbys: smithi135.lbhjof 2024-09-10T09:40:29.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:29.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:29.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:29.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: from='mgr.14634 ' entity='' 2024-09-10T09:40:29.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:29 smithi079 ceph-mon[87213]: mgrmap e33: smithi079.mhirny(active, since 3m), standbys: smithi135.lbhjof 2024-09-10T09:40:29.685 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:40:29.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: from='mgr.14634 172.21.15.79:0/3243332242' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:40:29.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: pgmap v98: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:29.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: pgmap v99: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:29.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: mon.smithi079 calling monitor election 2024-09-10T09:40:29.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: mon.smithi079 is new leader, mons smithi079,smithi135 in quorum (ranks 0,1) 2024-09-10T09:40:29.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: monmap epoch 2 2024-09-10T09:40:29.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:29.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: last_changed 2024-09-10T09:29:06.901918+0000 2024-09-10T09:40:29.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: created 2024-09-10T09:26:30.512309+0000 2024-09-10T09:40:29.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: min_mon_release 18 (reef) 2024-09-10T09:40:29.687 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: election_strategy: 1 2024-09-10T09:40:29.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-09-10T09:40:29.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.smithi135 2024-09-10T09:40:29.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:40:29.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: osdmap e49: 6 total, 6 up, 6 in 2024-09-10T09:40:29.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: mgrmap e32: smithi079.mhirny(active, since 3m), standbys: smithi135.lbhjof 2024-09-10T09:40:29.688 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:29.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:29.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:29.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: from='mgr.14634 ' entity='' 2024-09-10T09:40:29.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:29 smithi135 ceph-mon[33411]: mgrmap e33: smithi079.mhirny(active, since 3m), standbys: smithi135.lbhjof 2024-09-10T09:40:34.319 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: Active manager daemon smithi079.mhirny restarted 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: Activating manager daemon smithi079.mhirny 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: osdmap e50: 6 total, 6 up, 6 in 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: mgrmap e34: smithi079.mhirny(active, starting, since 0.00586771s), standbys: smithi135.lbhjof 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:40:34.320 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:40:34.321 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: Active manager daemon smithi079.mhirny restarted 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: Activating manager daemon smithi079.mhirny 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: osdmap e50: 6 total, 6 up, 6 in 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: mgrmap e34: smithi079.mhirny(active, starting, since 0.00586771s), standbys: smithi135.lbhjof 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:40:34.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi079.mhirny", "id": "smithi079.mhirny"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr metadata", "who": "smithi135.lbhjof", "id": "smithi135.lbhjof"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T09:40:34.370 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: Manager daemon smithi079.mhirny is now available 2024-09-10T09:40:34.371 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:34 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:35.357 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: Standby manager daemon smithi135.lbhjof restarted 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:40:35.358 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:35 smithi079 ceph-mon[87213]: mgrmap e35: smithi079.mhirny(active, since 1.00932s), standbys: smithi135.lbhjof 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/mirror_snapshot_schedule"}]: dispatch 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi079.mhirny/trash_purge_schedule"}]: dispatch 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof restarted 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: Standby manager daemon smithi135.lbhjof started 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/crt"}]: dispatch 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T09:40:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi135.lbhjof/key"}]: dispatch 2024-09-10T09:40:35.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: from='mgr.? 172.21.15.135:0/4217271954' entity='mgr.smithi135.lbhjof' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T09:40:35.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:35 smithi135 ceph-mon[33411]: mgrmap e35: smithi079.mhirny(active, since 1.00932s), standbys: smithi135.lbhjof 2024-09-10T09:40:36.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:36 smithi079 ceph-mon[87213]: [10/Sep/2024:09:40:35] ENGINE Bus STARTING 2024-09-10T09:40:36.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:36 smithi079 ceph-mon[87213]: pgmap v3: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:36 smithi079 ceph-mon[87213]: [10/Sep/2024:09:40:35] ENGINE Serving on http://172.21.15.79:8765 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:36 smithi079 ceph-mon[87213]: [10/Sep/2024:09:40:35] ENGINE Serving on https://172.21.15.79:7150 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:36 smithi079 ceph-mon[87213]: [10/Sep/2024:09:40:35] ENGINE Bus STARTED 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:36 smithi079 ceph-mon[87213]: [10/Sep/2024:09:40:35] ENGINE Error in HTTPServer.serve 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: Traceback (most recent call last): 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._run(expiration_interval) 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:40:36.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: s = self.context.wrap_socket( 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: return self.sslsocket_class._create( 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self.do_handshake() 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: self._sslobj.do_handshake() 2024-09-10T09:40:36.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:40:36.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:40:35] ENGINE Bus STARTING 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:36 smithi135 ceph-mon[33411]: pgmap v3: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:40:35] ENGINE Serving on http://172.21.15.79:8765 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:40:35] ENGINE Serving on https://172.21.15.79:7150 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:40:35] ENGINE Bus STARTED 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:36 smithi135 ceph-mon[33411]: [10/Sep/2024:09:40:35] ENGINE Error in HTTPServer.serve 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Traceback (most recent call last): 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._connections.run(self.expiration_interval) 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._run(expiration_interval) 2024-09-10T09:40:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: s = self.context.wrap_socket( 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: return self.sslsocket_class._create( 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self.do_handshake() 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: self._sslobj.do_handshake() 2024-09-10T09:40:36.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T09:40:37.455 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:37 smithi079 ceph-mon[87213]: pgmap v4: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:37.456 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:37 smithi079 ceph-mon[87213]: mgrmap e36: smithi079.mhirny(active, since 2s), standbys: smithi135.lbhjof 2024-09-10T09:40:37.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:37 smithi135 ceph-mon[33411]: pgmap v4: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:37.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:37 smithi135 ceph-mon[33411]: mgrmap e36: smithi079.mhirny(active, since 2s), standbys: smithi135.lbhjof 2024-09-10T09:40:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:40:38.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:38 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:38 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:38 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:38 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:38.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:38 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-09-10T09:40:39.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:39 smithi079 ceph-mon[87213]: pgmap v5: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:39.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:39 smithi079 ceph-mon[87213]: mgrmap e37: smithi079.mhirny(active, since 4s), standbys: smithi135.lbhjof 2024-09-10T09:40:39.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:39 smithi135 ceph-mon[33411]: pgmap v5: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:39.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:39 smithi135 ceph-mon[33411]: mgrmap e37: smithi079.mhirny(active, since 4s), standbys: smithi135.lbhjof 2024-09-10T09:40:40.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:40 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:40 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:40 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:40 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:40 smithi135 ceph-mon[33411]: pgmap v6: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:40.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:40.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:40 smithi079 ceph-mon[87213]: pgmap v6: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-10T09:40:43.310 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:43 smithi079 ceph-mon[87213]: pgmap v7: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T09:40:43.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:43 smithi135 ceph-mon[33411]: pgmap v7: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Detected new or changed devices on smithi079 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:40:44.699 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: pgmap v8: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:44.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:44 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T09:40:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Detected new or changed devices on smithi079 2024-09-10T09:40:44.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: Updating smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T09:40:44.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: pgmap v8: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:44.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-10T09:40:47.144 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:46 smithi135 ceph-mon[33411]: Upgrade: Updating mon.smithi135 2024-09-10T09:40:47.144 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:46 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:47.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:46 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:40:47.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:46 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:40:47.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:46 smithi135 ceph-mon[33411]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:47.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:46 smithi135 ceph-mon[33411]: Deploying daemon mon.smithi135 on smithi135 2024-09-10T09:40:47.145 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:46 smithi135 ceph-mon[33411]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-10T09:40:47.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:46 smithi079 ceph-mon[87213]: Upgrade: Updating mon.smithi135 2024-09-10T09:40:47.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:46 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:47.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:46 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:40:47.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:46 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:40:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:46 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:46 smithi079 ceph-mon[87213]: Deploying daemon mon.smithi135 on smithi135 2024-09-10T09:40:47.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:46 smithi079 ceph-mon[87213]: pgmap v9: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-10T09:40:47.716 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:47 smithi135 systemd[1]: Stopping Ceph mon.smithi135 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:40:47.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:47 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135[33388]: 2024-09-10T09:40:47.714+0000 7eff3562b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi135 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:40:47.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:47 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135[33388]: 2024-09-10T09:40:47.714+0000 7eff3562b700 -1 mon.smithi135@1(peon) e2 *** Got Signal Terminated *** 2024-09-10T09:40:47.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:47 smithi135 podman[65198]: 2024-09-10 09:40:47.827413779 +0000 UTC m=+0.221996424 container died 2d2b226b197a921153ec0bb658396cbf92d042715fd248d4c8bcef915127189b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux ) 2024-09-10T09:40:48.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:48 smithi135 podman[65198]: 2024-09-10 09:40:48.28170824 +0000 UTC m=+0.676290883 container cleanup 2d2b226b197a921153ec0bb658396cbf92d042715fd248d4c8bcef915127189b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.vendor=CentOS, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.0, ceph=True, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-09-10T09:40:48.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:48 smithi135 bash[65198]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135 2024-09-10T09:40:48.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:48 smithi135 podman[65211]: 2024-09-10 09:40:48.525021008 +0000 UTC m=+0.682965439 container remove 2d2b226b197a921153ec0bb658396cbf92d042715fd248d4c8bcef915127189b (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, org.label-schema.build-date=20231212, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-10T09:40:49.159 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:48 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi135.service: Deactivated successfully. 2024-09-10T09:40:49.159 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:48 smithi135 systemd[1]: Stopped Ceph mon.smithi135 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:40:49.159 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:48 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi135.service: Consumed 7.866s CPU time. 2024-09-10T09:40:49.159 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:48 smithi135 systemd[1]: Starting Ceph mon.smithi135 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:40:49.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 podman[65342]: 2024-09-10 09:40:49.061476266 +0000 UTC m=+0.015601671 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:40:49.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 podman[65342]: 2024-09-10 09:40:49.210658112 +0000 UTC m=+0.164783516 container create 1ce9e84003d6f14cd75d87d86120c1a288707c493835806e52e25b5b4b75b979 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T09:40:49.771 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 podman[65342]: 2024-09-10 09:40:49.478968749 +0000 UTC m=+0.433094151 container init 1ce9e84003d6f14cd75d87d86120c1a288707c493835806e52e25b5b4b75b979 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T09:40:49.771 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 podman[65342]: 2024-09-10 09:40:49.482484285 +0000 UTC m=+0.436609681 container start 1ce9e84003d6f14cd75d87d86120c1a288707c493835806e52e25b5b4b75b979 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T09:40:49.771 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 bash[65342]: 1ce9e84003d6f14cd75d87d86120c1a288707c493835806e52e25b5b4b75b979 2024-09-10T09:40:49.771 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 systemd[1]: Started Ceph mon.smithi135 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: pidfile_write: ignore empty --pid-file 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: load: jerasure load: lrc 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: RocksDB version: 7.9.2 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Git sha 0 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: DB SUMMARY 2024-09-10T09:40:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: DB Session ID: KP0JDQUH369DSJU0QA1V 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: CURRENT file: CURRENT 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi135/store.db dir, Total Num: 1, files: 000027.sst 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi135/store.db: 000025.log size: 8656150 ; 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.error_if_exists: 0 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.create_if_missing: 0 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.paranoid_checks: 1 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.env: 0x55e42f128940 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T09:40:50.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.info_log: 0x55e4310878c0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.statistics: (nil) 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.use_fsync: 0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_log_file_size: 0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.allow_fallocate: 1 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.use_direct_reads: 0 2024-09-10T09:40:50.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T09:40:50.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T09:40:50.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.db_log_dir: 2024-09-10T09:40:50.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.wal_dir: 2024-09-10T09:40:50.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T09:40:50.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T09:40:50.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T09:40:50.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T09:40:50.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.write_buffer_manager: 0x55e431096dc0 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.unordered_write: 0 2024-09-10T09:40:50.223 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.row_cache: None 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.wal_filter: None 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.two_write_queues: 0 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.wal_compression: 0 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.atomic_flush: 0 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T09:40:50.224 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.log_readahead_size: 0 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_background_jobs: 2 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_background_compactions: -1 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_subcompactions: 1 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T09:40:50.225 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_open_files: -1 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_background_flushes: -1 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Compression algorithms supported: 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kZSTD supported: 0 2024-09-10T09:40:50.226 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kXpressCompression supported: 0 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kBZip2Compression supported: 0 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kLZ4Compression supported: 1 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kZlibCompression supported: 1 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: kSnappyCompression supported: 1 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi135/store.db/MANIFEST-000010 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.merge_operator: 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_filter: None 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T09:40:50.227 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e431087520) 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: index_type: 0 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: data_block_index_type: 0 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: index_shortening: 1 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: checksum: 4 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: no_block_cache: 0 2024-09-10T09:40:50.228 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache: 0x55e43107b1f0 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache_options: 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: capacity : 536870912 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: num_shard_bits : 4 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: strict_capacity_limit : 0 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_cache_compressed: (nil) 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: persistent_cache: (nil) 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_size: 4096 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_size_deviation: 10 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_restart_interval: 16 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: index_block_restart_interval: 1 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: metadata_block_size: 4096 2024-09-10T09:40:50.229 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: partition_filters: 0 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: use_delta_encoding: 1 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: filter_policy: bloomfilter 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: whole_key_filtering: 1 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: verify_compression: 0 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: format_version: 5 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: enable_index_compression: 1 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: block_align: 0 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_auto_readahead_size: 262144 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: prepopulate_block_cache: 0 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: initial_auto_readahead_size: 8192 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T09:40:50.230 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression: NoCompression 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.num_levels: 7 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T09:40:50.231 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T09:40:50.232 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T09:40:50.233 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T09:40:50.234 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.inplace_update_support: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.bloom_locality: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.max_successive_merges: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.ttl: 2592000 2024-09-10T09:40:50.235 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.enable_blob_files: false 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.min_blob_size: 0 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T09:40:50.236 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi135/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12118, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e701ae5e-2723-4d0c-839b-a6773f1ea081 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725961249862078, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725961249889365, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 5137938, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12123, "largest_seqno": 16120, "table_properties": {"data_size": 5123655, "index_size": 9140, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 4101, "raw_key_size": 36096, "raw_average_key_size": 22, "raw_value_size": 5091420, "raw_average_value_size": 3127, "num_data_blocks": 412, "num_entries": 1628, "num_filter_entries": 1628, "num_deletions": 259, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725961249, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e701ae5e-2723-4d0c-839b-a6773f1ea081", "db_session_id": "KP0JDQUH369DSJU0QA1V", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725961249889497, "job": 1, "event": "recovery_finished"} 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi135/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e4310a8e00 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: DB pointer 0x55e4311a4000 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T09:40:50.237 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** DB Stats ** 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** Compaction Stats [default] ** 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: L0 1/0 4.90 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 470.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: L6 1/0 5.49 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-10T09:40:50.238 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Sum 2/0 10.39 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 470.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 470.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** Compaction Stats [default] ** 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 470.4 0.01 0.00 1 0.010 0 0 0.0 0.0 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Flush(GB): cumulative 0.005, interval 0.005 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T09:40:50.239 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Cumulative compaction: 0.00 GB write, 118.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Interval compaction: 0.00 GB write, 118.13 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Block cache BinnedLRUCache@0x55e43107b1f0#2 capacity: 512.00 MB usage: 13.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.53 KB,0.000864267%) IndexBlock(1,9.08 KB,0.00173151%) Misc(1,0.00 KB,0%) 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: starting mon.smithi135 rank 1 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi135 fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???) e2 preinit fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:50.240 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???).mds e16 new map 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???).mds e16 print_map 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: e16 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: legacy client fscid: 1 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Filesystem 'cephfs' (1) 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: fs_name cephfs 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: epoch 16 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:40:50.241 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: tableserver 0 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: root 0 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: session_timeout 60 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: session_autoclose 300 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_file_size 1099511627776 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_xattr_size 65536 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: required_client_features {} 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: last_failure 0 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: last_failure_osd_epoch 47 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:50.242 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: max_mds 1 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: in 0 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: up {0=24281} 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: failed 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: damaged 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: stopped 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: data_pools [3] 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: metadata_pool 2 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: inline_data enabled 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: balancer 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: bal_rank_mask -1 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: standby_count_wanted 1 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: qdb_cluster leader: 0 members: 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:50.243 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: Standby daemons: 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout: [mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-09-10T09:40:50.244 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:49 smithi135 ceph-mon[65362]: mon.smithi135@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-10T09:40:52.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:40:52.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: mon.smithi135 calling monitor election 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: mon.smithi079 calling monitor election 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: mon.smithi079 is new leader, mons smithi079,smithi135 in quorum (ranks 0,1) 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: monmap epoch 3 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: last_changed 2024-09-10T09:40:51.162490+0000 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: created 2024-09-10T09:26:30.512309+0000 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: min_mon_release 19 (squid) 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: election_strategy: 1 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.smithi135 2024-09-10T09:40:52.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: osdmap e50: 6 total, 6 up, 6 in 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: mgrmap e37: smithi079.mhirny(active, since 17s), standbys: smithi135.lbhjof 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:52.464 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:52 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi079"}]: dispatch 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: mon.smithi135 calling monitor election 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: mon.smithi079 calling monitor election 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: mon.smithi079 is new leader, mons smithi079,smithi135 in quorum (ranks 0,1) 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mon metadata", "id": "smithi135"}]: dispatch 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: monmap epoch 3 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: fsid afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: last_changed 2024-09-10T09:40:51.162490+0000 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: created 2024-09-10T09:26:30.512309+0000 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: min_mon_release 19 (squid) 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: election_strategy: 1 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: 0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.smithi079 2024-09-10T09:40:52.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.smithi135 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: osdmap e50: 6 total, 6 up, 6 in 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: mgrmap e37: smithi079.mhirny(active, since 17s), standbys: smithi135.lbhjof 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:52.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:52 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:40:53.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:53 smithi079 ceph-mon[87213]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-10T09:40:53.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:53 smithi135 ceph-mon[65362]: pgmap v12: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-10T09:40:54.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 -- 172.21.15.79:0/296632737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100460 msgr2=0x7fef78100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:54.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 --2- 172.21.15.79:0/296632737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100460 0x7fef78100830 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef74009910 tx=0x7fef74009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:54.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 -- 172.21.15.79:0/296632737 shutdown_connections 2024-09-10T09:40:54.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 --2- 172.21.15.79:0/296632737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100d70 0x7fef781094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:54.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 --2- 172.21.15.79:0/296632737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100460 0x7fef78100830 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:54.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 -- 172.21.15.79:0/296632737 >> 172.21.15.79:0/296632737 conn(0x7fef780748b0 msgr2=0x7fef78074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 -- 172.21.15.79:0/296632737 shutdown_connections 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.775+0000 7fef7fabe700 1 -- 172.21.15.79:0/296632737 wait complete. 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.776+0000 7fef7fabe700 1 Processor -- start 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.776+0000 7fef7fabe700 1 -- start start 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.776+0000 7fef7fabe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 0x7fef78196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.776+0000 7fef7fabe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100d70 0x7fef78197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.776+0000 7fef7fabe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef781977d0 con 0x7fef78100d70 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.776+0000 7fef7fabe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef78197910 con 0x7fef78100460 2024-09-10T09:40:54.780 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d059700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100d70 0x7fef78197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d059700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100d70 0x7fef78197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45826/0 (socket says 172.21.15.79:45826) 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d059700 1 -- 172.21.15.79:0/4062022170 learned_addr learned my addr 172.21.15.79:0/4062022170 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d85a700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 0x7fef78196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d85a700 1 -- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 msgr2=0x7fef78196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d85a700 1 -- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 msgr2=0x7fef78196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d85a700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 0x7fef78196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d85a700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 0x7fef78196cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d059700 1 -- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 msgr2=0x7fef78196cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d059700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 0x7fef78196cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d059700 1 -- 172.21.15.79:0/4062022170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740095f0 con 0x7fef78100d70 2024-09-10T09:40:54.781 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7d059700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100d70 0x7fef78197200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef6800d8d0 tx=0x7fef6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef6effd700 1 -- 172.21.15.79:0/4062022170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef68004a00 con 0x7fef78100d70 2024-09-10T09:40:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef6effd700 1 -- 172.21.15.79:0/4062022170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef680054e0 con 0x7fef78100d70 2024-09-10T09:40:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7819fd30 con 0x7fef78100d70 2024-09-10T09:40:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef6effd700 1 -- 172.21.15.79:0/4062022170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef68009d60 con 0x7fef78100d70 2024-09-10T09:40:54.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.777+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef781a01a0 con 0x7fef78100d70 2024-09-10T09:40:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.778+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef78106bd0 con 0x7fef78100d70 2024-09-10T09:40:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.779+0000 7fef6effd700 1 -- 172.21.15.79:0/4062022170 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fef68004f50 con 0x7fef78100d70 2024-09-10T09:40:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.779+0000 7fef6effd700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef6406e340 0x7fef640707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.779+0000 7fef6effd700 1 -- 172.21.15.79:0/4062022170 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fef6808de90 con 0x7fef78100d70 2024-09-10T09:40:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.779+0000 7fef7d85a700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef6406e340 0x7fef640707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:54.783 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.780+0000 7fef7d85a700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef6406e340 0x7fef640707f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fef7400b5c0 tx=0x7fef7401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:54.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:54.784+0000 7fef6effd700 1 -- 172.21.15.79:0/4062022170 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fef68057100 con 0x7fef78100d70 2024-09-10T09:40:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.010+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef7802ccf0 con 0x7fef6406e340 2024-09-10T09:40:55.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.012+0000 7fef6effd700 1 -- 172.21.15.79:0/4062022170 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fef7802ccf0 con 0x7fef6406e340 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef6406e340 msgr2=0x7fef640707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef6406e340 0x7fef640707f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fef7400b5c0 tx=0x7fef7401a040 comp rx=0 tx=0).stop 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100d70 msgr2=0x7fef78197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100d70 0x7fef78197200 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef6800d8d0 tx=0x7fef6800dc90 comp rx=0 tx=0).stop 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 shutdown_connections 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef6406e340 0x7fef640707f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef78100460 0x7fef78196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 --2- 172.21.15.79:0/4062022170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef78100d70 0x7fef78197200 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 >> 172.21.15.79:0/4062022170 conn(0x7fef780748b0 msgr2=0x7fef78103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 shutdown_connections 2024-09-10T09:40:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.014+0000 7fef7fabe700 1 -- 172.21.15.79:0/4062022170 wait complete. 2024-09-10T09:40:55.025 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:40:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 -- 172.21.15.79:0/3799597738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ffc60 msgr2=0x7f7ed010a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/3799597738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ffc60 0x7f7ed010a6d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009910 tx=0x7f7ec4009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 -- 172.21.15.79:0/3799597738 shutdown_connections 2024-09-10T09:40:55.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/3799597738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ffc60 0x7f7ed010a6d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/3799597738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed00ff350 0x7f7ed00ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 -- 172.21.15.79:0/3799597738 >> 172.21.15.79:0/3799597738 conn(0x7f7ed00748b0 msgr2=0x7f7ed0074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 -- 172.21.15.79:0/3799597738 shutdown_connections 2024-09-10T09:40:55.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.121+0000 7f7ed7c31700 1 -- 172.21.15.79:0/3799597738 wait complete. 2024-09-10T09:40:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed7c31700 1 Processor -- start 2024-09-10T09:40:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed7c31700 1 -- start start 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed7c31700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ff350 0x7f7ed0195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed7c31700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed00ffc60 0x7f7ed0196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed7c31700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed0196ae0 con 0x7f7ed00ff350 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed7c31700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed019a870 con 0x7f7ed00ffc60 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed59cd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ff350 0x7f7ed0195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed59cd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ff350 0x7f7ed0195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45844/0 (socket says 172.21.15.79:45844) 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed59cd700 1 -- 172.21.15.79:0/1645387979 learned_addr learned my addr 172.21.15.79:0/1645387979 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed51cc700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed00ffc60 0x7f7ed0196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed59cd700 1 -- 172.21.15.79:0/1645387979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed00ffc60 msgr2=0x7f7ed0196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed59cd700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed00ffc60 0x7f7ed0196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.122+0000 7f7ed59cd700 1 -- 172.21.15.79:0/1645387979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40095f0 con 0x7f7ed00ff350 2024-09-10T09:40:55.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.123+0000 7f7ed59cd700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ff350 0x7f7ed0195ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8007e90 tx=0x7f7ec800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:55.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.123+0000 7f7eceffd700 1 -- 172.21.15.79:0/1645387979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec800de60 con 0x7f7ed00ff350 2024-09-10T09:40:55.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.123+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed019ab50 con 0x7f7ed00ff350 2024-09-10T09:40:55.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.123+0000 7f7eceffd700 1 -- 172.21.15.79:0/1645387979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ec800f040 con 0x7f7ed00ff350 2024-09-10T09:40:55.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.123+0000 7f7eceffd700 1 -- 172.21.15.79:0/1645387979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec80045b0 con 0x7f7ed00ff350 2024-09-10T09:40:55.126 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.123+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed019b0a0 con 0x7f7ed00ff350 2024-09-10T09:40:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.124+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed0107dd0 con 0x7f7ed00ff350 2024-09-10T09:40:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.125+0000 7f7eceffd700 1 -- 172.21.15.79:0/1645387979 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f7ec8004ad0 con 0x7f7ed00ff350 2024-09-10T09:40:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.125+0000 7f7eceffd700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7eb806e340 0x7f7eb80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.125+0000 7f7eceffd700 1 -- 172.21.15.79:0/1645387979 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7ec808dd20 con 0x7f7ed00ff350 2024-09-10T09:40:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.125+0000 7f7ed51cc700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7eb806e340 0x7f7eb80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.126+0000 7f7ed51cc700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7eb806e340 0x7f7eb80707f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4005b40 tx=0x7f7ec4005ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:55.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.130+0000 7f7eceffd700 1 -- 172.21.15.79:0/1645387979 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ec8057010 con 0x7f7ed00ff350 2024-09-10T09:40:55.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.356+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ed019b310 con 0x7f7eb806e340 2024-09-10T09:40:55.358 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.357+0000 7f7eceffd700 1 -- 172.21.15.79:0/1645387979 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f7ed019b310 con 0x7f7eb806e340 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7eb806e340 msgr2=0x7f7eb80707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7eb806e340 0x7f7eb80707f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4005b40 tx=0x7f7ec4005ab0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ff350 msgr2=0x7f7ed0195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ff350 0x7f7ed0195ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8007e90 tx=0x7f7ec800d3b0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 shutdown_connections 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7eb806e340 0x7f7eb80707f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ed00ff350 0x7f7ed0195ec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 --2- 172.21.15.79:0/1645387979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7ed00ffc60 0x7f7ed0196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 >> 172.21.15.79:0/1645387979 conn(0x7f7ed00748b0 msgr2=0x7f7ed0104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:55.361 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 shutdown_connections 2024-09-10T09:40:55.362 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.360+0000 7f7ed7c31700 1 -- 172.21.15.79:0/1645387979 wait complete. 2024-09-10T09:40:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:55 smithi079 ceph-mon[87213]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.463+0000 7f70938f6700 1 -- 172.21.15.79:0/3205333917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 msgr2=0x7f708c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.463+0000 7f70938f6700 1 --2- 172.21.15.79:0/3205333917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c0ff790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7088009910 tx=0x7f7088009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:55.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.463+0000 7f70938f6700 1 -- 172.21.15.79:0/3205333917 shutdown_connections 2024-09-10T09:40:55.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.463+0000 7f70938f6700 1 --2- 172.21.15.79:0/3205333917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f708c0ffd60 0x7f708c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.463+0000 7f70938f6700 1 --2- 172.21.15.79:0/3205333917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c0ff790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.463+0000 7f70938f6700 1 -- 172.21.15.79:0/3205333917 >> 172.21.15.79:0/3205333917 conn(0x7f708c0fac60 msgr2=0x7f708c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:55.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 -- 172.21.15.79:0/3205333917 shutdown_connections 2024-09-10T09:40:55.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 -- 172.21.15.79:0/3205333917 wait complete. 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 Processor -- start 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 -- start start 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f708c0ffd60 0x7f708c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1978b0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.464+0000 7f70938f6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c197a20 con 0x7f708c0ffd60 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7091692700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7091692700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45862/0 (socket says 172.21.15.79:45862) 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7091692700 1 -- 172.21.15.79:0/2212314096 learned_addr learned my addr 172.21.15.79:0/2212314096 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7090e91700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f708c0ffd60 0x7f708c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7091692700 1 -- 172.21.15.79:0/2212314096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f708c0ffd60 msgr2=0x7f708c197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7091692700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f708c0ffd60 0x7f708c197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7091692700 1 -- 172.21.15.79:0/2212314096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880095f0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7090e91700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f708c0ffd60 0x7f708c197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f7091692700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c196d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7088006010 tx=0x7f708800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f70827fc700 1 -- 172.21.15.79:0/2212314096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f708801d070 con 0x7f708c0ff3c0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f70827fc700 1 -- 172.21.15.79:0/2212314096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7088004fb0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c19fdc0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f70827fc700 1 -- 172.21.15.79:0/2212314096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7088022ea0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.465+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c1a0230 con 0x7f708c0ff3c0 2024-09-10T09:40:55.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.466+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c1076d0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:55 smithi135 ceph-mon[65362]: pgmap v13: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:55.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.467+0000 7f70827fc700 1 -- 172.21.15.79:0/2212314096 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f7088022470 con 0x7f708c0ff3c0 2024-09-10T09:40:55.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.467+0000 7f70827fc700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f707806e340 0x7f70780707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.467+0000 7f70827fc700 1 -- 172.21.15.79:0/2212314096 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f708808f6f0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.467+0000 7f7090e91700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f707806e340 0x7f70780707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.470 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.468+0000 7f7090e91700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f707806e340 0x7f70780707f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f707c005fd0 tx=0x7f707c005e80 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:55.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.471+0000 7f70827fc700 1 -- 172.21.15.79:0/2212314096 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7088058bb0 con 0x7f708c0ff3c0 2024-09-10T09:40:55.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.682+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f708c0694f0 con 0x7f707806e340 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.691+0000 7f70827fc700 1 -- 172.21.15.79:0/2212314096 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f708c0694f0 con 0x7f707806e340 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (2m) 16s ago 12m 15.6M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (13m) 16s ago 13m 7960k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (12m) 1s ago 12m 7944k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (13m) 16s ago 13m 6669k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (12m) 1s ago 12m 6669k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (106s) 16s ago 12m 75.2M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:40:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (7m) 16s ago 7m 15.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (7m) 16s ago 7m 97.5M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (7m) 1s ago 7m 152M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (7m) 1s ago 7m 19.8M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (3m) 16s ago 14m 472M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (3m) 1s ago 11m 438M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (28s) 16s ago 14m 29.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (6s) 1s ago 11m 26.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (2m) 16s ago 12m 15.2M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (2m) 1s ago 11m 16.2M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (11m) 16s ago 11m 255M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (10m) 16s ago 10m 263M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (10m) 16s ago 10m 225M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:40:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (9m) 1s ago 9m 290M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:40:55.694 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (9m) 1s ago 9m 256M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:40:55.694 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (8m) 1s ago 8m 254M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:40:55.694 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (2m) 16s ago 12m 65.2M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:40:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f707806e340 msgr2=0x7f70780707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f707806e340 0x7f70780707f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f707c005fd0 tx=0x7f707c005e80 comp rx=0 tx=0).stop 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 msgr2=0x7f708c196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c196d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7088006010 tx=0x7f708800be20 comp rx=0 tx=0).stop 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 shutdown_connections 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f707806e340 0x7f70780707f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f708c0ff3c0 0x7f708c196d50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 --2- 172.21.15.79:0/2212314096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f708c0ffd60 0x7f708c197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 >> 172.21.15.79:0/2212314096 conn(0x7f708c0fac60 msgr2=0x7f708c0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 shutdown_connections 2024-09-10T09:40:55.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.693+0000 7f70938f6700 1 -- 172.21.15.79:0/2212314096 wait complete. 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 -- 172.21.15.79:0/583171620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040ffbd0 msgr2=0x7fe604100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 --2- 172.21.15.79:0/583171620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040ffbd0 0x7fe604100040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009910 tx=0x7fe5ec009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 -- 172.21.15.79:0/583171620 shutdown_connections 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 --2- 172.21.15.79:0/583171620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6040ffbd0 0x7fe604100040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 --2- 172.21.15.79:0/583171620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe604104130 0x7fe604104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 -- 172.21.15.79:0/583171620 >> 172.21.15.79:0/583171620 conn(0x7fe604075130 msgr2=0x7fe604075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 -- 172.21.15.79:0/583171620 shutdown_connections 2024-09-10T09:40:55.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.798+0000 7fe609a20700 1 -- 172.21.15.79:0/583171620 wait complete. 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe609a20700 1 Processor -- start 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe609a20700 1 -- start start 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe609a20700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6040ffbd0 0x7fe604194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe609a20700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe604104130 0x7fe604195390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe609a20700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe604195a70 con 0x7fe604104130 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe609a20700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe604199800 con 0x7fe6040ffbd0 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe5fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe604104130 0x7fe604195390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe5fbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe604104130 0x7fe604195390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45882/0 (socket says 172.21.15.79:45882) 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe5fbfff700 1 -- 172.21.15.79:0/2248571877 learned_addr learned my addr 172.21.15.79:0/2248571877 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe602ffd700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6040ffbd0 0x7fe604194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe5fbfff700 1 -- 172.21.15.79:0/2248571877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6040ffbd0 msgr2=0x7fe604194e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe5fbfff700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6040ffbd0 0x7fe604194e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.799+0000 7fe5fbfff700 1 -- 172.21.15.79:0/2248571877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0095f0 con 0x7fe604104130 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.800+0000 7fe5fbfff700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe604104130 0x7fe604195390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec006010 tx=0x7fe5ec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.800+0000 7fe608a1e700 1 -- 172.21.15.79:0/2248571877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec01d070 con 0x7fe604104130 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.800+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe604199a80 con 0x7fe604104130 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.800+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe604199f70 con 0x7fe604104130 2024-09-10T09:40:55.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.800+0000 7fe608a1e700 1 -- 172.21.15.79:0/2248571877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5ec00f460 con 0x7fe604104130 2024-09-10T09:40:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.800+0000 7fe608a1e700 1 -- 172.21.15.79:0/2248571877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec017630 con 0x7fe604104130 2024-09-10T09:40:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.801+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60404f2a0 con 0x7fe604104130 2024-09-10T09:40:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.802+0000 7fe608a1e700 1 -- 172.21.15.79:0/2248571877 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fe5ec00f5d0 con 0x7fe604104130 2024-09-10T09:40:55.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.803+0000 7fe608a1e700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe5f006e330 0x7fe5f00707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.803+0000 7fe608a1e700 1 -- 172.21.15.79:0/2248571877 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe5ec08f6c0 con 0x7fe604104130 2024-09-10T09:40:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.803+0000 7fe602ffd700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe5f006e330 0x7fe5f00707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:55.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.803+0000 7fe602ffd700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe5f006e330 0x7fe5f00707e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009a10 tx=0x7fe5f4009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:55.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:55.807+0000 7fe608a1e700 1 -- 172.21.15.79:0/2248571877 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe5ec058a70 con 0x7fe604104130 2024-09-10T09:40:56.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.095+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe60419a1e0 con 0x7fe604104130 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.096+0000 7fe608a1e700 1 -- 172.21.15.79:0/2248571877 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7fe5ec05c130 con 0x7fe604104130 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:40:56.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:40:56.098 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:40:56.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe5f006e330 msgr2=0x7fe5f00707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe5f006e330 0x7fe5f00707e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009a10 tx=0x7fe5f4009190 comp rx=0 tx=0).stop 2024-09-10T09:40:56.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe604104130 msgr2=0x7fe604195390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe604104130 0x7fe604195390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec006010 tx=0x7fe5ec00bd70 comp rx=0 tx=0).stop 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 shutdown_connections 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe5f006e330 0x7fe5f00707e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6040ffbd0 0x7fe604194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 --2- 172.21.15.79:0/2248571877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe604104130 0x7fe604195390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 >> 172.21.15.79:0/2248571877 conn(0x7fe604075130 msgr2=0x7fe6040fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 shutdown_connections 2024-09-10T09:40:56.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.098+0000 7fe609a20700 1 -- 172.21.15.79:0/2248571877 wait complete. 2024-09-10T09:40:56.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.203+0000 7fca082ce700 1 -- 172.21.15.79:0/1145172897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 msgr2=0x7fca00103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.203+0000 7fca082ce700 1 --2- 172.21.15.79:0/1145172897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca00103d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009910 tx=0x7fc9f0009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:56.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.203+0000 7fca082ce700 1 -- 172.21.15.79:0/1145172897 shutdown_connections 2024-09-10T09:40:56.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.203+0000 7fca082ce700 1 --2- 172.21.15.79:0/1145172897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca00103d30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.203+0000 7fca082ce700 1 --2- 172.21.15.79:0/1145172897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca000ff3c0 0x7fca000ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 -- 172.21.15.79:0/1145172897 >> 172.21.15.79:0/1145172897 conn(0x7fca000fac60 msgr2=0x7fca000fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 -- 172.21.15.79:0/1145172897 shutdown_connections 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 -- 172.21.15.79:0/1145172897 wait complete. 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 Processor -- start 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 -- start start 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca000ff3c0 0x7fca00194db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca001952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca001959d0 con 0x7fca000ffd60 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca082ce700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca00199760 con 0x7fca000ff3c0 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.204+0000 7fca05869700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca001952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca05869700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca001952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45896/0 (socket says 172.21.15.79:45896) 2024-09-10T09:40:56.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca05869700 1 -- 172.21.15.79:0/634568452 learned_addr learned my addr 172.21.15.79:0/634568452 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca0606a700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca000ff3c0 0x7fca00194db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca05869700 1 -- 172.21.15.79:0/634568452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca000ff3c0 msgr2=0x7fca00194db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca05869700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca000ff3c0 0x7fca00194db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca05869700 1 -- 172.21.15.79:0/634568452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00095f0 con 0x7fca000ffd60 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca05869700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca001952f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000bda0 tx=0x7fc9f000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fc9f77fe700 1 -- 172.21.15.79:0/634568452 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f001d070 con 0x7fca000ffd60 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fc9f77fe700 1 -- 172.21.15.79:0/634568452 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9f0005dc0 con 0x7fca000ffd60 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca001999e0 con 0x7fca000ffd60 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fc9f77fe700 1 -- 172.21.15.79:0/634568452 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f0017400 con 0x7fca000ffd60 2024-09-10T09:40:56.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.205+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca00199ed0 con 0x7fca000ffd60 2024-09-10T09:40:56.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.206+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca00107730 con 0x7fca000ffd60 2024-09-10T09:40:56.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.207+0000 7fc9f77fe700 1 -- 172.21.15.79:0/634568452 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fc9f000f6f0 con 0x7fca000ffd60 2024-09-10T09:40:56.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.207+0000 7fc9f77fe700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc9ec06e330 0x7fc9ec0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.207+0000 7fc9f77fe700 1 -- 172.21.15.79:0/634568452 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc9f008f570 con 0x7fca000ffd60 2024-09-10T09:40:56.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.207+0000 7fca0606a700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc9ec06e330 0x7fc9ec0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.208+0000 7fca0606a700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc9ec06e330 0x7fc9ec0707e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc007be0 tx=0x7fc9fc0073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:56.212 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.212+0000 7fc9f77fe700 1 -- 172.21.15.79:0/634568452 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc9f0058860 con 0x7fca000ffd60 2024-09-10T09:40:56.458 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.457+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fca0004f2a0 con 0x7fca000ffd60 2024-09-10T09:40:56.458 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:56 smithi079 ceph-mon[87213]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:56.458 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:56 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2248571877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:56.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.457+0000 7fc9f77fe700 1 -- 172.21.15.79:0/634568452 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7fc9f005bf20 con 0x7fca000ffd60 2024-09-10T09:40:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:40:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:40:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:40:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:40:56.459 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:40:56.460 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:40:56.461 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:56.462 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:56.463 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:56.463 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:40:56.463 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:40:56.463 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:56.463 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc9ec06e330 msgr2=0x7fc9ec0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc9ec06e330 0x7fc9ec0707e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc007be0 tx=0x7fc9fc0073d0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 msgr2=0x7fca001952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca001952f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000bda0 tx=0x7fc9f000bdd0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 shutdown_connections 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc9ec06e330 0x7fc9ec0707e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca000ff3c0 0x7fca00194db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.464 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 --2- 172.21.15.79:0/634568452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca000ffd60 0x7fca001952f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 >> 172.21.15.79:0/634568452 conn(0x7fca000fac60 msgr2=0x7fca000fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:56.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 shutdown_connections 2024-09-10T09:40:56.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.459+0000 7fca082ce700 1 -- 172.21.15.79:0/634568452 wait complete. 2024-09-10T09:40:56.465 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:40:56.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:56 smithi135 ceph-mon[65362]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:56.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:56 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2248571877' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:40:56.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 -- 172.21.15.79:0/2853431096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 msgr2=0x7fae9c100890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 --2- 172.21.15.79:0/2853431096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c100890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae9400b0a0 tx=0x7fae9400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 -- 172.21.15.79:0/2853431096 shutdown_connections 2024-09-10T09:40:56.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 --2- 172.21.15.79:0/2853431096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae9c100e60 0x7fae9c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 --2- 172.21.15.79:0/2853431096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c100890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 -- 172.21.15.79:0/2853431096 >> 172.21.15.79:0/2853431096 conn(0x7fae9c0fbd80 msgr2=0x7fae9c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:56.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 -- 172.21.15.79:0/2853431096 shutdown_connections 2024-09-10T09:40:56.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.565+0000 7faea12ab700 1 -- 172.21.15.79:0/2853431096 wait complete. 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7faea12ab700 1 Processor -- start 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7faea12ab700 1 -- start start 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7faea12ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7faea12ab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae9c100e60 0x7fae9c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7faea12ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c196bb0 con 0x7fae9c1004c0 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7faea12ab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c19a8d0 con 0x7fae9c100e60 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7fae9affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7fae9affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45922/0 (socket says 172.21.15.79:45922) 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7fae9affd700 1 -- 172.21.15.79:0/1212730481 learned_addr learned my addr 172.21.15.79:0/1212730481 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7fae9a7fc700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae9c100e60 0x7fae9c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7fae9affd700 1 -- 172.21.15.79:0/1212730481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae9c100e60 msgr2=0x7fae9c1964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7fae9affd700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae9c100e60 0x7fae9c1964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.566+0000 7fae9affd700 1 -- 172.21.15.79:0/1212730481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94009d00 con 0x7fae9c1004c0 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.567+0000 7fae9affd700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c195f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae94000f80 tx=0x7fae9400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.567+0000 7fae93fff700 1 -- 172.21.15.79:0/1212730481 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9400e040 con 0x7fae9c1004c0 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.567+0000 7fae93fff700 1 -- 172.21.15.79:0/1212730481 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae94003de0 con 0x7fae9c1004c0 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.567+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c19ab50 con 0x7fae9c1004c0 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.567+0000 7fae93fff700 1 -- 172.21.15.79:0/1212730481 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae9401d7d0 con 0x7fae9c1004c0 2024-09-10T09:40:56.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.567+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c19b040 con 0x7fae9c1004c0 2024-09-10T09:40:56.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.568+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c1087d0 con 0x7fae9c1004c0 2024-09-10T09:40:56.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.568+0000 7fae93fff700 1 -- 172.21.15.79:0/1212730481 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fae94004040 con 0x7fae9c1004c0 2024-09-10T09:40:56.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.569+0000 7fae93fff700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fae8806e340 0x7fae880707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.569+0000 7fae9a7fc700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fae8806e340 0x7fae880707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.569+0000 7fae93fff700 1 -- 172.21.15.79:0/1212730481 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fae9408fa90 con 0x7fae9c1004c0 2024-09-10T09:40:56.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.569+0000 7fae9a7fc700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fae8806e340 0x7fae880707f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae9c197540 tx=0x7fae84009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:56.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.573+0000 7fae93fff700 1 -- 172.21.15.79:0/1212730481 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fae94058d80 con 0x7fae9c1004c0 2024-09-10T09:40:56.795 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.794+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae9c19b2b0 con 0x7fae8806e340 2024-09-10T09:40:56.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.795+0000 7fae93fff700 1 -- 172.21.15.79:0/1212730481 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fae9c19b2b0 con 0x7fae8806e340 2024-09-10T09:40:56.796 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "4/23 daemons upgraded", 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading mon daemons", 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:40:56.797 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fae8806e340 msgr2=0x7fae880707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fae8806e340 0x7fae880707f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fae9c197540 tx=0x7fae84009190 comp rx=0 tx=0).stop 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 msgr2=0x7fae9c195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c195f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae94000f80 tx=0x7fae9400cd20 comp rx=0 tx=0).stop 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 shutdown_connections 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fae8806e340 0x7fae880707f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae9c1004c0 0x7fae9c195f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 --2- 172.21.15.79:0/1212730481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae9c100e60 0x7fae9c1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 >> 172.21.15.79:0/1212730481 conn(0x7fae9c0fbd80 msgr2=0x7fae9c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:56.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 shutdown_connections 2024-09-10T09:40:56.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.798+0000 7faea12ab700 1 -- 172.21.15.79:0/1212730481 wait complete. 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.901+0000 7efc14d85700 1 -- 172.21.15.79:0/2481256320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 msgr2=0x7efc1010a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.901+0000 7efc14d85700 1 --2- 172.21.15.79:0/2481256320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc1010a750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc04009910 tx=0x7efc04009c20 comp rx=0 tx=0).stop 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 -- 172.21.15.79:0/2481256320 shutdown_connections 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 --2- 172.21.15.79:0/2481256320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc1010a750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 --2- 172.21.15.79:0/2481256320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc100ff3d0 0x7efc100ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 -- 172.21.15.79:0/2481256320 >> 172.21.15.79:0/2481256320 conn(0x7efc10074930 msgr2=0x7efc10074d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 -- 172.21.15.79:0/2481256320 shutdown_connections 2024-09-10T09:40:56.903 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 -- 172.21.15.79:0/2481256320 wait complete. 2024-09-10T09:40:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 Processor -- start 2024-09-10T09:40:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.902+0000 7efc14d85700 1 -- start start 2024-09-10T09:40:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc14d85700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc100ff3d0 0x7efc101005b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc14d85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc10100af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.905 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc14d85700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10101030 con 0x7efc100ffce0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc14d85700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10101170 con 0x7efc100ff3d0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc10100af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc10100af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45946/0 (socket says 172.21.15.79:45946) 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0dd9b700 1 -- 172.21.15.79:0/3984111525 learned_addr learned my addr 172.21.15.79:0/3984111525 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0e59c700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc100ff3d0 0x7efc101005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0dd9b700 1 -- 172.21.15.79:0/3984111525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc100ff3d0 msgr2=0x7efc101005b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0dd9b700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc100ff3d0 0x7efc101005b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0dd9b700 1 -- 172.21.15.79:0/3984111525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040095f0 con 0x7efc100ffce0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0e59c700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc100ff3d0 0x7efc101005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc0dd9b700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc10100af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc040092e0 tx=0x7efc0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efbff7fe700 1 -- 172.21.15.79:0/3984111525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc0401d070 con 0x7efc100ffce0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efbff7fe700 1 -- 172.21.15.79:0/3984111525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc04005e00 con 0x7efc100ffce0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc101a1fa0 con 0x7efc100ffce0 2024-09-10T09:40:56.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efbff7fe700 1 -- 172.21.15.79:0/3984111525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc04017400 con 0x7efc100ffce0 2024-09-10T09:40:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.903+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc101a23b0 con 0x7efc100ffce0 2024-09-10T09:40:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.904+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc10107e50 con 0x7efc100ffce0 2024-09-10T09:40:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.905+0000 7efbff7fe700 1 -- 172.21.15.79:0/3984111525 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7efc0400f460 con 0x7efc100ffce0 2024-09-10T09:40:56.907 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.905+0000 7efbff7fe700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efbf806e330 0x7efbf80707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:40:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.905+0000 7efbff7fe700 1 -- 172.21.15.79:0/3984111525 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efc0408f6a0 con 0x7efc100ffce0 2024-09-10T09:40:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.905+0000 7efc0e59c700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efbf806e330 0x7efbf80707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:40:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.906+0000 7efc0e59c700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efbf806e330 0x7efbf80707e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc00005d90 tx=0x7efc00005d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:40:56.910 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:56.910+0000 7efbff7fe700 1 -- 172.21.15.79:0/3984111525 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efc04058990 con 0x7efc100ffce0 2024-09-10T09:40:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.193+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efc10107830 con 0x7efc100ffce0 2024-09-10T09:40:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.194+0000 7efbff7fe700 1 -- 172.21.15.79:0/3984111525 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7efc0405c050 con 0x7efc100ffce0 2024-09-10T09:40:57.195 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:57.195 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:40:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:40:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efbf806e330 msgr2=0x7efbf80707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:57.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efbf806e330 0x7efbf80707e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc00005d90 tx=0x7efc00005d00 comp rx=0 tx=0).stop 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 msgr2=0x7efc10100af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc10100af0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc040092e0 tx=0x7efc0400be20 comp rx=0 tx=0).stop 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 shutdown_connections 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efbf806e330 0x7efbf80707e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc100ff3d0 0x7efc101005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 --2- 172.21.15.79:0/3984111525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc100ffce0 0x7efc10100af0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.196+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 >> 172.21.15.79:0/3984111525 conn(0x7efc10074930 msgr2=0x7efc10104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.197+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 shutdown_connections 2024-09-10T09:40:57.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:40:57.197+0000 7efc14d85700 1 -- 172.21.15.79:0/3984111525 wait complete. 2024-09-10T09:40:57.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:57 smithi079 ceph-mon[87213]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:57.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:57 smithi079 ceph-mon[87213]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:57.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:57 smithi079 ceph-mon[87213]: pgmap v14: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:57.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:57 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/634568452' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:40:57.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:57 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3984111525' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:40:57.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:57 smithi135 ceph-mon[65362]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:57.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:57 smithi135 ceph-mon[65362]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:57.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:57 smithi135 ceph-mon[65362]: pgmap v14: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:40:57.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:57 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/634568452' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:40:57.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:57 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3984111525' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:40:58.369 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:58 smithi135 ceph-mon[65362]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:58.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:58 smithi079 ceph-mon[87213]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:40:59.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: pgmap v15: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:59.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:40:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:40:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:40:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:59.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: pgmap v15: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:40:59.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:59.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:59.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:40:59.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:40:59.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:40:59.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:40:59.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:40:59.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:40:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:00.337 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:00 smithi135 ceph-mon[65362]: Detected new or changed devices on smithi135 2024-09-10T09:41:00.337 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:00 smithi135 ceph-mon[65362]: Reconfiguring mon.smithi079 (monmap changed)... 2024-09-10T09:41:00.338 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:00 smithi135 ceph-mon[65362]: Reconfiguring daemon mon.smithi079 on smithi079 2024-09-10T09:41:00.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:00 smithi079 ceph-mon[87213]: Detected new or changed devices on smithi135 2024-09-10T09:41:00.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:00 smithi079 ceph-mon[87213]: Reconfiguring mon.smithi079 (monmap changed)... 2024-09-10T09:41:00.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:00 smithi079 ceph-mon[87213]: Reconfiguring daemon mon.smithi079 on smithi079 2024-09-10T09:41:01.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:01 smithi079 ceph-mon[87213]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:01.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:01 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:01.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:01 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:01.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:01 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:41:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:01 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:41:01.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:01 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:01.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:01 smithi135 ceph-mon[65362]: pgmap v16: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:01.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:01 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:01.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:01 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:01.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:01 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi079.mhirny", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:41:01.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:01 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:41:01.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:01 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:02.511 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: Reconfiguring mgr.smithi079.mhirny (monmap changed)... 2024-09-10T09:41:02.511 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: Reconfiguring daemon mgr.smithi079.mhirny on smithi079 2024-09-10T09:41:02.511 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:02.512 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:02.512 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:02.512 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:02.512 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T09:41:02.512 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi079"}]: dispatch 2024-09-10T09:41:02.512 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:02 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:02.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: Reconfiguring mgr.smithi079.mhirny (monmap changed)... 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: Reconfiguring daemon mgr.smithi079.mhirny on smithi079 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi079"}]: dispatch 2024-09-10T09:41:02.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:02 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:03.299 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:03 smithi079 ceph-mon[87213]: Reconfiguring ceph-exporter.smithi079 (monmap changed)... 2024-09-10T09:41:03.299 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:03 smithi079 ceph-mon[87213]: Unable to update caps for client.ceph-exporter.smithi079 2024-09-10T09:41:03.299 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:03 smithi079 ceph-mon[87213]: Reconfiguring daemon ceph-exporter.smithi079 on smithi079 2024-09-10T09:41:03.299 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:03 smithi079 ceph-mon[87213]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:03.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:03 smithi135 ceph-mon[65362]: Reconfiguring ceph-exporter.smithi079 (monmap changed)... 2024-09-10T09:41:03.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:03 smithi135 ceph-mon[65362]: Unable to update caps for client.ceph-exporter.smithi079 2024-09-10T09:41:03.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:03 smithi135 ceph-mon[65362]: Reconfiguring daemon ceph-exporter.smithi079 on smithi079 2024-09-10T09:41:03.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:03 smithi135 ceph-mon[65362]: pgmap v17: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:04.690 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:04.690 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:04.690 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: Reconfiguring crash.smithi079 (monmap changed)... 2024-09-10T09:41:04.690 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:04.690 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:04.690 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: Reconfiguring daemon crash.smithi079 on smithi079 2024-09-10T09:41:04.691 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:04.691 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: Reconfiguring crash.smithi079 (monmap changed)... 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: Reconfiguring daemon crash.smithi079 on smithi079 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: pgmap v18: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:04.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:06.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:05 smithi079 ceph-mon[87213]: Reconfiguring osd.0 (monmap changed)... 2024-09-10T09:41:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:41:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:05 smithi079 ceph-mon[87213]: Reconfiguring daemon osd.0 on smithi079 2024-09-10T09:41:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:05 smithi135 ceph-mon[65362]: Reconfiguring osd.0 (monmap changed)... 2024-09-10T09:41:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:41:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:05 smithi135 ceph-mon[65362]: Reconfiguring daemon osd.0 on smithi079 2024-09-10T09:41:06.925 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:06 smithi079 ceph-mon[87213]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:06.926 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:06 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:06.926 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:06 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:06.926 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:06 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:41:06.926 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:06 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:07.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:06 smithi135 ceph-mon[65362]: pgmap v19: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:07.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:06 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:07.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:06 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:07.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:06 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:41:07.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:06 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:07.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:07 smithi079 ceph-mon[87213]: Reconfiguring osd.1 (monmap changed)... 2024-09-10T09:41:07.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:07 smithi079 ceph-mon[87213]: Reconfiguring daemon osd.1 on smithi079 2024-09-10T09:41:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:07 smithi135 ceph-mon[65362]: Reconfiguring osd.1 (monmap changed)... 2024-09-10T09:41:08.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:07 smithi135 ceph-mon[65362]: Reconfiguring daemon osd.1 on smithi079 2024-09-10T09:41:09.127 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:08 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:09.127 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:08 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:09.127 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:08 smithi079 ceph-mon[87213]: Reconfiguring osd.2 (monmap changed)... 2024-09-10T09:41:09.128 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:08 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:41:09.128 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:08 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:09.128 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:08 smithi079 ceph-mon[87213]: Reconfiguring daemon osd.2 on smithi079 2024-09-10T09:41:09.128 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:08 smithi079 ceph-mon[87213]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:09.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:08 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:09.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:08 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:09.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:08 smithi135 ceph-mon[65362]: Reconfiguring osd.2 (monmap changed)... 2024-09-10T09:41:09.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:08 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:41:09.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:08 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:09.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:08 smithi135 ceph-mon[65362]: Reconfiguring daemon osd.2 on smithi079 2024-09-10T09:41:09.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:08 smithi135 ceph-mon[65362]: pgmap v20: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:10.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:10.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:10.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:10 smithi135 ceph-mon[65362]: Reconfiguring mds.cephfs.smithi079.pqgxjw (monmap changed)... 2024-09-10T09:41:10.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:10.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:10.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:10 smithi135 ceph-mon[65362]: Reconfiguring daemon mds.cephfs.smithi079.pqgxjw on smithi079 2024-09-10T09:41:10.568 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:10.568 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:10.568 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:10 smithi079 ceph-mon[87213]: Reconfiguring mds.cephfs.smithi079.pqgxjw (monmap changed)... 2024-09-10T09:41:10.568 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:10.568 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:10.569 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:10 smithi079 ceph-mon[87213]: Reconfiguring daemon mds.cephfs.smithi079.pqgxjw on smithi079 2024-09-10T09:41:11.241 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:11 smithi079 ceph-mon[87213]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:11.241 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:11 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:11.241 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:11 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:11.241 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:11 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:11.241 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:11 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:11 smithi135 ceph-mon[65362]: pgmap v21: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:11.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:11 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:11.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:11 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:11.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:11 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:11.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:11 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: Reconfiguring mds.cephfs.smithi079.wpfdzn (monmap changed)... 2024-09-10T09:41:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: Reconfiguring daemon mds.cephfs.smithi079.wpfdzn on smithi079 2024-09-10T09:41:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T09:41:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi135"}]: dispatch 2024-09-10T09:41:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:12.548 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: Reconfiguring mds.cephfs.smithi079.wpfdzn (monmap changed)... 2024-09-10T09:41:12.548 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: Reconfiguring daemon mds.cephfs.smithi079.wpfdzn on smithi079 2024-09-10T09:41:12.548 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:12.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:12.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:12.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:41:12.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-10T09:41:12.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi135"}]: dispatch 2024-09-10T09:41:12.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:13.495 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:13 smithi135 ceph-mon[65362]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:13.496 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:13 smithi135 ceph-mon[65362]: Reconfiguring ceph-exporter.smithi135 (monmap changed)... 2024-09-10T09:41:13.496 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:13 smithi135 ceph-mon[65362]: Unable to update caps for client.ceph-exporter.smithi135 2024-09-10T09:41:13.496 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:13 smithi135 ceph-mon[65362]: Reconfiguring daemon ceph-exporter.smithi135 on smithi135 2024-09-10T09:41:13.506 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:13 smithi079 ceph-mon[87213]: pgmap v22: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:13.506 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:13 smithi079 ceph-mon[87213]: Reconfiguring ceph-exporter.smithi135 (monmap changed)... 2024-09-10T09:41:13.506 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:13 smithi079 ceph-mon[87213]: Unable to update caps for client.ceph-exporter.smithi135 2024-09-10T09:41:13.506 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:13 smithi079 ceph-mon[87213]: Reconfiguring daemon ceph-exporter.smithi135 on smithi135 2024-09-10T09:41:14.802 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:14.802 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:14.802 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:14 smithi135 ceph-mon[65362]: Reconfiguring crash.smithi135 (monmap changed)... 2024-09-10T09:41:14.802 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:14.802 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:14.802 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:14 smithi135 ceph-mon[65362]: Reconfiguring daemon crash.smithi135 on smithi135 2024-09-10T09:41:14.802 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:14 smithi135 ceph-mon[65362]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:14.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:14 smithi079 ceph-mon[87213]: Reconfiguring crash.smithi135 (monmap changed)... 2024-09-10T09:41:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:14 smithi079 ceph-mon[87213]: Reconfiguring daemon crash.smithi135 on smithi135 2024-09-10T09:41:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:14 smithi079 ceph-mon[87213]: pgmap v23: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:16.034 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:16.034 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:16.034 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:15 smithi135 ceph-mon[65362]: Reconfiguring mgr.smithi135.lbhjof (monmap changed)... 2024-09-10T09:41:16.034 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:41:16.034 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:41:16.034 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:16.035 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:15 smithi135 ceph-mon[65362]: Reconfiguring daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:41:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:16.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:15 smithi079 ceph-mon[87213]: Reconfiguring mgr.smithi135.lbhjof (monmap changed)... 2024-09-10T09:41:16.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi135.lbhjof", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T09:41:16.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T09:41:16.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:16.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:15 smithi079 ceph-mon[87213]: Reconfiguring daemon mgr.smithi135.lbhjof on smithi135 2024-09-10T09:41:17.448 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: Reconfiguring mon.smithi135 (monmap changed)... 2024-09-10T09:41:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:41:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:41:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:17.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:17 smithi135 ceph-mon[65362]: Reconfiguring daemon mon.smithi135 on smithi135 2024-09-10T09:41:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: pgmap v24: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: Reconfiguring mon.smithi135 (monmap changed)... 2024-09-10T09:41:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T09:41:17.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T09:41:17.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:17.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:17 smithi079 ceph-mon[87213]: Reconfiguring daemon mon.smithi135 on smithi135 2024-09-10T09:41:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:18 smithi079 ceph-mon[87213]: Reconfiguring osd.3 (monmap changed)... 2024-09-10T09:41:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:41:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:18 smithi079 ceph-mon[87213]: Reconfiguring daemon osd.3 on smithi135 2024-09-10T09:41:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:18 smithi079 ceph-mon[87213]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:18.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:18 smithi135 ceph-mon[65362]: Reconfiguring osd.3 (monmap changed)... 2024-09-10T09:41:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:41:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:18 smithi135 ceph-mon[65362]: Reconfiguring daemon osd.3 on smithi135 2024-09-10T09:41:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:18 smithi135 ceph-mon[65362]: pgmap v25: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:20.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:20.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:20.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:20 smithi079 ceph-mon[87213]: Reconfiguring osd.4 (monmap changed)... 2024-09-10T09:41:20.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:41:20.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:20.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:20 smithi079 ceph-mon[87213]: Reconfiguring daemon osd.4 on smithi135 2024-09-10T09:41:20.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:20.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:20.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:20.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:20 smithi135 ceph-mon[65362]: Reconfiguring osd.4 (monmap changed)... 2024-09-10T09:41:20.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:41:20.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:20.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:20 smithi135 ceph-mon[65362]: Reconfiguring daemon osd.4 on smithi135 2024-09-10T09:41:20.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:21.316 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:21 smithi135 ceph-mon[65362]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:21.316 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:21 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:21.316 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:21 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:21.316 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:21 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T09:41:21.316 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:21 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:21 smithi079 ceph-mon[87213]: pgmap v26: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:21 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:21 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:21.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:21 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T09:41:21.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:21 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:22.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:22 smithi135 ceph-mon[65362]: Reconfiguring osd.5 (monmap changed)... 2024-09-10T09:41:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:22 smithi135 ceph-mon[65362]: Reconfiguring daemon osd.5 on smithi135 2024-09-10T09:41:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:22.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:22 smithi079 ceph-mon[87213]: Reconfiguring osd.5 (monmap changed)... 2024-09-10T09:41:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:22 smithi079 ceph-mon[87213]: Reconfiguring daemon osd.5 on smithi135 2024-09-10T09:41:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:22.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:22.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:23.319 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:23 smithi135 ceph-mon[65362]: Reconfiguring mds.cephfs.smithi135.lvmrsq (monmap changed)... 2024-09-10T09:41:23.319 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:23 smithi135 ceph-mon[65362]: Reconfiguring daemon mds.cephfs.smithi135.lvmrsq on smithi135 2024-09-10T09:41:23.319 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:23 smithi135 ceph-mon[65362]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:23 smithi079 ceph-mon[87213]: Reconfiguring mds.cephfs.smithi135.lvmrsq (monmap changed)... 2024-09-10T09:41:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:23 smithi079 ceph-mon[87213]: Reconfiguring daemon mds.cephfs.smithi135.lvmrsq on smithi135 2024-09-10T09:41:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:23 smithi079 ceph-mon[87213]: pgmap v27: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:24.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:24 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:24.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:24 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:24.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:24 smithi079 ceph-mon[87213]: Reconfiguring mds.cephfs.smithi135.oqqtlp (monmap changed)... 2024-09-10T09:41:24.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:24 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:24.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:24 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:24.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:24 smithi079 ceph-mon[87213]: Reconfiguring daemon mds.cephfs.smithi135.oqqtlp on smithi135 2024-09-10T09:41:24.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:24 smithi079 ceph-mon[87213]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:24 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:24 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:24 smithi135 ceph-mon[65362]: Reconfiguring mds.cephfs.smithi135.oqqtlp (monmap changed)... 2024-09-10T09:41:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:24 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:41:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:24 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:24 smithi135 ceph-mon[65362]: Reconfiguring daemon mds.cephfs.smithi135.oqqtlp on smithi135 2024-09-10T09:41:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:24 smithi135 ceph-mon[65362]: pgmap v28: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:26.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all mon 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]: dispatch 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]': finished 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]: dispatch 2024-09-10T09:41:26.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]': finished 2024-09-10T09:41:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:26.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all mon 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]: dispatch 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi079"}]': finished 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]: dispatch 2024-09-10T09:41:26.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi135"}]': finished 2024-09-10T09:41:27.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 -- 172.21.15.79:0/2614522131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 msgr2=0x7f4b74103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 --2- 172.21.15.79:0/2614522131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74103d30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009910 tx=0x7f4b64009c20 comp rx=0 tx=0).stop 2024-09-10T09:41:27.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 -- 172.21.15.79:0/2614522131 shutdown_connections 2024-09-10T09:41:27.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 --2- 172.21.15.79:0/2614522131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74103d30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 --2- 172.21.15.79:0/2614522131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b740ff3c0 0x7f4b740ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 -- 172.21.15.79:0/2614522131 >> 172.21.15.79:0/2614522131 conn(0x7f4b740fac80 msgr2=0x7f4b740fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:27.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 -- 172.21.15.79:0/2614522131 shutdown_connections 2024-09-10T09:41:27.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.308+0000 7f4b790dd700 1 -- 172.21.15.79:0/2614522131 wait complete. 2024-09-10T09:41:27.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b790dd700 1 Processor -- start 2024-09-10T09:41:27.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b790dd700 1 -- start start 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b790dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b740ff3c0 0x7f4b74196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b790dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b790dd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74197990 con 0x7f4b740ffd60 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b790dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74197b00 con 0x7f4b740ff3c0 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b7259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b7259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54736/0 (socket says 172.21.15.79:54736) 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b7259c700 1 -- 172.21.15.79:0/1913542402 learned_addr learned my addr 172.21.15.79:0/1913542402 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b72d9d700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b740ff3c0 0x7f4b74196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b7259c700 1 -- 172.21.15.79:0/1913542402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b740ff3c0 msgr2=0x7f4b74196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b7259c700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b740ff3c0 0x7f4b74196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.309+0000 7f4b7259c700 1 -- 172.21.15.79:0/1913542402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b640095f0 con 0x7f4b740ffd60 2024-09-10T09:41:27.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.310+0000 7f4b7259c700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74197370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b640092e0 tx=0x7f4b6400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:27.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.310+0000 7f4b5bfff700 1 -- 172.21.15.79:0/1913542402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6401d070 con 0x7f4b740ffd60 2024-09-10T09:41:27.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.310+0000 7f4b5bfff700 1 -- 172.21.15.79:0/1913542402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b6400f460 con 0x7f4b740ffd60 2024-09-10T09:41:27.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.310+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7419fea0 con 0x7f4b740ffd60 2024-09-10T09:41:27.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.310+0000 7f4b5bfff700 1 -- 172.21.15.79:0/1913542402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b640175f0 con 0x7f4b740ffd60 2024-09-10T09:41:27.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.310+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b741a0310 con 0x7f4b740ffd60 2024-09-10T09:41:27.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.311+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b74107680 con 0x7f4b740ffd60 2024-09-10T09:41:27.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.311+0000 7f4b5bfff700 1 -- 172.21.15.79:0/1913542402 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f4b6400f5d0 con 0x7f4b740ffd60 2024-09-10T09:41:27.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.312+0000 7f4b5bfff700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f4b5c06e340 0x7f4b5c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:27.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.312+0000 7f4b5bfff700 1 -- 172.21.15.79:0/1913542402 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4b6408f6d0 con 0x7f4b740ffd60 2024-09-10T09:41:27.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.312+0000 7f4b72d9d700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f4b5c06e340 0x7f4b5c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:27.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.312+0000 7f4b72d9d700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f4b5c06e340 0x7f4b5c0707f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006fd0 tx=0x7f4b68008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:27.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.316+0000 7f4b5bfff700 1 -- 172.21.15.79:0/1913542402 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b640589c0 con 0x7f4b740ffd60 2024-09-10T09:41:27.521 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:27 smithi079 ceph-mon[87213]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:27.521 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:27 smithi079 ceph-mon[87213]: Upgrade: Updating crash.smithi079 (1/2) 2024-09-10T09:41:27.521 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:27 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:27.521 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:27 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:27.521 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:27 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:27.521 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:27 smithi079 ceph-mon[87213]: Deploying daemon crash.smithi079 on smithi079 2024-09-10T09:41:27.545 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.544+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b740694f0 con 0x7f4b5c06e340 2024-09-10T09:41:27.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.546+0000 7f4b5bfff700 1 -- 172.21.15.79:0/1913542402 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f4b740694f0 con 0x7f4b5c06e340 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f4b5c06e340 msgr2=0x7f4b5c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f4b5c06e340 0x7f4b5c0707f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006fd0 tx=0x7f4b68008040 comp rx=0 tx=0).stop 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 msgr2=0x7f4b74197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74197370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b640092e0 tx=0x7f4b6400be20 comp rx=0 tx=0).stop 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 shutdown_connections 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f4b5c06e340 0x7f4b5c0707f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b740ff3c0 0x7f4b74196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 --2- 172.21.15.79:0/1913542402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b740ffd60 0x7f4b74197370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 >> 172.21.15.79:0/1913542402 conn(0x7f4b740fac80 msgr2=0x7f4b740fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:27.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 shutdown_connections 2024-09-10T09:41:27.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.548+0000 7f4b790dd700 1 -- 172.21.15.79:0/1913542402 wait complete. 2024-09-10T09:41:27.559 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:41:27.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 -- 172.21.15.79:0/1721786260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143810e9a0 msgr2=0x7f143810ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 --2- 172.21.15.79:0/1721786260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143810e9a0 0x7f143810ed70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f143000b0a0 tx=0x7f143000b3b0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 -- 172.21.15.79:0/1721786260 shutdown_connections 2024-09-10T09:41:27.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 --2- 172.21.15.79:0/1721786260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1438071ad0 0x7f1438071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 --2- 172.21.15.79:0/1721786260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f143810e9a0 0x7f143810ed70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 -- 172.21.15.79:0/1721786260 >> 172.21.15.79:0/1721786260 conn(0x7f143806c630 msgr2=0x7f143806ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:27.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 -- 172.21.15.79:0/1721786260 shutdown_connections 2024-09-10T09:41:27.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.666+0000 7f143e3e3700 1 -- 172.21.15.79:0/1721786260 wait complete. 2024-09-10T09:41:27.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.667+0000 7f143e3e3700 1 Processor -- start 2024-09-10T09:41:27.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.667+0000 7f143e3e3700 1 -- start start 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.667+0000 7f143e3e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1438071ad0 0x7f14381a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.667+0000 7f143e3e3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143810e9a0 0x7f14381a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.667+0000 7f143e3e3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14381a59b0 con 0x7f1438071ad0 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.667+0000 7f143e3e3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14381a9740 con 0x7f143810e9a0 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.667+0000 7f1437fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1438071ad0 0x7f14381a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f1437fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1438071ad0 0x7f14381a4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54750/0 (socket says 172.21.15.79:54750) 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f1437fff700 1 -- 172.21.15.79:0/439481073 learned_addr learned my addr 172.21.15.79:0/439481073 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f14377fe700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143810e9a0 0x7f14381a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f1437fff700 1 -- 172.21.15.79:0/439481073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143810e9a0 msgr2=0x7f14381a52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f1437fff700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143810e9a0 0x7f14381a52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f1437fff700 1 -- 172.21.15.79:0/439481073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009d00 con 0x7f1438071ad0 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f14377fe700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143810e9a0 0x7f14381a52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f1437fff700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1438071ad0 0x7f14381a4d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f143000b070 tx=0x7f1430003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f14357fa700 1 -- 172.21.15.79:0/439481073 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143000e040 con 0x7f1438071ad0 2024-09-10T09:41:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f14357fa700 1 -- 172.21.15.79:0/439481073 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1430007c00 con 0x7f1438071ad0 2024-09-10T09:41:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f14357fa700 1 -- 172.21.15.79:0/439481073 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143001d740 con 0x7f1438071ad0 2024-09-10T09:41:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14381a99c0 con 0x7f1438071ad0 2024-09-10T09:41:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.668+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14381a9eb0 con 0x7f1438071ad0 2024-09-10T09:41:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.669+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1438109b60 con 0x7f1438071ad0 2024-09-10T09:41:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.670+0000 7f14357fa700 1 -- 172.21.15.79:0/439481073 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f1430004040 con 0x7f1438071ad0 2024-09-10T09:41:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.670+0000 7f14357fa700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f142006e330 0x7f14200707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.671+0000 7f14357fa700 1 -- 172.21.15.79:0/439481073 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f143008fa40 con 0x7f1438071ad0 2024-09-10T09:41:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.671+0000 7f14377fe700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f142006e330 0x7f14200707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.671+0000 7f14377fe700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f142006e330 0x7f14200707e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14381a63b0 tx=0x7f142c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.675+0000 7f14357fa700 1 -- 172.21.15.79:0/439481073 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1430058d30 con 0x7f1438071ad0 2024-09-10T09:41:27.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:27 smithi135 ceph-mon[65362]: pgmap v29: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:27.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:27 smithi135 ceph-mon[65362]: Upgrade: Updating crash.smithi079 (1/2) 2024-09-10T09:41:27.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:27 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:27.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:27 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi079", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:27.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:27 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:27.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:27 smithi135 ceph-mon[65362]: Deploying daemon crash.smithi079 on smithi079 2024-09-10T09:41:27.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.928+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f143802cca0 con 0x7f142006e330 2024-09-10T09:41:27.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.930+0000 7f14357fa700 1 -- 172.21.15.79:0/439481073 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f143802cca0 con 0x7f142006e330 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f142006e330 msgr2=0x7f14200707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f142006e330 0x7f14200707e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14381a63b0 tx=0x7f142c008040 comp rx=0 tx=0).stop 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1438071ad0 msgr2=0x7f14381a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1438071ad0 0x7f14381a4d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f143000b070 tx=0x7f1430003ce0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 shutdown_connections 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f142006e330 0x7f14200707e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1438071ad0 0x7f14381a4d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 --2- 172.21.15.79:0/439481073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f143810e9a0 0x7f14381a52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 >> 172.21.15.79:0/439481073 conn(0x7f143806c630 msgr2=0x7f1438070490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.932+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 shutdown_connections 2024-09-10T09:41:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:27.933+0000 7f143e3e3700 1 -- 172.21.15.79:0/439481073 wait complete. 2024-09-10T09:41:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 -- 172.21.15.79:0/1655103639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 msgr2=0x7fed38100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 --2- 172.21.15.79:0/1655103639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38100040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed24009910 tx=0x7fed24009c20 comp rx=0 tx=0).stop 2024-09-10T09:41:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 -- 172.21.15.79:0/1655103639 shutdown_connections 2024-09-10T09:41:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 --2- 172.21.15.79:0/1655103639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38100040 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 --2- 172.21.15.79:0/1655103639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed38104130 0x7fed38104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 -- 172.21.15.79:0/1655103639 >> 172.21.15.79:0/1655103639 conn(0x7fed38075130 msgr2=0x7fed38075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:28.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 -- 172.21.15.79:0/1655103639 shutdown_connections 2024-09-10T09:41:28.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.047+0000 7fed3ed60700 1 -- 172.21.15.79:0/1655103639 wait complete. 2024-09-10T09:41:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3ed60700 1 Processor -- start 2024-09-10T09:41:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3ed60700 1 -- start start 2024-09-10T09:41:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3ed60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38194a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3ed60700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed38104130 0x7fed38194fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3ed60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38195510 con 0x7fed380ffbd0 2024-09-10T09:41:28.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3ed60700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed38195680 con 0x7fed38104130 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3cafc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38194a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3cafc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38194a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54758/0 (socket says 172.21.15.79:54758) 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3cafc700 1 -- 172.21.15.79:0/2412761679 learned_addr learned my addr 172.21.15.79:0/2412761679 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed37fff700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed38104130 0x7fed38194fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3cafc700 1 -- 172.21.15.79:0/2412761679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed38104130 msgr2=0x7fed38194fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3cafc700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed38104130 0x7fed38194fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3cafc700 1 -- 172.21.15.79:0/2412761679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240095f0 con 0x7fed380ffbd0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.048+0000 7fed3cafc700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38194a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00c8a0 tx=0x7fed2c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.049+0000 7fed35ffb700 1 -- 172.21.15.79:0/2412761679 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c00cea0 con 0x7fed380ffbd0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.049+0000 7fed35ffb700 1 -- 172.21.15.79:0/2412761679 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed2c004830 con 0x7fed380ffbd0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.049+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed381a2100 con 0x7fed380ffbd0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.049+0000 7fed35ffb700 1 -- 172.21.15.79:0/2412761679 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c0055b0 con 0x7fed380ffbd0 2024-09-10T09:41:28.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.049+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed381a2460 con 0x7fed380ffbd0 2024-09-10T09:41:28.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.050+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3804f2a0 con 0x7fed380ffbd0 2024-09-10T09:41:28.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.050+0000 7fed35ffb700 1 -- 172.21.15.79:0/2412761679 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fed2c0049a0 con 0x7fed380ffbd0 2024-09-10T09:41:28.053 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.051+0000 7fed35ffb700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed2806e340 0x7fed280707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.051+0000 7fed35ffb700 1 -- 172.21.15.79:0/2412761679 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fed2c08ded0 con 0x7fed380ffbd0 2024-09-10T09:41:28.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.051+0000 7fed37fff700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed2806e340 0x7fed280707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.054 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.051+0000 7fed37fff700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed2806e340 0x7fed280707f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fed38068ea0 tx=0x7fed2401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:28.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.055+0000 7fed35ffb700 1 -- 172.21.15.79:0/2412761679 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed2c05ac70 con 0x7fed380ffbd0 2024-09-10T09:41:28.292 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.289+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fed380ff240 con 0x7fed2806e340 2024-09-10T09:41:28.300 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.299+0000 7fed35ffb700 1 -- 172.21.15.79:0/2412761679 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fed380ff240 con 0x7fed2806e340 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (2m) 48s ago 13m 15.6M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (13m) 48s ago 13m 7960k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (12m) 33s ago 12m 7944k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (13m) 48s ago 13m 6669k - 18.2.0 dc2bc1663786 395d9c87458e 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (12m) 33s ago 12m 6669k - 18.2.0 dc2bc1663786 4878ebd9b1c5 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (2m) 48s ago 13m 75.2M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (7m) 48s ago 7m 15.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (7m) 48s ago 7m 97.5M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:41:28.301 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (7m) 33s ago 7m 152M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (7m) 33s ago 7m 19.8M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (4m) 48s ago 14m 472M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (3m) 33s ago 12m 438M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (60s) 48s ago 14m 29.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (39s) 33s ago 12m 26.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (3m) 48s ago 13m 15.2M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (3m) 33s ago 12m 16.2M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (11m) 48s ago 11m 255M 1216M 18.2.0 dc2bc1663786 889cc4a329ef 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (11m) 48s ago 11m 263M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (10m) 48s ago 10m 225M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (10m) 33s ago 10m 290M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (9m) 33s ago 9m 256M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (9m) 33s ago 9m 254M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:41:28.302 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (2m) 48s ago 12m 65.2M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:41:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed2806e340 msgr2=0x7fed280707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed2806e340 0x7fed280707f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fed38068ea0 tx=0x7fed2401a040 comp rx=0 tx=0).stop 2024-09-10T09:41:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 msgr2=0x7fed38194a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38194a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00c8a0 tx=0x7fed2c00cc60 comp rx=0 tx=0).stop 2024-09-10T09:41:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 shutdown_connections 2024-09-10T09:41:28.303 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed2806e340 0x7fed280707f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed380ffbd0 0x7fed38194a90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 --2- 172.21.15.79:0/2412761679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed38104130 0x7fed38194fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 >> 172.21.15.79:0/2412761679 conn(0x7fed38075130 msgr2=0x7fed380feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 shutdown_connections 2024-09-10T09:41:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.301+0000 7fed3ed60700 1 -- 172.21.15.79:0/2412761679 wait complete. 2024-09-10T09:41:28.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3103979863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 msgr2=0x7ff2f4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3103979863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4103d30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009910 tx=0x7ff2e4009c20 comp rx=0 tx=0).stop 2024-09-10T09:41:28.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3103979863 shutdown_connections 2024-09-10T09:41:28.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3103979863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4103d30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3103979863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f40ff3c0 0x7ff2f40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3103979863 >> 172.21.15.79:0/3103979863 conn(0x7ff2f40fac80 msgr2=0x7ff2f40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:28.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3103979863 shutdown_connections 2024-09-10T09:41:28.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.406+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3103979863 wait complete. 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2fc57b700 1 Processor -- start 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2fc57b700 1 -- start start 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2fc57b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f40ff3c0 0x7ff2f4196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2fc57b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2fc57b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f41979b0 con 0x7ff2f40ffd60 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2fc57b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4197af0 con 0x7ff2f40ff3c0 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2f9b16700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.407+0000 7ff2f9b16700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54762/0 (socket says 172.21.15.79:54762) 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2f9b16700 1 -- 172.21.15.79:0/3440279405 learned_addr learned my addr 172.21.15.79:0/3440279405 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2fa317700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f40ff3c0 0x7ff2f4196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2f9b16700 1 -- 172.21.15.79:0/3440279405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f40ff3c0 msgr2=0x7ff2f4196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2f9b16700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f40ff3c0 0x7ff2f4196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2f9b16700 1 -- 172.21.15.79:0/3440279405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40095f0 con 0x7ff2f40ffd60 2024-09-10T09:41:28.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2f9b16700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4197390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005f50 tx=0x7ff2e400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:28.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2eb7fe700 1 -- 172.21.15.79:0/3440279405 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e401d070 con 0x7ff2f40ffd60 2024-09-10T09:41:28.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2eb7fe700 1 -- 172.21.15.79:0/3440279405 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2e400f460 con 0x7ff2f40ffd60 2024-09-10T09:41:28.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2eb7fe700 1 -- 172.21.15.79:0/3440279405 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2e4017630 con 0x7ff2f40ffd60 2024-09-10T09:41:28.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f419fec0 con 0x7ff2f40ffd60 2024-09-10T09:41:28.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.408+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f41a02d0 con 0x7ff2f40ffd60 2024-09-10T09:41:28.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.409+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f4107680 con 0x7ff2f40ffd60 2024-09-10T09:41:28.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.410+0000 7ff2eb7fe700 1 -- 172.21.15.79:0/3440279405 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff2e400f5d0 con 0x7ff2f40ffd60 2024-09-10T09:41:28.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.410+0000 7ff2eb7fe700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff2e006e330 0x7ff2e00707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.410+0000 7ff2eb7fe700 1 -- 172.21.15.79:0/3440279405 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff2e408f7c0 con 0x7ff2f40ffd60 2024-09-10T09:41:28.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.410+0000 7ff2fa317700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff2e006e330 0x7ff2e00707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.411+0000 7ff2fa317700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff2e006e330 0x7ff2e00707e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009a10 tx=0x7ff2f0009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:28.416 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.414+0000 7ff2eb7fe700 1 -- 172.21.15.79:0/3440279405 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff2e4058a30 con 0x7ff2f40ffd60 2024-09-10T09:41:28.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.711+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff2f4107060 con 0x7ff2f40ffd60 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.712+0000 7ff2eb7fe700 1 -- 172.21.15.79:0/3440279405 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+694 (secure 0 0 0) 0x7ff2e405c0f0 con 0x7ff2f40ffd60 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:41:28.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 10, 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:41:28.715 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:41:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff2e006e330 msgr2=0x7ff2e00707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff2e006e330 0x7ff2e00707e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009a10 tx=0x7ff2f0009190 comp rx=0 tx=0).stop 2024-09-10T09:41:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 msgr2=0x7ff2f4197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4197390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4005f50 tx=0x7ff2e400bd70 comp rx=0 tx=0).stop 2024-09-10T09:41:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 shutdown_connections 2024-09-10T09:41:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff2e006e330 0x7ff2e00707e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2f40ff3c0 0x7ff2f4196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 --2- 172.21.15.79:0/3440279405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f40ffd60 0x7ff2f4197390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 >> 172.21.15.79:0/3440279405 conn(0x7ff2f40fac80 msgr2=0x7ff2f40fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:28.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 shutdown_connections 2024-09-10T09:41:28.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.714+0000 7ff2fc57b700 1 -- 172.21.15.79:0/3440279405 wait complete. 2024-09-10T09:41:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 -- 172.21.15.79:0/1767007773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 msgr2=0x7fcc880ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 --2- 172.21.15.79:0/1767007773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc880ff790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009910 tx=0x7fcc78009c20 comp rx=0 tx=0).stop 2024-09-10T09:41:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 -- 172.21.15.79:0/1767007773 shutdown_connections 2024-09-10T09:41:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 --2- 172.21.15.79:0/1767007773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc880ffd60 0x7fcc88103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 --2- 172.21.15.79:0/1767007773 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc880ff790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 -- 172.21.15.79:0/1767007773 >> 172.21.15.79:0/1767007773 conn(0x7fcc880fac80 msgr2=0x7fcc880fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 -- 172.21.15.79:0/1767007773 shutdown_connections 2024-09-10T09:41:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.824+0000 7fcc8c881700 1 -- 172.21.15.79:0/1767007773 wait complete. 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8c881700 1 Processor -- start 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8c881700 1 -- start start 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8c881700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc88195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8c881700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc880ffd60 0x7fcc88196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8c881700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88196b20 con 0x7fcc880ff3c0 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8c881700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8819a8b0 con 0x7fcc880ffd60 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc88195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc88195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54772/0 (socket says 172.21.15.79:54772) 2024-09-10T09:41:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.825+0000 7fcc8659c700 1 -- 172.21.15.79:0/654366838 learned_addr learned my addr 172.21.15.79:0/654366838 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc85d9b700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc880ffd60 0x7fcc88196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc8659c700 1 -- 172.21.15.79:0/654366838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc880ffd60 msgr2=0x7fcc88196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc8659c700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc880ffd60 0x7fcc88196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc8659c700 1 -- 172.21.15.79:0/654366838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780095f0 con 0x7fcc880ff3c0 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc8659c700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc88195f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc78006010 tx=0x7fcc7800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc777fe700 1 -- 172.21.15.79:0/654366838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc7801d070 con 0x7fcc880ff3c0 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8819ab30 con 0x7fcc880ff3c0 2024-09-10T09:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc777fe700 1 -- 172.21.15.79:0/654366838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc7800f460 con 0x7fcc880ff3c0 2024-09-10T09:41:28.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc777fe700 1 -- 172.21.15.79:0/654366838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc78017630 con 0x7fcc880ff3c0 2024-09-10T09:41:28.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.826+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8819b020 con 0x7fcc880ff3c0 2024-09-10T09:41:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.827+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8804f2a0 con 0x7fcc880ff3c0 2024-09-10T09:41:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.828+0000 7fcc777fe700 1 -- 172.21.15.79:0/654366838 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fcc78003a60 con 0x7fcc880ff3c0 2024-09-10T09:41:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.828+0000 7fcc777fe700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcc70072750 0x7fcc70074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.828+0000 7fcc777fe700 1 -- 172.21.15.79:0/654366838 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcc7808f750 con 0x7fcc880ff3c0 2024-09-10T09:41:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.828+0000 7fcc85d9b700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcc70072750 0x7fcc70074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.829+0000 7fcc85d9b700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcc70072750 0x7fcc70074c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c005950 tx=0x7fcc7c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:28.833+0000 7fcc777fe700 1 -- 172.21.15.79:0/654366838 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcc780589c0 con 0x7fcc880ff3c0 2024-09-10T09:41:29.099 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.097+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc8819b2e0 con 0x7fcc880ff3c0 2024-09-10T09:41:29.100 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.098+0000 7fcc777fe700 1 -- 172.21.15.79:0/654366838 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7fcc7805c080 con 0x7fcc880ff3c0 2024-09-10T09:41:29.100 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:41:29.100 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:41:29.100 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:41:29.100 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:41:29.100 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:41:29.100 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:41:29.101 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:41:29.102 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:41:29.103 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:41:29.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:41:29.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:41:29.103 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:41:29.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:41:29.103 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:41:29.103 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcc70072750 msgr2=0x7fcc70074c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcc70072750 0x7fcc70074c00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c005950 tx=0x7fcc7c0058e0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 msgr2=0x7fcc88195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc88195f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcc78006010 tx=0x7fcc7800be20 comp rx=0 tx=0).stop 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 shutdown_connections 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcc70072750 0x7fcc70074c00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcc880ff3c0 0x7fcc88195f00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 --2- 172.21.15.79:0/654366838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc880ffd60 0x7fcc88196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.101+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 >> 172.21.15.79:0/654366838 conn(0x7fcc880fac80 msgr2=0x7fcc881034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.102+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 shutdown_connections 2024-09-10T09:41:29.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.102+0000 7fcc8c881700 1 -- 172.21.15.79:0/654366838 wait complete. 2024-09-10T09:41:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:41:29.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 -- 172.21.15.79:0/4131976516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 msgr2=0x7ff09010a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 --2- 172.21.15.79:0/4131976516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff09010a230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff084009910 tx=0x7ff084009c20 comp rx=0 tx=0).stop 2024-09-10T09:41:29.228 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 -- 172.21.15.79:0/4131976516 shutdown_connections 2024-09-10T09:41:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 --2- 172.21.15.79:0/4131976516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff09010a230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 --2- 172.21.15.79:0/4131976516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff090101420 0x7ff0901017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 -- 172.21.15.79:0/4131976516 >> 172.21.15.79:0/4131976516 conn(0x7ff0900fac80 msgr2=0x7ff0900fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 -- 172.21.15.79:0/4131976516 shutdown_connections 2024-09-10T09:41:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 -- 172.21.15.79:0/4131976516 wait complete. 2024-09-10T09:41:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 Processor -- start 2024-09-10T09:41:29.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.226+0000 7ff096342700 1 -- start start 2024-09-10T09:41:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff096342700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff090101420 0x7ff090195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff096342700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff0901963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:29.230 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff096342700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090196aa0 con 0x7ff090101d30 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff096342700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09019a830 con 0x7ff090101420 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff08f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff0901963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff08f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff0901963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54792/0 (socket says 172.21.15.79:54792) 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff08f7fe700 1 -- 172.21.15.79:0/827325833 learned_addr learned my addr 172.21.15.79:0/827325833 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff08ffff700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff090101420 0x7ff090195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff08f7fe700 1 -- 172.21.15.79:0/827325833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff090101420 msgr2=0x7ff090195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff08f7fe700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff090101420 0x7ff090195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.227+0000 7ff08f7fe700 1 -- 172.21.15.79:0/827325833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0840095f0 con 0x7ff090101d30 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.228+0000 7ff08f7fe700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff0901963c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff084006010 tx=0x7ff08400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.228+0000 7ff08d7fa700 1 -- 172.21.15.79:0/827325833 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff08401d070 con 0x7ff090101d30 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.228+0000 7ff08d7fa700 1 -- 172.21.15.79:0/827325833 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff084004fb0 con 0x7ff090101d30 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.228+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09019aab0 con 0x7ff090101d30 2024-09-10T09:41:29.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.228+0000 7ff08d7fa700 1 -- 172.21.15.79:0/827325833 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff084022ea0 con 0x7ff090101d30 2024-09-10T09:41:29.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.228+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09019afa0 con 0x7ff090101d30 2024-09-10T09:41:29.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.229+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0901078a0 con 0x7ff090101d30 2024-09-10T09:41:29.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.229+0000 7ff08d7fa700 1 -- 172.21.15.79:0/827325833 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff08400f690 con 0x7ff090101d30 2024-09-10T09:41:29.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.230+0000 7ff08d7fa700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff07806e340 0x7ff0780707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:29.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.230+0000 7ff08d7fa700 1 -- 172.21.15.79:0/827325833 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff08408f720 con 0x7ff090101d30 2024-09-10T09:41:29.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.230+0000 7ff08ffff700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff07806e340 0x7ff0780707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:29.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.231+0000 7ff08ffff700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff07806e340 0x7ff0780707f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff080005fd0 tx=0x7ff08000a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:29.236 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.234+0000 7ff08d7fa700 1 -- 172.21.15.79:0/827325833 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff084058ac0 con 0x7ff090101d30 2024-09-10T09:41:29.378 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:29 smithi079 ceph-mon[87213]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:29.378 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:29 smithi079 ceph-mon[87213]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:29.378 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:29 smithi079 ceph-mon[87213]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:29.378 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:29 smithi079 ceph-mon[87213]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:29.378 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:29 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3440279405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:29.378 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:29 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/654366838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:41:29.467 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.464+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0901972f0 con 0x7ff07806e340 2024-09-10T09:41:29.468 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.466+0000 7ff08d7fa700 1 -- 172.21.15.79:0/827325833 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7ff0901972f0 con 0x7ff07806e340 2024-09-10T09:41:29.468 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:41:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:41:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:41:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:41:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:41:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:41:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:41:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:41:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "4/23 daemons upgraded", 2024-09-10T09:41:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading crash daemons", 2024-09-10T09:41:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:41:29.470 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:41:29.471 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff07806e340 msgr2=0x7ff0780707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff07806e340 0x7ff0780707f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff080005fd0 tx=0x7ff08000a560 comp rx=0 tx=0).stop 2024-09-10T09:41:29.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 msgr2=0x7ff0901963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff0901963c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff084006010 tx=0x7ff08400be20 comp rx=0 tx=0).stop 2024-09-10T09:41:29.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 shutdown_connections 2024-09-10T09:41:29.472 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff07806e340 0x7ff0780707f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff090101420 0x7ff090195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 --2- 172.21.15.79:0/827325833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff090101d30 0x7ff0901963c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 >> 172.21.15.79:0/827325833 conn(0x7ff0900fac80 msgr2=0x7ff0901049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:29.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 shutdown_connections 2024-09-10T09:41:29.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.468+0000 7ff096342700 1 -- 172.21.15.79:0/827325833 wait complete. 2024-09-10T09:41:29.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:29 smithi135 ceph-mon[65362]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:29.549 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:29 smithi135 ceph-mon[65362]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:29.550 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:29 smithi135 ceph-mon[65362]: pgmap v30: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:29.550 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:29 smithi135 ceph-mon[65362]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:29.550 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:29 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3440279405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:29.550 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:29 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/654366838' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:41:29.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 -- 172.21.15.79:0/3467827382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d8100e80 msgr2=0x7ff9d8104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 --2- 172.21.15.79:0/3467827382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d8100e80 0x7ff9d8104e50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009910 tx=0x7ff9c8009c20 comp rx=0 tx=0).stop 2024-09-10T09:41:29.578 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 -- 172.21.15.79:0/3467827382 shutdown_connections 2024-09-10T09:41:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 --2- 172.21.15.79:0/3467827382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d8100e80 0x7ff9d8104e50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 --2- 172.21.15.79:0/3467827382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9d81004e0 0x7ff9d81008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 -- 172.21.15.79:0/3467827382 >> 172.21.15.79:0/3467827382 conn(0x7ff9d80fbda0 msgr2=0x7ff9d80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 -- 172.21.15.79:0/3467827382 shutdown_connections 2024-09-10T09:41:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.576+0000 7ff9de180700 1 -- 172.21.15.79:0/3467827382 wait complete. 2024-09-10T09:41:29.579 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9de180700 1 Processor -- start 2024-09-10T09:41:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9de180700 1 -- start start 2024-09-10T09:41:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9de180700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d81004e0 0x7ff9d8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9de180700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9d8100e80 0x7ff9d8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:29.581 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9de180700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d8073ad0 con 0x7ff9d81004e0 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9de180700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d8073c10 con 0x7ff9d8100e80 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d81004e0 0x7ff9d8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9d77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d81004e0 0x7ff9d8073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54814/0 (socket says 172.21.15.79:54814) 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9d77fe700 1 -- 172.21.15.79:0/532631767 learned_addr learned my addr 172.21.15.79:0/532631767 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.577+0000 7ff9d6ffd700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9d8100e80 0x7ff9d8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9d77fe700 1 -- 172.21.15.79:0/532631767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9d8100e80 msgr2=0x7ff9d8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9d77fe700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9d8100e80 0x7ff9d8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9d77fe700 1 -- 172.21.15.79:0/532631767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80095f0 con 0x7ff9d81004e0 2024-09-10T09:41:29.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9d77fe700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d81004e0 0x7ff9d8073050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c930 tx=0x7ff9cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9d4ff9700 1 -- 172.21.15.79:0/532631767 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9cc007ad0 con 0x7ff9d81004e0 2024-09-10T09:41:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9d4ff9700 1 -- 172.21.15.79:0/532631767 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9cc00ce80 con 0x7ff9d81004e0 2024-09-10T09:41:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d81a2100 con 0x7ff9d81004e0 2024-09-10T09:41:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9d4ff9700 1 -- 172.21.15.79:0/532631767 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9cc018630 con 0x7ff9d81004e0 2024-09-10T09:41:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.578+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d81a2460 con 0x7ff9d81004e0 2024-09-10T09:41:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.579+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d8108850 con 0x7ff9d81004e0 2024-09-10T09:41:29.583 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.580+0000 7ff9d4ff9700 1 -- 172.21.15.79:0/532631767 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff9cc007c30 con 0x7ff9d81004e0 2024-09-10T09:41:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.580+0000 7ff9d4ff9700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff9c006e340 0x7ff9c00707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:41:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.580+0000 7ff9d4ff9700 1 -- 172.21.15.79:0/532631767 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff9cc08e1a0 con 0x7ff9d81004e0 2024-09-10T09:41:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.580+0000 7ff9d6ffd700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff9c006e340 0x7ff9c00707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:41:29.584 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.581+0000 7ff9d6ffd700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff9c006e340 0x7ff9c00707f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8074840 tx=0x7ff9c801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:41:29.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.584+0000 7ff9d4ff9700 1 -- 172.21.15.79:0/532631767 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff9cc057490 con 0x7ff9d81004e0 2024-09-10T09:41:29.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.880+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff9d8073dd0 con 0x7ff9d81004e0 2024-09-10T09:41:29.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.881+0000 7ff9d4ff9700 1 -- 172.21.15.79:0/532631767 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff9cc05ab50 con 0x7ff9d81004e0 2024-09-10T09:41:29.883 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:41:29.883 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:41:29.884 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:41:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff9c006e340 msgr2=0x7ff9c00707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff9c006e340 0x7ff9c00707f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8074840 tx=0x7ff9c801a040 comp rx=0 tx=0).stop 2024-09-10T09:41:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d81004e0 msgr2=0x7ff9d8073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d81004e0 0x7ff9d8073050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00c930 tx=0x7ff9cc00cc40 comp rx=0 tx=0).stop 2024-09-10T09:41:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 shutdown_connections 2024-09-10T09:41:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff9c006e340 0x7ff9c00707f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9d81004e0 0x7ff9d8073050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 --2- 172.21.15.79:0/532631767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9d8100e80 0x7ff9d8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:41:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 >> 172.21.15.79:0/532631767 conn(0x7ff9d80fbda0 msgr2=0x7ff9d80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:41:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 shutdown_connections 2024-09-10T09:41:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:29.883+0000 7ff9de180700 1 -- 172.21.15.79:0/532631767 wait complete. 2024-09-10T09:41:31.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:30 smithi079 ceph-mon[87213]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:31.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:30 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:31.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:30 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:31.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:30 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/532631767' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:41:31.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:30 smithi079 ceph-mon[87213]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:31.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:30 smithi135 ceph-mon[65362]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:41:31.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:30 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:31.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:30 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:31.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:30 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/532631767' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:41:31.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:30 smithi135 ceph-mon[65362]: pgmap v31: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:32.561 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:32 smithi135 ceph-mon[65362]: Upgrade: Updating crash.smithi135 (2/2) 2024-09-10T09:41:32.561 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:32.561 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:32.561 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:32.561 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:32 smithi135 ceph-mon[65362]: Deploying daemon crash.smithi135 on smithi135 2024-09-10T09:41:32.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:32 smithi079 ceph-mon[87213]: Upgrade: Updating crash.smithi135 (2/2) 2024-09-10T09:41:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi135", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-10T09:41:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:32 smithi079 ceph-mon[87213]: Deploying daemon crash.smithi135 on smithi135 2024-09-10T09:41:33.424 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:33 smithi135 ceph-mon[65362]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:33.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:33 smithi079 ceph-mon[87213]: pgmap v32: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:34.414 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:34 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:34.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:35.583 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:35 smithi079 ceph-mon[87213]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:35.583 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:35.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:35.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:35.590 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:35 smithi135 ceph-mon[65362]: pgmap v33: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:35.590 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:35.590 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:35.590 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:37.319 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:37 smithi135 ceph-mon[65362]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:37.590 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:37 smithi079 ceph-mon[87213]: pgmap v34: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:38 smithi079 ceph-mon[87213]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:38.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:38.847 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:38.848 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:38 smithi135 ceph-mon[65362]: pgmap v35: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:38.848 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:38.848 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:40 smithi079 ceph-mon[87213]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:40.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.814 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.839 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.839 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.839 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:40 smithi135 ceph-mon[65362]: pgmap v36: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:40.839 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:40.839 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:42.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:42 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:42.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:42 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:42.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:42 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:42.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:42 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:43.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:43 smithi079 ceph-mon[87213]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:43.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:43 smithi135 ceph-mon[65362]: pgmap v37: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all crash 2024-09-10T09:41:44.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]: dispatch 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]': finished 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]: dispatch 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]': finished 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: Upgrade: osd.0 is safe to restart 2024-09-10T09:41:44.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:44 smithi079 ceph-mon[87213]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:41:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all crash 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]: dispatch 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi079"}]': finished 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]: dispatch 2024-09-10T09:41:44.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi135"}]': finished 2024-09-10T09:41:44.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T09:41:44.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-10T09:41:44.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: Upgrade: osd.0 is safe to restart 2024-09-10T09:41:44.720 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:44 smithi135 ceph-mon[65362]: pgmap v38: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:45 smithi079 ceph-mon[87213]: Upgrade: Updating osd.0 2024-09-10T09:41:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:45 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:45 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:41:46.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:45 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:46.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:45 smithi079 ceph-mon[87213]: Deploying daemon osd.0 on smithi079 2024-09-10T09:41:46.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:45 smithi135 ceph-mon[65362]: Upgrade: Updating osd.0 2024-09-10T09:41:46.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:45 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:46.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:45 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T09:41:46.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:45 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:41:46.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:45 smithi135 ceph-mon[65362]: Deploying daemon osd.0 on smithi079 2024-09-10T09:41:47.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:46 smithi079 ceph-mon[87213]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:47.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:46 smithi135 ceph-mon[65362]: pgmap v39: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:41:48.160 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:47 smithi079 systemd[1]: Stopping Ceph osd.0 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:41:48.461 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:48 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[42665]: 2024-09-10T09:41:48.159+0000 7fabcb4b1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:41:48.461 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:48 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[42665]: 2024-09-10T09:41:48.159+0000 7fabcb4b1700 -1 osd.0 50 *** Got signal Terminated *** 2024-09-10T09:41:48.462 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:48 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[42665]: 2024-09-10T09:41:48.159+0000 7fabcb4b1700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:41:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:49 smithi079 ceph-mon[87213]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:49 smithi079 ceph-mon[87213]: osd.0 marked itself down and dead 2024-09-10T09:41:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:49.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:49 smithi135 ceph-mon[65362]: pgmap v40: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:41:49.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:49 smithi135 ceph-mon[65362]: osd.0 marked itself down and dead 2024-09-10T09:41:49.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:41:49.844 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:49 smithi079 podman[98274]: 2024-09-10 09:41:49.549328041 +0000 UTC m=+1.523209606 container died 889cc4a329efeb7cc5f081b03263c584db8651924c39a0c7438223d1b7018c3d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=HEAD) 2024-09-10T09:41:50.146 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:49 smithi079 podman[98274]: 2024-09-10 09:41:49.94247262 +0000 UTC m=+1.916354184 container cleanup 889cc4a329efeb7cc5f081b03263c584db8651924c39a0c7438223d1b7018c3d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-09-10T09:41:50.147 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:49 smithi079 bash[98274]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0 2024-09-10T09:41:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:50 smithi135 ceph-mon[65362]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:41:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:50 smithi135 ceph-mon[65362]: osdmap e51: 6 total, 5 up, 6 in 2024-09-10T09:41:50.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:50 smithi079 ceph-mon[87213]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:41:50.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:50 smithi079 ceph-mon[87213]: osdmap e51: 6 total, 5 up, 6 in 2024-09-10T09:41:50.462 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:50 smithi079 podman[98289]: 2024-09-10 09:41:50.177200026 +0000 UTC m=+0.624826832 container remove 889cc4a329efeb7cc5f081b03263c584db8651924c39a0c7438223d1b7018c3d (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-10T09:41:50.890 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:50 smithi079 podman[98379]: 2024-09-10 09:41:50.509382502 +0000 UTC m=+0.016214151 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:41:50.890 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:50 smithi079 podman[98379]: 2024-09-10 09:41:50.62810453 +0000 UTC m=+0.134936178 container create d00184b4ab1d2e309f50f8a0160d92190679f2b7a544b78490f6fe9c3a083f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T09:41:50.890 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:50 smithi079 podman[98379]: 2024-09-10 09:41:50.890026093 +0000 UTC m=+0.396857748 container init d00184b4ab1d2e309f50f8a0160d92190679f2b7a544b78490f6fe9c3a083f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:41:51.147 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:50 smithi079 podman[98379]: 2024-09-10 09:41:50.893717141 +0000 UTC m=+0.400548783 container start d00184b4ab1d2e309f50f8a0160d92190679f2b7a544b78490f6fe9c3a083f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T09:41:51.147 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:50 smithi079 podman[98379]: 2024-09-10 09:41:50.964432652 +0000 UTC m=+0.471264307 container attach d00184b4ab1d2e309f50f8a0160d92190679f2b7a544b78490f6fe9c3a083f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-10T09:41:51.148 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:51 smithi079 podman[98379]: 2024-09-10 09:41:51.078008884 +0000 UTC m=+0.584840534 container died d00184b4ab1d2e309f50f8a0160d92190679f2b7a544b78490f6fe9c3a083f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T09:41:51.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:51 smithi079 ceph-mon[87213]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-10T09:41:51.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:51 smithi079 ceph-mon[87213]: Health check failed: Reduced data availability: 27 pgs peering (PG_AVAILABILITY) 2024-09-10T09:41:51.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:51 smithi079 ceph-mon[87213]: osdmap e52: 6 total, 5 up, 6 in 2024-09-10T09:41:51.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:51 smithi135 ceph-mon[65362]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-10T09:41:51.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:51 smithi135 ceph-mon[65362]: Health check failed: Reduced data availability: 27 pgs peering (PG_AVAILABILITY) 2024-09-10T09:41:51.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:51 smithi135 ceph-mon[65362]: osdmap e52: 6 total, 5 up, 6 in 2024-09-10T09:41:51.655 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:51 smithi079 podman[98401]: 2024-09-10 09:41:51.64297072 +0000 UTC m=+0.557059970 container remove d00184b4ab1d2e309f50f8a0160d92190679f2b7a544b78490f6fe9c3a083f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T09:41:51.961 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:51 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-10T09:41:51.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:51 smithi079 systemd[1]: Stopped Ceph osd.0 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:41:51.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:51 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.0.service: Consumed 1min 2.382s CPU time. 2024-09-10T09:41:51.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:51 smithi079 systemd[1]: Starting Ceph osd.0 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:41:52.461 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 podman[98499]: 2024-09-10 09:41:51.981790759 +0000 UTC m=+0.015817023 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:41:52.462 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 podman[98499]: 2024-09-10 09:41:52.102686235 +0000 UTC m=+0.136712500 container create be7158937981d021ae74bd34be710b27bd81cafd6c4869a38508f8badac221cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T09:41:52.961 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 podman[98499]: 2024-09-10 09:41:52.497523791 +0000 UTC m=+0.531550052 container init be7158937981d021ae74bd34be710b27bd81cafd6c4869a38508f8badac221cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T09:41:52.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 podman[98499]: 2024-09-10 09:41:52.501150942 +0000 UTC m=+0.535177201 container start be7158937981d021ae74bd34be710b27bd81cafd6c4869a38508f8badac221cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T09:41:52.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 podman[98499]: 2024-09-10 09:41:52.580489485 +0000 UTC m=+0.614515754 container attach be7158937981d021ae74bd34be710b27bd81cafd6c4869a38508f8badac221cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T09:41:52.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:41:52.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 bash[98499]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:41:52.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:41:52.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:52 smithi079 bash[98499]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:41:53.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-mon[87213]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T09:41:53.461 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T09:41:53.462 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 bash[98499]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T09:41:53.462 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T09:41:53.462 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 bash[98499]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T09:41:53.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:53 smithi135 ceph-mon[65362]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 bash[98499]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 bash[98499]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 bash[98499]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 bash[98499]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate[98515]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 bash[98499]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-10T09:41:53.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:53 smithi079 podman[98499]: 2024-09-10 09:41:53.682663123 +0000 UTC m=+1.716689393 container died be7158937981d021ae74bd34be710b27bd81cafd6c4869a38508f8badac221cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T09:41:54.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 podman[98665]: 2024-09-10 09:41:54.417945486 +0000 UTC m=+0.725191749 container remove be7158937981d021ae74bd34be710b27bd81cafd6c4869a38508f8badac221cd (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T09:41:54.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 podman[98725]: 2024-09-10 09:41:54.523929556 +0000 UTC m=+0.015923058 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:41:54.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 podman[98725]: 2024-09-10 09:41:54.635379996 +0000 UTC m=+0.127373494 container create b909b443d0eb8d5fef858b6993c7d053d8971d8c581e457ed33f1d43627b5b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T09:41:55.153 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 podman[98725]: 2024-09-10 09:41:54.879525431 +0000 UTC m=+0.371518929 container init b909b443d0eb8d5fef858b6993c7d053d8971d8c581e457ed33f1d43627b5b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T09:41:55.153 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 podman[98725]: 2024-09-10 09:41:54.882610789 +0000 UTC m=+0.374604291 container start b909b443d0eb8d5fef858b6993c7d053d8971d8c581e457ed33f1d43627b5b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T09:41:55.153 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 ceph-osd[98743]: -- 172.21.15.79:0/4175950198 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b211141e0 con 0x561b2049a000 2024-09-10T09:41:55.153 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 bash[98725]: b909b443d0eb8d5fef858b6993c7d053d8971d8c581e457ed33f1d43627b5b79 2024-09-10T09:41:55.153 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:54 smithi079 systemd[1]: Started Ceph osd.0 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:41:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:55 smithi079 ceph-mon[87213]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 0 op/s 2024-09-10T09:41:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:55.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:55 smithi135 ceph-mon[65362]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 0 op/s 2024-09-10T09:41:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:41:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:41:56.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:56 smithi079 ceph-mon[87213]: Health check failed: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-10T09:41:56.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:56 smithi079 ceph-mon[87213]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 27 pgs peering) 2024-09-10T09:41:56.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:56 smithi135 ceph-mon[65362]: Health check failed: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded (PG_DEGRADED) 2024-09-10T09:41:56.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:56 smithi135 ceph-mon[65362]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 27 pgs peering) 2024-09-10T09:41:57.114 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:41:56 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[98739]: 2024-09-10T09:41:56.767+0000 7f75c18a6640 -1 Falling back to public interface 2024-09-10T09:41:57.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:57 smithi079 ceph-mon[87213]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:41:57.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:57 smithi135 ceph-mon[65362]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:41:59.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:41:59 smithi079 ceph-mon[87213]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:41:59.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:41:59 smithi135 ceph-mon[65362]: pgmap v47: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:41:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 -- 172.21.15.79:0/2653138756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 msgr2=0x7f2238104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:41:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 --2- 172.21.15.79:0/2653138756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f2238104500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2234009910 tx=0x7f2234009c20 comp rx=0 tx=0).stop 2024-09-10T09:41:59.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 -- 172.21.15.79:0/2653138756 shutdown_connections 2024-09-10T09:42:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 --2- 172.21.15.79:0/2653138756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22380ffbd0 0x7f2238100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 --2- 172.21.15.79:0/2653138756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f2238104500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 -- 172.21.15.79:0/2653138756 >> 172.21.15.79:0/2653138756 conn(0x7f2238075130 msgr2=0x7f2238075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 -- 172.21.15.79:0/2653138756 shutdown_connections 2024-09-10T09:42:00.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.998+0000 7f223f8f4700 1 -- 172.21.15.79:0/2653138756 wait complete. 2024-09-10T09:42:00.005 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223f8f4700 1 Processor -- start 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223f8f4700 1 -- start start 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223f8f4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22380ffbd0 0x7f2238196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223f8f4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f22381972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223f8f4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22381979b0 con 0x7f2238104130 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223f8f4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2238197b20 con 0x7f22380ffbd0 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223ce8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f22381972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223ce8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f22381972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56650/0 (socket says 172.21.15.79:56650) 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223ce8f700 1 -- 172.21.15.79:0/3562306216 learned_addr learned my addr 172.21.15.79:0/3562306216 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:41:59.999+0000 7f223d690700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22380ffbd0 0x7f2238196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f223ce8f700 1 -- 172.21.15.79:0/3562306216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22380ffbd0 msgr2=0x7f2238196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f223ce8f700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22380ffbd0 0x7f2238196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.006 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f223ce8f700 1 -- 172.21.15.79:0/3562306216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340095f0 con 0x7f2238104130 2024-09-10T09:42:00.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f223ce8f700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f22381972d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f222800b4b0 tx=0x7f222800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:00.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f222e7fc700 1 -- 172.21.15.79:0/3562306216 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2228011800 con 0x7f2238104130 2024-09-10T09:42:00.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f222e7fc700 1 -- 172.21.15.79:0/3562306216 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2228011e20 con 0x7f2238104130 2024-09-10T09:42:00.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223819fe00 con 0x7f2238104130 2024-09-10T09:42:00.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f222e7fc700 1 -- 172.21.15.79:0/3562306216 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222800f2e0 con 0x7f2238104130 2024-09-10T09:42:00.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.000+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22381a02c0 con 0x7f2238104130 2024-09-10T09:42:00.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.001+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22381076a0 con 0x7f2238104130 2024-09-10T09:42:00.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.002+0000 7f222e7fc700 1 -- 172.21.15.79:0/3562306216 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f2228010380 con 0x7f2238104130 2024-09-10T09:42:00.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.003+0000 7f222e7fc700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f222406e330 0x7f22240707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.003+0000 7f222e7fc700 1 -- 172.21.15.79:0/3562306216 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f222808df60 con 0x7f2238104130 2024-09-10T09:42:00.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.003+0000 7f223d690700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f222406e330 0x7f22240707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.003+0000 7f223d690700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f222406e330 0x7f22240707e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2234006010 tx=0x7f223401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:00.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.011+0000 7f222e7fc700 1 -- 172.21.15.79:0/3562306216 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2228057400 con 0x7f2238104130 2024-09-10T09:42:00.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.321+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2238061190 con 0x7f222406e330 2024-09-10T09:42:00.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.322+0000 7f222e7fc700 1 -- 172.21.15.79:0/3562306216 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2238061190 con 0x7f222406e330 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f222406e330 msgr2=0x7f22240707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f222406e330 0x7f22240707e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2234006010 tx=0x7f223401a040 comp rx=0 tx=0).stop 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 msgr2=0x7f22381972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f22381972d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f222800b4b0 tx=0x7f222800b7c0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 shutdown_connections 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f222406e330 0x7f22240707e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22380ffbd0 0x7f2238196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 --2- 172.21.15.79:0/3562306216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2238104130 0x7f22381972d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.327 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 >> 172.21.15.79:0/3562306216 conn(0x7f2238075130 msgr2=0x7f22380fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:00.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 shutdown_connections 2024-09-10T09:42:00.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.326+0000 7f223f8f4700 1 -- 172.21.15.79:0/3562306216 wait complete. 2024-09-10T09:42:00.340 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:42:00.455 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.454+0000 7f7da38bf700 1 -- 172.21.15.79:0/260547044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101d30 msgr2=0x7f7d9c10a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.454+0000 7f7da38bf700 1 --2- 172.21.15.79:0/260547044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101d30 0x7f7d9c10a230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009910 tx=0x7f7d8c009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.454+0000 7f7da38bf700 1 -- 172.21.15.79:0/260547044 shutdown_connections 2024-09-10T09:42:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.454+0000 7f7da38bf700 1 --2- 172.21.15.79:0/260547044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101d30 0x7f7d9c10a230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.454+0000 7f7da38bf700 1 --2- 172.21.15.79:0/260547044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d9c101420 0x7f7d9c1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.454+0000 7f7da38bf700 1 -- 172.21.15.79:0/260547044 >> 172.21.15.79:0/260547044 conn(0x7f7d9c0fac60 msgr2=0x7f7d9c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.455+0000 7f7da38bf700 1 -- 172.21.15.79:0/260547044 shutdown_connections 2024-09-10T09:42:00.456 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.455+0000 7f7da38bf700 1 -- 172.21.15.79:0/260547044 wait complete. 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.455+0000 7f7da38bf700 1 Processor -- start 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.455+0000 7f7da38bf700 1 -- start start 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da38bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101420 0x7f7d9c0ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da38bf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d9c101d30 0x7f7d9c0ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da38bf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0ffb00 con 0x7f7d9c101420 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da38bf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0ffc40 con 0x7f7d9c101d30 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da165b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101420 0x7f7d9c0ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.459 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da165b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101420 0x7f7d9c0ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56668/0 (socket says 172.21.15.79:56668) 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da165b700 1 -- 172.21.15.79:0/2823983227 learned_addr learned my addr 172.21.15.79:0/2823983227 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da0e5a700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d9c101d30 0x7f7d9c0ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da165b700 1 -- 172.21.15.79:0/2823983227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d9c101d30 msgr2=0x7f7d9c0ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da165b700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d9c101d30 0x7f7d9c0ff5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.456+0000 7f7da165b700 1 -- 172.21.15.79:0/2823983227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0095f0 con 0x7f7d9c101420 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.457+0000 7f7da165b700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101420 0x7f7d9c0ff080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c8a0 tx=0x7f7d9800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.457+0000 7f7d927fc700 1 -- 172.21.15.79:0/2823983227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9800cea0 con 0x7f7d9c101420 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.457+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c1a2020 con 0x7f7d9c101420 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.457+0000 7f7d927fc700 1 -- 172.21.15.79:0/2823983227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d98004830 con 0x7f7d9c101420 2024-09-10T09:42:00.460 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.457+0000 7f7d927fc700 1 -- 172.21.15.79:0/2823983227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d980055b0 con 0x7f7d9c101420 2024-09-10T09:42:00.461 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.457+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c1a2430 con 0x7f7d9c101420 2024-09-10T09:42:00.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.458+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c1078a0 con 0x7f7d9c101420 2024-09-10T09:42:00.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.459+0000 7f7d927fc700 1 -- 172.21.15.79:0/2823983227 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f7d98007ad0 con 0x7f7d9c101420 2024-09-10T09:42:00.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.459+0000 7f7d927fc700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7d8806e340 0x7f7d880707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.459+0000 7f7d927fc700 1 -- 172.21.15.79:0/2823983227 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7d9808dfe0 con 0x7f7d9c101420 2024-09-10T09:42:00.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.460+0000 7f7da0e5a700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7d8806e340 0x7f7d880707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.462 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.460+0000 7f7da0e5a700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7d8806e340 0x7f7d880707f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0059d0 tx=0x7f7d8c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:00.465 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.464+0000 7f7d927fc700 1 -- 172.21.15.79:0/2823983227 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7d98057250 con 0x7f7d9c101420 2024-09-10T09:42:00.758 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.757+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d9c061190 con 0x7f7d8806e340 2024-09-10T09:42:00.759 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.758+0000 7f7d927fc700 1 -- 172.21.15.79:0/2823983227 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7d9c061190 con 0x7f7d8806e340 2024-09-10T09:42:00.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7d8806e340 msgr2=0x7f7d880707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.761 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7d8806e340 0x7f7d880707f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c0059d0 tx=0x7f7d8c01a040 comp rx=0 tx=0).stop 2024-09-10T09:42:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101420 msgr2=0x7f7d9c0ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101420 0x7f7d9c0ff080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c8a0 tx=0x7f7d9800cc60 comp rx=0 tx=0).stop 2024-09-10T09:42:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 shutdown_connections 2024-09-10T09:42:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7d8806e340 0x7f7d880707f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d9c101420 0x7f7d9c0ff080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 --2- 172.21.15.79:0/2823983227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d9c101d30 0x7f7d9c0ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 >> 172.21.15.79:0/2823983227 conn(0x7f7d9c0fac60 msgr2=0x7f7d9c1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:00.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 shutdown_connections 2024-09-10T09:42:00.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.761+0000 7f7da38bf700 1 -- 172.21.15.79:0/2823983227 wait complete. 2024-09-10T09:42:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 -- 172.21.15.79:0/3239318583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 msgr2=0x7f8e440ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/3239318583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e440ff790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009910 tx=0x7f8e34009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:00.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 -- 172.21.15.79:0/3239318583 shutdown_connections 2024-09-10T09:42:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/3239318583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e440ffd60 0x7f8e44103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/3239318583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e440ff790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 -- 172.21.15.79:0/3239318583 >> 172.21.15.79:0/3239318583 conn(0x7f8e440fac80 msgr2=0x7f8e440fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 -- 172.21.15.79:0/3239318583 shutdown_connections 2024-09-10T09:42:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.888+0000 7f8e48bfb700 1 -- 172.21.15.79:0/3239318583 wait complete. 2024-09-10T09:42:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.889+0000 7f8e48bfb700 1 Processor -- start 2024-09-10T09:42:00.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.889+0000 7f8e48bfb700 1 -- start start 2024-09-10T09:42:00.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.889+0000 7f8e48bfb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e44100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.889+0000 7f8e48bfb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e440ffd60 0x7f8e44101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.889+0000 7f8e48bfb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e44101850 con 0x7f8e440ff3c0 2024-09-10T09:42:00.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.889+0000 7f8e48bfb700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e44101990 con 0x7f8e440ffd60 2024-09-10T09:42:00.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e4259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e44100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e4259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e44100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56680/0 (socket says 172.21.15.79:56680) 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e4259c700 1 -- 172.21.15.79:0/2718700671 learned_addr learned my addr 172.21.15.79:0/2718700671 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e41d9b700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e440ffd60 0x7f8e44101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e4259c700 1 -- 172.21.15.79:0/2718700671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e440ffd60 msgr2=0x7f8e44101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e4259c700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e440ffd60 0x7f8e44101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e4259c700 1 -- 172.21.15.79:0/2718700671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e340095f0 con 0x7f8e440ff3c0 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.890+0000 7f8e41d9b700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e440ffd60 0x7f8e44101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:42:00.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.891+0000 7f8e4259c700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e44100dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e34005f50 tx=0x7f8e3400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.891+0000 7f8e337fe700 1 -- 172.21.15.79:0/2718700671 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3401d070 con 0x7f8e440ff3c0 2024-09-10T09:42:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.891+0000 7f8e337fe700 1 -- 172.21.15.79:0/2718700671 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e3400b610 con 0x7f8e440ff3c0 2024-09-10T09:42:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.891+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e44101c10 con 0x7f8e440ff3c0 2024-09-10T09:42:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.891+0000 7f8e337fe700 1 -- 172.21.15.79:0/2718700671 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e34022470 con 0x7f8e440ff3c0 2024-09-10T09:42:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.891+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e441a2360 con 0x7f8e440ff3c0 2024-09-10T09:42:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.892+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4404f2a0 con 0x7f8e440ff3c0 2024-09-10T09:42:00.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.893+0000 7f8e337fe700 1 -- 172.21.15.79:0/2718700671 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f8e34003780 con 0x7f8e440ff3c0 2024-09-10T09:42:00.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.894+0000 7f8e337fe700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8e2c06e340 0x7f8e2c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:00.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.894+0000 7f8e41d9b700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8e2c06e340 0x7f8e2c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:00.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.894+0000 7f8e337fe700 1 -- 172.21.15.79:0/2718700671 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8e3408f820 con 0x7f8e440ff3c0 2024-09-10T09:42:00.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.894+0000 7f8e41d9b700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8e2c06e340 0x7f8e2c0707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8e441025c0 tx=0x7f8e38009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:00.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:00.898+0000 7f8e337fe700 1 -- 172.21.15.79:0/2718700671 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8e34058bd0 con 0x7f8e440ff3c0 2024-09-10T09:42:01.051 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:00 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.051 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:00 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.051 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:00 smithi079 ceph-mon[87213]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:01.051 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:00 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.051 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:00 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.134 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.133+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e440fba50 con 0x7f8e2c06e340 2024-09-10T09:42:01.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.150+0000 7f8e337fe700 1 -- 172.21.15.79:0/2718700671 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f8e440fba50 con 0x7f8e2c06e340 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (3m) 1s ago 13m 26.9M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (14m) 1s ago 14m 8102k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (13m) 23s ago 13m 7998k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (31s) 1s ago 14m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (26s) 23s ago 13m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (2m) 1s ago 13m 75.6M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (8m) 1s ago 8m 16.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (8m) 1s ago 8m 97.7M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:42:01.152 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (8m) 23s ago 8m 152M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (8m) 23s ago 8m 20.1M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (4m) 1s ago 15m 493M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (4m) 23s ago 13m 439M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (93s) 1s ago 15m 45.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (72s) 23s ago 12m 39.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (3m) 1s ago 14m 15.2M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (3m) 23s ago 13m 15.7M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (6s) 1s ago 12m 11.3M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (11m) 1s ago 11m 264M 1216M 18.2.0 dc2bc1663786 819a4479580f 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (11m) 1s ago 11m 225M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:42:01.153 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (10m) 23s ago 10m 291M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:42:01.154 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (10m) 23s ago 10m 256M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:42:01.154 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (9m) 23s ago 9m 255M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:42:01.154 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (3m) 1s ago 13m 76.7M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:42:01.154 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8e2c06e340 msgr2=0x7f8e2c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8e2c06e340 0x7f8e2c0707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8e441025c0 tx=0x7f8e38009260 comp rx=0 tx=0).stop 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 msgr2=0x7f8e44100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e44100dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e34005f50 tx=0x7f8e3400f690 comp rx=0 tx=0).stop 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 shutdown_connections 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8e2c06e340 0x7f8e2c0707f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e440ff3c0 0x7f8e44100dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 --2- 172.21.15.79:0/2718700671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e440ffd60 0x7f8e44101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 >> 172.21.15.79:0/2718700671 conn(0x7f8e440fac80 msgr2=0x7f8e44103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 shutdown_connections 2024-09-10T09:42:01.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.153+0000 7f8e48bfb700 1 -- 172.21.15.79:0/2718700671 wait complete. 2024-09-10T09:42:01.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:00 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:00 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:00 smithi135 ceph-mon[65362]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:01.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:00 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:00 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:01.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 -- 172.21.15.79:0/1021968874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63340ffbd0 msgr2=0x7f6334100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 --2- 172.21.15.79:0/1021968874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63340ffbd0 0x7f6334100040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6324009910 tx=0x7f6324009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:01.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 -- 172.21.15.79:0/1021968874 shutdown_connections 2024-09-10T09:42:01.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 --2- 172.21.15.79:0/1021968874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63340ffbd0 0x7f6334100040 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 --2- 172.21.15.79:0/1021968874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6334104130 0x7f6334104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 -- 172.21.15.79:0/1021968874 >> 172.21.15.79:0/1021968874 conn(0x7f6334075130 msgr2=0x7f6334075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:01.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 -- 172.21.15.79:0/1021968874 shutdown_connections 2024-09-10T09:42:01.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.264+0000 7f633c38f700 1 -- 172.21.15.79:0/1021968874 wait complete. 2024-09-10T09:42:01.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633c38f700 1 Processor -- start 2024-09-10T09:42:01.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633c38f700 1 -- start start 2024-09-10T09:42:01.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633c38f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63340ffbd0 0x7f6334196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:01.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633c38f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6334104130 0x7f63341971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633c38f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6334197800 con 0x7f6334104130 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633c38f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6334197940 con 0x7f63340ffbd0 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633992a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6334104130 0x7f63341971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633992a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6334104130 0x7f63341971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56692/0 (socket says 172.21.15.79:56692) 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.265+0000 7f633992a700 1 -- 172.21.15.79:0/3722857920 learned_addr learned my addr 172.21.15.79:0/3722857920 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f633a12b700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63340ffbd0 0x7f6334196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f633992a700 1 -- 172.21.15.79:0/3722857920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63340ffbd0 msgr2=0x7f6334196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f633992a700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63340ffbd0 0x7f6334196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f633992a700 1 -- 172.21.15.79:0/3722857920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63240095f0 con 0x7f6334104130 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f633992a700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6334104130 0x7f63341971e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6324006010 tx=0x7f632400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:01.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f632b7fe700 1 -- 172.21.15.79:0/3722857920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f632401d070 con 0x7f6334104130 2024-09-10T09:42:01.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f632b7fe700 1 -- 172.21.15.79:0/3722857920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6324004fb0 con 0x7f6334104130 2024-09-10T09:42:01.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633419fd10 con 0x7f6334104130 2024-09-10T09:42:01.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f632b7fe700 1 -- 172.21.15.79:0/3722857920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f632400f480 con 0x7f6334104130 2024-09-10T09:42:01.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.266+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63341a0120 con 0x7f6334104130 2024-09-10T09:42:01.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.267+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633404f2a0 con 0x7f6334104130 2024-09-10T09:42:01.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.268+0000 7f632b7fe700 1 -- 172.21.15.79:0/3722857920 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6324022890 con 0x7f6334104130 2024-09-10T09:42:01.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.268+0000 7f632b7fe700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f632006e330 0x7f63200707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:01.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.269+0000 7f632b7fe700 1 -- 172.21.15.79:0/3722857920 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f632408f9b0 con 0x7f6334104130 2024-09-10T09:42:01.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.269+0000 7f633a12b700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f632006e330 0x7f63200707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:01.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.269+0000 7f633a12b700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f632006e330 0x7f63200707e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6330005fd0 tx=0x7f633000a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:01.274 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.273+0000 7f632b7fe700 1 -- 172.21.15.79:0/3722857920 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6324058c30 con 0x7f6334104130 2024-09-10T09:42:01.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.569+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f63341a0470 con 0x7f6334104130 2024-09-10T09:42:01.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.570+0000 7f632b7fe700 1 -- 172.21.15.79:0/3722857920 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+693 (secure 0 0 0) 0x7f632405c2f0 con 0x7f6334104130 2024-09-10T09:42:01.571 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:42:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:42:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:42:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:01.571 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 9, 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:42:01.572 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:42:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f632006e330 msgr2=0x7f63200707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f632006e330 0x7f63200707e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6330005fd0 tx=0x7f633000a560 comp rx=0 tx=0).stop 2024-09-10T09:42:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6334104130 msgr2=0x7f63341971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6334104130 0x7f63341971e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6324006010 tx=0x7f632400be20 comp rx=0 tx=0).stop 2024-09-10T09:42:01.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 shutdown_connections 2024-09-10T09:42:01.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f632006e330 0x7f63200707e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63340ffbd0 0x7f6334196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 --2- 172.21.15.79:0/3722857920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6334104130 0x7f63341971e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 >> 172.21.15.79:0/3722857920 conn(0x7f6334075130 msgr2=0x7f63340feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:01.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 shutdown_connections 2024-09-10T09:42:01.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.572+0000 7f633c38f700 1 -- 172.21.15.79:0/3722857920 wait complete. 2024-09-10T09:42:01.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 -- 172.21.15.79:0/285615195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 msgr2=0x7f4628100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 --2- 172.21.15.79:0/285615195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628100040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4618009910 tx=0x7f4618009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 -- 172.21.15.79:0/285615195 shutdown_connections 2024-09-10T09:42:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 --2- 172.21.15.79:0/285615195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628100040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 --2- 172.21.15.79:0/285615195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4628104130 0x7f4628104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 -- 172.21.15.79:0/285615195 >> 172.21.15.79:0/285615195 conn(0x7f4628075130 msgr2=0x7f4628075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 -- 172.21.15.79:0/285615195 shutdown_connections 2024-09-10T09:42:01.685 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.683+0000 7f462f578700 1 -- 172.21.15.79:0/285615195 wait complete. 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.684+0000 7f462f578700 1 Processor -- start 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.684+0000 7f462f578700 1 -- start start 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462f578700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628194d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462f578700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4628104130 0x7f4628195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462f578700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628195950 con 0x7f46280ffbd0 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462f578700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46281996e0 con 0x7f4628104130 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462d314700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628194d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462d314700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628194d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:56712/0 (socket says 172.21.15.79:56712) 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462d314700 1 -- 172.21.15.79:0/4016483275 learned_addr learned my addr 172.21.15.79:0/4016483275 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462cb13700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4628104130 0x7f4628195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:01.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462d314700 1 -- 172.21.15.79:0/4016483275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4628104130 msgr2=0x7f4628195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462d314700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4628104130 0x7f4628195270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462d314700 1 -- 172.21.15.79:0/4016483275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46180095f0 con 0x7f46280ffbd0 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f462d314700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628194d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f462400d8d0 tx=0x7f462400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.685+0000 7f461e7fc700 1 -- 172.21.15.79:0/4016483275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46240098a0 con 0x7f46280ffbd0 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.686+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4628199900 con 0x7f46280ffbd0 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.686+0000 7f461e7fc700 1 -- 172.21.15.79:0/4016483275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4624010460 con 0x7f46280ffbd0 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.686+0000 7f461e7fc700 1 -- 172.21.15.79:0/4016483275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462400f5f0 con 0x7f46280ffbd0 2024-09-10T09:42:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.686+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4628199e50 con 0x7f46280ffbd0 2024-09-10T09:42:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.687+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462804f2a0 con 0x7f46280ffbd0 2024-09-10T09:42:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.688+0000 7f461e7fc700 1 -- 172.21.15.79:0/4016483275 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f4624009a00 con 0x7f46280ffbd0 2024-09-10T09:42:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.688+0000 7f461e7fc700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f461406e340 0x7f46140707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.688+0000 7f461e7fc700 1 -- 172.21.15.79:0/4016483275 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f462408e180 con 0x7f46280ffbd0 2024-09-10T09:42:01.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.688+0000 7f462cb13700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f461406e340 0x7f46140707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:01.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.689+0000 7f462cb13700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f461406e340 0x7f46140707f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4628196350 tx=0x7f461801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:01.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.696+0000 7f461e7fc700 1 -- 172.21.15.79:0/4016483275 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f46240573f0 con 0x7f46280ffbd0 2024-09-10T09:42:01.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.955+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f462819a070 con 0x7f46280ffbd0 2024-09-10T09:42:01.957 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:01 smithi079 ceph-mon[87213]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:01.957 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:01 smithi079 ceph-mon[87213]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:01.957 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:01 smithi079 ceph-mon[87213]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:01.957 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:01 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3722857920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:01.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.956+0000 7f461e7fc700 1 -- 172.21.15.79:0/4016483275 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f462405aab0 con 0x7f46280ffbd0 2024-09-10T09:42:01.957 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:42:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:42:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:01.960 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:01.961 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:42:01.961 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:01.961 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:01.961 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:01.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f461406e340 msgr2=0x7f46140707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f461406e340 0x7f46140707f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4628196350 tx=0x7f461801a040 comp rx=0 tx=0).stop 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 msgr2=0x7f4628194d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628194d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f462400d8d0 tx=0x7f462400dbe0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 shutdown_connections 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f461406e340 0x7f46140707f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46280ffbd0 0x7f4628194d30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 --2- 172.21.15.79:0/4016483275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4628104130 0x7f4628195270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 >> 172.21.15.79:0/4016483275 conn(0x7f4628075130 msgr2=0x7f46280feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 shutdown_connections 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:01.958+0000 7f462f578700 1 -- 172.21.15.79:0/4016483275 wait complete. 2024-09-10T09:42:01.962 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:42:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 -- 172.21.15.79:0/2111056246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ff3b0 msgr2=0x7f321c0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 --2- 172.21.15.79:0/2111056246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ff3b0 0x7f321c0ff780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f321400b0a0 tx=0x7f321400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 -- 172.21.15.79:0/2111056246 shutdown_connections 2024-09-10T09:42:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 --2- 172.21.15.79:0/2111056246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f321c0ffd50 0x7f321c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.064 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 --2- 172.21.15.79:0/2111056246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ff3b0 0x7f321c0ff780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 -- 172.21.15.79:0/2111056246 >> 172.21.15.79:0/2111056246 conn(0x7f321c0fac90 msgr2=0x7f321c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 -- 172.21.15.79:0/2111056246 shutdown_connections 2024-09-10T09:42:02.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.063+0000 7f3223be3700 1 -- 172.21.15.79:0/2111056246 wait complete. 2024-09-10T09:42:02.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f3223be3700 1 Processor -- start 2024-09-10T09:42:02.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f3223be3700 1 -- start start 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f3223be3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f321c0ff3b0 0x7f321c196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f3223be3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ffd50 0x7f321c197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f3223be3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c1978a0 con 0x7f321c0ffd50 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f3223be3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c197a10 con 0x7f321c0ff3b0 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f322117e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ffd50 0x7f321c197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f322117e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ffd50 0x7f321c197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60408/0 (socket says 172.21.15.79:60408) 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f322117e700 1 -- 172.21.15.79:0/3524944234 learned_addr learned my addr 172.21.15.79:0/3524944234 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f322117e700 1 -- 172.21.15.79:0/3524944234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f321c0ff3b0 msgr2=0x7f321c196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f322197f700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f321c0ff3b0 0x7f321c196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f322117e700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f321c0ff3b0 0x7f321c196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.064+0000 7f322117e700 1 -- 172.21.15.79:0/3524944234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3214009d00 con 0x7f321c0ffd50 2024-09-10T09:42:02.067 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.065+0000 7f322117e700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ffd50 0x7f321c197280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f321000d900 tx=0x7f321000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.065+0000 7f321affd700 1 -- 172.21.15.79:0/3524944234 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3210009900 con 0x7f321c0ffd50 2024-09-10T09:42:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.065+0000 7f321affd700 1 -- 172.21.15.79:0/3524944234 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3210010460 con 0x7f321c0ffd50 2024-09-10T09:42:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.065+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c19fdb0 con 0x7f321c0ffd50 2024-09-10T09:42:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.065+0000 7f321affd700 1 -- 172.21.15.79:0/3524944234 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f321000f5f0 con 0x7f321c0ffd50 2024-09-10T09:42:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.065+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c1a02a0 con 0x7f321c0ffd50 2024-09-10T09:42:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.066+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c1076c0 con 0x7f321c0ffd50 2024-09-10T09:42:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.066+0000 7f321affd700 1 -- 172.21.15.79:0/3524944234 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f32100105d0 con 0x7f321c0ffd50 2024-09-10T09:42:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.067+0000 7f321affd700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f320406e340 0x7f32040707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.067+0000 7f321affd700 1 -- 172.21.15.79:0/3524944234 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f321008e0f0 con 0x7f321c0ffd50 2024-09-10T09:42:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.067+0000 7f322197f700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f320406e340 0x7f32040707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:02.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.067+0000 7f322197f700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f320406e340 0x7f32040707f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f321400b830 tx=0x7f3214006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:02.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.071+0000 7f321affd700 1 -- 172.21.15.79:0/3524944234 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3210057360 con 0x7f321c0ffd50 2024-09-10T09:42:02.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:01 smithi135 ceph-mon[65362]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:01 smithi135 ceph-mon[65362]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:01 smithi135 ceph-mon[65362]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:02.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:01 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3722857920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.308+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f321c061190 con 0x7f320406e340 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.310+0000 7f321affd700 1 -- 172.21.15.79:0/3524944234 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f321c061190 con 0x7f320406e340 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:42:02.311 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:42:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "7/23 daemons upgraded", 2024-09-10T09:42:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T09:42:02.312 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:42:02.312 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:42:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f320406e340 msgr2=0x7f32040707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f320406e340 0x7f32040707f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f321400b830 tx=0x7f3214006000 comp rx=0 tx=0).stop 2024-09-10T09:42:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ffd50 msgr2=0x7f321c197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ffd50 0x7f321c197280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f321000d900 tx=0x7f321000dcc0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 shutdown_connections 2024-09-10T09:42:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f320406e340 0x7f32040707f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f321c0ff3b0 0x7f321c196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 --2- 172.21.15.79:0/3524944234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f321c0ffd50 0x7f321c197280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 >> 172.21.15.79:0/3524944234 conn(0x7f321c0fac90 msgr2=0x7f321c0fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 shutdown_connections 2024-09-10T09:42:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.313+0000 7f3223be3700 1 -- 172.21.15.79:0/3524944234 wait complete. 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 -- 172.21.15.79:0/1596864979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 msgr2=0x7eff280689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 --2- 172.21.15.79:0/1596864979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff280689b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009910 tx=0x7eff1c009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 -- 172.21.15.79:0/1596864979 shutdown_connections 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 --2- 172.21.15.79:0/1596864979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff280689b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 --2- 172.21.15.79:0/1596864979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff28106320 0x7eff281066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 -- 172.21.15.79:0/1596864979 >> 172.21.15.79:0/1596864979 conn(0x7eff28075130 msgr2=0x7eff28075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 -- 172.21.15.79:0/1596864979 shutdown_connections 2024-09-10T09:42:02.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.425+0000 7eff2d058700 1 -- 172.21.15.79:0/1596864979 wait complete. 2024-09-10T09:42:02.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff2d058700 1 Processor -- start 2024-09-10T09:42:02.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff2d058700 1 -- start start 2024-09-10T09:42:02.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff2d058700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff28195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:02.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff2d058700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff28106320 0x7eff281963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:02.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff2d058700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28196a80 con 0x7eff28068540 2024-09-10T09:42:02.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff2d058700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2819a810 con 0x7eff28106320 2024-09-10T09:42:02.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff26d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff28195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:02.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff26d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff28195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:60428/0 (socket says 172.21.15.79:60428) 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.426+0000 7eff26d9d700 1 -- 172.21.15.79:0/1342564124 learned_addr learned my addr 172.21.15.79:0/1342564124 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff2659c700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff28106320 0x7eff281963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff26d9d700 1 -- 172.21.15.79:0/1342564124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff28106320 msgr2=0x7eff281963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff26d9d700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff28106320 0x7eff281963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff26d9d700 1 -- 172.21.15.79:0/1342564124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0095f0 con 0x7eff28068540 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff26d9d700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff28195e60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff1800d8d0 tx=0x7eff1800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff0ffff700 1 -- 172.21.15.79:0/1342564124 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff18009940 con 0x7eff28068540 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2819aaf0 con 0x7eff28068540 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff0ffff700 1 -- 172.21.15.79:0/1342564124 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff18010460 con 0x7eff28068540 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff0ffff700 1 -- 172.21.15.79:0/1342564124 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1800f5f0 con 0x7eff28068540 2024-09-10T09:42:02.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.427+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2819b040 con 0x7eff28068540 2024-09-10T09:42:02.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.428+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff28108770 con 0x7eff28068540 2024-09-10T09:42:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.429+0000 7eff0ffff700 1 -- 172.21.15.79:0/1342564124 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 37) v1 ==== 92305+0+0 (secure 0 0 0) 0x7eff180105d0 con 0x7eff28068540 2024-09-10T09:42:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.429+0000 7eff0ffff700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1006e340 0x7eff100707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.429+0000 7eff0ffff700 1 -- 172.21.15.79:0/1342564124 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6156+0+0 (secure 0 0 0) 0x7eff1808e280 con 0x7eff28068540 2024-09-10T09:42:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.429+0000 7eff2659c700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1006e340 0x7eff100707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:02.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.430+0000 7eff2659c700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1006e340 0x7eff100707f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff1c005b40 tx=0x7eff1c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:02.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.434+0000 7eff0ffff700 1 -- 172.21.15.79:0/1342564124 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7eff180574f0 con 0x7eff28068540 2024-09-10T09:42:02.570 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:42:02 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[98739]: 2024-09-10T09:42:02.407+0000 7f75c18a6640 -1 osd.0 0 read_superblock omap replica is missing. 2024-09-10T09:42:02.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.771+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7eff2804f2a0 con 0x7eff28068540 2024-09-10T09:42:02.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.771+0000 7eff0ffff700 1 -- 172.21.15.79:0/1342564124 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1406 (secure 0 0 0) 0x7eff1805abb0 con 0x7eff28068540 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout: osd.0 (root=default,host=smithi079) is down 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-10T09:42:02.773 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-10T09:42:02.774 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-10T09:42:02.775 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-10T09:42:02.775 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-10T09:42:02.775 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-10T09:42:02.775 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-10T09:42:02.775 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-10T09:42:02.775 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-10T09:42:02.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1006e340 msgr2=0x7eff100707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1006e340 0x7eff100707f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff1c005b40 tx=0x7eff1c01a040 comp rx=0 tx=0).stop 2024-09-10T09:42:02.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 msgr2=0x7eff28195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:02.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff28195e60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff1800d8d0 tx=0x7eff1800dc90 comp rx=0 tx=0).stop 2024-09-10T09:42:02.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 shutdown_connections 2024-09-10T09:42:02.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1006e340 0x7eff100707f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff28068540 0x7eff28195e60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 --2- 172.21.15.79:0/1342564124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff28106320 0x7eff281963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:02.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.774+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 >> 172.21.15.79:0/1342564124 conn(0x7eff28075130 msgr2=0x7eff280febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:02.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.775+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 shutdown_connections 2024-09-10T09:42:02.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:02.775+0000 7eff2d058700 1 -- 172.21.15.79:0/1342564124 wait complete. 2024-09-10T09:42:03.211 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:42:02 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[98739]: 2024-09-10T09:42:02.850+0000 7f75c18a6640 -1 osd.0 50 log_to_monitors true 2024-09-10T09:42:03.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:02 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/4016483275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:42:03.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:02 smithi079 ceph-mon[87213]: pgmap v49: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 772 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:03.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:02 smithi079 ceph-mon[87213]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:03.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:02 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1342564124' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:42:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:02 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/4016483275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:42:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:02 smithi135 ceph-mon[65362]: pgmap v49: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 772 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:03.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:02 smithi135 ceph-mon[65362]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:03.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:02 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1342564124' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:42:03.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:03 smithi079 ceph-mon[87213]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T09:42:04.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:03 smithi135 ceph-mon[65362]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T09:42:04.962 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[98739]: 2024-09-10T09:42:04.642+0000 7f75b5638640 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: osdmap e53: 6 total, 5 up, 6 in 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: pgmap v51: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:04.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:04.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:04 smithi079 ceph-mon[87213]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' 2024-09-10T09:42:05.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: osdmap e53: 6 total, 5 up, 6 in 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: pgmap v51: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:42:05.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:05.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:05.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:05.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:05.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:04 smithi135 ceph-mon[65362]: from='osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534]' entity='osd.0' 2024-09-10T09:42:06.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:05 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:06.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:05 smithi079 ceph-mon[87213]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T09:42:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:05 smithi079 ceph-mon[87213]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:42:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:05 smithi079 ceph-mon[87213]: osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534] boot 2024-09-10T09:42:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:05 smithi079 ceph-mon[87213]: osdmap e54: 6 total, 6 up, 6 in 2024-09-10T09:42:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:42:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:05 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:06.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:05 smithi135 ceph-mon[65362]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-10T09:42:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:05 smithi135 ceph-mon[65362]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:42:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:05 smithi135 ceph-mon[65362]: osd.0 [v2:172.21.15.79:6802/1590249534,v1:172.21.15.79:6803/1590249534] boot 2024-09-10T09:42:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:05 smithi135 ceph-mon[65362]: osdmap e54: 6 total, 6 up, 6 in 2024-09-10T09:42:06.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T09:42:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:06 smithi079 ceph-mon[87213]: pgmap v53: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 383 B/s wr, 2 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:06 smithi079 ceph-mon[87213]: osdmap e55: 6 total, 6 up, 6 in 2024-09-10T09:42:07.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:06 smithi135 ceph-mon[65362]: pgmap v53: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 383 B/s wr, 2 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:07.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:06 smithi135 ceph-mon[65362]: osdmap e55: 6 total, 6 up, 6 in 2024-09-10T09:42:08.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:07 smithi079 ceph-mon[87213]: mgrmap e38: smithi079.mhirny(active, since 92s), standbys: smithi135.lbhjof 2024-09-10T09:42:08.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:07 smithi135 ceph-mon[65362]: mgrmap e38: smithi079.mhirny(active, since 92s), standbys: smithi135.lbhjof 2024-09-10T09:42:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:08 smithi079 ceph-mon[87213]: pgmap v55: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:09.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:08 smithi135 ceph-mon[65362]: pgmap v55: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 511 B/s wr, 2 op/s; 45/222 objects degraded (20.270%) 2024-09-10T09:42:10.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:10 smithi079 ceph-mon[87213]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded) 2024-09-10T09:42:10.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:10 smithi135 ceph-mon[65362]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 45/222 objects degraded (20.270%), 17 pgs degraded) 2024-09-10T09:42:11.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:11 smithi079 ceph-mon[87213]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 491 B/s wr, 3 op/s; 45 B/s, 0 objects/s recovering 2024-09-10T09:42:11.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:11 smithi135 ceph-mon[65362]: pgmap v56: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 491 B/s wr, 3 op/s; 45 B/s, 0 objects/s recovering 2024-09-10T09:42:13.455 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:13 smithi079 ceph-mon[87213]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s; 35 B/s, 0 objects/s recovering 2024-09-10T09:42:13.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:13 smithi135 ceph-mon[65362]: pgmap v57: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s; 35 B/s, 0 objects/s recovering 2024-09-10T09:42:15.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:15 smithi079 ceph-mon[87213]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 484 B/s rd, 0 op/s; 33 B/s, 0 objects/s recovering 2024-09-10T09:42:15.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:15 smithi135 ceph-mon[65362]: pgmap v58: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 484 B/s rd, 0 op/s; 33 B/s, 0 objects/s recovering 2024-09-10T09:42:17.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:17 smithi079 ceph-mon[87213]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-09-10T09:42:17.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:17 smithi135 ceph-mon[65362]: pgmap v59: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s; 28 B/s, 0 objects/s recovering 2024-09-10T09:42:19.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:19 smithi135 ceph-mon[65362]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 804 B/s rd, 1 op/s; 24 B/s, 0 objects/s recovering 2024-09-10T09:42:19.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:19.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:19.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:19 smithi079 ceph-mon[87213]: pgmap v60: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 804 B/s rd, 1 op/s; 24 B/s, 0 objects/s recovering 2024-09-10T09:42:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:20.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:20.483 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:21 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:21 smithi079 ceph-mon[87213]: Upgrade: osd.1 is safe to restart 2024-09-10T09:42:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:21 smithi079 ceph-mon[87213]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 23 B/s, 0 objects/s recovering 2024-09-10T09:42:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:21 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:21 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:42:21.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:21 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:21.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:21 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-10T09:42:21.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:21 smithi135 ceph-mon[65362]: Upgrade: osd.1 is safe to restart 2024-09-10T09:42:21.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:21 smithi135 ceph-mon[65362]: pgmap v61: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 23 B/s, 0 objects/s recovering 2024-09-10T09:42:21.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:21 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:21.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:21 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T09:42:21.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:21 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:22.421 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:22 smithi079 ceph-mon[87213]: Upgrade: Updating osd.1 2024-09-10T09:42:22.421 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:22 smithi079 ceph-mon[87213]: Deploying daemon osd.1 on smithi079 2024-09-10T09:42:22.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:22 smithi135 ceph-mon[65362]: Upgrade: Updating osd.1 2024-09-10T09:42:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:22 smithi135 ceph-mon[65362]: Deploying daemon osd.1 on smithi079 2024-09-10T09:42:23.367 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:23 smithi079 ceph-mon[87213]: pgmap v62: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:23.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:23 smithi135 ceph-mon[65362]: pgmap v62: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:23.989 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:23 smithi079 systemd[1]: Stopping Ceph osd.1 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:42:24.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:24 smithi079 ceph-mon[87213]: osd.1 marked itself down and dead 2024-09-10T09:42:24.462 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:23 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[48176]: 2024-09-10T09:42:23.987+0000 7f87417a3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:42:24.462 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:23 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[48176]: 2024-09-10T09:42:23.987+0000 7f87417a3700 -1 osd.1 55 *** Got signal Terminated *** 2024-09-10T09:42:24.462 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:23 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[48176]: 2024-09-10T09:42:23.988+0000 7f87417a3700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:42:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:24 smithi135 ceph-mon[65362]: osd.1 marked itself down and dead 2024-09-10T09:42:25.031 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:24 smithi079 podman[103837]: 2024-09-10 09:42:24.775163305 +0000 UTC m=+0.896120348 container died 819a4479580f050391afd31fdc0097f4cefae869e2c05c8566d66de1f0aca2bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, ceph=True, io.buildah.version=1.29.1) 2024-09-10T09:42:25.424 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:25 smithi079 ceph-mon[87213]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:25.424 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:25 smithi079 ceph-mon[87213]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:42:25.424 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:25 smithi079 ceph-mon[87213]: osdmap e56: 6 total, 5 up, 6 in 2024-09-10T09:42:25.424 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:25 smithi079 podman[103837]: 2024-09-10 09:42:25.213494701 +0000 UTC m=+1.334451734 container cleanup 819a4479580f050391afd31fdc0097f4cefae869e2c05c8566d66de1f0aca2bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T09:42:25.424 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:25 smithi079 bash[103837]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1 2024-09-10T09:42:25.711 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:25 smithi079 podman[103851]: 2024-09-10 09:42:25.423528888 +0000 UTC m=+0.648795825 container remove 819a4479580f050391afd31fdc0097f4cefae869e2c05c8566d66de1f0aca2bc (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212) 2024-09-10T09:42:25.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:25 smithi135 ceph-mon[65362]: pgmap v63: 65 pgs: 65 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:25.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:25 smithi135 ceph-mon[65362]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:42:25.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:25 smithi135 ceph-mon[65362]: osdmap e56: 6 total, 5 up, 6 in 2024-09-10T09:42:26.094 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:25 smithi079 podman[103941]: 2024-09-10 09:42:25.73285655 +0000 UTC m=+0.015946882 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:42:26.094 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:25 smithi079 podman[103941]: 2024-09-10 09:42:25.840918165 +0000 UTC m=+0.124008480 container create fdea2e43a5e2deaa1d9808d91b993ebcd501f24690f8ed2fb0b7c797b0f7f6d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T09:42:26.094 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 podman[103941]: 2024-09-10 09:42:26.093839194 +0000 UTC m=+0.376929511 container init fdea2e43a5e2deaa1d9808d91b993ebcd501f24690f8ed2fb0b7c797b0f7f6d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T09:42:26.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:26 smithi079 ceph-mon[87213]: osdmap e57: 6 total, 5 up, 6 in 2024-09-10T09:42:26.462 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 podman[103941]: 2024-09-10 09:42:26.097286507 +0000 UTC m=+0.380376829 container start fdea2e43a5e2deaa1d9808d91b993ebcd501f24690f8ed2fb0b7c797b0f7f6d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T09:42:26.462 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 podman[103941]: 2024-09-10 09:42:26.210683576 +0000 UTC m=+0.493773931 container attach fdea2e43a5e2deaa1d9808d91b993ebcd501f24690f8ed2fb0b7c797b0f7f6d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T09:42:26.462 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 podman[103941]: 2024-09-10 09:42:26.287051534 +0000 UTC m=+0.570141861 container died fdea2e43a5e2deaa1d9808d91b993ebcd501f24690f8ed2fb0b7c797b0f7f6d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T09:42:26.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:26 smithi135 ceph-mon[65362]: osdmap e57: 6 total, 5 up, 6 in 2024-09-10T09:42:27.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 podman[103965]: 2024-09-10 09:42:26.947960076 +0000 UTC m=+0.652383414 container remove fdea2e43a5e2deaa1d9808d91b993ebcd501f24690f8ed2fb0b7c797b0f7f6d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:42:27.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-10T09:42:27.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 systemd[1]: Stopped Ceph osd.1 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:42:27.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:26 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.1.service: Consumed 1min 8.296s CPU time. 2024-09-10T09:42:27.212 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 systemd[1]: Starting Ceph osd.1 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:42:27.525 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:27 smithi079 ceph-mon[87213]: pgmap v66: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:42:27.525 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:27 smithi079 ceph-mon[87213]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-10T09:42:27.525 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 podman[104063]: 2024-09-10 09:42:27.3044212 +0000 UTC m=+0.015549143 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:42:27.525 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 podman[104063]: 2024-09-10 09:42:27.407776272 +0000 UTC m=+0.118904215 container create b620883d9f76573cbac02106fa027966dbb051f33812c220f9e02f6886f42e67 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T09:42:27.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:27 smithi135 ceph-mon[65362]: pgmap v66: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:42:27.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:27 smithi135 ceph-mon[65362]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-10T09:42:27.782 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 podman[104063]: 2024-09-10 09:42:27.652093289 +0000 UTC m=+0.363221236 container init b620883d9f76573cbac02106fa027966dbb051f33812c220f9e02f6886f42e67 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T09:42:27.782 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 podman[104063]: 2024-09-10 09:42:27.655997129 +0000 UTC m=+0.367125073 container start b620883d9f76573cbac02106fa027966dbb051f33812c220f9e02f6886f42e67 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:42:27.783 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 podman[104063]: 2024-09-10 09:42:27.726762041 +0000 UTC m=+0.437889999 container attach b620883d9f76573cbac02106fa027966dbb051f33812c220f9e02f6886f42e67 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T09:42:28.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:42:28.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 bash[104063]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:42:28.212 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:42:28.212 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:27 smithi079 bash[104063]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:42:28.809 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T09:42:28.809 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 bash[104063]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T09:42:28.809 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T09:42:28.809 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 bash[104063]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T09:42:29.206 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T09:42:29.206 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 bash[104063]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T09:42:29.206 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T09:42:29.206 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 bash[104063]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T09:42:29.207 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-10T09:42:29.207 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 bash[104063]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-10T09:42:29.207 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T09:42:29.207 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 bash[104063]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T09:42:29.207 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate[104077]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-10T09:42:29.207 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 bash[104063]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-10T09:42:29.207 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:28 smithi079 podman[104063]: 2024-09-10 09:42:28.83649447 +0000 UTC m=+1.547622414 container died b620883d9f76573cbac02106fa027966dbb051f33812c220f9e02f6886f42e67 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T09:42:29.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:29 smithi079 ceph-mon[87213]: pgmap v67: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-10T09:42:29.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:29 smithi135 ceph-mon[65362]: pgmap v67: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-10T09:42:29.857 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:29 smithi079 podman[104213]: 2024-09-10 09:42:29.51430943 +0000 UTC m=+0.668808507 container remove b620883d9f76573cbac02106fa027966dbb051f33812c220f9e02f6886f42e67 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T09:42:29.857 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:29 smithi079 podman[104270]: 2024-09-10 09:42:29.620281853 +0000 UTC m=+0.015993350 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:42:29.857 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:29 smithi079 podman[104270]: 2024-09-10 09:42:29.723478088 +0000 UTC m=+0.119189575 container create 032a78efcc7cbeb97bf0f4bcc574ce2e11b944c22940298c8150edbab672652e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T09:42:30.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:29 smithi079 podman[104270]: 2024-09-10 09:42:29.950903491 +0000 UTC m=+0.346614979 container init 032a78efcc7cbeb97bf0f4bcc574ce2e11b944c22940298c8150edbab672652e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T09:42:30.212 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:29 smithi079 podman[104270]: 2024-09-10 09:42:29.954258927 +0000 UTC m=+0.349970416 container start 032a78efcc7cbeb97bf0f4bcc574ce2e11b944c22940298c8150edbab672652e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T09:42:30.212 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:29 smithi079 ceph-osd[104289]: -- 172.21.15.79:0/3161915933 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5644074a81e0 con 0x564407490000 2024-09-10T09:42:30.212 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:30 smithi079 bash[104270]: 032a78efcc7cbeb97bf0f4bcc574ce2e11b944c22940298c8150edbab672652e 2024-09-10T09:42:30.212 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:30 smithi079 systemd[1]: Started Ceph osd.1 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:42:31.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:31 smithi079 ceph-mon[87213]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:31.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:31 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:31.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:31 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:31.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:31 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:42:31.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:31 smithi079 ceph-mon[87213]: Health check failed: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T09:42:31.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:31 smithi079 ceph-mon[87213]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-10T09:42:31.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:31 smithi135 ceph-mon[65362]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:31.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:31 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:31.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:31 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:31.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:31 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:42:31.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:31 smithi135 ceph-mon[65362]: Health check failed: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded (PG_DEGRADED) 2024-09-10T09:42:31.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:31 smithi135 ceph-mon[65362]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-10T09:42:31.711 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:31 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[104285]: 2024-09-10T09:42:31.605+0000 7fb2fa77c640 -1 Falling back to public interface 2024-09-10T09:42:32.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 -- 172.21.15.79:0/3732770328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 msgr2=0x7f73b810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:32.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 --2- 172.21.15.79:0/3732770328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b810a6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009910 tx=0x7f73a8009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 -- 172.21.15.79:0/3732770328 shutdown_connections 2024-09-10T09:42:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 --2- 172.21.15.79:0/3732770328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b810a6d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 --2- 172.21.15.79:0/3732770328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b80ff350 0x7f73b80ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 -- 172.21.15.79:0/3732770328 >> 172.21.15.79:0/3732770328 conn(0x7f73b80748b0 msgr2=0x7f73b8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 -- 172.21.15.79:0/3732770328 shutdown_connections 2024-09-10T09:42:32.891 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.889+0000 7f73bf445700 1 -- 172.21.15.79:0/3732770328 wait complete. 2024-09-10T09:42:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.890+0000 7f73bf445700 1 Processor -- start 2024-09-10T09:42:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.890+0000 7f73bf445700 1 -- start start 2024-09-10T09:42:32.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.890+0000 7f73bf445700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b80ff350 0x7f73b8100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.890+0000 7f73bf445700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b8100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.890+0000 7f73bf445700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8100fb0 con 0x7f73b80ffc60 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.890+0000 7f73bf445700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b81010f0 con 0x7f73b80ff350 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bc9e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b8100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bc9e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b8100a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34534/0 (socket says 172.21.15.79:34534) 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bc9e0700 1 -- 172.21.15.79:0/2186999440 learned_addr learned my addr 172.21.15.79:0/2186999440 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bd1e1700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b80ff350 0x7f73b8100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bc9e0700 1 -- 172.21.15.79:0/2186999440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b80ff350 msgr2=0x7f73b8100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bc9e0700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b80ff350 0x7f73b8100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bc9e0700 1 -- 172.21.15.79:0/2186999440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80095f0 con 0x7f73b80ffc60 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bc9e0700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b8100a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73a8000c00 tx=0x7f73a80055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73ae7fc700 1 -- 172.21.15.79:0/2186999440 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a801d070 con 0x7f73b80ffc60 2024-09-10T09:42:32.893 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73ae7fc700 1 -- 172.21.15.79:0/2186999440 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73a8005dc0 con 0x7f73b80ffc60 2024-09-10T09:42:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73ae7fc700 1 -- 172.21.15.79:0/2186999440 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73a8021410 con 0x7f73b80ffc60 2024-09-10T09:42:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.891+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b81a2090 con 0x7f73b80ffc60 2024-09-10T09:42:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.892+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b81a24a0 con 0x7f73b80ffc60 2024-09-10T09:42:32.894 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.892+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b8107dd0 con 0x7f73b80ffc60 2024-09-10T09:42:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.894+0000 7f73ae7fc700 1 -- 172.21.15.79:0/2186999440 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f73a800f6f0 con 0x7f73b80ffc60 2024-09-10T09:42:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.895+0000 7f73ae7fc700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f73a406e200 0x7f73a40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.895+0000 7f73ae7fc700 1 -- 172.21.15.79:0/2186999440 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f73a808f480 con 0x7f73b80ffc60 2024-09-10T09:42:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.895+0000 7f73bd1e1700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f73a406e200 0x7f73a40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:32.896 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.895+0000 7f73bd1e1700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f73a406e200 0x7f73a40706b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73b4005950 tx=0x7f73b400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:32.899 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:32.898+0000 7f73ae7fc700 1 -- 172.21.15.79:0/2186999440 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f73a8058a30 con 0x7f73b80ffc60 2024-09-10T09:42:33.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.131+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73b8061190 con 0x7f73a406e200 2024-09-10T09:42:33.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.132+0000 7f73ae7fc700 1 -- 172.21.15.79:0/2186999440 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f73b8061190 con 0x7f73a406e200 2024-09-10T09:42:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f73a406e200 msgr2=0x7f73a40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f73a406e200 0x7f73a40706b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73b4005950 tx=0x7f73b400b410 comp rx=0 tx=0).stop 2024-09-10T09:42:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 msgr2=0x7f73b8100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b8100a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73a8000c00 tx=0x7f73a80055f0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 shutdown_connections 2024-09-10T09:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f73a406e200 0x7f73a40706b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f73b80ff350 0x7f73b8100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 --2- 172.21.15.79:0/2186999440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f73b80ffc60 0x7f73b8100a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 >> 172.21.15.79:0/2186999440 conn(0x7f73b80748b0 msgr2=0x7f73b8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 shutdown_connections 2024-09-10T09:42:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.134+0000 7f73bf445700 1 -- 172.21.15.79:0/2186999440 wait complete. 2024-09-10T09:42:33.147 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:42:33.147 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:33 smithi079 ceph-mon[87213]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 -- 172.21.15.79:0/982568171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ff3c0 msgr2=0x7fa9ac0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 --2- 172.21.15.79:0/982568171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ff3c0 0x7fa9ac0ff790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009910 tx=0x7fa9a8009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:33.247 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 -- 172.21.15.79:0/982568171 shutdown_connections 2024-09-10T09:42:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 --2- 172.21.15.79:0/982568171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ac0ffd60 0x7fa9ac103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 --2- 172.21.15.79:0/982568171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ff3c0 0x7fa9ac0ff790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 -- 172.21.15.79:0/982568171 >> 172.21.15.79:0/982568171 conn(0x7fa9ac0fac60 msgr2=0x7fa9ac0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 -- 172.21.15.79:0/982568171 shutdown_connections 2024-09-10T09:42:33.248 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.246+0000 7fa9b360a700 1 -- 172.21.15.79:0/982568171 wait complete. 2024-09-10T09:42:33.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.247+0000 7fa9b360a700 1 Processor -- start 2024-09-10T09:42:33.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.247+0000 7fa9b360a700 1 -- start start 2024-09-10T09:42:33.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.247+0000 7fa9b360a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ac0ff3c0 0x7fa9ac196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.247+0000 7fa9b360a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ffd60 0x7fa9ac197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.247+0000 7fa9b360a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac197930 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.247+0000 7fa9b360a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ac197a70 con 0x7fa9ac0ff3c0 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b0ba5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ffd60 0x7fa9ac197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b0ba5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ffd60 0x7fa9ac197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34560/0 (socket says 172.21.15.79:34560) 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b13a6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ac0ff3c0 0x7fa9ac196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b0ba5700 1 -- 172.21.15.79:0/1822279459 learned_addr learned my addr 172.21.15.79:0/1822279459 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b0ba5700 1 -- 172.21.15.79:0/1822279459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ac0ff3c0 msgr2=0x7fa9ac196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b0ba5700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ac0ff3c0 0x7fa9ac196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b0ba5700 1 -- 172.21.15.79:0/1822279459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a80095f0 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b0ba5700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ffd60 0x7fa9ac197250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00e8f0 tx=0x7fa99c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9a27fc700 1 -- 172.21.15.79:0/1822279459 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99c009790 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.250 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9a27fc700 1 -- 172.21.15.79:0/1822279459 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa99c00c810 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9a27fc700 1 -- 172.21.15.79:0/1822279459 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa99c005580 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9ac19fd80 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.251 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.248+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ac1a02a0 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.249+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ac1076d0 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.250+0000 7fa9a27fc700 1 -- 172.21.15.79:0/1822279459 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa99c004a00 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.250+0000 7fa9a27fc700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa99806e200 0x7fa9980706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.250+0000 7fa9a27fc700 1 -- 172.21.15.79:0/1822279459 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa99c014070 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.251+0000 7fa9b13a6700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa99806e200 0x7fa9980706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.252 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.251+0000 7fa9b13a6700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa99806e200 0x7fa9980706b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800b760 tx=0x7fa9a8005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:33.256 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.255+0000 7fa9a27fc700 1 -- 172.21.15.79:0/1822279459 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa99c057740 con 0x7fa9ac0ffd60 2024-09-10T09:42:33.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:33 smithi135 ceph-mon[65362]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:33.482 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.481+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9ac061190 con 0x7fa99806e200 2024-09-10T09:42:33.484 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.483+0000 7fa9a27fc700 1 -- 172.21.15.79:0/1822279459 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa9ac061190 con 0x7fa99806e200 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa99806e200 msgr2=0x7fa9980706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa99806e200 0x7fa9980706b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800b760 tx=0x7fa9a8005a90 comp rx=0 tx=0).stop 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ffd60 msgr2=0x7fa9ac197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ffd60 0x7fa9ac197250 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa99c00e8f0 tx=0x7fa99c00ec00 comp rx=0 tx=0).stop 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 shutdown_connections 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa99806e200 0x7fa9980706b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa9ac0ff3c0 0x7fa9ac196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 --2- 172.21.15.79:0/1822279459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9ac0ffd60 0x7fa9ac197250 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 >> 172.21.15.79:0/1822279459 conn(0x7fa9ac0fac60 msgr2=0x7fa9ac0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:33.486 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 shutdown_connections 2024-09-10T09:42:33.487 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.485+0000 7fa9b360a700 1 -- 172.21.15.79:0/1822279459 wait complete. 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2632168782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff694104130 msgr2=0x7ff694104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2632168782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff694104130 0x7ff694104500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff690009910 tx=0x7ff690009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2632168782 shutdown_connections 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2632168782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6940ffbd0 0x7ff694100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2632168782 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff694104130 0x7ff694104500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2632168782 >> 172.21.15.79:0/2632168782 conn(0x7ff694075130 msgr2=0x7ff694075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2632168782 shutdown_connections 2024-09-10T09:42:33.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.609+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2632168782 wait complete. 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff69bdc3700 1 Processor -- start 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff69bdc3700 1 -- start start 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff69bdc3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940ffbd0 0x7ff694196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff69bdc3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694104130 0x7ff6941971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff69bdc3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff694197810 con 0x7ff6940ffbd0 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff69bdc3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff694197950 con 0x7ff694104130 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff699b5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940ffbd0 0x7ff694196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff699b5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940ffbd0 0x7ff694196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34590/0 (socket says 172.21.15.79:34590) 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.610+0000 7ff699b5f700 1 -- 172.21.15.79:0/2327029461 learned_addr learned my addr 172.21.15.79:0/2327029461 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:33.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff69935e700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694104130 0x7ff6941971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff699b5f700 1 -- 172.21.15.79:0/2327029461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694104130 msgr2=0x7ff6941971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff699b5f700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694104130 0x7ff6941971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff699b5f700 1 -- 172.21.15.79:0/2327029461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900095f0 con 0x7ff6940ffbd0 2024-09-10T09:42:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff69935e700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694104130 0x7ff6941971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:42:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff699b5f700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940ffbd0 0x7ff694196cb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff69000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff68affd700 1 -- 172.21.15.79:0/2327029461 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69001d070 con 0x7ff6940ffbd0 2024-09-10T09:42:33.613 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff68affd700 1 -- 172.21.15.79:0/2327029461 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff690004fb0 con 0x7ff6940ffbd0 2024-09-10T09:42:33.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69419fd20 con 0x7ff6940ffbd0 2024-09-10T09:42:33.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff68affd700 1 -- 172.21.15.79:0/2327029461 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69000f480 con 0x7ff6940ffbd0 2024-09-10T09:42:33.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.611+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6941a0130 con 0x7ff6940ffbd0 2024-09-10T09:42:33.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.612+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6941076a0 con 0x7ff6940ffbd0 2024-09-10T09:42:33.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.613+0000 7ff68affd700 1 -- 172.21.15.79:0/2327029461 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff690022890 con 0x7ff6940ffbd0 2024-09-10T09:42:33.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.613+0000 7ff68affd700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff68006e200 0x7ff6800706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.613+0000 7ff68affd700 1 -- 172.21.15.79:0/2327029461 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff69008f630 con 0x7ff6940ffbd0 2024-09-10T09:42:33.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.613+0000 7ff69935e700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff68006e200 0x7ff6800706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.614+0000 7ff69935e700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff68006e200 0x7ff6800706b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff684005fd0 tx=0x7ff684005de0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:33.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.618+0000 7ff68affd700 1 -- 172.21.15.79:0/2327029461 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff690058b90 con 0x7ff6940ffbd0 2024-09-10T09:42:33.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.834+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff694061190 con 0x7ff68006e200 2024-09-10T09:42:33.844 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.843+0000 7ff68affd700 1 -- 172.21.15.79:0/2327029461 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff694061190 con 0x7ff68006e200 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (3m) 34s ago 14m 26.9M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (14m) 34s ago 14m 8102k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (13m) 56s ago 13m 7998k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (64s) 34s ago 14m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (59s) 56s ago 13m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (3m) 34s ago 14m 75.6M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (9m) 34s ago 9m 16.7M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (8m) 34s ago 8m 97.7M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:42:33.845 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (8m) 56s ago 8m 152M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (8m) 56s ago 8m 20.1M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (5m) 34s ago 15m 493M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (4m) 56s ago 13m 439M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (2m) 34s ago 16m 45.3M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (104s) 56s ago 13m 39.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (4m) 34s ago 14m 15.2M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (4m) 56s ago 13m 15.7M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (39s) 34s ago 12m 11.3M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 starting - - - 1216M 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (11m) 34s ago 11m 225M 1216M 18.2.0 dc2bc1663786 61fb765ede82 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (11m) 56s ago 11m 291M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (10m) 56s ago 10m 256M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (10m) 56s ago 10m 255M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:42:33.846 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (4m) 34s ago 14m 76.7M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:42:33.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff68006e200 msgr2=0x7ff6800706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff68006e200 0x7ff6800706b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff684005fd0 tx=0x7ff684005de0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940ffbd0 msgr2=0x7ff694196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940ffbd0 0x7ff694196cb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff69000be20 comp rx=0 tx=0).stop 2024-09-10T09:42:33.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 shutdown_connections 2024-09-10T09:42:33.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ff68006e200 0x7ff6800706b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6940ffbd0 0x7ff694196cb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 --2- 172.21.15.79:0/2327029461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff694104130 0x7ff6941971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 >> 172.21.15.79:0/2327029461 conn(0x7ff694075130 msgr2=0x7ff6940fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:33.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 shutdown_connections 2024-09-10T09:42:33.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.846+0000 7ff69bdc3700 1 -- 172.21.15.79:0/2327029461 wait complete. 2024-09-10T09:42:33.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 -- 172.21.15.79:0/3628635534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ff3c0 msgr2=0x7f804c0ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 --2- 172.21.15.79:0/3628635534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ff3c0 0x7f804c0ff790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f803c00b0a0 tx=0x7f803c00b3b0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 -- 172.21.15.79:0/3628635534 shutdown_connections 2024-09-10T09:42:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 --2- 172.21.15.79:0/3628635534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f804c0ffd60 0x7f804c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 --2- 172.21.15.79:0/3628635534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ff3c0 0x7f804c0ff790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 -- 172.21.15.79:0/3628635534 >> 172.21.15.79:0/3628635534 conn(0x7f804c0fac80 msgr2=0x7f804c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 -- 172.21.15.79:0/3628635534 shutdown_connections 2024-09-10T09:42:33.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.955+0000 7f80521b4700 1 -- 172.21.15.79:0/3628635534 wait complete. 2024-09-10T09:42:33.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.956+0000 7f80521b4700 1 Processor -- start 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.956+0000 7f80521b4700 1 -- start start 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.956+0000 7f80521b4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f804c0ff3c0 0x7f804c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.956+0000 7f80521b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ffd60 0x7f804c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.956+0000 7f80521b4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c1978b0 con 0x7f804c0ffd60 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.956+0000 7f80521b4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c1979f0 con 0x7f804c0ff3c0 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ffd60 0x7f804c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ffd60 0x7f804c197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34618/0 (socket says 172.21.15.79:34618) 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804affd700 1 -- 172.21.15.79:0/3188493321 learned_addr learned my addr 172.21.15.79:0/3188493321 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804b7fe700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f804c0ff3c0 0x7f804c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804affd700 1 -- 172.21.15.79:0/3188493321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f804c0ff3c0 msgr2=0x7f804c196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804affd700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f804c0ff3c0 0x7f804c196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804affd700 1 -- 172.21.15.79:0/3188493321 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c009d00 con 0x7f804c0ffd60 2024-09-10T09:42:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f804affd700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ffd60 0x7f804c197290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f803400d900 tx=0x7f803400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f8048ff9700 1 -- 172.21.15.79:0/3188493321 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8034009900 con 0x7f804c0ffd60 2024-09-10T09:42:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f8048ff9700 1 -- 172.21.15.79:0/3188493321 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8034010460 con 0x7f804c0ffd60 2024-09-10T09:42:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c19fdc0 con 0x7f804c0ffd60 2024-09-10T09:42:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.957+0000 7f8048ff9700 1 -- 172.21.15.79:0/3188493321 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803400f5f0 con 0x7f804c0ffd60 2024-09-10T09:42:33.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.958+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c1a0280 con 0x7f804c0ffd60 2024-09-10T09:42:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.959+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c1076d0 con 0x7f804c0ffd60 2024-09-10T09:42:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.959+0000 7f8048ff9700 1 -- 172.21.15.79:0/3188493321 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8034009a60 con 0x7f804c0ffd60 2024-09-10T09:42:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.959+0000 7f8048ff9700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f803806e200 0x7f80380706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.959+0000 7f8048ff9700 1 -- 172.21.15.79:0/3188493321 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f803408dac0 con 0x7f804c0ffd60 2024-09-10T09:42:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.959+0000 7f804b7fe700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f803806e200 0x7f80380706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:33.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.960+0000 7f804b7fe700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f803806e200 0x7f80380706b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f803c000f80 tx=0x7f803c0061f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:33.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:33.964+0000 7f8048ff9700 1 -- 172.21.15.79:0/3188493321 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8034056fd0 con 0x7f804c0ffd60 2024-09-10T09:42:34.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.313+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f804c04f2a0 con 0x7f804c0ffd60 2024-09-10T09:42:34.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.313+0000 7f8048ff9700 1 -- 172.21.15.79:0/3188493321 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f8034017330 con 0x7f804c0ffd60 2024-09-10T09:42:34.314 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:42:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:42:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:42:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 8, 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 5 2024-09-10T09:42:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:42:34.316 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:42:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f803806e200 msgr2=0x7f80380706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f803806e200 0x7f80380706b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f803c000f80 tx=0x7f803c0061f0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ffd60 msgr2=0x7f804c197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ffd60 0x7f804c197290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f803400d900 tx=0x7f803400dc10 comp rx=0 tx=0).stop 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 shutdown_connections 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f803806e200 0x7f80380706b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f804c0ff3c0 0x7f804c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 --2- 172.21.15.79:0/3188493321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f804c0ffd60 0x7f804c197290 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.315+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 >> 172.21.15.79:0/3188493321 conn(0x7f804c0fac80 msgr2=0x7f804c0fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.316+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 shutdown_connections 2024-09-10T09:42:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.316+0000 7f80521b4700 1 -- 172.21.15.79:0/3188493321 wait complete. 2024-09-10T09:42:34.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.422+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/4083830784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ffc60 msgr2=0x7ffa4410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.422+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/4083830784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ffc60 0x7ffa4410a6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009910 tx=0x7ffa34009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:34.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/4083830784 shutdown_connections 2024-09-10T09:42:34.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/4083830784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ffc60 0x7ffa4410a6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/4083830784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440ff350 0x7ffa440ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/4083830784 >> 172.21.15.79:0/4083830784 conn(0x7ffa440748b0 msgr2=0x7ffa44074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:34.425 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:34 smithi079 ceph-mon[87213]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:34.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/4083830784 shutdown_connections 2024-09-10T09:42:34.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/4083830784 wait complete. 2024-09-10T09:42:34.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 Processor -- start 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.423+0000 7ffa4b4f0700 1 -- start start 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4b4f0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ff350 0x7ffa44100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4b4f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440ffc60 0x7ffa44100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4b4f0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa44100fb0 con 0x7ffa440ff350 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4b4f0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa441010f0 con 0x7ffa440ffc60 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4928c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ff350 0x7ffa44100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa48a8b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440ffc60 0x7ffa44100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4928c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ff350 0x7ffa44100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34622/0 (socket says 172.21.15.79:34622) 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa48a8b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440ffc60 0x7ffa44100a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:33808/0 (socket says 172.21.15.79:33808) 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4928c700 1 -- 172.21.15.79:0/621637619 learned_addr learned my addr 172.21.15.79:0/621637619 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4928c700 1 -- 172.21.15.79:0/621637619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440ffc60 msgr2=0x7ffa44100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4928c700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440ffc60 0x7ffa44100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.427 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4928c700 1 -- 172.21.15.79:0/621637619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340095f0 con 0x7ffa440ff350 2024-09-10T09:42:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.424+0000 7ffa4928c700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ff350 0x7ffa44100530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000d900 tx=0x7ffa4000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.425+0000 7ffa3a7fc700 1 -- 172.21.15.79:0/621637619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa400041f0 con 0x7ffa440ff350 2024-09-10T09:42:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.425+0000 7ffa3a7fc700 1 -- 172.21.15.79:0/621637619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa40004350 con 0x7ffa440ff350 2024-09-10T09:42:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.425+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa441a20a0 con 0x7ffa440ff350 2024-09-10T09:42:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.425+0000 7ffa3a7fc700 1 -- 172.21.15.79:0/621637619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa40003cf0 con 0x7ffa440ff350 2024-09-10T09:42:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.425+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa441a2450 con 0x7ffa440ff350 2024-09-10T09:42:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.426+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa44107dd0 con 0x7ffa440ff350 2024-09-10T09:42:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.426+0000 7ffa3a7fc700 1 -- 172.21.15.79:0/621637619 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffa40009730 con 0x7ffa440ff350 2024-09-10T09:42:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.427+0000 7ffa3a7fc700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ffa3006e200 0x7ffa300706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.427+0000 7ffa3a7fc700 1 -- 172.21.15.79:0/621637619 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ffa4008de70 con 0x7ffa440ff350 2024-09-10T09:42:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.427+0000 7ffa48a8b700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ffa3006e200 0x7ffa300706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:34.429 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.428+0000 7ffa48a8b700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ffa3006e200 0x7ffa300706b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400b5c0 tx=0x7ffa3401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:34.432 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.432+0000 7ffa3a7fc700 1 -- 172.21.15.79:0/621637619 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ffa40057300 con 0x7ffa440ff350 2024-09-10T09:42:34.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:34 smithi135 ceph-mon[65362]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:34.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.699+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffa44101b70 con 0x7ffa440ff350 2024-09-10T09:42:34.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.699+0000 7ffa3a7fc700 1 -- 172.21.15.79:0/621637619 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7ffa4005a9c0 con 0x7ffa440ff350 2024-09-10T09:42:34.700 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:42:34.700 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:42:34.700 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:42:34.701 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:42:34.702 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:42:34.703 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:34.704 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:42:34.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ffa3006e200 msgr2=0x7ffa300706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ffa3006e200 0x7ffa300706b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400b5c0 tx=0x7ffa3401a040 comp rx=0 tx=0).stop 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ff350 msgr2=0x7ffa44100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ff350 0x7ffa44100530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000d900 tx=0x7ffa4000dc10 comp rx=0 tx=0).stop 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 shutdown_connections 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7ffa3006e200 0x7ffa300706b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa440ff350 0x7ffa44100530 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 --2- 172.21.15.79:0/621637619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffa440ffc60 0x7ffa44100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.701+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 >> 172.21.15.79:0/621637619 conn(0x7ffa440748b0 msgr2=0x7ffa44104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.702+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 shutdown_connections 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.702+0000 7ffa4b4f0700 1 -- 172.21.15.79:0/621637619 wait complete. 2024-09-10T09:42:34.705 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 -- 172.21.15.79:0/1850159768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 msgr2=0x7fbc18103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 --2- 172.21.15.79:0/1850159768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc18103d20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c00b0a0 tx=0x7fbc0c00b3b0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 -- 172.21.15.79:0/1850159768 shutdown_connections 2024-09-10T09:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 --2- 172.21.15.79:0/1850159768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc18103d20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 --2- 172.21.15.79:0/1850159768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc180ff3b0 0x7fbc180ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 -- 172.21.15.79:0/1850159768 >> 172.21.15.79:0/1850159768 conn(0x7fbc180fac90 msgr2=0x7fbc180fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 -- 172.21.15.79:0/1850159768 shutdown_connections 2024-09-10T09:42:34.817 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.815+0000 7fbc1f349700 1 -- 172.21.15.79:0/1850159768 wait complete. 2024-09-10T09:42:34.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1f349700 1 Processor -- start 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1f349700 1 -- start start 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1f349700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc180ff3b0 0x7fbc18194b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1f349700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc181950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1f349700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181955e0 con 0x7fbc180ffd50 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1f349700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18195750 con 0x7fbc180ff3b0 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1c8e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc181950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1c8e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc181950a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34636/0 (socket says 172.21.15.79:34636) 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1c8e4700 1 -- 172.21.15.79:0/644823602 learned_addr learned my addr 172.21.15.79:0/644823602 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.816+0000 7fbc1d0e5700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc180ff3b0 0x7fbc18194b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc1c8e4700 1 -- 172.21.15.79:0/644823602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc180ff3b0 msgr2=0x7fbc18194b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc1c8e4700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc180ff3b0 0x7fbc18194b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc1c8e4700 1 -- 172.21.15.79:0/644823602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c009d00 con 0x7fbc180ffd50 2024-09-10T09:42:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc1c8e4700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc181950a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006130 tx=0x7fbc0c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc167fc700 1 -- 172.21.15.79:0/644823602 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc0c00e040 con 0x7fbc180ffd50 2024-09-10T09:42:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc167fc700 1 -- 172.21.15.79:0/644823602 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc0c003de0 con 0x7fbc180ffd50 2024-09-10T09:42:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc181959d0 con 0x7fbc180ffd50 2024-09-10T09:42:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc167fc700 1 -- 172.21.15.79:0/644823602 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc0c01d740 con 0x7fbc180ffd50 2024-09-10T09:42:34.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.817+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc181a2450 con 0x7fbc180ffd50 2024-09-10T09:42:34.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.818+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc18107720 con 0x7fbc180ffd50 2024-09-10T09:42:34.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.819+0000 7fbc167fc700 1 -- 172.21.15.79:0/644823602 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbc0c004040 con 0x7fbc180ffd50 2024-09-10T09:42:34.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.819+0000 7fbc167fc700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbc0006e200 0x7fbc000706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:34.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.819+0000 7fbc167fc700 1 -- 172.21.15.79:0/644823602 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbc0c08f610 con 0x7fbc180ffd50 2024-09-10T09:42:34.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.819+0000 7fbc1d0e5700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbc0006e200 0x7fbc000706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:34.821 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.820+0000 7fbc1d0e5700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbc0006e200 0x7fbc000706b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc10005950 tx=0x7fbc100058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:34.824 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:34.824+0000 7fbc167fc700 1 -- 172.21.15.79:0/644823602 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbc0c05c650 con 0x7fbc180ffd50 2024-09-10T09:42:35.056 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.055+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc180694d0 con 0x7fbc0006e200 2024-09-10T09:42:35.057 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.056+0000 7fbc167fc700 1 -- 172.21.15.79:0/644823602 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbc180694d0 con 0x7fbc0006e200 2024-09-10T09:42:35.057 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:42:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:42:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:42:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:42:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "7/23 daemons upgraded", 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:42:35.058 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:42:35.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbc0006e200 msgr2=0x7fbc000706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:35.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbc0006e200 0x7fbc000706b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc10005950 tx=0x7fbc100058e0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.059 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 msgr2=0x7fbc181950a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc181950a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c006130 tx=0x7fbc0c00cdb0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 shutdown_connections 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbc0006e200 0x7fbc000706b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc180ff3b0 0x7fbc18194b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 --2- 172.21.15.79:0/644823602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc180ffd50 0x7fbc181950a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 >> 172.21.15.79:0/644823602 conn(0x7fbc180fac90 msgr2=0x7fbc180fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.058+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 shutdown_connections 2024-09-10T09:42:35.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.059+0000 7fbc1f349700 1 -- 172.21.15.79:0/644823602 wait complete. 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 -- 172.21.15.79:0/2845364810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14106320 msgr2=0x7fdf141066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 --2- 172.21.15.79:0/2845364810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14106320 0x7fdf141066f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009910 tx=0x7fdf10009c20 comp rx=0 tx=0).stop 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 -- 172.21.15.79:0/2845364810 shutdown_connections 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 --2- 172.21.15.79:0/2845364810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf14068540 0x7fdf140689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 --2- 172.21.15.79:0/2845364810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14106320 0x7fdf141066f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 -- 172.21.15.79:0/2845364810 >> 172.21.15.79:0/2845364810 conn(0x7fdf14075130 msgr2=0x7fdf14075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 -- 172.21.15.79:0/2845364810 shutdown_connections 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.171+0000 7fdf1c286700 1 -- 172.21.15.79:0/2845364810 wait complete. 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1c286700 1 Processor -- start 2024-09-10T09:42:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1c286700 1 -- start start 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1c286700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14068540 0x7fdf14195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1c286700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf14106320 0x7fdf141963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1c286700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14196a00 con 0x7fdf14068540 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1c286700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14196b40 con 0x7fdf14106320 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1a022700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14068540 0x7fdf14195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1a022700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14068540 0x7fdf14195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34654/0 (socket says 172.21.15.79:34654) 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.172+0000 7fdf1a022700 1 -- 172.21.15.79:0/1526433443 learned_addr learned my addr 172.21.15.79:0/1526433443 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf19821700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf14106320 0x7fdf141963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf1a022700 1 -- 172.21.15.79:0/1526433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf14106320 msgr2=0x7fdf141963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf1a022700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf14106320 0x7fdf141963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf1a022700 1 -- 172.21.15.79:0/1526433443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100095f0 con 0x7fdf14068540 2024-09-10T09:42:35.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf1a022700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14068540 0x7fdf14195e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdf10006010 tx=0x7fdf1000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:35.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf0b7fe700 1 -- 172.21.15.79:0/1526433443 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf1001d070 con 0x7fdf14068540 2024-09-10T09:42:35.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf0b7fe700 1 -- 172.21.15.79:0/1526433443 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf1000f460 con 0x7fdf14068540 2024-09-10T09:42:35.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1419a930 con 0x7fdf14068540 2024-09-10T09:42:35.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf0b7fe700 1 -- 172.21.15.79:0/1526433443 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf10017630 con 0x7fdf14068540 2024-09-10T09:42:35.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.173+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1419ae20 con 0x7fdf14068540 2024-09-10T09:42:35.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.174+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf14108790 con 0x7fdf14068540 2024-09-10T09:42:35.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.175+0000 7fdf0b7fe700 1 -- 172.21.15.79:0/1526433443 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdf1000f5d0 con 0x7fdf14068540 2024-09-10T09:42:35.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.175+0000 7fdf0b7fe700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdf0006e200 0x7fdf000706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:42:35.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.175+0000 7fdf0b7fe700 1 -- 172.21.15.79:0/1526433443 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdf1008f420 con 0x7fdf14068540 2024-09-10T09:42:35.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.175+0000 7fdf19821700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdf0006e200 0x7fdf000706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:42:35.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.176+0000 7fdf19821700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdf0006e200 0x7fdf000706b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf14197490 tx=0x7fdf0400a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:42:35.181 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.180+0000 7fdf0b7fe700 1 -- 172.21.15.79:0/1526433443 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdf10058930 con 0x7fdf14068540 2024-09-10T09:42:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:35 smithi079 ceph-mon[87213]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:35 smithi079 ceph-mon[87213]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:35 smithi079 ceph-mon[87213]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 933 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:35.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:35.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:35 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3188493321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:35.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:35 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/621637619' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:42:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:35 smithi135 ceph-mon[65362]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:35 smithi135 ceph-mon[65362]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:35 smithi135 ceph-mon[65362]: pgmap v70: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 933 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:35 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3188493321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:35.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:35 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/621637619' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:42:35.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.500+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdf14108170 con 0x7fdf14068540 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.501+0000 7fdf0b7fe700 1 -- 172.21.15.79:0/1526433443 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1182 (secure 0 0 0) 0x7fdf1005bff0 con 0x7fdf14068540 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout: osd.1 (root=default,host=smithi079) is down 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/222 objects degraded (13.964%), 13 pgs degraded 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-10T09:42:35.502 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-10T09:42:35.503 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-10T09:42:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdf0006e200 msgr2=0x7fdf000706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdf0006e200 0x7fdf000706b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdf14197490 tx=0x7fdf0400a380 comp rx=0 tx=0).stop 2024-09-10T09:42:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14068540 msgr2=0x7fdf14195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14068540 0x7fdf14195e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdf10006010 tx=0x7fdf1000bd70 comp rx=0 tx=0).stop 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 shutdown_connections 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdf0006e200 0x7fdf000706b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf14068540 0x7fdf14195e70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 --2- 172.21.15.79:0/1526433443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf14106320 0x7fdf141963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 >> 172.21.15.79:0/1526433443 conn(0x7fdf14075130 msgr2=0x7fdf140feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 shutdown_connections 2024-09-10T09:42:35.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:42:35.503+0000 7fdf1c286700 1 -- 172.21.15.79:0/1526433443 wait complete. 2024-09-10T09:42:36.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:36 smithi079 ceph-mon[87213]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:36.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:36 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:36.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:36 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:36.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:36 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1526433443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:42:36.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:36 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:36.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:36 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:36.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:36 smithi135 ceph-mon[65362]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:42:36.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:36 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:36.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:36 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:36 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1526433443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:42:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:36 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:36.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:36 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:37.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:37 smithi079 ceph-mon[87213]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 847 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:37.462 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:37 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[104285]: 2024-09-10T09:42:37.266+0000 7fb2fa77c640 -1 osd.1 0 read_superblock omap replica is missing. 2024-09-10T09:42:37.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:37 smithi135 ceph-mon[65362]: pgmap v71: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 847 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:38.028 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:37 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[104285]: 2024-09-10T09:42:37.801+0000 7fb2fa77c640 -1 osd.1 55 log_to_monitors true 2024-09-10T09:42:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:38 smithi079 ceph-mon[87213]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T09:42:38.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:38 smithi135 ceph-mon[65362]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T09:42:39.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:39 smithi079 ceph-mon[87213]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:39.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:39 smithi079 ceph-mon[87213]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T09:42:39.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:39 smithi079 ceph-mon[87213]: osdmap e58: 6 total, 5 up, 6 in 2024-09-10T09:42:39.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:39 smithi079 ceph-mon[87213]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:42:39.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:39 smithi079 ceph-mon[87213]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' 2024-09-10T09:42:39.377 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:42:39 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[104285]: 2024-09-10T09:42:39.008+0000 7fb2ee50e640 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:42:39.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:39 smithi135 ceph-mon[65362]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 31/222 objects degraded (13.964%) 2024-09-10T09:42:39.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:39 smithi135 ceph-mon[65362]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T09:42:39.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:39 smithi135 ceph-mon[65362]: osdmap e58: 6 total, 5 up, 6 in 2024-09-10T09:42:39.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:39 smithi135 ceph-mon[65362]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:42:39.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:39 smithi135 ceph-mon[65362]: from='osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754]' entity='osd.1' 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:40.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754] boot 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: osdmap e59: 6 total, 6 up, 6 in 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:42:40.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:40 smithi135 ceph-mon[65362]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 16/222 objects degraded (7.207%) 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-10T09:42:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:42:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: osd.1 [v2:172.21.15.79:6810/4287269754,v1:172.21.15.79:6811/4287269754] boot 2024-09-10T09:42:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: osdmap e59: 6 total, 6 up, 6 in 2024-09-10T09:42:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T09:42:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:40 smithi079 ceph-mon[87213]: pgmap v75: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 16/222 objects degraded (7.207%) 2024-09-10T09:42:42.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:41 smithi079 ceph-mon[87213]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T09:42:42.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:41 smithi079 ceph-mon[87213]: osdmap e60: 6 total, 6 up, 6 in 2024-09-10T09:42:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:41 smithi135 ceph-mon[65362]: Health check update: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded (PG_DEGRADED) 2024-09-10T09:42:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:41 smithi135 ceph-mon[65362]: osdmap e60: 6 total, 6 up, 6 in 2024-09-10T09:42:43.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:42 smithi079 ceph-mon[87213]: pgmap v77: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 16/222 objects degraded (7.207%) 2024-09-10T09:42:43.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:42 smithi135 ceph-mon[65362]: pgmap v77: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 16/222 objects degraded (7.207%) 2024-09-10T09:42:44.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:44 smithi079 ceph-mon[87213]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-10T09:42:44.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:44 smithi135 ceph-mon[65362]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/222 objects degraded (7.207%), 7 pgs degraded) 2024-09-10T09:42:45.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:45 smithi079 ceph-mon[87213]: pgmap v78: 65 pgs: 20 peering, 45 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:45.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:45 smithi135 ceph-mon[65362]: pgmap v78: 65 pgs: 20 peering, 45 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:47.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:47 smithi135 ceph-mon[65362]: pgmap v79: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T09:42:47.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:47 smithi079 ceph-mon[87213]: pgmap v79: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-10T09:42:49.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:49 smithi135 ceph-mon[65362]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:42:49.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:49.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:49 smithi079 ceph-mon[87213]: pgmap v80: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:42:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:42:51.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:51 smithi079 ceph-mon[87213]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-10T09:42:51.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:51 smithi135 ceph-mon[65362]: pgmap v81: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-10T09:42:53.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:53 smithi079 ceph-mon[87213]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 923 B/s rd, 1 op/s 2024-09-10T09:42:53.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:53 smithi135 ceph-mon[65362]: pgmap v82: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 923 B/s rd, 1 op/s 2024-09-10T09:42:55.392 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:55 smithi079 ceph-mon[87213]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:55.392 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:55.392 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:55.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:55 smithi135 ceph-mon[65362]: pgmap v83: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:55.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:56.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:56 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:56.449 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:56 smithi135 ceph-mon[65362]: Upgrade: osd.2 is safe to restart 2024-09-10T09:42:56.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:56 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-10T09:42:56.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:56 smithi079 ceph-mon[87213]: Upgrade: osd.2 is safe to restart 2024-09-10T09:42:57.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:57 smithi079 ceph-mon[87213]: pgmap v84: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:42:57.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:57 smithi079 ceph-mon[87213]: Upgrade: Updating osd.2 2024-09-10T09:42:57.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:57.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:42:57.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:57.538 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:57 smithi079 ceph-mon[87213]: Deploying daemon osd.2 on smithi079 2024-09-10T09:42:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:57 smithi135 ceph-mon[65362]: pgmap v84: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:42:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:57 smithi135 ceph-mon[65362]: Upgrade: Updating osd.2 2024-09-10T09:42:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:42:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T09:42:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:42:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:57 smithi135 ceph-mon[65362]: Deploying daemon osd.2 on smithi079 2024-09-10T09:42:59.492 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:42:59 smithi079 systemd[1]: Stopping Ceph osd.2 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:42:59.492 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:42:59 smithi079 ceph-mon[87213]: pgmap v85: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:42:59 smithi135 ceph-mon[65362]: pgmap v85: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:42:59.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:42:59 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[53574]: 2024-09-10T09:42:59.489+0000 7f5830c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:42:59.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:42:59 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[53574]: 2024-09-10T09:42:59.489+0000 7f5830c00700 -1 osd.2 60 *** Got signal Terminated *** 2024-09-10T09:42:59.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:42:59 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[53574]: 2024-09-10T09:42:59.489+0000 7f5830c00700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:43:00.492 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:00 smithi079 ceph-mon[87213]: osd.2 marked itself down and dead 2024-09-10T09:43:00.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:00 smithi135 ceph-mon[65362]: osd.2 marked itself down and dead 2024-09-10T09:43:00.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:00 smithi079 podman[109668]: 2024-09-10 09:43:00.694842669 +0000 UTC m=+1.308874432 container died 61fb765ede8212f85f1fd0b1683e1d4293548f7eadab3dbbfc02a5c205168b68 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=-18.2.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-10T09:43:01.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:01 smithi079 ceph-mon[87213]: pgmap v86: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:01.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:01 smithi079 ceph-mon[87213]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:43:01.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:01 smithi079 ceph-mon[87213]: osdmap e61: 6 total, 5 up, 6 in 2024-09-10T09:43:01.377 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:01 smithi079 podman[109668]: 2024-09-10 09:43:01.091028931 +0000 UTC m=+1.705060676 container cleanup 61fb765ede8212f85f1fd0b1683e1d4293548f7eadab3dbbfc02a5c205168b68 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, ceph=True, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0) 2024-09-10T09:43:01.377 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:01 smithi079 bash[109668]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2 2024-09-10T09:43:01.711 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:01 smithi079 podman[109688]: 2024-09-10 09:43:01.376092465 +0000 UTC m=+0.683694264 container remove 61fb765ede8212f85f1fd0b1683e1d4293548f7eadab3dbbfc02a5c205168b68 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.build-date=20231212, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-09-10T09:43:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:01 smithi135 ceph-mon[65362]: pgmap v86: 65 pgs: 65 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:01 smithi135 ceph-mon[65362]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:43:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:01 smithi135 ceph-mon[65362]: osdmap e61: 6 total, 5 up, 6 in 2024-09-10T09:43:02.021 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:01 smithi079 podman[109786]: 2024-09-10 09:43:01.631134748 +0000 UTC m=+0.015768757 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:43:02.022 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:01 smithi079 podman[109786]: 2024-09-10 09:43:01.769608777 +0000 UTC m=+0.154242774 container create bc193c896273a219005701eae1cd7aa09a722a9b00428e1d037d90fb0328f780 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T09:43:02.022 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 podman[109786]: 2024-09-10 09:43:02.021373282 +0000 UTC m=+0.406007281 container init bc193c896273a219005701eae1cd7aa09a722a9b00428e1d037d90fb0328f780 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T09:43:02.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:02 smithi079 ceph-mon[87213]: osdmap e62: 6 total, 5 up, 6 in 2024-09-10T09:43:02.462 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 podman[109786]: 2024-09-10 09:43:02.024984391 +0000 UTC m=+0.409618393 container start bc193c896273a219005701eae1cd7aa09a722a9b00428e1d037d90fb0328f780 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T09:43:02.462 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 podman[109786]: 2024-09-10 09:43:02.121125969 +0000 UTC m=+0.505759973 container attach bc193c896273a219005701eae1cd7aa09a722a9b00428e1d037d90fb0328f780 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True) 2024-09-10T09:43:02.462 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 podman[109786]: 2024-09-10 09:43:02.212098089 +0000 UTC m=+0.596732091 container died bc193c896273a219005701eae1cd7aa09a722a9b00428e1d037d90fb0328f780 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:43:02.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:02 smithi135 ceph-mon[65362]: osdmap e62: 6 total, 5 up, 6 in 2024-09-10T09:43:03.211 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 podman[109809]: 2024-09-10 09:43:02.758432657 +0000 UTC m=+0.540105302 container remove bc193c896273a219005701eae1cd7aa09a722a9b00428e1d037d90fb0328f780 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T09:43:03.212 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-10T09:43:03.212 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 systemd[1]: Stopped Ceph osd.2 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:43:03.212 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:02 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.2.service: Consumed 57.031s CPU time. 2024-09-10T09:43:03.212 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 systemd[1]: Starting Ceph osd.2 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:43:03.465 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:03 smithi079 ceph-mon[87213]: pgmap v89: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:03.466 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 podman[109909]: 2024-09-10 09:43:03.114991576 +0000 UTC m=+0.015733823 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:43:03.466 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 podman[109909]: 2024-09-10 09:43:03.217895573 +0000 UTC m=+0.118637859 container create 09fdf0e414beb96ea3ba5599b452a3fddbca2e2045fe453c55ff2fd467809884 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T09:43:03.466 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 podman[109909]: 2024-09-10 09:43:03.462169559 +0000 UTC m=+0.362911800 container init 09fdf0e414beb96ea3ba5599b452a3fddbca2e2045fe453c55ff2fd467809884 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T09:43:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:03 smithi135 ceph-mon[65362]: pgmap v89: 65 pgs: 9 stale+active+clean, 56 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:03.729 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 podman[109909]: 2024-09-10 09:43:03.465407112 +0000 UTC m=+0.366149359 container start 09fdf0e414beb96ea3ba5599b452a3fddbca2e2045fe453c55ff2fd467809884 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T09:43:03.729 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 podman[109909]: 2024-09-10 09:43:03.578733421 +0000 UTC m=+0.479475673 container attach 09fdf0e414beb96ea3ba5599b452a3fddbca2e2045fe453c55ff2fd467809884 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:43:03.730 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:03.730 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 bash[109909]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:03.730 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:03.730 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:03 smithi079 bash[109909]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:04.613 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T09:43:04.613 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 bash[109909]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T09:43:04.613 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T09:43:04.614 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 bash[109909]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T09:43:04.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 bash[109909]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 bash[109909]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 bash[109909]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 bash[109909]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate[109924]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 bash[109909]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-10T09:43:04.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:04 smithi079 podman[109909]: 2024-09-10 09:43:04.64156388 +0000 UTC m=+1.542306130 container died 09fdf0e414beb96ea3ba5599b452a3fddbca2e2045fe453c55ff2fd467809884 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T09:43:05.333 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:05 smithi079 ceph-mon[87213]: pgmap v90: 65 pgs: 9 active+undersized, 2 stale+active+clean, 6 active+undersized+degraded, 48 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/222 objects degraded (9.910%) 2024-09-10T09:43:05.333 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:05.333 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:05.333 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:05 smithi079 ceph-mon[87213]: Health check failed: Degraded data redundancy: 22/222 objects degraded (9.910%), 6 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:05 smithi135 ceph-mon[65362]: pgmap v90: 65 pgs: 9 active+undersized, 2 stale+active+clean, 6 active+undersized+degraded, 48 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/222 objects degraded (9.910%) 2024-09-10T09:43:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:05 smithi135 ceph-mon[65362]: Health check failed: Degraded data redundancy: 22/222 objects degraded (9.910%), 6 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:05.616 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:05 smithi079 podman[110058]: 2024-09-10 09:43:05.332992276 +0000 UTC m=+0.685519091 container remove 09fdf0e414beb96ea3ba5599b452a3fddbca2e2045fe453c55ff2fd467809884 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T09:43:05.616 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:05 smithi079 podman[110116]: 2024-09-10 09:43:05.446646634 +0000 UTC m=+0.015896487 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:43:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 -- 172.21.15.79:0/671269695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 msgr2=0x7fa468103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 --2- 172.21.15.79:0/671269695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468103c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b0a0 tx=0x7fa46400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 -- 172.21.15.79:0/671269695 shutdown_connections 2024-09-10T09:43:05.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 --2- 172.21.15.79:0/671269695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4680ff350 0x7fa4680ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 --2- 172.21.15.79:0/671269695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468103c80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 -- 172.21.15.79:0/671269695 >> 172.21.15.79:0/671269695 conn(0x7fa4680748b0 msgr2=0x7fa468074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 -- 172.21.15.79:0/671269695 shutdown_connections 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.614+0000 7fa46feb4700 1 -- 172.21.15.79:0/671269695 wait complete. 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46feb4700 1 Processor -- start 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46feb4700 1 -- start start 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46feb4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4680ff350 0x7fa468195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46feb4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46feb4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa468196a70 con 0x7fa4681038b0 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46feb4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46819a800 con 0x7fa4680ff350 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46d44f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:05.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46d44f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55864/0 (socket says 172.21.15.79:55864) 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46d44f700 1 -- 172.21.15.79:0/3466432597 learned_addr learned my addr 172.21.15.79:0/3466432597 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46dc50700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4680ff350 0x7fa468195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46d44f700 1 -- 172.21.15.79:0/3466432597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4680ff350 msgr2=0x7fa468195e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46d44f700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4680ff350 0x7fa468195e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46d44f700 1 -- 172.21.15.79:0/3466432597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464009d00 con 0x7fa4681038b0 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.615+0000 7fa46dc50700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4680ff350 0x7fa468195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.616+0000 7fa46d44f700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468196390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa45800dd40 tx=0x7fa45800a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.616+0000 7fa45effd700 1 -- 172.21.15.79:0/3466432597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45800ad10 con 0x7fa4681038b0 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.616+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46819aae0 con 0x7fa4681038b0 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.616+0000 7fa45effd700 1 -- 172.21.15.79:0/3466432597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa45800ae70 con 0x7fa4681038b0 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.616+0000 7fa45effd700 1 -- 172.21.15.79:0/3466432597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa458016960 con 0x7fa4681038b0 2024-09-10T09:43:05.619 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.616+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46819b030 con 0x7fa4681038b0 2024-09-10T09:43:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.617+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa468106e20 con 0x7fa4681038b0 2024-09-10T09:43:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.617+0000 7fa45effd700 1 -- 172.21.15.79:0/3466432597 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa45800e450 con 0x7fa4681038b0 2024-09-10T09:43:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.618+0000 7fa45effd700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa45406e200 0x7fa4540706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:05.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.618+0000 7fa45effd700 1 -- 172.21.15.79:0/3466432597 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa45808e150 con 0x7fa4681038b0 2024-09-10T09:43:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.618+0000 7fa46dc50700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa45406e200 0x7fa4540706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:05.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.618+0000 7fa46dc50700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa45406e200 0x7fa4540706b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa464009480 tx=0x7fa464006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:05.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.622+0000 7fa45effd700 1 -- 172.21.15.79:0/3466432597 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa458057710 con 0x7fa4681038b0 2024-09-10T09:43:05.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.851+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa46819b370 con 0x7fa45406e200 2024-09-10T09:43:05.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.853+0000 7fa45effd700 1 -- 172.21.15.79:0/3466432597 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa46819b370 con 0x7fa45406e200 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa45406e200 msgr2=0x7fa4540706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa45406e200 0x7fa4540706b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa464009480 tx=0x7fa464006000 comp rx=0 tx=0).stop 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 msgr2=0x7fa468196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468196390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa45800dd40 tx=0x7fa45800a530 comp rx=0 tx=0).stop 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 shutdown_connections 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa45406e200 0x7fa4540706b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4680ff350 0x7fa468195e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 --2- 172.21.15.79:0/3466432597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa4681038b0 0x7fa468196390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 >> 172.21.15.79:0/3466432597 conn(0x7fa4680748b0 msgr2=0x7fa4680fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:05.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 shutdown_connections 2024-09-10T09:43:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.855+0000 7fa46feb4700 1 -- 172.21.15.79:0/3466432597 wait complete. 2024-09-10T09:43:05.866 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:43:05.866 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:05 smithi079 podman[110116]: 2024-09-10 09:43:05.667274158 +0000 UTC m=+0.236523998 container create 5d91d18346d9fc99d9c8029f0ea4665e547b5981750896f5759a7406dcc57c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:43:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 -- 172.21.15.79:0/3212911037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 msgr2=0x7f47d8104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3212911037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8104eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009910 tx=0x7f47d4009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 -- 172.21.15.79:0/3212911037 shutdown_connections 2024-09-10T09:43:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3212911037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8104eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3212911037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80687a0 0x7f47d8068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 -- 172.21.15.79:0/3212911037 >> 172.21.15.79:0/3212911037 conn(0x7f47d8075130 msgr2=0x7f47d8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:05.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 -- 172.21.15.79:0/3212911037 shutdown_connections 2024-09-10T09:43:05.964 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.962+0000 7f47e07e0700 1 -- 172.21.15.79:0/3212911037 wait complete. 2024-09-10T09:43:05.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47e07e0700 1 Processor -- start 2024-09-10T09:43:05.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47e07e0700 1 -- start start 2024-09-10T09:43:05.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47e07e0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80687a0 0x7f47d8198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:05.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47e07e0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47e07e0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8198d60 con 0x7f47d8069140 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47e07e0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d819caf0 con 0x7f47d80687a0 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47ddd7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47ddd7b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55882/0 (socket says 172.21.15.79:55882) 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47ddd7b700 1 -- 172.21.15.79:0/3833586195 learned_addr learned my addr 172.21.15.79:0/3833586195 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.963+0000 7f47de57c700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80687a0 0x7f47d8198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47ddd7b700 1 -- 172.21.15.79:0/3833586195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80687a0 msgr2=0x7f47d8198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47ddd7b700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80687a0 0x7f47d8198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47ddd7b700 1 -- 172.21.15.79:0/3833586195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40095f0 con 0x7f47d8069140 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47ddd7b700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8198680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f47d4005f50 tx=0x7f47d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47cf7fe700 1 -- 172.21.15.79:0/3833586195 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d401d070 con 0x7f47d8069140 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47cf7fe700 1 -- 172.21.15.79:0/3833586195 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47d400f460 con 0x7f47d8069140 2024-09-10T09:43:05.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47cf7fe700 1 -- 172.21.15.79:0/3833586195 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47d4017630 con 0x7f47d8069140 2024-09-10T09:43:05.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d819cd70 con 0x7f47d8069140 2024-09-10T09:43:05.969 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.964+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d819d260 con 0x7f47d8069140 2024-09-10T09:43:05.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.965+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d804f2a0 con 0x7f47d8069140 2024-09-10T09:43:05.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.966+0000 7f47cf7fe700 1 -- 172.21.15.79:0/3833586195 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f47d400f5d0 con 0x7f47d8069140 2024-09-10T09:43:05.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.966+0000 7f47cf7fe700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f47c406e200 0x7f47c40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:05.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.967+0000 7f47de57c700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f47c406e200 0x7f47c40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:05.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.967+0000 7f47cf7fe700 1 -- 172.21.15.79:0/3833586195 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f47d408f480 con 0x7f47d8069140 2024-09-10T09:43:05.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.967+0000 7f47de57c700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f47c406e200 0x7f47c40706b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009a10 tx=0x7f47c8009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:05.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:05.971+0000 7f47cf7fe700 1 -- 172.21.15.79:0/3833586195 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47d4058990 con 0x7f47d8069140 2024-09-10T09:43:06.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.205+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47d819d680 con 0x7f47c406e200 2024-09-10T09:43:06.207 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:05 smithi079 podman[110116]: 2024-09-10 09:43:05.944780113 +0000 UTC m=+0.514029954 container init 5d91d18346d9fc99d9c8029f0ea4665e547b5981750896f5759a7406dcc57c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T09:43:06.207 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:05 smithi079 podman[110116]: 2024-09-10 09:43:05.948077494 +0000 UTC m=+0.517327329 container start 5d91d18346d9fc99d9c8029f0ea4665e547b5981750896f5759a7406dcc57c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T09:43:06.208 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:05 smithi079 ceph-osd[110163]: -- 172.21.15.79:0/1828158510 <== mon.0 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e6bd9741e0 con 0x55e6bcb21c00 2024-09-10T09:43:06.208 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:06 smithi079 bash[110116]: 5d91d18346d9fc99d9c8029f0ea4665e547b5981750896f5759a7406dcc57c48 2024-09-10T09:43:06.208 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:06 smithi079 systemd[1]: Started Ceph osd.2 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:43:06.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.207+0000 7f47cf7fe700 1 -- 172.21.15.79:0/3833586195 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f47d819d680 con 0x7f47c406e200 2024-09-10T09:43:06.210 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f47c406e200 msgr2=0x7f47c40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f47c406e200 0x7f47c40706b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009a10 tx=0x7f47c8009190 comp rx=0 tx=0).stop 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 msgr2=0x7f47d8198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8198680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f47d4005f50 tx=0x7f47d400bd70 comp rx=0 tx=0).stop 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 shutdown_connections 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f47c406e200 0x7f47c40706b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47d80687a0 0x7f47d8198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 --2- 172.21.15.79:0/3833586195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d8069140 0x7f47d8198680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.209+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 >> 172.21.15.79:0/3833586195 conn(0x7f47d8075130 msgr2=0x7f47d8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.210+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 shutdown_connections 2024-09-10T09:43:06.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.210+0000 7f47e07e0700 1 -- 172.21.15.79:0/3833586195 wait complete. 2024-09-10T09:43:06.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 -- 172.21.15.79:0/1346190924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ff350 msgr2=0x7fbf1c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/1346190924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ff350 0x7fbf1c0ff720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009910 tx=0x7fbf18009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:06.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 -- 172.21.15.79:0/1346190924 shutdown_connections 2024-09-10T09:43:06.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/1346190924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0ffc60 0x7fbf1c10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/1346190924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ff350 0x7fbf1c0ff720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 -- 172.21.15.79:0/1346190924 >> 172.21.15.79:0/1346190924 conn(0x7fbf1c0748b0 msgr2=0x7fbf1c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 -- 172.21.15.79:0/1346190924 shutdown_connections 2024-09-10T09:43:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 -- 172.21.15.79:0/1346190924 wait complete. 2024-09-10T09:43:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 Processor -- start 2024-09-10T09:43:06.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.319+0000 7fbf23bf2700 1 -- start start 2024-09-10T09:43:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf23bf2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0ff350 0x7fbf1c195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf23bf2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ffc60 0x7fbf1c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf23bf2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c196ac0 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf23bf2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c19a850 con 0x7fbf1c0ff350 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2118d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ffc60 0x7fbf1c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2198e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0ff350 0x7fbf1c195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2118d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ffc60 0x7fbf1c1963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55916/0 (socket says 172.21.15.79:55916) 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2118d700 1 -- 172.21.15.79:0/2811048079 learned_addr learned my addr 172.21.15.79:0/2811048079 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2118d700 1 -- 172.21.15.79:0/2811048079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0ff350 msgr2=0x7fbf1c195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2118d700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0ff350 0x7fbf1c195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2118d700 1 -- 172.21.15.79:0/2811048079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180095f0 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2198e700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0ff350 0x7fbf1c195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf2118d700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ffc60 0x7fbf1c1963e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e920 tx=0x7fbf0c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.320+0000 7fbf12ffd700 1 -- 172.21.15.79:0/2811048079 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf0c00c9d0 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.321+0000 7fbf12ffd700 1 -- 172.21.15.79:0/2811048079 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf0c010430 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.321+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c19ab30 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.321+0000 7fbf12ffd700 1 -- 172.21.15.79:0/2811048079 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf0c018630 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.321+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c19b080 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.321+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c107dd0 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.322+0000 7fbf12ffd700 1 -- 172.21.15.79:0/2811048079 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbf0c0105a0 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.323+0000 7fbf12ffd700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbf0806e200 0x7fbf080706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:06.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.323+0000 7fbf2198e700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbf0806e200 0x7fbf080706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.323+0000 7fbf12ffd700 1 -- 172.21.15.79:0/2811048079 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbf0c014070 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.325 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.323+0000 7fbf2198e700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbf0806e200 0x7fbf080706b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf180059d0 tx=0x7fbf18005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:06.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.327+0000 7fbf12ffd700 1 -- 172.21.15.79:0/2811048079 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbf0c0541b0 con 0x7fbf1c0ffc60 2024-09-10T09:43:06.577 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.576+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf1c19b310 con 0x7fbf0806e200 2024-09-10T09:43:06.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.585+0000 7fbf12ffd700 1 -- 172.21.15.79:0/2811048079 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fbf1c19b310 con 0x7fbf0806e200 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (4m) 31s ago 14m 26.9M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (15m) 31s ago 15m 8372k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (14m) 88s ago 14m 7998k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (97s) 31s ago 15m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (92s) 88s ago 14m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (3m) 31s ago 14m 74.8M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (9m) 31s ago 9m 16.9M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (9m) 31s ago 9m 97.4M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (9m) 88s ago 9m 152M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:43:06.588 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (9m) 88s ago 9m 20.1M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (6m) 31s ago 16m 497M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (5m) 88s ago 14m 439M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (2m) 31s ago 16m 47.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (2m) 88s ago 13m 39.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (4m) 31s ago 15m 15.3M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (4m) 88s ago 14m 15.7M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (72s) 31s ago 13m 100M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (36s) 31s ago 12m 11.4M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 starting - - - 1216M 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (11m) 88s ago 11m 291M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (11m) 88s ago 11m 256M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (11m) 88s ago 11m 255M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:43:06.589 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (4m) 31s ago 14m 76.9M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:43:06.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbf0806e200 msgr2=0x7fbf080706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbf0806e200 0x7fbf080706b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf180059d0 tx=0x7fbf18005940 comp rx=0 tx=0).stop 2024-09-10T09:43:06.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ffc60 msgr2=0x7fbf1c1963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.590 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ffc60 0x7fbf1c1963e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00e920 tx=0x7fbf0c00ec30 comp rx=0 tx=0).stop 2024-09-10T09:43:06.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 shutdown_connections 2024-09-10T09:43:06.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbf0806e200 0x7fbf080706b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf1c0ff350 0x7fbf1c195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 --2- 172.21.15.79:0/2811048079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf1c0ffc60 0x7fbf1c1963e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 >> 172.21.15.79:0/2811048079 conn(0x7fbf1c0748b0 msgr2=0x7fbf1c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:06.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 shutdown_connections 2024-09-10T09:43:06.591 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.588+0000 7fbf23bf2700 1 -- 172.21.15.79:0/2811048079 wait complete. 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.692+0000 7f47ac6bd700 1 -- 172.21.15.79:0/3631536037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 msgr2=0x7f47a41016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.692+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/3631536037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a41016b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009910 tx=0x7f47a0009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 -- 172.21.15.79:0/3631536037 shutdown_connections 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/3631536037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4101bf0 0x7f47a410a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/3631536037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a41016b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 -- 172.21.15.79:0/3631536037 >> 172.21.15.79:0/3631536037 conn(0x7f47a40fac90 msgr2=0x7f47a40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 -- 172.21.15.79:0/3631536037 shutdown_connections 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 -- 172.21.15.79:0/3631536037 wait complete. 2024-09-10T09:43:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 Processor -- start 2024-09-10T09:43:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 -- start start 2024-09-10T09:43:06.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a4195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4101bf0 0x7f47a41963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4196a20 con 0x7f47a41012e0 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.693+0000 7f47ac6bd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4196b60 con 0x7f47a4101bf0 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47aa459700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a4195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47aa459700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a4195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55930/0 (socket says 172.21.15.79:55930) 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47aa459700 1 -- 172.21.15.79:0/852390894 learned_addr learned my addr 172.21.15.79:0/852390894 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47a9c58700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4101bf0 0x7f47a41963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47aa459700 1 -- 172.21.15.79:0/852390894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4101bf0 msgr2=0x7f47a41963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47aa459700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4101bf0 0x7f47a41963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47aa459700 1 -- 172.21.15.79:0/852390894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a00095f0 con 0x7f47a41012e0 2024-09-10T09:43:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47aa459700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a4195e90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47a0006010 tx=0x7f47a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f479b7fe700 1 -- 172.21.15.79:0/852390894 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a001d070 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f479b7fe700 1 -- 172.21.15.79:0/852390894 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f47a000f460 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a419a950 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f479b7fe700 1 -- 172.21.15.79:0/852390894 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a0017630 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.694+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a419ae40 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.695+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a404f2a0 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.696+0000 7f479b7fe700 1 -- 172.21.15.79:0/852390894 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f47a000f5d0 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.696+0000 7f479b7fe700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f479006e200 0x7f47900706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.696+0000 7f479b7fe700 1 -- 172.21.15.79:0/852390894 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f47a008f530 con 0x7f47a41012e0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.696+0000 7f47a9c58700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f479006e200 0x7f47900706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.697+0000 7f47a9c58700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f479006e200 0x7f47900706b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f47a41974b0 tx=0x7f479400a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:06.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.701+0000 7f479b7fe700 1 -- 172.21.15.79:0/852390894 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47a00589c0 con 0x7f47a41012e0 2024-09-10T09:43:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.994+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47a41073e0 con 0x7f47a41012e0 2024-09-10T09:43:06.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.995+0000 7f479b7fe700 1 -- 172.21.15.79:0/852390894 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7f47a005c080 con 0x7f47a41012e0 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:06.996 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 7, 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:43:06.997 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f479006e200 msgr2=0x7f47900706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f479006e200 0x7f47900706b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f47a41974b0 tx=0x7f479400a380 comp rx=0 tx=0).stop 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 msgr2=0x7f47a4195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a4195e90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47a0006010 tx=0x7f47a000bd70 comp rx=0 tx=0).stop 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 shutdown_connections 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f479006e200 0x7f47900706b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47a41012e0 0x7f47a4195e90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 --2- 172.21.15.79:0/852390894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47a4101bf0 0x7f47a41963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 >> 172.21.15.79:0/852390894 conn(0x7f47a40fac90 msgr2=0x7f47a4104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 shutdown_connections 2024-09-10T09:43:06.998 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:06.997+0000 7f47ac6bd700 1 -- 172.21.15.79:0/852390894 wait complete. 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 -- 172.21.15.79:0/1294916585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1201004e0 msgr2=0x7fc1201008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1294916585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1201004e0 0x7fc1201008b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc110009910 tx=0x7fc110009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 -- 172.21.15.79:0/1294916585 shutdown_connections 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1294916585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc120100e80 0x7fc120104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1294916585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1201004e0 0x7fc1201008b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 -- 172.21.15.79:0/1294916585 >> 172.21.15.79:0/1294916585 conn(0x7fc1200fbda0 msgr2=0x7fc1200fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 -- 172.21.15.79:0/1294916585 shutdown_connections 2024-09-10T09:43:07.107 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.106+0000 7fc1262c0700 1 -- 172.21.15.79:0/1294916585 wait complete. 2024-09-10T09:43:07.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc1262c0700 1 Processor -- start 2024-09-10T09:43:07.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc1262c0700 1 -- start start 2024-09-10T09:43:07.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc1262c0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1201004e0 0x7fc120195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc1262c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc120100e80 0x7fc120196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc1262c0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc120196b10 con 0x7fc120100e80 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc1262c0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12019a8a0 con 0x7fc1201004e0 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc117fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc120100e80 0x7fc120196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc117fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc120100e80 0x7fc120196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55940/0 (socket says 172.21.15.79:55940) 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1201004e0 0x7fc120195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc117fff700 1 -- 172.21.15.79:0/1015860664 learned_addr learned my addr 172.21.15.79:0/1015860664 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc117fff700 1 -- 172.21.15.79:0/1015860664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1201004e0 msgr2=0x7fc120195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc117fff700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1201004e0 0x7fc120195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.107+0000 7fc117fff700 1 -- 172.21.15.79:0/1015860664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100095f0 con 0x7fc120100e80 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.108+0000 7fc117fff700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc120100e80 0x7fc120196430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc10800d8d0 tx=0x7fc10800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.108+0000 7fc11dffb700 1 -- 172.21.15.79:0/1015860664 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1080041f0 con 0x7fc120100e80 2024-09-10T09:43:07.110 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.108+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12019ab80 con 0x7fc120100e80 2024-09-10T09:43:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.108+0000 7fc11dffb700 1 -- 172.21.15.79:0/1015860664 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc108007620 con 0x7fc120100e80 2024-09-10T09:43:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.108+0000 7fc11dffb700 1 -- 172.21.15.79:0/1015860664 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1080056b0 con 0x7fc120100e80 2024-09-10T09:43:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.108+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12019b0d0 con 0x7fc120100e80 2024-09-10T09:43:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.109+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1201087f0 con 0x7fc120100e80 2024-09-10T09:43:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.109+0000 7fc11dffb700 1 -- 172.21.15.79:0/1015860664 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc108004830 con 0x7fc120100e80 2024-09-10T09:43:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.110+0000 7fc11dffb700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc10c06e200 0x7fc10c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.110+0000 7fc11dffb700 1 -- 172.21.15.79:0/1015860664 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fc10808de20 con 0x7fc120100e80 2024-09-10T09:43:07.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.110+0000 7fc11ffff700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc10c06e200 0x7fc10c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.110+0000 7fc11ffff700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc10c06e200 0x7fc10c0706b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc110006010 tx=0x7fc11001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:07.115 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.114+0000 7fc11dffb700 1 -- 172.21.15.79:0/1015860664 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc1080572b0 con 0x7fc120100e80 2024-09-10T09:43:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-mon[87213]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-mon[87213]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:07.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-mon[87213]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:07.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/852390894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.379+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc12019b2f0 con 0x7fc120100e80 2024-09-10T09:43:07.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.379+0000 7fc11dffb700 1 -- 172.21.15.79:0/1015860664 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7fc1080167b0 con 0x7fc120100e80 2024-09-10T09:43:07.380 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:43:07.381 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:43:07.382 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:07.383 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc10c06e200 msgr2=0x7fc10c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc10c06e200 0x7fc10c0706b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc110006010 tx=0x7fc11001a040 comp rx=0 tx=0).stop 2024-09-10T09:43:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc120100e80 msgr2=0x7fc120196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc120100e80 0x7fc120196430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc10800d8d0 tx=0x7fc10800dbe0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 shutdown_connections 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc10c06e200 0x7fc10c0706b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1201004e0 0x7fc120195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 --2- 172.21.15.79:0/1015860664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc120100e80 0x7fc120196430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 >> 172.21.15.79:0/1015860664 conn(0x7fc1200fbda0 msgr2=0x7fc1200fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 shutdown_connections 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.382+0000 7fc1262c0700 1 -- 172.21.15.79:0/1015860664 wait complete. 2024-09-10T09:43:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:43:07.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:07 smithi135 ceph-mon[65362]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:07.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:07 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:07.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:07 smithi135 ceph-mon[65362]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:07.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:07 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:07.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:07 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:07.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:07 smithi135 ceph-mon[65362]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:07.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:07 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/852390894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 -- 172.21.15.79:0/2869255217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ff3b0 msgr2=0x7f95480ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 --2- 172.21.15.79:0/2869255217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ff3b0 0x7f95480ff780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9530009910 tx=0x7f9530009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 -- 172.21.15.79:0/2869255217 shutdown_connections 2024-09-10T09:43:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 --2- 172.21.15.79:0/2869255217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95480ffd50 0x7f9548103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 --2- 172.21.15.79:0/2869255217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ff3b0 0x7f95480ff780 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.489 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 -- 172.21.15.79:0/2869255217 >> 172.21.15.79:0/2869255217 conn(0x7f95480fac90 msgr2=0x7f95480fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:07.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 -- 172.21.15.79:0/2869255217 shutdown_connections 2024-09-10T09:43:07.490 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.488+0000 7f954d26b700 1 -- 172.21.15.79:0/2869255217 wait complete. 2024-09-10T09:43:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f954d26b700 1 Processor -- start 2024-09-10T09:43:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f954d26b700 1 -- start start 2024-09-10T09:43:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f954d26b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95480ff3b0 0x7f9548194df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f954d26b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ffd50 0x7f9548195330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f954d26b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9548195a10 con 0x7f95480ffd50 2024-09-10T09:43:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f954d26b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95481997a0 con 0x7f95480ff3b0 2024-09-10T09:43:07.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f95467fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ffd50 0x7f9548195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f95467fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ffd50 0x7f9548195330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55954/0 (socket says 172.21.15.79:55954) 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f95467fc700 1 -- 172.21.15.79:0/263261038 learned_addr learned my addr 172.21.15.79:0/263261038 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.489+0000 7f9546ffd700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95480ff3b0 0x7f9548194df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f95467fc700 1 -- 172.21.15.79:0/263261038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95480ff3b0 msgr2=0x7f9548194df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f95467fc700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95480ff3b0 0x7f9548194df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f95467fc700 1 -- 172.21.15.79:0/263261038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95300095f0 con 0x7f95480ffd50 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f95467fc700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ffd50 0x7f9548195330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95380098f0 tx=0x7f9538009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f953ffff700 1 -- 172.21.15.79:0/263261038 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9538012070 con 0x7f95480ffd50 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f953ffff700 1 -- 172.21.15.79:0/263261038 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f953800d1f0 con 0x7f95480ffd50 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9548199a20 con 0x7f95480ffd50 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f953ffff700 1 -- 172.21.15.79:0/263261038 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f953800c8f0 con 0x7f95480ffd50 2024-09-10T09:43:07.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.490+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9548199f70 con 0x7f95480ffd50 2024-09-10T09:43:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.491+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954804f2a0 con 0x7f95480ffd50 2024-09-10T09:43:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.492+0000 7f953ffff700 1 -- 172.21.15.79:0/263261038 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9538016070 con 0x7f95480ffd50 2024-09-10T09:43:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.492+0000 7f953ffff700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f953406e200 0x7f95340706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.492+0000 7f953ffff700 1 -- 172.21.15.79:0/263261038 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f953808f150 con 0x7f95480ffd50 2024-09-10T09:43:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.492+0000 7f9546ffd700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f953406e200 0x7f95340706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.492+0000 7f9546ffd700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f953406e200 0x7f95340706b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9530006010 tx=0x7f953001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.496+0000 7f953ffff700 1 -- 172.21.15.79:0/263261038 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f95380585e0 con 0x7f95480ffd50 2024-09-10T09:43:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.728+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f954819a2a0 con 0x7f953406e200 2024-09-10T09:43:07.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.730+0000 7f953ffff700 1 -- 172.21.15.79:0/263261038 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f954819a2a0 con 0x7f953406e200 2024-09-10T09:43:07.730 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "8/23 daemons upgraded", 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:43:07.731 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f953406e200 msgr2=0x7f95340706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f953406e200 0x7f95340706b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9530006010 tx=0x7f953001a040 comp rx=0 tx=0).stop 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ffd50 msgr2=0x7f9548195330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ffd50 0x7f9548195330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95380098f0 tx=0x7f9538009c00 comp rx=0 tx=0).stop 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 shutdown_connections 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f953406e200 0x7f95340706b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95480ff3b0 0x7f9548194df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 --2- 172.21.15.79:0/263261038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95480ffd50 0x7f9548195330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.733 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 >> 172.21.15.79:0/263261038 conn(0x7f95480fac90 msgr2=0x7f95480fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:07.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 shutdown_connections 2024-09-10T09:43:07.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.732+0000 7f954d26b700 1 -- 172.21.15.79:0/263261038 wait complete. 2024-09-10T09:43:07.839 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 -- 172.21.15.79:0/1586561907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 msgr2=0x7f13940ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 --2- 172.21.15.79:0/1586561907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f13940ff790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1388009910 tx=0x7f1388009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 -- 172.21.15.79:0/1586561907 shutdown_connections 2024-09-10T09:43:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 --2- 172.21.15.79:0/1586561907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13940ffd60 0x7f1394103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 --2- 172.21.15.79:0/1586561907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f13940ff790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 -- 172.21.15.79:0/1586561907 >> 172.21.15.79:0/1586561907 conn(0x7f13940fac80 msgr2=0x7f13940fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 -- 172.21.15.79:0/1586561907 shutdown_connections 2024-09-10T09:43:07.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.838+0000 7f139ace9700 1 -- 172.21.15.79:0/1586561907 wait complete. 2024-09-10T09:43:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f139ace9700 1 Processor -- start 2024-09-10T09:43:07.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f139ace9700 1 -- start start 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f139ace9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f1394194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f139ace9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13940ffd60 0x7f13941952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f139ace9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13941959a0 con 0x7f13940ff3c0 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f139ace9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394199730 con 0x7f13940ffd60 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f1398a85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f1394194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f1398a85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f1394194d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:55974/0 (socket says 172.21.15.79:55974) 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f1398a85700 1 -- 172.21.15.79:0/2102750537 learned_addr learned my addr 172.21.15.79:0/2102750537 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f1393fff700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13940ffd60 0x7f13941952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f1398a85700 1 -- 172.21.15.79:0/2102750537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13940ffd60 msgr2=0x7f13941952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f1398a85700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13940ffd60 0x7f13941952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.839+0000 7f1398a85700 1 -- 172.21.15.79:0/2102750537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13880095f0 con 0x7f13940ff3c0 2024-09-10T09:43:07.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.840+0000 7f1398a85700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f1394194d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1388006010 tx=0x7f138800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.840+0000 7f1391ffb700 1 -- 172.21.15.79:0/2102750537 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138801d070 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.840+0000 7f1391ffb700 1 -- 172.21.15.79:0/2102750537 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f138800f460 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.840+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13941999b0 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.840+0000 7f1391ffb700 1 -- 172.21.15.79:0/2102750537 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1388017630 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.840+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1394199ea0 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.841+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13941076d0 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.842+0000 7f1391ffb700 1 -- 172.21.15.79:0/2102750537 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f138800f5d0 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.842+0000 7f1391ffb700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f138406e200 0x7f13840706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.842+0000 7f1391ffb700 1 -- 172.21.15.79:0/2102750537 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f138808f440 con 0x7f13940ff3c0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.842+0000 7f1393fff700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f138406e200 0x7f13840706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.843+0000 7f1393fff700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f138406e200 0x7f13840706b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1380005950 tx=0x7f13800058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:07.886 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:07.847+0000 7f1391ffb700 1 -- 172.21.15.79:0/2102750537 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1388058950 con 0x7f13940ff3c0 2024-09-10T09:43:07.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:07 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[110153]: 2024-09-10T09:43:07.865+0000 7ff6d7b88640 -1 Falling back to public interface 2024-09-10T09:43:08.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.168+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f139419a180 con 0x7f13940ff3c0 2024-09-10T09:43:08.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.168+0000 7f1391ffb700 1 -- 172.21.15.79:0/2102750537 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1074 (secure 0 0 0) 0x7f138805c010 con 0x7f13940ff3c0 2024-09-10T09:43:08.169 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded 2024-09-10T09:43:08.169 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: osd.2 (root=default,host=smithi079) is down 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-10T09:43:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-10T09:43:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-10T09:43:08.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f138406e200 msgr2=0x7f13840706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:08.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f138406e200 0x7f13840706b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1380005950 tx=0x7f13800058e0 comp rx=0 tx=0).stop 2024-09-10T09:43:08.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 msgr2=0x7f1394194d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f1394194d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1388006010 tx=0x7f138800be20 comp rx=0 tx=0).stop 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 shutdown_connections 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f138406e200 0x7f13840706b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13940ff3c0 0x7f1394194d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 --2- 172.21.15.79:0/2102750537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13940ffd60 0x7f13941952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.170+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 >> 172.21.15.79:0/2102750537 conn(0x7f13940fac80 msgr2=0x7f13940fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.171+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 shutdown_connections 2024-09-10T09:43:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:08.171+0000 7f139ace9700 1 -- 172.21.15.79:0/2102750537 wait complete. 2024-09-10T09:43:08.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:08 smithi079 ceph-mon[87213]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:08.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:08 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1015860664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:43:08.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:08 smithi135 ceph-mon[65362]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:08.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:08 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1015860664' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:43:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:09 smithi079 ceph-mon[87213]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:09 smithi079 ceph-mon[87213]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:09.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:09 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2102750537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:43:09.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:09 smithi135 ceph-mon[65362]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:09.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:09 smithi135 ceph-mon[65362]: pgmap v92: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:09.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:09 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2102750537' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:43:11.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:11 smithi079 ceph-mon[87213]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:11.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:11 smithi135 ceph-mon[65362]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:12.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:12 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:12.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:12.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:12.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:12.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:12 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:13.376 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:13 smithi079 ceph-mon[87213]: pgmap v94: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:13.377 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:13 smithi079 ceph-mon[87213]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:13.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:13 smithi135 ceph-mon[65362]: pgmap v94: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:13.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:13 smithi135 ceph-mon[65362]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:13.711 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:13 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[110153]: 2024-09-10T09:43:13.375+0000 7ff6d7b88640 -1 osd.2 0 read_superblock omap replica is missing. 2024-09-10T09:43:14.004 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:13 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[110153]: 2024-09-10T09:43:13.806+0000 7ff6d7b88640 -1 osd.2 60 log_to_monitors true 2024-09-10T09:43:14.274 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:14 smithi079 ceph-mon[87213]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T09:43:14.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:14 smithi135 ceph-mon[65362]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T09:43:15.211 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:43:15 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[110153]: 2024-09-10T09:43:15.060+0000 7ff6cb91a640 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:43:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:15 smithi079 ceph-mon[87213]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:15 smithi079 ceph-mon[87213]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T09:43:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:15 smithi079 ceph-mon[87213]: osdmap e63: 6 total, 5 up, 6 in 2024-09-10T09:43:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:15 smithi079 ceph-mon[87213]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:43:15.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:15 smithi079 ceph-mon[87213]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' 2024-09-10T09:43:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:15 smithi135 ceph-mon[65362]: pgmap v95: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 30/222 objects degraded (13.514%) 2024-09-10T09:43:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:15 smithi135 ceph-mon[65362]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T09:43:15.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:15 smithi135 ceph-mon[65362]: osdmap e63: 6 total, 5 up, 6 in 2024-09-10T09:43:15.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:15 smithi135 ceph-mon[65362]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]: dispatch 2024-09-10T09:43:15.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:15 smithi135 ceph-mon[65362]: from='osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711]' entity='osd.2' 2024-09-10T09:43:16.641 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:16.641 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:16.641 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711] boot 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: osdmap e64: 6 total, 6 up, 6 in 2024-09-10T09:43:16.642 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:43:16.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: osd.2 [v2:172.21.15.79:6818/2003041711,v1:172.21.15.79:6819/2003041711] boot 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: osdmap e64: 6 total, 6 up, 6 in 2024-09-10T09:43:16.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T09:43:17.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:17 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:17.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:17 smithi079 ceph-mon[87213]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T09:43:17.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:17 smithi079 ceph-mon[87213]: pgmap v98: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:43:17.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:17 smithi079 ceph-mon[87213]: osdmap e65: 6 total, 6 up, 6 in 2024-09-10T09:43:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:17 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:17 smithi135 ceph-mon[65362]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T09:43:17.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:17 smithi135 ceph-mon[65362]: pgmap v98: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:43:17.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:17 smithi135 ceph-mon[65362]: osdmap e65: 6 total, 6 up, 6 in 2024-09-10T09:43:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:19 smithi079 ceph-mon[87213]: pgmap v100: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:43:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:19.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:19 smithi135 ceph-mon[65362]: pgmap v100: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:43:19.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:19.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:20.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:20 smithi079 ceph-mon[87213]: pgmap v101: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-10T09:43:20.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:20 smithi079 ceph-mon[87213]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded) 2024-09-10T09:43:20.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:20 smithi135 ceph-mon[65362]: pgmap v101: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-10T09:43:20.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:20 smithi135 ceph-mon[65362]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/222 objects degraded (13.514%), 11 pgs degraded) 2024-09-10T09:43:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:23 smithi079 ceph-mon[87213]: pgmap v102: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:43:23.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:23 smithi135 ceph-mon[65362]: pgmap v102: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:43:25.446 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:25 smithi079 ceph-mon[87213]: pgmap v103: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 507 B/s rd, 0 op/s 2024-09-10T09:43:25.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:25 smithi135 ceph-mon[65362]: pgmap v103: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 507 B/s rd, 0 op/s 2024-09-10T09:43:27.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:27 smithi079 ceph-mon[87213]: pgmap v104: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-10T09:43:27.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:27 smithi135 ceph-mon[65362]: pgmap v104: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-09-10T09:43:29.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:29 smithi079 ceph-mon[87213]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 833 B/s rd, 1 op/s 2024-09-10T09:43:29.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:29 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:29.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:29 smithi135 ceph-mon[65362]: pgmap v105: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 833 B/s rd, 1 op/s 2024-09-10T09:43:29.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:29 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:31.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:31 smithi079 ceph-mon[87213]: pgmap v106: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:31.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:31 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:31.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:31 smithi135 ceph-mon[65362]: pgmap v106: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:31.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:31 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:32.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:32 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:32.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:32 smithi079 ceph-mon[87213]: Upgrade: osd.3 is safe to restart 2024-09-10T09:43:32.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:32.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:43:32.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:43:32.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:32 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-10T09:43:32.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:32 smithi135 ceph-mon[65362]: Upgrade: osd.3 is safe to restart 2024-09-10T09:43:32.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:32.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T09:43:32.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:43:33.460 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:33 smithi135 ceph-mon[65362]: Upgrade: Updating osd.3 2024-09-10T09:43:33.460 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:33 smithi135 ceph-mon[65362]: Deploying daemon osd.3 on smithi135 2024-09-10T09:43:33.460 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:33 smithi135 ceph-mon[65362]: pgmap v107: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:43:33.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:33 smithi079 ceph-mon[87213]: Upgrade: Updating osd.3 2024-09-10T09:43:33.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:33 smithi079 ceph-mon[87213]: Deploying daemon osd.3 on smithi135 2024-09-10T09:43:33.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:33 smithi079 ceph-mon[87213]: pgmap v107: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:43:35.111 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:34 smithi135 systemd[1]: Stopping Ceph osd.3 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:43:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:35 smithi079 ceph-mon[87213]: pgmap v108: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:43:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:35 smithi135 ceph-mon[65362]: pgmap v108: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:43:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:35.468 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:35 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[39395]: 2024-09-10T09:43:35.161+0000 7f546b923700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:43:35.468 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:35 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[39395]: 2024-09-10T09:43:35.161+0000 7f546b923700 -1 osd.3 65 *** Got signal Terminated *** 2024-09-10T09:43:35.468 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:35 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[39395]: 2024-09-10T09:43:35.161+0000 7f546b923700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:43:36.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:36 smithi079 ceph-mon[87213]: osd.3 marked itself down and dead 2024-09-10T09:43:36.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:36 smithi135 ceph-mon[65362]: osd.3 marked itself down and dead 2024-09-10T09:43:36.936 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:36 smithi135 podman[74375]: 2024-09-10 09:43:36.659969629 +0000 UTC m=+1.645847594 container died b68a031a0843bcf62e4d4c977217eeb77f4db254787107c8c0f59034a0d5e936 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20231212, ceph=True, io.buildah.version=1.29.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0) 2024-09-10T09:43:37.218 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:37 smithi135 podman[74375]: 2024-09-10 09:43:37.023386202 +0000 UTC m=+2.009264157 container cleanup b68a031a0843bcf62e4d4c977217eeb77f4db254787107c8c0f59034a0d5e936 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, ceph=True, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20231212, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308) 2024-09-10T09:43:37.218 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:37 smithi135 bash[74375]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3 2024-09-10T09:43:37.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:37 smithi135 ceph-mon[65362]: pgmap v109: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:37.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:37 smithi135 ceph-mon[65362]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:43:37.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:37 smithi135 ceph-mon[65362]: osdmap e66: 6 total, 5 up, 6 in 2024-09-10T09:43:37.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:37 smithi079 ceph-mon[87213]: pgmap v109: 65 pgs: 65 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:43:37.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:37 smithi079 ceph-mon[87213]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:43:37.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:37 smithi079 ceph-mon[87213]: osdmap e66: 6 total, 5 up, 6 in 2024-09-10T09:43:37.683 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:37 smithi135 podman[74403]: 2024-09-10 09:43:37.32525822 +0000 UTC m=+0.648135645 container remove b68a031a0843bcf62e4d4c977217eeb77f4db254787107c8c0f59034a0d5e936 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, RELEASE=HEAD, GIT_CLEAN=True, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T09:43:37.967 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:37 smithi135 podman[74491]: 2024-09-10 09:43:37.58550725 +0000 UTC m=+0.015848043 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:43:37.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:37 smithi135 podman[74491]: 2024-09-10 09:43:37.704689535 +0000 UTC m=+0.135030327 container create e17a4d6c7150fe6ea9c4799b1d8be62f7bb02869b1272db9d63af88c2d84190c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.288+0000 7f9fa5a80700 1 -- 172.21.15.79:0/1823961114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 msgr2=0x7f9fa0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.288+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/1823961114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa0104e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009910 tx=0x7f9f88009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.289+0000 7f9fa5a80700 1 -- 172.21.15.79:0/1823961114 shutdown_connections 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.289+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/1823961114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa0104e10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.289+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/1823961114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fa01004a0 0x7f9fa0100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.289+0000 7f9fa5a80700 1 -- 172.21.15.79:0/1823961114 >> 172.21.15.79:0/1823961114 conn(0x7f9fa00fbd40 msgr2=0x7f9fa00fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.289+0000 7f9fa5a80700 1 -- 172.21.15.79:0/1823961114 shutdown_connections 2024-09-10T09:43:38.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.289+0000 7f9fa5a80700 1 -- 172.21.15.79:0/1823961114 wait complete. 2024-09-10T09:43:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.289+0000 7f9fa5a80700 1 Processor -- start 2024-09-10T09:43:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9fa5a80700 1 -- start start 2024-09-10T09:43:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9fa5a80700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fa01004a0 0x7f9fa0195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9fa5a80700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa01963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.293 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9fa5a80700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0196ad0 con 0x7f9fa0100e40 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9fa5a80700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa019a860 con 0x7f9fa01004a0 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9f9effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa01963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9f9effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa01963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58448/0 (socket says 172.21.15.79:58448) 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9f9effd700 1 -- 172.21.15.79:0/3275621824 learned_addr learned my addr 172.21.15.79:0/3275621824 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9f9f7fe700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fa01004a0 0x7f9fa0195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9f9effd700 1 -- 172.21.15.79:0/3275621824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fa01004a0 msgr2=0x7f9fa0195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9f9effd700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fa01004a0 0x7f9fa0195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.290+0000 7f9f9effd700 1 -- 172.21.15.79:0/3275621824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880095f0 con 0x7f9fa0100e40 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.291+0000 7f9f9effd700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa01963f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9f880092e0 tx=0x7f9f8800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.291+0000 7f9f9cff9700 1 -- 172.21.15.79:0/3275621824 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8801d070 con 0x7f9fa0100e40 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.291+0000 7f9f9cff9700 1 -- 172.21.15.79:0/3275621824 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f88005dc0 con 0x7f9fa0100e40 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.291+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa019aae0 con 0x7f9fa0100e40 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.291+0000 7f9f9cff9700 1 -- 172.21.15.79:0/3275621824 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f88017400 con 0x7f9fa0100e40 2024-09-10T09:43:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.291+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa019afd0 con 0x7f9fa0100e40 2024-09-10T09:43:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.292+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa0108810 con 0x7f9fa0100e40 2024-09-10T09:43:38.295 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.292+0000 7f9f9cff9700 1 -- 172.21.15.79:0/3275621824 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9f8800f6f0 con 0x7f9fa0100e40 2024-09-10T09:43:38.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.293+0000 7f9f9cff9700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9f8c06e200 0x7f9f8c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.293+0000 7f9f9cff9700 1 -- 172.21.15.79:0/3275621824 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9f8808f3c0 con 0x7f9fa0100e40 2024-09-10T09:43:38.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.293+0000 7f9f9f7fe700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9f8c06e200 0x7f9f8c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.296 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.293+0000 7f9f9f7fe700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9f8c06e200 0x7f9f8c0706b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009550 tx=0x7f9f900091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:38.299 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.297+0000 7f9f9cff9700 1 -- 172.21.15.79:0/3275621824 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f88058850 con 0x7f9fa0100e40 2024-09-10T09:43:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:38 smithi079 ceph-mon[87213]: osdmap e67: 6 total, 5 up, 6 in 2024-09-10T09:43:38.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:38 smithi135 ceph-mon[65362]: osdmap e67: 6 total, 5 up, 6 in 2024-09-10T09:43:38.468 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:37 smithi135 podman[74491]: 2024-09-10 09:43:37.987984595 +0000 UTC m=+0.418325386 container init e17a4d6c7150fe6ea9c4799b1d8be62f7bb02869b1272db9d63af88c2d84190c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:43:38.468 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:37 smithi135 podman[74491]: 2024-09-10 09:43:37.991735732 +0000 UTC m=+0.422076524 container start e17a4d6c7150fe6ea9c4799b1d8be62f7bb02869b1272db9d63af88c2d84190c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:43:38.468 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:38 smithi135 podman[74491]: 2024-09-10 09:43:38.063084108 +0000 UTC m=+0.493424896 container attach e17a4d6c7150fe6ea9c4799b1d8be62f7bb02869b1272db9d63af88c2d84190c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T09:43:38.468 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:38 smithi135 podman[74491]: 2024-09-10 09:43:38.197773562 +0000 UTC m=+0.628114352 container died e17a4d6c7150fe6ea9c4799b1d8be62f7bb02869b1272db9d63af88c2d84190c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0) 2024-09-10T09:43:38.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.520+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fa0197320 con 0x7f9f8c06e200 2024-09-10T09:43:38.523 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.522+0000 7f9f9cff9700 1 -- 172.21.15.79:0/3275621824 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9fa0197320 con 0x7f9f8c06e200 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9f8c06e200 msgr2=0x7f9f8c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9f8c06e200 0x7f9f8c0706b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009550 tx=0x7f9f900091b0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 msgr2=0x7f9fa01963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa01963f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9f880092e0 tx=0x7f9f8800bd70 comp rx=0 tx=0).stop 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 shutdown_connections 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9f8c06e200 0x7f9f8c0706b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fa01004a0 0x7f9fa0195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.526 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 --2- 172.21.15.79:0/3275621824 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fa0100e40 0x7f9fa01963f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 >> 172.21.15.79:0/3275621824 conn(0x7f9fa00fbd40 msgr2=0x7f9fa00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:38.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 shutdown_connections 2024-09-10T09:43:38.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.524+0000 7f9fa5a80700 1 -- 172.21.15.79:0/3275621824 wait complete. 2024-09-10T09:43:38.536 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:43:38.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.628+0000 7f38562ff700 1 -- 172.21.15.79:0/2073454079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 msgr2=0x7f3850104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.628+0000 7f38562ff700 1 --2- 172.21.15.79:0/2073454079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850104500 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3840009910 tx=0x7f3840009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:38.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 -- 172.21.15.79:0/2073454079 shutdown_connections 2024-09-10T09:43:38.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 --2- 172.21.15.79:0/2073454079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38500ffbd0 0x7f3850100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 --2- 172.21.15.79:0/2073454079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850104500 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 -- 172.21.15.79:0/2073454079 >> 172.21.15.79:0/2073454079 conn(0x7f3850075130 msgr2=0x7f3850075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:38.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 -- 172.21.15.79:0/2073454079 shutdown_connections 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 -- 172.21.15.79:0/2073454079 wait complete. 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 Processor -- start 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 -- start start 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38500ffbd0 0x7f3850195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850196a50 con 0x7f3850104130 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.629+0000 7f38562ff700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385019a7e0 con 0x7f38500ffbd0 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f3847fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f3847fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58460/0 (socket says 172.21.15.79:58460) 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f3847fff700 1 -- 172.21.15.79:0/1950323678 learned_addr learned my addr 172.21.15.79:0/1950323678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f384ffff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38500ffbd0 0x7f3850195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f3847fff700 1 -- 172.21.15.79:0/1950323678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38500ffbd0 msgr2=0x7f3850195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f3847fff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38500ffbd0 0x7f3850195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f3847fff700 1 -- 172.21.15.79:0/1950323678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400095f0 con 0x7f3850104130 2024-09-10T09:43:38.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f3847fff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850196370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f383800d8d0 tx=0x7f383800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:38.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f384dffb700 1 -- 172.21.15.79:0/1950323678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38380098a0 con 0x7f3850104130 2024-09-10T09:43:38.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f384dffb700 1 -- 172.21.15.79:0/1950323678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3838010460 con 0x7f3850104130 2024-09-10T09:43:38.634 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385019aac0 con 0x7f3850104130 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f384dffb700 1 -- 172.21.15.79:0/1950323678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383800f5f0 con 0x7f3850104130 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.630+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385019b010 con 0x7f3850104130 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.631+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385004f2a0 con 0x7f3850104130 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.632+0000 7f384dffb700 1 -- 172.21.15.79:0/1950323678 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3838009a00 con 0x7f3850104130 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.632+0000 7f384dffb700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f383c06e200 0x7f383c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.632+0000 7f384dffb700 1 -- 172.21.15.79:0/1950323678 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f383808ddf0 con 0x7f3850104130 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.632+0000 7f384ffff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f383c06e200 0x7f383c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.633+0000 7f384ffff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f383c06e200 0x7f383c0706b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3840006010 tx=0x7f384001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:38.638 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.636+0000 7f384dffb700 1 -- 172.21.15.79:0/1950323678 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3838057300 con 0x7f3850104130 2024-09-10T09:43:38.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.857+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f385019b360 con 0x7f383c06e200 2024-09-10T09:43:38.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.858+0000 7f384dffb700 1 -- 172.21.15.79:0/1950323678 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f385019b360 con 0x7f383c06e200 2024-09-10T09:43:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f383c06e200 msgr2=0x7f383c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f383c06e200 0x7f383c0706b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3840006010 tx=0x7f384001a040 comp rx=0 tx=0).stop 2024-09-10T09:43:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 msgr2=0x7f3850196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850196370 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f383800d8d0 tx=0x7f383800dbe0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 shutdown_connections 2024-09-10T09:43:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f383c06e200 0x7f383c0706b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38500ffbd0 0x7f3850195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 --2- 172.21.15.79:0/1950323678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3850104130 0x7f3850196370 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 >> 172.21.15.79:0/1950323678 conn(0x7f3850075130 msgr2=0x7f38500685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 shutdown_connections 2024-09-10T09:43:38.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.860+0000 7f38562ff700 1 -- 172.21.15.79:0/1950323678 wait complete. 2024-09-10T09:43:38.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.965+0000 7f656c971700 1 -- 172.21.15.79:0/118508746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 msgr2=0x7f65680ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.965+0000 7f656c971700 1 --2- 172.21.15.79:0/118508746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f65680ff720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f655c009910 tx=0x7f655c009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:38.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.965+0000 7f656c971700 1 -- 172.21.15.79:0/118508746 shutdown_connections 2024-09-10T09:43:38.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.965+0000 7f656c971700 1 --2- 172.21.15.79:0/118508746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65680ffc60 0x7f656810a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.965+0000 7f656c971700 1 --2- 172.21.15.79:0/118508746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f65680ff720 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.966+0000 7f656c971700 1 -- 172.21.15.79:0/118508746 >> 172.21.15.79:0/118508746 conn(0x7f65680748b0 msgr2=0x7f6568074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:38.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.966+0000 7f656c971700 1 -- 172.21.15.79:0/118508746 shutdown_connections 2024-09-10T09:43:38.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.966+0000 7f656c971700 1 -- 172.21.15.79:0/118508746 wait complete. 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.966+0000 7f656c971700 1 Processor -- start 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.966+0000 7f656c971700 1 -- start start 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656c971700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f6568100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656c971700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65680ffc60 0x7f6568100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656c971700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6568100fb0 con 0x7f65680ff350 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656c971700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65681010f0 con 0x7f65680ffc60 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f6568100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f6568100530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58468/0 (socket says 172.21.15.79:58468) 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656659c700 1 -- 172.21.15.79:0/3635794428 learned_addr learned my addr 172.21.15.79:0/3635794428 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f6565d9b700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65680ffc60 0x7f6568100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656659c700 1 -- 172.21.15.79:0/3635794428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65680ffc60 msgr2=0x7f6568100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656659c700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65680ffc60 0x7f6568100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656659c700 1 -- 172.21.15.79:0/3635794428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0095f0 con 0x7f65680ff350 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656659c700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f6568100530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f655c005f50 tx=0x7f655c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f65577fe700 1 -- 172.21.15.79:0/3635794428 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f655c01d070 con 0x7f65680ff350 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f65577fe700 1 -- 172.21.15.79:0/3635794428 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f655c00b610 con 0x7f65680ff350 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6568101370 con 0x7f65680ff350 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f65577fe700 1 -- 172.21.15.79:0/3635794428 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f655c022470 con 0x7f65680ff350 2024-09-10T09:43:38.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.967+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65681a2380 con 0x7f65680ff350 2024-09-10T09:43:38.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.968+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6568107dd0 con 0x7f65680ff350 2024-09-10T09:43:38.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.969+0000 7f65577fe700 1 -- 172.21.15.79:0/3635794428 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f655c003780 con 0x7f65680ff350 2024-09-10T09:43:38.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.969+0000 7f65577fe700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f655006e200 0x7f65500706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:38.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.969+0000 7f65577fe700 1 -- 172.21.15.79:0/3635794428 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f655c08f310 con 0x7f65680ff350 2024-09-10T09:43:38.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.969+0000 7f6565d9b700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f655006e200 0x7f65500706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:38.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.970+0000 7f6565d9b700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f655006e200 0x7f65500706b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6568101d20 tx=0x7f6558009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:38.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:38.974+0000 7f65577fe700 1 -- 172.21.15.79:0/3635794428 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f655c058820 con 0x7f65680ff350 2024-09-10T09:43:39.156 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:38 smithi135 podman[74514]: 2024-09-10 09:43:38.809660935 +0000 UTC m=+0.601821841 container remove e17a4d6c7150fe6ea9c4799b1d8be62f7bb02869b1272db9d63af88c2d84190c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T09:43:39.156 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:38 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-10T09:43:39.156 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:38 smithi135 systemd[1]: Stopped Ceph osd.3 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:43:39.156 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:38 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.3.service: Consumed 1min 21.560s CPU time. 2024-09-10T09:43:39.156 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 systemd[1]: Starting Ceph osd.3 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:43:39.186 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.184+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6568101b70 con 0x7f655006e200 2024-09-10T09:43:39.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.193+0000 7f65577fe700 1 -- 172.21.15.79:0/3635794428 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f6568101b70 con 0x7f655006e200 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (4m) 27s ago 15m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (15m) 27s ago 15m 8614k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (14m) 2m ago 14m 7998k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (2m) 27s ago 15m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (2m) 2m ago 14m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (4m) 27s ago 15m 83.3M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (10m) 27s ago 10m 17.1M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (10m) 27s ago 10m 97.2M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (10m) 2m ago 10m 152M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (9m) 2m ago 9m 20.1M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:43:39.196 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (6m) 27s ago 16m 499M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (5m) 2m ago 14m 439M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (3m) 27s ago 17m 50.0M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (2m) 2m ago 14m 39.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (5m) 27s ago 15m 15.3M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (5m) 2m ago 14m 15.7M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (104s) 27s ago 13m 101M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (69s) 27s ago 13m 104M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (33s) 27s ago 12m 12.1M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (12m) 2m ago 12m 291M 4096M 18.2.0 dc2bc1663786 b68a031a0843 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (12m) 2m ago 12m 256M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (11m) 2m ago 11m 255M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:43:39.197 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (5m) 27s ago 15m 79.0M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:43:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f655006e200 msgr2=0x7f65500706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f655006e200 0x7f65500706b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6568101d20 tx=0x7f6558009260 comp rx=0 tx=0).stop 2024-09-10T09:43:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 msgr2=0x7f6568100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f6568100530 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f655c005f50 tx=0x7f655c00f690 comp rx=0 tx=0).stop 2024-09-10T09:43:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 shutdown_connections 2024-09-10T09:43:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f655006e200 0x7f65500706b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65680ff350 0x7f6568100530 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 --2- 172.21.15.79:0/3635794428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65680ffc60 0x7f6568100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 >> 172.21.15.79:0/3635794428 conn(0x7f65680748b0 msgr2=0x7f6568104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 shutdown_connections 2024-09-10T09:43:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.196+0000 7f656c971700 1 -- 172.21.15.79:0/3635794428 wait complete. 2024-09-10T09:43:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.301+0000 7fef75aae700 1 -- 172.21.15.79:0/3505582924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 msgr2=0x7fef70103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.301+0000 7fef75aae700 1 --2- 172.21.15.79:0/3505582924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70103d30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef64009910 tx=0x7fef64009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.301+0000 7fef75aae700 1 -- 172.21.15.79:0/3505582924 shutdown_connections 2024-09-10T09:43:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.301+0000 7fef75aae700 1 --2- 172.21.15.79:0/3505582924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70103d30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.301+0000 7fef75aae700 1 --2- 172.21.15.79:0/3505582924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef700ff3c0 0x7fef700ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.301+0000 7fef75aae700 1 -- 172.21.15.79:0/3505582924 >> 172.21.15.79:0/3505582924 conn(0x7fef700fac60 msgr2=0x7fef700fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:39.306 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.302+0000 7fef75aae700 1 -- 172.21.15.79:0/3505582924 shutdown_connections 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.302+0000 7fef75aae700 1 -- 172.21.15.79:0/3505582924 wait complete. 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.302+0000 7fef75aae700 1 Processor -- start 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.302+0000 7fef75aae700 1 -- start start 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef75aae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef700ff3c0 0x7fef70196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef75aae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef75aae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef70197920 con 0x7fef700ffd60 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef75aae700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef70197a60 con 0x7fef700ff3c0 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58488/0 (socket says 172.21.15.79:58488) 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6effd700 1 -- 172.21.15.79:0/1606329346 learned_addr learned my addr 172.21.15.79:0/1606329346 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6f7fe700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef700ff3c0 0x7fef70196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6effd700 1 -- 172.21.15.79:0/1606329346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef700ff3c0 msgr2=0x7fef70196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.307 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6effd700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef700ff3c0 0x7fef70196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6effd700 1 -- 172.21.15.79:0/1606329346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef640095f0 con 0x7fef700ffd60 2024-09-10T09:43:39.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6effd700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70197350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef64005f50 tx=0x7fef6400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:39.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.303+0000 7fef6cff9700 1 -- 172.21.15.79:0/1606329346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6401d070 con 0x7fef700ffd60 2024-09-10T09:43:39.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.304+0000 7fef6cff9700 1 -- 172.21.15.79:0/1606329346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef6400f460 con 0x7fef700ffd60 2024-09-10T09:43:39.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.304+0000 7fef6cff9700 1 -- 172.21.15.79:0/1606329346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef64017630 con 0x7fef700ffd60 2024-09-10T09:43:39.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.304+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7019fe80 con 0x7fef700ffd60 2024-09-10T09:43:39.308 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.304+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef701a0230 con 0x7fef700ffd60 2024-09-10T09:43:39.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.305+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef70107680 con 0x7fef700ffd60 2024-09-10T09:43:39.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.305+0000 7fef6cff9700 1 -- 172.21.15.79:0/1606329346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fef6400f5d0 con 0x7fef700ffd60 2024-09-10T09:43:39.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.306+0000 7fef6cff9700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef5806e200 0x7fef580706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:39.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.306+0000 7fef6cff9700 1 -- 172.21.15.79:0/1606329346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fef6408f480 con 0x7fef700ffd60 2024-09-10T09:43:39.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.306+0000 7fef6f7fe700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef5806e200 0x7fef580706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:39.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.306+0000 7fef6f7fe700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef5806e200 0x7fef580706b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef60009a10 tx=0x7fef60009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:39.312 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.310+0000 7fef6cff9700 1 -- 172.21.15.79:0/1606329346 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fef64058990 con 0x7fef700ffd60 2024-09-10T09:43:39.409 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:39 smithi135 ceph-mon[65362]: pgmap v112: 65 pgs: 16 stale+active+clean, 49 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-10T09:43:39.409 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 podman[74615]: 2024-09-10 09:43:39.136568762 +0000 UTC m=+0.016789673 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:43:39.409 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 podman[74615]: 2024-09-10 09:43:39.277704886 +0000 UTC m=+0.157925789 container create 6f6dd9cdeed1e625ac4a406b295d534bc245185c12d6f88f1cc33c6951bb1183 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:43:39.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:39 smithi079 ceph-mon[87213]: pgmap v112: 65 pgs: 16 stale+active+clean, 49 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-10T09:43:39.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.595+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef70197c20 con 0x7fef700ffd60 2024-09-10T09:43:39.597 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.595+0000 7fef6cff9700 1 -- 172.21.15.79:0/1606329346 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fef6405c050 con 0x7fef700ffd60 2024-09-10T09:43:39.597 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:43:39.597 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:43:39.597 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:43:39.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 2, 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 3 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 6, 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 7 2024-09-10T09:43:39.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:43:39.599 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:43:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef5806e200 msgr2=0x7fef580706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.599 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef5806e200 0x7fef580706b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef60009a10 tx=0x7fef60009190 comp rx=0 tx=0).stop 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 msgr2=0x7fef70197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70197350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef64005f50 tx=0x7fef6400bd70 comp rx=0 tx=0).stop 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 shutdown_connections 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fef5806e200 0x7fef580706b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef700ff3c0 0x7fef70196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 --2- 172.21.15.79:0/1606329346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef700ffd60 0x7fef70197350 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 >> 172.21.15.79:0/1606329346 conn(0x7fef700fac60 msgr2=0x7fef700fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 shutdown_connections 2024-09-10T09:43:39.600 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.597+0000 7fef75aae700 1 -- 172.21.15.79:0/1606329346 wait complete. 2024-09-10T09:43:39.679 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 podman[74615]: 2024-09-10 09:43:39.547629527 +0000 UTC m=+0.427850429 container init 6f6dd9cdeed1e625ac4a406b295d534bc245185c12d6f88f1cc33c6951bb1183 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-10T09:43:39.679 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 podman[74615]: 2024-09-10 09:43:39.55116846 +0000 UTC m=+0.431389364 container start 6f6dd9cdeed1e625ac4a406b295d534bc245185c12d6f88f1cc33c6951bb1183 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T09:43:39.679 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 podman[74615]: 2024-09-10 09:43:39.622667003 +0000 UTC m=+0.502887919 container attach 6f6dd9cdeed1e625ac4a406b295d534bc245185c12d6f88f1cc33c6951bb1183 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 -- 172.21.15.79:0/3314092628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 msgr2=0x7fdab410a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 --2- 172.21.15.79:0/3314092628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab410a6d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009910 tx=0x7fdab0009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 -- 172.21.15.79:0/3314092628 shutdown_connections 2024-09-10T09:43:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 --2- 172.21.15.79:0/3314092628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab410a6d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 --2- 172.21.15.79:0/3314092628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdab40ff350 0x7fdab40ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 -- 172.21.15.79:0/3314092628 >> 172.21.15.79:0/3314092628 conn(0x7fdab40748b0 msgr2=0x7fdab4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 -- 172.21.15.79:0/3314092628 shutdown_connections 2024-09-10T09:43:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.701+0000 7fdabb28c700 1 -- 172.21.15.79:0/3314092628 wait complete. 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.702+0000 7fdabb28c700 1 Processor -- start 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.702+0000 7fdabb28c700 1 -- start start 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.702+0000 7fdabb28c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdab40ff350 0x7fdab4100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.702+0000 7fdabb28c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab4100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.702+0000 7fdabb28c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4100fb0 con 0x7fdab40ffc60 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.702+0000 7fdabb28c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab41010f0 con 0x7fdab40ff350 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.702+0000 7fdab8827700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab4100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdab8827700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab4100a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58502/0 (socket says 172.21.15.79:58502) 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdab8827700 1 -- 172.21.15.79:0/1497458464 learned_addr learned my addr 172.21.15.79:0/1497458464 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdab9028700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdab40ff350 0x7fdab4100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdab8827700 1 -- 172.21.15.79:0/1497458464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdab40ff350 msgr2=0x7fdab4100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdab8827700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdab40ff350 0x7fdab4100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdab8827700 1 -- 172.21.15.79:0/1497458464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00095f0 con 0x7fdab40ffc60 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdab8827700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab4100a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdab0006010 tx=0x7fdab000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdaaa7fc700 1 -- 172.21.15.79:0/1497458464 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab001d070 con 0x7fdab40ffc60 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdaaa7fc700 1 -- 172.21.15.79:0/1497458464 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdab0005dc0 con 0x7fdab40ffc60 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdaaa7fc700 1 -- 172.21.15.79:0/1497458464 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab0017400 con 0x7fdab40ffc60 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab4101370 con 0x7fdab40ffc60 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.703+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab41a23e0 con 0x7fdab40ffc60 2024-09-10T09:43:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.704+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab4107dd0 con 0x7fdab40ffc60 2024-09-10T09:43:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.705+0000 7fdaaa7fc700 1 -- 172.21.15.79:0/1497458464 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdab0003a60 con 0x7fdab40ffc60 2024-09-10T09:43:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.705+0000 7fdaaa7fc700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdaa006e200 0x7fdaa00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.705+0000 7fdaaa7fc700 1 -- 172.21.15.79:0/1497458464 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdab008f370 con 0x7fdab40ffc60 2024-09-10T09:43:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.705+0000 7fdab9028700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdaa006e200 0x7fdaa00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.706+0000 7fdab9028700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdaa006e200 0x7fdaa00706b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdab406a640 tx=0x7fdaa4007400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:39.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.709+0000 7fdaaa7fc700 1 -- 172.21.15.79:0/1497458464 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdab0058880 con 0x7fdab40ffc60 2024-09-10T09:43:39.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.964+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdab404f2a0 con 0x7fdab40ffc60 2024-09-10T09:43:39.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.964+0000 7fdaaa7fc700 1 -- 172.21.15.79:0/1497458464 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7fdab005bf40 con 0x7fdab40ffc60 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:43:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:43:39.968 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:39.970 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:43:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:43:39.970 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:39.970 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:43:39.970 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:39.971 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 bash[74615]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:39.971 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:39.971 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:39 smithi135 bash[74615]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:43:39.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdaa006e200 msgr2=0x7fdaa00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdaa006e200 0x7fdaa00706b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdab406a640 tx=0x7fdaa4007400 comp rx=0 tx=0).stop 2024-09-10T09:43:39.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 msgr2=0x7fdab4100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:39.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab4100a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdab0006010 tx=0x7fdab000bd70 comp rx=0 tx=0).stop 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 shutdown_connections 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fdaa006e200 0x7fdaa00706b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdab40ff350 0x7fdab4100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 --2- 172.21.15.79:0/1497458464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdab40ffc60 0x7fdab4100a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 >> 172.21.15.79:0/1497458464 conn(0x7fdab40748b0 msgr2=0x7fdab4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 shutdown_connections 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:39.967+0000 7fdabb28c700 1 -- 172.21.15.79:0/1497458464 wait complete. 2024-09-10T09:43:39.972 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:43:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 -- 172.21.15.79:0/1426751292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 msgr2=0x7feaa81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 --2- 172.21.15.79:0/1426751292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa81008b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea98009910 tx=0x7fea98009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:40.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 -- 172.21.15.79:0/1426751292 shutdown_connections 2024-09-10T09:43:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 --2- 172.21.15.79:0/1426751292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa8100e80 0x7feaa8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 --2- 172.21.15.79:0/1426751292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa81008b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 -- 172.21.15.79:0/1426751292 >> 172.21.15.79:0/1426751292 conn(0x7feaa80fbda0 msgr2=0x7feaa80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 -- 172.21.15.79:0/1426751292 shutdown_connections 2024-09-10T09:43:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 -- 172.21.15.79:0/1426751292 wait complete. 2024-09-10T09:43:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 Processor -- start 2024-09-10T09:43:40.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.076+0000 7feaae7e6700 1 -- start start 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaae7e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaae7e6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa8100e80 0x7feaa8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaae7e6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8196b10 con 0x7feaa81004e0 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaae7e6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa819a8a0 con 0x7feaa8100e80 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa8195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58516/0 (socket says 172.21.15.79:58516) 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa7fff700 1 -- 172.21.15.79:0/274419882 learned_addr learned my addr 172.21.15.79:0/274419882 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa77fe700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa8100e80 0x7feaa8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa7fff700 1 -- 172.21.15.79:0/274419882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa8100e80 msgr2=0x7feaa8196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa7fff700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa8100e80 0x7feaa8196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa7fff700 1 -- 172.21.15.79:0/274419882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea980095f0 con 0x7feaa81004e0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa77fe700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa8100e80 0x7feaa8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa7fff700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa8195ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea98006010 tx=0x7fea9800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.077+0000 7feaa57fa700 1 -- 172.21.15.79:0/274419882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9801d070 con 0x7feaa81004e0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.078+0000 7feaa57fa700 1 -- 172.21.15.79:0/274419882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea98004fb0 con 0x7feaa81004e0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.078+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa819ab20 con 0x7feaa81004e0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.078+0000 7feaa57fa700 1 -- 172.21.15.79:0/274419882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9800f690 con 0x7feaa81004e0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.078+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa819b010 con 0x7feaa81004e0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.078+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa81087f0 con 0x7feaa81004e0 2024-09-10T09:43:40.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.079+0000 7feaa57fa700 1 -- 172.21.15.79:0/274419882 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fea980228a0 con 0x7feaa81004e0 2024-09-10T09:43:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.079+0000 7feaa57fa700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fea9006e200 0x7fea900706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.080+0000 7feaa57fa700 1 -- 172.21.15.79:0/274419882 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fea9808f840 con 0x7feaa81004e0 2024-09-10T09:43:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.080+0000 7feaa77fe700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fea9006e200 0x7fea900706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:40.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.080+0000 7feaa77fe700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fea9006e200 0x7fea900706b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea9c005fd0 tx=0x7fea9c005dc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:40.086 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.084+0000 7feaa57fa700 1 -- 172.21.15.79:0/274419882 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fea98058cd0 con 0x7feaa81004e0 2024-09-10T09:43:40.309 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.308+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feaa819b230 con 0x7fea9006e200 2024-09-10T09:43:40.310 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:40 smithi079 ceph-mon[87213]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:40.310 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:40 smithi079 ceph-mon[87213]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:40.310 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:40 smithi079 ceph-mon[87213]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:40.310 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:40 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1606329346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:40.310 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:40 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1497458464' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:43:40.310 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.309+0000 7feaa57fa700 1 -- 172.21.15.79:0/274419882 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7feaa819b230 con 0x7fea9006e200 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "9/23 daemons upgraded", 2024-09-10T09:43:40.311 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T09:43:40.312 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:43:40.312 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:43:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.311+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fea9006e200 msgr2=0x7fea900706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.313 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.311+0000 7feaae7e6700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fea9006e200 0x7fea900706b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea9c005fd0 tx=0x7fea9c005dc0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.311+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 msgr2=0x7feaa8195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.311+0000 7feaae7e6700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa8195ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea98006010 tx=0x7fea9800be20 comp rx=0 tx=0).stop 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.312+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 shutdown_connections 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.312+0000 7feaae7e6700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fea9006e200 0x7fea900706b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.312+0000 7feaae7e6700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaa81004e0 0x7feaa8195ef0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.312+0000 7feaae7e6700 1 --2- 172.21.15.79:0/274419882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feaa8100e80 0x7feaa8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.312+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 >> 172.21.15.79:0/274419882 conn(0x7feaa80fbda0 msgr2=0x7feaa80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.312+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 shutdown_connections 2024-09-10T09:43:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.312+0000 7feaae7e6700 1 -- 172.21.15.79:0/274419882 wait complete. 2024-09-10T09:43:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 -- 172.21.15.79:0/3442325959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc0ffbd0 msgr2=0x7f38bc100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 --2- 172.21.15.79:0/3442325959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc0ffbd0 0x7f38bc100040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009910 tx=0x7f38b0009c20 comp rx=0 tx=0).stop 2024-09-10T09:43:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 -- 172.21.15.79:0/3442325959 shutdown_connections 2024-09-10T09:43:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 --2- 172.21.15.79:0/3442325959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc0ffbd0 0x7f38bc100040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 --2- 172.21.15.79:0/3442325959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc104130 0x7f38bc104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 -- 172.21.15.79:0/3442325959 >> 172.21.15.79:0/3442325959 conn(0x7f38bc075130 msgr2=0x7f38bc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:40.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 -- 172.21.15.79:0/3442325959 shutdown_connections 2024-09-10T09:43:40.419 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.416+0000 7f38c240f700 1 -- 172.21.15.79:0/3442325959 wait complete. 2024-09-10T09:43:40.420 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38c240f700 1 Processor -- start 2024-09-10T09:43:40.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38c240f700 1 -- start start 2024-09-10T09:43:40.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38c240f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0ffbd0 0x7f38bc194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:40.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38c240f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc104130 0x7f38bc195390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:40.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38c240f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc195a70 con 0x7f38bc104130 2024-09-10T09:43:40.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38c240f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc199800 con 0x7f38bc0ffbd0 2024-09-10T09:43:40.421 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38bb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc104130 0x7f38bc195390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38bb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc104130 0x7f38bc195390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58532/0 (socket says 172.21.15.79:58532) 2024-09-10T09:43:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38bb7fe700 1 -- 172.21.15.79:0/2039215223 learned_addr learned my addr 172.21.15.79:0/2039215223 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:43:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38bbfff700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0ffbd0 0x7f38bc194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38bb7fe700 1 -- 172.21.15.79:0/2039215223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0ffbd0 msgr2=0x7f38bc194e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38bb7fe700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0ffbd0 0x7f38bc194e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.422 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.417+0000 7f38bb7fe700 1 -- 172.21.15.79:0/2039215223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b00095f0 con 0x7f38bc104130 2024-09-10T09:43:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.418+0000 7f38bb7fe700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc104130 0x7f38bc195390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f38b0006010 tx=0x7f38b000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.418+0000 7f38b97fa700 1 -- 172.21.15.79:0/2039215223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b001d070 con 0x7f38bc104130 2024-09-10T09:43:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.418+0000 7f38b97fa700 1 -- 172.21.15.79:0/2039215223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38b0004fb0 con 0x7f38bc104130 2024-09-10T09:43:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.418+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc199a80 con 0x7f38bc104130 2024-09-10T09:43:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.418+0000 7f38b97fa700 1 -- 172.21.15.79:0/2039215223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b000f480 con 0x7f38bc104130 2024-09-10T09:43:40.423 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.418+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc199f70 con 0x7f38bc104130 2024-09-10T09:43:40.424 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.419+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc04f2a0 con 0x7f38bc104130 2024-09-10T09:43:40.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.419+0000 7f38b97fa700 1 -- 172.21.15.79:0/2039215223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f38b0022890 con 0x7f38bc104130 2024-09-10T09:43:40.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.420+0000 7f38b97fa700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38a406e200 0x7f38a40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:43:40.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.420+0000 7f38b97fa700 1 -- 172.21.15.79:0/2039215223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f38b008f680 con 0x7f38bc104130 2024-09-10T09:43:40.425 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.420+0000 7f38bbfff700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38a406e200 0x7f38a40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:43:40.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.420+0000 7f38bbfff700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38a406e200 0x7f38a40706b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f38ac006fd0 tx=0x7f38ac008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:43:40.426 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.424+0000 7f38b97fa700 1 -- 172.21.15.79:0/2039215223 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f38b0058bc0 con 0x7f38bc104130 2024-09-10T09:43:40.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-mon[65362]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:40.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-mon[65362]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:40.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-mon[65362]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:40.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1606329346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:40.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1497458464' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:43:40.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.710+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f38bc19a250 con 0x7f38bc104130 2024-09-10T09:43:40.713 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.711+0000 7f38b97fa700 1 -- 172.21.15.79:0/2039215223 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1406 (secure 0 0 0) 0x7f38b005c280 con 0x7f38bc104130 2024-09-10T09:43:40.713 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded 2024-09-10T09:43:40.713 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:43:40.713 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout: osd.3 (root=default,host=smithi135) is down 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-10T09:43:40.714 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-10T09:43:40.715 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-10T09:43:40.716 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-10T09:43:40.716 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-10T09:43:40.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38a406e200 msgr2=0x7f38a40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38a406e200 0x7f38a40706b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f38ac006fd0 tx=0x7f38ac008040 comp rx=0 tx=0).stop 2024-09-10T09:43:40.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc104130 msgr2=0x7f38bc195390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:43:40.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc104130 0x7f38bc195390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f38b0006010 tx=0x7f38b000be20 comp rx=0 tx=0).stop 2024-09-10T09:43:40.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 shutdown_connections 2024-09-10T09:43:40.717 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38a406e200 0x7f38a40706b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38bc0ffbd0 0x7f38bc194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 --2- 172.21.15.79:0/2039215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38bc104130 0x7f38bc195390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:43:40.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 >> 172.21.15.79:0/2039215223 conn(0x7f38bc075130 msgr2=0x7f38bc0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:43:40.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 shutdown_connections 2024-09-10T09:43:40.718 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:43:40.714+0000 7f38c240f700 1 -- 172.21.15.79:0/2039215223 wait complete. 2024-09-10T09:43:40.900 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T09:43:40.900 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 bash[74615]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T09:43:40.900 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T09:43:40.900 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 bash[74615]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-10T09:43:41.161 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T09:43:41.161 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 bash[74615]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 bash[74615]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 bash[74615]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 bash[74615]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate[74630]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 bash[74615]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-10T09:43:41.162 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:40 smithi135 podman[74615]: 2024-09-10 09:43:40.942559032 +0000 UTC m=+1.822779942 container died 6f6dd9cdeed1e625ac4a406b295d534bc245185c12d6f88f1cc33c6951bb1183 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T09:43:41.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:41 smithi079 ceph-mon[87213]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:41.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:41 smithi079 ceph-mon[87213]: Health check failed: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:41.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:41 smithi079 ceph-mon[87213]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:41.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:41 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2039215223' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:43:41.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:41 smithi135 ceph-mon[65362]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:41.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:41 smithi135 ceph-mon[65362]: Health check failed: Degraded data redundancy: 49/222 objects degraded (22.072%), 17 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:41.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:41 smithi135 ceph-mon[65362]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:43:41.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:41 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2039215223' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:43:41.873 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:41 smithi135 podman[74762]: 2024-09-10 09:43:41.569789296 +0000 UTC m=+0.621080700 container remove 6f6dd9cdeed1e625ac4a406b295d534bc245185c12d6f88f1cc33c6951bb1183 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:43:41.873 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:41 smithi135 podman[74823]: 2024-09-10 09:43:41.677075245 +0000 UTC m=+0.015863195 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:43:41.873 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:41 smithi135 podman[74823]: 2024-09-10 09:43:41.795714639 +0000 UTC m=+0.134502589 container create 8c3025b323fcd167c70f2160a56aaab4c09c7653c44eef4cfdf32ce3571608bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T09:43:42.218 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:42 smithi135 podman[74823]: 2024-09-10 09:43:42.073906819 +0000 UTC m=+0.412694768 container init 8c3025b323fcd167c70f2160a56aaab4c09c7653c44eef4cfdf32ce3571608bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T09:43:42.218 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:42 smithi135 podman[74823]: 2024-09-10 09:43:42.077152634 +0000 UTC m=+0.415940584 container start 8c3025b323fcd167c70f2160a56aaab4c09c7653c44eef4cfdf32ce3571608bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T09:43:42.647 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:42 smithi135 bash[74823]: 8c3025b323fcd167c70f2160a56aaab4c09c7653c44eef4cfdf32ce3571608bc 2024-09-10T09:43:42.648 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:42 smithi135 systemd[1]: Started Ceph osd.3 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:43:42.953 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:42 smithi135 ceph-osd[74842]: -- 172.21.15.135:0/3016800186 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be965681e0 con 0x55be95711c00 2024-09-10T09:43:43.624 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:43 smithi135 ceph-mon[65362]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:43.625 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:43 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:43.625 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:43 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:43.625 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:43 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:43.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:43 smithi079 ceph-mon[87213]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:43.769 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:43 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:43.769 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:43 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:43.769 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:43 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:44.967 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:44 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:43:44.525+0000 7f4cd1ddc640 -1 Falling back to public interface 2024-09-10T09:43:45.572 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:45 smithi135 ceph-mon[65362]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:45.572 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:45 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:45.572 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:45 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:45.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:45 smithi079 ceph-mon[87213]: pgmap v115: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:45.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:45 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:45 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:46.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:46 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:46.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:46 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:46.622 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:46 smithi135 ceph-mon[65362]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:46.965 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:46 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:46.965 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:46 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:46.965 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:46 smithi079 ceph-mon[87213]: pgmap v116: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:48.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:48.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:48.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:49.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:49.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:43:50.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:43:50.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:49 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:43:50.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:49 smithi079 ceph-mon[87213]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T09:43:50.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:50.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:43:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:49 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:43:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:49 smithi135 ceph-mon[65362]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-10T09:43:50.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:43:50.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:43:50.854 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:50 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:43:50.567+0000 7f4cd1ddc640 -1 osd.3 0 read_superblock omap replica is missing. 2024-09-10T09:43:51.134 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:50 smithi135 ceph-mon[65362]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:51.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:50 smithi079 ceph-mon[87213]: pgmap v118: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-10T09:43:51.467 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:51 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:43:51.255+0000 7f4cd1ddc640 -1 osd.3 65 log_to_monitors true 2024-09-10T09:43:52.105 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:51 smithi135 ceph-mon[65362]: from='osd.3 [v2:172.21.15.135:6800/3115743255,v1:172.21.15.135:6801/3115743255]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:43:52.105 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:51 smithi135 ceph-mon[65362]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:43:52.106 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:43:51 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:43:51.880+0000 7f4cc9b76640 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:43:52.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:51 smithi079 ceph-mon[87213]: from='osd.3 [v2:172.21.15.135:6800/3115743255,v1:172.21.15.135:6801/3115743255]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:43:52.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:51 smithi079 ceph-mon[87213]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T09:43:53.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:52 smithi079 ceph-mon[87213]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T09:43:53.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:52 smithi079 ceph-mon[87213]: from='osd.3 [v2:172.21.15.135:6800/3115743255,v1:172.21.15.135:6801/3115743255]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:43:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:52 smithi079 ceph-mon[87213]: osdmap e68: 6 total, 5 up, 6 in 2024-09-10T09:43:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:52 smithi079 ceph-mon[87213]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:43:53.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:52 smithi079 ceph-mon[87213]: pgmap v120: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-09-10T09:43:53.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:52 smithi135 ceph-mon[65362]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T09:43:53.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:52 smithi135 ceph-mon[65362]: from='osd.3 [v2:172.21.15.135:6800/3115743255,v1:172.21.15.135:6801/3115743255]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:43:53.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:52 smithi135 ceph-mon[65362]: osdmap e68: 6 total, 5 up, 6 in 2024-09-10T09:43:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:52 smithi135 ceph-mon[65362]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:43:53.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:52 smithi135 ceph-mon[65362]: pgmap v120: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/222 objects degraded (22.072%) 2024-09-10T09:43:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:53 smithi079 ceph-mon[87213]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:43:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:53 smithi079 ceph-mon[87213]: osd.3 [v2:172.21.15.135:6800/3115743255,v1:172.21.15.135:6801/3115743255] boot 2024-09-10T09:43:54.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:53 smithi079 ceph-mon[87213]: osdmap e69: 6 total, 6 up, 6 in 2024-09-10T09:43:54.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:53 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:43:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:53 smithi135 ceph-mon[65362]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:43:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:53 smithi135 ceph-mon[65362]: osd.3 [v2:172.21.15.135:6800/3115743255,v1:172.21.15.135:6801/3115743255] boot 2024-09-10T09:43:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:53 smithi135 ceph-mon[65362]: osdmap e69: 6 total, 6 up, 6 in 2024-09-10T09:43:54.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:53 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T09:43:55.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:54 smithi079 ceph-mon[87213]: osdmap e70: 6 total, 6 up, 6 in 2024-09-10T09:43:55.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:54 smithi079 ceph-mon[87213]: pgmap v123: 65 pgs: 11 peering, 15 active+undersized, 12 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-09-10T09:43:55.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:54 smithi135 ceph-mon[65362]: osdmap e70: 6 total, 6 up, 6 in 2024-09-10T09:43:55.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:54 smithi135 ceph-mon[65362]: pgmap v123: 65 pgs: 11 peering, 15 active+undersized, 12 active+undersized+degraded, 27 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 34/222 objects degraded (15.315%) 2024-09-10T09:43:56.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:55 smithi079 ceph-mon[87213]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:56.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:55 smithi135 ceph-mon[65362]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T09:43:57.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:56 smithi079 ceph-mon[87213]: pgmap v124: 65 pgs: 11 peering, 8 active+undersized, 8 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 24/222 objects degraded (10.811%) 2024-09-10T09:43:57.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:56 smithi135 ceph-mon[65362]: pgmap v124: 65 pgs: 11 peering, 8 active+undersized, 8 active+undersized+degraded, 38 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 24/222 objects degraded (10.811%) 2024-09-10T09:43:58.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:58 smithi079 ceph-mon[87213]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/222 objects degraded (10.811%), 8 pgs degraded) 2024-09-10T09:43:58.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:58 smithi135 ceph-mon[65362]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/222 objects degraded (10.811%), 8 pgs degraded) 2024-09-10T09:43:59.613 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:43:59 smithi079 ceph-mon[87213]: pgmap v125: 65 pgs: 11 peering, 54 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 817 B/s rd, 1 op/s 2024-09-10T09:43:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:43:59 smithi135 ceph-mon[65362]: pgmap v125: 65 pgs: 11 peering, 54 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 817 B/s rd, 1 op/s 2024-09-10T09:44:01.598 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:01 smithi135 ceph-mon[65362]: pgmap v126: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-10T09:44:01.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:01 smithi079 ceph-mon[87213]: pgmap v126: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-09-10T09:44:03.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:03 smithi079 ceph-mon[87213]: pgmap v127: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:44:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:03 smithi135 ceph-mon[65362]: pgmap v127: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:44:04.500 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:44:04.500 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:04.500 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:04.529 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:44:04.529 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:04.529 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:05 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:44:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:05 smithi135 ceph-mon[65362]: Upgrade: osd.4 is safe to restart 2024-09-10T09:44:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:05 smithi135 ceph-mon[65362]: pgmap v128: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 999 B/s rd, 1 op/s 2024-09-10T09:44:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:44:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:05.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:05 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-10T09:44:05.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:05 smithi079 ceph-mon[87213]: Upgrade: osd.4 is safe to restart 2024-09-10T09:44:05.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:05 smithi079 ceph-mon[87213]: pgmap v128: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 999 B/s rd, 1 op/s 2024-09-10T09:44:05.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:05.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T09:44:05.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:06.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:06 smithi135 ceph-mon[65362]: Upgrade: Updating osd.4 2024-09-10T09:44:06.689 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:06 smithi135 ceph-mon[65362]: Deploying daemon osd.4 on smithi135 2024-09-10T09:44:06.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:06 smithi079 ceph-mon[87213]: Upgrade: Updating osd.4 2024-09-10T09:44:06.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:06 smithi079 ceph-mon[87213]: Deploying daemon osd.4 on smithi135 2024-09-10T09:44:07.585 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:07 smithi135 ceph-mon[65362]: pgmap v129: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:44:07.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:07 smithi079 ceph-mon[87213]: pgmap v129: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:44:08.218 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:08 smithi135 systemd[1]: Stopping Ceph osd.4 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:44:08.718 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:08 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[44074]: 2024-09-10T09:44:08.422+0000 7fd02138e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:44:08.718 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:08 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[44074]: 2024-09-10T09:44:08.422+0000 7fd02138e700 -1 osd.4 70 *** Got signal Terminated *** 2024-09-10T09:44:08.718 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:08 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[44074]: 2024-09-10T09:44:08.422+0000 7fd02138e700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:44:09.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:09 smithi079 ceph-mon[87213]: pgmap v130: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:44:09.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:09 smithi079 ceph-mon[87213]: osd.4 marked itself down and dead 2024-09-10T09:44:09.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:09 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:09.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:09 smithi135 ceph-mon[65362]: pgmap v130: 65 pgs: 65 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:44:09.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:09 smithi135 ceph-mon[65362]: osd.4 marked itself down and dead 2024-09-10T09:44:09.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:09 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:10.075 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:09 smithi135 podman[79734]: 2024-09-10 09:44:09.801336683 +0000 UTC m=+1.499243966 container died 1d00abfbbde3b32a8a9c0f8fc4c7f49f9cf703a14f4e88ba4c2ce33c27eeb59a (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, CEPH_POINT_RELEASE=-18.2.0, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux ) 2024-09-10T09:44:10.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:10 smithi135 ceph-mon[65362]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:44:10.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:10 smithi135 ceph-mon[65362]: osdmap e71: 6 total, 5 up, 6 in 2024-09-10T09:44:10.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:10 smithi135 podman[79734]: 2024-09-10 09:44:10.197866442 +0000 UTC m=+1.895773723 container cleanup 1d00abfbbde3b32a8a9c0f8fc4c7f49f9cf703a14f4e88ba4c2ce33c27eeb59a (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, org.label-schema.build-date=20231212, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-09-10T09:44:10.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:10 smithi135 bash[79734]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4 2024-09-10T09:44:10.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:10 smithi079 ceph-mon[87213]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:44:10.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:10 smithi079 ceph-mon[87213]: osdmap e71: 6 total, 5 up, 6 in 2024-09-10T09:44:10.809 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:10 smithi135 podman[79751]: 2024-09-10 09:44:10.500106711 +0000 UTC m=+0.686997239 container remove 1d00abfbbde3b32a8a9c0f8fc4c7f49f9cf703a14f4e88ba4c2ce33c27eeb59a (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, RELEASE=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 -- 172.21.15.79:0/1226160908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 msgr2=0x7f0e081008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 --2- 172.21.15.79:0/1226160908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e081008b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009910 tx=0x7f0df8009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 -- 172.21.15.79:0/1226160908 shutdown_connections 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 --2- 172.21.15.79:0/1226160908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e08100e80 0x7f0e08104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 --2- 172.21.15.79:0/1226160908 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e081008b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 -- 172.21.15.79:0/1226160908 >> 172.21.15.79:0/1226160908 conn(0x7f0e080fbda0 msgr2=0x7f0e080fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 -- 172.21.15.79:0/1226160908 shutdown_connections 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.832+0000 7f0e0e963700 1 -- 172.21.15.79:0/1226160908 wait complete. 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.833+0000 7f0e0e963700 1 Processor -- start 2024-09-10T09:44:10.834 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.833+0000 7f0e0e963700 1 -- start start 2024-09-10T09:44:10.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.833+0000 7f0e0e963700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e08195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:10.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.833+0000 7f0e0e963700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e08100e80 0x7f0e08196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:10.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.833+0000 7f0e0e963700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e08196b10 con 0x7f0e081004e0 2024-09-10T09:44:10.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.833+0000 7f0e0e963700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0819a8a0 con 0x7f0e08100e80 2024-09-10T09:44:10.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e07fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e08195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:10.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e07fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e08195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38212/0 (socket says 172.21.15.79:38212) 2024-09-10T09:44:10.836 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e07fff700 1 -- 172.21.15.79:0/3475089535 learned_addr learned my addr 172.21.15.79:0/3475089535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e077fe700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e08100e80 0x7f0e08196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e07fff700 1 -- 172.21.15.79:0/3475089535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e08100e80 msgr2=0x7f0e08196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e07fff700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e08100e80 0x7f0e08196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e07fff700 1 -- 172.21.15.79:0/3475089535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80095f0 con 0x7f0e081004e0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e07fff700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e08195ef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0df8006010 tx=0x7f0df800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e057fa700 1 -- 172.21.15.79:0/3475089535 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df801d070 con 0x7f0e081004e0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e057fa700 1 -- 172.21.15.79:0/3475089535 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0df8005dc0 con 0x7f0e081004e0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e057fa700 1 -- 172.21.15.79:0/3475089535 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0df8017400 con 0x7f0e081004e0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0819ab20 con 0x7f0e081004e0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.834+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0819b010 con 0x7f0e081004e0 2024-09-10T09:44:10.837 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.835+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e081087f0 con 0x7f0e081004e0 2024-09-10T09:44:10.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.836+0000 7f0e057fa700 1 -- 172.21.15.79:0/3475089535 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0df8003a60 con 0x7f0e081004e0 2024-09-10T09:44:10.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.836+0000 7f0e057fa700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0df406e200 0x7f0df40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:10.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.837+0000 7f0e077fe700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0df406e200 0x7f0df40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:10.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.837+0000 7f0e057fa700 1 -- 172.21.15.79:0/3475089535 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0df808f450 con 0x7f0e081004e0 2024-09-10T09:44:10.838 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.837+0000 7f0e077fe700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0df406e200 0x7f0df40706b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e08197510 tx=0x7f0df000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:10.842 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:10.841+0000 7f0e057fa700 1 -- 172.21.15.79:0/3475089535 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0df80588e0 con 0x7f0e081004e0 2024-09-10T09:44:11.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.065+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e0819b290 con 0x7f0df406e200 2024-09-10T09:44:11.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.066+0000 7f0e057fa700 1 -- 172.21.15.79:0/3475089535 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0e0819b290 con 0x7f0df406e200 2024-09-10T09:44:11.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0df406e200 msgr2=0x7f0df40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0df406e200 0x7f0df40706b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0e08197510 tx=0x7f0df000b410 comp rx=0 tx=0).stop 2024-09-10T09:44:11.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 msgr2=0x7f0e08195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e08195ef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0df8006010 tx=0x7f0df800bd70 comp rx=0 tx=0).stop 2024-09-10T09:44:11.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 shutdown_connections 2024-09-10T09:44:11.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0df406e200 0x7f0df40706b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e081004e0 0x7f0e08195ef0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 --2- 172.21.15.79:0/3475089535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e08100e80 0x7f0e08196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 >> 172.21.15.79:0/3475089535 conn(0x7f0e080fbda0 msgr2=0x7f0e080fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:11.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 shutdown_connections 2024-09-10T09:44:11.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.068+0000 7f0e0e963700 1 -- 172.21.15.79:0/3475089535 wait complete. 2024-09-10T09:44:11.080 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:44:11.146 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:10 smithi135 podman[79842]: 2024-09-10 09:44:10.711836898 +0000 UTC m=+0.015573156 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:44:11.146 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:10 smithi135 podman[79842]: 2024-09-10 09:44:10.809486084 +0000 UTC m=+0.113222339 container create cf92ed203c4cc65aa02ad77115b30c982066e675952bab3b538c0050cb654378 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:44:11.147 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 podman[79842]: 2024-09-10 09:44:11.054406961 +0000 UTC m=+0.358143214 container init cf92ed203c4cc65aa02ad77115b30c982066e675952bab3b538c0050cb654378 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T09:44:11.147 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 podman[79842]: 2024-09-10 09:44:11.057630529 +0000 UTC m=+0.361366787 container start cf92ed203c4cc65aa02ad77115b30c982066e675952bab3b538c0050cb654378 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:44:11.147 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 podman[79842]: 2024-09-10 09:44:11.146105721 +0000 UTC m=+0.449841972 container attach cf92ed203c4cc65aa02ad77115b30c982066e675952bab3b538c0050cb654378 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:44:11.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 -- 172.21.15.79:0/3821740019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 msgr2=0x7f2bdc10a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3821740019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc10a230 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009910 tx=0x7f2bd0009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 -- 172.21.15.79:0/3821740019 shutdown_connections 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3821740019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc10a230 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3821740019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bdc101420 0x7f2bdc1017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 -- 172.21.15.79:0/3821740019 >> 172.21.15.79:0/3821740019 conn(0x7f2bdc0fac60 msgr2=0x7f2bdc0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 -- 172.21.15.79:0/3821740019 shutdown_connections 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.173+0000 7f2be34cd700 1 -- 172.21.15.79:0/3821740019 wait complete. 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be34cd700 1 Processor -- start 2024-09-10T09:44:11.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be34cd700 1 -- start start 2024-09-10T09:44:11.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be34cd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bdc101420 0x7f2bdc0ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be34cd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc0ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be34cd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0ffb00 con 0x7f2bdc101d30 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be34cd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0ffc40 con 0x7f2bdc101420 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be0a68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc0ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be0a68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc0ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38240/0 (socket says 172.21.15.79:38240) 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be0a68700 1 -- 172.21.15.79:0/3796800939 learned_addr learned my addr 172.21.15.79:0/3796800939 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be1269700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bdc101420 0x7f2bdc0ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be0a68700 1 -- 172.21.15.79:0/3796800939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bdc101420 msgr2=0x7f2bdc0ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be0a68700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bdc101420 0x7f2bdc0ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.174+0000 7f2be0a68700 1 -- 172.21.15.79:0/3796800939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00095f0 con 0x7f2bdc101d30 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.175+0000 7f2be0a68700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc0ff5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00092e0 tx=0x7f2bd000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:11.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.175+0000 7f2bda7fc700 1 -- 172.21.15.79:0/3796800939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd001d070 con 0x7f2bdc101d30 2024-09-10T09:44:11.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.175+0000 7f2bda7fc700 1 -- 172.21.15.79:0/3796800939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2bd0005e00 con 0x7f2bdc101d30 2024-09-10T09:44:11.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.175+0000 7f2bda7fc700 1 -- 172.21.15.79:0/3796800939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd0017400 con 0x7f2bdc101d30 2024-09-10T09:44:11.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.175+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc0ffec0 con 0x7f2bdc101d30 2024-09-10T09:44:11.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.175+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc1a2350 con 0x7f2bdc101d30 2024-09-10T09:44:11.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.176+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc1078a0 con 0x7f2bdc101d30 2024-09-10T09:44:11.179 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.177+0000 7f2bda7fc700 1 -- 172.21.15.79:0/3796800939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2bd000f6f0 con 0x7f2bdc101d30 2024-09-10T09:44:11.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.177+0000 7f2bda7fc700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2bc406e200 0x7f2bc40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.177+0000 7f2bda7fc700 1 -- 172.21.15.79:0/3796800939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2bd008f440 con 0x7f2bdc101d30 2024-09-10T09:44:11.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.177+0000 7f2be1269700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2bc406e200 0x7f2bc40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.180 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.178+0000 7f2be1269700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2bc406e200 0x7f2bc40706b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009550 tx=0x7f2bcc0091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:11.182 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.182+0000 7f2bda7fc700 1 -- 172.21.15.79:0/3796800939 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2bd00588d0 con 0x7f2bdc101d30 2024-09-10T09:44:11.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.406+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bdc02cca0 con 0x7f2bc406e200 2024-09-10T09:44:11.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.407+0000 7f2bda7fc700 1 -- 172.21.15.79:0/3796800939 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2bdc02cca0 con 0x7f2bc406e200 2024-09-10T09:44:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2bc406e200 msgr2=0x7f2bc40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2bc406e200 0x7f2bc40706b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009550 tx=0x7f2bcc0091b0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 msgr2=0x7f2bdc0ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc0ff5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00092e0 tx=0x7f2bd000bd70 comp rx=0 tx=0).stop 2024-09-10T09:44:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 shutdown_connections 2024-09-10T09:44:11.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2bc406e200 0x7f2bc40706b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bdc101420 0x7f2bdc0ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 --2- 172.21.15.79:0/3796800939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2bdc101d30 0x7f2bdc0ff5c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 >> 172.21.15.79:0/3796800939 conn(0x7f2bdc0fac60 msgr2=0x7f2bdc1049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 shutdown_connections 2024-09-10T09:44:11.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.409+0000 7f2be34cd700 1 -- 172.21.15.79:0/3796800939 wait complete. 2024-09-10T09:44:11.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:11 smithi079 ceph-mon[87213]: pgmap v132: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-10T09:44:11.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:11 smithi079 ceph-mon[87213]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T09:44:11.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:11 smithi079 ceph-mon[87213]: osdmap e72: 6 total, 5 up, 6 in 2024-09-10T09:44:11.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:11 smithi135 ceph-mon[65362]: pgmap v132: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-10T09:44:11.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:11 smithi135 ceph-mon[65362]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T09:44:11.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:11 smithi135 ceph-mon[65362]: osdmap e72: 6 total, 5 up, 6 in 2024-09-10T09:44:11.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 podman[79842]: 2024-09-10 09:44:11.246085459 +0000 UTC m=+0.549821717 container died cf92ed203c4cc65aa02ad77115b30c982066e675952bab3b538c0050cb654378 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T09:44:11.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1099952569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc4101c90 msgr2=0x7f3bc410a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1099952569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc4101c90 0x7f3bc410a2d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009910 tx=0x7f3bb4009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:11.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1099952569 shutdown_connections 2024-09-10T09:44:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1099952569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc4101c90 0x7f3bc410a2d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1099952569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc41012f0 0x7f3bc41016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1099952569 >> 172.21.15.79:0/1099952569 conn(0x7f3bc40fac80 msgr2=0x7f3bc40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1099952569 shutdown_connections 2024-09-10T09:44:11.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.513+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1099952569 wait complete. 2024-09-10T09:44:11.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.514+0000 7f3bc9d30700 1 Processor -- start 2024-09-10T09:44:11.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.514+0000 7f3bc9d30700 1 -- start start 2024-09-10T09:44:11.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.514+0000 7f3bc9d30700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc41012f0 0x7f3bc41980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.514+0000 7f3bc9d30700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc4101c90 0x7f3bc4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.514+0000 7f3bc9d30700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4198d00 con 0x7f3bc41012f0 2024-09-10T09:44:11.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.514+0000 7f3bc9d30700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc419ca90 con 0x7f3bc4101c90 2024-09-10T09:44:11.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc41012f0 0x7f3bc41980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc41012f0 0x7f3bc41980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38262/0 (socket says 172.21.15.79:38262) 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc37fe700 1 -- 172.21.15.79:0/1690689995 learned_addr learned my addr 172.21.15.79:0/1690689995 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc2ffd700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc4101c90 0x7f3bc4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc37fe700 1 -- 172.21.15.79:0/1690689995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc4101c90 msgr2=0x7f3bc4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc37fe700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc4101c90 0x7f3bc4198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc37fe700 1 -- 172.21.15.79:0/1690689995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40095f0 con 0x7f3bc41012f0 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc37fe700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc41012f0 0x7f3bc41980e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800d8d0 tx=0x7f3bb800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc0ff9700 1 -- 172.21.15.79:0/1690689995 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb80098a0 con 0x7f3bc41012f0 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc419cd70 con 0x7f3bc41012f0 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc0ff9700 1 -- 172.21.15.79:0/1690689995 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bb8010460 con 0x7f3bc41012f0 2024-09-10T09:44:11.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc0ff9700 1 -- 172.21.15.79:0/1690689995 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bb800f5f0 con 0x7f3bc41012f0 2024-09-10T09:44:11.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.515+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc419d2c0 con 0x7f3bc41012f0 2024-09-10T09:44:11.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.516+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc4109e30 con 0x7f3bc41012f0 2024-09-10T09:44:11.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.517+0000 7f3bc0ff9700 1 -- 172.21.15.79:0/1690689995 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3bb8009a00 con 0x7f3bc41012f0 2024-09-10T09:44:11.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.517+0000 7f3bc0ff9700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3bac06e200 0x7f3bac0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.517+0000 7f3bc0ff9700 1 -- 172.21.15.79:0/1690689995 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3bb808ddc0 con 0x7f3bc41012f0 2024-09-10T09:44:11.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.517+0000 7f3bc2ffd700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3bac06e200 0x7f3bac0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.518+0000 7f3bc2ffd700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3bac06e200 0x7f3bac0706b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4199700 tx=0x7f3bb400b540 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:11.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.522+0000 7f3bc0ff9700 1 -- 172.21.15.79:0/1690689995 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3bb80572d0 con 0x7f3bc41012f0 2024-09-10T09:44:11.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.730+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bc419d530 con 0x7f3bac06e200 2024-09-10T09:44:11.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.739+0000 7f3bc0ff9700 1 -- 172.21.15.79:0/1690689995 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3bc419d530 con 0x7f3bac06e200 2024-09-10T09:44:11.740 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:44:11.740 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (5m) 60s ago 16m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:44:11.740 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (16m) 60s ago 16m 8614k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (15m) 26s ago 15m 8170k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (2m) 60s ago 16m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (2m) 26s ago 15m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (5m) 60s ago 15m 83.3M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (10m) 60s ago 10m 17.1M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (10m) 60s ago 10m 97.2M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (10m) 26s ago 10m 151M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (10m) 26s ago 10m 21.0M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (7m) 60s ago 17m 499M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (6m) 26s ago 15m 441M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (3m) 60s ago 17m 50.0M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (3m) 26s ago 15m 41.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (6m) 60s ago 16m 15.3M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (5m) 26s ago 15m 16.0M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:44:11.741 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (2m) 60s ago 14m 101M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:44:11.742 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (102s) 60s ago 13m 104M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:44:11.742 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (66s) 60s ago 13m 12.1M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:44:11.742 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (30s) 26s ago 12m 9.85M 4096M 19.1.1-305-g1cf819b7 41d671128357 8c3025b323fc 2024-09-10T09:44:11.742 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (12m) 26s ago 12m 256M 4096M 18.2.0 dc2bc1663786 1d00abfbbde3 2024-09-10T09:44:11.742 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (12m) 26s ago 12m 255M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:44:11.742 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (5m) 60s ago 15m 79.0M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:44:11.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3bac06e200 msgr2=0x7f3bac0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3bac06e200 0x7f3bac0706b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4199700 tx=0x7f3bb400b540 comp rx=0 tx=0).stop 2024-09-10T09:44:11.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc41012f0 msgr2=0x7f3bc41980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc41012f0 0x7f3bc41980e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800d8d0 tx=0x7f3bb800dbe0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 shutdown_connections 2024-09-10T09:44:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3bac06e200 0x7f3bac0706b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bc41012f0 0x7f3bc41980e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 --2- 172.21.15.79:0/1690689995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bc4101c90 0x7f3bc4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 >> 172.21.15.79:0/1690689995 conn(0x7f3bc40fac80 msgr2=0x7f3bc40ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 shutdown_connections 2024-09-10T09:44:11.744 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.742+0000 7f3bc9d30700 1 -- 172.21.15.79:0/1690689995 wait complete. 2024-09-10T09:44:11.813 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 podman[79865]: 2024-09-10 09:44:11.775785459 +0000 UTC m=+0.523760792 container remove cf92ed203c4cc65aa02ad77115b30c982066e675952bab3b538c0050cb654378 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T09:44:11.813 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-10T09:44:11.814 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 systemd[1]: Stopped Ceph osd.4 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:44:11.814 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.4.service: Consumed 1min 8.679s CPU time. 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.845+0000 7fb6ab14d700 1 -- 172.21.15.79:0/2376853336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ffd60 msgr2=0x7fb6a4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.845+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/2376853336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ffd60 0x7fb6a4103d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb694009910 tx=0x7fb694009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.845+0000 7fb6ab14d700 1 -- 172.21.15.79:0/2376853336 shutdown_connections 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.845+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/2376853336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ffd60 0x7fb6a4103d30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.845+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/2376853336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6a40ff3c0 0x7fb6a40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.845+0000 7fb6ab14d700 1 -- 172.21.15.79:0/2376853336 >> 172.21.15.79:0/2376853336 conn(0x7fb6a40fac80 msgr2=0x7fb6a40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.846+0000 7fb6ab14d700 1 -- 172.21.15.79:0/2376853336 shutdown_connections 2024-09-10T09:44:11.847 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.846+0000 7fb6ab14d700 1 -- 172.21.15.79:0/2376853336 wait complete. 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.846+0000 7fb6ab14d700 1 Processor -- start 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.846+0000 7fb6ab14d700 1 -- start start 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6ab14d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ff3c0 0x7fb6a4194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6ab14d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6a40ffd60 0x7fb6a4195420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6ab14d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4195b00 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6ab14d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a4199890 con 0x7fb6a40ffd60 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6a8ee9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ff3c0 0x7fb6a4194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6a8ee9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ff3c0 0x7fb6a4194ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38272/0 (socket says 172.21.15.79:38272) 2024-09-10T09:44:11.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6a8ee9700 1 -- 172.21.15.79:0/959841500 learned_addr learned my addr 172.21.15.79:0/959841500 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6a8ee9700 1 -- 172.21.15.79:0/959841500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6a40ffd60 msgr2=0x7fb6a4195420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6a8ee9700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6a40ffd60 0x7fb6a4195420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.847+0000 7fb6a8ee9700 1 -- 172.21.15.79:0/959841500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6940095f0 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.848+0000 7fb6a8ee9700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ff3c0 0x7fb6a4194ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00b4b0 tx=0x7fb68c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.848+0000 7fb6a1ffb700 1 -- 172.21.15.79:0/959841500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb68c011800 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.848+0000 7fb6a1ffb700 1 -- 172.21.15.79:0/959841500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb68c011e20 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.848+0000 7fb6a1ffb700 1 -- 172.21.15.79:0/959841500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb68c00f2e0 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.848+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a4199b10 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.848+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a419a060 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.850+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a404f2a0 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.850+0000 7fb6a1ffb700 1 -- 172.21.15.79:0/959841500 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb68c010380 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.850+0000 7fb6a1ffb700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb690070410 0x7fb6900728c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.851+0000 7fb6a1ffb700 1 -- 172.21.15.79:0/959841500 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb68c08daf0 con 0x7fb6a40ff3c0 2024-09-10T09:44:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.851+0000 7fb6a3fff700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb690070410 0x7fb6900728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:11.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.851+0000 7fb6a3fff700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb690070410 0x7fb6900728c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb69400b5c0 tx=0x7fb694005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:11.856 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:11.855+0000 7fb6a1ffb700 1 -- 172.21.15.79:0/959841500 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb68c0570b0 con 0x7fb6a40ff3c0 2024-09-10T09:44:12.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.157+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb6a419a430 con 0x7fb6a40ff3c0 2024-09-10T09:44:12.158 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.157+0000 7fb6a1ffb700 1 -- 172.21.15.79:0/959841500 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+799 (secure 0 0 0) 0x7fb68c05a770 con 0x7fb6a40ff3c0 2024-09-10T09:44:12.159 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:44:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:44:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:44:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:44:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:44:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:44:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-10T09:44:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T09:44:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:44:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:44:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:44:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 5, 2024-09-10T09:44:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 8 2024-09-10T09:44:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:44:12.162 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:44:12.163 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb690070410 msgr2=0x7fb6900728c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb690070410 0x7fb6900728c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb69400b5c0 tx=0x7fb694005960 comp rx=0 tx=0).stop 2024-09-10T09:44:12.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ff3c0 msgr2=0x7fb6a4194ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ff3c0 0x7fb6a4194ee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00b4b0 tx=0x7fb68c00b870 comp rx=0 tx=0).stop 2024-09-10T09:44:12.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 shutdown_connections 2024-09-10T09:44:12.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb690070410 0x7fb6900728c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6a40ff3c0 0x7fb6a4194ee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 --2- 172.21.15.79:0/959841500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6a40ffd60 0x7fb6a4195420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 >> 172.21.15.79:0/959841500 conn(0x7fb6a40fac80 msgr2=0x7fb6a40fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:12.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 shutdown_connections 2024-09-10T09:44:12.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.160+0000 7fb6ab14d700 1 -- 172.21.15.79:0/959841500 wait complete. 2024-09-10T09:44:12.202 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:11 smithi135 systemd[1]: Starting Ceph osd.4 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:44:12.265 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 -- 172.21.15.79:0/525268404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ff350 msgr2=0x7f38fc0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 --2- 172.21.15.79:0/525268404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ff350 0x7f38fc0ff720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009910 tx=0x7f38ec009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 -- 172.21.15.79:0/525268404 shutdown_connections 2024-09-10T09:44:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 --2- 172.21.15.79:0/525268404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38fc0ffc60 0x7f38fc10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 --2- 172.21.15.79:0/525268404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ff350 0x7f38fc0ff720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 -- 172.21.15.79:0/525268404 >> 172.21.15.79:0/525268404 conn(0x7f38fc0748b0 msgr2=0x7f38fc074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 -- 172.21.15.79:0/525268404 shutdown_connections 2024-09-10T09:44:12.266 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.264+0000 7f3900e32700 1 -- 172.21.15.79:0/525268404 wait complete. 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.265+0000 7f3900e32700 1 Processor -- start 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.265+0000 7f3900e32700 1 -- start start 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.265+0000 7f3900e32700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38fc0ff350 0x7f38fc195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.265+0000 7f3900e32700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ffc60 0x7f38fc1963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.265+0000 7f3900e32700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc196a80 con 0x7f38fc0ffc60 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.265+0000 7f3900e32700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc19a810 con 0x7f38fc0ff350 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.265+0000 7f38f9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ffc60 0x7f38fc1963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38f9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ffc60 0x7f38fc1963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47230/0 (socket says 172.21.15.79:47230) 2024-09-10T09:44:12.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38f9d9b700 1 -- 172.21.15.79:0/3909325829 learned_addr learned my addr 172.21.15.79:0/3909325829 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38fa59c700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38fc0ff350 0x7f38fc195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38f9d9b700 1 -- 172.21.15.79:0/3909325829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38fc0ff350 msgr2=0x7f38fc195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38f9d9b700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38fc0ff350 0x7f38fc195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38f9d9b700 1 -- 172.21.15.79:0/3909325829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec0095f0 con 0x7f38fc0ffc60 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38f9d9b700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ffc60 0x7f38fc1963a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38f000e920 tx=0x7f38f000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38eb7fe700 1 -- 172.21.15.79:0/3909325829 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f000c9d0 con 0x7f38fc0ffc60 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38eb7fe700 1 -- 172.21.15.79:0/3909325829 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38f0010430 con 0x7f38fc0ffc60 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc19aaf0 con 0x7f38fc0ffc60 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f38eb7fe700 1 -- 172.21.15.79:0/3909325829 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f0018630 con 0x7f38fc0ffc60 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.266+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc19b040 con 0x7f38fc0ffc60 2024-09-10T09:44:12.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.267+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc107dd0 con 0x7f38fc0ffc60 2024-09-10T09:44:12.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.268+0000 7f38eb7fe700 1 -- 172.21.15.79:0/3909325829 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f38f00105a0 con 0x7f38fc0ffc60 2024-09-10T09:44:12.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.268+0000 7f38eb7fe700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38e406e200 0x7f38e40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.268+0000 7f38eb7fe700 1 -- 172.21.15.79:0/3909325829 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f38f0014070 con 0x7f38fc0ffc60 2024-09-10T09:44:12.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.268+0000 7f38fa59c700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38e406e200 0x7f38e40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.268+0000 7f38fa59c700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38e406e200 0x7f38e40706b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0059d0 tx=0x7f38ec005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:12.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.272+0000 7f38eb7fe700 1 -- 172.21.15.79:0/3909325829 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f38f00541b0 con 0x7f38fc0ffc60 2024-09-10T09:44:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:12 smithi079 ceph-mon[87213]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:12.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:12 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/959841500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:12.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:12 smithi135 ceph-mon[65362]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:12.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:12 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/959841500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:12.467 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 podman[79963]: 2024-09-10 09:44:12.201982519 +0000 UTC m=+0.108859142 container create a6072ef9c910d285c2be66f37a4384945949a4140e52ca82cf4e4a32e23464da (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T09:44:12.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 podman[79963]: 2024-09-10 09:44:12.108661732 +0000 UTC m=+0.015538354 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:44:12.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 podman[79963]: 2024-09-10 09:44:12.422161711 +0000 UTC m=+0.329038326 container init a6072ef9c910d285c2be66f37a4384945949a4140e52ca82cf4e4a32e23464da (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T09:44:12.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 podman[79963]: 2024-09-10 09:44:12.425823613 +0000 UTC m=+0.332700239 container start a6072ef9c910d285c2be66f37a4384945949a4140e52ca82cf4e4a32e23464da (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:44:12.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.518+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f38fc04f2a0 con 0x7f38fc0ffc60 2024-09-10T09:44:12.519 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.518+0000 7f38eb7fe700 1 -- 172.21.15.79:0/3909325829 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f38f0057730 con 0x7f38fc0ffc60 2024-09-10T09:44:12.519 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:44:12.520 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:44:12.521 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:44:12.522 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:44:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:12.523 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38e406e200 msgr2=0x7f38e40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38e406e200 0x7f38e40706b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0059d0 tx=0x7f38ec005940 comp rx=0 tx=0).stop 2024-09-10T09:44:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ffc60 msgr2=0x7f38fc1963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ffc60 0x7f38fc1963a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f38f000e920 tx=0x7f38f000ec30 comp rx=0 tx=0).stop 2024-09-10T09:44:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 shutdown_connections 2024-09-10T09:44:12.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f38e406e200 0x7f38e40706b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38fc0ff350 0x7f38fc195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 --2- 172.21.15.79:0/3909325829 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38fc0ffc60 0x7f38fc1963a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 >> 172.21.15.79:0/3909325829 conn(0x7f38fc0748b0 msgr2=0x7f38fc104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 shutdown_connections 2024-09-10T09:44:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.521+0000 7f3900e32700 1 -- 172.21.15.79:0/3909325829 wait complete. 2024-09-10T09:44:12.525 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 -- 172.21.15.79:0/3589090126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c0ffbd0 msgr2=0x7f949c100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3589090126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c0ffbd0 0x7f949c100040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9498009910 tx=0x7f9498009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 -- 172.21.15.79:0/3589090126 shutdown_connections 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3589090126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c0ffbd0 0x7f949c100040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3589090126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f949c104130 0x7f949c104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 -- 172.21.15.79:0/3589090126 >> 172.21.15.79:0/3589090126 conn(0x7f949c075130 msgr2=0x7f949c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 -- 172.21.15.79:0/3589090126 shutdown_connections 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.626+0000 7f94a46e4700 1 -- 172.21.15.79:0/3589090126 wait complete. 2024-09-10T09:44:12.629 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a46e4700 1 Processor -- start 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a46e4700 1 -- start start 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a46e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f949c0ffbd0 0x7f949c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a46e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c104130 0x7f949c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a46e4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c197800 con 0x7f949c104130 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a46e4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c197940 con 0x7f949c0ffbd0 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a1c7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c104130 0x7f949c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a1c7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c104130 0x7f949c1971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47252/0 (socket says 172.21.15.79:47252) 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a1c7f700 1 -- 172.21.15.79:0/3551965085 learned_addr learned my addr 172.21.15.79:0/3551965085 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a2480700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f949c0ffbd0 0x7f949c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.630 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a1c7f700 1 -- 172.21.15.79:0/3551965085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f949c0ffbd0 msgr2=0x7f949c196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a1c7f700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f949c0ffbd0 0x7f949c196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.627+0000 7f94a1c7f700 1 -- 172.21.15.79:0/3551965085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980095f0 con 0x7f949c104130 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.628+0000 7f94a1c7f700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c104130 0x7f949c1971e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f949800bd70 tx=0x7f949800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.628+0000 7f94937fe700 1 -- 172.21.15.79:0/3551965085 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f949801d070 con 0x7f949c104130 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.628+0000 7f94937fe700 1 -- 172.21.15.79:0/3551965085 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9498005dc0 con 0x7f949c104130 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.628+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949c19fd10 con 0x7f949c104130 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.628+0000 7f94937fe700 1 -- 172.21.15.79:0/3551965085 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9498017400 con 0x7f949c104130 2024-09-10T09:44:12.631 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.628+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949c1a0120 con 0x7f949c104130 2024-09-10T09:44:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.629+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c04f2a0 con 0x7f949c104130 2024-09-10T09:44:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.629+0000 7f94937fe700 1 -- 172.21.15.79:0/3551965085 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f949800f460 con 0x7f949c104130 2024-09-10T09:44:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.630+0000 7f94937fe700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f948806e200 0x7f94880706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.632 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.630+0000 7f94937fe700 1 -- 172.21.15.79:0/3551965085 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f949808f450 con 0x7f949c104130 2024-09-10T09:44:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.630+0000 7f94a2480700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f948806e200 0x7f94880706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.633 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.630+0000 7f94a2480700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f948806e200 0x7f94880706b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f948c005950 tx=0x7f948c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:12.635 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.634+0000 7f94937fe700 1 -- 172.21.15.79:0/3551965085 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f94980589a0 con 0x7f949c104130 2024-09-10T09:44:12.859 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.858+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f949c0ff240 con 0x7f948806e200 2024-09-10T09:44:12.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.860+0000 7f94937fe700 1 -- 172.21.15.79:0/3551965085 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f949c0ff240 con 0x7f948806e200 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "10/23 daemons upgraded", 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T09:44:12.861 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:44:12.862 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f948806e200 msgr2=0x7f94880706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f948806e200 0x7f94880706b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f948c005950 tx=0x7f948c00b410 comp rx=0 tx=0).stop 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c104130 msgr2=0x7f949c1971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c104130 0x7f949c1971e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f949800bd70 tx=0x7f949800bda0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 shutdown_connections 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f948806e200 0x7f94880706b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f949c0ffbd0 0x7f949c196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 --2- 172.21.15.79:0/3551965085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949c104130 0x7f949c1971e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 >> 172.21.15.79:0/3551965085 conn(0x7f949c075130 msgr2=0x7f949c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:12.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 shutdown_connections 2024-09-10T09:44:12.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.862+0000 7f94a46e4700 1 -- 172.21.15.79:0/3551965085 wait complete. 2024-09-10T09:44:12.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 podman[79963]: 2024-09-10 09:44:12.514003814 +0000 UTC m=+0.420880445 container attach a6072ef9c910d285c2be66f37a4384945949a4140e52ca82cf4e4a32e23464da (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:44:12.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:12.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 bash[79963]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:12.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:12.969 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:12 smithi135 bash[79963]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/3379946024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 msgr2=0x7f7cb00ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/3379946024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb00ff380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009910 tx=0x7f7ca4009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/3379946024 shutdown_connections 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/3379946024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb00ff8c0 0x7f7cb010c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/3379946024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb00ff380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/3379946024 >> 172.21.15.79:0/3379946024 conn(0x7f7cb00fac80 msgr2=0x7f7cb00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/3379946024 shutdown_connections 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.967+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/3379946024 wait complete. 2024-09-10T09:44:12.971 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cb4d2d700 1 Processor -- start 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cb4d2d700 1 -- start start 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cb4d2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb0198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cb4d2d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb00ff8c0 0x7f7cb0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cb4d2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0198c30 con 0x7f7cb00fefb0 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cb4d2d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb019c9c0 con 0x7f7cb00ff8c0 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb0198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cae59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb0198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47266/0 (socket says 172.21.15.79:47266) 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cae59c700 1 -- 172.21.15.79:0/332179150 learned_addr learned my addr 172.21.15.79:0/332179150 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cadd9b700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb00ff8c0 0x7f7cb0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cae59c700 1 -- 172.21.15.79:0/332179150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb00ff8c0 msgr2=0x7f7cb0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cae59c700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb00ff8c0 0x7f7cb0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cae59c700 1 -- 172.21.15.79:0/332179150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40095f0 con 0x7f7cb00fefb0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.968+0000 7f7cae59c700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb0198010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4006010 tx=0x7f7ca400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.969+0000 7f7c9f7fe700 1 -- 172.21.15.79:0/332179150 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca401d070 con 0x7f7cb00fefb0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.969+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb019cca0 con 0x7f7cb00fefb0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.969+0000 7f7c9f7fe700 1 -- 172.21.15.79:0/332179150 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ca4005dc0 con 0x7f7cb00fefb0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.969+0000 7f7c9f7fe700 1 -- 172.21.15.79:0/332179150 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ca4017400 con 0x7f7cb00fefb0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.969+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb019d1f0 con 0x7f7cb00fefb0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.970+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb0109d90 con 0x7f7cb00fefb0 2024-09-10T09:44:12.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.970+0000 7f7c9f7fe700 1 -- 172.21.15.79:0/332179150 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7ca4003a60 con 0x7f7cb00fefb0 2024-09-10T09:44:12.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.971+0000 7f7c9f7fe700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7c9806e200 0x7f7c980706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:12.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.971+0000 7f7cadd9b700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7c9806e200 0x7f7c980706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:12.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.971+0000 7f7c9f7fe700 1 -- 172.21.15.79:0/332179150 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7ca408f3f0 con 0x7f7cb00fefb0 2024-09-10T09:44:12.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.971+0000 7f7cadd9b700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7c9806e200 0x7f7c980706b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0199630 tx=0x7f7ca000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:12.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:12.975+0000 7f7c9f7fe700 1 -- 172.21.15.79:0/332179150 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ca4058880 con 0x7f7cb00fefb0 2024-09-10T09:44:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.271+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7cb004f2a0 con 0x7f7cb00fefb0 2024-09-10T09:44:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.271+0000 7f7c9f7fe700 1 -- 172.21.15.79:0/332179150 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+919 (secure 0 0 0) 0x7f7ca405bf40 con 0x7f7cb00fefb0 2024-09-10T09:44:13.272 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 1 pg peering; Degraded data redundancy: 19/222 objects degraded (8.559%), 5 pgs degraded 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: osd.4 (root=default,host=smithi135) is down 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1c is stuck peering for 6m, current state peering, last acting [5,2] 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 19/222 objects degraded (8.559%), 5 pgs degraded 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-10T09:44:13.273 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7c9806e200 msgr2=0x7f7c980706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7c9806e200 0x7f7c980706b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0199630 tx=0x7f7ca000b410 comp rx=0 tx=0).stop 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 msgr2=0x7f7cb0198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb0198010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4006010 tx=0x7f7ca400bd70 comp rx=0 tx=0).stop 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 shutdown_connections 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7c9806e200 0x7f7c980706b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7cb00fefb0 0x7f7cb0198010 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 --2- 172.21.15.79:0/332179150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb00ff8c0 0x7f7cb0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 >> 172.21.15.79:0/332179150 conn(0x7f7cb00fac80 msgr2=0x7f7cb00fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:13.275 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 shutdown_connections 2024-09-10T09:44:13.276 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:13.274+0000 7f7cb4d2d700 1 -- 172.21.15.79:0/332179150 wait complete. 2024-09-10T09:44:13.580 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-mon[65362]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:13.580 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-mon[65362]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:13.580 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-mon[65362]: pgmap v134: 65 pgs: 6 active+undersized, 5 peering, 4 stale+active+clean, 5 active+undersized+degraded, 45 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 19/222 objects degraded (8.559%) 2024-09-10T09:44:13.580 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-mon[65362]: Health check failed: Degraded data redundancy: 19/222 objects degraded (8.559%), 5 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:13.580 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3909325829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:44:13.580 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T09:44:13.580 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 bash[79963]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T09:44:13.580 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T09:44:13.580 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 bash[79963]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-10T09:44:13.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:13 smithi079 ceph-mon[87213]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:13.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:13 smithi079 ceph-mon[87213]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:13.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:13 smithi079 ceph-mon[87213]: pgmap v134: 65 pgs: 6 active+undersized, 5 peering, 4 stale+active+clean, 5 active+undersized+degraded, 45 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 1 op/s; 19/222 objects degraded (8.559%) 2024-09-10T09:44:13.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:13 smithi079 ceph-mon[87213]: Health check failed: Degraded data redundancy: 19/222 objects degraded (8.559%), 5 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:13.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:13 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3909325829' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 bash[79963]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 bash[79963]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 bash[79963]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T09:44:13.893 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 bash[79963]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T09:44:13.894 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate[79978]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-10T09:44:13.894 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 bash[79963]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-10T09:44:13.894 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:13 smithi135 podman[79963]: 2024-09-10 09:44:13.608832824 +0000 UTC m=+1.515709448 container died a6072ef9c910d285c2be66f37a4384945949a4140e52ca82cf4e4a32e23464da (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T09:44:14.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:14 smithi135 ceph-mon[65362]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:14.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:14 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/332179150' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:44:14.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 podman[80124]: 2024-09-10 09:44:14.19384622 +0000 UTC m=+0.574704023 container remove a6072ef9c910d285c2be66f37a4384945949a4140e52ca82cf4e4a32e23464da (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T09:44:14.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 podman[80185]: 2024-09-10 09:44:14.302532279 +0000 UTC m=+0.015427362 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:44:14.468 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 podman[80185]: 2024-09-10 09:44:14.420183713 +0000 UTC m=+0.133078841 container create 05ee4cd92ec305501199edd55cbc4703453e2754e7b4dac1965ee12d427dcd65 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T09:44:14.639 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:14 smithi079 ceph-mon[87213]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:14.639 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:14 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/332179150' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:44:14.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 podman[80185]: 2024-09-10 09:44:14.639893749 +0000 UTC m=+0.352788833 container init 05ee4cd92ec305501199edd55cbc4703453e2754e7b4dac1965ee12d427dcd65 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:44:14.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 podman[80185]: 2024-09-10 09:44:14.643332319 +0000 UTC m=+0.356227405 container start 05ee4cd92ec305501199edd55cbc4703453e2754e7b4dac1965ee12d427dcd65 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T09:44:14.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 ceph-osd[80204]: -- 172.21.15.135:0/2592908890 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55898149c1e0 con 0x5589806b1c00 2024-09-10T09:44:14.969 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 bash[80185]: 05ee4cd92ec305501199edd55cbc4703453e2754e7b4dac1965ee12d427dcd65 2024-09-10T09:44:14.969 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:14 smithi135 systemd[1]: Started Ceph osd.4 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:44:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:15 smithi079 ceph-mon[87213]: pgmap v135: 65 pgs: 15 active+undersized, 5 peering, 1 stale+active+clean, 12 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 33/222 objects degraded (14.865%) 2024-09-10T09:44:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:15.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:15.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:15 smithi135 ceph-mon[65362]: pgmap v135: 65 pgs: 15 active+undersized, 5 peering, 1 stale+active+clean, 12 active+undersized+degraded, 32 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s; 33/222 objects degraded (14.865%) 2024-09-10T09:44:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:16.711 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:16 smithi135 ceph-mon[65362]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T09:44:16.711 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:16 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:44:16.535+0000 7f97b28e8640 -1 Falling back to public interface 2024-09-10T09:44:16.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:16 smithi079 ceph-mon[87213]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T09:44:17.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:17 smithi079 ceph-mon[87213]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:17 smithi135 ceph-mon[65362]: pgmap v136: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:18.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:18 smithi079 ceph-mon[87213]: Health check update: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:18.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:18 smithi079 ceph-mon[87213]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 230 B/s rd, 0 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:18.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:18 smithi135 ceph-mon[65362]: Health check update: Degraded data redundancy: 37/222 objects degraded (16.667%), 14 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:18.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:18.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:18 smithi135 ceph-mon[65362]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 230 B/s rd, 0 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:20.143 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:20.144 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:20.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:20.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:21.249 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:21 smithi135 ceph-mon[65362]: pgmap v138: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:21 smithi079 ceph-mon[87213]: pgmap v138: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:22.349 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:44:22.210+0000 7f97b28e8640 -1 osd.4 0 read_superblock omap replica is missing. 2024-09-10T09:44:22.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T09:44:22.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-mon[65362]: pgmap v139: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 604 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:22.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:22.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-10T09:44:22.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:22 smithi079 ceph-mon[87213]: pgmap v139: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 604 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:23.217 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:22 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:44:22.727+0000 7f97b28e8640 -1 osd.4 70 log_to_monitors true 2024-09-10T09:44:23.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:23 smithi079 ceph-mon[87213]: from='osd.4 [v2:172.21.15.135:6808/2589808146,v1:172.21.15.135:6809/2589808146]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:44:23.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:23 smithi079 ceph-mon[87213]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:44:23.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:23 smithi135 ceph-mon[65362]: from='osd.4 [v2:172.21.15.135:6808/2589808146,v1:172.21.15.135:6809/2589808146]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:44:23.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:23 smithi135 ceph-mon[65362]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T09:44:24.717 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:44:24 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:44:24.461+0000 7f97a667a640 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:44:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:24 smithi135 ceph-mon[65362]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T09:44:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:24 smithi135 ceph-mon[65362]: osdmap e73: 6 total, 5 up, 6 in 2024-09-10T09:44:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:24 smithi135 ceph-mon[65362]: from='osd.4 [v2:172.21.15.135:6808/2589808146,v1:172.21.15.135:6809/2589808146]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:24 smithi135 ceph-mon[65362]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:24 smithi135 ceph-mon[65362]: pgmap v141: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:24.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:24 smithi135 ceph-mon[65362]: from='osd.4 ' entity='osd.4' 2024-09-10T09:44:24.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:24 smithi079 ceph-mon[87213]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T09:44:24.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:24 smithi079 ceph-mon[87213]: osdmap e73: 6 total, 5 up, 6 in 2024-09-10T09:44:24.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:24 smithi079 ceph-mon[87213]: from='osd.4 [v2:172.21.15.135:6808/2589808146,v1:172.21.15.135:6809/2589808146]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:24.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:24 smithi079 ceph-mon[87213]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:24.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:24 smithi079 ceph-mon[87213]: pgmap v141: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:24.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:24 smithi079 ceph-mon[87213]: from='osd.4 ' entity='osd.4' 2024-09-10T09:44:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:25 smithi079 ceph-mon[87213]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:44:25.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:25 smithi079 ceph-mon[87213]: osd.4 [v2:172.21.15.135:6808/2589808146,v1:172.21.15.135:6809/2589808146] boot 2024-09-10T09:44:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:25 smithi079 ceph-mon[87213]: osdmap e74: 6 total, 6 up, 6 in 2024-09-10T09:44:25.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:25 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:44:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:25 smithi135 ceph-mon[65362]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:44:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:25 smithi135 ceph-mon[65362]: osd.4 [v2:172.21.15.135:6808/2589808146,v1:172.21.15.135:6809/2589808146] boot 2024-09-10T09:44:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:25 smithi135 ceph-mon[65362]: osdmap e74: 6 total, 6 up, 6 in 2024-09-10T09:44:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:25 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T09:44:26.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:26 smithi079 ceph-mon[87213]: pgmap v143: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:26.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:26 smithi079 ceph-mon[87213]: osdmap e75: 6 total, 6 up, 6 in 2024-09-10T09:44:26.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:26 smithi135 ceph-mon[65362]: pgmap v143: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 202 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 37/222 objects degraded (16.667%) 2024-09-10T09:44:26.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:26 smithi135 ceph-mon[65362]: osdmap e75: 6 total, 6 up, 6 in 2024-09-10T09:44:28.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:28 smithi079 ceph-mon[87213]: Health check update: Degraded data redundancy: 18/222 objects degraded (8.108%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:28.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:28 smithi135 ceph-mon[65362]: Health check update: Degraded data redundancy: 18/222 objects degraded (8.108%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:29.613 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:29 smithi079 ceph-mon[87213]: pgmap v145: 65 pgs: 15 active+undersized, 9 active+undersized+degraded, 41 active+clean; 202 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 18/222 objects degraded (8.108%) 2024-09-10T09:44:29.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:29 smithi135 ceph-mon[65362]: pgmap v145: 65 pgs: 15 active+undersized, 9 active+undersized+degraded, 41 active+clean; 202 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 18/222 objects degraded (8.108%) 2024-09-10T09:44:30.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:30 smithi079 ceph-mon[87213]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/222 objects degraded (8.108%), 9 pgs degraded) 2024-09-10T09:44:30.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:30 smithi135 ceph-mon[65362]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/222 objects degraded (8.108%), 9 pgs degraded) 2024-09-10T09:44:31.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:31 smithi079 ceph-mon[87213]: pgmap v146: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 1 op/s 2024-09-10T09:44:31.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:31 smithi135 ceph-mon[65362]: pgmap v146: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 1 op/s 2024-09-10T09:44:33.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:33 smithi079 ceph-mon[87213]: pgmap v147: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-10T09:44:33.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:33 smithi135 ceph-mon[65362]: pgmap v147: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-10T09:44:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:35 smithi079 ceph-mon[87213]: pgmap v148: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 943 B/s rd, 1 op/s 2024-09-10T09:44:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:35 smithi135 ceph-mon[65362]: pgmap v148: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 943 B/s rd, 1 op/s 2024-09-10T09:44:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:35.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:37.345 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:37 smithi135 ceph-mon[65362]: pgmap v149: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-10T09:44:37.345 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:37 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:37.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:37 smithi079 ceph-mon[87213]: pgmap v149: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-09-10T09:44:37.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:37 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:38.426 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:38 smithi135 ceph-mon[65362]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:38.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:38 smithi135 ceph-mon[65362]: Upgrade: osd.5 is safe to restart 2024-09-10T09:44:38.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:38.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T09:44:38.427 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:38 smithi079 ceph-mon[87213]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-10T09:44:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:38 smithi079 ceph-mon[87213]: Upgrade: osd.5 is safe to restart 2024-09-10T09:44:38.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:38.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T09:44:38.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:39.409 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:39 smithi135 ceph-mon[65362]: Upgrade: Updating osd.5 2024-09-10T09:44:39.409 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:39 smithi135 ceph-mon[65362]: Deploying daemon osd.5 on smithi135 2024-09-10T09:44:39.409 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:39 smithi135 ceph-mon[65362]: pgmap v150: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:44:39.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:39 smithi079 ceph-mon[87213]: Upgrade: Updating osd.5 2024-09-10T09:44:39.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:39 smithi079 ceph-mon[87213]: Deploying daemon osd.5 on smithi135 2024-09-10T09:44:39.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:39 smithi079 ceph-mon[87213]: pgmap v150: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:44:40.266 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:40.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:41.274 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:41 smithi135 ceph-mon[65362]: pgmap v151: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:44:41.274 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:40 smithi135 systemd[1]: Stopping Ceph osd.5 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:44:41.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:41 smithi079 ceph-mon[87213]: pgmap v151: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:44:41.717 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:41 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[48730]: 2024-09-10T09:44:41.272+0000 7fe001d81700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:44:41.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:41 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[48730]: 2024-09-10T09:44:41.272+0000 7fe001d81700 -1 osd.5 75 *** Got signal Terminated *** 2024-09-10T09:44:41.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:41 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[48730]: 2024-09-10T09:44:41.272+0000 7fe001d81700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:44:42.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:42 smithi079 ceph-mon[87213]: osd.5 marked itself down and dead 2024-09-10T09:44:42.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:42 smithi135 ceph-mon[65362]: osd.5 marked itself down and dead 2024-09-10T09:44:42.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:42 smithi135 podman[84813]: 2024-09-10 09:44:42.671701122 +0000 UTC m=+1.523735728 container died c490bd3ac70abf1bd4232f82a8b2c8da2f53ea14f0ab95ab897192fb20786bf5 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20231212, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T09:44:43.334 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:43 smithi135 ceph-mon[65362]: pgmap v152: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:44:43.334 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:43 smithi135 ceph-mon[65362]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:44:43.334 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:43 smithi135 ceph-mon[65362]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-10T09:44:43.334 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:43 smithi135 ceph-mon[65362]: osdmap e76: 6 total, 5 up, 6 in 2024-09-10T09:44:43.334 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 podman[84813]: 2024-09-10 09:44:43.048134964 +0000 UTC m=+1.900169561 container cleanup c490bd3ac70abf1bd4232f82a8b2c8da2f53ea14f0ab95ab897192fb20786bf5 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.build-date=20231212, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=HEAD, GIT_BRANCH=HEAD) 2024-09-10T09:44:43.335 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 bash[84813]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5 2024-09-10T09:44:43.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 -- 172.21.15.79:0/3160974796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ff3c0 msgr2=0x7f34b80ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 --2- 172.21.15.79:0/3160974796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ff3c0 0x7f34b80ff790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34a8009910 tx=0x7f34a8009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:43.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 -- 172.21.15.79:0/3160974796 shutdown_connections 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 --2- 172.21.15.79:0/3160974796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34b80ffd60 0x7f34b8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 --2- 172.21.15.79:0/3160974796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ff3c0 0x7f34b80ff790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 -- 172.21.15.79:0/3160974796 >> 172.21.15.79:0/3160974796 conn(0x7f34b80fac60 msgr2=0x7f34b80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 -- 172.21.15.79:0/3160974796 shutdown_connections 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.383+0000 7f34be17d700 1 -- 172.21.15.79:0/3160974796 wait complete. 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34be17d700 1 Processor -- start 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34be17d700 1 -- start start 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34be17d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34b80ff3c0 0x7f34b8195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34be17d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ffd60 0x7f34b81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34be17d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b8196a80 con 0x7f34b80ffd60 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34be17d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b819a810 con 0x7f34b80ff3c0 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34aeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ffd60 0x7f34b81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:43.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34aeffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ffd60 0x7f34b81963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33876/0 (socket says 172.21.15.79:33876) 2024-09-10T09:44:43.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34aeffd700 1 -- 172.21.15.79:0/4016440566 learned_addr learned my addr 172.21.15.79:0/4016440566 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:43.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34b77fe700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34b80ff3c0 0x7f34b8195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:43.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34aeffd700 1 -- 172.21.15.79:0/4016440566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34b80ff3c0 msgr2=0x7f34b8195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.384+0000 7f34aeffd700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34b80ff3c0 0x7f34b8195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.385+0000 7f34aeffd700 1 -- 172.21.15.79:0/4016440566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80095f0 con 0x7f34b80ffd60 2024-09-10T09:44:43.387 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.385+0000 7f34aeffd700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ffd60 0x7f34b81963a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34a000d900 tx=0x7f34a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.385+0000 7f34b57fa700 1 -- 172.21.15.79:0/4016440566 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a0009900 con 0x7f34b80ffd60 2024-09-10T09:44:43.388 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.385+0000 7f34b57fa700 1 -- 172.21.15.79:0/4016440566 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34a0010460 con 0x7f34b80ffd60 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.385+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b819aaf0 con 0x7f34b80ffd60 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.385+0000 7f34b57fa700 1 -- 172.21.15.79:0/4016440566 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a000f5f0 con 0x7f34b80ffd60 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.385+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b819b040 con 0x7f34b80ffd60 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.386+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b81086e0 con 0x7f34b80ffd60 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.386+0000 7f34b57fa700 1 -- 172.21.15.79:0/4016440566 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f34a00105d0 con 0x7f34b80ffd60 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.387+0000 7f34b57fa700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f34a406e200 0x7f34a40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.387+0000 7f34b57fa700 1 -- 172.21.15.79:0/4016440566 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f34a008dbb0 con 0x7f34b80ffd60 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.387+0000 7f34b77fe700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f34a406e200 0x7f34a40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:43.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.387+0000 7f34b77fe700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f34a406e200 0x7f34a40706b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34a8006010 tx=0x7f34a801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:43.392 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.391+0000 7f34b57fa700 1 -- 172.21.15.79:0/4016440566 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f34a0094080 con 0x7f34b80ffd60 2024-09-10T09:44:43.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:43 smithi079 ceph-mon[87213]: pgmap v152: 65 pgs: 65 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:44:43.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:43 smithi079 ceph-mon[87213]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-10T09:44:43.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:43 smithi079 ceph-mon[87213]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-10T09:44:43.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:43 smithi079 ceph-mon[87213]: osdmap e76: 6 total, 5 up, 6 in 2024-09-10T09:44:43.617 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.616+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f34b819b260 con 0x7f34a406e200 2024-09-10T09:44:43.618 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.618+0000 7f34b57fa700 1 -- 172.21.15.79:0/4016440566 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f34b819b260 con 0x7f34a406e200 2024-09-10T09:44:43.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f34a406e200 msgr2=0x7f34a40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f34a406e200 0x7f34a40706b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34a8006010 tx=0x7f34a801a040 comp rx=0 tx=0).stop 2024-09-10T09:44:43.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ffd60 msgr2=0x7f34b81963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ffd60 0x7f34b81963a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f34a000d900 tx=0x7f34a000dc10 comp rx=0 tx=0).stop 2024-09-10T09:44:43.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 shutdown_connections 2024-09-10T09:44:43.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f34a406e200 0x7f34a40706b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f34b80ff3c0 0x7f34b8195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 --2- 172.21.15.79:0/4016440566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f34b80ffd60 0x7f34b81963a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 >> 172.21.15.79:0/4016440566 conn(0x7f34b80fac60 msgr2=0x7f34b8069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:43.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 shutdown_connections 2024-09-10T09:44:43.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.620+0000 7f34be17d700 1 -- 172.21.15.79:0/4016440566 wait complete. 2024-09-10T09:44:43.632 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:44:43.658 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 podman[84829]: 2024-09-10 09:44:43.333452176 +0000 UTC m=+0.657799610 container remove c490bd3ac70abf1bd4232f82a8b2c8da2f53ea14f0ab95ab897192fb20786bf5 (image=quay.io/ceph/ceph@sha256:1793ff3af6ae74527c86e1a0b22401e9c42dc08d0ebb8379653be07db17d0007, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=0396eef90bef641b676c164ec7a3876f45010308, ceph=True, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20231212, CEPH_POINT_RELEASE=-18.2.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.license=GPLv2) 2024-09-10T09:44:43.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 -- 172.21.15.79:0/907086385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 msgr2=0x7f74800ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 --2- 172.21.15.79:0/907086385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f74800ff790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7470009910 tx=0x7f7470009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:43.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 -- 172.21.15.79:0/907086385 shutdown_connections 2024-09-10T09:44:43.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 --2- 172.21.15.79:0/907086385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74800ffd60 0x7f7480103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 --2- 172.21.15.79:0/907086385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f74800ff790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 -- 172.21.15.79:0/907086385 >> 172.21.15.79:0/907086385 conn(0x7f74800fac80 msgr2=0x7f74800fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:43.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 -- 172.21.15.79:0/907086385 shutdown_connections 2024-09-10T09:44:43.728 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.726+0000 7f7484cb5700 1 -- 172.21.15.79:0/907086385 wait complete. 2024-09-10T09:44:43.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f7484cb5700 1 Processor -- start 2024-09-10T09:44:43.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f7484cb5700 1 -- start start 2024-09-10T09:44:43.729 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f7484cb5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f7480196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f7484cb5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74800ffd60 0x7f7480197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f7484cb5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7480197830 con 0x7f74800ff3c0 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f7484cb5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74801979a0 con 0x7f74800ffd60 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f747e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f7480196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f747e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f7480196cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33902/0 (socket says 172.21.15.79:33902) 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f747e59c700 1 -- 172.21.15.79:0/4096144035 learned_addr learned my addr 172.21.15.79:0/4096144035 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f7477fff700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74800ffd60 0x7f7480197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f747e59c700 1 -- 172.21.15.79:0/4096144035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74800ffd60 msgr2=0x7f7480197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f747e59c700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74800ffd60 0x7f7480197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.727+0000 7f747e59c700 1 -- 172.21.15.79:0/4096144035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700095f0 con 0x7f74800ff3c0 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.728+0000 7f747e59c700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f7480196cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7470006010 tx=0x7f747000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:43.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.728+0000 7f74777fe700 1 -- 172.21.15.79:0/4096144035 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747001d070 con 0x7f74800ff3c0 2024-09-10T09:44:43.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.728+0000 7f74777fe700 1 -- 172.21.15.79:0/4096144035 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7470005dc0 con 0x7f74800ff3c0 2024-09-10T09:44:43.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.728+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748019fd40 con 0x7f74800ff3c0 2024-09-10T09:44:43.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.728+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74801a01b0 con 0x7f74800ff3c0 2024-09-10T09:44:43.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.728+0000 7f74777fe700 1 -- 172.21.15.79:0/4096144035 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7470017400 con 0x7f74800ff3c0 2024-09-10T09:44:43.731 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.729+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74801076d0 con 0x7f74800ff3c0 2024-09-10T09:44:43.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.729+0000 7f74777fe700 1 -- 172.21.15.79:0/4096144035 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7470003a60 con 0x7f74800ff3c0 2024-09-10T09:44:43.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.730+0000 7f74777fe700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f746c06e200 0x7f746c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:43.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.730+0000 7f74777fe700 1 -- 172.21.15.79:0/4096144035 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f747008f440 con 0x7f74800ff3c0 2024-09-10T09:44:43.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.730+0000 7f7477fff700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f746c06e200 0x7f746c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:43.732 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.730+0000 7f7477fff700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f746c06e200 0x7f746c0706b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74800696a0 tx=0x7f746800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:43.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.734+0000 7f74777fe700 1 -- 172.21.15.79:0/4096144035 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f74700588d0 con 0x7f74800ff3c0 2024-09-10T09:44:43.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.957+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7480061190 con 0x7f746c06e200 2024-09-10T09:44:43.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.958+0000 7f74777fe700 1 -- 172.21.15.79:0/4096144035 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7480061190 con 0x7f746c06e200 2024-09-10T09:44:43.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f746c06e200 msgr2=0x7f746c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f746c06e200 0x7f746c0706b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f74800696a0 tx=0x7f746800b410 comp rx=0 tx=0).stop 2024-09-10T09:44:43.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 msgr2=0x7f7480196cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:43.961 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f7480196cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7470006010 tx=0x7f747000bd70 comp rx=0 tx=0).stop 2024-09-10T09:44:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 shutdown_connections 2024-09-10T09:44:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f746c06e200 0x7f746c0706b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74800ff3c0 0x7f7480196cd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 --2- 172.21.15.79:0/4096144035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74800ffd60 0x7f7480197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 >> 172.21.15.79:0/4096144035 conn(0x7f74800fac80 msgr2=0x7f74800fc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 shutdown_connections 2024-09-10T09:44:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:43.960+0000 7f7484cb5700 1 -- 172.21.15.79:0/4096144035 wait complete. 2024-09-10T09:44:43.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 podman[84922]: 2024-09-10 09:44:43.560458248 +0000 UTC m=+0.016066814 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:44:43.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 podman[84922]: 2024-09-10 09:44:43.676363036 +0000 UTC m=+0.131971589 container create 90de75e439272e019bac425cc345fa4992161b094a4fb0d09e5b362d2b22bb12 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T09:44:43.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 podman[84922]: 2024-09-10 09:44:43.895931161 +0000 UTC m=+0.351539717 container init 90de75e439272e019bac425cc345fa4992161b094a4fb0d09e5b362d2b22bb12 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T09:44:43.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 podman[84922]: 2024-09-10 09:44:43.899310752 +0000 UTC m=+0.354919312 container start 90de75e439272e019bac425cc345fa4992161b094a4fb0d09e5b362d2b22bb12 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.065+0000 7fce66381700 1 -- 172.21.15.79:0/1955573788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 msgr2=0x7fce601008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.065+0000 7fce66381700 1 --2- 172.21.15.79:0/1955573788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce601008b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fce50009910 tx=0x7fce50009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.065+0000 7fce66381700 1 -- 172.21.15.79:0/1955573788 shutdown_connections 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.065+0000 7fce66381700 1 --2- 172.21.15.79:0/1955573788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce60100e80 0x7fce60104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.065+0000 7fce66381700 1 --2- 172.21.15.79:0/1955573788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce601008b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.065+0000 7fce66381700 1 -- 172.21.15.79:0/1955573788 >> 172.21.15.79:0/1955573788 conn(0x7fce600fbda0 msgr2=0x7fce600fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 -- 172.21.15.79:0/1955573788 shutdown_connections 2024-09-10T09:44:44.069 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 -- 172.21.15.79:0/1955573788 wait complete. 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 Processor -- start 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 -- start start 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce60195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce60100e80 0x7fce60196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce60196b10 con 0x7fce601004e0 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce66381700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6019a8a0 con 0x7fce60100e80 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce5ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce60195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.066+0000 7fce5ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce60195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33930/0 (socket says 172.21.15.79:33930) 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5ffff700 1 -- 172.21.15.79:0/1244310219 learned_addr learned my addr 172.21.15.79:0/1244310219 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce57fff700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce60100e80 0x7fce60196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5ffff700 1 -- 172.21.15.79:0/1244310219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce60100e80 msgr2=0x7fce60196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.070 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5ffff700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce60100e80 0x7fce60196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5ffff700 1 -- 172.21.15.79:0/1244310219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce500095f0 con 0x7fce601004e0 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5ffff700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce60195ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce50006010 tx=0x7fce5000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5dffb700 1 -- 172.21.15.79:0/1244310219 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce5001d070 con 0x7fce601004e0 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5dffb700 1 -- 172.21.15.79:0/1244310219 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce50005dc0 con 0x7fce601004e0 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6019ab20 con 0x7fce601004e0 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce5dffb700 1 -- 172.21.15.79:0/1244310219 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce50017400 con 0x7fce601004e0 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.067+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6019b010 con 0x7fce601004e0 2024-09-10T09:44:44.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.068+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce601087f0 con 0x7fce601004e0 2024-09-10T09:44:44.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.069+0000 7fce5dffb700 1 -- 172.21.15.79:0/1244310219 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fce50003a60 con 0x7fce601004e0 2024-09-10T09:44:44.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.069+0000 7fce5dffb700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fce4c06e200 0x7fce4c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.069+0000 7fce57fff700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fce4c06e200 0x7fce4c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.069+0000 7fce5dffb700 1 -- 172.21.15.79:0/1244310219 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fce5008f3a0 con 0x7fce601004e0 2024-09-10T09:44:44.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.070+0000 7fce57fff700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fce4c06e200 0x7fce4c0706b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce60197510 tx=0x7fce4800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:44.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.074+0000 7fce5dffb700 1 -- 172.21.15.79:0/1244310219 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fce500588b0 con 0x7fce601004e0 2024-09-10T09:44:44.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:44 smithi079 ceph-mon[87213]: osdmap e77: 6 total, 5 up, 6 in 2024-09-10T09:44:44.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.288+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce6019b280 con 0x7fce4c06e200 2024-09-10T09:44:44.298 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.297+0000 7fce5dffb700 1 -- 172.21.15.79:0/1244310219 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fce6019b280 con 0x7fce4c06e200 2024-09-10T09:44:44.298 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:44:44.298 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (5m) 93s ago 16m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:44:44.298 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (16m) 93s ago 16m 8614k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (15m) 26s ago 15m 8468k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (3m) 93s ago 16m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (3m) 26s ago 15m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (5m) 93s ago 16m 83.3M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (11m) 93s ago 11m 17.1M - 18.2.0 dc2bc1663786 c332534bb7b3 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (11m) 93s ago 11m 97.2M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (11m) 26s ago 11m 151M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (11m) 26s ago 11m 21.2M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (7m) 93s ago 18m 499M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (6m) 26s ago 15m 441M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (4m) 93s ago 18m 50.0M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (3m) 26s ago 15m 41.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:44:44.299 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (6m) 93s ago 16m 15.3M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (6m) 26s ago 15m 16.0M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (2m) 93s ago 14m 101M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (2m) 93s ago 14m 104M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (98s) 93s ago 13m 12.1M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (62s) 26s ago 13m 105M 4096M 19.1.1-305-g1cf819b7 41d671128357 8c3025b323fc 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (29s) 26s ago 13m 11.3M 4096M 19.1.1-305-g1cf819b7 41d671128357 05ee4cd92ec3 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (12m) 26s ago 12m 255M 4096M 18.2.0 dc2bc1663786 c490bd3ac70a 2024-09-10T09:44:44.300 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (6m) 93s ago 16m 79.0M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fce4c06e200 msgr2=0x7fce4c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fce4c06e200 0x7fce4c0706b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce60197510 tx=0x7fce4800b410 comp rx=0 tx=0).stop 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 msgr2=0x7fce60195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce60195ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce50006010 tx=0x7fce5000bd70 comp rx=0 tx=0).stop 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 shutdown_connections 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fce4c06e200 0x7fce4c0706b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce601004e0 0x7fce60195ef0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 --2- 172.21.15.79:0/1244310219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce60100e80 0x7fce60196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 >> 172.21.15.79:0/1244310219 conn(0x7fce600fbda0 msgr2=0x7fce600fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:44.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 shutdown_connections 2024-09-10T09:44:44.302 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.300+0000 7fce66381700 1 -- 172.21.15.79:0/1244310219 wait complete. 2024-09-10T09:44:44.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 -- 172.21.15.79:0/3972840517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc40687a0 msgr2=0x7fabc4068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3972840517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc40687a0 0x7fabc4068b70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009910 tx=0x7fabb4009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 -- 172.21.15.79:0/3972840517 shutdown_connections 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3972840517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc4069140 0x7fabc4104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3972840517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc40687a0 0x7fabc4068b70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 -- 172.21.15.79:0/3972840517 >> 172.21.15.79:0/3972840517 conn(0x7fabc4075130 msgr2=0x7fabc4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 -- 172.21.15.79:0/3972840517 shutdown_connections 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.403+0000 7fabc96ef700 1 -- 172.21.15.79:0/3972840517 wait complete. 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabc96ef700 1 Processor -- start 2024-09-10T09:44:44.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabc96ef700 1 -- start start 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabc96ef700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc40687a0 0x7fabc40ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabc96ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc4069140 0x7fabc41001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabc96ef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4100720 con 0x7fabc4069140 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabc96ef700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4100860 con 0x7fabc40687a0 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabbbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc4069140 0x7fabc41001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabbbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc4069140 0x7fabc41001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33946/0 (socket says 172.21.15.79:33946) 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabbbfff700 1 -- 172.21.15.79:0/3458418079 learned_addr learned my addr 172.21.15.79:0/3458418079 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabc2ffd700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc40687a0 0x7fabc40ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabbbfff700 1 -- 172.21.15.79:0/3458418079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc40687a0 msgr2=0x7fabc40ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabbbfff700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc40687a0 0x7fabc40ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.404+0000 7fabbbfff700 1 -- 172.21.15.79:0/3458418079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40095f0 con 0x7fabc4069140 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.405+0000 7fabbbfff700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc4069140 0x7fabc41001e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabac00d8d0 tx=0x7fabac00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.405+0000 7fabc0ff9700 1 -- 172.21.15.79:0/3458418079 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac0098a0 con 0x7fabc4069140 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.405+0000 7fabc0ff9700 1 -- 172.21.15.79:0/3458418079 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabac010460 con 0x7fabc4069140 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.405+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc41a1fb0 con 0x7fabc4069140 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.405+0000 7fabc0ff9700 1 -- 172.21.15.79:0/3458418079 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabac00f5f0 con 0x7fabc4069140 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.405+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc41a23c0 con 0x7fabc4069140 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.406+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc41087e0 con 0x7fabc4069140 2024-09-10T09:44:44.408 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.406+0000 7fabc0ff9700 1 -- 172.21.15.79:0/3458418079 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fabac009a00 con 0x7fabc4069140 2024-09-10T09:44:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.407+0000 7fabc0ff9700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fabb006e200 0x7fabb00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.407+0000 7fabc0ff9700 1 -- 172.21.15.79:0/3458418079 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fabac08dec0 con 0x7fabc4069140 2024-09-10T09:44:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.407+0000 7fabc2ffd700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fabb006e200 0x7fabb00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.409 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.407+0000 7fabc2ffd700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fabb006e200 0x7fabb00706b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006010 tx=0x7fabb401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:44.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.411+0000 7fabc0ff9700 1 -- 172.21.15.79:0/3458418079 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fabac057350 con 0x7fabc4069140 2024-09-10T09:44:44.425 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:44 smithi135 ceph-mon[65362]: osdmap e77: 6 total, 5 up, 6 in 2024-09-10T09:44:44.425 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:43 smithi135 podman[84922]: 2024-09-10 09:44:43.970996615 +0000 UTC m=+0.426605175 container attach 90de75e439272e019bac425cc345fa4992161b094a4fb0d09e5b362d2b22bb12 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:44:44.425 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:44 smithi135 podman[84922]: 2024-09-10 09:44:44.084027566 +0000 UTC m=+0.539636134 container died 90de75e439272e019bac425cc345fa4992161b094a4fb0d09e5b362d2b22bb12 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T09:44:44.694 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.693+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fabc404f2a0 con 0x7fabc4069140 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.694+0000 7fabc0ff9700 1 -- 172.21.15.79:0/3458418079 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+708 (secure 0 0 0) 0x7fabac05aa10 con 0x7fabc4069140 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:44:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 5 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 4, 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 9 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:44:44.696 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:44:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fabb006e200 msgr2=0x7fabb00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fabb006e200 0x7fabb00706b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fabb4006010 tx=0x7fabb401a040 comp rx=0 tx=0).stop 2024-09-10T09:44:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc4069140 msgr2=0x7fabc41001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc4069140 0x7fabc41001e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabac00d8d0 tx=0x7fabac00dbe0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 shutdown_connections 2024-09-10T09:44:44.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fabb006e200 0x7fabb00706b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc40687a0 0x7fabc40ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 --2- 172.21.15.79:0/3458418079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabc4069140 0x7fabc41001e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 >> 172.21.15.79:0/3458418079 conn(0x7fabc4075130 msgr2=0x7fabc4104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 shutdown_connections 2024-09-10T09:44:44.698 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.696+0000 7fabc96ef700 1 -- 172.21.15.79:0/3458418079 wait complete. 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 -- 172.21.15.79:0/194800102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7484100e80 msgr2=0x7f7484104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 --2- 172.21.15.79:0/194800102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7484100e80 0x7f7484104e50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7474009910 tx=0x7f7474009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 -- 172.21.15.79:0/194800102 shutdown_connections 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 --2- 172.21.15.79:0/194800102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7484100e80 0x7f7484104e50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 --2- 172.21.15.79:0/194800102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74841004e0 0x7f74841008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 -- 172.21.15.79:0/194800102 >> 172.21.15.79:0/194800102 conn(0x7f74840fbda0 msgr2=0x7f74840fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 -- 172.21.15.79:0/194800102 shutdown_connections 2024-09-10T09:44:44.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 -- 172.21.15.79:0/194800102 wait complete. 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 Processor -- start 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.801+0000 7f748c015700 1 -- start start 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f748c015700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74841004e0 0x7f7484195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f748c015700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7484100e80 0x7f7484196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f748c015700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484196b30 con 0x7f74841004e0 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f748c015700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748419a8c0 con 0x7f7484100e80 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f7489db1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74841004e0 0x7f7484195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f7489db1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74841004e0 0x7f7484195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33962/0 (socket says 172.21.15.79:33962) 2024-09-10T09:44:44.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f7489db1700 1 -- 172.21.15.79:0/2747237424 learned_addr learned my addr 172.21.15.79:0/2747237424 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f74895b0700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7484100e80 0x7f7484196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f7489db1700 1 -- 172.21.15.79:0/2747237424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7484100e80 msgr2=0x7f7484196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f7489db1700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7484100e80 0x7f7484196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f7489db1700 1 -- 172.21.15.79:0/2747237424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740095f0 con 0x7f74841004e0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f7489db1700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74841004e0 0x7f7484195f10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f748000d8d0 tx=0x7f748000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f747affd700 1 -- 172.21.15.79:0/2747237424 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74800098a0 con 0x7f74841004e0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f747affd700 1 -- 172.21.15.79:0/2747237424 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7480010460 con 0x7f74841004e0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748419aba0 con 0x7f74841004e0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f747affd700 1 -- 172.21.15.79:0/2747237424 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f748000f5f0 con 0x7f74841004e0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.802+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748419b0f0 con 0x7f74841004e0 2024-09-10T09:44:44.805 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.803+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7484108850 con 0x7f74841004e0 2024-09-10T09:44:44.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.804+0000 7f747affd700 1 -- 172.21.15.79:0/2747237424 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7480009a00 con 0x7f74841004e0 2024-09-10T09:44:44.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.804+0000 7f747affd700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f747006e200 0x7f74700706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:44.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.804+0000 7f747affd700 1 -- 172.21.15.79:0/2747237424 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f748008ddc0 con 0x7f74841004e0 2024-09-10T09:44:44.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.804+0000 7f74895b0700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f747006e200 0x7f74700706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:44.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.805+0000 7f74895b0700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f747006e200 0x7f74700706b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7484197530 tx=0x7f747401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:44.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:44.809+0000 7f747affd700 1 -- 172.21.15.79:0/2747237424 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f74800572d0 con 0x7f74841004e0 2024-09-10T09:44:44.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:44 smithi135 podman[84945]: 2024-09-10 09:44:44.709462758 +0000 UTC m=+0.613890683 container remove 90de75e439272e019bac425cc345fa4992161b094a4fb0d09e5b362d2b22bb12 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:44:44.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:44 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-10T09:44:44.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:44 smithi135 systemd[1]: Stopped Ceph osd.5 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:44:44.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:44 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.5.service: Consumed 1min 9.269s CPU time. 2024-09-10T09:44:44.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:44 smithi135 systemd[1]: Starting Ceph osd.5 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:44:45.060 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.059+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f748419b360 con 0x7f74841004e0 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.060+0000 7f747affd700 1 -- 172.21.15.79:0/2747237424 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1944 (secure 0 0 0) 0x7f74800207b0 con 0x7f74841004e0 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout:e16 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:44:45.061 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 16 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:33:45.783866+0000 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:44:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 47 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:44:45.063 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 0 members: 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:14474} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.79:6828/397850123,v1:172.21.15.79:6829/397850123] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:14488} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1635861920,v1:172.21.15.79:6827/1635861920] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:45.064 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:44:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f747006e200 msgr2=0x7f74700706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f747006e200 0x7f74700706b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7484197530 tx=0x7f747401a040 comp rx=0 tx=0).stop 2024-09-10T09:44:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74841004e0 msgr2=0x7f7484195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74841004e0 0x7f7484195f10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f748000d8d0 tx=0x7f748000dbe0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 shutdown_connections 2024-09-10T09:44:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f747006e200 0x7f74700706b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f74841004e0 0x7f7484195f10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 --2- 172.21.15.79:0/2747237424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7484100e80 0x7f7484196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 >> 172.21.15.79:0/2747237424 conn(0x7f74840fbda0 msgr2=0x7f74840fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 shutdown_connections 2024-09-10T09:44:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.062+0000 7f748c015700 1 -- 172.21.15.79:0/2747237424 wait complete. 2024-09-10T09:44:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 16 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 -- 172.21.15.79:0/1629971573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 msgr2=0x7f2da40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/1629971573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da40ff790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400b0a0 tx=0x7f2d9400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 -- 172.21.15.79:0/1629971573 shutdown_connections 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/1629971573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da40ffd60 0x7f2da4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/1629971573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da40ff790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 -- 172.21.15.79:0/1629971573 >> 172.21.15.79:0/1629971573 conn(0x7f2da40fac60 msgr2=0x7f2da40fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 -- 172.21.15.79:0/1629971573 shutdown_connections 2024-09-10T09:44:45.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 -- 172.21.15.79:0/1629971573 wait complete. 2024-09-10T09:44:45.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 Processor -- start 2024-09-10T09:44:45.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.169+0000 7f2da9a8e700 1 -- start start 2024-09-10T09:44:45.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da9a8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da4195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da9a8e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da40ffd60 0x7f2da4196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da9a8e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da4196b30 con 0x7f2da40ff3c0 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da9a8e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da419a8c0 con 0x7f2da40ffd60 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da4195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da4195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:33992/0 (socket says 172.21.15.79:33992) 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da37fe700 1 -- 172.21.15.79:0/3889038109 learned_addr learned my addr 172.21.15.79:0/3889038109 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da2ffd700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da40ffd60 0x7f2da4196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da37fe700 1 -- 172.21.15.79:0/3889038109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da40ffd60 msgr2=0x7f2da4196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da37fe700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da40ffd60 0x7f2da4196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da37fe700 1 -- 172.21.15.79:0/3889038109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94009d00 con 0x7f2da40ff3c0 2024-09-10T09:44:45.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da37fe700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da4195f10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400b070 tx=0x7f2d9400bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:45.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.170+0000 7f2da0ff9700 1 -- 172.21.15.79:0/3889038109 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d9400e040 con 0x7f2da40ff3c0 2024-09-10T09:44:45.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.171+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da419ab40 con 0x7f2da40ff3c0 2024-09-10T09:44:45.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.171+0000 7f2da0ff9700 1 -- 172.21.15.79:0/3889038109 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d94003c10 con 0x7f2da40ff3c0 2024-09-10T09:44:45.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.171+0000 7f2da0ff9700 1 -- 172.21.15.79:0/3889038109 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d9401d6a0 con 0x7f2da40ff3c0 2024-09-10T09:44:45.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.171+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da419b030 con 0x7f2da40ff3c0 2024-09-10T09:44:45.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.172+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da404f2a0 con 0x7f2da40ff3c0 2024-09-10T09:44:45.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.172+0000 7f2da0ff9700 1 -- 172.21.15.79:0/3889038109 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2d94019070 con 0x7f2da40ff3c0 2024-09-10T09:44:45.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.173+0000 7f2da0ff9700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2d8c06e200 0x7f2d8c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:45.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.173+0000 7f2da0ff9700 1 -- 172.21.15.79:0/3889038109 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2d9408f510 con 0x7f2da40ff3c0 2024-09-10T09:44:45.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.173+0000 7f2da2ffd700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2d8c06e200 0x7f2d8c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:45.175 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.173+0000 7f2da2ffd700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2d8c06e200 0x7f2d8c0706b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2da4197530 tx=0x7f2d98009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:45.178 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.177+0000 7f2da0ff9700 1 -- 172.21.15.79:0/3889038109 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2d940589a0 con 0x7f2da40ff3c0 2024-09-10T09:44:45.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.400+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2da419b360 con 0x7f2d8c06e200 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: pgmap v155: 65 pgs: 7 active+undersized, 3 peering, 6 stale+active+clean, 3 active+undersized+degraded, 46 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/222 objects degraded (2.703%) 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: Health check failed: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3458418079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:45.402 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:45 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2747237424' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:44:45.403 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.402+0000 7f2da0ff9700 1 -- 172.21.15.79:0/3889038109 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2da419b360 con 0x7f2d8c06e200 2024-09-10T09:44:45.403 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:44:45.403 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:44:45.403 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:44:45.403 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:44:45.403 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:44:45.404 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:44:45.404 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:44:45.404 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:44:45.404 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:44:45.404 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "11/23 daemons upgraded", 2024-09-10T09:44:45.404 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading osd daemons", 2024-09-10T09:44:45.404 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:44:45.405 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:44:45.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2d8c06e200 msgr2=0x7f2d8c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2d8c06e200 0x7f2d8c0706b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2da4197530 tx=0x7f2d98009260 comp rx=0 tx=0).stop 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 msgr2=0x7f2da4195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da4195f10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400b070 tx=0x7f2d9400bc60 comp rx=0 tx=0).stop 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 shutdown_connections 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2d8c06e200 0x7f2d8c0706b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40ff3c0 0x7f2da4195f10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 --2- 172.21.15.79:0/3889038109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2da40ffd60 0x7f2da4196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 >> 172.21.15.79:0/3889038109 conn(0x7f2da40fac60 msgr2=0x7f2da40fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 shutdown_connections 2024-09-10T09:44:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.404+0000 7f2da9a8e700 1 -- 172.21.15.79:0/3889038109 wait complete. 2024-09-10T09:44:45.423 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:45.423 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:45.423 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: pgmap v155: 65 pgs: 7 active+undersized, 3 peering, 6 stale+active+clean, 3 active+undersized+degraded, 46 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/222 objects degraded (2.703%) 2024-09-10T09:44:45.423 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-10T09:44:45.424 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: Health check failed: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:45.424 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:45.424 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3458418079' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:45.424 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2747237424' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:44:45.424 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 podman[85042]: 2024-09-10 09:44:45.055385677 +0000 UTC m=+0.015804540 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:44:45.424 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 podman[85042]: 2024-09-10 09:44:45.169530923 +0000 UTC m=+0.129949786 container create b110c0992f3418b1f74a3ca4fe15d679ffe28b375f6012ed895589e7c6d81c6c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T09:44:45.424 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 podman[85042]: 2024-09-10 09:44:45.423170633 +0000 UTC m=+0.383589497 container init b110c0992f3418b1f74a3ca4fe15d679ffe28b375f6012ed895589e7c6d81c6c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 -- 172.21.15.79:0/977940188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 msgr2=0x7fed700ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 --2- 172.21.15.79:0/977940188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed700ff790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fed60009910 tx=0x7fed60009c20 comp rx=0 tx=0).stop 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 -- 172.21.15.79:0/977940188 shutdown_connections 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 --2- 172.21.15.79:0/977940188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed700ffd60 0x7fed70103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 --2- 172.21.15.79:0/977940188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed700ff790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 -- 172.21.15.79:0/977940188 >> 172.21.15.79:0/977940188 conn(0x7fed700fac80 msgr2=0x7fed700fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 -- 172.21.15.79:0/977940188 shutdown_connections 2024-09-10T09:44:45.512 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.509+0000 7fed756c9700 1 -- 172.21.15.79:0/977940188 wait complete. 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed756c9700 1 Processor -- start 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed756c9700 1 -- start start 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed756c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed70195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed756c9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed700ffd60 0x7fed70196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed756c9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70196b20 con 0x7fed700ff3c0 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed756c9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7019a8b0 con 0x7fed700ffd60 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed6effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed70195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed6effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed70195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:34006/0 (socket says 172.21.15.79:34006) 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed6effd700 1 -- 172.21.15.79:0/39389533 learned_addr learned my addr 172.21.15.79:0/39389533 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:44:45.513 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed6e7fc700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed700ffd60 0x7fed70196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed6effd700 1 -- 172.21.15.79:0/39389533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed700ffd60 msgr2=0x7fed70196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed6effd700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed700ffd60 0x7fed70196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.510+0000 7fed6effd700 1 -- 172.21.15.79:0/39389533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed600095f0 con 0x7fed700ff3c0 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.511+0000 7fed6effd700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed70195f00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed60006010 tx=0x7fed6000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.511+0000 7fed57fff700 1 -- 172.21.15.79:0/39389533 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6001d070 con 0x7fed700ff3c0 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.511+0000 7fed57fff700 1 -- 172.21.15.79:0/39389533 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed60005dc0 con 0x7fed700ff3c0 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.511+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7019ab30 con 0x7fed700ff3c0 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.511+0000 7fed57fff700 1 -- 172.21.15.79:0/39389533 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed60017400 con 0x7fed700ff3c0 2024-09-10T09:44:45.514 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.511+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7019b020 con 0x7fed700ff3c0 2024-09-10T09:44:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.512+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7004f2a0 con 0x7fed700ff3c0 2024-09-10T09:44:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.512+0000 7fed57fff700 1 -- 172.21.15.79:0/39389533 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fed60003a60 con 0x7fed700ff3c0 2024-09-10T09:44:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.513+0000 7fed57fff700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed5806e200 0x7fed580706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:44:45.515 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.513+0000 7fed57fff700 1 -- 172.21.15.79:0/39389533 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fed6008f450 con 0x7fed700ff3c0 2024-09-10T09:44:45.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.513+0000 7fed6e7fc700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed5806e200 0x7fed580706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:44:45.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.513+0000 7fed6e7fc700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed5806e200 0x7fed580706b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed70197520 tx=0x7fed6400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:44:45.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.517+0000 7fed57fff700 1 -- 172.21.15.79:0/39389533 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed600588e0 con 0x7fed700ff3c0 2024-09-10T09:44:45.717 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 podman[85042]: 2024-09-10 09:44:45.426449034 +0000 UTC m=+0.386867898 container start b110c0992f3418b1f74a3ca4fe15d679ffe28b375f6012ed895589e7c6d81c6c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:44:45.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 podman[85042]: 2024-09-10 09:44:45.506515001 +0000 UTC m=+0.466933876 container attach b110c0992f3418b1f74a3ca4fe15d679ffe28b375f6012ed895589e7c6d81c6c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:44:45.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:45.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 bash[85042]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:45.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:45.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:45 smithi135 bash[85042]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-10T09:44:45.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.805+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fed7019b240 con 0x7fed700ff3c0 2024-09-10T09:44:45.806 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.805+0000 7fed57fff700 1 -- 172.21.15.79:0/39389533 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1043 (secure 0 0 0) 0x7fed6005bfa0 con 0x7fed700ff3c0 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 1 pg peering; Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout: osd.5 (root=default,host=smithi135) is down 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 1 pg peering 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.2 is stuck peering for 6m, current state peering, last acting [1,0] 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-10T09:44:45.807 INFO:teuthology.orchestra.run.smithi079.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed5806e200 msgr2=0x7fed580706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed5806e200 0x7fed580706b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fed70197520 tx=0x7fed6400b410 comp rx=0 tx=0).stop 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 msgr2=0x7fed70195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed70195f00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed60006010 tx=0x7fed6000bd70 comp rx=0 tx=0).stop 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 shutdown_connections 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fed5806e200 0x7fed580706b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed700ff3c0 0x7fed70195f00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 --2- 172.21.15.79:0/39389533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed700ffd60 0x7fed70196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:44:45.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 >> 172.21.15.79:0/39389533 conn(0x7fed700fac80 msgr2=0x7fed701034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:44:45.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 shutdown_connections 2024-09-10T09:44:45.810 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:44:45.808+0000 7fed756c9700 1 -- 172.21.15.79:0/39389533 wait complete. 2024-09-10T09:44:46.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:46 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/39389533' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:44:46.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/39389533' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:44:46.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T09:44:46.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 bash[85042]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T09:44:46.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T09:44:46.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 bash[85042]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-10T09:44:46.877 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T09:44:46.877 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 bash[85042]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-10T09:44:46.877 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T09:44:46.877 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 bash[85042]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-10T09:44:46.878 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-10T09:44:46.878 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 bash[85042]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-10T09:44:46.878 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T09:44:46.878 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 bash[85042]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T09:44:46.878 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate[85057]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-10T09:44:46.878 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 bash[85042]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-10T09:44:46.878 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:46 smithi135 podman[85200]: 2024-09-10 09:44:46.633799223 +0000 UTC m=+0.016465486 container died b110c0992f3418b1f74a3ca4fe15d679ffe28b375f6012ed895589e7c6d81c6c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T09:44:47.454 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:47 smithi135 ceph-mon[65362]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:47.454 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:47 smithi135 ceph-mon[65362]: pgmap v156: 65 pgs: 10 active+undersized, 3 peering, 3 stale+active+clean, 5 active+undersized+degraded, 44 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/222 objects degraded (4.505%) 2024-09-10T09:44:47.454 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 podman[85200]: 2024-09-10 09:44:47.228259282 +0000 UTC m=+0.610925605 container remove b110c0992f3418b1f74a3ca4fe15d679ffe28b375f6012ed895589e7c6d81c6c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T09:44:47.455 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 podman[85258]: 2024-09-10 09:44:47.339689837 +0000 UTC m=+0.015678402 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:44:47.455 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 podman[85258]: 2024-09-10 09:44:47.454269719 +0000 UTC m=+0.130258271 container create e48bce7b2061b7b5d4da1e04cf0e425abde08b31afc851feeb1a543f3a601d93 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T09:44:47.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:47 smithi079 ceph-mon[87213]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:44:47.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:47 smithi079 ceph-mon[87213]: pgmap v156: 65 pgs: 10 active+undersized, 3 peering, 3 stale+active+clean, 5 active+undersized+degraded, 44 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 10/222 objects degraded (4.505%) 2024-09-10T09:44:47.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 podman[85258]: 2024-09-10 09:44:47.70776154 +0000 UTC m=+0.383750090 container init e48bce7b2061b7b5d4da1e04cf0e425abde08b31afc851feeb1a543f3a601d93 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:44:47.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 podman[85258]: 2024-09-10 09:44:47.711117171 +0000 UTC m=+0.387105725 container start e48bce7b2061b7b5d4da1e04cf0e425abde08b31afc851feeb1a543f3a601d93 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T09:44:47.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 ceph-osd[85278]: -- 172.21.15.135:0/2842612312 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600e79581e0 con 0x5600e78ee000 2024-09-10T09:44:47.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 bash[85258]: e48bce7b2061b7b5d4da1e04cf0e425abde08b31afc851feeb1a543f3a601d93 2024-09-10T09:44:47.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:47 smithi135 systemd[1]: Started Ceph osd.5 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:44:49.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:49.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:49.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:49.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:48 smithi079 ceph-mon[87213]: pgmap v157: 65 pgs: 15 active+undersized, 3 peering, 10 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 28/222 objects degraded (12.613%) 2024-09-10T09:44:49.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:49.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:49.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:49.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:48 smithi135 ceph-mon[65362]: pgmap v157: 65 pgs: 15 active+undersized, 3 peering, 10 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 0 op/s; 28/222 objects degraded (12.613%) 2024-09-10T09:44:49.593 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:49 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:44:49.591+0000 7f10526fa640 -1 Falling back to public interface 2024-09-10T09:44:50.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:50 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:50.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:50 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:50.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:50 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:50.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:50 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:44:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:51 smithi079 ceph-mon[87213]: pgmap v158: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:51 smithi079 ceph-mon[87213]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:51 smithi079 ceph-mon[87213]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T09:44:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:51 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:51.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:51 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:51.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:51 smithi135 ceph-mon[65362]: pgmap v158: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:51.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:51 smithi135 ceph-mon[65362]: Health check update: Degraded data redundancy: 30/222 objects degraded (13.514%), 12 pgs degraded (PG_DEGRADED) 2024-09-10T09:44:51.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:51 smithi135 ceph-mon[65362]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-10T09:44:51.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:51 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:51.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:51 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:52.589 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:52 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:52.589 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:52 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:52.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:52 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:52.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:52 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:53.600 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:53 smithi135 ceph-mon[65362]: pgmap v159: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:53.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:53 smithi079 ceph-mon[87213]: pgmap v159: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: pgmap v160: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 93 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-10T09:44:55.463 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-10T09:44:55.467 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:44:55.129+0000 7f10526fa640 -1 osd.5 0 read_superblock omap replica is missing. 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: pgmap v160: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 93 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:55.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-10T09:44:55.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-10T09:44:55.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:55 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:44:55.548+0000 7f10526fa640 -1 osd.5 75 log_to_monitors true 2024-09-10T09:44:56.560 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all osd 2024-09-10T09:44:56.560 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: Upgrade: Setting require_osd_release to 19 squid 2024-09-10T09:44:56.560 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-10T09:44:56.560 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-10T09:44:56.561 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: osdmap e78: 6 total, 5 up, 6 in 2024-09-10T09:44:56.561 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:56.561 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-10T09:44:56.561 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: from='osd.5 [v2:172.21.15.135:6816/1229798985,v1:172.21.15.135:6817/1229798985]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:44:56.561 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:56 smithi079 ceph-mon[87213]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:44:56.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all osd 2024-09-10T09:44:56.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: Upgrade: Setting require_osd_release to 19 squid 2024-09-10T09:44:56.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-10T09:44:56.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-10T09:44:56.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: osdmap e78: 6 total, 5 up, 6 in 2024-09-10T09:44:56.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:56.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-10T09:44:56.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: from='osd.5 [v2:172.21.15.135:6816/1229798985,v1:172.21.15.135:6817/1229798985]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:44:56.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:56 smithi135 ceph-mon[65362]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T09:44:57.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-10T09:44:57.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: pgmap v162: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:57.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: osdmap e79: 6 total, 5 up, 6 in 2024-09-10T09:44:57.292 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 2 up:standby 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:57.293 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:57 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:57.695 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:44:57.273+0000 7f104a494640 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T09:44:57.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-10T09:44:57.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: pgmap v162: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 947 MiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:57.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: osdmap e79: 6 total, 5 up, 6 in 2024-09-10T09:44:57.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-10T09:44:57.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 2 up:standby 2024-09-10T09:44:57.695 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:57.696 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:57 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:44:58.578 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T09:44:58.578 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: osdmap e80: 6 total, 5 up, 6 in 2024-09-10T09:44:58.578 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: from='osd.5 [v2:172.21.15.135:6816/1229798985,v1:172.21.15.135:6817/1229798985]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:58.578 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:58.578 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.79:6828/32452037,v1:172.21.15.79:6829/32452037] up:boot 2024-09-10T09:44:58.579 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:44:58.579 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:44:58.579 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:58.579 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:44:58.579 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:58 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:58.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: osdmap e80: 6 total, 5 up, 6 in 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: from='osd.5 [v2:172.21.15.135:6816/1229798985,v1:172.21.15.135:6817/1229798985]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.79:6828/32452037,v1:172.21.15.79:6829/32452037] up:boot 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.pqgxjw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:44:58.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:58 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:44:59.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: Upgrade: Updating mds.cephfs.smithi079.pqgxjw 2024-09-10T09:44:59.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: Deploying daemon mds.cephfs.smithi079.pqgxjw on smithi079 2024-09-10T09:44:59.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: pgmap v165: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 885 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:44:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: osd.5 [v2:172.21.15.135:6816/1229798985,v1:172.21.15.135:6817/1229798985] boot 2024-09-10T09:44:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: osdmap e81: 6 total, 6 up, 6 in 2024-09-10T09:44:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:44:59.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:44:59 smithi079 ceph-mon[87213]: osdmap e82: 6 total, 6 up, 6 in 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: Upgrade: Updating mds.cephfs.smithi079.pqgxjw 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: Deploying daemon mds.cephfs.smithi079.pqgxjw on smithi079 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: pgmap v165: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 202 MiB data, 885 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 30/222 objects degraded (13.514%) 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: osd.5 [v2:172.21.15.135:6816/1229798985,v1:172.21.15.135:6817/1229798985] boot 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: osdmap e81: 6 total, 6 up, 6 in 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T09:44:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:44:59 smithi135 ceph-mon[65362]: osdmap e82: 6 total, 6 up, 6 in 2024-09-10T09:45:00.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:00 smithi079 ceph-mon[87213]: Health check update: Degraded data redundancy: 24/222 objects degraded (10.811%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T09:45:00.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:00 smithi079 ceph-mon[87213]: osdmap e83: 6 total, 6 up, 6 in 2024-09-10T09:45:00.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:00 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 2 up:standby 2024-09-10T09:45:00.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:00 smithi135 ceph-mon[65362]: Health check update: Degraded data redundancy: 24/222 objects degraded (10.811%), 9 pgs degraded (PG_DEGRADED) 2024-09-10T09:45:00.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:00 smithi135 ceph-mon[65362]: osdmap e83: 6 total, 6 up, 6 in 2024-09-10T09:45:00.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:00 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 2 up:standby 2024-09-10T09:45:01.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:01 smithi079 ceph-mon[87213]: pgmap v168: 65 pgs: 6 peering, 13 active+undersized, 9 active+undersized+degraded, 37 active+clean; 202 MiB data, 885 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 24/222 objects degraded (10.811%) 2024-09-10T09:45:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:01 smithi135 ceph-mon[65362]: pgmap v168: 65 pgs: 6 peering, 13 active+undersized, 9 active+undersized+degraded, 37 active+clean; 202 MiB data, 885 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 24/222 objects degraded (10.811%) 2024-09-10T09:45:03.442 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:03 smithi079 ceph-mon[87213]: pgmap v170: 65 pgs: 6 peering, 10 active+undersized, 5 active+undersized+degraded, 44 active+clean; 202 MiB data, 885 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 9/222 objects degraded (4.054%) 2024-09-10T09:45:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:03 smithi135 ceph-mon[65362]: pgmap v170: 65 pgs: 6 peering, 10 active+undersized, 5 active+undersized+degraded, 44 active+clean; 202 MiB data, 885 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 9/222 objects degraded (4.054%) 2024-09-10T09:45:05.417 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:05.417 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:05.417 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:05 smithi079 ceph-mon[87213]: pgmap v171: 65 pgs: 2 peering, 63 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-10T09:45:05.417 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:05.417 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:05.418 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:05 smithi135 ceph-mon[65362]: pgmap v171: 65 pgs: 2 peering, 63 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-10T09:45:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:06.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:06 smithi079 ceph-mon[87213]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/222 objects degraded (4.054%), 5 pgs degraded) 2024-09-10T09:45:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:06 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:boot 2024-09-10T09:45:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:06 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:45:06.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:06 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:45:06.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:06 smithi135 ceph-mon[65362]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/222 objects degraded (4.054%), 5 pgs degraded) 2024-09-10T09:45:06.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:06 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:boot 2024-09-10T09:45:06.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:06 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:45:06.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:06 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:45:07.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:07 smithi079 ceph-mon[87213]: pgmap v172: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-10T09:45:07.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:07 smithi135 ceph-mon[65362]: pgmap v172: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-10T09:45:09.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:09 smithi079 ceph-mon[87213]: pgmap v173: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:09.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:09 smithi135 ceph-mon[65362]: pgmap v173: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:10.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:10.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:10 smithi079 ceph-mon[87213]: pgmap v174: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:10.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:10.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:10.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:10 smithi135 ceph-mon[65362]: pgmap v174: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:10.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:13.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:13 smithi079 ceph-mon[87213]: pgmap v175: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:13.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:13 smithi135 ceph-mon[65362]: pgmap v175: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: pgmap v176: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:14.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:14.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: pgmap v176: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:14.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 -- 172.21.15.79:0/2554923319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 msgr2=0x7f15181017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 --2- 172.21.15.79:0/2554923319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181017f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1514009910 tx=0x7f1514009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 -- 172.21.15.79:0/2554923319 shutdown_connections 2024-09-10T09:45:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 --2- 172.21.15.79:0/2554923319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1518101d30 0x7f151810a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 --2- 172.21.15.79:0/2554923319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181017f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:15.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 -- 172.21.15.79:0/2554923319 >> 172.21.15.79:0/2554923319 conn(0x7f15180fac80 msgr2=0x7f15180fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 -- 172.21.15.79:0/2554923319 shutdown_connections 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 -- 172.21.15.79:0/2554923319 wait complete. 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 Processor -- start 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.921+0000 7f1520332700 1 -- start start 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f1520332700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f1520332700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1518101d30 0x7f1518198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f1520332700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518198c50 con 0x7f1518101420 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f1520332700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518198d90 con 0x7f1518101d30 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151e0ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:15.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151e0ce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38748/0 (socket says 172.21.15.79:38748) 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151e0ce700 1 -- 172.21.15.79:0/151083019 learned_addr learned my addr 172.21.15.79:0/151083019 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151d8cd700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1518101d30 0x7f1518198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151e0ce700 1 -- 172.21.15.79:0/151083019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1518101d30 msgr2=0x7f1518198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151e0ce700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1518101d30 0x7f1518198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151e0ce700 1 -- 172.21.15.79:0/151083019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140095f0 con 0x7f1518101420 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f151e0ce700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181980c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f151400b5c0 tx=0x7f151400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f150f7fe700 1 -- 172.21.15.79:0/151083019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f151401d070 con 0x7f1518101420 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f150f7fe700 1 -- 172.21.15.79:0/151083019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f151400f460 con 0x7f1518101420 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151819cb80 con 0x7f1518101420 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.922+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151819d070 con 0x7f1518101420 2024-09-10T09:45:15.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.923+0000 7f150f7fe700 1 -- 172.21.15.79:0/151083019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1514017630 con 0x7f1518101420 2024-09-10T09:45:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.923+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc005320 con 0x7f1518101420 2024-09-10T09:45:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.924+0000 7f150f7fe700 1 -- 172.21.15.79:0/151083019 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1514003a60 con 0x7f1518101420 2024-09-10T09:45:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.924+0000 7f150f7fe700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f150406e200 0x7f15040706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.925+0000 7f150f7fe700 1 -- 172.21.15.79:0/151083019 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f151408f4e0 con 0x7f1518101420 2024-09-10T09:45:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.925+0000 7f151d8cd700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f150406e200 0x7f15040706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:15.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.925+0000 7f151d8cd700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f150406e200 0x7f15040706b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15181996e0 tx=0x7f150800a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:15.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:15.929+0000 7f150f7fe700 1 -- 172.21.15.79:0/151083019 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1514058970 con 0x7f1518101420 2024-09-10T09:45:16.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.151+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14fc000bf0 con 0x7f150406e200 2024-09-10T09:45:16.153 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.152+0000 7f150f7fe700 1 -- 172.21.15.79:0/151083019 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f14fc000bf0 con 0x7f150406e200 2024-09-10T09:45:16.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f150406e200 msgr2=0x7f15040706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f150406e200 0x7f15040706b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15181996e0 tx=0x7f150800a380 comp rx=0 tx=0).stop 2024-09-10T09:45:16.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 msgr2=0x7f15181980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181980c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f151400b5c0 tx=0x7f151400bd50 comp rx=0 tx=0).stop 2024-09-10T09:45:16.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 shutdown_connections 2024-09-10T09:45:16.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f150406e200 0x7f15040706b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1518101420 0x7f15181980c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 --2- 172.21.15.79:0/151083019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1518101d30 0x7f1518198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 >> 172.21.15.79:0/151083019 conn(0x7f15180fac80 msgr2=0x7f15180ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:16.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 shutdown_connections 2024-09-10T09:45:16.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.154+0000 7f1520332700 1 -- 172.21.15.79:0/151083019 wait complete. 2024-09-10T09:45:16.166 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:45:16.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 -- 172.21.15.79:0/3665154776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ffd50 msgr2=0x7f1184103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 --2- 172.21.15.79:0/3665154776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ffd50 0x7f1184103d20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1174009910 tx=0x7f1174009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:16.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 -- 172.21.15.79:0/3665154776 shutdown_connections 2024-09-10T09:45:16.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 --2- 172.21.15.79:0/3665154776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ffd50 0x7f1184103d20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 --2- 172.21.15.79:0/3665154776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11840ff3b0 0x7f11840ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.267 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 -- 172.21.15.79:0/3665154776 >> 172.21.15.79:0/3665154776 conn(0x7f11840fac90 msgr2=0x7f11840fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 -- 172.21.15.79:0/3665154776 shutdown_connections 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.264+0000 7f118aa8f700 1 -- 172.21.15.79:0/3665154776 wait complete. 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118aa8f700 1 Processor -- start 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118aa8f700 1 -- start start 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118aa8f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ff3b0 0x7f1184195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118aa8f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11840ffd50 0x7f11841964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118aa8f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184196bb0 con 0x7f11840ff3b0 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118aa8f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118419a940 con 0x7f11840ffd50 2024-09-10T09:45:16.268 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118882b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ff3b0 0x7f1184195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118882b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ff3b0 0x7f1184195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38766/0 (socket says 172.21.15.79:38766) 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.265+0000 7f118882b700 1 -- 172.21.15.79:0/2190726500 learned_addr learned my addr 172.21.15.79:0/2190726500 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f1183fff700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11840ffd50 0x7f11841964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f118882b700 1 -- 172.21.15.79:0/2190726500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11840ffd50 msgr2=0x7f11841964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f118882b700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11840ffd50 0x7f11841964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f118882b700 1 -- 172.21.15.79:0/2190726500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740095f0 con 0x7f11840ff3b0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f118882b700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ff3b0 0x7f1184195f90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f116c00b4b0 tx=0x7f116c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f1181ffb700 1 -- 172.21.15.79:0/2190726500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116c011800 con 0x7f11840ff3b0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f1181ffb700 1 -- 172.21.15.79:0/2190726500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f116c011e20 con 0x7f11840ff3b0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118419ac20 con 0x7f11840ff3b0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f1181ffb700 1 -- 172.21.15.79:0/2190726500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f116c00f2e0 con 0x7f11840ff3b0 2024-09-10T09:45:16.269 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.266+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118419b170 con 0x7f11840ff3b0 2024-09-10T09:45:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.267+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118404f2a0 con 0x7f11840ff3b0 2024-09-10T09:45:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.268+0000 7f1181ffb700 1 -- 172.21.15.79:0/2190726500 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f116c010380 con 0x7f11840ff3b0 2024-09-10T09:45:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.268+0000 7f1181ffb700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f117006e200 0x7f11700706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.268+0000 7f1181ffb700 1 -- 172.21.15.79:0/2190726500 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f116c08daf0 con 0x7f11840ff3b0 2024-09-10T09:45:16.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.268+0000 7f1183fff700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f117006e200 0x7f11700706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.271 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.269+0000 7f1183fff700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f117006e200 0x7f11700706b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f11841975b0 tx=0x7f117401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:16.273 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.272+0000 7f1181ffb700 1 -- 172.21.15.79:0/2190726500 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f116c0570b0 con 0x7f11840ff3b0 2024-09-10T09:45:16.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:16 smithi079 ceph-mon[87213]: Upgrade: Updating mds.cephfs.smithi079.wpfdzn 2024-09-10T09:45:16.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:16.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:45:16.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:16.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:16 smithi079 ceph-mon[87213]: Deploying daemon mds.cephfs.smithi079.wpfdzn on smithi079 2024-09-10T09:45:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.496+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f118419b4e0 con 0x7f117006e200 2024-09-10T09:45:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.498+0000 7f1181ffb700 1 -- 172.21.15.79:0/2190726500 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f118419b4e0 con 0x7f117006e200 2024-09-10T09:45:16.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f117006e200 msgr2=0x7f11700706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f117006e200 0x7f11700706b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f11841975b0 tx=0x7f117401a040 comp rx=0 tx=0).stop 2024-09-10T09:45:16.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ff3b0 msgr2=0x7f1184195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ff3b0 0x7f1184195f90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f116c00b4b0 tx=0x7f116c00b870 comp rx=0 tx=0).stop 2024-09-10T09:45:16.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 shutdown_connections 2024-09-10T09:45:16.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f117006e200 0x7f11700706b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11840ff3b0 0x7f1184195f90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 --2- 172.21.15.79:0/2190726500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11840ffd50 0x7f11841964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 >> 172.21.15.79:0/2190726500 conn(0x7f11840fac90 msgr2=0x7f11840fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:16.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 shutdown_connections 2024-09-10T09:45:16.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.500+0000 7f118aa8f700 1 -- 172.21.15.79:0/2190726500 wait complete. 2024-09-10T09:45:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 -- 172.21.15.79:0/2436006457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 msgr2=0x7f525c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 --2- 172.21.15.79:0/2436006457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c103d30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5258009910 tx=0x7f5258009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 -- 172.21.15.79:0/2436006457 shutdown_connections 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 --2- 172.21.15.79:0/2436006457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c103d30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 --2- 172.21.15.79:0/2436006457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c0ff3c0 0x7f525c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 -- 172.21.15.79:0/2436006457 >> 172.21.15.79:0/2436006457 conn(0x7f525c0fac80 msgr2=0x7f525c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 -- 172.21.15.79:0/2436006457 shutdown_connections 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.606+0000 7f5263f6e700 1 -- 172.21.15.79:0/2436006457 wait complete. 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5263f6e700 1 Processor -- start 2024-09-10T09:45:16.608 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5263f6e700 1 -- start start 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5263f6e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c0ff3c0 0x7f525c194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5263f6e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c195420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5263f6e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c195b00 con 0x7f525c0ffd60 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5263f6e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c199890 con 0x7f525c0ff3c0 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5261509700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c195420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5261509700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c195420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38782/0 (socket says 172.21.15.79:38782) 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5261509700 1 -- 172.21.15.79:0/3315393476 learned_addr learned my addr 172.21.15.79:0/3315393476 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.607+0000 7f5261d0a700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c0ff3c0 0x7f525c194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5261509700 1 -- 172.21.15.79:0/3315393476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c0ff3c0 msgr2=0x7f525c194ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5261509700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c0ff3c0 0x7f525c194ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.610 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5261509700 1 -- 172.21.15.79:0/3315393476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580095f0 con 0x7f525c0ffd60 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5261d0a700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c0ff3c0 0x7f525c194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5261509700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c195420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52580092e0 tx=0x7f525800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5252ffd700 1 -- 172.21.15.79:0/3315393476 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525801d070 con 0x7f525c0ffd60 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5252ffd700 1 -- 172.21.15.79:0/3315393476 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f525800f460 con 0x7f525c0ffd60 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c199b10 con 0x7f525c0ffd60 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5252ffd700 1 -- 172.21.15.79:0/3315393476 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52580175f0 con 0x7f525c0ffd60 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.608+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c19a000 con 0x7f525c0ffd60 2024-09-10T09:45:16.611 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.609+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c107680 con 0x7f525c0ffd60 2024-09-10T09:45:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.609+0000 7f5252ffd700 1 -- 172.21.15.79:0/3315393476 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f525800f5d0 con 0x7f525c0ffd60 2024-09-10T09:45:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.610+0000 7f5252ffd700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f524806e200 0x7f52480706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.610+0000 7f5252ffd700 1 -- 172.21.15.79:0/3315393476 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f525808f570 con 0x7f525c0ffd60 2024-09-10T09:45:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.610+0000 7f5261d0a700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f524806e200 0x7f52480706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.610+0000 7f5261d0a700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f524806e200 0x7f52480706b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f524c007900 tx=0x7f524c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:16.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.614+0000 7f5252ffd700 1 -- 172.21.15.79:0/3315393476 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5258058a00 con 0x7f525c0ffd60 2024-09-10T09:45:16.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:16 smithi135 ceph-mon[65362]: Upgrade: Updating mds.cephfs.smithi079.wpfdzn 2024-09-10T09:45:16.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:16.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi079.wpfdzn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:45:16.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:16.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:16 smithi135 ceph-mon[65362]: Deploying daemon mds.cephfs.smithi079.wpfdzn on smithi079 2024-09-10T09:45:16.846 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.844+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f525c19a2e0 con 0x7f524806e200 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.854+0000 7f5252ffd700 1 -- 172.21.15.79:0/3315393476 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f525c19a2e0 con 0x7f524806e200 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (6m) 7s ago 17m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (17m) 7s ago 17m 8980k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (16m) 26s ago 16m 8694k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (3m) 7s ago 17m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (3m) 26s ago 16m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (6m) 7s ago 16m 81.4M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (12s) 7s ago 11m 14.0M - 19.1.1-305-g1cf819b7 41d671128357 8b9798263ca8 2024-09-10T09:45:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (11m) 7s ago 11m 11.4M - 18.2.0 dc2bc1663786 c5789047c6cb 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (11m) 26s ago 11m 151M - 18.2.0 dc2bc1663786 dd7af01b8f07 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (11m) 26s ago 11m 21.5M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (8m) 7s ago 18m 504M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (7m) 26s ago 16m 441M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (4m) 7s ago 18m 54.0M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (4m) 26s ago 16m 41.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 7s ago 17m 15.0M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (7m) 26s ago 16m 16.2M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (3m) 7s ago 15m 105M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (2m) 7s ago 14m 109M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (2m) 7s ago 14m 97.2M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (95s) 26s ago 14m 106M 4096M 19.1.1-305-g1cf819b7 41d671128357 8c3025b323fc 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (62s) 26s ago 13m 108M 4096M 19.1.1-305-g1cf819b7 41d671128357 05ee4cd92ec3 2024-09-10T09:45:16.856 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (29s) 26s ago 13m 12.1M 4096M 19.1.1-305-g1cf819b7 41d671128357 e48bce7b2061 2024-09-10T09:45:16.857 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (6m) 7s ago 16m 81.2M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:45:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f524806e200 msgr2=0x7f52480706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f524806e200 0x7f52480706b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f524c007900 tx=0x7f524c008040 comp rx=0 tx=0).stop 2024-09-10T09:45:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 msgr2=0x7f525c195420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c195420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f52580092e0 tx=0x7f525800be20 comp rx=0 tx=0).stop 2024-09-10T09:45:16.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 shutdown_connections 2024-09-10T09:45:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f524806e200 0x7f52480706b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c0ff3c0 0x7f525c194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 --2- 172.21.15.79:0/3315393476 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f525c0ffd60 0x7f525c195420 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 >> 172.21.15.79:0/3315393476 conn(0x7f525c0fac80 msgr2=0x7f525c0fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 shutdown_connections 2024-09-10T09:45:16.858 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.856+0000 7f5263f6e700 1 -- 172.21.15.79:0/3315393476 wait complete. 2024-09-10T09:45:16.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 -- 172.21.15.79:0/3581411287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101c20 msgr2=0x7f133410a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 --2- 172.21.15.79:0/3581411287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101c20 0x7f133410a2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1320009910 tx=0x7f1320009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:16.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 -- 172.21.15.79:0/3581411287 shutdown_connections 2024-09-10T09:45:16.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 --2- 172.21.15.79:0/3581411287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101c20 0x7f133410a2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 --2- 172.21.15.79:0/3581411287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1334101310 0x7f13341016e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.965 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 -- 172.21.15.79:0/3581411287 >> 172.21.15.79:0/3581411287 conn(0x7f13340fac60 msgr2=0x7f13340fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 -- 172.21.15.79:0/3581411287 shutdown_connections 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.962+0000 7f133ac23700 1 -- 172.21.15.79:0/3581411287 wait complete. 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f133ac23700 1 Processor -- start 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f133ac23700 1 -- start start 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f133ac23700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101310 0x7f13340ff140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f133ac23700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1334101c20 0x7f13340ff680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f133ac23700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340ffbc0 con 0x7f1334101310 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f133ac23700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340ffd00 con 0x7f1334101c20 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f13389bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101310 0x7f13340ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f13389bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101310 0x7f13340ff140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38806/0 (socket says 172.21.15.79:38806) 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.963+0000 7f13389bf700 1 -- 172.21.15.79:0/867889047 learned_addr learned my addr 172.21.15.79:0/867889047 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f1333fff700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1334101c20 0x7f13340ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f13389bf700 1 -- 172.21.15.79:0/867889047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1334101c20 msgr2=0x7f13340ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f13389bf700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1334101c20 0x7f13340ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f13389bf700 1 -- 172.21.15.79:0/867889047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200095f0 con 0x7f1334101310 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f1333fff700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1334101c20 0x7f13340ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f13389bf700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101310 0x7f13340ff140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f132800c8a0 tx=0x7f132800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f1331ffb700 1 -- 172.21.15.79:0/867889047 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132800cea0 con 0x7f1334101310 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13341a2080 con 0x7f1334101310 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f1331ffb700 1 -- 172.21.15.79:0/867889047 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1328004830 con 0x7f1334101310 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f1331ffb700 1 -- 172.21.15.79:0/867889047 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13280055b0 con 0x7f1334101310 2024-09-10T09:45:16.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.964+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13341a2490 con 0x7f1334101310 2024-09-10T09:45:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.965+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13341079f0 con 0x7f1334101310 2024-09-10T09:45:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.966+0000 7f1331ffb700 1 -- 172.21.15.79:0/867889047 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f13280049a0 con 0x7f1334101310 2024-09-10T09:45:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.966+0000 7f1331ffb700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f132406e200 0x7f13240706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.967+0000 7f1331ffb700 1 -- 172.21.15.79:0/867889047 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f132808dc90 con 0x7f1334101310 2024-09-10T09:45:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.967+0000 7f1333fff700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f132406e200 0x7f13240706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:16.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.967+0000 7f1333fff700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f132406e200 0x7f13240706b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f132000b5c0 tx=0x7f132000b7d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:16.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:16.972+0000 7f1331ffb700 1 -- 172.21.15.79:0/867889047 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1328057120 con 0x7f1334101310 2024-09-10T09:45:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.286+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13341073d0 con 0x7f1334101310 2024-09-10T09:45:17.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.287+0000 7f1331ffb700 1 -- 172.21.15.79:0/867889047 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f132801d340 con 0x7f1334101310 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:45:17.288 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 1 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 3, 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 11 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:45:17.289 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f132406e200 msgr2=0x7f13240706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f132406e200 0x7f13240706b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f132000b5c0 tx=0x7f132000b7d0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101310 msgr2=0x7f13340ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101310 0x7f13340ff140 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f132800c8a0 tx=0x7f132800cc60 comp rx=0 tx=0).stop 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 shutdown_connections 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f132406e200 0x7f13240706b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1334101310 0x7f13340ff140 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 --2- 172.21.15.79:0/867889047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1334101c20 0x7f13340ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 >> 172.21.15.79:0/867889047 conn(0x7f13340fac60 msgr2=0x7f1334104b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 shutdown_connections 2024-09-10T09:45:17.291 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.289+0000 7f133ac23700 1 -- 172.21.15.79:0/867889047 wait complete. 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 -- 172.21.15.79:0/1937953602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 msgr2=0x7f956c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 --2- 172.21.15.79:0/1937953602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c1008b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f955c009910 tx=0x7f955c009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 -- 172.21.15.79:0/1937953602 shutdown_connections 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 --2- 172.21.15.79:0/1937953602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c100e80 0x7f956c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 --2- 172.21.15.79:0/1937953602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c1008b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 -- 172.21.15.79:0/1937953602 >> 172.21.15.79:0/1937953602 conn(0x7f956c0fbda0 msgr2=0x7f956c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 -- 172.21.15.79:0/1937953602 shutdown_connections 2024-09-10T09:45:17.396 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 -- 172.21.15.79:0/1937953602 wait complete. 2024-09-10T09:45:17.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.395+0000 7f9572233700 1 Processor -- start 2024-09-10T09:45:17.398 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f9572233700 1 -- start start 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f9572233700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f9572233700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c100e80 0x7f956c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f9572233700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c196b10 con 0x7f956c1004e0 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f9572233700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c19a8a0 con 0x7f956c100e80 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38832/0 (socket says 172.21.15.79:38832) 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956b7fe700 1 -- 172.21.15.79:0/3098454114 learned_addr learned my addr 172.21.15.79:0/3098454114 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956affd700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c100e80 0x7f956c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956b7fe700 1 -- 172.21.15.79:0/3098454114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c100e80 msgr2=0x7f956c196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956b7fe700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c100e80 0x7f956c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956b7fe700 1 -- 172.21.15.79:0/3098454114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0095f0 con 0x7f956c1004e0 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.396+0000 7f956b7fe700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c195ef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f955c006010 tx=0x7f955c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:17.399 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.397+0000 7f9568ff9700 1 -- 172.21.15.79:0/3098454114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f955c01d070 con 0x7f956c1004e0 2024-09-10T09:45:17.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.397+0000 7f9568ff9700 1 -- 172.21.15.79:0/3098454114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f955c00f460 con 0x7f956c1004e0 2024-09-10T09:45:17.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.397+0000 7f9568ff9700 1 -- 172.21.15.79:0/3098454114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f955c017630 con 0x7f956c1004e0 2024-09-10T09:45:17.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.397+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c19ab20 con 0x7f956c1004e0 2024-09-10T09:45:17.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.397+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c19b010 con 0x7f956c1004e0 2024-09-10T09:45:17.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.398+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c1087f0 con 0x7f956c1004e0 2024-09-10T09:45:17.400 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.398+0000 7f9568ff9700 1 -- 172.21.15.79:0/3098454114 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f955c00f5d0 con 0x7f956c1004e0 2024-09-10T09:45:17.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.399+0000 7f9568ff9700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f955406e200 0x7f95540706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:17.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.399+0000 7f9568ff9700 1 -- 172.21.15.79:0/3098454114 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f955c08f4a0 con 0x7f956c1004e0 2024-09-10T09:45:17.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.399+0000 7f956affd700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f955406e200 0x7f95540706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:17.401 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.399+0000 7f956affd700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f955406e200 0x7f95540706b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f956c197510 tx=0x7f95600094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:17.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.403+0000 7f9568ff9700 1 -- 172.21.15.79:0/3098454114 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f955c058930 con 0x7f956c1004e0 2024-09-10T09:45:17.653 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.652+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f956c1081d0 con 0x7f956c1004e0 2024-09-10T09:45:17.653 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:17 smithi079 ceph-mon[87213]: pgmap v177: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:17.654 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:17 smithi079 ceph-mon[87213]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.652+0000 7f9568ff9700 1 -- 172.21.15.79:0/3098454114 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1924 (secure 0 0 0) 0x7f955c05bff0 con 0x7f956c1004e0 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stdout:e20 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stdout:btime 2024-09-10T09:45:05:137194+0000 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:17.654 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 17 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:44:56.507694+0000 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:45:17.655 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 0 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24281} 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:45:17.656 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 24281 members: 24281 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{0:24281} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.135:6824/3101337164,v1:172.21.15.135:6825/3101337164] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:24287} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6828/32452037,v1:172.21.15.79:6829/32452037] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:45:17.657 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:45:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f955406e200 msgr2=0x7f95540706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f955406e200 0x7f95540706b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f956c197510 tx=0x7f95600094f0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 msgr2=0x7f956c195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c195ef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f955c006010 tx=0x7f955c00be20 comp rx=0 tx=0).stop 2024-09-10T09:45:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 shutdown_connections 2024-09-10T09:45:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f955406e200 0x7f95540706b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f956c1004e0 0x7f956c195ef0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 --2- 172.21.15.79:0/3098454114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f956c100e80 0x7f956c196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 >> 172.21.15.79:0/3098454114 conn(0x7f956c0fbda0 msgr2=0x7f956c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 shutdown_connections 2024-09-10T09:45:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.656+0000 7f9572233700 1 -- 172.21.15.79:0/3098454114 wait complete. 2024-09-10T09:45:17.659 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 20 2024-09-10T09:45:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:17 smithi135 ceph-mon[65362]: pgmap v177: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:17 smithi135 ceph-mon[65362]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:17.762 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 -- 172.21.15.79:0/1406527120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 msgr2=0x7fcf641017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 --2- 172.21.15.79:0/1406527120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf641017f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009910 tx=0x7fcf54009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 -- 172.21.15.79:0/1406527120 shutdown_connections 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 --2- 172.21.15.79:0/1406527120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf64101d30 0x7fcf6410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 --2- 172.21.15.79:0/1406527120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf641017f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 -- 172.21.15.79:0/1406527120 >> 172.21.15.79:0/1406527120 conn(0x7fcf640fac60 msgr2=0x7fcf640fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 -- 172.21.15.79:0/1406527120 shutdown_connections 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.761+0000 7fcf68acd700 1 -- 172.21.15.79:0/1406527120 wait complete. 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf68acd700 1 Processor -- start 2024-09-10T09:45:17.763 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf68acd700 1 -- start start 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf68acd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf640ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf68acd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf64101d30 0x7fcf640ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf68acd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640ffb00 con 0x7fcf64101420 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf68acd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640ffc40 con 0x7fcf64101d30 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf6259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf640ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf6259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf640ff080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38844/0 (socket says 172.21.15.79:38844) 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.762+0000 7fcf6259c700 1 -- 172.21.15.79:0/322166001 learned_addr learned my addr 172.21.15.79:0/322166001 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf6259c700 1 -- 172.21.15.79:0/322166001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf64101d30 msgr2=0x7fcf640ff5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf6259c700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf64101d30 0x7fcf640ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf6259c700 1 -- 172.21.15.79:0/322166001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf540095f0 con 0x7fcf64101420 2024-09-10T09:45:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf6259c700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf640ff080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf54006010 tx=0x7fcf5400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf537fe700 1 -- 172.21.15.79:0/322166001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf5401d070 con 0x7fcf64101420 2024-09-10T09:45:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf640ffec0 con 0x7fcf64101420 2024-09-10T09:45:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf537fe700 1 -- 172.21.15.79:0/322166001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf5400f460 con 0x7fcf64101420 2024-09-10T09:45:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf537fe700 1 -- 172.21.15.79:0/322166001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf54017630 con 0x7fcf64101420 2024-09-10T09:45:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.763+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf641a23a0 con 0x7fcf64101420 2024-09-10T09:45:17.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.764+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf64107900 con 0x7fcf64101420 2024-09-10T09:45:17.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.765+0000 7fcf537fe700 1 -- 172.21.15.79:0/322166001 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcf5400f5d0 con 0x7fcf64101420 2024-09-10T09:45:17.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.765+0000 7fcf537fe700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcf4c06e200 0x7fcf4c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:17.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.765+0000 7fcf537fe700 1 -- 172.21.15.79:0/322166001 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcf5408f450 con 0x7fcf64101420 2024-09-10T09:45:17.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.765+0000 7fcf61d9b700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcf4c06e200 0x7fcf4c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:17.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.766+0000 7fcf61d9b700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcf4c06e200 0x7fcf4c0706b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcf58005950 tx=0x7fcf580058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:17.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.769+0000 7fcf537fe700 1 -- 172.21.15.79:0/322166001 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf540588e0 con 0x7fcf64101420 2024-09-10T09:45:17.999 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:17.998+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf64061190 con 0x7fcf4c06e200 2024-09-10T09:45:18.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.000+0000 7fcf537fe700 1 -- 172.21.15.79:0/322166001 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fcf64061190 con 0x7fcf4c06e200 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "osd", 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "13/23 daemons upgraded", 2024-09-10T09:45:18.001 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading mds daemons", 2024-09-10T09:45:18.002 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:45:18.002 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:45:18.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcf4c06e200 msgr2=0x7fcf4c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:18.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcf4c06e200 0x7fcf4c0706b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcf58005950 tx=0x7fcf580058e0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 msgr2=0x7fcf640ff080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:18.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf640ff080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf54006010 tx=0x7fcf5400be20 comp rx=0 tx=0).stop 2024-09-10T09:45:18.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 shutdown_connections 2024-09-10T09:45:18.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fcf4c06e200 0x7fcf4c0706b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf64101420 0x7fcf640ff080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 --2- 172.21.15.79:0/322166001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf64101d30 0x7fcf640ff5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 >> 172.21.15.79:0/322166001 conn(0x7fcf640fac60 msgr2=0x7fcf64104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:18.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 shutdown_connections 2024-09-10T09:45:18.004 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.002+0000 7fcf68acd700 1 -- 172.21.15.79:0/322166001 wait complete. 2024-09-10T09:45:18.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 -- 172.21.15.79:0/3539378185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 msgr2=0x7f8488100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 --2- 172.21.15.79:0/3539378185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488100830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8470009910 tx=0x7f8470009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 -- 172.21.15.79:0/3539378185 shutdown_connections 2024-09-10T09:45:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 --2- 172.21.15.79:0/3539378185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8488100d70 0x7f84881094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 --2- 172.21.15.79:0/3539378185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488100830 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 -- 172.21.15.79:0/3539378185 >> 172.21.15.79:0/3539378185 conn(0x7f84880748b0 msgr2=0x7f8488074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 -- 172.21.15.79:0/3539378185 shutdown_connections 2024-09-10T09:45:18.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.107+0000 7f848ced2700 1 -- 172.21.15.79:0/3539378185 wait complete. 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848ced2700 1 Processor -- start 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848ced2700 1 -- start start 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848ced2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848ced2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8488100d70 0x7f84881964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848ced2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488196bc0 con 0x7f8488100460 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848ced2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848819a950 con 0x7f8488100d70 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38864/0 (socket says 172.21.15.79:38864) 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.108+0000 7f848659c700 1 -- 172.21.15.79:0/1626314644 learned_addr learned my addr 172.21.15.79:0/1626314644 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:18.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f8485d9b700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8488100d70 0x7f84881964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f848659c700 1 -- 172.21.15.79:0/1626314644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8488100d70 msgr2=0x7f84881964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f848659c700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8488100d70 0x7f84881964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f848659c700 1 -- 172.21.15.79:0/1626314644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700095f0 con 0x7f8488100460 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f848659c700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488195fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8470006010 tx=0x7f847000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f847f7fe700 1 -- 172.21.15.79:0/1626314644 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847001d070 con 0x7f8488100460 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848819abd0 con 0x7f8488100460 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f847f7fe700 1 -- 172.21.15.79:0/1626314644 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8470004fb0 con 0x7f8488100460 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f847f7fe700 1 -- 172.21.15.79:0/1626314644 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8470022ea0 con 0x7f8488100460 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.109+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848819b0c0 con 0x7f8488100460 2024-09-10T09:45:18.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.110+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8488107e40 con 0x7f8488100460 2024-09-10T09:45:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.111+0000 7f847f7fe700 1 -- 172.21.15.79:0/1626314644 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8470022470 con 0x7f8488100460 2024-09-10T09:45:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.111+0000 7f847f7fe700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f847406e200 0x7f84740706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.111+0000 7f847f7fe700 1 -- 172.21.15.79:0/1626314644 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f847008f560 con 0x7f8488100460 2024-09-10T09:45:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.111+0000 7f8485d9b700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f847406e200 0x7f84740706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:18.113 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.112+0000 7f8485d9b700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f847406e200 0x7f84740706b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8478006fd0 tx=0x7f8478008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:18.116 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.116+0000 7f847f7fe700 1 -- 172.21.15.79:0/1626314644 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8470058aa0 con 0x7f8488100460 2024-09-10T09:45:18.404 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.403+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f848804f2a0 con 0x7f8488100460 2024-09-10T09:45:18.404 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:18 smithi079 ceph-mon[87213]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:18.404 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:18 smithi079 ceph-mon[87213]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:18.404 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:18 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/867889047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:18.404 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:18 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3098454114' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:45:18.404 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:18 smithi079 ceph-mon[87213]: osdmap e84: 6 total, 6 up, 6 in 2024-09-10T09:45:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.403+0000 7f847f7fe700 1 -- 172.21.15.79:0/1626314644 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f8470022720 con 0x7f8488100460 2024-09-10T09:45:18.405 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:45:18.405 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:45:18.405 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:45:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f847406e200 msgr2=0x7f84740706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f847406e200 0x7f84740706b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8478006fd0 tx=0x7f8478008040 comp rx=0 tx=0).stop 2024-09-10T09:45:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 msgr2=0x7f8488195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488195fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8470006010 tx=0x7f847000be20 comp rx=0 tx=0).stop 2024-09-10T09:45:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 shutdown_connections 2024-09-10T09:45:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f847406e200 0x7f84740706b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8488100460 0x7f8488195fa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 --2- 172.21.15.79:0/1626314644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8488100d70 0x7f84881964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 >> 172.21.15.79:0/1626314644 conn(0x7f84880748b0 msgr2=0x7f84880fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 shutdown_connections 2024-09-10T09:45:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:18.405+0000 7f848ced2700 1 -- 172.21.15.79:0/1626314644 wait complete. 2024-09-10T09:45:18.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:18 smithi135 ceph-mon[65362]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:18.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:18 smithi135 ceph-mon[65362]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:18.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:18 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/867889047' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:18.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:18 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3098454114' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:45:18.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:18 smithi135 ceph-mon[65362]: osdmap e84: 6 total, 6 up, 6 in 2024-09-10T09:45:19.619 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:19 smithi135 ceph-mon[65362]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:19.620 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:19 smithi135 ceph-mon[65362]: pgmap v179: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:19.620 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:19 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 2 up:standby 2024-09-10T09:45:19.620 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:19 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1626314644' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:45:19.620 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:19.620 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:19 smithi079 ceph-mon[87213]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:19 smithi079 ceph-mon[87213]: pgmap v179: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:19 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 2 up:standby 2024-09-10T09:45:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:19 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1626314644' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:45:19.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:19.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:21.668 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:21 smithi079 ceph-mon[87213]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:21.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:21 smithi135 ceph-mon[65362]: pgmap v180: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:23 smithi079 ceph-mon[87213]: pgmap v181: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:23.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:23 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:23.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:23 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:23.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:23 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:23.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:23 smithi135 ceph-mon[65362]: pgmap v181: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:23.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:23 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:23.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:23 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:23.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:23 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:24.614 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:24 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.79:6828/2505923187,v1:172.21.15.79:6829/2505923187] up:boot 2024-09-10T09:45:24.615 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:24 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:45:24.615 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:24 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:45:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:24 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.79:6828/2505923187,v1:172.21.15.79:6829/2505923187] up:boot 2024-09-10T09:45:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:24 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.lvmrsq=up:active} 3 up:standby 2024-09-10T09:45:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:24 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:45:25.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:25 smithi079 ceph-mon[87213]: pgmap v182: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:25.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:25 smithi135 ceph-mon[65362]: pgmap v182: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:27.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:27 smithi079 ceph-mon[87213]: pgmap v183: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:27.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:27 smithi135 ceph-mon[65362]: pgmap v183: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:28.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:28 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:28 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:28 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.707 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:28 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.708 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:28 smithi079 ceph-mon[87213]: pgmap v184: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:28.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:28 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:28 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:28 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:28 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:28.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:28 smithi135 ceph-mon[65362]: pgmap v184: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:31.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:31 smithi079 ceph-mon[87213]: pgmap v185: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:31.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:31 smithi135 ceph-mon[65362]: pgmap v185: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:32.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:32.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:32 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:32.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:32.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:32 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:33.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:33 smithi135 ceph-mon[65362]: pgmap v186: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:33.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:33 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:33.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:33 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:45:33.525 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:33 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:33.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:33 smithi079 ceph-mon[87213]: pgmap v186: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:33.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:33 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:33.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:33 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.lvmrsq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:45:33.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:33 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:34.431 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:34 smithi135 ceph-mon[65362]: Upgrade: Updating mds.cephfs.smithi135.lvmrsq 2024-09-10T09:45:34.431 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:34 smithi135 ceph-mon[65362]: Deploying daemon mds.cephfs.smithi135.lvmrsq on smithi135 2024-09-10T09:45:34.431 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:34 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:34.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:34 smithi079 ceph-mon[87213]: Upgrade: Updating mds.cephfs.smithi135.lvmrsq 2024-09-10T09:45:34.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:34 smithi079 ceph-mon[87213]: Deploying daemon mds.cephfs.smithi135.lvmrsq on smithi135 2024-09-10T09:45:34.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:34.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:34 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[87209]: 2024-09-10T09:45:34.670+0000 7f5aa7dcb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:45:35.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: pgmap v187: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: osdmap e85: 6 total, 6 up, 6 in 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: Standby daemon mds.cephfs.smithi135.oqqtlp assigned to filesystem cephfs as rank 0 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: fsmap cephfs:1/1 {0=cephfs.smithi135.oqqtlp=up:replay} 2 up:standby 2024-09-10T09:45:35.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:45:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: pgmap v187: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T09:45:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:45:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: osdmap e85: 6 total, 6 up, 6 in 2024-09-10T09:45:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: Standby daemon mds.cephfs.smithi135.oqqtlp assigned to filesystem cephfs as rank 0 2024-09-10T09:45:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T09:45:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-10T09:45:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: fsmap cephfs:1/1 {0=cephfs.smithi135.oqqtlp=up:replay} 2 up:standby 2024-09-10T09:45:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:45:37.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:37 smithi079 ceph-mon[87213]: pgmap v189: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:37.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:37 smithi135 ceph-mon[65362]: pgmap v189: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail 2024-09-10T09:45:38.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:38 smithi135 ceph-mon[65362]: pgmap v190: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 1 op/s 2024-09-10T09:45:38.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:38 smithi079 ceph-mon[87213]: pgmap v190: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 1 op/s 2024-09-10T09:45:41.456 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:41 smithi135 ceph-mon[65362]: pgmap v191: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-10T09:45:41.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:41 smithi079 ceph-mon[87213]: pgmap v191: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-10T09:45:43.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:43 smithi079 ceph-mon[87213]: pgmap v192: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-10T09:45:43.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:43 smithi135 ceph-mon[65362]: pgmap v192: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-10T09:45:44.695 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:44 smithi079 ceph-mon[87213]: reconnect by client.24309 v1:192.168.0.1:0/3633561501 after 0 2024-09-10T09:45:44.695 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:44 smithi079 ceph-mon[87213]: reconnect by client.14510 v1:192.168.0.1:0/871001870 after 0.00099998 2024-09-10T09:45:44.695 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:44 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:reconnect 2024-09-10T09:45:44.696 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:44 smithi079 ceph-mon[87213]: fsmap cephfs:1/1 {0=cephfs.smithi135.oqqtlp=up:reconnect} 2 up:standby 2024-09-10T09:45:44.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:44 smithi135 ceph-mon[65362]: reconnect by client.24309 v1:192.168.0.1:0/3633561501 after 0 2024-09-10T09:45:44.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:44 smithi135 ceph-mon[65362]: reconnect by client.14510 v1:192.168.0.1:0/871001870 after 0.00099998 2024-09-10T09:45:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:44 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:reconnect 2024-09-10T09:45:44.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:44 smithi135 ceph-mon[65362]: fsmap cephfs:1/1 {0=cephfs.smithi135.oqqtlp=up:reconnect} 2 up:standby 2024-09-10T09:45:45.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:45 smithi135 ceph-mon[65362]: pgmap v193: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-10T09:45:45.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:45 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:rejoin 2024-09-10T09:45:45.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:45 smithi135 ceph-mon[65362]: fsmap cephfs:1/1 {0=cephfs.smithi135.oqqtlp=up:rejoin} 2 up:standby 2024-09-10T09:45:45.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:45 smithi135 ceph-mon[65362]: daemon mds.cephfs.smithi135.oqqtlp is now active in filesystem cephfs as rank 0 2024-09-10T09:45:45.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:45 smithi079 ceph-mon[87213]: pgmap v193: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-10T09:45:45.596 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:45 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:rejoin 2024-09-10T09:45:45.597 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:45 smithi079 ceph-mon[87213]: fsmap cephfs:1/1 {0=cephfs.smithi135.oqqtlp=up:rejoin} 2 up:standby 2024-09-10T09:45:45.597 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:45 smithi079 ceph-mon[87213]: daemon mds.cephfs.smithi135.oqqtlp is now active in filesystem cephfs as rank 0 2024-09-10T09:45:46.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:46 smithi135 ceph-mon[65362]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T09:45:46.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:46 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:active 2024-09-10T09:45:46.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:46 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.oqqtlp=up:active} 2 up:standby 2024-09-10T09:45:46.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:46 smithi079 ceph-mon[87213]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T09:45:46.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:46 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] up:active 2024-09-10T09:45:46.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:46 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.oqqtlp=up:active} 2 up:standby 2024-09-10T09:45:47.394 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:47 smithi135 ceph-mon[65362]: pgmap v194: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 89 B/s wr, 5 op/s 2024-09-10T09:45:47.394 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:47 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:47.394 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:47 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:47.394 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:47 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:47.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:47 smithi079 ceph-mon[87213]: pgmap v194: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 89 B/s wr, 5 op/s 2024-09-10T09:45:47.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:47 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:47.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:47 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:47.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:47 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:48.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.526+0000 7f532a072700 1 -- 172.21.15.79:0/1735878269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 msgr2=0x7f5324104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:48.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.526+0000 7f532a072700 1 --2- 172.21.15.79:0/1735878269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324104500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5314009910 tx=0x7f5314009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:48.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 -- 172.21.15.79:0/1735878269 shutdown_connections 2024-09-10T09:45:48.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 --2- 172.21.15.79:0/1735878269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53240ffbd0 0x7f5324100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 --2- 172.21.15.79:0/1735878269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324104500 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 -- 172.21.15.79:0/1735878269 >> 172.21.15.79:0/1735878269 conn(0x7f5324075130 msgr2=0x7f5324075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 -- 172.21.15.79:0/1735878269 shutdown_connections 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 -- 172.21.15.79:0/1735878269 wait complete. 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 Processor -- start 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 -- start start 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53240ffbd0 0x7f5324194d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.527+0000 7f532a072700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f532a072700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53241958d0 con 0x7f5324104130 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f532a072700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324195a10 con 0x7f53240ffbd0 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f531bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:48.530 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f531bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324195280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51900/0 (socket says 172.21.15.79:51900) 2024-09-10T09:45:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f53237fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53240ffbd0 0x7f5324194d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f531bfff700 1 -- 172.21.15.79:0/2636875673 learned_addr learned my addr 172.21.15.79:0/2636875673 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f531bfff700 1 -- 172.21.15.79:0/2636875673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53240ffbd0 msgr2=0x7f5324194d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f531bfff700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53240ffbd0 0x7f5324194d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f531bfff700 1 -- 172.21.15.79:0/2636875673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140095f0 con 0x7f5324104130 2024-09-10T09:45:48.531 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.528+0000 7f531bfff700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324195280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c930 tx=0x7f530c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.531+0000 7f53217fa700 1 -- 172.21.15.79:0/2636875673 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530c007ad0 con 0x7f5324104130 2024-09-10T09:45:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.531+0000 7f53217fa700 1 -- 172.21.15.79:0/2636875673 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f530c00ce80 con 0x7f5324104130 2024-09-10T09:45:48.532 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.531+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5324199860 con 0x7f5324104130 2024-09-10T09:45:48.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.531+0000 7f53217fa700 1 -- 172.21.15.79:0/2636875673 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f530c018630 con 0x7f5324104130 2024-09-10T09:45:48.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.531+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5324199db0 con 0x7f5324104130 2024-09-10T09:45:48.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.532+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53241076a0 con 0x7f5324104130 2024-09-10T09:45:48.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.533+0000 7f53217fa700 1 -- 172.21.15.79:0/2636875673 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f530c00f450 con 0x7f5324104130 2024-09-10T09:45:48.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.534+0000 7f53217fa700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f531006e250 0x7f5310070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:48.534 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.534+0000 7f53217fa700 1 -- 172.21.15.79:0/2636875673 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f530c08df20 con 0x7f5324104130 2024-09-10T09:45:48.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.534+0000 7f53237fe700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f531006e250 0x7f5310070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:48.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.534+0000 7f53237fe700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f531006e250 0x7f5310070700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5314006010 tx=0x7f531401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:48.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.546+0000 7f53217fa700 1 -- 172.21.15.79:0/2636875673 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f530c0c31b0 con 0x7f5324104130 2024-09-10T09:45:48.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.767+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53241961b0 con 0x7f531006e250 2024-09-10T09:45:48.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.768+0000 7f53217fa700 1 -- 172.21.15.79:0/2636875673 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f53241961b0 con 0x7f531006e250 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.770+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f531006e250 msgr2=0x7f5310070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.770+0000 7f532a072700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f531006e250 0x7f5310070700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5314006010 tx=0x7f531401a040 comp rx=0 tx=0).stop 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.770+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 msgr2=0x7f5324195280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.770+0000 7f532a072700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324195280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f530c00c930 tx=0x7f530c00cc40 comp rx=0 tx=0).stop 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.771+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 shutdown_connections 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.771+0000 7f532a072700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f531006e250 0x7f5310070700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.771+0000 7f532a072700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53240ffbd0 0x7f5324194d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.771+0000 7f532a072700 1 --2- 172.21.15.79:0/2636875673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5324104130 0x7f5324195280 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.771+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 >> 172.21.15.79:0/2636875673 conn(0x7f5324075130 msgr2=0x7f53240fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.771+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 shutdown_connections 2024-09-10T09:45:48.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.771+0000 7f532a072700 1 -- 172.21.15.79:0/2636875673 wait complete. 2024-09-10T09:45:48.782 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:45:48.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:48 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.135:6824/1647814509,v1:172.21.15.135:6825/1647814509] up:boot 2024-09-10T09:45:48.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:48 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi135.oqqtlp=up:active} 3 up:standby 2024-09-10T09:45:48.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:48 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:45:48.782 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:48 smithi079 ceph-mon[87213]: pgmap v195: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T09:45:48.829 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:48 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.135:6824/1647814509,v1:172.21.15.135:6825/1647814509] up:boot 2024-09-10T09:45:48.829 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:48 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi135.oqqtlp=up:active} 3 up:standby 2024-09-10T09:45:48.829 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:48 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:45:48.829 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:48 smithi135 ceph-mon[65362]: pgmap v195: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-10T09:45:48.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 -- 172.21.15.79:0/2930770514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 msgr2=0x7f12b0104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:48.876 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 --2- 172.21.15.79:0/2930770514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0104e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009910 tx=0x7f12a4009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:48.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 -- 172.21.15.79:0/2930770514 shutdown_connections 2024-09-10T09:45:48.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 --2- 172.21.15.79:0/2930770514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0104e50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 --2- 172.21.15.79:0/2930770514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01004e0 0x7f12b01008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 -- 172.21.15.79:0/2930770514 >> 172.21.15.79:0/2930770514 conn(0x7f12b00fbda0 msgr2=0x7f12b00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:48.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 -- 172.21.15.79:0/2930770514 shutdown_connections 2024-09-10T09:45:48.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.875+0000 7f12b6783700 1 -- 172.21.15.79:0/2930770514 wait complete. 2024-09-10T09:45:48.878 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.876+0000 7f12b6783700 1 Processor -- start 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.876+0000 7f12b6783700 1 -- start start 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.876+0000 7f12b6783700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01004e0 0x7f12b0195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.876+0000 7f12b6783700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.876+0000 7f12b6783700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b0196b30 con 0x7f12b0100e80 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.876+0000 7f12b6783700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b019a850 con 0x7f12b01004e0 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12af7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12af7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51926/0 (socket says 172.21.15.79:51926) 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12af7fe700 1 -- 172.21.15.79:0/3195996523 learned_addr learned my addr 172.21.15.79:0/3195996523 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12affff700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01004e0 0x7f12b0195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12af7fe700 1 -- 172.21.15.79:0/3195996523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01004e0 msgr2=0x7f12b0195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12af7fe700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01004e0 0x7f12b0195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12af7fe700 1 -- 172.21.15.79:0/3195996523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40095f0 con 0x7f12b0100e80 2024-09-10T09:45:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12af7fe700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0196450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f12a400bda0 tx=0x7f12a400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12ad7fa700 1 -- 172.21.15.79:0/3195996523 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12a401d070 con 0x7f12b0100e80 2024-09-10T09:45:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b019aad0 con 0x7f12b0100e80 2024-09-10T09:45:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12ad7fa700 1 -- 172.21.15.79:0/3195996523 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12a4005dc0 con 0x7f12b0100e80 2024-09-10T09:45:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12ad7fa700 1 -- 172.21.15.79:0/3195996523 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12a4017400 con 0x7f12b0100e80 2024-09-10T09:45:48.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.877+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b019afc0 con 0x7f12b0100e80 2024-09-10T09:45:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.878+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b0108850 con 0x7f12b0100e80 2024-09-10T09:45:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.879+0000 7f12ad7fa700 1 -- 172.21.15.79:0/3195996523 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f12a400f460 con 0x7f12b0100e80 2024-09-10T09:45:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.879+0000 7f12ad7fa700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f129806e200 0x7f12980706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.879+0000 7f12ad7fa700 1 -- 172.21.15.79:0/3195996523 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f12a408f3e0 con 0x7f12b0100e80 2024-09-10T09:45:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.879+0000 7f12affff700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f129806e200 0x7f12980706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:48.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.879+0000 7f12affff700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f129806e200 0x7f12980706b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f12a0007be0 tx=0x7f12a00073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:48.884 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:48.883+0000 7f12ad7fa700 1 -- 172.21.15.79:0/3195996523 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f12a4058810 con 0x7f12b0100e80 2024-09-10T09:45:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.103+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b019b1e0 con 0x7f129806e200 2024-09-10T09:45:49.105 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.105+0000 7f12ad7fa700 1 -- 172.21.15.79:0/3195996523 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f12b019b1e0 con 0x7f129806e200 2024-09-10T09:45:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f129806e200 msgr2=0x7f12980706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f129806e200 0x7f12980706b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f12a0007be0 tx=0x7f12a00073d0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 msgr2=0x7f12b0196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0196450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f12a400bda0 tx=0x7f12a400bdd0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.108 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 shutdown_connections 2024-09-10T09:45:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f129806e200 0x7f12980706b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b01004e0 0x7f12b0195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 --2- 172.21.15.79:0/3195996523 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12b0100e80 0x7f12b0196450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 >> 172.21.15.79:0/3195996523 conn(0x7f12b00fbda0 msgr2=0x7f12b00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 shutdown_connections 2024-09-10T09:45:49.109 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.107+0000 7f12b6783700 1 -- 172.21.15.79:0/3195996523 wait complete. 2024-09-10T09:45:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 -- 172.21.15.79:0/3071144293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 msgr2=0x7fbcb81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.213 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 --2- 172.21.15.79:0/3071144293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb81008b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009910 tx=0x7fbcac009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 -- 172.21.15.79:0/3071144293 shutdown_connections 2024-09-10T09:45:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 --2- 172.21.15.79:0/3071144293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8100e80 0x7fbcb8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 --2- 172.21.15.79:0/3071144293 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb81008b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 -- 172.21.15.79:0/3071144293 >> 172.21.15.79:0/3071144293 conn(0x7fbcb80fbda0 msgr2=0x7fbcb80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 -- 172.21.15.79:0/3071144293 shutdown_connections 2024-09-10T09:45:49.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.212+0000 7fbcbef46700 1 -- 172.21.15.79:0/3071144293 wait complete. 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbef46700 1 Processor -- start 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbef46700 1 -- start start 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbef46700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbef46700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8100e80 0x7fbcb8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbef46700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb8196b10 con 0x7fbcb81004e0 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbef46700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb819a8a0 con 0x7fbcb8100e80 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbcce2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbcce2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb8195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51938/0 (socket says 172.21.15.79:51938) 2024-09-10T09:45:49.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcbcce2700 1 -- 172.21.15.79:0/1043828665 learned_addr learned my addr 172.21.15.79:0/1043828665 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.213+0000 7fbcb7fff700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8100e80 0x7fbcb8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcbcce2700 1 -- 172.21.15.79:0/1043828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8100e80 msgr2=0x7fbcb8196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcbcce2700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8100e80 0x7fbcb8196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcbcce2700 1 -- 172.21.15.79:0/1043828665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0095f0 con 0x7fbcb81004e0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcbcce2700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb8195ef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbcac006010 tx=0x7fbcac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcb5ffb700 1 -- 172.21.15.79:0/1043828665 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcac01d070 con 0x7fbcb81004e0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcb5ffb700 1 -- 172.21.15.79:0/1043828665 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcac00f460 con 0x7fbcb81004e0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb819ab20 con 0x7fbcb81004e0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcb5ffb700 1 -- 172.21.15.79:0/1043828665 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcac017630 con 0x7fbcb81004e0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.214+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb819b010 con 0x7fbcb81004e0 2024-09-10T09:45:49.217 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.215+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb81087f0 con 0x7fbcb81004e0 2024-09-10T09:45:49.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.216+0000 7fbcb5ffb700 1 -- 172.21.15.79:0/1043828665 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbcac00f5d0 con 0x7fbcb81004e0 2024-09-10T09:45:49.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.216+0000 7fbcb5ffb700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbca806e200 0x7fbca80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.216+0000 7fbcb5ffb700 1 -- 172.21.15.79:0/1043828665 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fbcac08f4d0 con 0x7fbcb81004e0 2024-09-10T09:45:49.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.216+0000 7fbcb7fff700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbca806e200 0x7fbca80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.216+0000 7fbcb7fff700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbca806e200 0x7fbca80706b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbca4005950 tx=0x7fbca40058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:49.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.220+0000 7fbcb5ffb700 1 -- 172.21.15.79:0/1043828665 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbcac058900 con 0x7fbcb81004e0 2024-09-10T09:45:49.434 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.433+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcb819b230 con 0x7fbca806e200 2024-09-10T09:45:49.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.443+0000 7fbcb5ffb700 1 -- 172.21.15.79:0/1043828665 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fbcb819b230 con 0x7fbca806e200 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (7m) 22s ago 17m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (17m) 22s ago 17m 9005k - 18.2.0 dc2bc1663786 b5bfbe8b3cd7 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (17m) 0s ago 17m 9059k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (4m) 22s ago 17m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (4m) 0s ago 16m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (6m) 22s ago 17m 81.4M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (45s) 22s ago 12m 16.2M - 19.1.1-305-g1cf819b7 41d671128357 8b9798263ca8 2024-09-10T09:45:49.444 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (27s) 22s ago 12m 13.2M - 19.1.1-305-g1cf819b7 41d671128357 0b76e0343289 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (3s) 0s ago 12m 11.6M - 19.1.1-305-g1cf819b7 41d671128357 c2b0b0dae143 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (12m) 0s ago 12m 89.5M - 18.2.0 dc2bc1663786 75aa7d773a95 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (8m) 22s ago 19m 504M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (8m) 0s ago 16m 442M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (5m) 22s ago 19m 56.7M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (5m) 0s ago 16m 43.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (7m) 22s ago 17m 15.3M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (7m) 0s ago 16m 16.3M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (3m) 22s ago 15m 105M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (3m) 22s ago 15m 109M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:45:49.445 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (2m) 22s ago 15m 97.3M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:45:49.446 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (2m) 0s ago 14m 120M 4096M 19.1.1-305-g1cf819b7 41d671128357 8c3025b323fc 2024-09-10T09:45:49.446 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (95s) 0s ago 14m 109M 4096M 19.1.1-305-g1cf819b7 41d671128357 05ee4cd92ec3 2024-09-10T09:45:49.448 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (62s) 0s ago 13m 104M 4096M 19.1.1-305-g1cf819b7 41d671128357 e48bce7b2061 2024-09-10T09:45:49.448 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (7m) 22s ago 17m 81.2M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbca806e200 msgr2=0x7fbca80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbca806e200 0x7fbca80706b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbca4005950 tx=0x7fbca40058e0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 msgr2=0x7fbcb8195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb8195ef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbcac006010 tx=0x7fbcac00be20 comp rx=0 tx=0).stop 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 shutdown_connections 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fbca806e200 0x7fbca80706b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcb81004e0 0x7fbcb8195ef0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 --2- 172.21.15.79:0/1043828665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcb8100e80 0x7fbcb8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 >> 172.21.15.79:0/1043828665 conn(0x7fbcb80fbda0 msgr2=0x7fbcb80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:49.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 shutdown_connections 2024-09-10T09:45:49.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.445+0000 7fbcbef46700 1 -- 172.21.15.79:0/1043828665 wait complete. 2024-09-10T09:45:49.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 -- 172.21.15.79:0/1147413487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ffd60 msgr2=0x7f1f1c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 --2- 172.21.15.79:0/1147413487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ffd60 0x7f1f1c103d30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009910 tx=0x7f1f18009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:49.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 -- 172.21.15.79:0/1147413487 shutdown_connections 2024-09-10T09:45:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 --2- 172.21.15.79:0/1147413487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ffd60 0x7f1f1c103d30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 --2- 172.21.15.79:0/1147413487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c0ff3c0 0x7f1f1c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 -- 172.21.15.79:0/1147413487 >> 172.21.15.79:0/1147413487 conn(0x7f1f1c0fac80 msgr2=0x7f1f1c0fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 -- 172.21.15.79:0/1147413487 shutdown_connections 2024-09-10T09:45:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.548+0000 7f1f246e2700 1 -- 172.21.15.79:0/1147413487 wait complete. 2024-09-10T09:45:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f246e2700 1 Processor -- start 2024-09-10T09:45:49.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f246e2700 1 -- start start 2024-09-10T09:45:49.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f246e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ff3c0 0x7f1f1c195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f246e2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c0ffd60 0x7f1f1c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f246e2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c196ab0 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f246e2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c19a840 con 0x7f1f1c0ffd60 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f2247e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ff3c0 0x7f1f1c195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f2247e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ff3c0 0x7f1f1c195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51948/0 (socket says 172.21.15.79:51948) 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f2247e700 1 -- 172.21.15.79:0/4250961817 learned_addr learned my addr 172.21.15.79:0/4250961817 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f21c7d700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c0ffd60 0x7f1f1c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f2247e700 1 -- 172.21.15.79:0/4250961817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c0ffd60 msgr2=0x7f1f1c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f2247e700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c0ffd60 0x7f1f1c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.549+0000 7f1f2247e700 1 -- 172.21.15.79:0/4250961817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f180095f0 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.550+0000 7f1f2247e700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ff3c0 0x7f1f1c195e90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00d8d0 tx=0x7f1f0c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.550+0000 7f1f137fe700 1 -- 172.21.15.79:0/4250961817 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f0c0098a0 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.550+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c19ab20 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.550+0000 7f1f137fe700 1 -- 172.21.15.79:0/4250961817 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f0c010460 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.550+0000 7f1f137fe700 1 -- 172.21.15.79:0/4250961817 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f0c00f5f0 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.550+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c19b070 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.551+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c108740 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.551+0000 7f1f137fe700 1 -- 172.21.15.79:0/4250961817 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1f0c009a00 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.552+0000 7f1f137fe700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1f0806e200 0x7f1f080706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.552+0000 7f1f137fe700 1 -- 172.21.15.79:0/4250961817 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f1f0c08df00 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.552+0000 7f1f21c7d700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1f0806e200 0x7f1f080706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.552+0000 7f1f21c7d700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1f0806e200 0x7f1f080706b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c1974b0 tx=0x7f1f1801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:49.557 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.556+0000 7f1f137fe700 1 -- 172.21.15.79:0/4250961817 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1f0c057330 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:49 smithi079 ceph-mon[87213]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:49 smithi079 ceph-mon[87213]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:49.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:49.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.847+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1f1c19b2e0 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.848 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.847+0000 7f1f137fe700 1 -- 172.21.15.79:0/4250961817 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+815 (secure 0 0 0) 0x7f1f0c05a9f0 con 0x7f1f1c0ff3c0 2024-09-10T09:45:49.848 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:45:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:45:49.848 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 3 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 18.2.0 (5dd24139a1eada541a3bc16b6941c5dde975e26d) reef (stable)": 1, 2024-09-10T09:45:49.849 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 13 2024-09-10T09:45:49.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:45:49.850 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:45:49.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1f0806e200 msgr2=0x7f1f080706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1f0806e200 0x7f1f080706b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c1974b0 tx=0x7f1f1801a040 comp rx=0 tx=0).stop 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ff3c0 msgr2=0x7f1f1c195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ff3c0 0x7f1f1c195e90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00d8d0 tx=0x7f1f0c00dbe0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 shutdown_connections 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1f0806e200 0x7f1f080706b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f1c0ff3c0 0x7f1f1c195e90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 --2- 172.21.15.79:0/4250961817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c0ffd60 0x7f1f1c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 >> 172.21.15.79:0/4250961817 conn(0x7f1f1c0fac80 msgr2=0x7f1f1c0690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 shutdown_connections 2024-09-10T09:45:49.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.850+0000 7f1f246e2700 1 -- 172.21.15.79:0/4250961817 wait complete. 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.953+0000 7faf5a24d700 1 -- 172.21.15.79:0/1479709442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540ff8c0 msgr2=0x7faf5410c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.953+0000 7faf5a24d700 1 --2- 172.21.15.79:0/1479709442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540ff8c0 0x7faf5410c620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf48009910 tx=0x7faf48009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.953+0000 7faf5a24d700 1 -- 172.21.15.79:0/1479709442 shutdown_connections 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.953+0000 7faf5a24d700 1 --2- 172.21.15.79:0/1479709442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540ff8c0 0x7faf5410c620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.954+0000 7faf5a24d700 1 --2- 172.21.15.79:0/1479709442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf540fefb0 0x7faf540ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.954+0000 7faf5a24d700 1 -- 172.21.15.79:0/1479709442 >> 172.21.15.79:0/1479709442 conn(0x7faf540fac80 msgr2=0x7faf540fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.954+0000 7faf5a24d700 1 -- 172.21.15.79:0/1479709442 shutdown_connections 2024-09-10T09:45:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.954+0000 7faf5a24d700 1 -- 172.21.15.79:0/1479709442 wait complete. 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.954+0000 7faf5a24d700 1 Processor -- start 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.954+0000 7faf5a24d700 1 -- start start 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf5a24d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540fefb0 0x7faf54198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf5a24d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf540ff8c0 0x7faf54198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf5a24d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54198c60 con 0x7faf540fefb0 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf5a24d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5419c9f0 con 0x7faf540ff8c0 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf537fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540fefb0 0x7faf54198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf537fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540fefb0 0x7faf54198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51958/0 (socket says 172.21.15.79:51958) 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf537fe700 1 -- 172.21.15.79:0/2981148777 learned_addr learned my addr 172.21.15.79:0/2981148777 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf52ffd700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf540ff8c0 0x7faf54198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf537fe700 1 -- 172.21.15.79:0/2981148777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf540ff8c0 msgr2=0x7faf54198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf537fe700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf540ff8c0 0x7faf54198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf537fe700 1 -- 172.21.15.79:0/2981148777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480095f0 con 0x7faf540fefb0 2024-09-10T09:45:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf537fe700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540fefb0 0x7faf54198040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d8d0 tx=0x7faf4400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf50ff9700 1 -- 172.21.15.79:0/2981148777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf440098a0 con 0x7faf540fefb0 2024-09-10T09:45:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf50ff9700 1 -- 172.21.15.79:0/2981148777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf44010460 con 0x7faf540fefb0 2024-09-10T09:45:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5419ccd0 con 0x7faf540fefb0 2024-09-10T09:45:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.955+0000 7faf50ff9700 1 -- 172.21.15.79:0/2981148777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf4400f5f0 con 0x7faf540fefb0 2024-09-10T09:45:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.956+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5419d1f0 con 0x7faf540fefb0 2024-09-10T09:45:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.957+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf54109d90 con 0x7faf540fefb0 2024-09-10T09:45:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.957+0000 7faf50ff9700 1 -- 172.21.15.79:0/2981148777 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faf44009a00 con 0x7faf540fefb0 2024-09-10T09:45:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.958+0000 7faf50ff9700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf3c06e200 0x7faf3c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.958+0000 7faf50ff9700 1 -- 172.21.15.79:0/2981148777 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6242+0+0 (secure 0 0 0) 0x7faf4408df20 con 0x7faf540fefb0 2024-09-10T09:45:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.958+0000 7faf52ffd700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf3c06e200 0x7faf3c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.958+0000 7faf52ffd700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf3c06e200 0x7faf3c0706b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf4800b5c0 tx=0x7faf4801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:49.963 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:49.962+0000 7faf50ff9700 1 -- 172.21.15.79:0/2981148777 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faf440c31b0 con 0x7faf540fefb0 2024-09-10T09:45:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:49 smithi135 ceph-mon[65362]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:49 smithi135 ceph-mon[65362]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:45:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:49.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.210+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf5419d410 con 0x7faf540fefb0 2024-09-10T09:45:50.211 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.210+0000 7faf50ff9700 1 -- 172.21.15.79:0/2981148777 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1933 (secure 0 0 0) 0x7faf44057350 con 0x7faf540fefb0 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:e28 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:btime 2024-09-10T09:45:47:526989+0000 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 27 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:45:45.214924+0000 2024-09-10T09:45:50.212 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 85 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=24287} 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:45:50.213 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 24287 members: 24287 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{0:24287} state up:active seq 184 join_fscid=1 addr [v2:172.21.15.135:6826/3081889881,v1:172.21.15.135:6827/3081889881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:45:50.214 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.79:6828/2505923187,v1:172.21.15.79:6829/2505923187] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:45:50.215 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1647814509,v1:172.21.15.135:6825/1647814509] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:45:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf3c06e200 msgr2=0x7faf3c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf3c06e200 0x7faf3c0706b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf4800b5c0 tx=0x7faf4801a040 comp rx=0 tx=0).stop 2024-09-10T09:45:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540fefb0 msgr2=0x7faf54198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540fefb0 0x7faf54198040 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d8d0 tx=0x7faf4400dbe0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 shutdown_connections 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf3c06e200 0x7faf3c0706b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf540fefb0 0x7faf54198040 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 --2- 172.21.15.79:0/2981148777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf540ff8c0 0x7faf54198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 >> 172.21.15.79:0/2981148777 conn(0x7faf540fac80 msgr2=0x7faf540fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 shutdown_connections 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.213+0000 7faf5a24d700 1 -- 172.21.15.79:0/2981148777 wait complete. 2024-09-10T09:45:50.216 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 -- 172.21.15.79:0/614272222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 msgr2=0x7fc8e8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 --2- 172.21.15.79:0/614272222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8103d30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009910 tx=0x7fc8d0009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 -- 172.21.15.79:0/614272222 shutdown_connections 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 --2- 172.21.15.79:0/614272222 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8103d30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 --2- 172.21.15.79:0/614272222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8e80ff3c0 0x7fc8e80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 -- 172.21.15.79:0/614272222 >> 172.21.15.79:0/614272222 conn(0x7fc8e80fac60 msgr2=0x7fc8e80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 -- 172.21.15.79:0/614272222 shutdown_connections 2024-09-10T09:45:50.320 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.319+0000 7fc8ec853700 1 -- 172.21.15.79:0/614272222 wait complete. 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ec853700 1 Processor -- start 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ec853700 1 -- start start 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ec853700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8e80ff3c0 0x7fc8e8194dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ec853700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ec853700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e81959f0 con 0x7fc8e80ffd60 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ec853700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8199780 con 0x7fc8e80ff3c0 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ddd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ddd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51972/0 (socket says 172.21.15.79:51972) 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ddd9b700 1 -- 172.21.15.79:0/1473468098 learned_addr learned my addr 172.21.15.79:0/1473468098 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8e659c700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8e80ff3c0 0x7fc8e8194dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:50.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ddd9b700 1 -- 172.21.15.79:0/1473468098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8e80ff3c0 msgr2=0x7fc8e8194dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ddd9b700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8e80ff3c0 0x7fc8e8194dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.320+0000 7fc8ddd9b700 1 -- 172.21.15.79:0/1473468098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00095f0 con 0x7fc8e80ffd60 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.321+0000 7fc8ddd9b700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8195310 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00092e0 tx=0x7fc8d000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.321+0000 7fc8dffff700 1 -- 172.21.15.79:0/1473468098 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d001d070 con 0x7fc8e80ffd60 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.321+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e8199a00 con 0x7fc8e80ffd60 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.321+0000 7fc8dffff700 1 -- 172.21.15.79:0/1473468098 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8d0005dc0 con 0x7fc8e80ffd60 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.321+0000 7fc8dffff700 1 -- 172.21.15.79:0/1473468098 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d0017400 con 0x7fc8e80ffd60 2024-09-10T09:45:50.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.321+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e8199ef0 con 0x7fc8e80ffd60 2024-09-10T09:45:50.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.322+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e8107730 con 0x7fc8e80ffd60 2024-09-10T09:45:50.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.322+0000 7fc8dffff700 1 -- 172.21.15.79:0/1473468098 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc8d000f6f0 con 0x7fc8e80ffd60 2024-09-10T09:45:50.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.323+0000 7fc8dffff700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc8d406e200 0x7fc8d40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:50.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.323+0000 7fc8dffff700 1 -- 172.21.15.79:0/1473468098 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6242+0+0 (secure 0 0 0) 0x7fc8d008f420 con 0x7fc8e80ffd60 2024-09-10T09:45:50.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.323+0000 7fc8e659c700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc8d406e200 0x7fc8d40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:50.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.323+0000 7fc8e659c700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc8d406e200 0x7fc8d40706b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8005950 tx=0x7fc8d800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:50.328 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.327+0000 7fc8dffff700 1 -- 172.21.15.79:0/1473468098 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc8d0058850 con 0x7fc8e80ffd60 2024-09-10T09:45:50.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.547+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8e819a1d0 con 0x7fc8d406e200 2024-09-10T09:45:50.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.549+0000 7fc8dffff700 1 -- 172.21.15.79:0/1473468098 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc8e819a1d0 con 0x7fc8d406e200 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "crash", 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "osd", 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "mon" 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "15/23 daemons upgraded", 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading mds daemons", 2024-09-10T09:45:50.550 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:45:50.551 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:45:50.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc8d406e200 msgr2=0x7fc8d40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc8d406e200 0x7fc8d40706b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8005950 tx=0x7fc8d800b410 comp rx=0 tx=0).stop 2024-09-10T09:45:50.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 msgr2=0x7fc8e8195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8195310 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00092e0 tx=0x7fc8d000bd70 comp rx=0 tx=0).stop 2024-09-10T09:45:50.552 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 shutdown_connections 2024-09-10T09:45:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc8d406e200 0x7fc8d40706b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8e80ff3c0 0x7fc8e8194dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 --2- 172.21.15.79:0/1473468098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8e80ffd60 0x7fc8e8195310 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 >> 172.21.15.79:0/1473468098 conn(0x7fc8e80fac60 msgr2=0x7fc8e80fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.551+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 shutdown_connections 2024-09-10T09:45:50.553 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.552+0000 7fc8ec853700 1 -- 172.21.15.79:0/1473468098 wait complete. 2024-09-10T09:45:50.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 -- 172.21.15.79:0/133921703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db4069140 msgr2=0x7f0db4104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 --2- 172.21.15.79:0/133921703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db4069140 0x7f0db4104eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009910 tx=0x7f0d9c009c20 comp rx=0 tx=0).stop 2024-09-10T09:45:50.656 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 -- 172.21.15.79:0/133921703 shutdown_connections 2024-09-10T09:45:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 --2- 172.21.15.79:0/133921703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db4069140 0x7f0db4104eb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 --2- 172.21.15.79:0/133921703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db40687a0 0x7f0db4068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 -- 172.21.15.79:0/133921703 >> 172.21.15.79:0/133921703 conn(0x7f0db4075130 msgr2=0x7f0db4075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 -- 172.21.15.79:0/133921703 shutdown_connections 2024-09-10T09:45:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.655+0000 7f0dba315700 1 -- 172.21.15.79:0/133921703 wait complete. 2024-09-10T09:45:50.658 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0dba315700 1 Processor -- start 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0dba315700 1 -- start start 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0dba315700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db40687a0 0x7f0db40ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0dba315700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4069140 0x7f0db41001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0dba315700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4100720 con 0x7f0db40687a0 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0dba315700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4100860 con 0x7f0db4069140 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0db3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db40687a0 0x7f0db40ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0db3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db40687a0 0x7f0db40ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:51988/0 (socket says 172.21.15.79:51988) 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0db3fff700 1 -- 172.21.15.79:0/1645393247 learned_addr learned my addr 172.21.15.79:0/1645393247 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.656+0000 7f0db37fe700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4069140 0x7f0db41001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0db3fff700 1 -- 172.21.15.79:0/1645393247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4069140 msgr2=0x7f0db41001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0db3fff700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4069140 0x7f0db41001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0db3fff700 1 -- 172.21.15.79:0/1645393247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c0095f0 con 0x7f0db40687a0 2024-09-10T09:45:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0db3fff700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db40687a0 0x7f0db40ffca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0da400b4b0 tx=0x7f0da400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0db17fa700 1 -- 172.21.15.79:0/1645393247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da4011800 con 0x7f0db40687a0 2024-09-10T09:45:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0db17fa700 1 -- 172.21.15.79:0/1645393247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0da4011e20 con 0x7f0db40687a0 2024-09-10T09:45:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db41a2150 con 0x7f0db40687a0 2024-09-10T09:45:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0db17fa700 1 -- 172.21.15.79:0/1645393247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0da400f2e0 con 0x7f0db40687a0 2024-09-10T09:45:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.657+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db41a2560 con 0x7f0db40687a0 2024-09-10T09:45:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.658+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4108800 con 0x7f0db40687a0 2024-09-10T09:45:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.659+0000 7f0db17fa700 1 -- 172.21.15.79:0/1645393247 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0da4010380 con 0x7f0db40687a0 2024-09-10T09:45:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.659+0000 7f0db17fa700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0da006e200 0x7f0da00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:45:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.659+0000 7f0db17fa700 1 -- 172.21.15.79:0/1645393247 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f0da408da60 con 0x7f0db40687a0 2024-09-10T09:45:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.659+0000 7f0db37fe700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0da006e200 0x7f0da00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:45:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.660+0000 7f0db37fe700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0da006e200 0x7f0da00706b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0db4101490 tx=0x7f0d9c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:45:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.664+0000 7f0db17fa700 1 -- 172.21.15.79:0/1645393247 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0da4056f10 con 0x7f0db40687a0 2024-09-10T09:45:50.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:50 smithi135 ceph-mon[65362]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:50.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:50 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/4250961817' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:50.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:50 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:50.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:50 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:50.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:50 smithi135 ceph-mon[65362]: pgmap v196: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T09:45:50.677 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:50 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2981148777' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:45:50.952 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.951+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0db404f2a0 con 0x7f0db40687a0 2024-09-10T09:45:50.953 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:50 smithi079 ceph-mon[87213]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:50.953 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:50 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/4250961817' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:50.953 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:50 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:50.953 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:50 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:50.953 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:50 smithi079 ceph-mon[87213]: pgmap v196: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T09:45:50.953 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:50 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2981148777' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:45:50.954 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.952+0000 7f0db17fa700 1 -- 172.21.15.79:0/1645393247 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0da40150e0 con 0x7f0db40687a0 2024-09-10T09:45:50.954 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:45:50.954 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:45:50.954 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:45:50.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0da006e200 msgr2=0x7f0da00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0da006e200 0x7f0da00706b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0db4101490 tx=0x7f0d9c01a040 comp rx=0 tx=0).stop 2024-09-10T09:45:50.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db40687a0 msgr2=0x7f0db40ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:45:50.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db40687a0 0x7f0db40ffca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0da400b4b0 tx=0x7f0da400b7c0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 shutdown_connections 2024-09-10T09:45:50.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f0da006e200 0x7f0da00706b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0db40687a0 0x7f0db40ffca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 --2- 172.21.15.79:0/1645393247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4069140 0x7f0db41001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:45:50.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 >> 172.21.15.79:0/1645393247 conn(0x7f0db4075130 msgr2=0x7f0db40fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:45:50.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 shutdown_connections 2024-09-10T09:45:50.957 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:45:50.955+0000 7f0dba315700 1 -- 172.21.15.79:0/1645393247 wait complete. 2024-09-10T09:45:51.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:51 smithi135 ceph-mon[65362]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:51.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:51 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1645393247' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:45:51.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:51 smithi079 ceph-mon[87213]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:45:51.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:51 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1645393247' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:45:52.824 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:52 smithi135 ceph-mon[65362]: pgmap v197: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T09:45:52.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:52 smithi079 ceph-mon[87213]: pgmap v197: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T09:45:54.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:54.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:54.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:54.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:45:54.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:54.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:54.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:54.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:54.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:54.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:54 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:54.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:54.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:54.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:54.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:45:54.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:54.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:45:54.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:54.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:54.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:54.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:54 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:45:55.322 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:55 smithi135 ceph-mon[65362]: pgmap v198: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 3.9 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-10T09:45:55.322 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:55.322 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:45:55.322 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:55 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:55.696 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:55 smithi079 ceph-mon[87213]: pgmap v198: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 3.9 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-10T09:45:55.696 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:45:55.696 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi135.oqqtlp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T09:45:55.696 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:55 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:45:56.322 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:56 smithi135 ceph-mon[65362]: Upgrade: Updating mds.cephfs.smithi135.oqqtlp 2024-09-10T09:45:56.322 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:56 smithi135 ceph-mon[65362]: Deploying daemon mds.cephfs.smithi135.oqqtlp on smithi135 2024-09-10T09:45:56.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:56 smithi079 ceph-mon[87213]: Upgrade: Updating mds.cephfs.smithi135.oqqtlp 2024-09-10T09:45:56.591 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:56 smithi079 ceph-mon[87213]: Deploying daemon mds.cephfs.smithi135.oqqtlp on smithi135 2024-09-10T09:45:56.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:56 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[87209]: 2024-09-10T09:45:56.590+0000 7f5aa7dcb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:45:56.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:45:56 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:45:56.618+0000 7f4cb6346640 -1 bdev(0x55be9655cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-10T09:45:56.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:45:56 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:45:56.620+0000 7f4cb7348640 -1 bdev(0x55be9655cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 11 2024-09-10T09:45:56.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:45:56 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:45:56.620+0000 7f4cafb39640 -1 bdev(0x55be9655cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 10 2024-09-10T09:45:57.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: pgmap v199: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-10T09:45:57.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T09:45:57.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:45:57.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: osdmap e86: 6 total, 6 up, 6 in 2024-09-10T09:45:57.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: Standby daemon mds.cephfs.smithi079.pqgxjw assigned to filesystem cephfs as rank 0 2024-09-10T09:45:57.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T09:45:57.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-10T09:45:57.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:57 smithi079 ceph-mon[87213]: fsmap cephfs:1/1 {0=cephfs.smithi079.pqgxjw=up:replay} 2 up:standby 2024-09-10T09:45:57.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: pgmap v199: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-10T09:45:57.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T09:45:57.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T09:45:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: osdmap e86: 6 total, 6 up, 6 in 2024-09-10T09:45:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: Standby daemon mds.cephfs.smithi079.pqgxjw assigned to filesystem cephfs as rank 0 2024-09-10T09:45:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T09:45:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-10T09:45:57.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:57 smithi135 ceph-mon[65362]: fsmap cephfs:1/1 {0=cephfs.smithi079.pqgxjw=up:replay} 2 up:standby 2024-09-10T09:45:59.514 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:45:59 smithi079 ceph-mon[87213]: pgmap v201: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-10T09:45:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:45:59 smithi135 ceph-mon[65362]: pgmap v201: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-10T09:46:00.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:00 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:46:00.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:00 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:46:01.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:01 smithi079 ceph-mon[87213]: pgmap v202: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 7.4 MiB/s rd, 3 op/s 2024-09-10T09:46:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:01 smithi135 ceph-mon[65362]: pgmap v202: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 7.4 MiB/s rd, 3 op/s 2024-09-10T09:46:03.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:03 smithi079 ceph-mon[87213]: pgmap v203: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-10T09:46:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:03 smithi135 ceph-mon[65362]: pgmap v203: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-10T09:46:05.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:05.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:05 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:05.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:05 smithi079 ceph-mon[87213]: pgmap v204: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-10T09:46:05.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:05 smithi079 ceph-mon[87213]: reconnect by client.14510 v1:192.168.0.1:0/871001870 after 0.000999976 2024-09-10T09:46:05.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:05 smithi079 ceph-mon[87213]: reconnect by client.24309 v1:192.168.0.1:0/3633561501 after 0.000999976 2024-09-10T09:46:05.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:05 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:reconnect 2024-09-10T09:46:05.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:05 smithi079 ceph-mon[87213]: fsmap cephfs:1/1 {0=cephfs.smithi079.pqgxjw=up:reconnect} 2 up:standby 2024-09-10T09:46:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:05 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:05 smithi135 ceph-mon[65362]: pgmap v204: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-10T09:46:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:05 smithi135 ceph-mon[65362]: reconnect by client.14510 v1:192.168.0.1:0/871001870 after 0.000999976 2024-09-10T09:46:05.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:05 smithi135 ceph-mon[65362]: reconnect by client.24309 v1:192.168.0.1:0/3633561501 after 0.000999976 2024-09-10T09:46:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:05 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:reconnect 2024-09-10T09:46:05.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:05 smithi135 ceph-mon[65362]: fsmap cephfs:1/1 {0=cephfs.smithi079.pqgxjw=up:reconnect} 2 up:standby 2024-09-10T09:46:06.523 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:06 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:rejoin 2024-09-10T09:46:06.523 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:06 smithi135 ceph-mon[65362]: fsmap cephfs:1/1 {0=cephfs.smithi079.pqgxjw=up:rejoin} 2 up:standby 2024-09-10T09:46:06.524 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:06 smithi135 ceph-mon[65362]: daemon mds.cephfs.smithi079.pqgxjw is now active in filesystem cephfs as rank 0 2024-09-10T09:46:06.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:06 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:rejoin 2024-09-10T09:46:06.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:06 smithi079 ceph-mon[87213]: fsmap cephfs:1/1 {0=cephfs.smithi079.pqgxjw=up:rejoin} 2 up:standby 2024-09-10T09:46:06.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:06 smithi079 ceph-mon[87213]: daemon mds.cephfs.smithi079.pqgxjw is now active in filesystem cephfs as rank 0 2024-09-10T09:46:07.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:07 smithi135 ceph-mon[65362]: pgmap v205: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-10T09:46:07.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:07 smithi135 ceph-mon[65362]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T09:46:07.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:07 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:active 2024-09-10T09:46:07.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:07 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 2 up:standby 2024-09-10T09:46:07.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:07 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:07.546 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:07 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:07.547 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:07 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:07.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:07 smithi079 ceph-mon[87213]: pgmap v205: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-10T09:46:07.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:07 smithi079 ceph-mon[87213]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T09:46:07.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:07 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] up:active 2024-09-10T09:46:07.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:07 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 2 up:standby 2024-09-10T09:46:07.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:07 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:07.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:07 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:07.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:07 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:08.464 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:08 smithi135 ceph-mon[65362]: mds.? [v2:172.21.15.135:6826/3728464568,v1:172.21.15.135:6827/3728464568] up:boot 2024-09-10T09:46:08.464 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:08 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 3 up:standby 2024-09-10T09:46:08.464 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:08 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:46:08.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:08 smithi079 ceph-mon[87213]: mds.? [v2:172.21.15.135:6826/3728464568,v1:172.21.15.135:6827/3728464568] up:boot 2024-09-10T09:46:08.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:08 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 3 up:standby 2024-09-10T09:46:08.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:08 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:46:09.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:09 smithi079 ceph-mon[87213]: pgmap v206: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 88 B/s wr, 6 op/s 2024-09-10T09:46:09.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:09 smithi135 ceph-mon[65362]: pgmap v206: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 88 B/s wr, 6 op/s 2024-09-10T09:46:10.925 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:10.925 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:10.925 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:10 smithi135 ceph-mon[65362]: pgmap v207: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T09:46:10.925 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:10.925 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:10 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:10 smithi079 ceph-mon[87213]: pgmap v207: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-10T09:46:10.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:10.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:10 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:13.423 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:13 smithi135 ceph-mon[65362]: pgmap v208: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T09:46:13.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:13 smithi079 ceph-mon[87213]: pgmap v208: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all mds 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pqgxjw"}]': finished 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.wpfdzn"}]': finished 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lvmrsq"}]': finished 2024-09-10T09:46:14.713 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:46:14.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.oqqtlp"}]': finished 2024-09-10T09:46:14.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: Upgrade: Setting filesystem cephfs Joinable 2024-09-10T09:46:14.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-10T09:46:14.714 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:14 smithi079 ceph-mon[87213]: pgmap v209: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:14.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all mds 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pqgxjw"}]: dispatch 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.pqgxjw"}]': finished 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.wpfdzn"}]: dispatch 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi079.wpfdzn"}]': finished 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lvmrsq"}]: dispatch 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.lvmrsq"}]': finished 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.oqqtlp"}]: dispatch 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi135.oqqtlp"}]': finished 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: Upgrade: Setting filesystem cephfs Joinable 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-10T09:46:14.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:14 smithi135 ceph-mon[65362]: pgmap v209: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 6.9 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-10T09:46:15.911 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-10T09:46:15.911 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:15 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 3 up:standby 2024-09-10T09:46:15.911 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:15 smithi079 ceph-mon[87213]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-10T09:46:15.911 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:15 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-10T09:46:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-10T09:46:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 3 up:standby 2024-09-10T09:46:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-mon[65362]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-10T09:46:15.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-10T09:46:15.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:46:15.654+0000 7f4cb7348640 -1 bdev(0x55be9655cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-09-10T09:46:15.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:46:15.655+0000 7f4cb6346640 -1 bdev(0x55be9655cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-10T09:46:15.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:46:15.656+0000 7f4cb133c640 -1 bdev(0x55be9655cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 9 2024-09-10T09:46:15.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:46:15 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:46:15.656+0000 7f4cb3b41640 -1 bdev(0x55be9655cc00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 8 2024-09-10T09:46:16.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 3 up:standby 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all rgw 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:16.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:16 smithi079 ceph-mon[87213]: pgmap v210: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T09:46:16.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-10T09:46:16.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 3 up:standby 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all rgw 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all rbd-mirror 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:16.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:16 smithi135 ceph-mon[65362]: pgmap v210: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-10T09:46:18.961 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:18 smithi079 ceph-mon[87213]: Upgrade: Updating ceph-exporter.smithi079 (1/2) 2024-09-10T09:46:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:46:18.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:18 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:18.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:18 smithi079 ceph-mon[87213]: Deploying daemon ceph-exporter.smithi079 on smithi079 2024-09-10T09:46:18.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:18 smithi079 ceph-mon[87213]: pgmap v211: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-10T09:46:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:18 smithi135 ceph-mon[65362]: Upgrade: Updating ceph-exporter.smithi079 (1/2) 2024-09-10T09:46:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi079", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:46:18.968 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:18 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:18.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:18 smithi135 ceph-mon[65362]: Deploying daemon ceph-exporter.smithi079 on smithi079 2024-09-10T09:46:18.969 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:18 smithi135 ceph-mon[65362]: pgmap v211: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-10T09:46:20.334 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:20.334 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:20 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:20.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:20.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:20 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 -- 172.21.15.79:0/984611567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc90104130 msgr2=0x7efc90104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 --2- 172.21.15.79:0/984611567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc90104130 0x7efc90104500 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc80009910 tx=0x7efc80009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 -- 172.21.15.79:0/984611567 shutdown_connections 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 --2- 172.21.15.79:0/984611567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc900ffbd0 0x7efc90100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 --2- 172.21.15.79:0/984611567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc90104130 0x7efc90104500 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 -- 172.21.15.79:0/984611567 >> 172.21.15.79:0/984611567 conn(0x7efc90075130 msgr2=0x7efc90075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 -- 172.21.15.79:0/984611567 shutdown_connections 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.067+0000 7efc94fa6700 1 -- 172.21.15.79:0/984611567 wait complete. 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc94fa6700 1 Processor -- start 2024-09-10T09:46:21.071 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc94fa6700 1 -- start start 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc94fa6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc900ffbd0 0x7efc90100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc94fa6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc90104130 0x7efc90101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc94fa6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc901018b0 con 0x7efc900ffbd0 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc94fa6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc901019f0 con 0x7efc90104130 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc8e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc900ffbd0 0x7efc90100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc8e59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc900ffbd0 0x7efc90100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42258/0 (socket says 172.21.15.79:42258) 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.068+0000 7efc8e59c700 1 -- 172.21.15.79:0/3788028707 learned_addr learned my addr 172.21.15.79:0/3788028707 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc8e59c700 1 -- 172.21.15.79:0/3788028707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc90104130 msgr2=0x7efc90101370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:46:21.072 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc8e59c700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc90104130 0x7efc90101370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc8e59c700 1 -- 172.21.15.79:0/3788028707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800095f0 con 0x7efc900ffbd0 2024-09-10T09:46:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc8e59c700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc900ffbd0 0x7efc90100e30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc8000bd70 tx=0x7efc8000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc7f7fe700 1 -- 172.21.15.79:0/3788028707 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc8001d070 con 0x7efc900ffbd0 2024-09-10T09:46:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc7f7fe700 1 -- 172.21.15.79:0/3788028707 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc8000f460 con 0x7efc900ffbd0 2024-09-10T09:46:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc90101c70 con 0x7efc900ffbd0 2024-09-10T09:46:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc7f7fe700 1 -- 172.21.15.79:0/3788028707 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc80017630 con 0x7efc900ffbd0 2024-09-10T09:46:21.073 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.069+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc901a2350 con 0x7efc900ffbd0 2024-09-10T09:46:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.070+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc901086a0 con 0x7efc900ffbd0 2024-09-10T09:46:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.071+0000 7efc7f7fe700 1 -- 172.21.15.79:0/3788028707 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efc80003a60 con 0x7efc900ffbd0 2024-09-10T09:46:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.072+0000 7efc7f7fe700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efc7806e200 0x7efc780706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.074 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.072+0000 7efc7f7fe700 1 -- 172.21.15.79:0/3788028707 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7efc8008f510 con 0x7efc900ffbd0 2024-09-10T09:46:21.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.072+0000 7efc8dd9b700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efc7806e200 0x7efc780706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.075 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.073+0000 7efc8dd9b700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efc7806e200 0x7efc780706b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc90102620 tx=0x7efc8400b3f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:21.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.077+0000 7efc7f7fe700 1 -- 172.21.15.79:0/3788028707 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efc80058a30 con 0x7efc900ffbd0 2024-09-10T09:46:21.339 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:21 smithi079 ceph-mon[87213]: pgmap v212: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-10T09:46:21.376 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.375+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc90061190 con 0x7efc7806e200 2024-09-10T09:46:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.376+0000 7efc7f7fe700 1 -- 172.21.15.79:0/3788028707 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7efc90061190 con 0x7efc7806e200 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efc7806e200 msgr2=0x7efc780706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efc7806e200 0x7efc780706b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc90102620 tx=0x7efc8400b3f0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc900ffbd0 msgr2=0x7efc90100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc900ffbd0 0x7efc90100e30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc8000bd70 tx=0x7efc8000be50 comp rx=0 tx=0).stop 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 shutdown_connections 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7efc7806e200 0x7efc780706b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc900ffbd0 0x7efc90100e30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 --2- 172.21.15.79:0/3788028707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efc90104130 0x7efc90101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.380+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 >> 172.21.15.79:0/3788028707 conn(0x7efc90075130 msgr2=0x7efc900fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.381+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 shutdown_connections 2024-09-10T09:46:21.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.381+0000 7efc94fa6700 1 -- 172.21.15.79:0/3788028707 wait complete. 2024-09-10T09:46:21.395 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:46:21.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:21 smithi135 ceph-mon[65362]: pgmap v212: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 -- 172.21.15.79:0/1025271930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c069140 msgr2=0x7f459c104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 --2- 172.21.15.79:0/1025271930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c069140 0x7f459c104eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f458c009910 tx=0x7f458c009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 -- 172.21.15.79:0/1025271930 shutdown_connections 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 --2- 172.21.15.79:0/1025271930 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c069140 0x7f459c104eb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 --2- 172.21.15.79:0/1025271930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c0687a0 0x7f459c068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 -- 172.21.15.79:0/1025271930 >> 172.21.15.79:0/1025271930 conn(0x7f459c075130 msgr2=0x7f459c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 -- 172.21.15.79:0/1025271930 shutdown_connections 2024-09-10T09:46:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.494+0000 7f45a442a700 1 -- 172.21.15.79:0/1025271930 wait complete. 2024-09-10T09:46:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a442a700 1 Processor -- start 2024-09-10T09:46:21.497 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a442a700 1 -- start start 2024-09-10T09:46:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a442a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c0687a0 0x7f459c0ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a442a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c069140 0x7f459c1001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a442a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c100720 con 0x7f459c0687a0 2024-09-10T09:46:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a442a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c100860 con 0x7f459c069140 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a21c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c0687a0 0x7f459c0ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a21c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c0687a0 0x7f459c0ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42288/0 (socket says 172.21.15.79:42288) 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a21c6700 1 -- 172.21.15.79:0/1537461498 learned_addr learned my addr 172.21.15.79:0/1537461498 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.495+0000 7f45a19c5700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c069140 0x7f459c1001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45a21c6700 1 -- 172.21.15.79:0/1537461498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c069140 msgr2=0x7f459c1001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45a21c6700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c069140 0x7f459c1001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45a21c6700 1 -- 172.21.15.79:0/1537461498 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c0095f0 con 0x7f459c0687a0 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45a21c6700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c0687a0 0x7f459c0ffca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f459800d900 tx=0x7f459800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45937fe700 1 -- 172.21.15.79:0/1537461498 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4598004a00 con 0x7f459c0687a0 2024-09-10T09:46:21.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45937fe700 1 -- 172.21.15.79:0/1537461498 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45980054e0 con 0x7f459c0687a0 2024-09-10T09:46:21.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45937fe700 1 -- 172.21.15.79:0/1537461498 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4598009d00 con 0x7f459c0687a0 2024-09-10T09:46:21.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c1a2030 con 0x7f459c0687a0 2024-09-10T09:46:21.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.496+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c1a2440 con 0x7f459c0687a0 2024-09-10T09:46:21.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.497+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c108750 con 0x7f459c0687a0 2024-09-10T09:46:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.498+0000 7f45937fe700 1 -- 172.21.15.79:0/1537461498 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4598005020 con 0x7f459c0687a0 2024-09-10T09:46:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.499+0000 7f45937fe700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f458806e200 0x7f45880706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.499+0000 7f45937fe700 1 -- 172.21.15.79:0/1537461498 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f459808df40 con 0x7f459c0687a0 2024-09-10T09:46:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.499+0000 7f45a19c5700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f458806e200 0x7f45880706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.499+0000 7f45a19c5700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f458806e200 0x7f45880706b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f459c101490 tx=0x7f458c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.507+0000 7f45937fe700 1 -- 172.21.15.79:0/1537461498 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f45980c31b0 con 0x7f459c0687a0 2024-09-10T09:46:21.739 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.737+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f459c061190 con 0x7f458806e200 2024-09-10T09:46:21.740 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.738+0000 7f45937fe700 1 -- 172.21.15.79:0/1537461498 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f459c061190 con 0x7f458806e200 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f458806e200 msgr2=0x7f45880706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f458806e200 0x7f45880706b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f459c101490 tx=0x7f458c01a040 comp rx=0 tx=0).stop 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c0687a0 msgr2=0x7f459c0ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c0687a0 0x7f459c0ffca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f459800d900 tx=0x7f459800dc10 comp rx=0 tx=0).stop 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 shutdown_connections 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f458806e200 0x7f45880706b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f459c0687a0 0x7f459c0ffca0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 --2- 172.21.15.79:0/1537461498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f459c069140 0x7f459c1001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 >> 172.21.15.79:0/1537461498 conn(0x7f459c075130 msgr2=0x7f459c104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 shutdown_connections 2024-09-10T09:46:21.743 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.741+0000 7f45a442a700 1 -- 172.21.15.79:0/1537461498 wait complete. 2024-09-10T09:46:21.849 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 -- 172.21.15.79:0/2056981828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90068540 msgr2=0x7f1c900689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 --2- 172.21.15.79:0/2056981828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90068540 0x7f1c900689b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009910 tx=0x7f1c84009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 -- 172.21.15.79:0/2056981828 shutdown_connections 2024-09-10T09:46:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 --2- 172.21.15.79:0/2056981828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90068540 0x7f1c900689b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 --2- 172.21.15.79:0/2056981828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90106320 0x7f1c901066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 -- 172.21.15.79:0/2056981828 >> 172.21.15.79:0/2056981828 conn(0x7f1c90075130 msgr2=0x7f1c90075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 -- 172.21.15.79:0/2056981828 shutdown_connections 2024-09-10T09:46:21.850 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.847+0000 7f1c961c0700 1 -- 172.21.15.79:0/2056981828 wait complete. 2024-09-10T09:46:21.851 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.848+0000 7f1c961c0700 1 Processor -- start 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.848+0000 7f1c961c0700 1 -- start start 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.848+0000 7f1c961c0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90068540 0x7f1c900ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c961c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90106320 0x7f1c901001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c961c0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901007b0 con 0x7f1c90106320 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c961c0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90100920 con 0x7f1c90068540 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90106320 0x7f1c901001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90106320 0x7f1c901001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:42298/0 (socket says 172.21.15.79:42298) 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8effd700 1 -- 172.21.15.79:0/1253292678 learned_addr learned my addr 172.21.15.79:0/1253292678 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8f7fe700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90068540 0x7f1c900ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8effd700 1 -- 172.21.15.79:0/1253292678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90068540 msgr2=0x7f1c900ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8effd700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90068540 0x7f1c900ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:21.852 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8effd700 1 -- 172.21.15.79:0/1253292678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c840095f0 con 0x7f1c90106320 2024-09-10T09:46:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8effd700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90106320 0x7f1c901001e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005f50 tx=0x7f1c8400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8cff9700 1 -- 172.21.15.79:0/1253292678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c8401d070 con 0x7f1c90106320 2024-09-10T09:46:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8cff9700 1 -- 172.21.15.79:0/1253292678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c8400b610 con 0x7f1c90106320 2024-09-10T09:46:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c901a2030 con 0x7f1c90106320 2024-09-10T09:46:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.849+0000 7f1c8cff9700 1 -- 172.21.15.79:0/1253292678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c84022470 con 0x7f1c90106320 2024-09-10T09:46:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.850+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c901a2390 con 0x7f1c90106320 2024-09-10T09:46:21.853 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.851+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c90108770 con 0x7f1c90106320 2024-09-10T09:46:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.852+0000 7f1c8cff9700 1 -- 172.21.15.79:0/1253292678 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1c84003780 con 0x7f1c90106320 2024-09-10T09:46:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.852+0000 7f1c8cff9700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1c7806e200 0x7f1c780706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.852+0000 7f1c8cff9700 1 -- 172.21.15.79:0/1253292678 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f1c8408f460 con 0x7f1c90106320 2024-09-10T09:46:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.852+0000 7f1c8f7fe700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1c7806e200 0x7f1c780706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:21.855 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.853+0000 7f1c8f7fe700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1c7806e200 0x7f1c780706b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009c60 tx=0x7f1c80009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:21.862 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:21.861+0000 7f1c8cff9700 1 -- 172.21.15.79:0/1253292678 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1c84058840 con 0x7f1c90106320 2024-09-10T09:46:22.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.092+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c90061190 con 0x7f1c7806e200 2024-09-10T09:46:22.106 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.104+0000 7f1c8cff9700 1 -- 172.21.15.79:0/1253292678 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7f1c90061190 con 0x7f1c7806e200 2024-09-10T09:46:22.106 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:46:22.106 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (7m) 54s ago 18m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:46:22.106 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 starting - - - - 2024-09-10T09:46:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (17m) 12s ago 17m 9084k - 18.2.0 dc2bc1663786 453876f9f640 2024-09-10T09:46:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (4m) 54s ago 18m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:46:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (4m) 12s ago 17m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:46:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (7m) 54s ago 18m 81.4M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:46:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (77s) 54s ago 12m 16.2M - 19.1.1-305-g1cf819b7 41d671128357 8b9798263ca8 2024-09-10T09:46:22.107 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (60s) 54s ago 12m 13.2M - 19.1.1-305-g1cf819b7 41d671128357 0b76e0343289 2024-09-10T09:46:22.108 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (36s) 12s ago 12m 13.8M - 19.1.1-305-g1cf819b7 41d671128357 c2b0b0dae143 2024-09-10T09:46:22.108 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (15s) 12s ago 12m 11.0M - 19.1.1-305-g1cf819b7 41d671128357 9b612ab66995 2024-09-10T09:46:22.108 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (9m) 54s ago 19m 504M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:46:22.108 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (8m) 12s ago 17m 442M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:46:22.108 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (5m) 54s ago 19m 56.7M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:46:22.108 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (5m) 12s ago 17m 45.7M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:46:22.109 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (8m) 54s ago 18m 15.3M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:46:22.109 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (8m) 12s ago 17m 16.1M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:46:22.109 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (4m) 54s ago 16m 105M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:46:22.109 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (3m) 54s ago 16m 109M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:46:22.110 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (3m) 54s ago 15m 97.3M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:46:22.110 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (2m) 12s ago 15m 121M 4096M 19.1.1-305-g1cf819b7 41d671128357 8c3025b323fc 2024-09-10T09:46:22.110 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (2m) 12s ago 14m 110M 4096M 19.1.1-305-g1cf819b7 41d671128357 05ee4cd92ec3 2024-09-10T09:46:22.110 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (94s) 12s ago 14m 105M 4096M 19.1.1-305-g1cf819b7 41d671128357 e48bce7b2061 2024-09-10T09:46:22.110 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (7m) 54s ago 17m 81.2M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:46:22.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1c7806e200 msgr2=0x7f1c780706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1c7806e200 0x7f1c780706b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009c60 tx=0x7f1c80009260 comp rx=0 tx=0).stop 2024-09-10T09:46:22.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90106320 msgr2=0x7f1c901001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90106320 0x7f1c901001e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c84005f50 tx=0x7f1c8400f690 comp rx=0 tx=0).stop 2024-09-10T09:46:22.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 shutdown_connections 2024-09-10T09:46:22.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f1c7806e200 0x7f1c780706b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.111 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c90068540 0x7f1c900ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 --2- 172.21.15.79:0/1253292678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c90106320 0x7f1c901001e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 >> 172.21.15.79:0/1253292678 conn(0x7f1c90075130 msgr2=0x7f1c900febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:22.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 shutdown_connections 2024-09-10T09:46:22.112 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.106+0000 7f1c961c0700 1 -- 172.21.15.79:0/1253292678 wait complete. 2024-09-10T09:46:22.214 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 -- 172.21.15.79:0/345765793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ffc60 msgr2=0x7fecfc10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 --2- 172.21.15.79:0/345765793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ffc60 0x7fecfc10a6d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fecec009910 tx=0x7fecec009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 -- 172.21.15.79:0/345765793 shutdown_connections 2024-09-10T09:46:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 --2- 172.21.15.79:0/345765793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ffc60 0x7fecfc10a6d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 --2- 172.21.15.79:0/345765793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecfc0ff350 0x7fecfc0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 -- 172.21.15.79:0/345765793 >> 172.21.15.79:0/345765793 conn(0x7fecfc0748b0 msgr2=0x7fecfc074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 -- 172.21.15.79:0/345765793 shutdown_connections 2024-09-10T09:46:22.215 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.212+0000 7fed038cc700 1 -- 172.21.15.79:0/345765793 wait complete. 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.213+0000 7fed038cc700 1 Processor -- start 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.213+0000 7fed038cc700 1 -- start start 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.213+0000 7fed038cc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ff350 0x7fecfc195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.213+0000 7fed038cc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecfc0ffc60 0x7fecfc1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.213+0000 7fed038cc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc196ad0 con 0x7fecfc0ff350 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.213+0000 7fed038cc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc19a860 con 0x7fecfc0ffc60 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.213+0000 7fed01668700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ff350 0x7fecfc195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:22.218 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed01668700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ff350 0x7fecfc195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38142/0 (socket says 172.21.15.79:38142) 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed01668700 1 -- 172.21.15.79:0/1386758095 learned_addr learned my addr 172.21.15.79:0/1386758095 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed00e67700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecfc0ffc60 0x7fecfc1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed01668700 1 -- 172.21.15.79:0/1386758095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecfc0ffc60 msgr2=0x7fecfc1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed01668700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecfc0ffc60 0x7fecfc1963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed01668700 1 -- 172.21.15.79:0/1386758095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0095f0 con 0x7fecfc0ff350 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed01668700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ff350 0x7fecfc195eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c8f0 tx=0x7fecf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fecf27fc700 1 -- 172.21.15.79:0/1386758095 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf8007a70 con 0x7fecfc0ff350 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc19ab40 con 0x7fecfc0ff350 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fecf27fc700 1 -- 172.21.15.79:0/1386758095 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecf8007bd0 con 0x7fecfc0ff350 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fecf27fc700 1 -- 172.21.15.79:0/1386758095 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf8018630 con 0x7fecfc0ff350 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.214+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc19b090 con 0x7fecfc0ff350 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.216+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece0005320 con 0x7fecfc0ff350 2024-09-10T09:46:22.219 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.216+0000 7fecf27fc700 1 -- 172.21.15.79:0/1386758095 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fecf800f450 con 0x7fecfc0ff350 2024-09-10T09:46:22.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.216+0000 7fecf27fc700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fece806e200 0x7fece80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:22.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.217+0000 7fecf27fc700 1 -- 172.21.15.79:0/1386758095 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fecf808e080 con 0x7fecfc0ff350 2024-09-10T09:46:22.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.217+0000 7fed00e67700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fece806e200 0x7fece80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:22.220 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.217+0000 7fed00e67700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fece806e200 0x7fece80706b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fecec0059d0 tx=0x7fecec01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:22.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.221+0000 7fecf27fc700 1 -- 172.21.15.79:0/1386758095 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fecf8057460 con 0x7fecfc0ff350 2024-09-10T09:46:22.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.566+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fece0006200 con 0x7fecfc0ff350 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.566+0000 7fecf27fc700 1 -- 172.21.15.79:0/1386758095 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fecf805ab20 con 0x7fecfc0ff350 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:46:22.569 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 14 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:46:22.570 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:46:22.571 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fece806e200 msgr2=0x7fece80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fece806e200 0x7fece80706b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fecec0059d0 tx=0x7fecec01a040 comp rx=0 tx=0).stop 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ff350 msgr2=0x7fecfc195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ff350 0x7fecfc195eb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fecf800c8f0 tx=0x7fecf800ccb0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 shutdown_connections 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fece806e200 0x7fece80706b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fecfc0ff350 0x7fecfc195eb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 --2- 172.21.15.79:0/1386758095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fecfc0ffc60 0x7fecfc1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 >> 172.21.15.79:0/1386758095 conn(0x7fecfc0748b0 msgr2=0x7fecfc104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:22.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 shutdown_connections 2024-09-10T09:46:22.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.570+0000 7fed038cc700 1 -- 172.21.15.79:0/1386758095 wait complete. 2024-09-10T09:46:22.651 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:22 smithi079 ceph-mon[87213]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:22.651 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:22.651 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:22 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:22.651 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:22 smithi079 ceph-mon[87213]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:22.651 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:22 smithi079 ceph-mon[87213]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:22.651 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:22 smithi079 ceph-mon[87213]: pgmap v213: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-10T09:46:22.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 -- 172.21.15.79:0/866208453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ffd60 msgr2=0x7fc708103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 --2- 172.21.15.79:0/866208453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ffd60 0x7fc708103d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009910 tx=0x7fc6f4009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:22.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 -- 172.21.15.79:0/866208453 shutdown_connections 2024-09-10T09:46:22.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 --2- 172.21.15.79:0/866208453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ffd60 0x7fc708103d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 --2- 172.21.15.79:0/866208453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7080ff3c0 0x7fc7080ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 -- 172.21.15.79:0/866208453 >> 172.21.15.79:0/866208453 conn(0x7fc7080fac60 msgr2=0x7fc7080fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:22.700 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 -- 172.21.15.79:0/866208453 shutdown_connections 2024-09-10T09:46:22.701 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.698+0000 7fc70f01e700 1 -- 172.21.15.79:0/866208453 wait complete. 2024-09-10T09:46:22.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70f01e700 1 Processor -- start 2024-09-10T09:46:22.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70f01e700 1 -- start start 2024-09-10T09:46:22.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70f01e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ff3c0 0x7fc708195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:22.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70f01e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7080ffd60 0x7fc7081963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:22.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70f01e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc708196ab0 con 0x7fc7080ff3c0 2024-09-10T09:46:22.702 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70f01e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70819a7d0 con 0x7fc7080ffd60 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70cdba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ff3c0 0x7fc708195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70cdba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ff3c0 0x7fc708195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38168/0 (socket says 172.21.15.79:38168) 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc70cdba700 1 -- 172.21.15.79:0/4188259554 learned_addr learned my addr 172.21.15.79:0/4188259554 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.699+0000 7fc707fff700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7080ffd60 0x7fc7081963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.700+0000 7fc70cdba700 1 -- 172.21.15.79:0/4188259554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7080ffd60 msgr2=0x7fc7081963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.700+0000 7fc70cdba700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7080ffd60 0x7fc7081963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.700+0000 7fc70cdba700 1 -- 172.21.15.79:0/4188259554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40095f0 con 0x7fc7080ff3c0 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.700+0000 7fc70cdba700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ff3c0 0x7fc708195e90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00d8d0 tx=0x7fc6fc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.700+0000 7fc705ffb700 1 -- 172.21.15.79:0/4188259554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6fc0098a0 con 0x7fc7080ff3c0 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.700+0000 7fc705ffb700 1 -- 172.21.15.79:0/4188259554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6fc010460 con 0x7fc7080ff3c0 2024-09-10T09:46:22.703 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.700+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70819aa50 con 0x7fc7080ff3c0 2024-09-10T09:46:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.701+0000 7fc705ffb700 1 -- 172.21.15.79:0/4188259554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6fc00f5f0 con 0x7fc7080ff3c0 2024-09-10T09:46:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.701+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70819afa0 con 0x7fc7080ff3c0 2024-09-10T09:46:22.704 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.702+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708108740 con 0x7fc7080ff3c0 2024-09-10T09:46:22.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.703+0000 7fc705ffb700 1 -- 172.21.15.79:0/4188259554 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc6fc009a00 con 0x7fc7080ff3c0 2024-09-10T09:46:22.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.704+0000 7fc705ffb700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc6f806dff0 0x7fc6f80704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:22.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.704+0000 7fc705ffb700 1 -- 172.21.15.79:0/4188259554 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc6fc08d930 con 0x7fc7080ff3c0 2024-09-10T09:46:22.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.704+0000 7fc707fff700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc6f806dff0 0x7fc6f80704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:22.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.705+0000 7fc707fff700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc6f806dff0 0x7fc6f80704a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc708197440 tx=0x7fc6f401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:22.714 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.713+0000 7fc705ffb700 1 -- 172.21.15.79:0/4188259554 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc6fc056d90 con 0x7fc7080ff3c0 2024-09-10T09:46:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:22 smithi135 ceph-mon[65362]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:22 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:22 smithi135 ceph-mon[65362]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:22 smithi135 ceph-mon[65362]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:22.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:22 smithi135 ceph-mon[65362]: pgmap v213: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-10T09:46:22.990 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.988+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc70819b1e0 con 0x7fc7080ff3c0 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.989+0000 7fc705ffb700 1 -- 172.21.15.79:0/4188259554 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+2004 (secure 0 0 0) 0x7fc6fc0167f0 con 0x7fc7080ff3c0 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:e37 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:btime 2024-09-10T09:46:15:637352+0000 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 37 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:46:15.637337+0000 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 86 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=34378} 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 34378 members: 34378 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{0:34378} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:34410} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.79:6828/2505923187,v1:172.21.15.79:6829/2505923187] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1647814509,v1:172.21.15.135:6825/1647814509] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3728464568,v1:172.21.15.135:6827/3728464568] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc6f806dff0 msgr2=0x7fc6f80704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc6f806dff0 0x7fc6f80704a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc708197440 tx=0x7fc6f401a040 comp rx=0 tx=0).stop 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ff3c0 msgr2=0x7fc708195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ff3c0 0x7fc708195e90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00d8d0 tx=0x7fc6fc00dbe0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 shutdown_connections 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc6f806dff0 0x7fc6f80704a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7080ff3c0 0x7fc708195e90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 --2- 172.21.15.79:0/4188259554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc7080ffd60 0x7fc7081963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:22.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 >> 172.21.15.79:0/4188259554 conn(0x7fc7080fac60 msgr2=0x7fc708069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:22.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 shutdown_connections 2024-09-10T09:46:22.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:22.992+0000 7fc70f01e700 1 -- 172.21.15.79:0/4188259554 wait complete. 2024-09-10T09:46:22.996 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 37 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 -- 172.21.15.79:0/2504072181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ff350 msgr2=0x7f40e80ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 --2- 172.21.15.79:0/2504072181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ff350 0x7f40e80ff720 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009910 tx=0x7f40e4009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 -- 172.21.15.79:0/2504072181 shutdown_connections 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 --2- 172.21.15.79:0/2504072181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e80ffc60 0x7f40e810a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 --2- 172.21.15.79:0/2504072181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ff350 0x7f40e80ff720 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 -- 172.21.15.79:0/2504072181 >> 172.21.15.79:0/2504072181 conn(0x7f40e80748b0 msgr2=0x7f40e8074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 -- 172.21.15.79:0/2504072181 shutdown_connections 2024-09-10T09:46:23.127 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 -- 172.21.15.79:0/2504072181 wait complete. 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.125+0000 7f40efccd700 1 Processor -- start 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40efccd700 1 -- start start 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40efccd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e80ff350 0x7f40e8195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40efccd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ffc60 0x7f40e81963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40efccd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8196ac0 con 0x7f40e80ffc60 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40efccd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e819a850 con 0x7f40e80ff350 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40eda69700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e80ff350 0x7f40e8195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40ed268700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ffc60 0x7f40e81963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40eda69700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e80ff350 0x7f40e8195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.79:38164/0 (socket says 172.21.15.79:38164) 2024-09-10T09:46:23.129 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40eda69700 1 -- 172.21.15.79:0/3367407569 learned_addr learned my addr 172.21.15.79:0/3367407569 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40ed268700 1 -- 172.21.15.79:0/3367407569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e80ff350 msgr2=0x7f40e8195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40ed268700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e80ff350 0x7f40e8195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.126+0000 7f40ed268700 1 -- 172.21.15.79:0/3367407569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40095f0 con 0x7f40e80ffc60 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.127+0000 7f40ed268700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ffc60 0x7f40e81963e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f40d8007a60 tx=0x7f40d8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.127+0000 7f40deffd700 1 -- 172.21.15.79:0/3367407569 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d8014070 con 0x7f40e80ffc60 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.127+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e819aad0 con 0x7f40e80ffc60 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.127+0000 7f40deffd700 1 -- 172.21.15.79:0/3367407569 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40d8004830 con 0x7f40e80ffc60 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.127+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e819b020 con 0x7f40e80ffc60 2024-09-10T09:46:23.130 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.127+0000 7f40deffd700 1 -- 172.21.15.79:0/3367407569 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40d8005620 con 0x7f40e80ffc60 2024-09-10T09:46:23.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.128+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e8107dd0 con 0x7f40e80ffc60 2024-09-10T09:46:23.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.129+0000 7f40deffd700 1 -- 172.21.15.79:0/3367407569 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f40d8018070 con 0x7f40e80ffc60 2024-09-10T09:46:23.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.129+0000 7f40deffd700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f40d406e200 0x7f40d40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:23.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.129+0000 7f40deffd700 1 -- 172.21.15.79:0/3367407569 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f40d8091e10 con 0x7f40e80ffc60 2024-09-10T09:46:23.131 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.130+0000 7f40eda69700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f40d406e200 0x7f40d40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:23.132 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.130+0000 7f40eda69700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f40d406e200 0x7f40d40706b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b850 tx=0x7f40e4005ad0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:23.135 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.133+0000 7f40deffd700 1 -- 172.21.15.79:0/3367407569 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f40d805b1d0 con 0x7f40e80ffc60 2024-09-10T09:46:23.385 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.383+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40e819b300 con 0x7f40d406e200 2024-09-10T09:46:23.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.384+0000 7f40deffd700 1 -- 172.21.15.79:0/3367407569 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f40e819b300 con 0x7f40d406e200 2024-09-10T09:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559", 2024-09-10T09:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": true, 2024-09-10T09:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [ 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "osd", 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "mon", 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "mds", 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr", 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "crash" 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": "16/23 daemons upgraded", 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f40d406e200 msgr2=0x7f40d40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f40d406e200 0x7f40d40706b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b850 tx=0x7f40e4005ad0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ffc60 msgr2=0x7f40e81963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ffc60 0x7f40e81963e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f40d8007a60 tx=0x7f40d8007d70 comp rx=0 tx=0).stop 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 shutdown_connections 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f40d406e200 0x7f40d40706b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e80ff350 0x7f40e8195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 --2- 172.21.15.79:0/3367407569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40e80ffc60 0x7f40e81963e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.389 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 >> 172.21.15.79:0/3367407569 conn(0x7f40e80748b0 msgr2=0x7f40e8104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 shutdown_connections 2024-09-10T09:46:23.390 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.387+0000 7f40efccd700 1 -- 172.21.15.79:0/3367407569 wait complete. 2024-09-10T09:46:23.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:23 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1386758095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:23.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:23 smithi135 ceph-mon[65362]: Upgrade: Updating ceph-exporter.smithi135 (2/2) 2024-09-10T09:46:23.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:23 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:23.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:23 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:46:23.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:23 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:23.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:23 smithi135 ceph-mon[65362]: Deploying daemon ceph-exporter.smithi135 on smithi135 2024-09-10T09:46:23.469 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:23 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/4188259554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:46:23.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 -- 172.21.15.79:0/1887202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 msgr2=0x7f6fa8104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 --2- 172.21.15.79:0/1887202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa8104500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009910 tx=0x7f6f98009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:23.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 -- 172.21.15.79:0/1887202 shutdown_connections 2024-09-10T09:46:23.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 --2- 172.21.15.79:0/1887202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa80ffbd0 0x7f6fa8100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 --2- 172.21.15.79:0/1887202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa8104500 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 -- 172.21.15.79:0/1887202 >> 172.21.15.79:0/1887202 conn(0x7f6fa8075130 msgr2=0x7f6fa8075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:23.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 -- 172.21.15.79:0/1887202 shutdown_connections 2024-09-10T09:46:23.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.493+0000 7f6fad45a700 1 -- 172.21.15.79:0/1887202 wait complete. 2024-09-10T09:46:23.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fad45a700 1 Processor -- start 2024-09-10T09:46:23.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fad45a700 1 -- start start 2024-09-10T09:46:23.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fad45a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa80ffbd0 0x7f6fa8196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:23.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fad45a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa81971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:23.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fad45a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa81978b0 con 0x7f6fa8104130 2024-09-10T09:46:23.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fad45a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8197a20 con 0x7f6fa80ffbd0 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fa67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa81971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fa6ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa80ffbd0 0x7f6fa8196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.494+0000 7f6fa67fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa81971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38200/0 (socket says 172.21.15.79:38200) 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6fa67fc700 1 -- 172.21.15.79:0/2259985857 learned_addr learned my addr 172.21.15.79:0/2259985857 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6fa67fc700 1 -- 172.21.15.79:0/2259985857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa80ffbd0 msgr2=0x7f6fa8196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6fa67fc700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa80ffbd0 0x7f6fa8196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6fa67fc700 1 -- 172.21.15.79:0/2259985857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980095f0 con 0x7f6fa8104130 2024-09-10T09:46:23.500 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6fa67fc700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa81971d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00e940 tx=0x7f6f9c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6f8ffff700 1 -- 172.21.15.79:0/2259985857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c00cba0 con 0x7f6fa8104130 2024-09-10T09:46:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6f8ffff700 1 -- 172.21.15.79:0/2259985857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f9c00ee90 con 0x7f6fa8104130 2024-09-10T09:46:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6f8ffff700 1 -- 172.21.15.79:0/2259985857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c0055d0 con 0x7f6fa8104130 2024-09-10T09:46:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa819fd00 con 0x7f6fa8104130 2024-09-10T09:46:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.495+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa81a0250 con 0x7f6fa8104130 2024-09-10T09:46:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.496+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa81076a0 con 0x7f6fa8104130 2024-09-10T09:46:23.501 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.497+0000 7f6f8ffff700 1 -- 172.21.15.79:0/2259985857 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6f9c004750 con 0x7f6fa8104130 2024-09-10T09:46:23.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.497+0000 7f6f8ffff700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f6f9006e200 0x7f6f900706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:23.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.497+0000 7f6f8ffff700 1 -- 172.21.15.79:0/2259985857 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f6f9c014070 con 0x7f6fa8104130 2024-09-10T09:46:23.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.497+0000 7f6fa6ffd700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f6f9006e200 0x7f6f900706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:23.502 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.498+0000 7f6fa6ffd700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f6f9006e200 0x7f6f900706b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6f98000c00 tx=0x7f6f98009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:23.503 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.502+0000 7f6f8ffff700 1 -- 172.21.15.79:0/2259985857 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6f9c057780 con 0x7f6fa8104130 2024-09-10T09:46:23.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:23 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1386758095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:23.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:23 smithi079 ceph-mon[87213]: Upgrade: Updating ceph-exporter.smithi135 (2/2) 2024-09-10T09:46:23.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:23 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:23.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:23 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi135", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-10T09:46:23.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:23 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:23.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:23 smithi079 ceph-mon[87213]: Deploying daemon ceph-exporter.smithi135 on smithi135 2024-09-10T09:46:23.674 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:23 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/4188259554' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:46:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.797+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6fa8107080 con 0x7f6fa8104130 2024-09-10T09:46:23.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.798+0000 7f6f8ffff700 1 -- 172.21.15.79:0/2259985857 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6f9c05ae40 con 0x7f6fa8104130 2024-09-10T09:46:23.800 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:46:23.801 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:46:23.801 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f6f9006e200 msgr2=0x7f6f900706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f6f9006e200 0x7f6f900706b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6f98000c00 tx=0x7f6f98009f70 comp rx=0 tx=0).stop 2024-09-10T09:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 msgr2=0x7f6fa81971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa81971d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00e940 tx=0x7f6f9c00ec50 comp rx=0 tx=0).stop 2024-09-10T09:46:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 shutdown_connections 2024-09-10T09:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f6f9006e200 0x7f6f900706b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6fa80ffbd0 0x7f6fa8196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 --2- 172.21.15.79:0/2259985857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fa8104130 0x7f6fa81971d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 >> 172.21.15.79:0/2259985857 conn(0x7f6fa8075130 msgr2=0x7f6fa80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 shutdown_connections 2024-09-10T09:46:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:23.800+0000 7f6fad45a700 1 -- 172.21.15.79:0/2259985857 wait complete. 2024-09-10T09:46:24.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:24 smithi135 ceph-mon[65362]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:24.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:24 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2259985857' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:46:24.700 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:24 smithi135 ceph-mon[65362]: pgmap v214: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-10T09:46:24.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:24 smithi079 ceph-mon[87213]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:24.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:24 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2259985857' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:46:24.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:24 smithi079 ceph-mon[87213]: pgmap v214: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-10T09:46:27.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:27 smithi079 ceph-mon[87213]: pgmap v215: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-10T09:46:27.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:27 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:27.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:27 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:27.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:27 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:27.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:27 smithi135 ceph-mon[65362]: pgmap v215: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-09-10T09:46:27.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:27 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:27.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:27 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:27.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:27 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:29.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:29 smithi135 ceph-mon[65362]: pgmap v216: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-10T09:46:29.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:29 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:29.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:29 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:29.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:29 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:29.468 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:29 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:29.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:29 smithi079 ceph-mon[87213]: pgmap v216: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-10T09:46:29.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:29 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:29.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:29 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:29.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:29 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:29.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:29 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:31.496 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:31 smithi135 ceph-mon[65362]: pgmap v217: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-10T09:46:31.509 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:31 smithi079 ceph-mon[87213]: pgmap v217: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-10T09:46:33.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:33 smithi079 ceph-mon[87213]: pgmap v218: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 2 op/s 2024-09-10T09:46:33.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:33 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:33.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:33 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:33.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:33 smithi135 ceph-mon[65362]: pgmap v218: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 7.5 MiB/s rd, 2 op/s 2024-09-10T09:46:33.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:33 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:33.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:33 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:34.244 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:34.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:34 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:35.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:35 smithi079 ceph-mon[87213]: pgmap v219: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-09-10T09:46:35.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:35.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:35 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:35 smithi135 ceph-mon[65362]: pgmap v219: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 4.9 MiB/s rd, 2 op/s 2024-09-10T09:46:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:35.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:35 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:36.586 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:36 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:36.586 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:36 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:36.605 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:36 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:36.605 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:36 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:37.589 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:37 smithi135 ceph-mon[65362]: pgmap v220: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 1 op/s 2024-09-10T09:46:37.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:37 smithi079 ceph-mon[87213]: pgmap v220: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 1 op/s 2024-09-10T09:46:38.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: pgmap v221: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:46:38.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:38.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:38.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:38.962 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:38.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:38.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:38.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:38.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:38.963 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:38.964 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:38.964 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:38.964 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:38 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: pgmap v221: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:39.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:39.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:39.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:39.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:39.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:38 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-10T09:46:40.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: Upgrade: Setting filesystem cephfs Joinable 2024-09-10T09:46:40.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-10T09:46:40.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:46:40.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi079"}]: dispatch 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi079"}]': finished 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi135"}]: dispatch 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi135"}]': finished 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-10T09:46:40.214 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-10T09:46:40.215 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:40.216 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:40.217 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:39 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: Upgrade: Setting filesystem cephfs Joinable 2024-09-10T09:46:40.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-10T09:46:40.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: fsmap cephfs:1 {0=cephfs.smithi079.pqgxjw=up:active} 1 up:standby-replay 2 up:standby 2024-09-10T09:46:40.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi079"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi079"}]': finished 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi135"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi135"}]': finished 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.219 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-10T09:46:40.220 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-10T09:46:40.221 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:40.222 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:39 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:41.211 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all ceph-exporter 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all iscsi 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all nfs 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: Upgrade: Setting container_image for all nvmeof 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: Upgrade: Finalizing container_image settings 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: Upgrade: Complete! 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:41.212 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:41.213 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:40 smithi079 ceph-mon[87213]: pgmap v222: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:46:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all ceph-exporter 2024-09-10T09:46:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all iscsi 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all nfs 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: Upgrade: Setting container_image for all nvmeof 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: Upgrade: Finalizing container_image settings 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: Upgrade: Complete! 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:41.218 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:40 smithi135 ceph-mon[65362]: pgmap v222: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:46:43.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:43 smithi135 ceph-mon[65362]: pgmap v223: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:43.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:43 smithi079 ceph-mon[87213]: pgmap v223: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:45.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:45 smithi079 ceph-mon[87213]: pgmap v224: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:46:45.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:45 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:45.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:45 smithi135 ceph-mon[65362]: pgmap v224: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:46:45.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:45 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:46:47.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:47 smithi079 ceph-mon[87213]: pgmap v225: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:46:47.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:47 smithi135 ceph-mon[65362]: pgmap v225: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:46:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:49 smithi079 ceph-mon[87213]: pgmap v226: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:49.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:49 smithi135 ceph-mon[65362]: pgmap v226: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:49.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:46:51.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:51 smithi079 ceph-mon[87213]: pgmap v227: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:46:51.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:51 smithi135 ceph-mon[65362]: pgmap v227: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:46:53.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:53 smithi079 ceph-mon[87213]: pgmap v228: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:53.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:53 smithi135 ceph-mon[65362]: pgmap v228: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 -- 172.21.15.79:0/2257390419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 msgr2=0x7f07f41094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 --2- 172.21.15.79:0/2257390419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41094d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009910 tx=0x7f07e4009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 -- 172.21.15.79:0/2257390419 shutdown_connections 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 --2- 172.21.15.79:0/2257390419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41094d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 --2- 172.21.15.79:0/2257390419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4100460 0x7f07f4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 -- 172.21.15.79:0/2257390419 >> 172.21.15.79:0/2257390419 conn(0x7f07f40748b0 msgr2=0x7f07f4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 -- 172.21.15.79:0/2257390419 shutdown_connections 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 -- 172.21.15.79:0/2257390419 wait complete. 2024-09-10T09:46:53.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 Processor -- start 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.920+0000 7f07fc319700 1 -- start start 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07fc319700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4100460 0x7f07f4195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07fc319700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07fc319700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4196ba0 con 0x7f07f4100d70 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07fc319700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f419a930 con 0x7f07f4100460 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07f98b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07f98b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58382/0 (socket says 172.21.15.79:58382) 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07f98b4700 1 -- 172.21.15.79:0/2791343475 learned_addr learned my addr 172.21.15.79:0/2791343475 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07fa0b5700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4100460 0x7f07f4195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07f98b4700 1 -- 172.21.15.79:0/2791343475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4100460 msgr2=0x7f07f4195f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07f98b4700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4100460 0x7f07f4195f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:53.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07f98b4700 1 -- 172.21.15.79:0/2791343475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40095f0 con 0x7f07f4100d70 2024-09-10T09:46:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07fa0b5700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4100460 0x7f07f4195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:46:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.921+0000 7f07f98b4700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41964c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07e4006010 tx=0x7f07e400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.922+0000 7f07eb7fe700 1 -- 172.21.15.79:0/2791343475 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e401d070 con 0x7f07f4100d70 2024-09-10T09:46:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.922+0000 7f07eb7fe700 1 -- 172.21.15.79:0/2791343475 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07e4004fb0 con 0x7f07f4100d70 2024-09-10T09:46:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.922+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f419abb0 con 0x7f07f4100d70 2024-09-10T09:46:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.922+0000 7f07eb7fe700 1 -- 172.21.15.79:0/2791343475 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e4022ea0 con 0x7f07f4100d70 2024-09-10T09:46:53.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.922+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f419b0a0 con 0x7f07f4100d70 2024-09-10T09:46:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.923+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f4107e40 con 0x7f07f4100d70 2024-09-10T09:46:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.923+0000 7f07eb7fe700 1 -- 172.21.15.79:0/2791343475 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f07e4022470 con 0x7f07f4100d70 2024-09-10T09:46:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.924+0000 7f07eb7fe700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07e006e200 0x7f07e00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.924+0000 7f07eb7fe700 1 -- 172.21.15.79:0/2791343475 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f07e408f510 con 0x7f07f4100d70 2024-09-10T09:46:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.924+0000 7f07fa0b5700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07e006e200 0x7f07e00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:53.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.924+0000 7f07fa0b5700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07e006e200 0x7f07e00706b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07f00099d0 tx=0x7f07f0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:53.929 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:53.928+0000 7f07eb7fe700 1 -- 172.21.15.79:0/2791343475 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07e4058b40 con 0x7f07f4100d70 2024-09-10T09:46:54.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.151+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07f402cca0 con 0x7f07e006e200 2024-09-10T09:46:54.152 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.152+0000 7f07eb7fe700 1 -- 172.21.15.79:0/2791343475 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f07f402cca0 con 0x7f07e006e200 2024-09-10T09:46:54.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07e006e200 msgr2=0x7f07e00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:54.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07e006e200 0x7f07e00706b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07f00099d0 tx=0x7f07f0008040 comp rx=0 tx=0).stop 2024-09-10T09:46:54.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 msgr2=0x7f07f41964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:54.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41964c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07e4006010 tx=0x7f07e400be20 comp rx=0 tx=0).stop 2024-09-10T09:46:54.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 shutdown_connections 2024-09-10T09:46:54.155 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07e006e200 0x7f07e00706b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:54.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07f4100460 0x7f07f4195f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:54.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 --2- 172.21.15.79:0/2791343475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07f4100d70 0x7f07f41964c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:54.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 >> 172.21.15.79:0/2791343475 conn(0x7f07f40748b0 msgr2=0x7f07f40fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:54.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 shutdown_connections 2024-09-10T09:46:54.156 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:54.154+0000 7f07fc319700 1 -- 172.21.15.79:0/2791343475 wait complete. 2024-09-10T09:46:54.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch ps' 2024-09-10T09:46:55.108 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:46:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:55 smithi079 ceph-mon[87213]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:55.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:55 smithi079 ceph-mon[87213]: pgmap v229: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:46:55.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:55 smithi135 ceph-mon[65362]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:55.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:55 smithi135 ceph-mon[65362]: pgmap v229: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.773+0000 7f6560e40700 1 -- 172.21.15.79:0/1978818606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 msgr2=0x7f655c104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.773+0000 7f6560e40700 1 --2- 172.21.15.79:0/1978818606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c104d20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6544009910 tx=0x7f6544009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 -- 172.21.15.79:0/1978818606 shutdown_connections 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 --2- 172.21.15.79:0/1978818606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c104d20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 --2- 172.21.15.79:0/1978818606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655c1003b0 0x7f655c100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 -- 172.21.15.79:0/1978818606 >> 172.21.15.79:0/1978818606 conn(0x7f655c0fbc70 msgr2=0x7f655c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 -- 172.21.15.79:0/1978818606 shutdown_connections 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 -- 172.21.15.79:0/1978818606 wait complete. 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 Processor -- start 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.774+0000 7f6560e40700 1 -- start start 2024-09-10T09:46:56.776 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6560e40700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655c1003b0 0x7f655c195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6560e40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6560e40700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c196a20 con 0x7f655c100d50 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6560e40700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c19a7b0 con 0x7f655c1003b0 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6559d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6559d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58406/0 (socket says 172.21.15.79:58406) 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6559d9b700 1 -- 172.21.15.79:0/2234452383 learned_addr learned my addr 172.21.15.79:0/2234452383 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f655a59c700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655c1003b0 0x7f655c195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6559d9b700 1 -- 172.21.15.79:0/2234452383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655c1003b0 msgr2=0x7f655c195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6559d9b700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655c1003b0 0x7f655c195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6559d9b700 1 -- 172.21.15.79:0/2234452383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440095f0 con 0x7f655c100d50 2024-09-10T09:46:56.777 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f655a59c700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655c1003b0 0x7f655c195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:46:56.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6559d9b700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c196340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65440092e0 tx=0x7f654400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:56.778 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f65537fe700 1 -- 172.21.15.79:0/2234452383 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f654401d070 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c19aa30 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f65537fe700 1 -- 172.21.15.79:0/2234452383 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f654400f460 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.775+0000 7f65537fe700 1 -- 172.21.15.79:0/2234452383 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65440175f0 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.776+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c19af20 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.776+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c108670 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.777+0000 7f65537fe700 1 -- 172.21.15.79:0/2234452383 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f654400f5d0 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.777+0000 7f65537fe700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f654806e200 0x7f65480706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.777+0000 7f65537fe700 1 -- 172.21.15.79:0/2234452383 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f654408f5b0 con 0x7f655c100d50 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.777+0000 7f655a59c700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f654806e200 0x7f65480706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:56.779 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.778+0000 7f655a59c700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f654806e200 0x7f65480706b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f654c009fa0 tx=0x7f654c009570 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:56.782 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.782+0000 7f65537fe700 1 -- 172.21.15.79:0/2234452383 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6544058990 con 0x7f655c100d50 2024-09-10T09:46:56.994 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:56.993+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f655c02cd20 con 0x7f654806e200 2024-09-10T09:46:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.007+0000 7f65537fe700 1 -- 172.21.15.79:0/2234452383 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f655c02cd20 con 0x7f654806e200 2024-09-10T09:46:57.008 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:46:57.008 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (8m) 22s ago 18m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:46:57.008 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (36s) 22s ago 19m 7738k - 19.1.1-305-g1cf819b7 41d671128357 d807a1ff3586 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (31s) 28s ago 18m 7331k - 19.1.1-305-g1cf819b7 41d671128357 ce8d6cdd57bd 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (5m) 22s ago 19m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (5m) 28s ago 18m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (7m) 22s ago 18m 81.9M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (112s) 22s ago 13m 88.8M - 19.1.1-305-g1cf819b7 41d671128357 8b9798263ca8 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (95s) 22s ago 13m 85.4M - 19.1.1-305-g1cf819b7 41d671128357 0b76e0343289 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (71s) 28s ago 13m 13.9M - 19.1.1-305-g1cf819b7 41d671128357 c2b0b0dae143 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (50s) 28s ago 13m 13.2M - 19.1.1-305-g1cf819b7 41d671128357 9b612ab66995 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (9m) 22s ago 20m 506M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (9m) 28s ago 17m 442M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (6m) 22s ago 20m 59.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (6m) 28s ago 17m 46.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (8m) 22s ago 18m 14.5M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:46:57.009 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (8m) 28s ago 18m 16.3M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:46:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (5m) 22s ago 17m 113M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:46:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (4m) 22s ago 16m 123M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:46:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (3m) 22s ago 16m 109M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:46:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (3m) 28s ago 15m 124M 4096M 19.1.1-305-g1cf819b7 41d671128357 8c3025b323fc 2024-09-10T09:46:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (2m) 28s ago 15m 111M 4096M 19.1.1-305-g1cf819b7 41d671128357 05ee4cd92ec3 2024-09-10T09:46:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (2m) 28s ago 14m 108M 4096M 19.1.1-305-g1cf819b7 41d671128357 e48bce7b2061 2024-09-10T09:46:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (8m) 22s ago 18m 81.3M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.009+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f654806e200 msgr2=0x7f65480706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.009+0000 7f6560e40700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f654806e200 0x7f65480706b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f654c009fa0 tx=0x7f654c009570 comp rx=0 tx=0).stop 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.009+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 msgr2=0x7f655c196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.009+0000 7f6560e40700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c196340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65440092e0 tx=0x7f654400be20 comp rx=0 tx=0).stop 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.010+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 shutdown_connections 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.010+0000 7f6560e40700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f654806e200 0x7f65480706b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.010+0000 7f6560e40700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f655c1003b0 0x7f655c195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.010+0000 7f6560e40700 1 --2- 172.21.15.79:0/2234452383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f655c100d50 0x7f655c196340 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.010+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 >> 172.21.15.79:0/2234452383 conn(0x7f655c0fbc70 msgr2=0x7f655c0fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.010+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 shutdown_connections 2024-09-10T09:46:57.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:57.010+0000 7f6560e40700 1 -- 172.21.15.79:0/2234452383 wait complete. 2024-09-10T09:46:57.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:57 smithi135 ceph-mon[65362]: pgmap v230: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:46:57.502 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:57 smithi079 ceph-mon[87213]: pgmap v230: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:46:57.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch upgrade status' 2024-09-10T09:46:57.838 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:46:58.657 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:58 smithi079 ceph-mon[87213]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:58.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:58 smithi135 ceph-mon[65362]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:46:59.597 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:46:59 smithi079 ceph-mon[87213]: pgmap v231: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 -- 172.21.15.79:0/2311380171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101d20 msgr2=0x7fa67c10a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2311380171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101d20 0x7fa67c10a220 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa670009910 tx=0x7fa670009c20 comp rx=0 tx=0).stop 2024-09-10T09:46:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 -- 172.21.15.79:0/2311380171 shutdown_connections 2024-09-10T09:46:59.705 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2311380171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101d20 0x7fa67c10a220 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2311380171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa67c101410 0x7fa67c1017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 -- 172.21.15.79:0/2311380171 >> 172.21.15.79:0/2311380171 conn(0x7fa67c0fac90 msgr2=0x7fa67c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 -- 172.21.15.79:0/2311380171 shutdown_connections 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 -- 172.21.15.79:0/2311380171 wait complete. 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.700+0000 7fa680fb0700 1 Processor -- start 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa680fb0700 1 -- start start 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa680fb0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101410 0x7fa67c195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa680fb0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa67c101d20 0x7fa67c196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa680fb0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c196a60 con 0x7fa67c101410 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa680fb0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c19a7f0 con 0x7fa67c101d20 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa67a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101410 0x7fa67c195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:59.706 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa67a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101410 0x7fa67c195e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58424/0 (socket says 172.21.15.79:58424) 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa67a59c700 1 -- 172.21.15.79:0/2770327060 learned_addr learned my addr 172.21.15.79:0/2770327060 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa679d9b700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa67c101d20 0x7fa67c196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa67a59c700 1 -- 172.21.15.79:0/2770327060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa67c101d20 msgr2=0x7fa67c196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa67a59c700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa67c101d20 0x7fa67c196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa67a59c700 1 -- 172.21.15.79:0/2770327060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700095f0 con 0x7fa67c101410 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa679d9b700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa67c101d20 0x7fa67c196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa67a59c700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101410 0x7fa67c195e40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c8a0 tx=0x7fa66c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa66b7fe700 1 -- 172.21.15.79:0/2770327060 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66c00cea0 con 0x7fa67c101410 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa66b7fe700 1 -- 172.21.15.79:0/2770327060 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa66c004830 con 0x7fa67c101410 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa66b7fe700 1 -- 172.21.15.79:0/2770327060 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66c0055b0 con 0x7fa67c101410 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.701+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c19aad0 con 0x7fa67c101410 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.702+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c19b020 con 0x7fa67c101410 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.703+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c107890 con 0x7fa67c101410 2024-09-10T09:46:59.707 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.703+0000 7fa66b7fe700 1 -- 172.21.15.79:0/2770327060 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa66c007ad0 con 0x7fa67c101410 2024-09-10T09:46:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.703+0000 7fa66b7fe700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa66406e200 0x7fa6640706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:46:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.703+0000 7fa66b7fe700 1 -- 172.21.15.79:0/2770327060 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa66c08de00 con 0x7fa67c101410 2024-09-10T09:46:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.703+0000 7fa679d9b700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa66406e200 0x7fa6640706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:46:59.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.704+0000 7fa679d9b700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa66406e200 0x7fa6640706b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6700059d0 tx=0x7fa67001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:46:59.709 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.708+0000 7fa66b7fe700 1 -- 172.21.15.79:0/2770327060 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa66c0571e0 con 0x7fa67c101410 2024-09-10T09:46:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:46:59 smithi135 ceph-mon[65362]: pgmap v231: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:46:59.927 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.926+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa67c19b2a0 con 0x7fa66406e200 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.927+0000 7fa66b7fe700 1 -- 172.21.15.79:0/2770327060 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fa67c19b2a0 con 0x7fa66406e200 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stdout: "target_image": null, 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stdout: "in_progress": false, 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stdout: "which": "", 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stdout: "services_complete": [], 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stdout: "progress": null, 2024-09-10T09:46:59.928 INFO:teuthology.orchestra.run.smithi079.stdout: "message": "", 2024-09-10T09:46:59.929 INFO:teuthology.orchestra.run.smithi079.stdout: "is_paused": false 2024-09-10T09:46:59.929 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:46:59.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa66406e200 msgr2=0x7fa6640706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:59.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa66406e200 0x7fa6640706b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6700059d0 tx=0x7fa67001a040 comp rx=0 tx=0).stop 2024-09-10T09:46:59.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101410 msgr2=0x7fa67c195e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:46:59.931 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101410 0x7fa67c195e40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c8a0 tx=0x7fa66c00cc60 comp rx=0 tx=0).stop 2024-09-10T09:46:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 shutdown_connections 2024-09-10T09:46:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fa66406e200 0x7fa6640706b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa67c101410 0x7fa67c195e40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 --2- 172.21.15.79:0/2770327060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa67c101d20 0x7fa67c196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:46:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 >> 172.21.15.79:0/2770327060 conn(0x7fa67c0fac90 msgr2=0x7fa67c1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:46:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 shutdown_connections 2024-09-10T09:46:59.932 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:46:59.930+0000 7fa680fb0700 1 -- 172.21.15.79:0/2770327060 wait complete. 2024-09-10T09:47:00.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph health detail' 2024-09-10T09:47:00.799 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:47:01.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:01 smithi079 ceph-mon[87213]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:47:01.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:01 smithi079 ceph-mon[87213]: pgmap v232: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:01 smithi135 ceph-mon[65362]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:47:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:01 smithi135 ceph-mon[65362]: pgmap v232: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:02.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 -- 172.21.15.79:0/1039275129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 msgr2=0x7fc5f81008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:02.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 --2- 172.21.15.79:0/1039275129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f81008b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009910 tx=0x7fc5ec009c20 comp rx=0 tx=0).stop 2024-09-10T09:47:02.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 -- 172.21.15.79:0/1039275129 shutdown_connections 2024-09-10T09:47:02.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 --2- 172.21.15.79:0/1039275129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5f8100e80 0x7fc5f8104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:02.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 --2- 172.21.15.79:0/1039275129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f81008b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:02.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 -- 172.21.15.79:0/1039275129 >> 172.21.15.79:0/1039275129 conn(0x7fc5f80fbda0 msgr2=0x7fc5f80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:47:02.535 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 -- 172.21.15.79:0/1039275129 shutdown_connections 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.516+0000 7fc5fde12700 1 -- 172.21.15.79:0/1039275129 wait complete. 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5fde12700 1 Processor -- start 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5fde12700 1 -- start start 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5fde12700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f8195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5fde12700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5f8100e80 0x7fc5f8196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5fde12700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8196b10 con 0x7fc5f81004e0 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5fde12700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f819a8a0 con 0x7fc5f8100e80 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f8195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5f77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f8195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43530/0 (socket says 172.21.15.79:43530) 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5f77fe700 1 -- 172.21.15.79:0/255239624 learned_addr learned my addr 172.21.15.79:0/255239624 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5f6ffd700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5f8100e80 0x7fc5f8196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5f77fe700 1 -- 172.21.15.79:0/255239624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5f8100e80 msgr2=0x7fc5f8196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:02.536 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5f8100e80 0x7fc5f8196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.517+0000 7fc5f77fe700 1 -- 172.21.15.79:0/255239624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec0095f0 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.518+0000 7fc5f77fe700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f8195ef0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006010 tx=0x7fc5ec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.518+0000 7fc5f4ff9700 1 -- 172.21.15.79:0/255239624 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec01d070 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.518+0000 7fc5f4ff9700 1 -- 172.21.15.79:0/255239624 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5ec004fb0 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.518+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f819ab20 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.518+0000 7fc5f4ff9700 1 -- 172.21.15.79:0/255239624 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5ec022ea0 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.518+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f819b010 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.519+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f81087f0 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.519+0000 7fc5f4ff9700 1 -- 172.21.15.79:0/255239624 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc5ec004af0 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.520+0000 7fc5f4ff9700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc5e006e200 0x7fc5e00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.520+0000 7fc5f4ff9700 1 -- 172.21.15.79:0/255239624 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc5ec08f5e0 con 0x7fc5f81004e0 2024-09-10T09:47:02.537 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.520+0000 7fc5f6ffd700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc5e006e200 0x7fc5e00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:47:02.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.520+0000 7fc5f6ffd700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc5e006e200 0x7fc5e00706b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8005fd0 tx=0x7fc5e800a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:47:02.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.524+0000 7fc5f4ff9700 1 -- 172.21.15.79:0/255239624 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc5ec058a70 con 0x7fc5f81004e0 2024-09-10T09:47:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.810+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc5f804f2a0 con 0x7fc5f81004e0 2024-09-10T09:47:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.810+0000 7fc5f4ff9700 1 -- 172.21.15.79:0/255239624 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc5ec05c130 con 0x7fc5f81004e0 2024-09-10T09:47:02.811 INFO:teuthology.orchestra.run.smithi079.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-10T09:47:02.811 INFO:teuthology.orchestra.run.smithi079.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-10T09:47:02.812 INFO:teuthology.orchestra.run.smithi079.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-10T09:47:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc5e006e200 msgr2=0x7fc5e00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc5e006e200 0x7fc5e00706b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8005fd0 tx=0x7fc5e800a560 comp rx=0 tx=0).stop 2024-09-10T09:47:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 msgr2=0x7fc5f8195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f8195ef0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec006010 tx=0x7fc5ec00be20 comp rx=0 tx=0).stop 2024-09-10T09:47:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 shutdown_connections 2024-09-10T09:47:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc5e006e200 0x7fc5e00706b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5f81004e0 0x7fc5f8195ef0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 --2- 172.21.15.79:0/255239624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc5f8100e80 0x7fc5f8196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.812+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 >> 172.21.15.79:0/255239624 conn(0x7fc5f80fbda0 msgr2=0x7fc5f80fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:47:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.813+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 shutdown_connections 2024-09-10T09:47:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:02.813+0000 7fc5fde12700 1 -- 172.21.15.79:0/255239624 wait complete. 2024-09-10T09:47:03.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:03 smithi079 ceph-mon[87213]: pgmap v233: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:03.462 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:03 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/255239624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:47:03.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions' 2024-09-10T09:47:03.695 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:47:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:03 smithi135 ceph-mon[65362]: pgmap v233: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:03 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/255239624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-10T09:47:04.570 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:04.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:05.457 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:05 smithi079 ceph-mon[87213]: pgmap v234: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 -- 172.21.15.79:0/3125358064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 msgr2=0x7eff28103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 --2- 172.21.15.79:0/3125358064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff28103d30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7eff10009910 tx=0x7eff10009c20 comp rx=0 tx=0).stop 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 -- 172.21.15.79:0/3125358064 shutdown_connections 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 --2- 172.21.15.79:0/3125358064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff28103d30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 --2- 172.21.15.79:0/3125358064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff280ff3c0 0x7eff280ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 -- 172.21.15.79:0/3125358064 >> 172.21.15.79:0/3125358064 conn(0x7eff280fac80 msgr2=0x7eff280fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 -- 172.21.15.79:0/3125358064 shutdown_connections 2024-09-10T09:47:05.559 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 -- 172.21.15.79:0/3125358064 wait complete. 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 Processor -- start 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.557+0000 7eff2cce5700 1 -- start start 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff2cce5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff280ff3c0 0x7eff28198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff2cce5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff281985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff2cce5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28198bf0 con 0x7eff280ffd60 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff2cce5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28198d30 con 0x7eff280ff3c0 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff25d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff281985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff25d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff281985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:43552/0 (socket says 172.21.15.79:43552) 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff25d9b700 1 -- 172.21.15.79:0/1887042634 learned_addr learned my addr 172.21.15.79:0/1887042634 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff2659c700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff280ff3c0 0x7eff28198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:47:05.561 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff25d9b700 1 -- 172.21.15.79:0/1887042634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff280ff3c0 msgr2=0x7eff28198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff25d9b700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff280ff3c0 0x7eff28198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff25d9b700 1 -- 172.21.15.79:0/1887042634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff100095f0 con 0x7eff280ffd60 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff25d9b700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff281985a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff1000bda0 tx=0x7eff1000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff1f7fe700 1 -- 172.21.15.79:0/1887042634 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1001d070 con 0x7eff280ffd60 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff1f7fe700 1 -- 172.21.15.79:0/1887042634 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff10004fb0 con 0x7eff280ffd60 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.558+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2819cab0 con 0x7eff280ffd60 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.559+0000 7eff1f7fe700 1 -- 172.21.15.79:0/1887042634 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff1000f480 con 0x7eff280ffd60 2024-09-10T09:47:05.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.559+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2819cfa0 con 0x7eff280ffd60 2024-09-10T09:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.559+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2804f2a0 con 0x7eff280ffd60 2024-09-10T09:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.560+0000 7eff1f7fe700 1 -- 172.21.15.79:0/1887042634 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7eff10022870 con 0x7eff280ffd60 2024-09-10T09:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.560+0000 7eff1f7fe700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1406e200 0x7eff140706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.560+0000 7eff1f7fe700 1 -- 172.21.15.79:0/1887042634 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7eff1008f630 con 0x7eff280ffd60 2024-09-10T09:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.560+0000 7eff2659c700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1406e200 0x7eff140706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:47:05.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.561+0000 7eff2659c700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1406e200 0x7eff140706b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff2000e270 tx=0x7eff20009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:47:05.566 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.565+0000 7eff1f7fe700 1 -- 172.21.15.79:0/1887042634 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7eff10058c60 con 0x7eff280ffd60 2024-09-10T09:47:05.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:05 smithi135 ceph-mon[65362]: pgmap v234: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:05.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.852+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7eff281993c0 con 0x7eff280ffd60 2024-09-10T09:47:05.854 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.852+0000 7eff1f7fe700 1 -- 172.21.15.79:0/1887042634 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7eff1005c320 con 0x7eff280ffd60 2024-09-10T09:47:05.854 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:47:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:47:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 14 2024-09-10T09:47:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:47:05.856 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1406e200 msgr2=0x7eff140706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1406e200 0x7eff140706b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff2000e270 tx=0x7eff20009040 comp rx=0 tx=0).stop 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 msgr2=0x7eff281985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff281985a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff1000bda0 tx=0x7eff1000be80 comp rx=0 tx=0).stop 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 shutdown_connections 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7eff1406e200 0x7eff140706b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff280ff3c0 0x7eff28198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 --2- 172.21.15.79:0/1887042634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff280ffd60 0x7eff281985a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 >> 172.21.15.79:0/1887042634 conn(0x7eff280fac80 msgr2=0x7eff280fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 shutdown_connections 2024-09-10T09:47:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:47:05.855+0000 7eff2cce5700 1 -- 172.21.15.79:0/1887042634 wait complete. 2024-09-10T09:47:06.537 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:06 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1887042634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:47:06.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-10T09:47:06.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:06 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1887042634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:47:06.754 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:47:07.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:07 smithi079 ceph-mon[87213]: pgmap v235: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:07.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:07 smithi135 ceph-mon[65362]: pgmap v235: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:08.391 INFO:teuthology.orchestra.run.smithi079.stdout:wait for servicemap items w/ changing names to refresh 2024-09-10T09:47:09.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'sleep 60' 2024-09-10T09:47:09.233 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:47:09.353 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:09 smithi079 ceph-mon[87213]: pgmap v236: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:09.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:09 smithi135 ceph-mon[65362]: pgmap v236: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:11.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:11 smithi079 ceph-mon[87213]: pgmap v237: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:11 smithi135 ceph-mon[65362]: pgmap v237: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:13.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:13 smithi079 ceph-mon[87213]: pgmap v238: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:13.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:13 smithi135 ceph-mon[65362]: pgmap v238: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:15.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:15 smithi079 ceph-mon[87213]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:15 smithi135 ceph-mon[65362]: pgmap v239: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:17.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:17 smithi135 ceph-mon[65362]: pgmap v240: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:17.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:17 smithi079 ceph-mon[87213]: pgmap v240: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:19 smithi079 ceph-mon[87213]: pgmap v241: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:19.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:19.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:19 smithi135 ceph-mon[65362]: pgmap v241: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:19.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:21.520 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:21 smithi135 ceph-mon[65362]: pgmap v242: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:21.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:21 smithi079 ceph-mon[87213]: pgmap v242: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:23.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:23 smithi079 ceph-mon[87213]: pgmap v243: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:23.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:23 smithi135 ceph-mon[65362]: pgmap v243: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:25.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:25 smithi079 ceph-mon[87213]: pgmap v244: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:25.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:25 smithi135 ceph-mon[65362]: pgmap v244: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:27.566 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:27 smithi079 ceph-mon[87213]: pgmap v245: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:27.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:27 smithi135 ceph-mon[65362]: pgmap v245: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:29.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:29 smithi079 ceph-mon[87213]: pgmap v246: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:29.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:29 smithi135 ceph-mon[65362]: pgmap v246: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:31.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:31 smithi079 ceph-mon[87213]: pgmap v247: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:31.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:31 smithi135 ceph-mon[65362]: pgmap v247: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:33.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:33 smithi079 ceph-mon[87213]: pgmap v248: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:33.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:33 smithi135 ceph-mon[65362]: pgmap v248: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:34.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:34.721 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:34 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:35.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:35 smithi079 ceph-mon[87213]: pgmap v249: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:35 smithi135 ceph-mon[65362]: pgmap v249: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:37.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:37 smithi079 ceph-mon[87213]: pgmap v250: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:37.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:37 smithi135 ceph-mon[65362]: pgmap v250: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:39.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:39 smithi079 ceph-mon[87213]: pgmap v251: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:39.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:39 smithi135 ceph-mon[65362]: pgmap v251: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:40.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:47:40.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:47:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:41 smithi079 ceph-mon[87213]: pgmap v252: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:47:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:47:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:47:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:47:41.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:47:41.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:41 smithi135 ceph-mon[65362]: pgmap v252: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:41.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:47:41.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:47:41.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:47:41.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:47:41.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:47:43.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:43 smithi079 ceph-mon[87213]: pgmap v253: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:43.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:43 smithi135 ceph-mon[65362]: pgmap v253: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:45.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:45 smithi079 ceph-mon[87213]: pgmap v254: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:45.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:45 smithi135 ceph-mon[65362]: pgmap v254: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:47.672 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:47 smithi135 ceph-mon[65362]: pgmap v255: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:47.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:47 smithi079 ceph-mon[87213]: pgmap v255: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:49.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:49 smithi079 ceph-mon[87213]: pgmap v256: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:49.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:49 smithi135 ceph-mon[65362]: pgmap v256: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:47:51.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:51 smithi079 ceph-mon[87213]: pgmap v257: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:51.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:51 smithi135 ceph-mon[65362]: pgmap v257: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:53.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:53 smithi079 ceph-mon[87213]: pgmap v258: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:53.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:53 smithi135 ceph-mon[65362]: pgmap v258: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:55.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:55 smithi079 ceph-mon[87213]: pgmap v259: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:55.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:55 smithi135 ceph-mon[65362]: pgmap v259: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:47:57.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:57 smithi079 ceph-mon[87213]: pgmap v260: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:57.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:57 smithi135 ceph-mon[65362]: pgmap v260: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:47:59.625 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:47:59 smithi079 ceph-mon[87213]: pgmap v261: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:47:59.719 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:47:59 smithi135 ceph-mon[65362]: pgmap v261: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:01.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:01 smithi079 ceph-mon[87213]: pgmap v262: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:01 smithi135 ceph-mon[65362]: pgmap v262: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:03.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:03 smithi079 ceph-mon[87213]: pgmap v263: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:03 smithi135 ceph-mon[65362]: pgmap v263: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:04.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:04.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:05.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:05 smithi079 ceph-mon[87213]: pgmap v264: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:05.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:05 smithi135 ceph-mon[65362]: pgmap v264: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:07.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:07 smithi079 ceph-mon[87213]: pgmap v265: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:07.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:07 smithi135 ceph-mon[65362]: pgmap v265: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:09.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:09 smithi079 ceph-mon[87213]: pgmap v266: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:09.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:09 smithi135 ceph-mon[65362]: pgmap v266: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:11.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:11 smithi079 ceph-mon[87213]: pgmap v267: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:11 smithi135 ceph-mon[65362]: pgmap v267: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:11.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph orch ps' 2024-09-10T09:48:12.084 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:13.656 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:13 smithi079 ceph-mon[87213]: pgmap v268: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:13.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:13 smithi135 ceph-mon[65362]: pgmap v268: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.915+0000 7f8c70e59700 1 -- 172.21.15.79:0/2987544304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ffc60 msgr2=0x7f8c6c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.915+0000 7f8c70e59700 1 --2- 172.21.15.79:0/2987544304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ffc60 0x7f8c6c10a6d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009910 tx=0x7f8c5c009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.915+0000 7f8c70e59700 1 -- 172.21.15.79:0/2987544304 shutdown_connections 2024-09-10T09:48:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.915+0000 7f8c70e59700 1 --2- 172.21.15.79:0/2987544304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ffc60 0x7f8c6c10a6d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.915+0000 7f8c70e59700 1 --2- 172.21.15.79:0/2987544304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c0ff350 0x7f8c6c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.915+0000 7f8c70e59700 1 -- 172.21.15.79:0/2987544304 >> 172.21.15.79:0/2987544304 conn(0x7f8c6c0748b0 msgr2=0x7f8c6c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:13.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.916+0000 7f8c70e59700 1 -- 172.21.15.79:0/2987544304 shutdown_connections 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.916+0000 7f8c70e59700 1 -- 172.21.15.79:0/2987544304 wait complete. 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.916+0000 7f8c70e59700 1 Processor -- start 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.916+0000 7f8c70e59700 1 -- start start 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c70e59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ff350 0x7f8c6c195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c70e59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c0ffc60 0x7f8c6c196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c70e59700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c196a70 con 0x7f8c6c0ff350 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c70e59700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c196bb0 con 0x7f8c6c0ffc60 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c6a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ff350 0x7f8c6c195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c6a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ff350 0x7f8c6c195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52888/0 (socket says 172.21.15.79:52888) 2024-09-10T09:48:13.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c6a59c700 1 -- 172.21.15.79:0/753796220 learned_addr learned my addr 172.21.15.79:0/753796220 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c69d9b700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c0ffc60 0x7f8c6c196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c6a59c700 1 -- 172.21.15.79:0/753796220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c0ffc60 msgr2=0x7f8c6c196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c6a59c700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c0ffc60 0x7f8c6c196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c6a59c700 1 -- 172.21.15.79:0/753796220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0095f0 con 0x7f8c6c0ff350 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c69d9b700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c0ffc60 0x7f8c6c196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.917+0000 7f8c6a59c700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ff350 0x7f8c6c195ee0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400c910 tx=0x7f8c5400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.918+0000 7f8c637fe700 1 -- 172.21.15.79:0/753796220 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c540041f0 con 0x7f8c6c0ff350 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.918+0000 7f8c637fe700 1 -- 172.21.15.79:0/753796220 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c54007dc0 con 0x7f8c6c0ff350 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.918+0000 7f8c637fe700 1 -- 172.21.15.79:0/753796220 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c54003e70 con 0x7f8c6c0ff350 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.918+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c19aa00 con 0x7f8c6c0ff350 2024-09-10T09:48:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.918+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c19af50 con 0x7f8c6c0ff350 2024-09-10T09:48:13.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.919+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c107dd0 con 0x7f8c6c0ff350 2024-09-10T09:48:13.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.919+0000 7f8c637fe700 1 -- 172.21.15.79:0/753796220 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8c54004350 con 0x7f8c6c0ff350 2024-09-10T09:48:13.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.920+0000 7f8c637fe700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8c5806e1b0 0x7f8c58070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:13.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.920+0000 7f8c69d9b700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8c5806e1b0 0x7f8c58070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:13.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.920+0000 7f8c637fe700 1 -- 172.21.15.79:0/753796220 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f8c5408dea0 con 0x7f8c6c0ff350 2024-09-10T09:48:13.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.921+0000 7f8c69d9b700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8c5806e1b0 0x7f8c58070660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0059d0 tx=0x7f8c5c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:13.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:13.925+0000 7f8c637fe700 1 -- 172.21.15.79:0/753796220 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8c54057220 con 0x7f8c6c0ff350 2024-09-10T09:48:14.137 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.137+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 --> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c6c19b1d0 con 0x7f8c5806e1b0 2024-09-10T09:48:14.147 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.146+0000 7f8c637fe700 1 -- 172.21.15.79:0/753796220 <== mgr.34104 v2:172.21.15.79:6800/1910344825 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8c6c19b1d0 con 0x7f8c5806e1b0 2024-09-10T09:48:14.147 INFO:teuthology.orchestra.run.smithi079.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T09:48:14.147 INFO:teuthology.orchestra.run.smithi079.stdout:alertmanager.smithi079 smithi079 *:9093,9094 running (9m) 99s ago 20m 26.0M - 0.25.0 c8568f914cd2 f7c934bd835c 2024-09-10T09:48:14.147 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi079 smithi079 running (113s) 99s ago 20m 7738k - 19.1.1-305-g1cf819b7 41d671128357 d807a1ff3586 2024-09-10T09:48:14.147 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-exporter.smithi135 smithi135 running (108s) 105s ago 19m 7331k - 19.1.1-305-g1cf819b7 41d671128357 ce8d6cdd57bd 2024-09-10T09:48:14.147 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi079 smithi079 running (6m) 99s ago 20m 6895k - 19.1.1-305-g1cf819b7 41d671128357 8e819a4fb936 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:crash.smithi135 smithi135 running (6m) 105s ago 19m 6895k - 19.1.1-305-g1cf819b7 41d671128357 4db4d714b59a 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:grafana.smithi079 smithi079 *:3000 running (9m) 99s ago 19m 81.9M - 9.4.12 2bacad6d85d8 4de43214d73d 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.pqgxjw smithi079 running (3m) 99s ago 14m 88.8M - 19.1.1-305-g1cf819b7 41d671128357 8b9798263ca8 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi079.wpfdzn smithi079 running (2m) 99s ago 14m 85.4M - 19.1.1-305-g1cf819b7 41d671128357 0b76e0343289 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.lvmrsq smithi135 running (2m) 105s ago 14m 13.9M - 19.1.1-305-g1cf819b7 41d671128357 c2b0b0dae143 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mds.cephfs.smithi135.oqqtlp smithi135 running (2m) 105s ago 14m 13.2M - 19.1.1-305-g1cf819b7 41d671128357 9b612ab66995 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi079.mhirny smithi079 *:8443,9283,8765 running (11m) 99s ago 21m 506M - 19.1.1-305-g1cf819b7 41d671128357 9c39c99ba28d 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mgr.smithi135.lbhjof smithi135 *:8443,9283,8765 running (10m) 105s ago 19m 442M - 19.1.1-305-g1cf819b7 41d671128357 48a70b108e85 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi079 smithi079 running (7m) 99s ago 21m 59.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 888aa89ba764 2024-09-10T09:48:14.148 INFO:teuthology.orchestra.run.smithi079.stdout:mon.smithi135 smithi135 running (7m) 105s ago 19m 46.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 1ce9e84003d6 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi079 smithi079 *:9100 running (10m) 99s ago 20m 14.5M - 1.5.0 0da6a335fe13 93caaba99a9b 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:node-exporter.smithi135 smithi135 *:9100 running (10m) 105s ago 19m 16.3M - 1.5.0 0da6a335fe13 9c3ac46b4991 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 smithi079 running (6m) 99s ago 18m 113M 1216M 19.1.1-305-g1cf819b7 41d671128357 b909b443d0eb 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 smithi079 running (5m) 99s ago 17m 123M 1216M 19.1.1-305-g1cf819b7 41d671128357 032a78efcc7c 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 smithi079 running (5m) 99s ago 17m 109M 1216M 19.1.1-305-g1cf819b7 41d671128357 5d91d18346d9 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 smithi135 running (4m) 105s ago 17m 124M 4096M 19.1.1-305-g1cf819b7 41d671128357 8c3025b323fc 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 smithi135 running (3m) 105s ago 16m 111M 4096M 19.1.1-305-g1cf819b7 41d671128357 05ee4cd92ec3 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 smithi135 running (3m) 105s ago 16m 108M 4096M 19.1.1-305-g1cf819b7 41d671128357 e48bce7b2061 2024-09-10T09:48:14.149 INFO:teuthology.orchestra.run.smithi079.stdout:prometheus.smithi079 smithi079 *:9095 running (9m) 99s ago 19m 81.3M - 2.43.0 a07b618ecd1d cc979c0ac74d 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8c5806e1b0 msgr2=0x7f8c58070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8c5806e1b0 0x7f8c58070660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0059d0 tx=0x7f8c5c01a040 comp rx=0 tx=0).stop 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ff350 msgr2=0x7f8c6c195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ff350 0x7f8c6c195ee0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400c910 tx=0x7f8c5400ccd0 comp rx=0 tx=0).stop 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 shutdown_connections 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f8c5806e1b0 0x7f8c58070660 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c6c0ff350 0x7f8c6c195ee0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:14.150 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 --2- 172.21.15.79:0/753796220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c6c0ffc60 0x7f8c6c196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 >> 172.21.15.79:0/753796220 conn(0x7f8c6c0748b0 msgr2=0x7f8c6c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 shutdown_connections 2024-09-10T09:48:14.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:14.149+0000 7f8c70e59700 1 -- 172.21.15.79:0/753796220 wait complete. 2024-09-10T09:48:14.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions' 2024-09-10T09:48:15.105 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:15.499 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:15 smithi079 ceph-mon[87213]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:48:15.499 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:15 smithi079 ceph-mon[87213]: pgmap v269: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:15.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:15 smithi135 ceph-mon[65362]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T09:48:15.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:15 smithi135 ceph-mon[65362]: pgmap v269: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 -- 172.21.15.79:0/3262948098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc100e60 msgr2=0x7f03cc104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/3262948098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc100e60 0x7f03cc104e30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009910 tx=0x7f03b4009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 -- 172.21.15.79:0/3262948098 shutdown_connections 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/3262948098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc100e60 0x7f03cc104e30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/3262948098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03cc1004c0 0x7f03cc100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 -- 172.21.15.79:0/3262948098 >> 172.21.15.79:0/3262948098 conn(0x7f03cc0fbd80 msgr2=0x7f03cc0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 -- 172.21.15.79:0/3262948098 shutdown_connections 2024-09-10T09:48:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.798+0000 7f03d0d1d700 1 -- 172.21.15.79:0/3262948098 wait complete. 2024-09-10T09:48:16.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03d0d1d700 1 Processor -- start 2024-09-10T09:48:16.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03d0d1d700 1 -- start start 2024-09-10T09:48:16.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03d0d1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc1004c0 0x7f03cc073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:16.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03d0d1d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03cc100e60 0x7f03cc073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:16.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03d0d1d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc073ad0 con 0x7f03cc1004c0 2024-09-10T09:48:16.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03d0d1d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc073c10 con 0x7f03cc100e60 2024-09-10T09:48:16.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03ca59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc1004c0 0x7f03cc073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03ca59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc1004c0 0x7f03cc073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52900/0 (socket says 172.21.15.79:52900) 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03ca59c700 1 -- 172.21.15.79:0/1348930875 learned_addr learned my addr 172.21.15.79:0/1348930875 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03c1d9b700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03cc100e60 0x7f03cc073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03ca59c700 1 -- 172.21.15.79:0/1348930875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03cc100e60 msgr2=0x7f03cc073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03ca59c700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03cc100e60 0x7f03cc073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.799+0000 7f03ca59c700 1 -- 172.21.15.79:0/1348930875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40095f0 con 0x7f03cc1004c0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.800+0000 7f03ca59c700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc1004c0 0x7f03cc073050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00d8d0 tx=0x7f03bc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.800+0000 7f03c3fff700 1 -- 172.21.15.79:0/1348930875 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03bc0098a0 con 0x7f03cc1004c0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.800+0000 7f03c3fff700 1 -- 172.21.15.79:0/1348930875 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03bc010460 con 0x7f03cc1004c0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.800+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc1a20c0 con 0x7f03cc1004c0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.800+0000 7f03c3fff700 1 -- 172.21.15.79:0/1348930875 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03bc00f5f0 con 0x7f03cc1004c0 2024-09-10T09:48:16.802 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.800+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc1a24d0 con 0x7f03cc1004c0 2024-09-10T09:48:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.801+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc108830 con 0x7f03cc1004c0 2024-09-10T09:48:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.801+0000 7f03c3fff700 1 -- 172.21.15.79:0/1348930875 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f03bc009a00 con 0x7f03cc1004c0 2024-09-10T09:48:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.802+0000 7f03c3fff700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f03b806e200 0x7f03b80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.802+0000 7f03c3fff700 1 -- 172.21.15.79:0/1348930875 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f03bc08df70 con 0x7f03cc1004c0 2024-09-10T09:48:16.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.802+0000 7f03c1d9b700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f03b806e200 0x7f03b80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:16.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.802+0000 7f03c1d9b700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f03b806e200 0x7f03b80706b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03cc074840 tx=0x7f03b401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:16.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:16.806+0000 7f03c3fff700 1 -- 172.21.15.79:0/1348930875 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f03bc0c31b0 con 0x7f03cc1004c0 2024-09-10T09:48:17.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.090+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f03cc074690 con 0x7f03cc1004c0 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.091+0000 7f03c3fff700 1 -- 172.21.15.79:0/1348930875 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f03bc057350 con 0x7f03cc1004c0 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": { 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": { 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 2 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:48:17.092 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": { 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 6 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 4 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "overall": { 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)": 14 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-10T09:48:17.093 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f03b806e200 msgr2=0x7f03b80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f03b806e200 0x7f03b80706b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03cc074840 tx=0x7f03b401a040 comp rx=0 tx=0).stop 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc1004c0 msgr2=0x7f03cc073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc1004c0 0x7f03cc073050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00d8d0 tx=0x7f03bc00dbe0 comp rx=0 tx=0).stop 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 shutdown_connections 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f03b806e200 0x7f03b80706b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f03cc1004c0 0x7f03cc073050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 --2- 172.21.15.79:0/1348930875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03cc100e60 0x7f03cc073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 >> 172.21.15.79:0/1348930875 conn(0x7f03cc0fbd80 msgr2=0x7f03cc0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 shutdown_connections 2024-09-10T09:48:17.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:17.093+0000 7f03d0d1d700 1 -- 172.21.15.79:0/1348930875 wait complete. 2024-09-10T09:48:17.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:17 smithi079 ceph-mon[87213]: pgmap v270: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:17.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:17 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1348930875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:48:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:17 smithi135 ceph-mon[65362]: pgmap v270: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:17 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1348930875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:48:17.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-10T09:48:17.984 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 -- 172.21.15.79:0/2241026466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 msgr2=0x7f3524104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 --2- 172.21.15.79:0/2241026466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524104500 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3514009910 tx=0x7f3514009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 -- 172.21.15.79:0/2241026466 shutdown_connections 2024-09-10T09:48:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 --2- 172.21.15.79:0/2241026466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35240ffbd0 0x7f3524100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 --2- 172.21.15.79:0/2241026466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524104500 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 -- 172.21.15.79:0/2241026466 >> 172.21.15.79:0/2241026466 conn(0x7f3524075130 msgr2=0x7f3524075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 -- 172.21.15.79:0/2241026466 shutdown_connections 2024-09-10T09:48:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.567+0000 7f3529f56700 1 -- 172.21.15.79:0/2241026466 wait complete. 2024-09-10T09:48:19.570 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:19 smithi079 ceph-mon[87213]: pgmap v271: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:19.570 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:19.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.568+0000 7f3529f56700 1 Processor -- start 2024-09-10T09:48:19.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.568+0000 7f3529f56700 1 -- start start 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.568+0000 7f3529f56700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35240ffbd0 0x7f3524194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.568+0000 7f3529f56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.568+0000 7f3529f56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3524195a60 con 0x7f3524104130 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.568+0000 7f3529f56700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35241997f0 con 0x7f35240ffbd0 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f351affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f351affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:52910/0 (socket says 172.21.15.79:52910) 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f351affd700 1 -- 172.21.15.79:0/3388446025 learned_addr learned my addr 172.21.15.79:0/3388446025 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f35237fe700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35240ffbd0 0x7f3524194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f351affd700 1 -- 172.21.15.79:0/3388446025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35240ffbd0 msgr2=0x7f3524194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f351affd700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35240ffbd0 0x7f3524194e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f351affd700 1 -- 172.21.15.79:0/3388446025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140095f0 con 0x7f3524104130 2024-09-10T09:48:19.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f351affd700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524195380 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b4b0 tx=0x7f350c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f35217fa700 1 -- 172.21.15.79:0/3388446025 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350c011800 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f35217fa700 1 -- 172.21.15.79:0/3388446025 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f350c011e20 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.569+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3524199ad0 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.570+0000 7f35217fa700 1 -- 172.21.15.79:0/3388446025 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f350c00f2e0 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.570+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352419a020 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.571+0000 7f35217fa700 1 -- 172.21.15.79:0/3388446025 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f350c00f510 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.571+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35241076a0 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.571+0000 7f35217fa700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f351006e200 0x7f35100706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.571+0000 7f35217fa700 1 -- 172.21.15.79:0/3388446025 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f350c08dc70 con 0x7f3524104130 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.571+0000 7f35237fe700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f351006e200 0x7f35100706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:19.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.572+0000 7f35237fe700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f351006e200 0x7f35100706b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f351400b5c0 tx=0x7f3514005460 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:19.576 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.576+0000 7f35217fa700 1 -- 172.21.15.79:0/3388446025 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f350c057130 con 0x7f3524104130 2024-09-10T09:48:19.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:19 smithi135 ceph-mon[65362]: pgmap v271: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:19.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:19.860 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.859+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3524196240 con 0x7f3524104130 2024-09-10T09:48:19.861 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.860+0000 7f35217fa700 1 -- 172.21.15.79:0/3388446025 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f350c05a7f0 con 0x7f3524104130 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f351006e200 msgr2=0x7f35100706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f351006e200 0x7f35100706b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f351400b5c0 tx=0x7f3514005460 comp rx=0 tx=0).stop 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 msgr2=0x7f3524195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524195380 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b4b0 tx=0x7f350c00b870 comp rx=0 tx=0).stop 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 shutdown_connections 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f351006e200 0x7f35100706b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35240ffbd0 0x7f3524194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:19.863 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 --2- 172.21.15.79:0/3388446025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3524104130 0x7f3524195380 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:19.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 >> 172.21.15.79:0/3388446025 conn(0x7f3524075130 msgr2=0x7f35240fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:19.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 shutdown_connections 2024-09-10T09:48:19.864 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:19.862+0000 7f3529f56700 1 -- 172.21.15.79:0/3388446025 wait complete. 2024-09-10T09:48:19.873 INFO:teuthology.orchestra.run.smithi079.stdout:true 2024-09-10T09:48:20.546 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:20 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3388446025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:48:20.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -e sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-10T09:48:20.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:20 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3388446025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:48:20.768 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:21.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:21 smithi079 ceph-mon[87213]: pgmap v272: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:21.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:21 smithi135 ceph-mon[65362]: pgmap v272: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:22.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 -- 172.21.15.79:0/3843599618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ff3b0 msgr2=0x7f7a480ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:22.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 --2- 172.21.15.79:0/3843599618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ff3b0 0x7f7a480ff780 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800b0a0 tx=0x7f7a3800b3b0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 -- 172.21.15.79:0/3843599618 shutdown_connections 2024-09-10T09:48:22.410 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 --2- 172.21.15.79:0/3843599618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a480ffd50 0x7f7a48103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 --2- 172.21.15.79:0/3843599618 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ff3b0 0x7f7a480ff780 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 -- 172.21.15.79:0/3843599618 >> 172.21.15.79:0/3843599618 conn(0x7f7a480fac90 msgr2=0x7f7a480fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 -- 172.21.15.79:0/3843599618 shutdown_connections 2024-09-10T09:48:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 -- 172.21.15.79:0/3843599618 wait complete. 2024-09-10T09:48:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.409+0000 7f7a4db65700 1 Processor -- start 2024-09-10T09:48:22.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a4db65700 1 -- start start 2024-09-10T09:48:22.412 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a4db65700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a480ff3b0 0x7f7a48196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a4db65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ffd50 0x7f7a481972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a4db65700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48197980 con 0x7f7a480ffd50 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a4db65700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48197ac0 con 0x7f7a480ff3b0 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a46ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ffd50 0x7f7a481972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a46ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ffd50 0x7f7a481972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58180/0 (socket says 172.21.15.79:58180) 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a46ffd700 1 -- 172.21.15.79:0/1461003497 learned_addr learned my addr 172.21.15.79:0/1461003497 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a477fe700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a480ff3b0 0x7f7a48196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a46ffd700 1 -- 172.21.15.79:0/1461003497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a480ff3b0 msgr2=0x7f7a48196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a46ffd700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a480ff3b0 0x7f7a48196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a46ffd700 1 -- 172.21.15.79:0/1461003497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a38009d00 con 0x7f7a480ffd50 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.410+0000 7f7a46ffd700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ffd50 0x7f7a481972a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d900 tx=0x7f7a3000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:22.413 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.411+0000 7f7a44ff9700 1 -- 172.21.15.79:0/1461003497 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a30009900 con 0x7f7a480ffd50 2024-09-10T09:48:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.411+0000 7f7a44ff9700 1 -- 172.21.15.79:0/1461003497 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a30010460 con 0x7f7a480ffd50 2024-09-10T09:48:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.411+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4819fdd0 con 0x7f7a480ffd50 2024-09-10T09:48:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.411+0000 7f7a44ff9700 1 -- 172.21.15.79:0/1461003497 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a3000f5f0 con 0x7f7a480ffd50 2024-09-10T09:48:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.411+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a481a02f0 con 0x7f7a480ffd50 2024-09-10T09:48:22.414 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.412+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a481076c0 con 0x7f7a480ffd50 2024-09-10T09:48:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.412+0000 7f7a44ff9700 1 -- 172.21.15.79:0/1461003497 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7a300105d0 con 0x7f7a480ffd50 2024-09-10T09:48:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.413+0000 7f7a44ff9700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7a3406e200 0x7f7a340706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.413+0000 7f7a44ff9700 1 -- 172.21.15.79:0/1461003497 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7a3008db00 con 0x7f7a480ffd50 2024-09-10T09:48:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.413+0000 7f7a477fe700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7a3406e200 0x7f7a340706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:22.415 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.413+0000 7f7a477fe700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7a3406e200 0x7f7a340706b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f80 tx=0x7f7a380061f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:22.418 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.417+0000 7f7a44ff9700 1 -- 172.21.15.79:0/1461003497 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7a30056f60 con 0x7f7a480ffd50 2024-09-10T09:48:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:22 smithi079 ceph-mon[87213]: pgmap v273: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:22.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.707+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7a4804f2a0 con 0x7f7a480ffd50 2024-09-10T09:48:22.708 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.707+0000 7f7a44ff9700 1 -- 172.21.15.79:0/1461003497 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f7a30017290 con 0x7f7a480ffd50 2024-09-10T09:48:22.710 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7a3406e200 msgr2=0x7f7a340706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7a3406e200 0x7f7a340706b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f80 tx=0x7f7a380061f0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ffd50 msgr2=0x7f7a481972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ffd50 0x7f7a481972a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d900 tx=0x7f7a3000dc10 comp rx=0 tx=0).stop 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 shutdown_connections 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f7a3406e200 0x7f7a340706b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7a480ff3b0 0x7f7a48196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 --2- 172.21.15.79:0/1461003497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a480ffd50 0x7f7a481972a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.709+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 >> 172.21.15.79:0/1461003497 conn(0x7f7a480fac90 msgr2=0x7f7a480fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.710+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 shutdown_connections 2024-09-10T09:48:22.711 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:22.710+0000 7f7a4db65700 1 -- 172.21.15.79:0/1461003497 wait complete. 2024-09-10T09:48:22.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:22 smithi135 ceph-mon[65362]: pgmap v273: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:22.720 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)" 2024-09-10T09:48:23.386 DEBUG:teuthology.parallel:result is None 2024-09-10T09:48:23.386 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T09:48:23.400 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:48:23.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T09:48:23.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:23 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1461003497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:48:23.599 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:23.620 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:23 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1461003497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-10T09:48:24.671 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:24 smithi079 ceph-mon[87213]: pgmap v274: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:24.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:24 smithi135 ceph-mon[65362]: pgmap v274: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/3387120088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 msgr2=0x7f5b3810a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/3387120088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b3810a6d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009910 tx=0x7f5b28009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/3387120088 shutdown_connections 2024-09-10T09:48:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/3387120088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b3810a6d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/3387120088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b380ff350 0x7f5b380ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/3387120088 >> 172.21.15.79:0/3387120088 conn(0x7f5b380748b0 msgr2=0x7f5b38074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/3387120088 shutdown_connections 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.193+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/3387120088 wait complete. 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.194+0000 7f5b3dd8c700 1 Processor -- start 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.194+0000 7f5b3dd8c700 1 -- start start 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.194+0000 7f5b3dd8c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b380ff350 0x7f5b38195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.194+0000 7f5b3dd8c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b381963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.194+0000 7f5b3dd8c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38196a30 con 0x7f5b380ffc60 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.194+0000 7f5b3dd8c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38196b70 con 0x7f5b380ff350 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b381963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b36ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b381963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58192/0 (socket says 172.21.15.79:58192) 2024-09-10T09:48:25.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b36ffd700 1 -- 172.21.15.79:0/2972306367 learned_addr learned my addr 172.21.15.79:0/2972306367 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b377fe700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b380ff350 0x7f5b38195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b36ffd700 1 -- 172.21.15.79:0/2972306367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b380ff350 msgr2=0x7f5b38195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b36ffd700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b380ff350 0x7f5b38195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b36ffd700 1 -- 172.21.15.79:0/2972306367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280095f0 con 0x7f5b380ffc60 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b36ffd700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b381963e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006010 tx=0x7f5b280055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b34ff9700 1 -- 172.21.15.79:0/2972306367 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b2801d070 con 0x7f5b380ffc60 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b34ff9700 1 -- 172.21.15.79:0/2972306367 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b28005dc0 con 0x7f5b380ffc60 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3819a9c0 con 0x7f5b380ffc60 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b34ff9700 1 -- 172.21.15.79:0/2972306367 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b28021410 con 0x7f5b380ffc60 2024-09-10T09:48:25.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.195+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3819af10 con 0x7f5b380ffc60 2024-09-10T09:48:25.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.196+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b38107dd0 con 0x7f5b380ffc60 2024-09-10T09:48:25.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.197+0000 7f5b34ff9700 1 -- 172.21.15.79:0/2972306367 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5b2800f460 con 0x7f5b380ffc60 2024-09-10T09:48:25.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.197+0000 7f5b34ff9700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f5b2406e200 0x7f5b240706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:25.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.197+0000 7f5b377fe700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f5b2406e200 0x7f5b240706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:25.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.197+0000 7f5b34ff9700 1 -- 172.21.15.79:0/2972306367 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f5b2808f1f0 con 0x7f5b380ffc60 2024-09-10T09:48:25.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.198+0000 7f5b377fe700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f5b2406e200 0x7f5b240706b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000ac50 tx=0x7f5b2000a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:25.203 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.202+0000 7f5b34ff9700 1 -- 172.21.15.79:0/2972306367 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5b28058650 con 0x7f5b380ffc60 2024-09-10T09:48:25.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.445+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b38197200 con 0x7f5b380ffc60 2024-09-10T09:48:25.447 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.446+0000 7f5b34ff9700 1 -- 172.21.15.79:0/2972306367 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+2004 (secure 0 0 0) 0x7f5b2805bd10 con 0x7f5b380ffc60 2024-09-10T09:48:25.447 INFO:teuthology.orchestra.run.smithi079.stdout:e38 2024-09-10T09:48:25.447 INFO:teuthology.orchestra.run.smithi079.stdout:btime 2024-09-10T09:46:39:750726+0000 2024-09-10T09:48:25.447 INFO:teuthology.orchestra.run.smithi079.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T09:48:25.447 INFO:teuthology.orchestra.run.smithi079.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-10T09:48:25.447 INFO:teuthology.orchestra.run.smithi079.stdout:legacy client fscid: 1 2024-09-10T09:48:25.447 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:Filesystem 'cephfs' (1) 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:fs_name cephfs 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 38 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-10T09:33:26.721509+0000 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-10T09:46:38.874550+0000 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:tableserver 0 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:root 0 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:session_timeout 60 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:session_autoclose 300 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:max_file_size 1099511627776 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:max_xattr_size 65536 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:required_client_features {} 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure 0 2024-09-10T09:48:25.448 INFO:teuthology.orchestra.run.smithi079.stdout:last_failure_osd_epoch 86 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:max_mds 1 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:in 0 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:up {0=34378} 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:failed 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:damaged 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:stopped 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:data_pools [3] 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:metadata_pool 2 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:inline_data enabled 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:balancer 2024-09-10T09:48:25.449 INFO:teuthology.orchestra.run.smithi079.stdout:bal_rank_mask -1 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:standby_count_wanted 1 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:qdb_cluster leader: 34378 members: 34378 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.pqgxjw{0:34378} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.79:6826/1667265711,v1:172.21.15.79:6827/1667265711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi079.wpfdzn{0:34410} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.79:6828/2505923187,v1:172.21.15.79:6829/2505923187] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:Standby daemons: 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.lvmrsq{-1:44291} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6824/1647814509,v1:172.21.15.135:6825/1647814509] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:48:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.cephfs.smithi135.oqqtlp{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.135:6826/3728464568,v1:172.21.15.135:6827/3728464568] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T09:48:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f5b2406e200 msgr2=0x7f5b240706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f5b2406e200 0x7f5b240706b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000ac50 tx=0x7f5b2000a380 comp rx=0 tx=0).stop 2024-09-10T09:48:25.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 msgr2=0x7f5b381963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b381963e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006010 tx=0x7f5b280055f0 comp rx=0 tx=0).stop 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 shutdown_connections 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f5b2406e200 0x7f5b240706b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b380ff350 0x7f5b38195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 --2- 172.21.15.79:0/2972306367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b380ffc60 0x7f5b381963e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.448+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 >> 172.21.15.79:0/2972306367 conn(0x7f5b380748b0 msgr2=0x7f5b38104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.449+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 shutdown_connections 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:25.449+0000 7f5b3dd8c700 1 -- 172.21.15.79:0/2972306367 wait complete. 2024-09-10T09:48:25.452 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 38 2024-09-10T09:48:25.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:25 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2972306367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:48:25.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:25 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2972306367' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T09:48:26.068 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-10T09:48:26.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T09:48:26.281 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:26.675 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:26 smithi079 ceph-mon[87213]: pgmap v275: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:26.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:26 smithi135 ceph-mon[65362]: pgmap v275: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 -- 172.21.15.79:0/2284065314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 msgr2=0x7f57c8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2284065314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8103d30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009910 tx=0x7f57bc009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 -- 172.21.15.79:0/2284065314 shutdown_connections 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2284065314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8103d30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2284065314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ff3c0 0x7f57c80ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 -- 172.21.15.79:0/2284065314 >> 172.21.15.79:0/2284065314 conn(0x7f57c80fac60 msgr2=0x7f57c80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 -- 172.21.15.79:0/2284065314 shutdown_connections 2024-09-10T09:48:27.937 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.933+0000 7f57cfe08700 1 -- 172.21.15.79:0/2284065314 wait complete. 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cfe08700 1 Processor -- start 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cfe08700 1 -- start start 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cfe08700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ff3c0 0x7f57c8195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cfe08700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cfe08700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8196ae0 con 0x7f57c80ffd60 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cfe08700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c819a870 con 0x7f57c80ff3c0 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cd3a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cd3a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58206/0 (socket says 172.21.15.79:58206) 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cd3a3700 1 -- 172.21.15.79:0/2550805127 learned_addr learned my addr 172.21.15.79:0/2550805127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.934+0000 7f57cdba4700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ff3c0 0x7f57c8195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57cd3a3700 1 -- 172.21.15.79:0/2550805127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ff3c0 msgr2=0x7f57c8195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57cd3a3700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ff3c0 0x7f57c8195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57cd3a3700 1 -- 172.21.15.79:0/2550805127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0095f0 con 0x7f57c80ffd60 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57cd3a3700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8196400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0092e0 tx=0x7f57bc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:27.938 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57c6ffd700 1 -- 172.21.15.79:0/2550805127 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57bc01d070 con 0x7f57c80ffd60 2024-09-10T09:48:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c819aaf0 con 0x7f57c80ffd60 2024-09-10T09:48:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57c6ffd700 1 -- 172.21.15.79:0/2550805127 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57bc005dc0 con 0x7f57c80ffd60 2024-09-10T09:48:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57c6ffd700 1 -- 172.21.15.79:0/2550805127 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57bc017400 con 0x7f57c80ffd60 2024-09-10T09:48:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.935+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c819afe0 con 0x7f57c80ffd60 2024-09-10T09:48:27.939 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.936+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c804f2a0 con 0x7f57c80ffd60 2024-09-10T09:48:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.936+0000 7f57c6ffd700 1 -- 172.21.15.79:0/2550805127 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f57bc00f6f0 con 0x7f57c80ffd60 2024-09-10T09:48:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.937+0000 7f57c6ffd700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f57b006e200 0x7f57b00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.937+0000 7f57c6ffd700 1 -- 172.21.15.79:0/2550805127 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f57bc08f470 con 0x7f57c80ffd60 2024-09-10T09:48:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.937+0000 7f57cdba4700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f57b006e200 0x7f57b00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:27.940 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.937+0000 7f57cdba4700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f57b006e200 0x7f57b00706b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009550 tx=0x7f57b80091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:27.943 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:27.941+0000 7f57c6ffd700 1 -- 172.21.15.79:0/2550805127 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f57bc058850 con 0x7f57c80ffd60 2024-09-10T09:48:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.185+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57c819b2c0 con 0x7f57c80ffd60 2024-09-10T09:48:28.187 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.185+0000 7f57c6ffd700 1 -- 172.21.15.79:0/2550805127 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5263 (secure 0 0 0) 0x7f57bc05bf10 con 0x7f57c80ffd60 2024-09-10T09:48:28.188 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:28.188 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"btime":"2024-09-10T09:46:39:750726+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44319,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3728464568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3728464568},{"type":"v1","addr":"172.21.15.135:6827","nonce":3728464568}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:38.874550+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f57b006e200 msgr2=0x7f57b00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f57b006e200 0x7f57b00706b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009550 tx=0x7f57b80091b0 comp rx=0 tx=0).stop 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 msgr2=0x7f57c8196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8196400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0092e0 tx=0x7f57bc00bd70 comp rx=0 tx=0).stop 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 shutdown_connections 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f57b006e200 0x7f57b00706b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57c80ff3c0 0x7f57c8195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 --2- 172.21.15.79:0/2550805127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57c80ffd60 0x7f57c8196400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 >> 172.21.15.79:0/2550805127 conn(0x7f57c80fac60 msgr2=0x7f57c8103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 shutdown_connections 2024-09-10T09:48:28.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:28.188+0000 7f57cfe08700 1 -- 172.21.15.79:0/2550805127 wait complete. 2024-09-10T09:48:28.191 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 38 2024-09-10T09:48:28.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:28 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2550805127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T09:48:28.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:28 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2550805127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T09:48:28.868 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-09-10T09:48:28.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 17 2024-09-10T09:48:29.066 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:29.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:29 smithi079 ceph-mon[87213]: pgmap v276: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:29.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:29 smithi135 ceph-mon[65362]: pgmap v276: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:30.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 -- 172.21.15.79:0/1755512404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 msgr2=0x7f5970104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 --2- 172.21.15.79:0/1755512404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970104e30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5960009910 tx=0x7f5960009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 -- 172.21.15.79:0/1755512404 shutdown_connections 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 --2- 172.21.15.79:0/1755512404 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970104e30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 --2- 172.21.15.79:0/1755512404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59701004c0 0x7f5970100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 -- 172.21.15.79:0/1755512404 >> 172.21.15.79:0/1755512404 conn(0x7f59700fbd80 msgr2=0x7f59700fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 -- 172.21.15.79:0/1755512404 shutdown_connections 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.762+0000 7f597536b700 1 -- 172.21.15.79:0/1755512404 wait complete. 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.763+0000 7f597536b700 1 Processor -- start 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.763+0000 7f597536b700 1 -- start start 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.763+0000 7f597536b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59701004c0 0x7f5970073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.763+0000 7f597536b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:30.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.763+0000 7f597536b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5970073ad0 con 0x7f5970100e60 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.763+0000 7f597536b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5970073c10 con 0x7f59701004c0 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.763+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:58234/0 (socket says 172.21.15.79:58234) 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f596e7fc700 1 -- 172.21.15.79:0/2994029341 learned_addr learned my addr 172.21.15.79:0/2994029341 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f596effd700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59701004c0 0x7f5970073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f596e7fc700 1 -- 172.21.15.79:0/2994029341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59701004c0 msgr2=0x7f5970073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f596e7fc700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59701004c0 0x7f5970073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f596e7fc700 1 -- 172.21.15.79:0/2994029341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600095f0 con 0x7f5970100e60 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f596e7fc700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970073590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59600059d0 tx=0x7f596000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f5957fff700 1 -- 172.21.15.79:0/2994029341 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596001d070 con 0x7f5970100e60 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f5957fff700 1 -- 172.21.15.79:0/2994029341 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f596000b610 con 0x7f5970100e60 2024-09-10T09:48:30.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5970073e90 con 0x7f5970100e60 2024-09-10T09:48:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f5957fff700 1 -- 172.21.15.79:0/2994029341 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5960022470 con 0x7f5970100e60 2024-09-10T09:48:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.764+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59701a23f0 con 0x7f5970100e60 2024-09-10T09:48:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.765+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5970108830 con 0x7f5970100e60 2024-09-10T09:48:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.766+0000 7f5957fff700 1 -- 172.21.15.79:0/2994029341 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5960003710 con 0x7f5970100e60 2024-09-10T09:48:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.767+0000 7f5957fff700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f595806e200 0x7f59580706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:30.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.767+0000 7f5957fff700 1 -- 172.21.15.79:0/2994029341 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f596008f550 con 0x7f5970100e60 2024-09-10T09:48:30.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.767+0000 7f596effd700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f595806e200 0x7f59580706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:30.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.767+0000 7f596effd700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f595806e200 0x7f59580706b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5964009c60 tx=0x7f5964009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:30.773 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:30.771+0000 7f5957fff700 1 -- 172.21.15.79:0/2994029341 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5960058930 con 0x7f5970100e60 2024-09-10T09:48:31.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.027+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f5970074620 con 0x7f5970100e60 2024-09-10T09:48:31.029 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.027+0000 7f5957fff700 1 -- 172.21.15.79:0/2994029341 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v38) v1 ==== 107+0+4136 (secure 0 0 0) 0x7f596005bff0 con 0x7f5970100e60 2024-09-10T09:48:31.030 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:31.030 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":17,"btime":"2024-09-10T09:44:56:507697+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1635861920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1635861920},{"type":"v1","addr":"172.21.15.79:6827","nonce":1635861920}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:44:56.507694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi135.lvmrsq","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6825/3101337164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3101337164},{"type":"v1","addr":"172.21.15.135:6825","nonce":3101337164}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-10T09:48:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f595806e200 msgr2=0x7f59580706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f595806e200 0x7f59580706b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5964009c60 tx=0x7f5964009260 comp rx=0 tx=0).stop 2024-09-10T09:48:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 msgr2=0x7f5970073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970073590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59600059d0 tx=0x7f596000f690 comp rx=0 tx=0).stop 2024-09-10T09:48:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 shutdown_connections 2024-09-10T09:48:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f595806e200 0x7f59580706b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:31.032 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59701004c0 0x7f5970073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 --2- 172.21.15.79:0/2994029341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5970100e60 0x7f5970073590 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 >> 172.21.15.79:0/2994029341 conn(0x7f59700fbd80 msgr2=0x7f59700fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 shutdown_connections 2024-09-10T09:48:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:31.030+0000 7f597536b700 1 -- 172.21.15.79:0/2994029341 wait complete. 2024-09-10T09:48:31.033 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 17 2024-09-10T09:48:31.339 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:31 smithi079 ceph-mon[87213]: pgmap v277: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:31.339 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:31 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2994029341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-10T09:48:31.613 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-10T09:48:31.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 18 2024-09-10T09:48:31.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:31 smithi135 ceph-mon[65362]: pgmap v277: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:31.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:31 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2994029341' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-10T09:48:31.816 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:33.525 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:33 smithi079 ceph-mon[87213]: pgmap v278: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 -- 172.21.15.79:0/2497700666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 msgr2=0x7f358c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2497700666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c1094d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f357c009940 tx=0x7f357c009c50 comp rx=0 tx=0).stop 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 -- 172.21.15.79:0/2497700666 shutdown_connections 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2497700666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c1094d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2497700666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100460 0x7f358c100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 -- 172.21.15.79:0/2497700666 >> 172.21.15.79:0/2497700666 conn(0x7f358c0748b0 msgr2=0x7f358c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 -- 172.21.15.79:0/2497700666 shutdown_connections 2024-09-10T09:48:33.546 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.544+0000 7f3592f5d700 1 -- 172.21.15.79:0/2497700666 wait complete. 2024-09-10T09:48:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3592f5d700 1 Processor -- start 2024-09-10T09:48:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3592f5d700 1 -- start start 2024-09-10T09:48:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3592f5d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100460 0x7f358c194e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3592f5d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c195380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:33.548 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3592f5d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c195a60 con 0x7f358c100d70 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3592f5d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1997f0 con 0x7f358c100460 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3583fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c195380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3583fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c195380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44444/0 (socket says 172.21.15.79:44444) 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3583fff700 1 -- 172.21.15.79:0/2604603694 learned_addr learned my addr 172.21.15.79:0/2604603694 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3590cf9700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100460 0x7f358c194e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3583fff700 1 -- 172.21.15.79:0/2604603694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100460 msgr2=0x7f358c194e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3583fff700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100460 0x7f358c194e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.545+0000 7f3583fff700 1 -- 172.21.15.79:0/2604603694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0095f0 con 0x7f358c100d70 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.546+0000 7f3583fff700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c195380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f357c0055f0 tx=0x7f357c005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.546+0000 7f3581ffb700 1 -- 172.21.15.79:0/2604603694 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f357c01d070 con 0x7f358c100d70 2024-09-10T09:48:33.549 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.546+0000 7f3581ffb700 1 -- 172.21.15.79:0/2604603694 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f357c005a00 con 0x7f358c100d70 2024-09-10T09:48:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.546+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c199a70 con 0x7f358c100d70 2024-09-10T09:48:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.546+0000 7f3581ffb700 1 -- 172.21.15.79:0/2604603694 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f357c00fd90 con 0x7f358c100d70 2024-09-10T09:48:33.550 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.546+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c199fc0 con 0x7f358c100d70 2024-09-10T09:48:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.548+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c106bd0 con 0x7f358c100d70 2024-09-10T09:48:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.549+0000 7f3581ffb700 1 -- 172.21.15.79:0/2604603694 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f357c00f5f0 con 0x7f358c100d70 2024-09-10T09:48:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.549+0000 7f3581ffb700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f357406e200 0x7f35740706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.549+0000 7f3581ffb700 1 -- 172.21.15.79:0/2604603694 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f357c08f300 con 0x7f358c100d70 2024-09-10T09:48:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.549+0000 7f3590cf9700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f357406e200 0x7f35740706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:33.551 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.550+0000 7f3590cf9700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f357406e200 0x7f35740706b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3588009550 tx=0x7f35880091b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:33.554 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.552+0000 7f3581ffb700 1 -- 172.21.15.79:0/2604603694 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f357c0586e0 con 0x7f358c100d70 2024-09-10T09:48:33.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:33 smithi135 ceph-mon[65362]: pgmap v278: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:33.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.799+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f358c04f2a0 con 0x7f358c100d70 2024-09-10T09:48:33.801 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.800+0000 7f3581ffb700 1 -- 172.21.15.79:0/2604603694 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v38) v1 ==== 107+0+4909 (secure 0 0 0) 0x7f357c05bda0 con 0x7f358c100d70 2024-09-10T09:48:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:33.801 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"btime":"2024-09-10T09:44:57:521441+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14488,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1635861920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1635861920},{"type":"v1","addr":"172.21.15.79:6827","nonce":1635861920}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/32452037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":32452037},{"type":"v1","addr":"172.21.15.79:6829","nonce":32452037}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:44:56.507694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi135.lvmrsq","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6825/3101337164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3101337164},{"type":"v1","addr":"172.21.15.135:6825","nonce":3101337164}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-10T09:48:33.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f357406e200 msgr2=0x7f35740706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:33.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f357406e200 0x7f35740706b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3588009550 tx=0x7f35880091b0 comp rx=0 tx=0).stop 2024-09-10T09:48:33.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 msgr2=0x7f358c195380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c195380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f357c0055f0 tx=0x7f357c005620 comp rx=0 tx=0).stop 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 shutdown_connections 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f357406e200 0x7f35740706b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f358c100460 0x7f358c194e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 --2- 172.21.15.79:0/2604603694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f358c100d70 0x7f358c195380 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.802+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 >> 172.21.15.79:0/2604603694 conn(0x7f358c0748b0 msgr2=0x7f358c103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.803+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 shutdown_connections 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:33.803+0000 7f3592f5d700 1 -- 172.21.15.79:0/2604603694 wait complete. 2024-09-10T09:48:33.804 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2024-09-10T09:48:34.439 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:34 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2604603694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-10T09:48:34.439 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:34.460 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-10T09:48:34.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 19 2024-09-10T09:48:34.660 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:34.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:34 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2604603694' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-10T09:48:34.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:34 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:35.438 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:35 smithi079 ceph-mon[87213]: pgmap v279: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:35.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:35 smithi135 ceph-mon[65362]: pgmap v279: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 -- 172.21.15.79:0/3439063922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ffd60 msgr2=0x7f278c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 --2- 172.21.15.79:0/3439063922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ffd60 0x7f278c103d30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2774009910 tx=0x7f2774009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 -- 172.21.15.79:0/3439063922 shutdown_connections 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 --2- 172.21.15.79:0/3439063922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ffd60 0x7f278c103d30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 --2- 172.21.15.79:0/3439063922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c0ff3c0 0x7f278c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 -- 172.21.15.79:0/3439063922 >> 172.21.15.79:0/3439063922 conn(0x7f278c0fac60 msgr2=0x7f278c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 -- 172.21.15.79:0/3439063922 shutdown_connections 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 -- 172.21.15.79:0/3439063922 wait complete. 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.327+0000 7f2791664700 1 Processor -- start 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f2791664700 1 -- start start 2024-09-10T09:48:36.330 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f2791664700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ff3c0 0x7f278c100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f2791664700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c0ffd60 0x7f278c101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f2791664700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c101850 con 0x7f278c0ff3c0 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f2791664700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c101990 con 0x7f278c0ffd60 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ff3c0 0x7f278c100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ff3c0 0x7f278c100dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44452/0 (socket says 172.21.15.79:44452) 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278affd700 1 -- 172.21.15.79:0/3217026688 learned_addr learned my addr 172.21.15.79:0/3217026688 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278a7fc700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c0ffd60 0x7f278c101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278affd700 1 -- 172.21.15.79:0/3217026688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c0ffd60 msgr2=0x7f278c101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278affd700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c0ffd60 0x7f278c101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278affd700 1 -- 172.21.15.79:0/3217026688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740095f0 con 0x7f278c0ff3c0 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f278affd700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ff3c0 0x7f278c100dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f277c00cfd0 tx=0x7f277c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f2783fff700 1 -- 172.21.15.79:0/3217026688 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277c00ad70 con 0x7f278c0ff3c0 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.328+0000 7f2783fff700 1 -- 172.21.15.79:0/3217026688 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f277c007e70 con 0x7f278c0ff3c0 2024-09-10T09:48:36.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.329+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c1a2100 con 0x7f278c0ff3c0 2024-09-10T09:48:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.329+0000 7f2783fff700 1 -- 172.21.15.79:0/3217026688 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277c011810 con 0x7f278c0ff3c0 2024-09-10T09:48:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.329+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c1a2460 con 0x7f278c0ff3c0 2024-09-10T09:48:36.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.329+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c04f2a0 con 0x7f278c0ff3c0 2024-09-10T09:48:36.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.330+0000 7f2783fff700 1 -- 172.21.15.79:0/3217026688 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f277c011a10 con 0x7f278c0ff3c0 2024-09-10T09:48:36.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.330+0000 7f2783fff700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f277806e200 0x7f27780706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:36.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.331+0000 7f2783fff700 1 -- 172.21.15.79:0/3217026688 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f277c08e3d0 con 0x7f278c0ff3c0 2024-09-10T09:48:36.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.331+0000 7f278a7fc700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f277806e200 0x7f27780706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:36.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.331+0000 7f278a7fc700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f277806e200 0x7f27780706b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f278c1025c0 tx=0x7f277401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:36.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.335+0000 7f2783fff700 1 -- 172.21.15.79:0/3217026688 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f277c0577b0 con 0x7f278c0ff3c0 2024-09-10T09:48:36.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.580+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f278c102300 con 0x7f278c0ff3c0 2024-09-10T09:48:36.582 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.581+0000 7f2783fff700 1 -- 172.21.15.79:0/3217026688 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v38) v1 ==== 107+0+4130 (secure 0 0 0) 0x7f277c05ae70 con 0x7f278c0ff3c0 2024-09-10T09:48:36.583 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:36.583 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":19,"btime":"2024-09-10T09:45:00:275771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/32452037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":32452037},{"type":"v1","addr":"172.21.15.79:6829","nonce":32452037}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:44:56.507694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi135.lvmrsq","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6825/3101337164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3101337164},{"type":"v1","addr":"172.21.15.135:6825","nonce":3101337164}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-10T09:48:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.583+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f277806e200 msgr2=0x7f27780706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.583+0000 7f2791664700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f277806e200 0x7f27780706b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f278c1025c0 tx=0x7f277401a040 comp rx=0 tx=0).stop 2024-09-10T09:48:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.583+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ff3c0 msgr2=0x7f278c100dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:36.585 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.583+0000 7f2791664700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ff3c0 0x7f278c100dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f277c00cfd0 tx=0x7f277c00a340 comp rx=0 tx=0).stop 2024-09-10T09:48:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.584+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 shutdown_connections 2024-09-10T09:48:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.584+0000 7f2791664700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f277806e200 0x7f27780706b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.584+0000 7f2791664700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f278c0ff3c0 0x7f278c100dd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.584+0000 7f2791664700 1 --2- 172.21.15.79:0/3217026688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f278c0ffd60 0x7f278c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.584+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 >> 172.21.15.79:0/3217026688 conn(0x7f278c0fac60 msgr2=0x7f278c103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:36.586 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.584+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 shutdown_connections 2024-09-10T09:48:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:36.584+0000 7f2791664700 1 -- 172.21.15.79:0/3217026688 wait complete. 2024-09-10T09:48:36.587 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 19 2024-09-10T09:48:37.303 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-10T09:48:37.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 20 2024-09-10T09:48:37.502 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:37.622 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:37 smithi079 ceph-mon[87213]: pgmap v280: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:37.622 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:37 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3217026688' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-10T09:48:37.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:37 smithi135 ceph-mon[65362]: pgmap v280: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:37.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:37 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3217026688' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-10T09:48:39.168 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:38 smithi079 ceph-mon[87213]: pgmap v281: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:39.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.194+0000 7fb14d866700 1 -- 172.21.15.79:0/2848078189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 msgr2=0x7fb148104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:39.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.194+0000 7fb14d866700 1 --2- 172.21.15.79:0/2848078189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148104e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009910 tx=0x7fb13c009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:39.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.195+0000 7fb14d866700 1 -- 172.21.15.79:0/2848078189 shutdown_connections 2024-09-10T09:48:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.195+0000 7fb14d866700 1 --2- 172.21.15.79:0/2848078189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148104e50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.195+0000 7fb14d866700 1 --2- 172.21.15.79:0/2848078189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481004e0 0x7fb1481008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.195+0000 7fb14d866700 1 -- 172.21.15.79:0/2848078189 >> 172.21.15.79:0/2848078189 conn(0x7fb1480fbda0 msgr2=0x7fb1480fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.195+0000 7fb14d866700 1 -- 172.21.15.79:0/2848078189 shutdown_connections 2024-09-10T09:48:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.195+0000 7fb14d866700 1 -- 172.21.15.79:0/2848078189 wait complete. 2024-09-10T09:48:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.195+0000 7fb14d866700 1 Processor -- start 2024-09-10T09:48:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb14d866700 1 -- start start 2024-09-10T09:48:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb14d866700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481004e0 0x7fb148073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb14d866700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb14d866700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148073ad0 con 0x7fb148100e80 2024-09-10T09:48:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb14d866700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148073c10 con 0x7fb1481004e0 2024-09-10T09:48:39.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb1467fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb1467fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44468/0 (socket says 172.21.15.79:44468) 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb1467fc700 1 -- 172.21.15.79:0/2795834537 learned_addr learned my addr 172.21.15.79:0/2795834537 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb146ffd700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481004e0 0x7fb148073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb1467fc700 1 -- 172.21.15.79:0/2795834537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481004e0 msgr2=0x7fb148073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb1467fc700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481004e0 0x7fb148073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb1467fc700 1 -- 172.21.15.79:0/2795834537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0095f0 con 0x7fb148100e80 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb1467fc700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148073590 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0092e0 tx=0x7fb13c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.196+0000 7fb14c864700 1 -- 172.21.15.79:0/2795834537 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13c01d070 con 0x7fb148100e80 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.197+0000 7fb14c864700 1 -- 172.21.15.79:0/2795834537 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb13c00f460 con 0x7fb148100e80 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.197+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb148073e90 con 0x7fb148100e80 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.197+0000 7fb14c864700 1 -- 172.21.15.79:0/2795834537 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb13c0175d0 con 0x7fb148100e80 2024-09-10T09:48:39.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.197+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1481a2390 con 0x7fb148100e80 2024-09-10T09:48:39.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.198+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148108760 con 0x7fb148100e80 2024-09-10T09:48:39.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.198+0000 7fb14c864700 1 -- 172.21.15.79:0/2795834537 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb13c00f5d0 con 0x7fb148100e80 2024-09-10T09:48:39.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.199+0000 7fb14c864700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb13006e200 0x7fb1300706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:39.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.199+0000 7fb14c864700 1 -- 172.21.15.79:0/2795834537 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fb13c08f460 con 0x7fb148100e80 2024-09-10T09:48:39.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.199+0000 7fb146ffd700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb13006e200 0x7fb1300706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:39.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.199+0000 7fb146ffd700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb13006e200 0x7fb1300706b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb138005950 tx=0x7fb13800a300 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:39.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.203+0000 7fb14c864700 1 -- 172.21.15.79:0/2795834537 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb13c0588c0 con 0x7fb148100e80 2024-09-10T09:48:39.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:38 smithi135 ceph-mon[65362]: pgmap v281: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:39.448 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.447+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fb148074580 con 0x7fb148100e80 2024-09-10T09:48:39.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.448+0000 7fb14c864700 1 -- 172.21.15.79:0/2795834537 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v38) v1 ==== 107+0+4977 (secure 0 0 0) 0x7fb13c05bf80 con 0x7fb148100e80 2024-09-10T09:48:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:39.449 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"btime":"2024-09-10T09:45:05:137194+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34374,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/32452037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":32452037},{"type":"v1","addr":"172.21.15.79:6829","nonce":32452037}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:44:56.507694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi135.lvmrsq","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6825/3101337164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3101337164},{"type":"v1","addr":"172.21.15.135:6825","nonce":3101337164}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-10T09:48:39.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb13006e200 msgr2=0x7fb1300706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:39.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb13006e200 0x7fb1300706b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb138005950 tx=0x7fb13800a300 comp rx=0 tx=0).stop 2024-09-10T09:48:39.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 msgr2=0x7fb148073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:39.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148073590 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0092e0 tx=0x7fb13c00bd70 comp rx=0 tx=0).stop 2024-09-10T09:48:39.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 shutdown_connections 2024-09-10T09:48:39.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fb13006e200 0x7fb1300706b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:39.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1481004e0 0x7fb148073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:39.452 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 --2- 172.21.15.79:0/2795834537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb148100e80 0x7fb148073590 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:39.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 >> 172.21.15.79:0/2795834537 conn(0x7fb1480fbda0 msgr2=0x7fb1481046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:39.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.450+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 shutdown_connections 2024-09-10T09:48:39.453 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:39.451+0000 7fb14d866700 1 -- 172.21.15.79:0/2795834537 wait complete. 2024-09-10T09:48:39.453 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 20 2024-09-10T09:48:40.064 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:39 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2795834537' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-10T09:48:40.085 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-10T09:48:40.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 21 2024-09-10T09:48:40.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:39 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2795834537' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-10T09:48:40.287 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:41.081 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:40 smithi079 ceph-mon[87213]: pgmap v282: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:41.081 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:40 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:48:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:40 smithi135 ceph-mon[65362]: pgmap v282: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:41.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:40 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T09:48:41.916 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:48:41.916 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:48:41.917 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:41 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:48:42.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 -- 172.21.15.79:0/3807744058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ffd60 msgr2=0x7f3e60103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:42.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3807744058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ffd60 0x7f3e60103d30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009910 tx=0x7f3e54009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:42.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 -- 172.21.15.79:0/3807744058 shutdown_connections 2024-09-10T09:48:42.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3807744058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ffd60 0x7f3e60103d30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:42.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3807744058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e600ff3c0 0x7f3e600ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:42.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 -- 172.21.15.79:0/3807744058 >> 172.21.15.79:0/3807744058 conn(0x7f3e600fac80 msgr2=0x7f3e600fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:42.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 -- 172.21.15.79:0/3807744058 shutdown_connections 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.912+0000 7f3e666a0700 1 -- 172.21.15.79:0/3807744058 wait complete. 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e666a0700 1 Processor -- start 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e666a0700 1 -- start start 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e666a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ff3c0 0x7f3e60194e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e666a0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e600ffd60 0x7f3e60195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e666a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60195a30 con 0x7f3e600ff3c0 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e666a0700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e60199750 con 0x7f3e600ffd60 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e5ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ff3c0 0x7f3e60194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e5ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ff3c0 0x7f3e60194e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44478/0 (socket says 172.21.15.79:44478) 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.913+0000 7f3e5ffff700 1 -- 172.21.15.79:0/3777191812 learned_addr learned my addr 172.21.15.79:0/3777191812 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.914+0000 7f3e5f7fe700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e600ffd60 0x7f3e60195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.914+0000 7f3e5ffff700 1 -- 172.21.15.79:0/3777191812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e600ffd60 msgr2=0x7f3e60195350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:42.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.914+0000 7f3e5ffff700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e600ffd60 0x7f3e60195350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.914+0000 7f3e5ffff700 1 -- 172.21.15.79:0/3777191812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e540095f0 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.914+0000 7f3e5f7fe700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e600ffd60 0x7f3e60195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.914+0000 7f3e5ffff700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ff3c0 0x7f3e60194e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d8d0 tx=0x7f3e5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.914+0000 7f3e5d7fa700 1 -- 172.21.15.79:0/3777191812 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e50009940 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.915+0000 7f3e5d7fa700 1 -- 172.21.15.79:0/3777191812 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e50010460 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.915+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e60199a30 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.915+0000 7f3e5d7fa700 1 -- 172.21.15.79:0/3777191812 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e5000f5f0 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.915+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e60199f80 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.916+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e60107730 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.916+0000 7f3e5d7fa700 1 -- 172.21.15.79:0/3777191812 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3e50009aa0 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.917+0000 7f3e5d7fa700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3e4806e200 0x7f3e480706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.917+0000 7f3e5d7fa700 1 -- 172.21.15.79:0/3777191812 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3e5008dff0 con 0x7f3e600ff3c0 2024-09-10T09:48:42.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.917+0000 7f3e5f7fe700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3e4806e200 0x7f3e480706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:42.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.917+0000 7f3e5f7fe700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3e4806e200 0x7f3e480706b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e601963c0 tx=0x7f3e5401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:42.097 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:41.921+0000 7f3e5d7fa700 1 -- 172.21.15.79:0/3777191812 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3e50057430 con 0x7f3e600ff3c0 2024-09-10T09:48:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.168+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f3e6004f2a0 con 0x7f3e600ff3c0 2024-09-10T09:48:42.170 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.169+0000 7f3e5d7fa700 1 -- 172.21.15.79:0/3777191812 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v38) v1 ==== 107+0+4204 (secure 0 0 0) 0x7f3e5005aaf0 con 0x7f3e600ff3c0 2024-09-10T09:48:42.170 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:42.170 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"btime":"2024-09-10T09:45:18:240770+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:44:56.507694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi135.lvmrsq","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6825/3101337164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3101337164},{"type":"v1","addr":"172.21.15.135:6825","nonce":3101337164}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-10T09:48:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3e4806e200 msgr2=0x7f3e480706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3e4806e200 0x7f3e480706b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e601963c0 tx=0x7f3e5401a040 comp rx=0 tx=0).stop 2024-09-10T09:48:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ff3c0 msgr2=0x7f3e60194e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ff3c0 0x7f3e60194e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000d8d0 tx=0x7f3e5000dc90 comp rx=0 tx=0).stop 2024-09-10T09:48:42.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 shutdown_connections 2024-09-10T09:48:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3e4806e200 0x7f3e480706b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e600ff3c0 0x7f3e60194e10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 --2- 172.21.15.79:0/3777191812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e600ffd60 0x7f3e60195350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 >> 172.21.15.79:0/3777191812 conn(0x7f3e600fac80 msgr2=0x7f3e600fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 shutdown_connections 2024-09-10T09:48:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:42.171+0000 7f3e666a0700 1 -- 172.21.15.79:0/3777191812 wait complete. 2024-09-10T09:48:42.173 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 21 2024-09-10T09:48:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T09:48:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T09:48:42.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:41 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' 2024-09-10T09:48:42.870 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-10T09:48:42.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 22 2024-09-10T09:48:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:43.187 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:42 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3777191812' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-10T09:48:43.188 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:42 smithi079 ceph-mon[87213]: pgmap v283: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:43.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:42 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3777191812' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-10T09:48:43.217 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:42 smithi135 ceph-mon[65362]: pgmap v283: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:44.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 -- 172.21.15.79:0/1455453208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 msgr2=0x7f3f401094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 --2- 172.21.15.79:0/1455453208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f401094d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009910 tx=0x7f3f28009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 -- 172.21.15.79:0/1455453208 shutdown_connections 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 --2- 172.21.15.79:0/1455453208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f401094d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 --2- 172.21.15.79:0/1455453208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f40100460 0x7f3f40100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 -- 172.21.15.79:0/1455453208 >> 172.21.15.79:0/1455453208 conn(0x7f3f400748b0 msgr2=0x7f3f40074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 -- 172.21.15.79:0/1455453208 shutdown_connections 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.737+0000 7f3f465ea700 1 -- 172.21.15.79:0/1455453208 wait complete. 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f465ea700 1 Processor -- start 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f465ea700 1 -- start start 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f465ea700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f40100460 0x7f3f40195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:44.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f465ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f40196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f465ea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40196b20 con 0x7f3f40100d70 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f465ea700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4019a8b0 con 0x7f3f40100460 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f37fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f40196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f37fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f40196440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45514/0 (socket says 172.21.15.79:45514) 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f37fff700 1 -- 172.21.15.79:0/3038752486 learned_addr learned my addr 172.21.15.79:0/3038752486 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f3ffff700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f40100460 0x7f3f40195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f37fff700 1 -- 172.21.15.79:0/3038752486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f40100460 msgr2=0x7f3f40195f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.738+0000 7f3f37fff700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f40100460 0x7f3f40195f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.739+0000 7f3f37fff700 1 -- 172.21.15.79:0/3038752486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280095f0 con 0x7f3f40100d70 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.739+0000 7f3f37fff700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f40196440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3f28006010 tx=0x7f3f2800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.739+0000 7f3f3dffb700 1 -- 172.21.15.79:0/3038752486 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f2801d070 con 0x7f3f40100d70 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.739+0000 7f3f3dffb700 1 -- 172.21.15.79:0/3038752486 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f28004fb0 con 0x7f3f40100d70 2024-09-10T09:48:44.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.739+0000 7f3f3dffb700 1 -- 172.21.15.79:0/3038752486 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f2800f690 con 0x7f3f40100d70 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.739+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4019ab90 con 0x7f3f40100d70 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.739+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4019b090 con 0x7f3f40100d70 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.740+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40107e40 con 0x7f3f40100d70 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.740+0000 7f3f3dffb700 1 -- 172.21.15.79:0/3038752486 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3f280228a0 con 0x7f3f40100d70 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.741+0000 7f3f3dffb700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3f2c06e200 0x7f3f2c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.741+0000 7f3f3dffb700 1 -- 172.21.15.79:0/3038752486 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3f2808f920 con 0x7f3f40100d70 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.741+0000 7f3f3ffff700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3f2c06e200 0x7f3f2c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.741+0000 7f3f3ffff700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3f2c06e200 0x7f3f2c0706b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f30006fd0 tx=0x7f3f30008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:44.772 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.745+0000 7f3f3dffb700 1 -- 172.21.15.79:0/3038752486 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3f28058d00 con 0x7f3f40100d70 2024-09-10T09:48:44.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.992+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f3f4004f2a0 con 0x7f3f40100d70 2024-09-10T09:48:44.993 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.992+0000 7f3f3dffb700 1 -- 172.21.15.79:0/3038752486 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v38) v1 ==== 107+0+5051 (secure 0 0 0) 0x7f3f2805c3c0 con 0x7f3f40100d70 2024-09-10T09:48:44.993 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:44.993 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":22,"btime":"2024-09-10T09:45:23:253636+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:44:56.507694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24281":{"gid":24281,"name":"cephfs.smithi135.lvmrsq","rank":0,"incarnation":12,"state":"up:active","state_seq":6,"addr":"172.21.15.135:6825/3101337164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3101337164},{"type":"v1","addr":"172.21.15.135:6825","nonce":3101337164}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24281,"qdb_cluster":[24281]},"id":1}]} 2024-09-10T09:48:44.995 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.994+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3f2c06e200 msgr2=0x7f3f2c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.994+0000 7f3f465ea700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3f2c06e200 0x7f3f2c0706b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f30006fd0 tx=0x7f3f30008040 comp rx=0 tx=0).stop 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.994+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 msgr2=0x7f3f40196440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.994+0000 7f3f465ea700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f40196440 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3f28006010 tx=0x7f3f2800be20 comp rx=0 tx=0).stop 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.994+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 shutdown_connections 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.995+0000 7f3f465ea700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f3f2c06e200 0x7f3f2c0706b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.995+0000 7f3f465ea700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f40100460 0x7f3f40195f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.995+0000 7f3f465ea700 1 --2- 172.21.15.79:0/3038752486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3f40100d70 0x7f3f40196440 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.995+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 >> 172.21.15.79:0/3038752486 conn(0x7f3f400748b0 msgr2=0x7f3f400fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.995+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 shutdown_connections 2024-09-10T09:48:44.996 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:44.995+0000 7f3f465ea700 1 -- 172.21.15.79:0/3038752486 wait complete. 2024-09-10T09:48:44.997 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 22 2024-09-10T09:48:45.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:45 smithi079 ceph-mon[87213]: pgmap v284: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:45.712 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:45 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3038752486' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-10T09:48:45.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:45 smithi135 ceph-mon[65362]: pgmap v284: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:45.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:45 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3038752486' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-10T09:48:45.737 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-10T09:48:45.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 23 2024-09-10T09:48:45.942 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:47.401 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:47 smithi079 ceph-mon[87213]: pgmap v285: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 -- 172.21.15.79:0/3745210217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 msgr2=0x7f9fe40ff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/3745210217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe40ff790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009910 tx=0x7f9fd8009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 -- 172.21.15.79:0/3745210217 shutdown_connections 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/3745210217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe40ffd60 0x7f9fe4103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/3745210217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe40ff790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 -- 172.21.15.79:0/3745210217 >> 172.21.15.79:0/3745210217 conn(0x7f9fe40fac80 msgr2=0x7f9fe40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 -- 172.21.15.79:0/3745210217 shutdown_connections 2024-09-10T09:48:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.662+0000 7f9fe89b7700 1 -- 172.21.15.79:0/3745210217 wait complete. 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.663+0000 7f9fe89b7700 1 Processor -- start 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.663+0000 7f9fe89b7700 1 -- start start 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.663+0000 7f9fe89b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe4195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.663+0000 7f9fe89b7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe40ffd60 0x7f9fe41964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.663+0000 7f9fe89b7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe4196b80 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.663+0000 7f9fe89b7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe419a910 con 0x7f9fe40ffd60 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.663+0000 7f9fe259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe4195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe4195f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45538/0 (socket says 172.21.15.79:45538) 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe259c700 1 -- 172.21.15.79:0/2942773028 learned_addr learned my addr 172.21.15.79:0/2942773028 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:47.666 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe1d9b700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe40ffd60 0x7f9fe41964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe259c700 1 -- 172.21.15.79:0/2942773028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe40ffd60 msgr2=0x7f9fe41964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe259c700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe40ffd60 0x7f9fe41964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe259c700 1 -- 172.21.15.79:0/2942773028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80095f0 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe1d9b700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe40ffd60 0x7f9fe41964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe259c700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe4195f60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8006010 tx=0x7f9fd800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fd37fe700 1 -- 172.21.15.79:0/2942773028 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd801d070 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe419ab90 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe419b080 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fd37fe700 1 -- 172.21.15.79:0/2942773028 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fd8004fb0 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.667 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.664+0000 7f9fd37fe700 1 -- 172.21.15.79:0/2942773028 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd800f690 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.666+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe41086e0 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.666+0000 7f9fd37fe700 1 -- 172.21.15.79:0/2942773028 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9fd800f7f0 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.666+0000 7f9fd37fe700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9fcc06e200 0x7f9fcc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:47.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.666+0000 7f9fd37fe700 1 -- 172.21.15.79:0/2942773028 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f9fd808f860 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.668 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.666+0000 7f9fe1d9b700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9fcc06e200 0x7f9fcc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:47.669 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.667+0000 7f9fe1d9b700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9fcc06e200 0x7f9fcc0706b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4197580 tx=0x7f9fd4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:47.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.671+0000 7f9fd37fe700 1 -- 172.21.15.79:0/2942773028 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9fd8058cc0 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:47 smithi135 ceph-mon[65362]: pgmap v285: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.915+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f9fe41080c0 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.915+0000 7f9fd37fe700 1 -- 172.21.15.79:0/2942773028 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v38) v1 ==== 107+0+4250 (secure 0 0 0) 0x7f9fd805c380 con 0x7f9fe40ff3c0 2024-09-10T09:48:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:47.917 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":23,"btime":"2024-09-10T09:45:34:671155+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:34.671152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9fcc06e200 msgr2=0x7f9fcc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9fcc06e200 0x7f9fcc0706b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4197580 tx=0x7f9fd4008040 comp rx=0 tx=0).stop 2024-09-10T09:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 msgr2=0x7f9fe4195f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe4195f60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8006010 tx=0x7f9fd800be20 comp rx=0 tx=0).stop 2024-09-10T09:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 shutdown_connections 2024-09-10T09:48:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f9fcc06e200 0x7f9fcc0706b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fe40ff3c0 0x7f9fe4195f60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 --2- 172.21.15.79:0/2942773028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9fe40ffd60 0x7f9fe41964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 >> 172.21.15.79:0/2942773028 conn(0x7f9fe40fac80 msgr2=0x7f9fe4069190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 shutdown_connections 2024-09-10T09:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:47.918+0000 7f9fe89b7700 1 -- 172.21.15.79:0/2942773028 wait complete. 2024-09-10T09:48:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 23 2024-09-10T09:48:48.558 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:48 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2942773028' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-10T09:48:48.582 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-10T09:48:48.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 24 2024-09-10T09:48:48.608 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:48 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2942773028' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-10T09:48:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:49 smithi079 ceph-mon[87213]: pgmap v286: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:49.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:49 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:49 smithi135 ceph-mon[65362]: pgmap v286: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:49.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:49 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:48:50.473 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 -- 172.21.15.79:0/1316225433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ffd60 msgr2=0x7f2f84103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/1316225433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ffd60 0x7f2f84103d30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009910 tx=0x7f2f6c009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 -- 172.21.15.79:0/1316225433 shutdown_connections 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/1316225433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ffd60 0x7f2f84103d30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/1316225433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f840ff3c0 0x7f2f840ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 -- 172.21.15.79:0/1316225433 >> 172.21.15.79:0/1316225433 conn(0x7f2f840fac60 msgr2=0x7f2f840fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 -- 172.21.15.79:0/1316225433 shutdown_connections 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.472+0000 7f2f89b8d700 1 -- 172.21.15.79:0/1316225433 wait complete. 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f89b8d700 1 Processor -- start 2024-09-10T09:48:50.474 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f89b8d700 1 -- start start 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f89b8d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ff3c0 0x7f2f84195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f89b8d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f840ffd60 0x7f2f841963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f89b8d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84196ac0 con 0x7f2f840ff3c0 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f89b8d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8419a850 con 0x7f2f840ffd60 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f837fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ff3c0 0x7f2f84195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f837fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ff3c0 0x7f2f84195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45558/0 (socket says 172.21.15.79:45558) 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f837fe700 1 -- 172.21.15.79:0/3399067661 learned_addr learned my addr 172.21.15.79:0/3399067661 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.473+0000 7f2f7affd700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f840ffd60 0x7f2f841963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:50.476 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.474+0000 7f2f7affd700 1 -- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ff3c0 msgr2=0x7f2f84195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.474+0000 7f2f7affd700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ff3c0 0x7f2f84195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.474+0000 7f2f7affd700 1 -- 172.21.15.79:0/3399067661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0095f0 con 0x7f2f840ffd60 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.474+0000 7f2f7affd700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f840ffd60 0x7f2f841963e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f84067fb0 tx=0x7f2f6c00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.475+0000 7f2f817fa700 1 -- 172.21.15.79:0/3399067661 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6c01d070 con 0x7f2f840ffd60 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.475+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8419aad0 con 0x7f2f840ffd60 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.475+0000 7f2f817fa700 1 -- 172.21.15.79:0/3399067661 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f6c005dc0 con 0x7f2f840ffd60 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.475+0000 7f2f817fa700 1 -- 172.21.15.79:0/3399067661 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6c00fe80 con 0x7f2f840ffd60 2024-09-10T09:48:50.477 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.475+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8419afc0 con 0x7f2f840ffd60 2024-09-10T09:48:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.476+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8404f2a0 con 0x7f2f840ffd60 2024-09-10T09:48:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.476+0000 7f2f817fa700 1 -- 172.21.15.79:0/3399067661 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2f6c00f6f0 con 0x7f2f840ffd60 2024-09-10T09:48:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.477+0000 7f2f817fa700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2f7006e200 0x7f2f700706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.477+0000 7f2f817fa700 1 -- 172.21.15.79:0/3399067661 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f2f6c08f450 con 0x7f2f840ffd60 2024-09-10T09:48:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.477+0000 7f2f837fe700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2f7006e200 0x7f2f700706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:50.478 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.477+0000 7f2f837fe700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2f7006e200 0x7f2f700706b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f74005950 tx=0x7f2f7400b500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:50.483 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.482+0000 7f2f817fa700 1 -- 172.21.15.79:0/3399067661 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f6c058790 con 0x7f2f840ffd60 2024-09-10T09:48:50.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.726+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f2f84197200 con 0x7f2f840ffd60 2024-09-10T09:48:50.727 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.727+0000 7f2f817fa700 1 -- 172.21.15.79:0/3399067661 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v38) v1 ==== 107+0+4261 (secure 0 0 0) 0x7f2f6c05be50 con 0x7f2f840ffd60 2024-09-10T09:48:50.727 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:50.728 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":24,"btime":"2024-09-10T09:45:34:676063+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:34.676051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2f7006e200 msgr2=0x7f2f700706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2f7006e200 0x7f2f700706b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2f74005950 tx=0x7f2f7400b500 comp rx=0 tx=0).stop 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f840ffd60 msgr2=0x7f2f841963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f840ffd60 0x7f2f841963e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2f84067fb0 tx=0x7f2f6c00bd70 comp rx=0 tx=0).stop 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 shutdown_connections 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f2f7006e200 0x7f2f700706b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2f840ff3c0 0x7f2f84195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 --2- 172.21.15.79:0/3399067661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f840ffd60 0x7f2f841963e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 >> 172.21.15.79:0/3399067661 conn(0x7f2f840fac60 msgr2=0x7f2f84103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 shutdown_connections 2024-09-10T09:48:50.730 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:50.729+0000 7f2f89b8d700 1 -- 172.21.15.79:0/3399067661 wait complete. 2024-09-10T09:48:50.731 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 24 2024-09-10T09:48:51.408 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:51 smithi079 ceph-mon[87213]: pgmap v287: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:51.409 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:51 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3399067661' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-10T09:48:51.430 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-10T09:48:51.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 25 2024-09-10T09:48:51.520 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:51 smithi135 ceph-mon[65362]: pgmap v287: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:51.520 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:51 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3399067661' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-10T09:48:51.630 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 -- 172.21.15.79:0/4112016265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c1004e0 msgr2=0x7f406c1008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 --2- 172.21.15.79:0/4112016265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c1004e0 0x7f406c1008b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f405c009910 tx=0x7f405c009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 -- 172.21.15.79:0/4112016265 shutdown_connections 2024-09-10T09:48:53.196 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 --2- 172.21.15.79:0/4112016265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f406c100e80 0x7f406c104e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:53.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 --2- 172.21.15.79:0/4112016265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c1004e0 0x7f406c1008b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:53.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 -- 172.21.15.79:0/4112016265 >> 172.21.15.79:0/4112016265 conn(0x7f406c0fbda0 msgr2=0x7f406c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:53.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 -- 172.21.15.79:0/4112016265 shutdown_connections 2024-09-10T09:48:53.197 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.195+0000 7f4070c43700 1 -- 172.21.15.79:0/4112016265 wait complete. 2024-09-10T09:48:53.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4070c43700 1 Processor -- start 2024-09-10T09:48:53.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4070c43700 1 -- start start 2024-09-10T09:48:53.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4070c43700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f406c1004e0 0x7f406c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:53.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4070c43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c100e80 0x7f406c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:53.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4070c43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c196b10 con 0x7f406c100e80 2024-09-10T09:48:53.198 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4070c43700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c19a8a0 con 0x7f406c1004e0 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4061d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c100e80 0x7f406c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4061d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c100e80 0x7f406c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38316/0 (socket says 172.21.15.79:38316) 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.196+0000 7f4061d9b700 1 -- 172.21.15.79:0/3215437741 learned_addr learned my addr 172.21.15.79:0/3215437741 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f406a59c700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f406c1004e0 0x7f406c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4061d9b700 1 -- 172.21.15.79:0/3215437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f406c1004e0 msgr2=0x7f406c195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4061d9b700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f406c1004e0 0x7f406c195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4061d9b700 1 -- 172.21.15.79:0/3215437741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0095f0 con 0x7f406c100e80 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4061d9b700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c100e80 0x7f406c196430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f405400c8f0 tx=0x7f405400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4063fff700 1 -- 172.21.15.79:0/3215437741 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4054007a50 con 0x7f406c100e80 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c19ab80 con 0x7f406c100e80 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4063fff700 1 -- 172.21.15.79:0/3215437741 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4054007bb0 con 0x7f406c100e80 2024-09-10T09:48:53.199 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4063fff700 1 -- 172.21.15.79:0/3215437741 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4054018630 con 0x7f406c100e80 2024-09-10T09:48:53.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.197+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c19b0d0 con 0x7f406c100e80 2024-09-10T09:48:53.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.198+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c1087f0 con 0x7f406c100e80 2024-09-10T09:48:53.200 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.199+0000 7f4063fff700 1 -- 172.21.15.79:0/3215437741 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4054007d20 con 0x7f406c100e80 2024-09-10T09:48:53.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.199+0000 7f4063fff700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f405806e200 0x7f40580706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:53.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.199+0000 7f4063fff700 1 -- 172.21.15.79:0/3215437741 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f405408dfa0 con 0x7f406c100e80 2024-09-10T09:48:53.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.199+0000 7f406a59c700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f405806e200 0x7f40580706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:53.201 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.200+0000 7f406a59c700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f405806e200 0x7f40580706b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f405c00b5c0 tx=0x7f405c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:53.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.204+0000 7f4063fff700 1 -- 172.21.15.79:0/3215437741 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4054057400 con 0x7f406c100e80 2024-09-10T09:48:53.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.450+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f406c19b3a0 con 0x7f406c100e80 2024-09-10T09:48:53.451 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:53 smithi079 ceph-mon[87213]: pgmap v288: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:53.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.450+0000 7f4063fff700 1 -- 172.21.15.79:0/3215437741 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v38) v1 ==== 107+0+4266 (secure 0 0 0) 0x7f405405aac0 con 0x7f406c100e80 2024-09-10T09:48:53.451 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:53.452 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"btime":"2024-09-10T09:45:43:203321+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:42.938154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":182,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.452+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f405806e200 msgr2=0x7f40580706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.452+0000 7f4070c43700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f405806e200 0x7f40580706b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f405c00b5c0 tx=0x7f405c01a040 comp rx=0 tx=0).stop 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c100e80 msgr2=0x7f406c196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c100e80 0x7f406c196430 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f405400c8f0 tx=0x7f405400ccb0 comp rx=0 tx=0).stop 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 shutdown_connections 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f405806e200 0x7f40580706b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f406c1004e0 0x7f406c195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 --2- 172.21.15.79:0/3215437741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f406c100e80 0x7f406c196430 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 >> 172.21.15.79:0/3215437741 conn(0x7f406c0fbda0 msgr2=0x7f406c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 shutdown_connections 2024-09-10T09:48:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:53.453+0000 7f4070c43700 1 -- 172.21.15.79:0/3215437741 wait complete. 2024-09-10T09:48:53.455 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 25 2024-09-10T09:48:53.686 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:53 smithi135 ceph-mon[65362]: pgmap v288: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:54.062 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-10T09:48:54.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 26 2024-09-10T09:48:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:54.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:54 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3215437741' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-10T09:48:54.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:54 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3215437741' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-10T09:48:55.518 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:55 smithi079 ceph-mon[87213]: pgmap v289: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:55.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:55 smithi135 ceph-mon[65362]: pgmap v289: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:48:55.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.919+0000 7f983f0cf700 1 -- 172.21.15.79:0/735731360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 msgr2=0x7f9838103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:55.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.919+0000 7f983f0cf700 1 --2- 172.21.15.79:0/735731360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838103d30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9824009910 tx=0x7f9824009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:55.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 -- 172.21.15.79:0/735731360 shutdown_connections 2024-09-10T09:48:55.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 --2- 172.21.15.79:0/735731360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838103d30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:55.922 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 --2- 172.21.15.79:0/735731360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98380ff3c0 0x7f98380ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 -- 172.21.15.79:0/735731360 >> 172.21.15.79:0/735731360 conn(0x7f98380fac80 msgr2=0x7f98380fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 -- 172.21.15.79:0/735731360 shutdown_connections 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 -- 172.21.15.79:0/735731360 wait complete. 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 Processor -- start 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 -- start start 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98380ff3c0 0x7f9838195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9838196af0 con 0x7f98380ffd60 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.920+0000 7f983f0cf700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983819a880 con 0x7f98380ff3c0 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9837fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9837fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38338/0 (socket says 172.21.15.79:38338) 2024-09-10T09:48:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9837fff700 1 -- 172.21.15.79:0/1740705877 learned_addr learned my addr 172.21.15.79:0/1740705877 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f983ce6b700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98380ff3c0 0x7f9838195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9837fff700 1 -- 172.21.15.79:0/1740705877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98380ff3c0 msgr2=0x7f9838195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9837fff700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98380ff3c0 0x7f9838195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9837fff700 1 -- 172.21.15.79:0/1740705877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240095f0 con 0x7f98380ffd60 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9837fff700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838196410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f982400bd70 tx=0x7f982400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9835ffb700 1 -- 172.21.15.79:0/1740705877 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f982401d070 con 0x7f98380ffd60 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983819ab00 con 0x7f98380ffd60 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9835ffb700 1 -- 172.21.15.79:0/1740705877 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9824005dc0 con 0x7f98380ffd60 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f9835ffb700 1 -- 172.21.15.79:0/1740705877 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9824017400 con 0x7f98380ffd60 2024-09-10T09:48:55.924 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.921+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983819aff0 con 0x7f98380ffd60 2024-09-10T09:48:55.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.922+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9838107730 con 0x7f98380ffd60 2024-09-10T09:48:55.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.923+0000 7f9835ffb700 1 -- 172.21.15.79:0/1740705877 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f982400f720 con 0x7f98380ffd60 2024-09-10T09:48:55.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.923+0000 7f9835ffb700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f982806e200 0x7f98280706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:55.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.923+0000 7f9835ffb700 1 -- 172.21.15.79:0/1740705877 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f982408f570 con 0x7f98380ffd60 2024-09-10T09:48:55.925 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.923+0000 7f983ce6b700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f982806e200 0x7f98280706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:55.926 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.924+0000 7f983ce6b700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f982806e200 0x7f98280706b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f982c005950 tx=0x7f982c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:55.928 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:55.928+0000 7f9835ffb700 1 -- 172.21.15.79:0/1740705877 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9824058950 con 0x7f98380ffd60 2024-09-10T09:48:56.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.172+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f9838107110 con 0x7f98380ffd60 2024-09-10T09:48:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.173+0000 7f9835ffb700 1 -- 172.21.15.79:0/1740705877 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v38) v1 ==== 107+0+4263 (secure 0 0 0) 0x7f982405c010 con 0x7f98380ffd60 2024-09-10T09:48:56.174 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:56.174 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":26,"btime":"2024-09-10T09:45:44:210222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:43.212193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":183,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:48:56.176 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.175+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f982806e200 msgr2=0x7f98280706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.175+0000 7f983f0cf700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f982806e200 0x7f98280706b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f982c005950 tx=0x7f982c00b410 comp rx=0 tx=0).stop 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.175+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 msgr2=0x7f9838196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.175+0000 7f983f0cf700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838196410 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f982400bd70 tx=0x7f982400bda0 comp rx=0 tx=0).stop 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.176+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 shutdown_connections 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.176+0000 7f983f0cf700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f982806e200 0x7f98280706b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.176+0000 7f983f0cf700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98380ff3c0 0x7f9838195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.176+0000 7f983f0cf700 1 --2- 172.21.15.79:0/1740705877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98380ffd60 0x7f9838196410 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.176+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 >> 172.21.15.79:0/1740705877 conn(0x7f98380fac80 msgr2=0x7f98380fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.176+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 shutdown_connections 2024-09-10T09:48:56.177 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:56.176+0000 7f983f0cf700 1 -- 172.21.15.79:0/1740705877 wait complete. 2024-09-10T09:48:56.178 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 26 2024-09-10T09:48:56.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:56 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1740705877' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-10T09:48:56.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:56 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1740705877' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-10T09:48:56.829 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-10T09:48:56.829 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 27 2024-09-10T09:48:57.027 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:48:57.437 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:57 smithi079 ceph-mon[87213]: pgmap v290: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:57.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:57 smithi135 ceph-mon[65362]: pgmap v290: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:48:58.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 -- 172.21.15.79:0/3864145525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ffc60 msgr2=0x7faf6c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 --2- 172.21.15.79:0/3864145525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ffc60 0x7faf6c10a6d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf5c009910 tx=0x7faf5c009c20 comp rx=0 tx=0).stop 2024-09-10T09:48:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 -- 172.21.15.79:0/3864145525 shutdown_connections 2024-09-10T09:48:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 --2- 172.21.15.79:0/3864145525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ffc60 0x7faf6c10a6d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 --2- 172.21.15.79:0/3864145525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c0ff350 0x7faf6c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 -- 172.21.15.79:0/3864145525 >> 172.21.15.79:0/3864145525 conn(0x7faf6c0748b0 msgr2=0x7faf6c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 -- 172.21.15.79:0/3864145525 shutdown_connections 2024-09-10T09:48:58.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.765+0000 7faf73a4c700 1 -- 172.21.15.79:0/3864145525 wait complete. 2024-09-10T09:48:58.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf73a4c700 1 Processor -- start 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf73a4c700 1 -- start start 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf73a4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ff350 0x7faf6c195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf73a4c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c0ffc60 0x7faf6c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf73a4c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c196ad0 con 0x7faf6c0ff350 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf73a4c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c19a860 con 0x7faf6c0ffc60 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf717e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ff350 0x7faf6c195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf717e8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ff350 0x7faf6c195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38362/0 (socket says 172.21.15.79:38362) 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.766+0000 7faf717e8700 1 -- 172.21.15.79:0/2869973755 learned_addr learned my addr 172.21.15.79:0/2869973755 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf717e8700 1 -- 172.21.15.79:0/2869973755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c0ffc60 msgr2=0x7faf6c1963f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf717e8700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c0ffc60 0x7faf6c1963f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf717e8700 1 -- 172.21.15.79:0/2869973755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0095f0 con 0x7faf6c0ff350 2024-09-10T09:48:58.769 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf717e8700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ff350 0x7faf6c195eb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d900 tx=0x7faf6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:58.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf627fc700 1 -- 172.21.15.79:0/2869973755 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf6800b920 con 0x7faf6c0ff350 2024-09-10T09:48:58.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf627fc700 1 -- 172.21.15.79:0/2869973755 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf68010460 con 0x7faf6c0ff350 2024-09-10T09:48:58.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf627fc700 1 -- 172.21.15.79:0/2869973755 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf6800f590 con 0x7faf6c0ff350 2024-09-10T09:48:58.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c19ab40 con 0x7faf6c0ff350 2024-09-10T09:48:58.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.767+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c19afd0 con 0x7faf6c0ff350 2024-09-10T09:48:58.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.768+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6c107dd0 con 0x7faf6c0ff350 2024-09-10T09:48:58.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.769+0000 7faf627fc700 1 -- 172.21.15.79:0/2869973755 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faf680105d0 con 0x7faf6c0ff350 2024-09-10T09:48:58.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.769+0000 7faf627fc700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf5806e200 0x7faf580706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:48:58.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.769+0000 7faf627fc700 1 -- 172.21.15.79:0/2869973755 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7faf6808ded0 con 0x7faf6c0ff350 2024-09-10T09:48:58.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.769+0000 7faf70fe7700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf5806e200 0x7faf580706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:48:58.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.770+0000 7faf70fe7700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf5806e200 0x7faf580706b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf5c000c00 tx=0x7faf5c005fb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:48:58.774 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:58.774+0000 7faf627fc700 1 -- 172.21.15.79:0/2869973755 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faf68057330 con 0x7faf6c0ff350 2024-09-10T09:48:59.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.016+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7faf6c04f2a0 con 0x7faf6c0ff350 2024-09-10T09:48:59.018 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.017+0000 7faf627fc700 1 -- 172.21.15.79:0/2869973755 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v38) v1 ==== 107+0+4272 (secure 0 0 0) 0x7faf68016090 con 0x7faf6c0ff350 2024-09-10T09:48:59.018 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:48:59.018 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"btime":"2024-09-10T09:45:45:214928+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:45.214924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":0,"incarnation":24,"state":"up:active","state_seq":184,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24287,"qdb_cluster":[24287]},"id":1}]} 2024-09-10T09:48:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf5806e200 msgr2=0x7faf580706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf5806e200 0x7faf580706b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf5c000c00 tx=0x7faf5c005fb0 comp rx=0 tx=0).stop 2024-09-10T09:48:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ff350 msgr2=0x7faf6c195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:48:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ff350 0x7faf6c195eb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d900 tx=0x7faf6800dcc0 comp rx=0 tx=0).stop 2024-09-10T09:48:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 shutdown_connections 2024-09-10T09:48:59.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7faf5806e200 0x7faf580706b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf6c0ff350 0x7faf6c195eb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 --2- 172.21.15.79:0/2869973755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf6c0ffc60 0x7faf6c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:48:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 >> 172.21.15.79:0/2869973755 conn(0x7faf6c0748b0 msgr2=0x7faf6c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:48:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 shutdown_connections 2024-09-10T09:48:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:48:59.020+0000 7faf73a4c700 1 -- 172.21.15.79:0/2869973755 wait complete. 2024-09-10T09:48:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 27 2024-09-10T09:48:59.529 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:59 smithi079 ceph-mon[87213]: pgmap v291: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:59.529 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:48:59 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2869973755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-10T09:48:59.673 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-10T09:48:59.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 28 2024-09-10T09:48:59.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:59 smithi135 ceph-mon[65362]: pgmap v291: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:48:59.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:48:59 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2869973755' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-10T09:48:59.878 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:01.546 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:01 smithi079 ceph-mon[87213]: pgmap v292: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 -- 172.21.15.79:0/2526071746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101420 msgr2=0x7fc6241017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 --2- 172.21.15.79:0/2526071746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101420 0x7fc6241017f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc61400b0a0 tx=0x7fc61400b3b0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 -- 172.21.15.79:0/2526071746 shutdown_connections 2024-09-10T09:49:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 --2- 172.21.15.79:0/2526071746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc624101d30 0x7fc62410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 --2- 172.21.15.79:0/2526071746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101420 0x7fc6241017f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 -- 172.21.15.79:0/2526071746 >> 172.21.15.79:0/2526071746 conn(0x7fc6240fac60 msgr2=0x7fc6240fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 -- 172.21.15.79:0/2526071746 shutdown_connections 2024-09-10T09:49:01.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.563+0000 7fc628d49700 1 -- 172.21.15.79:0/2526071746 wait complete. 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc628d49700 1 Processor -- start 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc628d49700 1 -- start start 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc628d49700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc624101420 0x7fc6240ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc628d49700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101d30 0x7fc6240ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc628d49700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240ffb00 con 0x7fc624101d30 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc628d49700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240ffc40 con 0x7fc624101420 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc621d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101d30 0x7fc6240ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc621d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101d30 0x7fc6240ff5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:38388/0 (socket says 172.21.15.79:38388) 2024-09-10T09:49:01.567 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.564+0000 7fc621d9b700 1 -- 172.21.15.79:0/3080382718 learned_addr learned my addr 172.21.15.79:0/3080382718 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc62259c700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc624101420 0x7fc6240ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc621d9b700 1 -- 172.21.15.79:0/3080382718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc624101420 msgr2=0x7fc6240ff080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc621d9b700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc624101420 0x7fc6240ff080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc621d9b700 1 -- 172.21.15.79:0/3080382718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc614009d00 con 0x7fc624101d30 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc62259c700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc624101420 0x7fc6240ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc621d9b700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101d30 0x7fc6240ff5c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00d8d0 tx=0x7fc60c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc61b7fe700 1 -- 172.21.15.79:0/3080382718 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60c009940 con 0x7fc624101d30 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc61b7fe700 1 -- 172.21.15.79:0/3080382718 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc60c010460 con 0x7fc624101d30 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6241a2070 con 0x7fc624101d30 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc61b7fe700 1 -- 172.21.15.79:0/3080382718 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60c00f5f0 con 0x7fc624101d30 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.565+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6241a2480 con 0x7fc624101d30 2024-09-10T09:49:01.568 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.566+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc624107900 con 0x7fc624101d30 2024-09-10T09:49:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.567+0000 7fc61b7fe700 1 -- 172.21.15.79:0/3080382718 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc60c0105d0 con 0x7fc624101d30 2024-09-10T09:49:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.567+0000 7fc61b7fe700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc61006e200 0x7fc6100706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:01.569 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.567+0000 7fc61b7fe700 1 -- 172.21.15.79:0/3080382718 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc60c08e0a0 con 0x7fc624101d30 2024-09-10T09:49:01.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.567+0000 7fc62259c700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc61006e200 0x7fc6100706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:01.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.568+0000 7fc62259c700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc61006e200 0x7fc6100706b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc614009480 tx=0x7fc6140097a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:01.572 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.571+0000 7fc61b7fe700 1 -- 172.21.15.79:0/3080382718 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc60c057480 con 0x7fc624101d30 2024-09-10T09:49:01.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:01 smithi135 ceph-mon[65362]: pgmap v292: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.815+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fc6241072e0 con 0x7fc624101d30 2024-09-10T09:49:01.816 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.815+0000 7fc61b7fe700 1 -- 172.21.15.79:0/3080382718 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v38) v1 ==== 107+0+5122 (secure 0 0 0) 0x7fc60c05ab40 con 0x7fc624101d30 2024-09-10T09:49:01.816 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:01.816 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":28,"btime":"2024-09-10T09:45:47:526989+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:45.214924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24287":{"gid":24287,"name":"cephfs.smithi135.oqqtlp","rank":0,"incarnation":24,"state":"up:active","state_seq":184,"addr":"172.21.15.135:6827/3081889881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3081889881},{"type":"v1","addr":"172.21.15.135:6827","nonce":3081889881}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24287,"qdb_cluster":[24287]},"id":1}]} 2024-09-10T09:49:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc61006e200 msgr2=0x7fc6100706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc61006e200 0x7fc6100706b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc614009480 tx=0x7fc6140097a0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101d30 msgr2=0x7fc6240ff5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101d30 0x7fc6240ff5c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00d8d0 tx=0x7fc60c00dc90 comp rx=0 tx=0).stop 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 shutdown_connections 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc61006e200 0x7fc6100706b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc624101420 0x7fc6240ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 --2- 172.21.15.79:0/3080382718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc624101d30 0x7fc6240ff5c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.817+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 >> 172.21.15.79:0/3080382718 conn(0x7fc6240fac60 msgr2=0x7fc624104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.818+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 shutdown_connections 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:01.818+0000 7fc628d49700 1 -- 172.21.15.79:0/3080382718 wait complete. 2024-09-10T09:49:01.819 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 28 2024-09-10T09:49:02.441 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:02 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3080382718' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-10T09:49:02.463 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-10T09:49:02.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 29 2024-09-10T09:49:02.661 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:02.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:02 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3080382718' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-10T09:49:03.448 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:03 smithi079 ceph-mon[87213]: pgmap v293: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:03.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:03 smithi135 ceph-mon[65362]: pgmap v293: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:04.226 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.225+0000 7f678295a700 1 -- 172.21.15.79:0/2062485639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 msgr2=0x7f677c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:04.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.225+0000 7f678295a700 1 --2- 172.21.15.79:0/2062485639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c0689b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6764009910 tx=0x7f6764009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:04.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 -- 172.21.15.79:0/2062485639 shutdown_connections 2024-09-10T09:49:04.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 --2- 172.21.15.79:0/2062485639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c0689b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:04.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 --2- 172.21.15.79:0/2062485639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c101000 0x7f677c1013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:04.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 -- 172.21.15.79:0/2062485639 >> 172.21.15.79:0/2062485639 conn(0x7f677c075130 msgr2=0x7f677c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:04.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 -- 172.21.15.79:0/2062485639 shutdown_connections 2024-09-10T09:49:04.227 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 -- 172.21.15.79:0/2062485639 wait complete. 2024-09-10T09:49:04.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 Processor -- start 2024-09-10T09:49:04.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.226+0000 7f678295a700 1 -- start start 2024-09-10T09:49:04.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f678295a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:04.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f678295a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c101000 0x7f677c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:04.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f678295a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c198df0 con 0x7f677c068540 2024-09-10T09:49:04.231 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f678295a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c19cb80 con 0x7f677c101000 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c1981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44236/0 (socket says 172.21.15.79:44236) 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677bfff700 1 -- 172.21.15.79:0/2674888575 learned_addr learned my addr 172.21.15.79:0/2674888575 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677b7fe700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c101000 0x7f677c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677bfff700 1 -- 172.21.15.79:0/2674888575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c101000 msgr2=0x7f677c198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677bfff700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c101000 0x7f677c198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677bfff700 1 -- 172.21.15.79:0/2674888575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640095f0 con 0x7f677c068540 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f677bfff700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c1981d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e940 tx=0x7f676c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f67797fa700 1 -- 172.21.15.79:0/2674888575 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f676c0097b0 con 0x7f677c068540 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c19ce60 con 0x7f677c068540 2024-09-10T09:49:04.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f67797fa700 1 -- 172.21.15.79:0/2674888575 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f676c004cf0 con 0x7f677c068540 2024-09-10T09:49:04.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f67797fa700 1 -- 172.21.15.79:0/2674888575 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f676c005700 con 0x7f677c068540 2024-09-10T09:49:04.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.227+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c19d3b0 con 0x7f677c068540 2024-09-10T09:49:04.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.228+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c10a9b0 con 0x7f677c068540 2024-09-10T09:49:04.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.229+0000 7f67797fa700 1 -- 172.21.15.79:0/2674888575 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f676c00cba0 con 0x7f677c068540 2024-09-10T09:49:04.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.229+0000 7f67797fa700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f676806e200 0x7f67680706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:04.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.229+0000 7f67797fa700 1 -- 172.21.15.79:0/2674888575 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f676c014070 con 0x7f677c068540 2024-09-10T09:49:04.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.229+0000 7f677b7fe700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f676806e200 0x7f67680706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:04.234 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.230+0000 7f677b7fe700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f676806e200 0x7f67680706b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f67640059d0 tx=0x7f6764005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:04.235 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.234+0000 7f67797fa700 1 -- 172.21.15.79:0/2674888575 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f676c057810 con 0x7f677c068540 2024-09-10T09:49:04.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.486+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f677c04f2a0 con 0x7f677c068540 2024-09-10T09:49:04.488 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.487+0000 7f67797fa700 1 -- 172.21.15.79:0/2674888575 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v38) v1 ==== 107+0+4318 (secure 0 0 0) 0x7f676c05aed0 con 0x7f677c068540 2024-09-10T09:49:04.488 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:04.488 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":29,"btime":"2024-09-10T09:45:56:591297+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:56.591294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:49:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f676806e200 msgr2=0x7f67680706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:04.491 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f676806e200 0x7f67680706b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f67640059d0 tx=0x7f6764005940 comp rx=0 tx=0).stop 2024-09-10T09:49:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 msgr2=0x7f677c1981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c1981d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f676c00e940 tx=0x7f676c00ed00 comp rx=0 tx=0).stop 2024-09-10T09:49:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 shutdown_connections 2024-09-10T09:49:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f676806e200 0x7f67680706b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f677c068540 0x7f677c1981d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 --2- 172.21.15.79:0/2674888575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f677c101000 0x7f677c198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:04.492 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 >> 172.21.15.79:0/2674888575 conn(0x7f677c075130 msgr2=0x7f677c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 shutdown_connections 2024-09-10T09:49:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:04.490+0000 7f678295a700 1 -- 172.21.15.79:0/2674888575 wait complete. 2024-09-10T09:49:04.493 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 29 2024-09-10T09:49:04.711 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:04 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:49:04.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:04 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:49:05.162 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-10T09:49:05.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 30 2024-09-10T09:49:05.360 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:05.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:05 smithi079 ceph-mon[87213]: pgmap v294: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:49:05.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:05 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2674888575' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-10T09:49:05.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:05 smithi135 ceph-mon[65362]: pgmap v294: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:49:05.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:05 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2674888575' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.975+0000 7f0812889700 1 -- 172.21.15.79:0/403219381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ffc60 msgr2=0x7f080c10a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.975+0000 7f0812889700 1 --2- 172.21.15.79:0/403219381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ffc60 0x7f080c10a6d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009910 tx=0x7f07f4009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.975+0000 7f0812889700 1 -- 172.21.15.79:0/403219381 shutdown_connections 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.975+0000 7f0812889700 1 --2- 172.21.15.79:0/403219381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ffc60 0x7f080c10a6d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.975+0000 7f0812889700 1 --2- 172.21.15.79:0/403219381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f080c0ff350 0x7f080c0ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.975+0000 7f0812889700 1 -- 172.21.15.79:0/403219381 >> 172.21.15.79:0/403219381 conn(0x7f080c0748b0 msgr2=0x7f080c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.976+0000 7f0812889700 1 -- 172.21.15.79:0/403219381 shutdown_connections 2024-09-10T09:49:07.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.976+0000 7f0812889700 1 -- 172.21.15.79:0/403219381 wait complete. 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.976+0000 7f0812889700 1 Processor -- start 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.976+0000 7f0812889700 1 -- start start 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0812889700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ff350 0x7f080c195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0812889700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f080c0ffc60 0x7f080c196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0812889700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c196b50 con 0x7f080c0ff350 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0812889700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c19a8e0 con 0x7f080c0ffc60 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f080bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ff350 0x7f080c195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f080bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ff350 0x7f080c195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44262/0 (socket says 172.21.15.79:44262) 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f080bfff700 1 -- 172.21.15.79:0/1063732320 learned_addr learned my addr 172.21.15.79:0/1063732320 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0803fff700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f080c0ffc60 0x7f080c196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f080bfff700 1 -- 172.21.15.79:0/1063732320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f080c0ffc60 msgr2=0x7f080c196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f080bfff700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f080c0ffc60 0x7f080c196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:07.002 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f080bfff700 1 -- 172.21.15.79:0/1063732320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40095f0 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f080bfff700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ff350 0x7f080c195f30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b480 tx=0x7f07fc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0809ffb700 1 -- 172.21.15.79:0/1063732320 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc0118c0 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0809ffb700 1 -- 172.21.15.79:0/1063732320 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f07fc010380 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c19abc0 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0809ffb700 1 -- 172.21.15.79:0/1063732320 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc00f4f0 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.977+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c19b110 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.978+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c107dd0 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.979+0000 7f0809ffb700 1 -- 172.21.15.79:0/1063732320 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f07fc0104f0 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.979+0000 7f0809ffb700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07f806e200 0x7f07f80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.979+0000 7f0809ffb700 1 -- 172.21.15.79:0/1063732320 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f07fc08dce0 con 0x7f080c0ff350 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.979+0000 7f0803fff700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07f806e200 0x7f07f80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.980+0000 7f0803fff700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07f806e200 0x7f07f80706b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f07f400b5c0 tx=0x7f07f4005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:07.003 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:06.983+0000 7f0809ffb700 1 -- 172.21.15.79:0/1063732320 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07fc0570c0 con 0x7f080c0ff350 2024-09-10T09:49:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.227+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f080c19b390 con 0x7f080c0ff350 2024-09-10T09:49:07.229 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.228+0000 7f0809ffb700 1 -- 172.21.15.79:0/1063732320 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v38) v1 ==== 107+0+4397 (secure 0 0 0) 0x7f07fc05a780 con 0x7f080c0ff350 2024-09-10T09:49:07.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:07.230 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":30,"btime":"2024-09-10T09:45:56:600432+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:45:56.600419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07f806e200 msgr2=0x7f07f80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07f806e200 0x7f07f80706b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f07f400b5c0 tx=0x7f07f4005960 comp rx=0 tx=0).stop 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ff350 msgr2=0x7f080c195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ff350 0x7f080c195f30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b480 tx=0x7f07fc00b840 comp rx=0 tx=0).stop 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 shutdown_connections 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f07f806e200 0x7f07f80706b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f080c0ff350 0x7f080c195f30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 --2- 172.21.15.79:0/1063732320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f080c0ffc60 0x7f080c196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 >> 172.21.15.79:0/1063732320 conn(0x7f080c0748b0 msgr2=0x7f080c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 shutdown_connections 2024-09-10T09:49:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:07.230+0000 7f0812889700 1 -- 172.21.15.79:0/1063732320 wait complete. 2024-09-10T09:49:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 30 2024-09-10T09:49:07.530 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:07 smithi079 ceph-mon[87213]: pgmap v295: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:07.530 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:07 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/1063732320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-10T09:49:07.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:07 smithi135 ceph-mon[65362]: pgmap v295: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:07.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:07 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/1063732320' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-10T09:49:07.903 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-10T09:49:07.903 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 31 2024-09-10T09:49:08.102 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:09.507 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:09 smithi079 ceph-mon[87213]: pgmap v296: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:09.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:09 smithi135 ceph-mon[65362]: pgmap v296: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:09.796 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- 172.21.15.79:0/3391027943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100d70 msgr2=0x7f97d41094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 --2- 172.21.15.79:0/3391027943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100d70 0x7f97d41094d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009910 tx=0x7f97c0009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- 172.21.15.79:0/3391027943 shutdown_connections 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 --2- 172.21.15.79:0/3391027943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100d70 0x7f97d41094d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 --2- 172.21.15.79:0/3391027943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97d4100460 0x7f97d4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- 172.21.15.79:0/3391027943 >> 172.21.15.79:0/3391027943 conn(0x7f97d40748b0 msgr2=0x7f97d4074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- 172.21.15.79:0/3391027943 shutdown_connections 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- 172.21.15.79:0/3391027943 wait complete. 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 Processor -- start 2024-09-10T09:49:09.797 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- start start 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100460 0x7f97d4196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97d4100d70 0x7f97d41972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d41978f0 con 0x7f97d4100460 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.793+0000 7f97db0d4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4197a30 con 0x7f97d4100d70 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d8e70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100460 0x7f97d4196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d8e70700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100460 0x7f97d4196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:44284/0 (socket says 172.21.15.79:44284) 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d8e70700 1 -- 172.21.15.79:0/2525569208 learned_addr learned my addr 172.21.15.79:0/2525569208 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d3fff700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97d4100d70 0x7f97d41972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d8e70700 1 -- 172.21.15.79:0/2525569208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97d4100d70 msgr2=0x7f97d41972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d8e70700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97d4100d70 0x7f97d41972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:09.798 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d8e70700 1 -- 172.21.15.79:0/2525569208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00095f0 con 0x7f97d4100460 2024-09-10T09:49:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d3fff700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97d4100d70 0x7f97d41972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:49:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d8e70700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100460 0x7f97d4196d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f97c800d8d0 tx=0x7f97c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d1ffb700 1 -- 172.21.15.79:0/2525569208 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c8009940 con 0x7f97d4100460 2024-09-10T09:49:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d1ffb700 1 -- 172.21.15.79:0/2525569208 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97c8010460 con 0x7f97d4100460 2024-09-10T09:49:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d419fe00 con 0x7f97d4100460 2024-09-10T09:49:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.794+0000 7f97d1ffb700 1 -- 172.21.15.79:0/2525569208 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97c800f5f0 con 0x7f97d4100460 2024-09-10T09:49:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.795+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d41a02c0 con 0x7f97d4100460 2024-09-10T09:49:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.795+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d4106bd0 con 0x7f97d4100460 2024-09-10T09:49:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.796+0000 7f97d1ffb700 1 -- 172.21.15.79:0/2525569208 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f97c80105d0 con 0x7f97d4100460 2024-09-10T09:49:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.796+0000 7f97d1ffb700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f97c406e200 0x7f97c40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.796+0000 7f97d1ffb700 1 -- 172.21.15.79:0/2525569208 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f97c808df90 con 0x7f97d4100460 2024-09-10T09:49:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.796+0000 7f97d3fff700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f97c406e200 0x7f97c40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.797+0000 7f97d3fff700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f97c406e200 0x7f97c40706b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97d40ffc00 tx=0x7f97c001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:09.801+0000 7f97d1ffb700 1 -- 172.21.15.79:0/2525569208 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f97c80573f0 con 0x7f97d4100460 2024-09-10T09:49:10.048 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.046+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f97d404f2a0 con 0x7f97d4100460 2024-09-10T09:49:10.049 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.047+0000 7f97d1ffb700 1 -- 172.21.15.79:0/2525569208 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v38) v1 ==== 107+0+4401 (secure 0 0 0) 0x7f97c805aab0 con 0x7f97d4100460 2024-09-10T09:49:10.049 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:10.050 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":31,"btime":"2024-09-10T09:46:04:237081+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:03.655747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:49:10.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f97c406e200 msgr2=0x7f97c40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:10.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f97c406e200 0x7f97c40706b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f97d40ffc00 tx=0x7f97c001a040 comp rx=0 tx=0).stop 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100460 msgr2=0x7f97d4196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100460 0x7f97d4196d90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f97c800d8d0 tx=0x7f97c800dc90 comp rx=0 tx=0).stop 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 shutdown_connections 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f97c406e200 0x7f97c40706b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f97d4100460 0x7f97d4196d90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 --2- 172.21.15.79:0/2525569208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97d4100d70 0x7f97d41972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.049+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 >> 172.21.15.79:0/2525569208 conn(0x7f97d40748b0 msgr2=0x7f97d4103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.050+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 shutdown_connections 2024-09-10T09:49:10.052 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:10.050+0000 7f97db0d4700 1 -- 172.21.15.79:0/2525569208 wait complete. 2024-09-10T09:49:10.053 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 31 2024-09-10T09:49:10.350 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:10 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2525569208' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-10T09:49:10.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:10 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2525569208' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-10T09:49:10.759 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-10T09:49:10.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 32 2024-09-10T09:49:10.957 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:11.390 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:11 smithi079 ceph-mon[87213]: pgmap v297: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:11.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:11 smithi135 ceph-mon[65362]: pgmap v297: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 -- 172.21.15.79:0/1472853861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ffd60 msgr2=0x7f1364103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 --2- 172.21.15.79:0/1472853861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ffd60 0x7f1364103d30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1354009910 tx=0x7f1354009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 -- 172.21.15.79:0/1472853861 shutdown_connections 2024-09-10T09:49:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 --2- 172.21.15.79:0/1472853861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ffd60 0x7f1364103d30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 --2- 172.21.15.79:0/1472853861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13640ff3c0 0x7f13640ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 -- 172.21.15.79:0/1472853861 >> 172.21.15.79:0/1472853861 conn(0x7f13640fac80 msgr2=0x7f13640fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:12.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 -- 172.21.15.79:0/1472853861 shutdown_connections 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.685+0000 7f1368829700 1 -- 172.21.15.79:0/1472853861 wait complete. 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.686+0000 7f1368829700 1 Processor -- start 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.686+0000 7f1368829700 1 -- start start 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1368829700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ff3c0 0x7f1364196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1368829700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13640ffd60 0x7f13641972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1368829700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13641978c0 con 0x7f13640ff3c0 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1368829700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1364197a30 con 0x7f13640ffd60 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f136259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ff3c0 0x7f1364196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f136259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ff3c0 0x7f1364196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53564/0 (socket says 172.21.15.79:53564) 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f136259c700 1 -- 172.21.15.79:0/3598952898 learned_addr learned my addr 172.21.15.79:0/3598952898 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1361d9b700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13640ffd60 0x7f13641972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f136259c700 1 -- 172.21.15.79:0/3598952898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13640ffd60 msgr2=0x7f13641972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f136259c700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13640ffd60 0x7f13641972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:12.808 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f136259c700 1 -- 172.21.15.79:0/3598952898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540095f0 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1361d9b700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13640ffd60 0x7f13641972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f136259c700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ff3c0 0x7f1364196d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f135800d8d0 tx=0x7f135800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f13537fe700 1 -- 172.21.15.79:0/3598952898 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1358009940 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f13537fe700 1 -- 172.21.15.79:0/3598952898 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1358010460 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136419fdd0 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f13537fe700 1 -- 172.21.15.79:0/3598952898 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135800f5f0 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.687+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13641a0290 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.688+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1364107730 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.689+0000 7f13537fe700 1 -- 172.21.15.79:0/3598952898 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f13580105d0 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.689+0000 7f13537fe700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f134c06e200 0x7f134c0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.689+0000 7f1361d9b700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f134c06e200 0x7f134c0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.689+0000 7f13537fe700 1 -- 172.21.15.79:0/3598952898 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f135808e070 con 0x7f13640ff3c0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.690+0000 7f1361d9b700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f134c06e200 0x7f134c0706b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1354006010 tx=0x7f135401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.694+0000 7f13537fe700 1 -- 172.21.15.79:0/3598952898 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1358057450 con 0x7f13640ff3c0 2024-09-10T09:49:12.945 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.943+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f1364069520 con 0x7f13640ff3c0 2024-09-10T09:49:12.946 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.944+0000 7f13537fe700 1 -- 172.21.15.79:0/3598952898 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v38) v1 ==== 107+0+4398 (secure 0 0 0) 0x7f135805ab10 con 0x7f13640ff3c0 2024-09-10T09:49:12.946 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:12.946 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":32,"btime":"2024-09-10T09:46:05:240374+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:04.243147+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-10T09:49:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f134c06e200 msgr2=0x7f134c0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f134c06e200 0x7f134c0706b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1354006010 tx=0x7f135401a040 comp rx=0 tx=0).stop 2024-09-10T09:49:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ff3c0 msgr2=0x7f1364196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:12.948 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ff3c0 0x7f1364196d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f135800d8d0 tx=0x7f135800dc90 comp rx=0 tx=0).stop 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 shutdown_connections 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f134c06e200 0x7f134c0706b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f13640ff3c0 0x7f1364196d60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 --2- 172.21.15.79:0/3598952898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13640ffd60 0x7f13641972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 >> 172.21.15.79:0/3598952898 conn(0x7f13640fac80 msgr2=0x7f13640fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 shutdown_connections 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:12.946+0000 7f1368829700 1 -- 172.21.15.79:0/3598952898 wait complete. 2024-09-10T09:49:12.949 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 32 2024-09-10T09:49:13.577 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:13 smithi079 ceph-mon[87213]: pgmap v298: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:13.577 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:13 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3598952898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-10T09:49:13.598 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-10T09:49:13.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 33 2024-09-10T09:49:13.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:13 smithi135 ceph-mon[65362]: pgmap v298: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:13.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:13 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3598952898' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-10T09:49:13.795 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 -- 172.21.15.79:0/3054947871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 msgr2=0x7f1680104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 --2- 172.21.15.79:0/3054947871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680104e50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1674009910 tx=0x7f1674009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 -- 172.21.15.79:0/3054947871 shutdown_connections 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 --2- 172.21.15.79:0/3054947871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680104e50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 --2- 172.21.15.79:0/3054947871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16801004e0 0x7f16801008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 -- 172.21.15.79:0/3054947871 >> 172.21.15.79:0/3054947871 conn(0x7f16800fbda0 msgr2=0x7f16800fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 -- 172.21.15.79:0/3054947871 shutdown_connections 2024-09-10T09:49:15.516 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.514+0000 7f1686012700 1 -- 172.21.15.79:0/3054947871 wait complete. 2024-09-10T09:49:15.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.515+0000 7f1686012700 1 Processor -- start 2024-09-10T09:49:15.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.515+0000 7f1686012700 1 -- start start 2024-09-10T09:49:15.517 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.515+0000 7f1686012700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16801004e0 0x7f1680195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.515+0000 7f1686012700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.515+0000 7f1686012700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680196aa0 con 0x7f1680100e80 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.515+0000 7f1686012700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1680196be0 con 0x7f16801004e0 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680196450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53568/0 (socket says 172.21.15.79:53568) 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167effd700 1 -- 172.21.15.79:0/3606375267 learned_addr learned my addr 172.21.15.79:0/3606375267 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167f7fe700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16801004e0 0x7f1680195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167effd700 1 -- 172.21.15.79:0/3606375267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16801004e0 msgr2=0x7f1680195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167effd700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16801004e0 0x7f1680195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:15.518 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167effd700 1 -- 172.21.15.79:0/3606375267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740095f0 con 0x7f1680100e80 2024-09-10T09:49:15.519 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:15 smithi079 ceph-mon[87213]: pgmap v299: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167effd700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680196450 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f167400bda0 tx=0x7f167400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167cff9700 1 -- 172.21.15.79:0/3606375267 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167401d070 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167cff9700 1 -- 172.21.15.79:0/3606375267 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1674004fb0 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f167cff9700 1 -- 172.21.15.79:0/3606375267 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167400f480 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.516+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168019a9d0 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.517+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168019aec0 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.518+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1680108850 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.518+0000 7f167cff9700 1 -- 172.21.15.79:0/3606375267 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1674022870 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.519+0000 7f167cff9700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f166806e200 0x7f16680706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.519+0000 7f167cff9700 1 -- 172.21.15.79:0/3606375267 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f167408f630 con 0x7f1680100e80 2024-09-10T09:49:15.520 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.519+0000 7f167f7fe700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f166806e200 0x7f16680706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:15.521 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.519+0000 7f167f7fe700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f166806e200 0x7f16680706b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f167000ba60 tx=0x7f1670005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:15.524 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.523+0000 7f167cff9700 1 -- 172.21.15.79:0/3606375267 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1674058c60 con 0x7f1680100e80 2024-09-10T09:49:15.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:15 smithi135 ceph-mon[65362]: pgmap v299: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:49:15.767 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.766+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f1680108230 con 0x7f1680100e80 2024-09-10T09:49:15.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.767+0000 7f167cff9700 1 -- 172.21.15.79:0/3606375267 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v38) v1 ==== 107+0+4407 (secure 0 0 0) 0x7f167405c320 con 0x7f1680100e80 2024-09-10T09:49:15.768 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:15.768 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":33,"btime":"2024-09-10T09:46:06:242382+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:06.242379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-10T09:49:15.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.769+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f166806e200 msgr2=0x7f16680706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:15.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.769+0000 7f1686012700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f166806e200 0x7f16680706b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f167000ba60 tx=0x7f1670005d50 comp rx=0 tx=0).stop 2024-09-10T09:49:15.770 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.769+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 msgr2=0x7f1680196450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.769+0000 7f1686012700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680196450 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f167400bda0 tx=0x7f167400be80 comp rx=0 tx=0).stop 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.769+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 shutdown_connections 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.769+0000 7f1686012700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f166806e200 0x7f16680706b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.769+0000 7f1686012700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16801004e0 0x7f1680195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.770+0000 7f1686012700 1 --2- 172.21.15.79:0/3606375267 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680100e80 0x7f1680196450 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.770+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 >> 172.21.15.79:0/3606375267 conn(0x7f16800fbda0 msgr2=0x7f16800fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.770+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 shutdown_connections 2024-09-10T09:49:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:15.770+0000 7f1686012700 1 -- 172.21.15.79:0/3606375267 wait complete. 2024-09-10T09:49:15.772 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 33 2024-09-10T09:49:16.385 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:16 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3606375267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-10T09:49:16.407 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-10T09:49:16.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 34 2024-09-10T09:49:16.612 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:16.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:16 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3606375267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-10T09:49:17.650 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:17 smithi079 ceph-mon[87213]: pgmap v300: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:17.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:17 smithi135 ceph-mon[65362]: pgmap v300: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 -- 172.21.15.79:0/1053490183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc0ffbd0 msgr2=0x7f95bc100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 --2- 172.21.15.79:0/1053490183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc0ffbd0 0x7f95bc100040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009910 tx=0x7f95ac009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 -- 172.21.15.79:0/1053490183 shutdown_connections 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 --2- 172.21.15.79:0/1053490183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc0ffbd0 0x7f95bc100040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 --2- 172.21.15.79:0/1053490183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95bc104130 0x7f95bc104500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 -- 172.21.15.79:0/1053490183 >> 172.21.15.79:0/1053490183 conn(0x7f95bc075130 msgr2=0x7f95bc075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 -- 172.21.15.79:0/1053490183 shutdown_connections 2024-09-10T09:49:18.321 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 -- 172.21.15.79:0/1053490183 wait complete. 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 Processor -- start 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.313+0000 7f95c3796700 1 -- start start 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c3796700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95bc0ffbd0 0x7f95bc100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c3796700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc104130 0x7f95bc101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c3796700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1018b0 con 0x7f95bc104130 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c3796700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc1019f0 con 0x7f95bc0ffbd0 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c0d31700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc104130 0x7f95bc101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c0d31700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc104130 0x7f95bc101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53584/0 (socket says 172.21.15.79:53584) 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c0d31700 1 -- 172.21.15.79:0/857735465 learned_addr learned my addr 172.21.15.79:0/857735465 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c1532700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95bc0ffbd0 0x7f95bc100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c0d31700 1 -- 172.21.15.79:0/857735465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95bc0ffbd0 msgr2=0x7f95bc100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c0d31700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95bc0ffbd0 0x7f95bc100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:18.322 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c0d31700 1 -- 172.21.15.79:0/857735465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac0095f0 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c0d31700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc104130 0x7f95bc101370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0092e0 tx=0x7f95ac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95b27fc700 1 -- 172.21.15.79:0/857735465 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ac01d070 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95b27fc700 1 -- 172.21.15.79:0/857735465 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95ac00f460 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95b27fc700 1 -- 172.21.15.79:0/857735465 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95ac005e20 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.314+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc101c70 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.315+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc1a2370 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.316+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc1086a0 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.316+0000 7f95b27fc700 1 -- 172.21.15.79:0/857735465 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f95ac00f5d0 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.316+0000 7f95b27fc700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f95a806e200 0x7f95a80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.317+0000 7f95c1532700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f95a806e200 0x7f95a80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.317+0000 7f95b27fc700 1 -- 172.21.15.79:0/857735465 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f95ac08f450 con 0x7f95bc104130 2024-09-10T09:49:18.323 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.317+0000 7f95c1532700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f95a806e200 0x7f95a80706b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95b8005950 tx=0x7f95b800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:18.324 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.321+0000 7f95b27fc700 1 -- 172.21.15.79:0/857735465 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f95ac058970 con 0x7f95bc104130 2024-09-10T09:49:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.569+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f95bc102400 con 0x7f95bc104130 2024-09-10T09:49:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.570+0000 7f95b27fc700 1 -- 172.21.15.79:0/857735465 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v38) v1 ==== 107+0+5257 (secure 0 0 0) 0x7f95ac05c030 con 0x7f95bc104130 2024-09-10T09:49:18.571 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:18.571 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":34,"btime":"2024-09-10T09:46:07:246860+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44319,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3728464568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3728464568},{"type":"v1","addr":"172.21.15.135:6827","nonce":3728464568}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:06.242379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f95a806e200 msgr2=0x7f95a80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f95a806e200 0x7f95a80706b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f95b8005950 tx=0x7f95b800b410 comp rx=0 tx=0).stop 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc104130 msgr2=0x7f95bc101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc104130 0x7f95bc101370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0092e0 tx=0x7f95ac00bd70 comp rx=0 tx=0).stop 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 shutdown_connections 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f95a806e200 0x7f95a80706b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f95bc0ffbd0 0x7f95bc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 --2- 172.21.15.79:0/857735465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95bc104130 0x7f95bc101370 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 >> 172.21.15.79:0/857735465 conn(0x7f95bc075130 msgr2=0x7f95bc0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 shutdown_connections 2024-09-10T09:49:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:18.572+0000 7f95c3796700 1 -- 172.21.15.79:0/857735465 wait complete. 2024-09-10T09:49:18.574 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 34 2024-09-10T09:49:19.188 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-10T09:49:19.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 35 2024-09-10T09:49:19.389 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:19.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:19 smithi079 ceph-mon[87213]: pgmap v301: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:19.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:19 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/857735465' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-10T09:49:19.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:19 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:49:19.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:19 smithi135 ceph-mon[65362]: pgmap v301: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:19.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:19 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/857735465' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-10T09:49:19.467 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:19 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:49:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 -- 172.21.15.79:0/883337104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718105230 msgr2=0x7f8718105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 --2- 172.21.15.79:0/883337104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718105230 0x7f8718105600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8714009910 tx=0x7f8714009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 -- 172.21.15.79:0/883337104 shutdown_connections 2024-09-10T09:49:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 --2- 172.21.15.79:0/883337104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8718068540 0x7f87180689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 --2- 172.21.15.79:0/883337104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718105230 0x7f8718105600 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 -- 172.21.15.79:0/883337104 >> 172.21.15.79:0/883337104 conn(0x7f8718075130 msgr2=0x7f8718075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 -- 172.21.15.79:0/883337104 shutdown_connections 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.240+0000 7f871fdf2700 1 -- 172.21.15.79:0/883337104 wait complete. 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871fdf2700 1 Processor -- start 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871fdf2700 1 -- start start 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871fdf2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718068540 0x7f87180728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871fdf2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8718105230 0x7f871806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871fdf2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871806dde0 con 0x7f8718068540 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871fdf2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871806df50 con 0x7f8718105230 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871db8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718068540 0x7f87180728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871db8e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718068540 0x7f87180728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:53602/0 (socket says 172.21.15.79:53602) 2024-09-10T09:49:21.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.241+0000 7f871db8e700 1 -- 172.21.15.79:0/3261371292 learned_addr learned my addr 172.21.15.79:0/3261371292 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f871d38d700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8718105230 0x7f871806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f871db8e700 1 -- 172.21.15.79:0/3261371292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8718105230 msgr2=0x7f871806d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f871db8e700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8718105230 0x7f871806d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f871db8e700 1 -- 172.21.15.79:0/3261371292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140095f0 con 0x7f8718068540 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f871db8e700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718068540 0x7f87180728a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8714006010 tx=0x7f871400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f870effd700 1 -- 172.21.15.79:0/3261371292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f871401d070 con 0x7f8718068540 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871806e1d0 con 0x7f8718068540 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f870effd700 1 -- 172.21.15.79:0/3261371292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f871400f460 con 0x7f8718068540 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f870effd700 1 -- 172.21.15.79:0/3261371292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8714017630 con 0x7f8718068540 2024-09-10T09:49:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.242+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871806e6c0 con 0x7f8718068540 2024-09-10T09:49:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.243+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871804f2a0 con 0x7f8718068540 2024-09-10T09:49:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.244+0000 7f870effd700 1 -- 172.21.15.79:0/3261371292 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f871400f5d0 con 0x7f8718068540 2024-09-10T09:49:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.244+0000 7f870effd700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f870406e200 0x7f87040706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.244+0000 7f870effd700 1 -- 172.21.15.79:0/3261371292 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f871408f4d0 con 0x7f8718068540 2024-09-10T09:49:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.244+0000 7f871d38d700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f870406e200 0x7f87040706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.245+0000 7f871d38d700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f870406e200 0x7f87040706b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8708005950 tx=0x7f87080058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:21.249 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.249+0000 7f870effd700 1 -- 172.21.15.79:0/3261371292 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8714058930 con 0x7f8718068540 2024-09-10T09:49:21.495 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.494+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f87181a8bb0 con 0x7f8718068540 2024-09-10T09:49:21.495 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:21 smithi079 ceph-mon[87213]: pgmap v302: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:21.496 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.495+0000 7f870effd700 1 -- 172.21.15.79:0/3261371292 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v38) v1 ==== 107+0+5257 (secure 0 0 0) 0x7f871405bff0 con 0x7f8718068540 2024-09-10T09:49:21.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:21.496 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":35,"btime":"2024-09-10T09:46:14:624620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44319,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3728464568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3728464568},{"type":"v1","addr":"172.21.15.135:6827","nonce":3728464568}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:13.627292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-10T09:49:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f870406e200 msgr2=0x7f87040706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f870406e200 0x7f87040706b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8708005950 tx=0x7f87080058e0 comp rx=0 tx=0).stop 2024-09-10T09:49:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718068540 msgr2=0x7f87180728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718068540 0x7f87180728a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8714006010 tx=0x7f871400be20 comp rx=0 tx=0).stop 2024-09-10T09:49:21.498 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 shutdown_connections 2024-09-10T09:49:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f870406e200 0x7f87040706b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8718068540 0x7f87180728a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 --2- 172.21.15.79:0/3261371292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8718105230 0x7f871806d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 >> 172.21.15.79:0/3261371292 conn(0x7f8718075130 msgr2=0x7f87180fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 shutdown_connections 2024-09-10T09:49:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:21.497+0000 7f871fdf2700 1 -- 172.21.15.79:0/3261371292 wait complete. 2024-09-10T09:49:21.499 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 35 2024-09-10T09:49:21.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:21 smithi135 ceph-mon[65362]: pgmap v302: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:22.177 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-10T09:49:22.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 36 2024-09-10T09:49:22.378 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:22.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:22 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3261371292' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-10T09:49:22.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:22 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3261371292' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-10T09:49:23.565 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:23 smithi079 ceph-mon[87213]: pgmap v303: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:23.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:23 smithi135 ceph-mon[65362]: pgmap v303: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 -- 172.21.15.79:0/3273681287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 msgr2=0x7f08a80ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 --2- 172.21.15.79:0/3273681287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a80ff810 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009910 tx=0x7f08a4009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 -- 172.21.15.79:0/3273681287 shutdown_connections 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 --2- 172.21.15.79:0/3273681287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a80ffde0 0x7f08a8103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 --2- 172.21.15.79:0/3273681287 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a80ff810 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 -- 172.21.15.79:0/3273681287 >> 172.21.15.79:0/3273681287 conn(0x7f08a80face0 msgr2=0x7f08a80fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 -- 172.21.15.79:0/3273681287 shutdown_connections 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.119+0000 7f08af447700 1 -- 172.21.15.79:0/3273681287 wait complete. 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08af447700 1 Processor -- start 2024-09-10T09:49:24.122 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08af447700 1 -- start start 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08af447700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a8195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08af447700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a80ffde0 0x7f08a81964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08af447700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a8196ba0 con 0x7f08a80ff440 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08af447700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a819a930 con 0x7f08a80ffde0 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ad1e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a8195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ad1e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a8195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50010/0 (socket says 172.21.15.79:50010) 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ad1e3700 1 -- 172.21.15.79:0/528927936 learned_addr learned my addr 172.21.15.79:0/528927936 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ac9e2700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a80ffde0 0x7f08a81964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ad1e3700 1 -- 172.21.15.79:0/528927936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a80ffde0 msgr2=0x7f08a81964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ad1e3700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a80ffde0 0x7f08a81964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ad1e3700 1 -- 172.21.15.79:0/528927936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a40095f0 con 0x7f08a80ff440 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.120+0000 7f08ac9e2700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a80ffde0 0x7f08a81964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.121+0000 7f08ad1e3700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a8195f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f08a4006010 tx=0x7f08a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:24.123 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.121+0000 7f089e7fc700 1 -- 172.21.15.79:0/528927936 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a401d070 con 0x7f08a80ff440 2024-09-10T09:49:24.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.121+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a819abb0 con 0x7f08a80ff440 2024-09-10T09:49:24.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.121+0000 7f089e7fc700 1 -- 172.21.15.79:0/528927936 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08a4004fb0 con 0x7f08a80ff440 2024-09-10T09:49:24.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.121+0000 7f089e7fc700 1 -- 172.21.15.79:0/528927936 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a4022ea0 con 0x7f08a80ff440 2024-09-10T09:49:24.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.121+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a819b0a0 con 0x7f08a80ff440 2024-09-10T09:49:24.124 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.122+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a8107750 con 0x7f08a80ff440 2024-09-10T09:49:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.122+0000 7f089e7fc700 1 -- 172.21.15.79:0/528927936 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f08a4022470 con 0x7f08a80ff440 2024-09-10T09:49:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.123+0000 7f089e7fc700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f089406e200 0x7f08940706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.123+0000 7f089e7fc700 1 -- 172.21.15.79:0/528927936 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f08a408f610 con 0x7f08a80ff440 2024-09-10T09:49:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.123+0000 7f08ac9e2700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f089406e200 0x7f08940706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:24.125 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.123+0000 7f08ac9e2700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f089406e200 0x7f08940706b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08a81975a0 tx=0x7f0898008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:24.128 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.127+0000 7f089e7fc700 1 -- 172.21.15.79:0/528927936 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f08a4058aa0 con 0x7f08a80ff440 2024-09-10T09:49:24.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.373+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f08a804f2a0 con 0x7f08a80ff440 2024-09-10T09:49:24.374 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.373+0000 7f089e7fc700 1 -- 172.21.15.79:0/528927936 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v38) v1 ==== 107+0+5256 (secure 0 0 0) 0x7f08a4022720 con 0x7f08a80ff440 2024-09-10T09:49:24.374 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:24.375 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":36,"btime":"2024-09-10T09:46:15:632730+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44319,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3728464568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3728464568},{"type":"v1","addr":"172.21.15.135:6827","nonce":3728464568}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:14.636075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-10T09:49:24.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f089406e200 msgr2=0x7f08940706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:24.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f089406e200 0x7f08940706b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f08a81975a0 tx=0x7f0898008040 comp rx=0 tx=0).stop 2024-09-10T09:49:24.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 msgr2=0x7f08a8195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:24.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a8195f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f08a4006010 tx=0x7f08a400be20 comp rx=0 tx=0).stop 2024-09-10T09:49:24.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 shutdown_connections 2024-09-10T09:49:24.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f089406e200 0x7f08940706b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:24.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08a80ff440 0x7f08a8195f80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:24.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 --2- 172.21.15.79:0/528927936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f08a80ffde0 0x7f08a81964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:24.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 >> 172.21.15.79:0/528927936 conn(0x7f08a80face0 msgr2=0x7f08a80fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:24.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 shutdown_connections 2024-09-10T09:49:24.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:24.376+0000 7f08af447700 1 -- 172.21.15.79:0/528927936 wait complete. 2024-09-10T09:49:24.378 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 36 2024-09-10T09:49:25.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 37 2024-09-10T09:49:25.275 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:25.650 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:25 smithi079 ceph-mon[87213]: pgmap v304: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:49:25.650 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:25 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/528927936' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-10T09:49:25.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:25 smithi135 ceph-mon[65362]: pgmap v304: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-09-10T09:49:25.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:25 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/528927936' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-10T09:49:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 -- 172.21.15.79:0/4192716810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 msgr2=0x7fc1f4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:26.827 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/4192716810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f4103d30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009910 tx=0x7fc1e8009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 -- 172.21.15.79:0/4192716810 shutdown_connections 2024-09-10T09:49:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/4192716810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f4103d30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/4192716810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40ff3c0 0x7fc1f40ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 -- 172.21.15.79:0/4192716810 >> 172.21.15.79:0/4192716810 conn(0x7fc1f40fac80 msgr2=0x7fc1f40fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 -- 172.21.15.79:0/4192716810 shutdown_connections 2024-09-10T09:49:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.826+0000 7fc1f96e4700 1 -- 172.21.15.79:0/4192716810 wait complete. 2024-09-10T09:49:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f96e4700 1 Processor -- start 2024-09-10T09:49:26.829 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f96e4700 1 -- start start 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f96e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40ff3c0 0x7fc1f4195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f96e4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f41963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f96e4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4196a10 con 0x7fc1f40ffd60 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f96e4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4196b50 con 0x7fc1f40ff3c0 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f27fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f41963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f27fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f41963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50028/0 (socket says 172.21.15.79:50028) 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.827+0000 7fc1f27fc700 1 -- 172.21.15.79:0/2153704388 learned_addr learned my addr 172.21.15.79:0/2153704388 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1f2ffd700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40ff3c0 0x7fc1f4195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1f27fc700 1 -- 172.21.15.79:0/2153704388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40ff3c0 msgr2=0x7fc1f4195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1f27fc700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40ff3c0 0x7fc1f4195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1f27fc700 1 -- 172.21.15.79:0/2153704388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80095f0 con 0x7fc1f40ffd60 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1f27fc700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f41963c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800bda0 tx=0x7fc1e800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:26.830 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1dbfff700 1 -- 172.21.15.79:0/2153704388 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1e801d070 con 0x7fc1f40ffd60 2024-09-10T09:49:26.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f419a940 con 0x7fc1f40ffd60 2024-09-10T09:49:26.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1dbfff700 1 -- 172.21.15.79:0/2153704388 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1e8004fb0 con 0x7fc1f40ffd60 2024-09-10T09:49:26.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1dbfff700 1 -- 172.21.15.79:0/2153704388 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1e800f480 con 0x7fc1f40ffd60 2024-09-10T09:49:26.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.828+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f419ae30 con 0x7fc1f40ffd60 2024-09-10T09:49:26.831 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.829+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f404f2a0 con 0x7fc1f40ffd60 2024-09-10T09:49:26.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.830+0000 7fc1dbfff700 1 -- 172.21.15.79:0/2153704388 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc1e8004af0 con 0x7fc1f40ffd60 2024-09-10T09:49:26.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.830+0000 7fc1dbfff700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc1dc06e200 0x7fc1dc0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:26.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.830+0000 7fc1dbfff700 1 -- 172.21.15.79:0/2153704388 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fc1e808f5f0 con 0x7fc1f40ffd60 2024-09-10T09:49:26.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.830+0000 7fc1f2ffd700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc1dc06e200 0x7fc1dc0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:26.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.830+0000 7fc1f2ffd700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc1dc06e200 0x7fc1dc0706b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4005ea0 tx=0x7fc1e4005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:26.835 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:26.834+0000 7fc1dbfff700 1 -- 172.21.15.79:0/2153704388 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc1e8058a80 con 0x7fc1f40ffd60 2024-09-10T09:49:27.078 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.077+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fc1f419b050 con 0x7fc1f40ffd60 2024-09-10T09:49:27.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.078+0000 7fc1dbfff700 1 -- 172.21.15.79:0/2153704388 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v38) v1 ==== 107+0+5263 (secure 0 0 0) 0x7fc1e805c140 con 0x7fc1f40ffd60 2024-09-10T09:49:27.079 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-10T09:49:27.079 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":37,"btime":"2024-09-10T09:46:15:637352+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44291,"name":"cephfs.smithi135.lvmrsq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6825/1647814509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1647814509},{"type":"v1","addr":"172.21.15.135:6825","nonce":1647814509}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44319,"name":"cephfs.smithi135.oqqtlp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6827/3728464568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3728464568},{"type":"v1","addr":"172.21.15.135:6827","nonce":3728464568}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T09:33:26.721509+0000","modified":"2024-09-10T09:46:15.637337+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi079.pqgxjw","rank":0,"incarnation":30,"state":"up:active","state_seq":18,"addr":"172.21.15.79:6827/1667265711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1667265711},{"type":"v1","addr":"172.21.15.79:6827","nonce":1667265711}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi079.wpfdzn","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6829/2505923187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2505923187},{"type":"v1","addr":"172.21.15.79:6829","nonce":2505923187}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378]},"id":1}]} 2024-09-10T09:49:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc1dc06e200 msgr2=0x7fc1dc0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc1dc06e200 0x7fc1dc0706b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4005ea0 tx=0x7fc1e4005e30 comp rx=0 tx=0).stop 2024-09-10T09:49:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 msgr2=0x7fc1f41963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f41963c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800bda0 tx=0x7fc1e800be80 comp rx=0 tx=0).stop 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 shutdown_connections 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fc1dc06e200 0x7fc1dc0706b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1f40ff3c0 0x7fc1f4195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 --2- 172.21.15.79:0/2153704388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc1f40ffd60 0x7fc1f41963c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 >> 172.21.15.79:0/2153704388 conn(0x7fc1f40fac80 msgr2=0x7fc1f4068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 shutdown_connections 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:27.080+0000 7fc1f96e4700 1 -- 172.21.15.79:0/2153704388 wait complete. 2024-09-10T09:49:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 37 2024-09-10T09:49:27.434 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:27 smithi079 ceph-mon[87213]: pgmap v305: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:27.435 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:27 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/2153704388' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-10T09:49:27.705 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T09:49:27.716 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T09:49:27.717 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:49:27.717 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:49:27.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:27 smithi135 ceph-mon[65362]: pgmap v305: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:27.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:27 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/2153704388' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-10T09:49:27.737 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-10T09:49:27.737 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:49:27.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T09:49:28.033 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:29.555 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:29 smithi079 ceph-mon[87213]: pgmap v306: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:29.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:29 smithi135 ceph-mon[65362]: pgmap v306: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-10T09:49:29.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 -- 172.21.15.79:0/1403382141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 msgr2=0x7fe91c0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:29.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 --2- 172.21.15.79:0/1403382141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c0ff720 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009910 tx=0x7fe90c009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:29.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 -- 172.21.15.79:0/1403382141 shutdown_connections 2024-09-10T09:49:29.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 --2- 172.21.15.79:0/1403382141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ffc60 0x7fe91c10a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:29.785 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 --2- 172.21.15.79:0/1403382141 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c0ff720 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:29.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 -- 172.21.15.79:0/1403382141 >> 172.21.15.79:0/1403382141 conn(0x7fe91c0748b0 msgr2=0x7fe91c074cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:29.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 -- 172.21.15.79:0/1403382141 shutdown_connections 2024-09-10T09:49:29.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 -- 172.21.15.79:0/1403382141 wait complete. 2024-09-10T09:49:29.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.784+0000 7fe922254700 1 Processor -- start 2024-09-10T09:49:29.786 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe922254700 1 -- start start 2024-09-10T09:49:29.787 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe922254700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe922254700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ffc60 0x7fe91c1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe922254700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c196ac0 con 0x7fe91c0ff350 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe922254700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c19a850 con 0x7fe91c0ffc60 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:50042/0 (socket says 172.21.15.79:50042) 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91b7fe700 1 -- 172.21.15.79:0/3320534972 learned_addr learned my addr 172.21.15.79:0/3320534972 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91affd700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ffc60 0x7fe91c1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91b7fe700 1 -- 172.21.15.79:0/3320534972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ffc60 msgr2=0x7fe91c1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91b7fe700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ffc60 0x7fe91c1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91b7fe700 1 -- 172.21.15.79:0/3320534972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0095f0 con 0x7fe91c0ff350 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91affd700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ffc60 0x7fe91c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T09:49:29.788 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe91b7fe700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c195ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0092e0 tx=0x7fe90c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe918ff9700 1 -- 172.21.15.79:0/3320534972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe90c01d070 con 0x7fe91c0ff350 2024-09-10T09:49:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe918ff9700 1 -- 172.21.15.79:0/3320534972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe90c005dc0 con 0x7fe91c0ff350 2024-09-10T09:49:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c19aad0 con 0x7fe91c0ff350 2024-09-10T09:49:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.785+0000 7fe918ff9700 1 -- 172.21.15.79:0/3320534972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe90c017400 con 0x7fe91c0ff350 2024-09-10T09:49:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.786+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c19afc0 con 0x7fe91c0ff350 2024-09-10T09:49:29.789 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.786+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c107dd0 con 0x7fe91c0ff350 2024-09-10T09:49:29.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.787+0000 7fe918ff9700 1 -- 172.21.15.79:0/3320534972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe90c00f460 con 0x7fe91c0ff350 2024-09-10T09:49:29.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.788+0000 7fe918ff9700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe90406e200 0x7fe9040706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:29.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.788+0000 7fe91affd700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe90406e200 0x7fe9040706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:29.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.788+0000 7fe918ff9700 1 -- 172.21.15.79:0/3320534972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fe90c08f570 con 0x7fe91c0ff350 2024-09-10T09:49:29.790 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.788+0000 7fe91affd700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe90406e200 0x7fe9040706b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe910005950 tx=0x7fe9100058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:29.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:29.792+0000 7fe918ff9700 1 -- 172.21.15.79:0/3320534972 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe90c058950 con 0x7fe91c0ff350 2024-09-10T09:49:30.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.016+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe91c04f2a0 con 0x7fe91c0ff350 2024-09-10T09:49:30.021 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.017+0000 7fe918ff9700 1 -- 172.21.15.79:0/3320534972 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v86) v1 ==== 81+0+2055 (secure 0 0 0) 0x7fe90c05c010 con 0x7fe91c0ff350 2024-09-10T09:49:30.021 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6827/3081889881 2024-09-11T09:45:56.591042+0000 2024-09-10T09:49:30.021 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6826/3081889881 2024-09-11T09:45:56.591042+0000 2024-09-10T09:49:30.021 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6824/3101337164 2024-09-11T09:45:34.670903+0000 2024-09-10T09:49:30.021 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3370970589 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:30.021 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1268167286 2024-09-11T09:27:33.747139+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/4092786036 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2095060336 2024-09-11T09:28:40.595640+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1097692560 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/2779823908 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/250070562 2024-09-11T09:27:33.747139+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2331707006 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/897136131 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/2 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/3664846071 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6825/3101337164 2024-09-11T09:45:34.670903+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1657459337 2024-09-11T09:27:33.747139+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/136481957 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/1428661850 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1642724973 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:30.022 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2967164301 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3342987250 2024-09-11T09:28:40.595640+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/2 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1985948133 2024-09-11T09:28:40.595640+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/484505899 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6828/2288780689 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6829/2288780689 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/1726090662 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/4287758029 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3646919951 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3332228866 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6826/2813902761 2024-09-11T09:33:42.766704+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/3521716998 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6827/2813902761 2024-09-11T09:33:42.766704+0000 2024-09-10T09:49:30.023 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/1961655090 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:30.024 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/484505899 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:30.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.019+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe90406e200 msgr2=0x7fe9040706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:30.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.019+0000 7fe922254700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe90406e200 0x7fe9040706b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe910005950 tx=0x7fe9100058e0 comp rx=0 tx=0).stop 2024-09-10T09:49:30.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.019+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 msgr2=0x7fe91c195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:30.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.019+0000 7fe922254700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c195ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0092e0 tx=0x7fe90c00be20 comp rx=0 tx=0).stop 2024-09-10T09:49:30.024 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.020+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 shutdown_connections 2024-09-10T09:49:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.020+0000 7fe922254700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7fe90406e200 0x7fe9040706b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.020+0000 7fe922254700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe91c0ff350 0x7fe91c195ea0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.020+0000 7fe922254700 1 --2- 172.21.15.79:0/3320534972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe91c0ffc60 0x7fe91c1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.020+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 >> 172.21.15.79:0/3320534972 conn(0x7fe91c0748b0 msgr2=0x7fe91c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.020+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 shutdown_connections 2024-09-10T09:49:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:30.020+0000 7fe922254700 1 -- 172.21.15.79:0/3320534972 wait complete. 2024-09-10T09:49:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:listed 35 entries 2024-09-10T09:49:30.685 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:30 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/3320534972' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T09:49:30.707 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T09:49:30.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:30.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T09:49:30.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:30 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/3320534972' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T09:49:30.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:49:30.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:30.737 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T09:49:30.800 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:49:30.800 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:49:30.831 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T09:49:30.831 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T09:49:30.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.0 shell --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T09:49:31.089 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/mon.smithi079/config 2024-09-10T09:49:31.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:31 smithi079 ceph-mon[87213]: pgmap v307: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:31.718 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:31 smithi135 ceph-mon[65362]: pgmap v307: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 -- 172.21.15.79:0/2260698576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 msgr2=0x7f05c4104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 --2- 172.21.15.79:0/2260698576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4104e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009910 tx=0x7f05b4009c20 comp rx=0 tx=0).stop 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 -- 172.21.15.79:0/2260698576 shutdown_connections 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 --2- 172.21.15.79:0/2260698576 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4104e50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 --2- 172.21.15.79:0/2260698576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c41004e0 0x7f05c41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 -- 172.21.15.79:0/2260698576 >> 172.21.15.79:0/2260698576 conn(0x7f05c40fbda0 msgr2=0x7f05c40fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 -- 172.21.15.79:0/2260698576 shutdown_connections 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.732+0000 7f05cae60700 1 -- 172.21.15.79:0/2260698576 wait complete. 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05cae60700 1 Processor -- start 2024-09-10T09:49:32.734 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05cae60700 1 -- start start 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05cae60700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c41004e0 0x7f05c4073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05cae60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05cae60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4073ad0 con 0x7f05c4100e80 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05cae60700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4073c10 con 0x7f05c41004e0 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05bbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05bbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:40992/0 (socket says 172.21.15.79:40992) 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05bbfff700 1 -- 172.21.15.79:0/4062202419 learned_addr learned my addr 172.21.15.79:0/4062202419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-10T09:49:32.735 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05c8bfc700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c41004e0 0x7f05c4073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05bbfff700 1 -- 172.21.15.79:0/4062202419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c41004e0 msgr2=0x7f05c4073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05bbfff700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c41004e0 0x7f05c4073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.733+0000 7f05bbfff700 1 -- 172.21.15.79:0/4062202419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40095f0 con 0x7f05c4100e80 2024-09-10T09:49:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.734+0000 7f05bbfff700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4073590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f05b40092e0 tx=0x7f05b400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:32.736 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.734+0000 7f05b9ffb700 1 -- 172.21.15.79:0/4062202419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b401d070 con 0x7f05c4100e80 2024-09-10T09:49:32.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.734+0000 7f05b9ffb700 1 -- 172.21.15.79:0/4062202419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05b4005dc0 con 0x7f05c4100e80 2024-09-10T09:49:32.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.734+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c4073e90 con 0x7f05c4100e80 2024-09-10T09:49:32.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.734+0000 7f05b9ffb700 1 -- 172.21.15.79:0/4062202419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b4017400 con 0x7f05c4100e80 2024-09-10T09:49:32.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.734+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c41a2410 con 0x7f05c4100e80 2024-09-10T09:49:32.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.735+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c4108850 con 0x7f05c4100e80 2024-09-10T09:49:32.737 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.735+0000 7f05b9ffb700 1 -- 172.21.15.79:0/4062202419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 38) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f05b4017560 con 0x7f05c4100e80 2024-09-10T09:49:32.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.736+0000 7f05b9ffb700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f05ac06e200 0x7f05ac0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T09:49:32.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.736+0000 7f05b9ffb700 1 -- 172.21.15.79:0/4062202419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f05b408f3d0 con 0x7f05c4100e80 2024-09-10T09:49:32.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.736+0000 7f05c8bfc700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f05ac06e200 0x7f05ac0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T09:49:32.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.736+0000 7f05c8bfc700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f05ac06e200 0x7f05ac0706b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05c0005950 tx=0x7f05c000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T09:49:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.740+0000 7f05b9ffb700 1 -- 172.21.15.79:0/4062202419 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f05b4058830 con 0x7f05c4100e80 2024-09-10T09:49:32.955 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.954+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05c404f2a0 con 0x7f05c4100e80 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.955+0000 7f05b9ffb700 1 -- 172.21.15.79:0/4062202419 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v86) v1 ==== 81+0+2055 (secure 0 0 0) 0x7f05b405bef0 con 0x7f05c4100e80 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6827/3081889881 2024-09-11T09:45:56.591042+0000 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6826/3081889881 2024-09-11T09:45:56.591042+0000 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6824/3101337164 2024-09-11T09:45:34.670903+0000 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3370970589 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1268167286 2024-09-11T09:27:33.747139+0000 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/4092786036 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2095060336 2024-09-11T09:28:40.595640+0000 2024-09-10T09:49:32.956 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1097692560 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/2779823908 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/250070562 2024-09-11T09:27:33.747139+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2331707006 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/897136131 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/2 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/3664846071 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6825/3101337164 2024-09-11T09:45:34.670903+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1657459337 2024-09-11T09:27:33.747139+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/136481957 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/1428661850 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1642724973 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/2967164301 2024-09-11T09:36:32.183002+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3342987250 2024-09-11T09:28:40.595640+0000 2024-09-10T09:49:32.957 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/2 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/1985948133 2024-09-11T09:28:40.595640+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6800/484505899 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6828/2288780689 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:6829/2288780689 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/1726090662 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/4287758029 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3646919951 2024-09-11T09:27:01.091778+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:0/3332228866 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6826/2813902761 2024-09-11T09:33:42.766704+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/3521716998 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6827/2813902761 2024-09-11T09:33:42.766704+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.135:0/1961655090 2024-09-11T09:37:16.798651+0000 2024-09-10T09:49:32.958 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79:6801/484505899 2024-09-11T09:40:34.065061+0000 2024-09-10T09:49:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f05ac06e200 msgr2=0x7f05ac0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f05ac06e200 0x7f05ac0706b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f05c0005950 tx=0x7f05c000b410 comp rx=0 tx=0).stop 2024-09-10T09:49:32.959 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 msgr2=0x7f05c4073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4073590 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f05b40092e0 tx=0x7f05b400bd70 comp rx=0 tx=0).stop 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 shutdown_connections 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:6800/1910344825,v1:172.21.15.79:6801/1910344825] conn(0x7f05ac06e200 0x7f05ac0706b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c41004e0 0x7f05c4073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 --2- 172.21.15.79:0/4062202419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05c4100e80 0x7f05c4073590 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 >> 172.21.15.79:0/4062202419 conn(0x7f05c40fbda0 msgr2=0x7f05c40fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 shutdown_connections 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-10T09:49:32.958+0000 7f05cae60700 1 -- 172.21.15.79:0/4062202419 wait complete. 2024-09-10T09:49:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:listed 35 entries 2024-09-10T09:49:33.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:33 smithi079 ceph-mon[87213]: pgmap v308: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T09:49:33.584 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:33 smithi079 ceph-mon[87213]: from='client.? 172.21.15.79:0/4062202419' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T09:49:33.604 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T09:49:33.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:33.604 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-10T09:49:33.632 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:33 smithi135 ceph-mon[65362]: pgmap v308: 65 pgs: 65 active+clean; 202 MiB data, 889 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-10T09:49:33.632 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:33 smithi135 ceph-mon[65362]: from='client.? 172.21.15.79:0/4062202419' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T09:49:33.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-09-10T09:49:33.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:33.647 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T09:49:33.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:33.721 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-09-10T09:49:33.738 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T09:49:33.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:33.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T09:49:33.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:33.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-09-10T09:49:33.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:33.914 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-09-10T09:49:33.934 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T09:49:33.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:33.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T09:49:34.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T09:49:34.006 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-09-10T09:49:34.111 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T09:49:34.123 INFO:tasks.cephadm:Teardown begin 2024-09-10T09:49:34.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:49:34.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:49:34.179 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T09:49:34.179 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T09:49:34.208 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T09:49:34.237 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T09:49:34.237 INFO:tasks.cephadm.mon.smithi079:Stopping mon.smithi079... 2024-09-10T09:49:34.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079 2024-09-10T09:49:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:34 smithi079 systemd[1]: Stopping Ceph mon.smithi079 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:49:34.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:34 smithi079 ceph-mon[87213]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:49:34.717 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:34 smithi135 ceph-mon[65362]: from='mgr.34104 172.21.15.79:0/3695527239' entity='mgr.smithi079.mhirny' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-10T09:49:34.837 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:34 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[87209]: 2024-09-10T09:49:34.571+0000 7f5aad5d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi079 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:49:34.837 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:34 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079[87209]: 2024-09-10T09:49:34.571+0000 7f5aad5d6640 -1 mon.smithi079@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T09:49:34.837 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:34 smithi079 podman[134642]: 2024-09-10 09:49:34.796717528 +0000 UTC m=+0.364539080 container died 888aa89ba764f5128ce7f27c26ea862f5e527aced1c555ac7cf4bc7c9dd61fee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:49:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:35 smithi079 podman[134642]: 2024-09-10 09:49:35.197055751 +0000 UTC m=+0.764877290 container cleanup 888aa89ba764f5128ce7f27c26ea862f5e527aced1c555ac7cf4bc7c9dd61fee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T09:49:35.461 INFO:journalctl@ceph.mon.smithi079.smithi079.stdout:Sep 10 09:49:35 smithi079 bash[134642]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi079 2024-09-10T09:49:35.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi079.service' 2024-09-10T09:49:35.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:49:35.649 INFO:tasks.cephadm.mon.smithi079:Stopped mon.smithi079 2024-09-10T09:49:35.650 INFO:tasks.cephadm.mon.smithi135:Stopping mon.smithi135... 2024-09-10T09:49:35.650 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi135 2024-09-10T09:49:35.967 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:35 smithi135 systemd[1]: Stopping Ceph mon.smithi135 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:49:36.327 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:36 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135[65357]: 2024-09-10T09:49:36.022+0000 7f520db97640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi135 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:49:36.327 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:36 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135[65357]: 2024-09-10T09:49:36.022+0000 7f520db97640 -1 mon.smithi135@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T09:49:36.327 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:36 smithi135 podman[101594]: 2024-09-10 09:49:36.124405122 +0000 UTC m=+0.274513935 container died 1ce9e84003d6f14cd75d87d86120c1a288707c493835806e52e25b5b4b75b979 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T09:49:36.591 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:36 smithi135 podman[101594]: 2024-09-10 09:49:36.572721045 +0000 UTC m=+0.722829858 container cleanup 1ce9e84003d6f14cd75d87d86120c1a288707c493835806e52e25b5b4b75b979 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:49:36.591 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:36 smithi135 bash[101594]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135 2024-09-10T09:49:37.026 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi135.service' 2024-09-10T09:49:37.049 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:36 smithi135 podman[101608]: 2024-09-10 09:49:36.866188541 +0000 UTC m=+0.743569385 container remove 1ce9e84003d6f14cd75d87d86120c1a288707c493835806e52e25b5b4b75b979 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-mon-smithi135, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T09:49:37.049 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:37 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi135.service: Deactivated successfully. 2024-09-10T09:49:37.050 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:37 smithi135 systemd[1]: Stopped Ceph mon.smithi135 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:49:37.050 INFO:journalctl@ceph.mon.smithi135.smithi135.stdout:Sep 10 09:49:37 smithi135 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@mon.smithi135.service: Consumed 5.119s CPU time. 2024-09-10T09:49:37.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:49:37.079 INFO:tasks.cephadm.mon.smithi135:Stopped mon.smithi135 2024-09-10T09:49:37.079 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T09:49:37.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.0 2024-09-10T09:49:37.385 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:37 smithi079 systemd[1]: Stopping Ceph osd.0 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:49:37.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:37 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[98739]: 2024-09-10T09:49:37.384+0000 7f75be83e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:49:37.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:37 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[98739]: 2024-09-10T09:49:37.384+0000 7f75be83e640 -1 osd.0 86 *** Got signal Terminated *** 2024-09-10T09:49:37.712 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:37 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0[98739]: 2024-09-10T09:49:37.384+0000 7f75be83e640 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:49:43.211 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:42 smithi079 podman[134776]: 2024-09-10 09:49:42.944659332 +0000 UTC m=+5.671517315 container died b909b443d0eb8d5fef858b6993c7d053d8971d8c581e457ed33f1d43627b5b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T09:49:43.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:43 smithi079 podman[134776]: 2024-09-10 09:49:43.518244922 +0000 UTC m=+6.245102902 container cleanup b909b443d0eb8d5fef858b6993c7d053d8971d8c581e457ed33f1d43627b5b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T09:49:43.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:43 smithi079 bash[134776]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0 2024-09-10T09:49:44.190 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:43 smithi079 podman[134794]: 2024-09-10 09:49:43.83671233 +0000 UTC m=+0.886060003 container remove b909b443d0eb8d5fef858b6993c7d053d8971d8c581e457ed33f1d43627b5b79 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T09:49:44.457 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:44 smithi079 podman[134882]: 2024-09-10 09:49:44.092501899 +0000 UTC m=+0.015796014 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:49:44.457 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:44 smithi079 podman[134882]: 2024-09-10 09:49:44.204120515 +0000 UTC m=+0.127414622 container create 722b14f2cc10f8dc7b8eef51beedea1164a59378761bcb5e8aa92edf21f79910 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T09:49:44.457 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:44 smithi079 podman[134882]: 2024-09-10 09:49:44.457111535 +0000 UTC m=+0.380405649 container init 722b14f2cc10f8dc7b8eef51beedea1164a59378761bcb5e8aa92edf21f79910 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T09:49:44.711 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:44 smithi079 podman[134882]: 2024-09-10 09:49:44.460884269 +0000 UTC m=+0.384178377 container start 722b14f2cc10f8dc7b8eef51beedea1164a59378761bcb5e8aa92edf21f79910 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T09:49:44.712 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:44 smithi079 podman[134882]: 2024-09-10 09:49:44.548590068 +0000 UTC m=+0.471884194 container attach 722b14f2cc10f8dc7b8eef51beedea1164a59378761bcb5e8aa92edf21f79910 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:49:44.712 INFO:journalctl@ceph.osd.0.smithi079.stdout:Sep 10 09:49:44 smithi079 podman[134882]: 2024-09-10 09:49:44.645852397 +0000 UTC m=+0.569146505 container died 722b14f2cc10f8dc7b8eef51beedea1164a59378761bcb5e8aa92edf21f79910 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T09:49:45.338 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T09:49:45.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:49:45.377 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T09:49:45.377 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T09:49:45.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.1 2024-09-10T09:49:45.707 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:45 smithi079 systemd[1]: Stopping Ceph osd.1 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:49:45.961 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:45 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[104285]: 2024-09-10T09:49:45.705+0000 7fb2f7714640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:49:45.961 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:45 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[104285]: 2024-09-10T09:49:45.705+0000 7fb2f7714640 -1 osd.1 86 *** Got signal Terminated *** 2024-09-10T09:49:45.961 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:45 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1[104285]: 2024-09-10T09:49:45.705+0000 7fb2f7714640 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:49:51.533 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:51 smithi079 podman[134982]: 2024-09-10 09:49:51.250577305 +0000 UTC m=+5.654117403 container died 032a78efcc7cbeb97bf0f4bcc574ce2e11b944c22940298c8150edbab672652e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T09:49:51.898 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:51 smithi079 podman[134982]: 2024-09-10 09:49:51.613380954 +0000 UTC m=+6.016921039 container cleanup 032a78efcc7cbeb97bf0f4bcc574ce2e11b944c22940298c8150edbab672652e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T09:49:51.898 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:51 smithi079 bash[134982]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1 2024-09-10T09:49:52.211 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:51 smithi079 podman[134998]: 2024-09-10 09:49:51.897981493 +0000 UTC m=+0.641778676 container remove 032a78efcc7cbeb97bf0f4bcc574ce2e11b944c22940298c8150edbab672652e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T09:49:52.480 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:52 smithi079 podman[135086]: 2024-09-10 09:49:52.130104368 +0000 UTC m=+0.015441495 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:49:52.573 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:52 smithi079 podman[135086]: 2024-09-10 09:49:52.240873798 +0000 UTC m=+0.126210954 container create e0b7eba5f13f79f04b4c749bb63818c026ae3e6ef49e420807d5d26d2568e0d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T09:49:52.573 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:52 smithi079 podman[135086]: 2024-09-10 09:49:52.476663513 +0000 UTC m=+0.362000627 container init e0b7eba5f13f79f04b4c749bb63818c026ae3e6ef49e420807d5d26d2568e0d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-10T09:49:52.573 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:52 smithi079 podman[135086]: 2024-09-10 09:49:52.479880923 +0000 UTC m=+0.365218041 container start e0b7eba5f13f79f04b4c749bb63818c026ae3e6ef49e420807d5d26d2568e0d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T09:49:52.947 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:52 smithi079 podman[135086]: 2024-09-10 09:49:52.568469066 +0000 UTC m=+0.453806188 container attach e0b7eba5f13f79f04b4c749bb63818c026ae3e6ef49e420807d5d26d2568e0d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T09:49:52.947 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 10 09:49:52 smithi079 podman[135086]: 2024-09-10 09:49:52.666803446 +0000 UTC m=+0.552140571 container died e0b7eba5f13f79f04b4c749bb63818c026ae3e6ef49e420807d5d26d2568e0d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:49:53.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T09:49:53.389 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:49:53.389 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T09:49:53.390 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T09:49:53.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.2 2024-09-10T09:49:53.611 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:53 smithi079 systemd[1]: Stopping Ceph osd.2 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:49:53.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[110153]: 2024-09-10T09:49:53.741+0000 7ff6d4b20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:49:53.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[110153]: 2024-09-10T09:49:53.741+0000 7ff6d4b20640 -1 osd.2 86 *** Got signal Terminated *** 2024-09-10T09:49:53.961 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:53 smithi079 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2[110153]: 2024-09-10T09:49:53.741+0000 7ff6d4b20640 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:49:59.461 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:59 smithi079 podman[135189]: 2024-09-10 09:49:59.205260164 +0000 UTC m=+5.586132467 container died 5d91d18346d9fc99d9c8029f0ea4665e547b5981750896f5759a7406dcc57c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T09:49:59.944 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:59 smithi079 podman[135189]: 2024-09-10 09:49:59.726095823 +0000 UTC m=+6.106968124 container cleanup 5d91d18346d9fc99d9c8029f0ea4665e547b5981750896f5759a7406dcc57c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T09:49:59.945 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:59 smithi079 bash[135189]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2 2024-09-10T09:50:00.211 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:49:59 smithi079 podman[135215]: 2024-09-10 09:49:59.9442869 +0000 UTC m=+0.736545879 container remove 5d91d18346d9fc99d9c8029f0ea4665e547b5981750896f5759a7406dcc57c48 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T09:50:00.589 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:00 smithi079 podman[135303]: 2024-09-10 09:50:00.241896605 +0000 UTC m=+0.016200045 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:50:00.590 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:00 smithi079 podman[135303]: 2024-09-10 09:50:00.36204609 +0000 UTC m=+0.136349551 container create 29a862c4c04f5b3a4c199ee9d58adf98efa2a3e86ea8a1d88a1c46db23011d84 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T09:50:00.590 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:00 smithi079 podman[135303]: 2024-09-10 09:50:00.589363362 +0000 UTC m=+0.363666782 container init 29a862c4c04f5b3a4c199ee9d58adf98efa2a3e86ea8a1d88a1c46db23011d84 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD) 2024-09-10T09:50:00.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:00 smithi079 podman[135303]: 2024-09-10 09:50:00.592666602 +0000 UTC m=+0.366970026 container start 29a862c4c04f5b3a4c199ee9d58adf98efa2a3e86ea8a1d88a1c46db23011d84 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T09:50:00.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:00 smithi079 podman[135303]: 2024-09-10 09:50:00.714887733 +0000 UTC m=+0.489191167 container attach 29a862c4c04f5b3a4c199ee9d58adf98efa2a3e86ea8a1d88a1c46db23011d84 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T09:50:00.962 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:00 smithi079 podman[135303]: 2024-09-10 09:50:00.77744103 +0000 UTC m=+0.551744463 container died 29a862c4c04f5b3a4c199ee9d58adf98efa2a3e86ea8a1d88a1c46db23011d84 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T09:50:01.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T09:50:01.320 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:01 smithi079 podman[135328]: 2024-09-10 09:50:01.276491439 +0000 UTC m=+0.493219347 container remove 29a862c4c04f5b3a4c199ee9d58adf98efa2a3e86ea8a1d88a1c46db23011d84 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T09:50:01.320 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:01 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-10T09:50:01.321 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:01 smithi079 systemd[1]: Stopped Ceph osd.2 for afb60aa6-6f56-11ef-bcea-c7b262605968. 2024-09-10T09:50:01.321 INFO:journalctl@ceph.osd.2.smithi079.stdout:Sep 10 09:50:01 smithi079 systemd[1]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.2.service: Consumed 7.812s CPU time. 2024-09-10T09:50:01.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:50:01.336 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T09:50:01.336 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T09:50:01.336 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.3 2024-09-10T09:50:01.627 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:01 smithi135 systemd[1]: Stopping Ceph osd.3 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:50:01.967 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:01 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:50:01.626+0000 7f4cced74640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:50:01.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:01 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:50:01.626+0000 7f4cced74640 -1 osd.3 86 *** Got signal Terminated *** 2024-09-10T09:50:01.968 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:01 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:50:01.626+0000 7f4cced74640 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:50:03.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:03 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:03.600+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:04.717 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:04 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:04.580+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:04.718 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:04 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:50:04.444+0000 7f4ccb379640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:41.200400+0000 front 2024-09-10T09:49:41.200494+0000 (oldest deadline 2024-09-10T09:50:03.500262+0000) 2024-09-10T09:50:05.694 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:05 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:50:05.423+0000 7f4ccb379640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:41.200400+0000 front 2024-09-10T09:49:41.200494+0000 (oldest deadline 2024-09-10T09:50:03.500262+0000) 2024-09-10T09:50:05.694 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:05 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:05.601+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:06.584 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:06 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3[74838]: 2024-09-10T09:50:06.429+0000 7f4ccb379640 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:41.200400+0000 front 2024-09-10T09:49:41.200494+0000 (oldest deadline 2024-09-10T09:50:03.500262+0000) 2024-09-10T09:50:06.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:06 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:06.625+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:06.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:06 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:06.584+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:07.319 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:07 smithi135 podman[101743]: 2024-09-10 09:50:07.044759466 +0000 UTC m=+5.514770007 container died 8c3025b323fcd167c70f2160a56aaab4c09c7653c44eef4cfdf32ce3571608bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T09:50:07.642 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:07 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:07.558+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:07.642 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:07 smithi135 podman[101743]: 2024-09-10 09:50:07.485140095 +0000 UTC m=+5.955150682 container cleanup 8c3025b323fcd167c70f2160a56aaab4c09c7653c44eef4cfdf32ce3571608bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T09:50:07.642 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:07 smithi135 bash[101743]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3 2024-09-10T09:50:07.967 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:07 smithi135 podman[101759]: 2024-09-10 09:50:07.689127667 +0000 UTC m=+0.640290745 container remove 8c3025b323fcd167c70f2160a56aaab4c09c7653c44eef4cfdf32ce3571608bc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T09:50:07.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:07 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:07.640+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:08.390 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:08 smithi135 podman[101849]: 2024-09-10 09:50:08.000086509 +0000 UTC m=+0.016018235 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:50:08.390 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:08 smithi135 podman[101849]: 2024-09-10 09:50:08.104003809 +0000 UTC m=+0.119935524 container create bb910faadcbcb108bdd240137cc1e740e0f8f4ccfaf4834347ab442a70ccf2dc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T09:50:08.390 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:08 smithi135 podman[101849]: 2024-09-10 09:50:08.306318307 +0000 UTC m=+0.322250022 container init bb910faadcbcb108bdd240137cc1e740e0f8f4ccfaf4834347ab442a70ccf2dc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T09:50:08.390 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:08 smithi135 podman[101849]: 2024-09-10 09:50:08.309973117 +0000 UTC m=+0.325904838 container start bb910faadcbcb108bdd240137cc1e740e0f8f4ccfaf4834347ab442a70ccf2dc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-10T09:50:08.390 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:08 smithi135 podman[101849]: 2024-09-10 09:50:08.389606244 +0000 UTC m=+0.405537969 container attach bb910faadcbcb108bdd240137cc1e740e0f8f4ccfaf4834347ab442a70ccf2dc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T09:50:08.643 INFO:journalctl@ceph.osd.3.smithi135.stdout:Sep 10 09:50:08 smithi135 podman[101849]: 2024-09-10 09:50:08.501898901 +0000 UTC m=+0.517830621 container died bb910faadcbcb108bdd240137cc1e740e0f8f4ccfaf4834347ab442a70ccf2dc (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T09:50:08.643 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:08 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:08.564+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:08.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:08 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:08.641+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:09.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T09:50:09.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:50:09.193 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T09:50:09.194 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T09:50:09.194 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.4 2024-09-10T09:50:09.417 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:09 smithi135 systemd[1]: Stopping Ceph osd.4 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:50:09.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:09 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:09.658+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:09.718 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:09 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:09.546+0000 7f97af880640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:50:09.718 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:09 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:09.546+0000 7f97af880640 -1 osd.4 86 *** Got signal Terminated *** 2024-09-10T09:50:09.718 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:09 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:09.546+0000 7f97af880640 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:50:09.718 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:09 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:09.586+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:10.650 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:10 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:10.556+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:10.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:10 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:10.649+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:11.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:11 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:11.631+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:11.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:11 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:11.596+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:11.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:11 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:11.596+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:45.571066+0000 front 2024-09-10T09:49:45.571087+0000 (oldest deadline 2024-09-10T09:50:11.471146+0000) 2024-09-10T09:50:12.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:12 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:12.646+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:12.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:12 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:12.581+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:12.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:12 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:12.581+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:45.571066+0000 front 2024-09-10T09:49:45.571087+0000 (oldest deadline 2024-09-10T09:50:11.471146+0000) 2024-09-10T09:50:13.967 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:13.601+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.370427+0000 front 2024-09-10T09:49:40.370333+0000 (oldest deadline 2024-09-10T09:50:05.570632+0000) 2024-09-10T09:50:13.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4[80200]: 2024-09-10T09:50:13.601+0000 7f97a7e7d640 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:45.571066+0000 front 2024-09-10T09:49:45.571087+0000 (oldest deadline 2024-09-10T09:50:11.471146+0000) 2024-09-10T09:50:13.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:13.680+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:13.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:13 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:13.680+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:14.968 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:14 smithi135 podman[101952]: 2024-09-10 09:50:14.887548061 +0000 UTC m=+5.458474400 container died 05ee4cd92ec305501199edd55cbc4703453e2754e7b4dac1965ee12d427dcd65 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T09:50:14.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:14 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:14.664+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:14.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:14 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:14.664+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:15.406 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:15 smithi135 podman[101952]: 2024-09-10 09:50:15.229910763 +0000 UTC m=+5.800837091 container cleanup 05ee4cd92ec305501199edd55cbc4703453e2754e7b4dac1965ee12d427dcd65 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T09:50:15.406 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:15 smithi135 bash[101952]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4 2024-09-10T09:50:15.717 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:15 smithi135 podman[101978]: 2024-09-10 09:50:15.406099824 +0000 UTC m=+0.516886521 container remove 05ee4cd92ec305501199edd55cbc4703453e2754e7b4dac1965ee12d427dcd65 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2) 2024-09-10T09:50:15.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:15 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:15.623+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:15.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:15 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:15.623+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:16.160 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:15 smithi135 podman[102068]: 2024-09-10 09:50:15.743205773 +0000 UTC m=+0.016205936 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:50:16.160 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:15 smithi135 podman[102068]: 2024-09-10 09:50:15.857329173 +0000 UTC m=+0.130329321 container create bf08428283858644a902aed2f38036c99523e307a6da14a1e3b2e1ee4bbb57ff (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:50:16.160 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:16 smithi135 podman[102068]: 2024-09-10 09:50:16.08545972 +0000 UTC m=+0.358459881 container init bf08428283858644a902aed2f38036c99523e307a6da14a1e3b2e1ee4bbb57ff (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T09:50:16.160 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:16 smithi135 podman[102068]: 2024-09-10 09:50:16.089005821 +0000 UTC m=+0.362005980 container start bf08428283858644a902aed2f38036c99523e307a6da14a1e3b2e1ee4bbb57ff (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T09:50:16.160 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:16 smithi135 podman[102068]: 2024-09-10 09:50:16.159676465 +0000 UTC m=+0.432676820 container attach bf08428283858644a902aed2f38036c99523e307a6da14a1e3b2e1ee4bbb57ff (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T09:50:16.467 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 09:50:16 smithi135 podman[102068]: 2024-09-10 09:50:16.278922537 +0000 UTC m=+0.551922696 container died bf08428283858644a902aed2f38036c99523e307a6da14a1e3b2e1ee4bbb57ff (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T09:50:16.846 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:16 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:16.589+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:16.847 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:16 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:16.589+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:16.865 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T09:50:16.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:50:16.903 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T09:50:16.903 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T09:50:16.903 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.5 2024-09-10T09:50:17.216 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:16 smithi135 systemd[1]: Stopping Ceph osd.5 for afb60aa6-6f56-11ef-bcea-c7b262605968... 2024-09-10T09:50:17.467 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:17 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:17.215+0000 7f104f692640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T09:50:17.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:17 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:17.215+0000 7f104f692640 -1 osd.5 86 *** Got signal Terminated *** 2024-09-10T09:50:17.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:17 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:17.215+0000 7f104f692640 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T09:50:17.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:17 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:17.612+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:17.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:17 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:17.612+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:18.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:18 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:18.573+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:18.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:18 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:18.573+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:19.886 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:19 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:19.560+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:19.886 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:19 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:19.560+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:20.717 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:20 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:20.602+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:20.717 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:20 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:20.602+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:20.718 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:20 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:20.602+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6822 osd.2 since back 2024-09-10T09:49:57.788525+0000 front 2024-09-10T09:49:57.788494+0000 (oldest deadline 2024-09-10T09:50:20.088322+0000) 2024-09-10T09:50:21.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:21 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:21.624+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6806 osd.0 since back 2024-09-10T09:49:40.286343+0000 front 2024-09-10T09:49:40.286216+0000 (oldest deadline 2024-09-10T09:50:03.086676+0000) 2024-09-10T09:50:21.967 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:21 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:21.624+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2024-09-10T09:49:48.387537+0000 front 2024-09-10T09:49:48.387615+0000 (oldest deadline 2024-09-10T09:50:13.087528+0000) 2024-09-10T09:50:21.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:21 smithi135 ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5[85274]: 2024-09-10T09:50:21.624+0000 7f104bc97640 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.79:6822 osd.2 since back 2024-09-10T09:49:57.788525+0000 front 2024-09-10T09:49:57.788494+0000 (oldest deadline 2024-09-10T09:50:20.088322+0000) 2024-09-10T09:50:22.968 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:22 smithi135 podman[102168]: 2024-09-10 09:50:22.703648437 +0000 UTC m=+5.582908693 container died e48bce7b2061b7b5d4da1e04cf0e425abde08b31afc851feeb1a543f3a601d93 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T09:50:23.467 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 podman[102168]: 2024-09-10 09:50:23.049047745 +0000 UTC m=+5.928308001 container cleanup e48bce7b2061b7b5d4da1e04cf0e425abde08b31afc851feeb1a543f3a601d93 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T09:50:23.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 bash[102168]: ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5 2024-09-10T09:50:23.468 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 podman[102183]: 2024-09-10 09:50:23.225295 +0000 UTC m=+0.516077286 container remove e48bce7b2061b7b5d4da1e04cf0e425abde08b31afc851feeb1a543f3a601d93 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T09:50:23.953 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 podman[102277]: 2024-09-10 09:50:23.560099418 +0000 UTC m=+0.016142233 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T09:50:23.954 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 podman[102277]: 2024-09-10 09:50:23.659245637 +0000 UTC m=+0.115288435 container create eb2f99bb9006e517806cfb6398172e98f1c750011dc8e85a56db633773392793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T09:50:23.954 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 podman[102277]: 2024-09-10 09:50:23.861569093 +0000 UTC m=+0.317611893 container init eb2f99bb9006e517806cfb6398172e98f1c750011dc8e85a56db633773392793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T09:50:23.954 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 podman[102277]: 2024-09-10 09:50:23.864847241 +0000 UTC m=+0.320890042 container start eb2f99bb9006e517806cfb6398172e98f1c750011dc8e85a56db633773392793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T09:50:23.954 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:23 smithi135 podman[102277]: 2024-09-10 09:50:23.95323397 +0000 UTC m=+0.409276788 container attach eb2f99bb9006e517806cfb6398172e98f1c750011dc8e85a56db633773392793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T09:50:24.217 INFO:journalctl@ceph.osd.5.smithi135.stdout:Sep 10 09:50:24 smithi135 podman[102277]: 2024-09-10 09:50:24.049413295 +0000 UTC m=+0.505456104 container died eb2f99bb9006e517806cfb6398172e98f1c750011dc8e85a56db633773392793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-afb60aa6-6f56-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-10T09:50:24.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-afb60aa6-6f56-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T09:50:24.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T09:50:24.723 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T09:50:24.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T09:50:24.875 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:50:48.123 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T09:50:48.275 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:51:04.164 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:51:04.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T09:51:04.225 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T09:51:04.227 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975/remote/smithi079/crash 2024-09-10T09:51:04.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/crash -- . 2024-09-10T09:51:04.266 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T09:51:04.266 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2024-09-10T09:51:04.268 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975/remote/smithi135/crash 2024-09-10T09:51:04.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/crash -- . 2024-09-10T09:51:04.292 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T09:51:04.292 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-09-10T09:51:04.293 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T09:51:04.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T09:51:04.346 INFO:tasks.cephadm:Compressing logs... 2024-09-10T09:51:04.346 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T09:51:04.389 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T09:51:04.413 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T09:51:04.413 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T09:51:04.413 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T09:51:04.414 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T09:51:04.414 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T09:51:04.416 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T09:51:04.417 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi079.pqgxjw.log 2024-09-10T09:51:04.417 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T09:51:04.417 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi079.pqgxjw.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.log 2024-09-10T09:51:04.417 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.2.log: 86.0%gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi079.wpfdzn.log 2024-09-10T09:51:04.417 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T09:51:04.417 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi079.log 2024-09-10T09:51:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi079.wpfdzn.log: 91.4% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T09:51:04.420 INFO:teuthology.orchestra.run.smithi079.stderr: 88.1% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T09:51:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mgr.smithi079.mhirny.log 2024-09-10T09:51:04.420 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi079.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mon.smithi079.log 2024-09-10T09:51:04.422 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mgr.smithi079.mhirny.log: 94.1% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi079.log.gz 2024-09-10T09:51:04.423 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T09:51:04.430 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-09-10T09:51:04.430 INFO:teuthology.orchestra.run.smithi135.stderr: /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mgr.smithi135.lbhjof.log 2024-09-10T09:51:04.430 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi135.lvmrsq.log 2024-09-10T09:51:04.430 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi135.log 2024-09-10T09:51:04.430 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mgr.smithi135.lbhjof.log: /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi135.lvmrsq.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T09:51:04.430 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi135.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T09:51:04.430 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mon.smithi135.log 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mon.smithi135.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.log 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr: 94.1% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-client.ceph-exporter.smithi135.log.gz 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.3.log/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.5.log: 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi135.oqqtlp.log 2024-09-10T09:51:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T09:51:04.432 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mon.smithi079.log: 91.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T09:51:04.455 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/cephadm.log: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T09:51:04.516 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi135.oqqtlp.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T09:51:04.524 INFO:teuthology.orchestra.run.smithi135.stderr: 88.1% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T09:51:04.525 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T09:51:04.596 INFO:teuthology.orchestra.run.smithi135.stderr: 86.0% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T09:51:04.697 INFO:teuthology.orchestra.run.smithi079.stderr: 88.7% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mgr.smithi079.mhirny.log.gz 2024-09-10T09:51:04.955 INFO:teuthology.orchestra.run.smithi135.stderr: 91.4% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T09:51:05.294 INFO:teuthology.orchestra.run.smithi079.stderr: 90.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mon.smithi079.log.gz 2024-09-10T09:51:05.318 INFO:teuthology.orchestra.run.smithi135.stderr: 89.0% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mgr.smithi135.lbhjof.log.gz 2024-09-10T09:51:05.630 INFO:teuthology.orchestra.run.smithi135.stderr: 92.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mon.smithi135.log.gz 2024-09-10T09:51:09.167 INFO:teuthology.orchestra.run.smithi079.stderr: 93.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T09:51:09.896 INFO:teuthology.orchestra.run.smithi135.stderr: 94.9% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi135.oqqtlp.log.gz 2024-09-10T09:51:10.132 INFO:teuthology.orchestra.run.smithi079.stderr: 94.8% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi079.pqgxjw.log.gz 2024-09-10T09:51:10.671 INFO:teuthology.orchestra.run.smithi079.stderr: 93.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T09:51:11.225 INFO:teuthology.orchestra.run.smithi079.stderr: 93.5% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T09:51:11.640 INFO:teuthology.orchestra.run.smithi135.stderr: 93.5% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T09:51:17.760 INFO:teuthology.orchestra.run.smithi135.stderr: 93.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T09:51:17.873 INFO:teuthology.orchestra.run.smithi135.stderr: 93.6% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T09:51:18.404 INFO:teuthology.orchestra.run.smithi079.stderr: 95.0% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi079.wpfdzn.log.gz 2024-09-10T09:51:18.406 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-10T09:51:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m14.004s 2024-09-10T09:51:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m37.330s 2024-09-10T09:51:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m1.342s 2024-09-10T09:52:41.041 INFO:teuthology.orchestra.run.smithi135.stderr: 92.5% -- replaced with /var/log/ceph/afb60aa6-6f56-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi135.lvmrsq.log.gz 2024-09-10T09:52:41.043 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-10T09:52:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:real 1m36.639s 2024-09-10T09:52:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:user 1m46.446s 2024-09-10T09:52:41.043 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m3.840s 2024-09-10T09:52:41.044 INFO:tasks.cephadm:Archiving logs... 2024-09-10T09:52:41.045 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975/remote/smithi079/log 2024-09-10T09:52:41.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T09:52:45.520 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975/remote/smithi135/log 2024-09-10T09:52:45.521 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T09:53:02.226 INFO:tasks.cephadm:Removing cluster... 2024-09-10T09:53:02.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 --force 2024-09-10T09:53:02.379 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:53:02.709 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid afb60aa6-6f56-11ef-bcea-c7b262605968 --force 2024-09-10T09:53:02.862 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: afb60aa6-6f56-11ef-bcea-c7b262605968 2024-09-10T09:53:03.262 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T09:53:03.262 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T09:53:03.279 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T09:53:03.294 INFO:tasks.cephadm:Teardown complete 2024-09-10T09:53:03.295 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T09:53:03.312 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T09:53:03.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T09:53:03.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T09:53:03.424 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T09:53:03.435 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T09:53:03.436 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:53:03.438 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T09:53:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:53:03.457 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 -82us[ -66us] +/- 52ms 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 +843us[ +843us] +/- 75ms 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -731us[ -731us] +/- 75ms 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 65 -71us[ -67us] +/- 52ms 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 +832us[ +832us] +/- 75ms 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -731us[ -731us] +/- 75ms 2024-09-10T09:53:03.459 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T09:53:03.460 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T09:53:03.472 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T09:53:03.473 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T09:53:03.485 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T09:53:03.581 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T09:53:03.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:53:03.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:53:03.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T09:53:03.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:53:03.786 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T09:53:03.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T09:53:03.808 INFO:teuthology.task.internal:Duration was 1976.301730 seconds 2024-09-10T09:53:03.808 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T09:53:03.822 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T09:53:03.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T09:53:03.825 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T09:53:03.861 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:53:03.887 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T09:53:04.274 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T09:53:04.275 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-10T09:53:04.275 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T09:53:04.313 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-10T09:53:04.314 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T09:53:04.343 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T09:53:04.344 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T09:53:04.359 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T09:53:04.410 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T09:53:04.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T09:53:04.425 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T09:53:05.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T09:53:05.139 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T09:53:05.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T09:53:05.165 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T09:53:05.212 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T09:53:05.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:53:05.227 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:53:05.248 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-10T09:53:05.259 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-10T09:53:05.272 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:53:05.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:53:05.317 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T09:53:05.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T09:53:05.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T09:53:05.344 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T09:53:05.346 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975/remote/smithi079 2024-09-10T09:53:05.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T09:53:05.408 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898975/remote/smithi135 2024-09-10T09:53:05.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T09:53:05.447 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T09:53:05.448 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T09:53:05.450 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T09:53:05.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T09:53:05.509 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T09:53:05.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T09:53:05.524 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T09:53:05.524 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T09:53:05.527 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T09:53:05.539 INFO:teuthology.orchestra.run.smithi079.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 09:53 /home/ubuntu/cephtest 2024-09-10T09:53:05.552 INFO:teuthology.orchestra.run.smithi135.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 09:53 /home/ubuntu/cephtest 2024-09-10T09:53:05.553 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T09:53:05.565 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T09:53:05.603 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1976.3017299175262 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T09:53:05.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T09:53:05.683 INFO:teuthology.run:pass